Skip to content

Class 06: Model Evaluation

Hunter Zhang edited this page Jun 26, 2023 · 1 revision

Previous class

Video

PPT

[2023-06-25] Evaluation of Recommenders.pptx

Homework

Each group writes a report (less than 2 pages) to describe how you are going to evaluate your model. The report must include:

  1. Offline evaluation: What are the metrics? How do you split train and test data? You must complete the offline evaluation and present the result during the final presentation.
  2. User study (optional): Who are your subjects? How do you run the experiment? What data do you want to collect? What are the metrics?
  3. Online evaluation: What are the metrics? How to collect the data? You don't need to do the online evaluation in this project, but you should learn how to do it theoretically.