CMSC 198G - Spring 2008
Prof Guimbretiere

Introduction to Human-Computer Interaction
Home Contact Syllabus Schedule HW & Project Links

Homework #8: Evaluation
(Due 05/01/08)

1) (10 points) Cognitive walk though

Describe the key steps of a cognitive walk through.

2) (30 points) Design heuristics

  1. (10 points) Describe the key steps one should follow while performing a Neilsen's heuristic evaluations. Why is it the case that only 3-5 experts are needed for this kind of evaluation.
  2. (20 points) Pick two of Neilsen's heuristics of your choice. For each heuristic, write a short paragraph describing this heuristic, and using your own examples (examples used in class will not be accepted) describe one interface which successfully implement this heuristic and one interface which fail to implement this heuristic.

3) (60 points) Direct observation technique

Before hiring you as a HCI consultant, a users experience consulting firm is asking you to produce a detailled description of a usability test designed to compare users experience buying digital music on amazon.com and apple.com. They specifically requested a "thinking aloud" design lasting less than one hour. Your description should include (be sure to explain all your answers):

  1. (10 Points) A general description of the main goal of your evaluation and the different steps required to design a successful experiment;
  2. (10 points) A description of the demographics you will target, why you think this is the right demographics and how you will proceed to recruit participants in that group;
  3. (10 Points) A description of the task(s) you will use during your experiments and the reason behind your choice of task(s);
  4. (10 points) The actual check list you will use during the experiment. For each item in the check list, provide an estimate of the time it will take to perform this items (please be sure to justify how you came up with your estimates);
  5. (10 points) A description of how you will conduct the interview, including the physical setting you will use, and the moderating techniques you will use;
  6. (10 points) A description of the key questions you will ask during the debriefing process, and why you think they are important questions;