CS-E5210 - Usability evaluation, 26.02.2019-14.05.2019

Topic outline

• Exam questions
  
  

  Following is the list of questions that covers all the lectures delivered in the course. Please prepare all the listed questions thoroughly. In exams, you will get only 3 questions from the following list to answer. Good Luck!
  

  
  

  • How does methodological triangulation improve validity of a usability study?
  • What are the strengths and weaknesses of the heuristic evaluation method?
  • What way would you decide which set of usability heuristics you would use in an evaluation of a product’s usability?
  • Describe three different methods that can be used to measure effectiveness.
  • Describe three different methods that can be used to measure efficiency.
  • Describe three different methods that can be used to measure satisfaction.
  • What are the pros and cons of a narrow research question?
  • Describe three ways with which you can help the usability study participant act naturally in a lab setting.
  • Let’s imagine that you will be evaluating the standard mobile-based SMS editor. Invent three different research questions (one open-ended, one close-ended, and one yes/no question) that a heuristic evaluation could address. For each research question, explain the reason why it would be considered a good question.
  • Let’s image that you will be evaluating the standard mobile-based SMS editor. Invent three different research questions (one open-ended, one close-ended, and one yes/no question) that an empirical usability evaluation could address. For each research question, explain the reason why it would be considered a good question.
  • Present three different biases / validity threats in usability tests with users and how they can be overcome.
  • Why are scenarios so important in both walkthroughs and empirical usability evaluations?
  • Develop a brief scenario that can presented to the users to test the usability of a social map application.
  • How can be usability problems related to the gulf of evaluation be studied?
  • How can be usability problems related to the gulf of execution be studied?
  • It is better to carry out the expert evaluation first and only after that the empirical evaluation. Why?
  • Using the concepts of reliability and/or validity, explain why it is a good idea that a heuristic evaluation is carried out by 3–5 evaluators.
  • What is think aloud protocol? How is it applied within the context of usability testing?
  • Consider a heart rate monitoring machine installed in a hospital. Briefly describe three critical aspects of usability from the perspective of nursing staff and patients. Explain why you identified these aspects in particular.
  • List down any three Nielsen's usability heuristics, and briefly explain each of them with an example.
  • What would be your sampling (recruitment) strategy if you intend to test a newly designed ATM?