User-centered evaluation of adaptive and adaptable systems: a literature review.
Van Velsen, L., Van der Geest, Th., Klaassen, R. & Steehouder, M. (2008). User-centered evaluation of adaptive and adaptable systems: A literature review. Knowledge Engineering Review, 23 (03), 261-281.
This literature review focuses on user-centered evaluation studies of adaptive and adaptable systems. Usability, perceived usefulness and appropriateness of adaptation are the three variables assessed most. Questionnaires appeared to be the most popular method, followed by interviews and data log analysis. The quality of used questionnaires is troublesome and reporting of interviews and think-aloud protocols was found to be shallow. Furthermore, we found a need for triangulation when analyzing data logs. The article provides a concept of an iterative design process for adaptive and adaptable systems, linked to the goal a user-centered evaluation can serve: supporting decisions, problem detection or the verification of quality. In this concept, variables to be assessed at each stage of the process and methods to assess them with are summarized.
terug naar publicaties / back to publications