This paper addresses the issue of usability testing in a component-based software engineering environment, specifically measuring the usability of different versions of a component in a more powerful manner than other, more holistic, usability methods. Three component-specific usability measures are presented: an objective performance measure, a perceived ease-of-use measure, and a satisfaction measure. The objective performance measure is derived from the message exchange between components recorded in a log file, whereas the other measures are obtained through a questionnaire. The power of the measures was studied in an experimental setting. Eight different prototypes of a mobile telephone were subjected to usability tests, in which 80 subjects participated. Analyses of the statistical power of these measures show that the component-specific performance measure can be more powerful than overall usability measures, which means fewer users are needed in a test.
|Title of host publication||Engineering Human Computer Interaction and Interactive Systems: Joint Working Conferences EHCI-DSVIS 2004|
|Editors||R. Bastide, P. Palanque, J. Roth|
|Place of Publication||Berlin|
|Publication status||Published - 2005|
|Name||Lecture Notes in Computer Science|
Brinkman, W. P., Haakma, R., & Bouwhuis, D. G. (2005). Empirical usability testing in a component-based environment : improving test efficiency with component-specific usability measures. In R. Bastide, P. Palanque, & J. Roth (Eds.), Engineering Human Computer Interaction and Interactive Systems: Joint Working Conferences EHCI-DSVIS 2004 (pp. 20-37). (Lecture Notes in Computer Science; Vol. 3425). Berlin: Springer. https://doi.org/10.1007/11431879_2