Measuring the response bias induced by an experience and application research center

B. de Ruyter, R. van Geel, P. Markopoulos

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    Abstract

    In recent years we have observed the rise of Experience and Application Research centers (EARC). These EARCs simulate realistic environments and are used for the empirical evaluation of interactive systems in a controlled setting. Such laboratory environments are intended to facilitate data collection without influencing the data itself. Accumulated experience in the use of EARCs has raised concerns that test participants could be impressed by the environments and have raised expectations for advanced systems they expect to encounter; this brings about the danger of systematic bias in subjective report data collected with EARCs. To evaluate the impact of an EARC as an instrument, a controlled experiment with 40 test participants was conducted. This experiment involved the replication of a traditional usability test in both the EARC and a traditional laboratory environment. The results of this study provide evidence regarding the validity and reliability of EARCs as instruments for evaluating interactive systems.
    Original languageEnglish
    Title of host publicationAmbient Intelligence
    Subtitle of host publicationEuropean Conference, AmI 2009, Salzburg, Austria, November 18-21, 2009. Proceedings
    EditorsM. Tscheligi , B. de Ruyter, P. Markopoulos, R. Wichert, T. Mirlacher, A. Meschterjakov , W. Reitberger
    Place of PublicationDordrecht
    PublisherSpringer
    Pages235-244
    ISBN (Print)978-3-642-05408-2
    DOIs
    Publication statusPublished - 2009
    Eventconference; AmI 2009, Salzburg, Austria; 2009-11-18; 2009-11-21 -
    Duration: 18 Nov 200921 Nov 2009

    Publication series

    NameLNCS
    Volume5859

    Conference

    Conferenceconference; AmI 2009, Salzburg, Austria; 2009-11-18; 2009-11-21
    Period18/11/0921/11/09
    OtherAmI 2009, Salzburg, Austria

    Fingerprint

    Dive into the research topics of 'Measuring the response bias induced by an experience and application research center'. Together they form a unique fingerprint.

    Cite this