Using video prototypes for evaluating design concepts with users : a comparison to usability testing

M.J. Zwinderman, R.A. Leenheer, A. Shirzad, N. Chupriyanov, G. Veugen, Biyong Zhang, P. Markopoulos

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

4 Citations (Scopus)

Abstract

We present an exploratory study that compared user feedback obtained from evaluating a mobile application versus a reverse engineered video prototype of this same application. The comparison included qualitative and quantitative data analysis. Questionnaire responses regarding user acceptance (UTAUT [8]) and the overall user experience (AttrakDiff [4]) showed no differences. Qualitative analysis of the comments by potential users yielded similar results. Some differences regarding comments pertaining to the fit of the application to its context of use and appreciation of hedonic qualities, warrant investigation in future research. Usability tests seem better suited to identify issues referring to the functionality and data accessed. Overall the results confirm the validity and usefulness of video prototyping, and can help us develop a better understanding of its strengths and weaknesses.
Original languageEnglish
Title of host publicationHuman-Computer Interaction – INTERACT 2013
Subtitle of host publication14th IFIP TC 13 International Conference, Cape Town, South Africa, September 2-6, 2013, Proceedings, Part II
EditorsP. Kotzé, G. Marsden, G. Lindgaard, J. Wesson, M. Winckler
Place of PublicationDordrecht
PublisherSpringer
Pages774-781
ISBN (Print)978-3-642-40480-1
DOIs
Publication statusPublished - 2013
Event14th IFIP International Conference on Human-Computer Interaction (INTERACT 2013) - Cape Town, South Africa
Duration: 2 Sep 20136 Sep 2013
Conference number: 14

Conference

Conference14th IFIP International Conference on Human-Computer Interaction (INTERACT 2013)
Abbreviated titleINTERACT 2013
CountrySouth Africa
CityCape Town
Period2/09/136/09/13

Fingerprint

Testing
Feedback

Cite this

Zwinderman, M. J., Leenheer, R. A., Shirzad, A., Chupriyanov, N., Veugen, G., Zhang, B., & Markopoulos, P. (2013). Using video prototypes for evaluating design concepts with users : a comparison to usability testing. In P. Kotzé, G. Marsden, G. Lindgaard, J. Wesson, & M. Winckler (Eds.), Human-Computer Interaction – INTERACT 2013: 14th IFIP TC 13 International Conference, Cape Town, South Africa, September 2-6, 2013, Proceedings, Part II (pp. 774-781). Dordrecht: Springer. https://doi.org/10.1007/978-3-642-40480-1_55
Zwinderman, M.J. ; Leenheer, R.A. ; Shirzad, A. ; Chupriyanov, N. ; Veugen, G. ; Zhang, Biyong ; Markopoulos, P. / Using video prototypes for evaluating design concepts with users : a comparison to usability testing. Human-Computer Interaction – INTERACT 2013: 14th IFIP TC 13 International Conference, Cape Town, South Africa, September 2-6, 2013, Proceedings, Part II. editor / P. Kotzé ; G. Marsden ; G. Lindgaard ; J. Wesson ; M. Winckler. Dordrecht : Springer, 2013. pp. 774-781
@inproceedings{481088ddad95437d994d65f8c183c624,
title = "Using video prototypes for evaluating design concepts with users : a comparison to usability testing",
abstract = "We present an exploratory study that compared user feedback obtained from evaluating a mobile application versus a reverse engineered video prototype of this same application. The comparison included qualitative and quantitative data analysis. Questionnaire responses regarding user acceptance (UTAUT [8]) and the overall user experience (AttrakDiff [4]) showed no differences. Qualitative analysis of the comments by potential users yielded similar results. Some differences regarding comments pertaining to the fit of the application to its context of use and appreciation of hedonic qualities, warrant investigation in future research. Usability tests seem better suited to identify issues referring to the functionality and data accessed. Overall the results confirm the validity and usefulness of video prototyping, and can help us develop a better understanding of its strengths and weaknesses.",
author = "M.J. Zwinderman and R.A. Leenheer and A. Shirzad and N. Chupriyanov and G. Veugen and Biyong Zhang and P. Markopoulos",
year = "2013",
doi = "10.1007/978-3-642-40480-1_55",
language = "English",
isbn = "978-3-642-40480-1",
pages = "774--781",
editor = "P. Kotz{\'e} and G. Marsden and G. Lindgaard and J. Wesson and M. Winckler",
booktitle = "Human-Computer Interaction – INTERACT 2013",
publisher = "Springer",
address = "Germany",

}

Zwinderman, MJ, Leenheer, RA, Shirzad, A, Chupriyanov, N, Veugen, G, Zhang, B & Markopoulos, P 2013, Using video prototypes for evaluating design concepts with users : a comparison to usability testing. in P Kotzé, G Marsden, G Lindgaard, J Wesson & M Winckler (eds), Human-Computer Interaction – INTERACT 2013: 14th IFIP TC 13 International Conference, Cape Town, South Africa, September 2-6, 2013, Proceedings, Part II. Springer, Dordrecht, pp. 774-781, 14th IFIP International Conference on Human-Computer Interaction (INTERACT 2013), Cape Town, South Africa, 2/09/13. https://doi.org/10.1007/978-3-642-40480-1_55

Using video prototypes for evaluating design concepts with users : a comparison to usability testing. / Zwinderman, M.J.; Leenheer, R.A.; Shirzad, A.; Chupriyanov, N.; Veugen, G.; Zhang, Biyong; Markopoulos, P.

Human-Computer Interaction – INTERACT 2013: 14th IFIP TC 13 International Conference, Cape Town, South Africa, September 2-6, 2013, Proceedings, Part II. ed. / P. Kotzé; G. Marsden; G. Lindgaard; J. Wesson; M. Winckler. Dordrecht : Springer, 2013. p. 774-781.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Using video prototypes for evaluating design concepts with users : a comparison to usability testing

AU - Zwinderman, M.J.

AU - Leenheer, R.A.

AU - Shirzad, A.

AU - Chupriyanov, N.

AU - Veugen, G.

AU - Zhang, Biyong

AU - Markopoulos, P.

PY - 2013

Y1 - 2013

N2 - We present an exploratory study that compared user feedback obtained from evaluating a mobile application versus a reverse engineered video prototype of this same application. The comparison included qualitative and quantitative data analysis. Questionnaire responses regarding user acceptance (UTAUT [8]) and the overall user experience (AttrakDiff [4]) showed no differences. Qualitative analysis of the comments by potential users yielded similar results. Some differences regarding comments pertaining to the fit of the application to its context of use and appreciation of hedonic qualities, warrant investigation in future research. Usability tests seem better suited to identify issues referring to the functionality and data accessed. Overall the results confirm the validity and usefulness of video prototyping, and can help us develop a better understanding of its strengths and weaknesses.

AB - We present an exploratory study that compared user feedback obtained from evaluating a mobile application versus a reverse engineered video prototype of this same application. The comparison included qualitative and quantitative data analysis. Questionnaire responses regarding user acceptance (UTAUT [8]) and the overall user experience (AttrakDiff [4]) showed no differences. Qualitative analysis of the comments by potential users yielded similar results. Some differences regarding comments pertaining to the fit of the application to its context of use and appreciation of hedonic qualities, warrant investigation in future research. Usability tests seem better suited to identify issues referring to the functionality and data accessed. Overall the results confirm the validity and usefulness of video prototyping, and can help us develop a better understanding of its strengths and weaknesses.

U2 - 10.1007/978-3-642-40480-1_55

DO - 10.1007/978-3-642-40480-1_55

M3 - Conference contribution

SN - 978-3-642-40480-1

SP - 774

EP - 781

BT - Human-Computer Interaction – INTERACT 2013

A2 - Kotzé, P.

A2 - Marsden, G.

A2 - Lindgaard, G.

A2 - Wesson, J.

A2 - Winckler, M.

PB - Springer

CY - Dordrecht

ER -

Zwinderman MJ, Leenheer RA, Shirzad A, Chupriyanov N, Veugen G, Zhang B et al. Using video prototypes for evaluating design concepts with users : a comparison to usability testing. In Kotzé P, Marsden G, Lindgaard G, Wesson J, Winckler M, editors, Human-Computer Interaction – INTERACT 2013: 14th IFIP TC 13 International Conference, Cape Town, South Africa, September 2-6, 2013, Proceedings, Part II. Dordrecht: Springer. 2013. p. 774-781 https://doi.org/10.1007/978-3-642-40480-1_55