Evaluating ubiquitous systems with users: workshop summary

Christian Kray, Lars Bo Larsen, Patrick Olivier, Margit Biemans, Arthur van Bunningen, Mirko Fetter, Tim Jay, Vassilis Javed Khan, Gerhard Leitner, Ingrid Mulder, Jörg Müller, Thomas Plötz, Irene Lopez de Vallejo

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

2 Citations (Scopus)

Abstract

Evaluating ubiquitous systems with users can be a challenge, and the goal of this workshop was to take stock of current issues and novel approaches to address this challenge. In this paper, we report on the discussions we had during several plenary and small-group sessions. We first briefly review those evaluation methods that we identified as being used in ubiquitous computing, and then discuss several issues and research questions that emerged during the discussion. These issues include: data sources used for evaluation, comparing ubiquitous systems, interdisciplinary evaluation, multi-method evaluation, factoring in context and disengaged users.

Original languageEnglish
Title of host publicationConstructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers
EditorsMax Muhlhauser, Erwin Aitenbichler, Alois Ferscha
Place of PublicationHeidelberg
PublisherSpringer
Pages63-74
Number of pages12
ISBN (Electronic)978-3-540-85379-4
ISBN (Print)978-3-540-85378-7
DOIs
Publication statusPublished - 2008
EventEuropean Conference on Ambient Intelligence, AmI 2007 - Darmstadt, Germany
Duration: 7 Nov 200710 Nov 2007

Publication series

NameCommunications in Computer and Information Science
Volume11
ISSN (Print)1865-0929

Conference

ConferenceEuropean Conference on Ambient Intelligence, AmI 2007
CountryGermany
CityDarmstadt
Period7/11/0710/11/07

Fingerprint

Ubiquitous computing
Evaluation Method
Factoring
Ubiquitous Computing
Evaluation
Review
Context

Cite this

Kray, C., Larsen, L. B., Olivier, P., Biemans, M., van Bunningen, A., Fetter, M., ... Lopez de Vallejo, I. (2008). Evaluating ubiquitous systems with users: workshop summary. In M. Muhlhauser, E. Aitenbichler, & A. Ferscha (Eds.), Constructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers (pp. 63-74). (Communications in Computer and Information Science; Vol. 11). Heidelberg: Springer. https://doi.org/10.1007/978-3-540-85379-4_8
Kray, Christian ; Larsen, Lars Bo ; Olivier, Patrick ; Biemans, Margit ; van Bunningen, Arthur ; Fetter, Mirko ; Jay, Tim ; Khan, Vassilis Javed ; Leitner, Gerhard ; Mulder, Ingrid ; Müller, Jörg ; Plötz, Thomas ; Lopez de Vallejo, Irene. / Evaluating ubiquitous systems with users : workshop summary. Constructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers. editor / Max Muhlhauser ; Erwin Aitenbichler ; Alois Ferscha. Heidelberg : Springer, 2008. pp. 63-74 (Communications in Computer and Information Science).
@inproceedings{70098c860c3a4d5f89d38011f5b6cdca,
title = "Evaluating ubiquitous systems with users: workshop summary",
abstract = "Evaluating ubiquitous systems with users can be a challenge, and the goal of this workshop was to take stock of current issues and novel approaches to address this challenge. In this paper, we report on the discussions we had during several plenary and small-group sessions. We first briefly review those evaluation methods that we identified as being used in ubiquitous computing, and then discuss several issues and research questions that emerged during the discussion. These issues include: data sources used for evaluation, comparing ubiquitous systems, interdisciplinary evaluation, multi-method evaluation, factoring in context and disengaged users.",
author = "Christian Kray and Larsen, {Lars Bo} and Patrick Olivier and Margit Biemans and {van Bunningen}, Arthur and Mirko Fetter and Tim Jay and Khan, {Vassilis Javed} and Gerhard Leitner and Ingrid Mulder and J{\"o}rg M{\"u}ller and Thomas Pl{\"o}tz and {Lopez de Vallejo}, Irene",
year = "2008",
doi = "10.1007/978-3-540-85379-4_8",
language = "English",
isbn = "978-3-540-85378-7",
series = "Communications in Computer and Information Science",
publisher = "Springer",
pages = "63--74",
editor = "Max Muhlhauser and Erwin Aitenbichler and Alois Ferscha",
booktitle = "Constructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers",
address = "Germany",

}

Kray, C, Larsen, LB, Olivier, P, Biemans, M, van Bunningen, A, Fetter, M, Jay, T, Khan, VJ, Leitner, G, Mulder, I, Müller, J, Plötz, T & Lopez de Vallejo, I 2008, Evaluating ubiquitous systems with users: workshop summary. in M Muhlhauser, E Aitenbichler & A Ferscha (eds), Constructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers. Communications in Computer and Information Science, vol. 11, Springer, Heidelberg, pp. 63-74, European Conference on Ambient Intelligence, AmI 2007, Darmstadt, Germany, 7/11/07. https://doi.org/10.1007/978-3-540-85379-4_8

Evaluating ubiquitous systems with users : workshop summary. / Kray, Christian; Larsen, Lars Bo; Olivier, Patrick; Biemans, Margit; van Bunningen, Arthur; Fetter, Mirko; Jay, Tim; Khan, Vassilis Javed; Leitner, Gerhard; Mulder, Ingrid; Müller, Jörg; Plötz, Thomas; Lopez de Vallejo, Irene.

Constructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers. ed. / Max Muhlhauser; Erwin Aitenbichler; Alois Ferscha. Heidelberg : Springer, 2008. p. 63-74 (Communications in Computer and Information Science; Vol. 11).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Evaluating ubiquitous systems with users

T2 - workshop summary

AU - Kray, Christian

AU - Larsen, Lars Bo

AU - Olivier, Patrick

AU - Biemans, Margit

AU - van Bunningen, Arthur

AU - Fetter, Mirko

AU - Jay, Tim

AU - Khan, Vassilis Javed

AU - Leitner, Gerhard

AU - Mulder, Ingrid

AU - Müller, Jörg

AU - Plötz, Thomas

AU - Lopez de Vallejo, Irene

PY - 2008

Y1 - 2008

N2 - Evaluating ubiquitous systems with users can be a challenge, and the goal of this workshop was to take stock of current issues and novel approaches to address this challenge. In this paper, we report on the discussions we had during several plenary and small-group sessions. We first briefly review those evaluation methods that we identified as being used in ubiquitous computing, and then discuss several issues and research questions that emerged during the discussion. These issues include: data sources used for evaluation, comparing ubiquitous systems, interdisciplinary evaluation, multi-method evaluation, factoring in context and disengaged users.

AB - Evaluating ubiquitous systems with users can be a challenge, and the goal of this workshop was to take stock of current issues and novel approaches to address this challenge. In this paper, we report on the discussions we had during several plenary and small-group sessions. We first briefly review those evaluation methods that we identified as being used in ubiquitous computing, and then discuss several issues and research questions that emerged during the discussion. These issues include: data sources used for evaluation, comparing ubiquitous systems, interdisciplinary evaluation, multi-method evaluation, factoring in context and disengaged users.

UR - http://www.scopus.com/inward/record.url?scp=84876678925&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-85379-4_8

DO - 10.1007/978-3-540-85379-4_8

M3 - Conference contribution

AN - SCOPUS:84876678925

SN - 978-3-540-85378-7

T3 - Communications in Computer and Information Science

SP - 63

EP - 74

BT - Constructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers

A2 - Muhlhauser, Max

A2 - Aitenbichler, Erwin

A2 - Ferscha, Alois

PB - Springer

CY - Heidelberg

ER -

Kray C, Larsen LB, Olivier P, Biemans M, van Bunningen A, Fetter M et al. Evaluating ubiquitous systems with users: workshop summary. In Muhlhauser M, Aitenbichler E, Ferscha A, editors, Constructing Ambient Intelligence - AmI 2007 Workshops, Revised Papers. Heidelberg: Springer. 2008. p. 63-74. (Communications in Computer and Information Science). https://doi.org/10.1007/978-3-540-85379-4_8