A pragmatic procedure to support the user-centric evaluation of recommender systems

B.P. Knijnenburg; M.C. Willemsen; A. Kobsa

doi:10.1145/2043932.2043993

A pragmatic procedure to support the user-centric evaluation of recommender systems

B.P. Knijnenburg, M.C. Willemsen, A. Kobsa

Human Technology Interaction

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/Congresprocedure › Conferentiebijdrage › Academic › peer review

55 Citaten (Scopus)

476 Downloads (Pure)

Samenvatting

As recommender systems are increasingly deployed in the real world, they are not merely tested offline for precision and coverage, but also "online" with test users to ensure good user experience. The user evaluation of recommenders is however complex and resource-consuming. We introduce a pragmatic procedure to evaluate recommender systems for experience products with test users, within industry constraints on time and budget. Researchers and practitioners can employ our approach to gain a comprehensive understanding of the user experience with their systems.

Originele taal-2	Engels
Titel	RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA
Redacteuren	B. Mobasher, R. Burke
Plaats van productie	New York
Uitgeverij	Association for Computing Machinery, Inc
Pagina's	321-324
ISBN van geprinte versie	978-1-4503-0689-6
DOI's	https://doi.org/10.1145/2043932.2043993
Status	Gepubliceerd - 2011

Toegang tot document

10.1145/2043932.2043993

publishers versionDefinitieve gepubliceerde versie, 539 KB

Citeer dit

Knijnenburg, B. P., Willemsen, M. C., & Kobsa, A. (2011). A pragmatic procedure to support the user-centric evaluation of recommender systems. In B. Mobasher, & R. Burke (editors), RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA (blz. 321-324). Association for Computing Machinery, Inc. https://doi.org/10.1145/2043932.2043993

Knijnenburg, B.P. ; Willemsen, M.C. ; Kobsa, A. / A pragmatic procedure to support the user-centric evaluation of recommender systems. RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA. redacteur / B. Mobasher ; R. Burke. New York : Association for Computing Machinery, Inc, 2011. blz. 321-324

@inproceedings{7b90a242138f4cd0be8acddb877038ef,

title = "A pragmatic procedure to support the user-centric evaluation of recommender systems",

abstract = "As recommender systems are increasingly deployed in the real world, they are not merely tested offline for precision and coverage, but also {"}online{"} with test users to ensure good user experience. The user evaluation of recommenders is however complex and resource-consuming. We introduce a pragmatic procedure to evaluate recommender systems for experience products with test users, within industry constraints on time and budget. Researchers and practitioners can employ our approach to gain a comprehensive understanding of the user experience with their systems.",

author = "B.P. Knijnenburg and M.C. Willemsen and A. Kobsa",

year = "2011",

doi = "10.1145/2043932.2043993",

language = "English",

isbn = "978-1-4503-0689-6",

pages = "321--324",

editor = "B. Mobasher and R. Burke",

booktitle = "RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA",

publisher = "Association for Computing Machinery, Inc",

address = "United States",

}

Knijnenburg, BP, Willemsen, MC & Kobsa, A 2011, A pragmatic procedure to support the user-centric evaluation of recommender systems. in B Mobasher & R Burke (uitgave), RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA. Association for Computing Machinery, Inc, New York, blz. 321-324. https://doi.org/10.1145/2043932.2043993

A pragmatic procedure to support the user-centric evaluation of recommender systems. / Knijnenburg, B.P.; Willemsen, M.C.; Kobsa, A.
RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA. uitgave / B. Mobasher; R. Burke. New York: Association for Computing Machinery, Inc, 2011. blz. 321-324.

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/Congresprocedure › Conferentiebijdrage › Academic › peer review

TY - GEN

T1 - A pragmatic procedure to support the user-centric evaluation of recommender systems

AU - Knijnenburg, B.P.

AU - Willemsen, M.C.

AU - Kobsa, A.

PY - 2011

Y1 - 2011

N2 - As recommender systems are increasingly deployed in the real world, they are not merely tested offline for precision and coverage, but also "online" with test users to ensure good user experience. The user evaluation of recommenders is however complex and resource-consuming. We introduce a pragmatic procedure to evaluate recommender systems for experience products with test users, within industry constraints on time and budget. Researchers and practitioners can employ our approach to gain a comprehensive understanding of the user experience with their systems.

AB - As recommender systems are increasingly deployed in the real world, they are not merely tested offline for precision and coverage, but also "online" with test users to ensure good user experience. The user evaluation of recommenders is however complex and resource-consuming. We introduce a pragmatic procedure to evaluate recommender systems for experience products with test users, within industry constraints on time and budget. Researchers and practitioners can employ our approach to gain a comprehensive understanding of the user experience with their systems.

U2 - 10.1145/2043932.2043993

DO - 10.1145/2043932.2043993

M3 - Conference contribution

SN - 978-1-4503-0689-6

SP - 321

EP - 324

BT - RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA

A2 - Mobasher, B.

A2 - Burke, R.

PB - Association for Computing Machinery, Inc

CY - New York

ER -

Knijnenburg BP, Willemsen MC, Kobsa A. A pragmatic procedure to support the user-centric evaluation of recommender systems. In Mobasher B, Burke R, redacteurs, RecSys '11 Proceedings of the fifth ACM International Conference on Recommender Systems, 23-27 October 2011, Chicago, Il., USA. New York: Association for Computing Machinery, Inc. 2011. blz. 321-324 doi: 10.1145/2043932.2043993

A pragmatic procedure to support the user-centric evaluation of recommender systems

Samenvatting

Toegang tot document

Vingerafdruk

Citeer dit