How playlist evaluation compares to track evaluations in music recommender systems

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

4 Citaten (Scopus)
198 Downloads (Pure)

Samenvatting

Most recommendation evaluations in music domain are focused on algorithmic performance: how a recommendation algorithm could predict a user's liking of an individual track. However, individual track rating might not fully reflect the user's liking of the whole recommendation list. Previous work has shown that subjective measures such as perceived diversity and familiarity of the recommendations, as well as the peak-end effect can influence the user's overall (holistic) evaluation of the list. In this study, we investigate how individual track evaluation compares to holistic playlist evaluation in music recommender systems, especially how playlist attractiveness is related to individual track rating and other subjective measures (perceived diversity) or objective measures (objective familiarity, peak-end effect and occurrence of good recommendations in the list). We explore this relation using a within-subjects online user experiment, in which recommendations for each condition are generated by different algorithms. We found that individual track ratings can not fully predict playlist evaluations, as other factors such as perceived diversity and recommendation approaches can influence playlist attractiveness to a larger extent. In addition, inclusion of the highest and last track rating (peak-end) is equally good in predicting playlist attractiveness as the inclusion of all track evaluations. Our results imply that it is important to consider which evaluation metric to use when evaluating recommendation approaches.

Originele taal-2Engels
TitelIntRS 2019 Interfaces and Human Decision Making for Recommender Systems 2019
SubtitelProceedings of the 6th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems co-located with 13th ACM Conference on Recommender Systems (RecSys 2019) Copenhagen, Denmark, September 19, 2019
RedacteurenP. Brusilovsky, M. de Gemmis, A. Felfernig, P. Lops, J. O'Donovan, G. Semeraro, M.C. Willemsen
UitgeverijCEUR-WS.org
Pagina's1-9
Aantal pagina's9
StatusGepubliceerd - 1 jan. 2019
Evenement6th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, IntRS 2019 - Copenhagen, Denemarken
Duur: 19 sep. 2019 → …

Publicatie series

NaamCEUR Workshop Proceedings
UitgeverijCEUR-WS.org
Volume2450
ISSN van geprinte versie1613-0073

Congres

Congres6th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, IntRS 2019
Land/RegioDenemarken
StadCopenhagen
Periode19/09/19 → …

Vingerafdruk

Duik in de onderzoeksthema's van 'How playlist evaluation compares to track evaluations in music recommender systems'. Samen vormen ze een unieke vingerafdruk.

Citeer dit