Modelling and detecting changes in user satisfaction

J. Kiseleva, E. Crestan, R. Brigo, R. Dittel

    Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

    9 Citaten (Scopus)
    1 Downloads (Pure)

    Samenvatting

    Informational needs behind queries, that people issue to search engines, are inherently sensitive to external factors such as breaking news, new models of devices, or seasonal changes as 'black Friday'. Mostly these changes happen suddenly and it is natural to suppose that they may cause a shift in user satisfaction with presented old search results and push users to reformulate their queries. For instance, if users issued the query 'CIKM conference' in 2013 they were satisfied with results referring to the page cikm2013.org and this page gets a majority of clicks. However, the confernce site has been changed and the same query issued in 2014 should be linked to the different page cikm2014.fudan.edu.cn. If the link to the fresh page is not among the retrieved results then users will reformulate the query to find desired information. In this paper, we examine how to detect changes in user satisfaction if some events affect user information goals but search results remained the same. We formulate a problem using concept drift detection techniques. The proposed method works in an unsupervised manner, we do not rely on any labelling. We report results of a large scale evaluation over real user interactions, that are collected by a commercial search engine within six months. The final datasets consist of more than sixty millions log entries. The results of our experiments demonstrate that by using our method we can accurately detect changes in user behavior. The detected drifts can be used to enhance query auto-completion, user satisfaction metrics, and recency ranking.
    Originele taal-2Engels
    TitelProceedings of the 23rd ACM International Conference on Information and Knowledge Management (CIKM'14, Shanghai, China, November 3-7, 2014)
    Plaats van productieNew York NY
    UitgeverijAssociation for Computing Machinery, Inc
    Pagina's1449-1458
    ISBN van geprinte versie978-1-4503-2598-1
    DOI's
    StatusGepubliceerd - 2014
    Evenementconference; 23rd ACM International Conference on Conference on Information and Knowledge Management; 2014-11-03; 2014-11-07 -
    Duur: 3 nov 20147 nov 2014

    Congres

    Congresconference; 23rd ACM International Conference on Conference on Information and Knowledge Management; 2014-11-03; 2014-11-07
    Periode3/11/147/11/14
    Ander23rd ACM International Conference on Conference on Information and Knowledge Management

    Vingerafdruk

    Duik in de onderzoeksthema's van 'Modelling and detecting changes in user satisfaction'. Samen vormen ze een unieke vingerafdruk.

    Citeer dit