How was it? Exploiting smartphone sensing to measure implicit audience responses to live performances

Claudio Martella, Ekin Gedik, Laura Cabrera-Quiros, Gwenn Englebienne, Hayley Hung

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

16 Citations (Scopus)

Abstract

In this paper, we present an approach to understand the response of an audience to a live dance performance by the processing of mobile sensor data. We argue that exploiting sensing capabilities already available in smart phones enables a potentially large scale measurement of an audience's implicit response to a performance. In this work, we leverage both tri-Axial accelerometers, worn by ordinary members of the public during a dance performance, to predict responses to a number of survey answers, comprising enjoyment, immersion, willingness to recommend the event to others, and change in mood.We also analyse how behaviour as a result of seeing a dance performance might be reflected in a people's subsequent social behaviour using proximity and acceleration sensing. To our knowledge, this is the first work where pervasive mobile sensing has been used to investigate spontaneous responses to predict the affective evaluation of a live performance. Using a single body worn accelerometer to monitor a set of audience members, we were able to predict whether they enjoyed the event with a balanced classification accuracy of 90%. The collective coordination of the audience's bodily movements also highlighted memorable moments that were reported later by the audience. The effective use of body movements to measure affective responses in such a setting is particularly surprising given that traditionally, physiological signals such as skin conductance or brain-based signals are the more commonly accepted methods to measure implicit affective response. Our experiments open interesting new directions for research on both automated techniques and applications for the implicit tagging of real world events via spontaneous and implicit audience responses during as well as after a performance.

Original languageEnglish
Title of host publicationMM'15 : Proceedings of the 2015 ACM international conference on Multimedia, October 26-30, 2015, Brisbane, Australia
Place of PublicationNew York
PublisherAssociation for Computing Machinery, Inc
Pages201-210
Number of pages10
ISBN (Electronic)9781450334594
DOIs
Publication statusPublished - 13 Oct 2015
Externally publishedYes
Event23rd ACM International Conference on Multimedia, (MM2015) - Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015

Conference

Conference23rd ACM International Conference on Multimedia, (MM2015)
Abbreviated titleMM2015
CountryAustralia
CityBrisbane
Period26/10/1530/10/15

Keywords

  • Accelerometers
  • Arts
  • Audience response
  • Dance
  • Human behavior
  • Mobile phones.
  • Proximity sensing
  • Wearable sensors

Cite this