Automatic mashup generation from multiple-camera concert recordings

P. Shrestha, P.H.N. With, de, J. Weda, M. Barbieri, E.H.L. Aarts

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

59 Citations (Scopus)
1 Downloads (Pure)

Abstract

A large number of videos are captured and shared by the audience from musical concerts. However, such recordings are typically perceived as boring mainly because of their limited view, poor visual quality and incomplete coverage. It is our objective to enrich the viewing experience of these recordings by exploiting the abundance of content from multiple sources. In this paper, we propose a novel Virtual Director system that automatically combines the most desirable segments from different recordings resulting in a single video stream, called mashup. We start by eliciting requirements from focus groups, interviewing professional video editors and consulting film grammar literature. We design a formal model for automatic mashup generation based on maximizing the degree of fulfillment of the requirements. Various audio-visual content analysis techniques are used to determine how well the requirements are satisfied by a recording. To validate the system, we compare our mashups with two other mashups: manually created by a professional video editor and machine generated by random segment selection. The mashups are evaluated in terms of visual quality, content diversity and pleasantness by 40 subjects. The results show that our mashups and the manual mashups are perceived as comparable, while both of them are significantly higher than the random mashups in all three terms.
Original languageEnglish
Title of host publicationProceedings of the international conference on Multimedia, MM '10 (Firenze, Italy, October 25-29, 2010)
PublisherAssociation for Computing Machinery, Inc
Pages541-550
ISBN (Print)978-1-60558-933-6
DOIs
Publication statusPublished - 2010

Fingerprint

Dive into the research topics of 'Automatic mashup generation from multiple-camera concert recordings'. Together they form a unique fingerprint.

Cite this