The Effect of Distance on Audiovisual Temporal Integration in an Indoor Virtual Environment

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

For several decades, it has been debated whether a distance compensation mechanism exists during audiovisual (AV) synchrony judgements, regardless of the vast difference between the speed of sound and light. Here we aimed to investigate the effect of stimulus distance on the human tolerance for (physical) asynchronies and broaden earlier findings with a state-of-the-art head-mounted display (HMD). In this study, we measured the point of subjective simultaneity (PSS) of visual and auditory stimuli in an indoor virtual environment (VE). The synchrony judgement method was used for 11 stimulus onset asynchronies (SOA) and six egocentric distances up to 30 m. In addition, to obtain higher validity of the dataset, we implemented in our data analysis the results from the previous studies of the egocentric distance perception and the AV hardware latency delay. Our findings displayed positive PSS values that increased with distance showing that in our VE, a distance compensation mechanism is taking its place. However, the gain was smaller than was expected for complete compensation for the slower speed of sound.
Original languageEnglish
Title of host publicationAI Technologies and Virtual Reality
Subtitle of host publicationProceedings of 7th International Conference on Artificial Intelligence and Virtual Reality (AIVR 2023)
EditorsKazumi Nakamatsu, Srikanta Patnaik, Roumen Kountchev
PublisherSpringer
Chapter8
Pages101-120
Number of pages20
ISBN (Electronic)978-981-99-9018-4
ISBN (Print)978-981-99-9017-7
DOIs
Publication statusPublished - 20 Mar 2024
Event7th International Conference on Artificial Intelligence and Virtual Reality, AIVR 2023 - Kumamoto, Japan
Duration: 21 Jul 202323 Jul 2023

Publication series

NameSmart Innovation, Systems and Technologies (SIST)
Volume382
ISSN (Print)2190-3018
ISSN (Electronic)2190-3026

Conference

Conference7th International Conference on Artificial Intelligence and Virtual Reality, AIVR 2023
Abbreviated titleAIVR 2023
Country/TerritoryJapan
CityKumamoto
Period21/07/2323/07/23

Funding

We want to thank the late Armin Kohlrausch for his supervision and considerable inspiration that made this work possible. We also thank the Building Acoustics research group at the Eindhoven University of Technology for the advice and help with the audio auralization process. This project has received funding from the European Union\u2019s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 812719.

FundersFunder number
Horizon 2020 Framework Programme
Marie Skłodowska‐Curie812719

    Keywords

    • Audiovisual
    • Depth cues
    • Multisensory perception
    • Synchrony judgements
    • Temporal integration
    • VR
    • Virtual reality

    Fingerprint

    Dive into the research topics of 'The Effect of Distance on Audiovisual Temporal Integration in an Indoor Virtual Environment'. Together they form a unique fingerprint.

    Cite this