Real-time auralization based on a convolutional neural network trained by low-frequency wave-based calculations

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

Samenvatting

Acoustic Virtual Reality (AVR) has been increasingly used in building design, where sound fields are expected to be updated in real-time as the receiver and source move around the space. At low frequencies, wave-based methods can be used in the pre-calculation stage to obtain credible sound fields, that are stored for later real-time interpolation, which may lead to large storage requirements. This research proposed Neural Networks (NNs) trained by results from low-frequency room acoustic calculations such that they can provide the binaural room impulse responses (BRIRs) in real-time in an AVR framework. The room sound fields were calculated by solving the Helmholtz equation through the Finite Element Method and stored at spherical receiver arrays to build the training datasets. Convolutional Neural Networks are used to predict the spherical harmonics (SH) coefficients of the sound field distribution on spherical receiver arrays with the positions of the source and receiver as input. Combined with head-related transfer functions, these SH coefficients can be used to obtain BRIRs efficiently. At the cost of training NNs, this method is applicable to AVR scenarios with moving source and receiver and arbitrary head orientation, with the advantages of fast real-time calculation and distinct storage data reduction.

Originele taal-2Engels
TitelForum Acusticum 2023 - 10th Convention of the European Acoustics Association, EAA 2023
UitgeverijEuropean Acoustics Association
ISBN van elektronische versie9788888942674
StatusGepubliceerd - 2023
Evenement10th Convention of the European Acoustics Association, EAA 2023 - Torino, Italië
Duur: 11 sep. 202315 sep. 2023

Congres

Congres10th Convention of the European Acoustics Association, EAA 2023
Land/RegioItalië
StadTorino
Periode11/09/2315/09/23

Bibliografische nota

Publisher Copyright:
© 2023 First author et al. This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 Unported License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Vingerafdruk

Duik in de onderzoeksthema's van 'Real-time auralization based on a convolutional neural network trained by low-frequency wave-based calculations'. Samen vormen ze een unieke vingerafdruk.

Citeer dit