Robustness improvement of ultrasound-based sensor systems for speech communication

Nemanja Cvijanovic, Patrick Kechichian, Kees Janse, Armin Kohlrausch

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

2 Citations (Scopus)

Abstract

In recent years, auxiliary sensors have been employed to improve the robustness of emerging hands-free speech communication systems based on air-conduction microphones, especially in low signal-to-noise-ratio environments. One such sensor, based on ultrasound, captures articulatory movement information during speech production and has been used in a voice activity detector and also shown to improve the performance of speech recognizers. However, studies thus far have tested such sensors in ideal scenarios where only relevant ar-ticulatory information was assumed to be present. Therefore, in this paper the robustness of such sensors in realistic scenarios is investigated. Challenges arising from non-articulatory movements and other environmental influences captured by ultrasound sensors are discussed and strategies for their detection presented. Finally, the proposed strategies are evaluated in an ultrasound-based voice activity detector.

Original languageEnglish
Title of host publication2015 23rd European Signal Processing Conference, EUSIPCO 2015
Place of PublicationPiscataway
PublisherInstitute of Electrical and Electronics Engineers
Pages884-888
Number of pages5
ISBN (Electronic)9780992862633
DOIs
Publication statusPublished - 22 Dec 2015
Event23rd European Signal Processing Conference, EUSIPCO 2015 - Nice, France
Duration: 31 Aug 20154 Sep 2015

Conference

Conference23rd European Signal Processing Conference, EUSIPCO 2015
CountryFrance
CityNice
Period31/08/154/09/15

Keywords

  • articulation
  • Doppler shift
  • robustness
  • Ultrasound
  • voice activity detection

Fingerprint

Dive into the research topics of 'Robustness improvement of ultrasound-based sensor systems for speech communication'. Together they form a unique fingerprint.

Cite this