Binaural Rendering of Spherical Microphone Array Signals
Licentiatavhandling, 2021

The presentation of extended reality for consumer and professional applications requires major advancements in the capture and reproduction of its auditory component to provide a plausible listening experience. A spatial representation of the acoustic environment needs to be considered to allow for movement within or an interaction with the augmented or virtual reality. This thesis focuses on the application of capturing a real-world acoustic environment by means of a spherical microphone array with the subsequent head-tracked binaural reproduction to a single listener via headphones. The introduction establishes the fundamental concepts and relevant terminology for non-experts of the field. Furthermore, the specific challenges of the method due to spatial oversampling the sound field as well as physical limitations and imperfections of the microphone array are presented to the reader. The first objective of this thesis was to develop a software in the Python programming language, which is capable of performing all required computations for the acoustic rendering of the captured signals in real-time. The implemented processing pipeline was made publicly available under an open-source license. Secondly, specific parameters of the microphone array hardware as well as the rendering software that are required for a perceptually high reproduction quality have been identified and investigated by means of multiple user studies. Lastly, the results provide insights into how unwanted additive noise components in the captured microphone signals from different spherical array configurations contribute to the reproduced ear signals.

additive noise

binaural rendering

Spherical microphone arrays

real-time signal processing

Online
Opponent: Prof. Christoph Pörschmann, TH Köln - University of Applied Sciences, Germany

Författare

Hannes Helmholz

Chalmers, Arkitektur och samhällsbyggnadsteknik, Teknisk akustik

Real-Time Implementation of Binaural Rendering of High-Order Spherical Microphone Array Signals

Fortschritte der Akustik - DAGA 2019,; (2019)

Paper i proceeding

Updates on the Real-Time Spherical Array Renderer (ReTiSAR)

Fortschritte der Akustik - DAGA 2020,; (2020)p. 1169-1172

Paper i proceeding

Evaluation of Sensor Self-Noise in Binaural Rendering of Spherical Microphone Array Signals

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings,; (2020)p. 161-165

Paper i proceeding

Instrumental Evaluation of Sensor Self-Noise in Binaural Rendering of Spherical Microphone Array Signals

Proceedings of Forum Acusticum,; (2020)p. 1349-1356

Paper i proceeding

H. Helmholz, D. Lou Alon, S. V. Amengual Garí, and J. Ahrens, “Effects of Additive Noise in Binaural Rendering of Spherical Microphone Array Signals,” IEEE/ACM Trans. Audio, Speech, Lang. Process., pp. 1-12 (accepted).

Binaural reproduktion av inspelningar med sfäriska mikrofonsystem

Oculus Inc., 2018-05-01 -- 2019-04-30.

Ämneskategorier

Medieteknik

Telekommunikation

Programvaruteknik

Signalbehandling

Styrkeområden

Informations- och kommunikationsteknik

Lic / Architecture and Civil Engineering / Chalmers University of Technology: Technical report ACE 2021:9

Utgivare

Chalmers tekniska högskola

Online

Online

Opponent: Prof. Christoph Pörschmann, TH Köln - University of Applied Sciences, Germany

Mer information

Senast uppdaterat

2021-11-15