3D binaural spatialisation for virtual reality and psychoacoustics
- Autores: María Cuevas Rodriguez
- Directores de la Tesis: Luis Molina Tanco (dir. tes.), Arcadio Reyes Lecuona (dir. tes.)
- Lectura: En la Universidad de Málaga ( España ) en 2022
- Idioma: español
- Tribunal Calificador de la Tesis: Adrian Hilton (presid.), Ana María Barbancho Pérez (secret.), Pablo Gutiérrez Parera (voc.)
- Programa de doctorado: Programa de Doctorado en Ingeniería de Telecomunicación por la Universidad de Málaga
- Materias:
- Enlaces
- Resumen
The incorporation of spatial audio to the simulation of immersive Virtual Reality (VR) environments is becoming essential. The aim of spatialised audio is to create in the listener the illusion of sound sources existing in three-dimensional space, increasing the realism of the VR environment. In the real world, the shape of the listener's head and pinna act as a filter that modifies the sound before it reaches the eardrum. This sound is interpreted by the brain to localise its position. The use of headphones in an immersive VR environment destroys this natural filter. To overcome this limitation, we endeavour to simulate the natural filtering process by adding a series of cues to the original audio signal that can be interpreted by the brain for the spatial localisation of the sound source. Many of these cues are captured in what is known as Head-Related Transfer Function (HRTF).
This thesis describes an open source and multiplatform library developed in C++, the 3DTI Toolkit-BS. Its main task is to process an auditory signal based on its position within the VR environment and the characteristics of the listener and the environment. The library offers a set of algorithms to simulate sources at different distances, to customise the simulation for each listener (by means of HRTF interpolation and convolution) and to simulate sounds whose sources are in enclosed environments (by means of Ambisonics and convolution with Binaural Room Impulse Responses - BRIRs). The library is implemented with a flexible and modular structure, allowing new rendering methods to be integrated.
Current immersive VR environments are dynamic and interactive. The user is constantly moving and interacting with time-varying elements in the environment. In terms of audio, this means that the relative position between the sound sources and the listener are constantly changing. The 3DTI Toolkit-BS is designed to manage complex, dynamic acoustic scenes that change in real time. Smooth transitions for moving sources and/or listener were developed to avoid audible artefacts. The library has been evaluated with a battery of tests demonstrating its good dynamic behaviour and performance.
The applications of the 3DTI Toolkit-BS library are not limited to Virtual Reality; the library aims to become a reference tool for the execution of psychoacoustics experiments, as it brings together in a single tool several techniques and functionalities developed and evaluated of spatial audio research in the last 20 years. The 3DTI Toolkit-BS tool was tested in a psychoacoustics experiment, a study on the influence of non-individual HRTF on speech intelligibility. It is known that HRTF signals have an impact on speech intelligibility in a Cocktail Party scenario (where the listener tries to focus attention on a particular acoustic stimulus, filtering out all other stimuli). In the experiment, the Speech Reception Threshold (SRT) was measured, showing significant global and individual differences between the SRTs measured using different HRTFs. These results confirmed that for these Cocktail Party situations, the choice of HRTF should be carefully considered for each individual.
