Grant: Discovery Grants Program - Individual
McGill University
$110,000.00
Sound in Space: towards a unified theory of auditory localization
EF 2023-24
Résumé
One of the major challenges to the auditory system is to track sound sources as they move to predict their future path and guide action (e.g. avoid an approaching car). Yet, dynamic sound localization, our ability to determine the position of sounds as they move in space, has largely been understudied due to the complications of laboratory setups. The long-term goal of this program is to understand the perceptual and cognitive underpinnings of auditory motion in an attempt to reconcile current theories of static and dynamic sound localization. Our recent work has demonstrated the existence of upper limits of auditory motion in a range of velocities that had not been explored before. Based on this work, we hypothesize that auditory motion is based on the comparison of static localization cues at successive points in time, constrained by the temporal resolution of the binaural system (blurred snapshot model). But our work so far focused on azimuthal localization using sounds revolving at a fixed distance on the horizontal plane. To test our hypothesis and the relative contributions of different localization cues, we will extend our investigation to trajectories resulting in changes in intensity, direct to reverberant ratio and Doppler shifts. To do so, we first need to characterize spatial audio rendering techniques in terms of their ability to preserve localization cues at the listeners' ears. We will then systematically investigate the effect on monaural and binaural localization cues on motion perception. In later years, we will examine the effect of spatial features on grouping processes of dynamic sound sources in complex auditory scenes with multiple simultaneous trajectories. In parallel, we will implement models of sound localization informed by the results of experiments with human listeners. We will proceed by a progressive complexification, starting with a simple model of azimuthal localization of sounds at a fixed distance, then adding motion-induced blur, then modeling distance and velocity estimation, and finally accounting for our ability to track multiple sounds sources simultaneously. In Year 5, we will integrate the different cues in a Bayesian observer model for optimal prediction, similar to the ones used for visual motion perception. The predictions will be compared with empirical findings to test alternative theories of sound localization. On theoretical grounds, this research program will provide grounds for a unified theory of sound localization. This program has practical implications for spatial sound reproduction (in virtual reality, entertainment, videoconferencing), for improving spatial functionalities in hearing aids and for acoustic monitoring of target sounds. Future directions include multisensory integration in motion perception by investigating how the visual and auditory system can provide complementary information about the movement of objects.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2019-06121
Name nom
Guastavino, Catherine
Department département
School of Information Studies
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2019
Award amount
110000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
3109
Research subject group en
Physics
Research subject group fr
Acoustics
Research subject en
Physique
Research subject fr
Acoustique
Application title
Sound in Space: towards a unified theory of auditory localization
Keyword
Acoustics; Motion perception; Psychoacoustics; Psychophysics; Sound localization; Spatial audio; Spatial hearing
Application summary
One of the major challenges to the auditory system is to track sound sources as they move to predict their future path and guide action (e.g. avoid an approaching car). Yet, dynamic sound localization, our ability to determine the position of sounds as they move in space, has largely been understudied due to the complications of laboratory setups. The long-term goal of this program is to understand the perceptual and cognitive underpinnings of auditory motion in an attempt to reconcile current theories of static and dynamic sound localization. Our recent work has demonstrated the existence of upper limits of auditory motion in a range of velocities that had not been explored before. Based on this work, we hypothesize that auditory motion is based on the comparison of static localization cues at successive points in time, constrained by the temporal resolution of the binaural system (blurred snapshot model). But our work so far focused on azimuthal localization using sounds revolving at a fixed distance on the horizontal plane. To test our hypothesis and the relative contributions of different localization cues, we will extend our investigation to trajectories resulting in changes in intensity, direct to reverberant ratio and Doppler shifts. To do so, we first need to characterize spatial audio rendering techniques in terms of their ability to preserve localization cues at the listeners' ears. We will then systematically investigate the effect on monaural and binaural localization cues on motion perception. In later years, we will examine the effect of spatial features on grouping processes of dynamic sound sources in complex auditory scenes with multiple simultaneous trajectories. In parallel, we will implement models of sound localization informed by the results of experiments with human listeners. We will proceed by a progressive complexification, starting with a simple model of azimuthal localization of sounds at a fixed distance, then adding motion-induced blur, then modeling distance and velocity estimation, and finally accounting for our ability to track multiple sounds sources simultaneously. In Year 5, we will integrate the different cues in a Bayesian observer model for optimal prediction, similar to the ones used for visual motion perception. The predictions will be compared with empirical findings to test alternative theories of sound localization. On theoretical grounds, this research program will provide grounds for a unified theory of sound localization. This program has practical implications for spatial sound reproduction (in virtual reality, entertainment, videoconferencing), for improving spatial functionalities in hearing aids and for acoustic monitoring of target sounds. Future directions include multisensory integration in motion perception by investigating how the visual and auditory system can provide complementary information about the movement of objects.