Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

Concordia University

$24,000.00

Using pupil dilation as a tool for assisted hearing in noisy environments

FY 2023-24

Summary
The human brain struggles to cope with multi-talker environments, also referred to as "cocktail-party situations". Research efforts across the disciplines of audiology, linguistics, psychology and engineering have made substantial advances in understanding what makes a voice intelligible in the presence of interfering sounds. While this knowledge has led to many applications such as noise-cancellation headphones, speech recognition systems, and auditory prostheses, current technologies suffer from being disconnected from human cognition. So how do we integrate the brain into audio devices, so that they accommodate the needs of a listener at any given time? My NSERC DG program will test the potential of a biomarker, the pupil dilation, to steer signal processing in assisted hearing, thereby advancing our understanding of human selective attention. To do so, we propose to characterize the "harmonic cancellation" process, a theory on how listeners manage to separate voices that compete for processing. The first 18 months (Axis 1) will be spent on behavioral experiments of speech intelligibility in different situations of auditory masking where the harmonic structure of competing voices is manipulated carefully. Over the following two years (Axis 2), we will focus on pupillometry during speech comprehension. We will demonstrate that variations in the pupil diameter can be used to cue the presence of the target voice in a mixture of talkers, because the listener spends extra effort at specific times. As such, we can select specific time windows of noisy environments where statistical properties of the target signal can be best isolated and characterized. In turn, this would enable to identify which harmonic structure belongs to the target or the interfering voice, a pre-requisite to harmonic cancellation. Over the final 18 months (Axis 3), we will test this approach to assisted hearing by switching on and off a comb-filter (i.e. mimicking the harmonic cancellation mechanism with parameters that are neurophysiologically plausible) set to the fundamental frequency of the voice "identified" as the masker. This 5-year research program will participate to a change in paradigm with regard to the role of sound segregation processes and the listeners' awareness of multiple speakers. It will also bring concrete answers, by testing the actual benefit of eye-tracking devices (portable, wireless, glasses) that measure the pupil in real time to simplify the auditory scene in difficult environments such as restaurants or family diners. This proof of concept will undoubtedly translate into further collaborative funding with industry (hearing aids, cochlear implants). Together with a training plan to transfer expertise with eye-tracking towards audiology students, this interdisciplinary program - spanning biomedical engineering, audiology and cognitive neuroscience - is uniquely relevant to the goals of NSERC's discovery program.
Program
Discovery Grants Program - Individual
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2020-05536
Name nom
DEROCHE, Mickael
Department département
Psychology
Organization id
70
Institution établissement
Concordia University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2020
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
1210
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Psychology
Area of application fr
Psychologie
Research subject code
6303
Research subject group en
Psychology
Research subject group fr
Sensory systems -- auditory
Research subject en
Psychologie
Research subject fr
Systèmes sensoriels -- ouïe
Application title
Using pupil dilation as a tool for assisted hearing in noisy environments
Keyword
assisted hearing; auditory masking; cocktail-party problem; communication difficulties; harmonicity; individual differences; prosody; pupillometry; selective attention; speech perception in noise
Application summary
The human brain struggles to cope with multi-talker environments, also referred to as "cocktail-party situations". Research efforts across the disciplines of audiology, linguistics, psychology and engineering have made substantial advances in understanding what makes a voice intelligible in the presence of interfering sounds. While this knowledge has led to many applications such as noise-cancellation headphones, speech recognition systems, and auditory prostheses, current technologies suffer from being disconnected from human cognition. So how do we integrate the brain into audio devices, so that they accommodate the needs of a listener at any given time? My NSERC DG program will test the potential of a biomarker, the pupil dilation, to steer signal processing in assisted hearing, thereby advancing our understanding of human selective attention. To do so, we propose to characterize the "harmonic cancellation" process, a theory on how listeners manage to separate voices that compete for processing. The first 18 months (Axis 1) will be spent on behavioral experiments of speech intelligibility in different situations of auditory masking where the harmonic structure of competing voices is manipulated carefully. Over the following two years (Axis 2), we will focus on pupillometry during speech comprehension. We will demonstrate that variations in the pupil diameter can be used to cue the presence of the target voice in a mixture of talkers, because the listener spends extra effort at specific times. As such, we can select specific time windows of noisy environments where statistical properties of the target signal can be best isolated and characterized. In turn, this would enable to identify which harmonic structure belongs to the target or the interfering voice, a pre-requisite to harmonic cancellation. Over the final 18 months (Axis 3), we will test this approach to assisted hearing by switching on and off a comb-filter (i.e. mimicking the harmonic cancellation mechanism with parameters that are neurophysiologically plausible) set to the fundamental frequency of the voice "identified" as the masker. This 5-year research program will participate to a change in paradigm with regard to the role of sound segregation processes and the listeners' awareness of multiple speakers. It will also bring concrete answers, by testing the actual benefit of eye-tracking devices (portable, wireless, glasses) that measure the pupil in real time to simplify the auditory scene in difficult environments such as restaurants or family diners. This proof of concept will undoubtedly translate into further collaborative funding with industry (hearing aids, cochlear implants). Together with a training plan to transfer expertise with eye-tracking towards audiology students, this interdisciplinary program - spanning biomedical engineering, audiology and cognitive neuroscience - is uniquely relevant to the goals of NSERC's discovery program.