Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Research Tools and Instruments

University of Toronto

$117,990.00

Using eye-tracking and in-depth video analysis to understand how speech input relates to speech development

FY 2020-21

Summary
Fifty years ago, the field of infant speech perception was born. In a study that revolutionized the way we understand early cognitive development, infants were shown to perceive speech sounds in a categorical manner much like adults do. Subsequent work demonstrated that this behaviour was universal, and independent of language experience. Since these initial foundational studies, experimental paradigms designed to measure children's attentional shifts in response to speech sounds have revealed that the development of spoken language depends on an intricate interplay between innate knowledge and experience. But until recently, findings have been primarily based on data that has been hand-coded by experimenters, an approach susceptible to experimenter bias, and unable to capture the subtle, fine-grained behaviour that often is necessary to answer nuanced experimental questions. And most analyses have collapsed observations across dozens of infants, focusing on group-level effects and therefore unable to address the question of how individual experiences are linked to individual differences in speech development. Thankfully, recent technological advancements offer more sophisticated methods to test questions about infant development. Eye-trackers can automatically record children's gaze/pupil dilation as the speech signal unfolds, and specialized software can tailor experiments in real time in response to children's performance. Highly engaging experimental stimuli can be created using advanced animation technology, improving the quality of data collected in the lab. And improvements in audio-visual technology and digital memory make it feasible to collect data-rich longitudinal recordings of individual caregiver-child interactions, which can then be aligned with individual performance in perception studies. Johnson has been a trailblazer in the use of these technologies to study speech development (e.g., she developed the first large-scale video corpus of caregiver-infant interactions linked to eyetracking data, and worked with SR Research to help them beta-test their first arm mount for their infant eyetracking system). But the equipment Johnson purchased when she was first built her lab at U of Toronto is now becoming obsolete. To maintain her cutting-edge research program on speech development in linguistically-diverse communities, she will purchase a new Eyelink eyetracker and update the stimulus creation and audio-visual recording equipment in her lab. She will also replace outdated software and purchase a new type of headmounted eyetracker. This new infant speech testing setup will be widely shared with other cognitive scientists, most notably Assistant Professor Jessamyn Schertz an expert in the relationship between speech perception and production. Updating this equipment will contribute to Canada's training and research capacities, as well as advance our understanding of speech development in our increasingly multilingual population.
Program
Research Tools and Instruments
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RTI-2021-00487
Name nom
Johnson, Elizabeth
Department département
Psychology
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2021
Award amount
117990
Program id
RTI
Program name en
Research Tools and Instruments
Program name fr
Outils et instruments de recherche
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1602
Committee name en
Biological Systems and Functions (RTI)
Committee name fr
Systèmes et fonctions biologiques (OIR)
Area of application code
1210
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Psychology
Area of application fr
Psychologie
Research subject code
6305
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Cognitive science -- development
Research subject fr
Science cognitive -- développement
Installment
inst:1-1
Partie
1
Nb partie
1
Application title
Using eye-tracking and in-depth video analysis to understand how speech input relates to speech development
Keyword
NSERC
Application summary
Fifty years ago, the field of infant speech perception was born. In a study that revolutionized the way we understand early cognitive development, infants were shown to perceive speech sounds in a categorical manner much like adults do. Subsequent work demonstrated that this behaviour was universal, and independent of language experience. Since these initial foundational studies, experimental paradigms designed to measure children's attentional shifts in response to speech sounds have revealed that the development of spoken language depends on an intricate interplay between innate knowledge and experience. But until recently, findings have been primarily based on data that has been hand-coded by experimenters, an approach susceptible to experimenter bias, and unable to capture the subtle, fine-grained behaviour that often is necessary to answer nuanced experimental questions. And most analyses have collapsed observations across dozens of infants, focusing on group-level effects and therefore unable to address the question of how individual experiences are linked to individual differences in speech development. Thankfully, recent technological advancements offer more sophisticated methods to test questions about infant development. Eye-trackers can automatically record children's gaze/pupil dilation as the speech signal unfolds, and specialized software can tailor experiments in real time in response to children's performance. Highly engaging experimental stimuli can be created using advanced animation technology, improving the quality of data collected in the lab. And improvements in audio-visual technology and digital memory make it feasible to collect data-rich longitudinal recordings of individual caregiver-child interactions, which can then be aligned with individual performance in perception studies. Johnson has been a trailblazer in the use of these technologies to study speech development (e.g., she developed the first large-scale video corpus of caregiver-infant interactions linked to eyetracking data, and worked with SR Research to help them beta-test their first arm mount for their infant eyetracking system). But the equipment Johnson purchased when she was first built her lab at U of Toronto is now becoming obsolete. To maintain her cutting-edge research program on speech development in linguistically-diverse communities, she will purchase a new Eyelink eyetracker and update the stimulus creation and audio-visual recording equipment in her lab. She will also replace outdated software and purchase a new type of headmounted eyetracker. This new infant speech testing setup will be widely shared with other cognitive scientists, most notably Assistant Professor Jessamyn Schertz an expert in the relationship between speech perception and production. Updating this equipment will contribute to Canada's training and research capacities, as well as advance our understanding of speech development in our increasingly multilingual population.