Grant: Discovery Grants Program - Individual
McMaster University
$19,000.00
The role of amplitude envelope in auditory-visual integration
EF 2010-11
Résumé
Ventriloquists routinely exploit the perceptual system's propensity to integrate auditory and visual information, using it to trick audiences into ""hearing"" puppets speak. I have shown that some musicians (percussionists) use similar principles, allowing their audiences to hear certain musical notes as longer or shorter than their acoustic duration. This novel illusion using naturalistic percussion sounds is at odds with earlier research (often using unnatural, artificial sounds), which has repeatedly concluded that such patterns of visual influence are not possible. Curiously, although artificial sounds are popular in a wide range of auditory research, they rarely occur in the natural world. In contrast, percussive sounds are common in our everyday experience. Therefore this proposed research program will explore the degree to which previous work using artificial sounds generalizes to everyday perceiving by focusing on the following three objectives: (1) Exploring vision's influence on the perception of ""hybrid"" sounds mixing characteristics of percussive and artificial sounds. (2) Exploring whether percussive sounds are easier to process (one explanation for their propensity to integrate with visual information) by examining reaction times for detecting target intervals amidst a stream of percussive vs. artificial sounds. (3) Testing participants on their ability to intentionally associate sounds with objects, exploring whether performance is better for percussive rather than artificial sounds. Together, these experiments will contribute to our basic understanding of auditory perception by documenting the extent to which previous research using artificial sounds generalizes to the perception of real world auditory events. This work will also be relevant to researchers in other fields. For example, it will be useful to brain scientists investigating the biological basis of multi-sensory perception, an area of neuroscience research that has seen a great deal of growth in recent years. Additionally, our third objective focused on remembering associations between sounds and objects could prove helpful in designing effective auditory human-computer-interfaces, which require users to remember associations between sounds and their intended meaning.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
386603-2010
Name nom
Schutz, Michael
Department département
Arts and Science Program
Organization id
27
Institution établissement
McMaster University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2010
Competition year année de concours
2010
Award amount
19000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
1210
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Psychology
Area of application fr
Psychologie
Research subject code
6301
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Sensory systems and perception
Research subject fr
Systèmes sensoriels et perception
Partie
1
Nb partie
5
Application title
The role of amplitude envelope in auditory-visual integration
Keyword
NSERC
Application summary
Ventriloquists routinely exploit the perceptual system's propensity to integrate auditory and visual information, using it to trick audiences into ""hearing"" puppets speak. I have shown that some musicians (percussionists) use similar principles, allowing their audiences to hear certain musical notes as longer or shorter than their acoustic duration. This novel illusion using naturalistic percussion sounds is at odds with earlier research (often using unnatural, artificial sounds), which has repeatedly concluded that such patterns of visual influence are not possible. Curiously, although artificial sounds are popular in a wide range of auditory research, they rarely occur in the natural world. In contrast, percussive sounds are common in our everyday experience. Therefore this proposed research program will explore the degree to which previous work using artificial sounds generalizes to everyday perceiving by focusing on the following three objectives: (1) Exploring vision's influence on the perception of ""hybrid"" sounds mixing characteristics of percussive and artificial sounds. (2) Exploring whether percussive sounds are easier to process (one explanation for their propensity to integrate with visual information) by examining reaction times for detecting target intervals amidst a stream of percussive vs. artificial sounds. (3) Testing participants on their ability to intentionally associate sounds with objects, exploring whether performance is better for percussive rather than artificial sounds. Together, these experiments will contribute to our basic understanding of auditory perception by documenting the extent to which previous research using artificial sounds generalizes to the perception of real world auditory events. This work will also be relevant to researchers in other fields. For example, it will be useful to brain scientists investigating the biological basis of multi-sensory perception, an area of neuroscience research that has seen a great deal of growth in recent years. Additionally, our third objective focused on remembering associations between sounds and objects could prove helpful in designing effective auditory human-computer-interfaces, which require users to remember associations between sounds and their intended meaning.