Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

Queen's University

$53,801.00

Multisensory cues for conversational coordination

EF 2020-21

Résumé
The primary unit of conversation is the turn. When two or more people converse, one speaker holds the floor and then almost seamlessly another person's turn begins. The turn exchange times are usually very short; the modal time in numerous studies is less than 200 ms with tight variation around this value. Such timing distributions are consistent across a wide range of languages and contexts. This fact is remarkable when the diversity of linguistic structures for the more than 5000 living languages is considered. Turn taking has been investigated in non-human primates and birds and similarities have been noted. Further, turn taking has been identified as a critical aspect of the development of language and communication. These facts suggest that the coordination of turn exchanges is a fundamental aspect of language. In spite of the primacy of this behaviour in many communication systems, much is unknown about the behavioural and neural representations needed to accomplish it. The approach taken in the proposed research is to quantify conversational behaviour in naturalistic situations and use innovative methods to manipulate aspects of the exchanges. The proposed studies include monitoring auditory-only and audiovisual conversations. In addition, unique perceptual and eye tracking studies will address what information aids rapid turn exchanges. Finally, our studies will use unique methods to produce real time perturbations of conversational dynamics. These methods include mapping the delay function between talking and listening and using real-time animation to modify the information that talkers display in conversation. By emphasizing the rich dynamics of conversation, the research will focus on the temporal constraints that shape our most common use of language. How time pressure and cognitive resource sharing determine the form and capacity of language use can only be truly studied by research about conversation. The methods that are required for this research involve non-invasive motion and acoustic measures of individuals talking naturally. New uses of animation and eye trackers will enhance research in this area. Understanding conversation has both engineering and basic science importance. The use of avatars and conversational agents is expanding rapidly and the importance of realism in these agents is obvious. The studies make novel contributions to language processing methods and research questions about language representation. Further, the studies provide the tools and statistical basis for understanding a number of clinical disorders of communication.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2019-04997
Name nom
Munhall, Kevin
Department département
Psychology
Organization id
29
Institution établissement
Queen's University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2019
Award amount
53801
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
6306
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Cognitive science -- language
Research subject fr
Science cognitive -- langage
Installment
inst:2-5
Partie
4
Nb partie
5
Application title
Multisensory cues for conversational coordination
Keyword
NSERC
Application summary
The primary unit of conversation is the turn. When two or more people converse, one speaker holds the floor and then almost seamlessly another person's turn begins. The turn exchange times are usually very short; the modal time in numerous studies is less than 200 ms with tight variation around this value. Such timing distributions are consistent across a wide range of languages and contexts. This fact is remarkable when the diversity of linguistic structures for the more than 5000 living languages is considered. Turn taking has been investigated in non-human primates and birds and similarities have been noted. Further, turn taking has been identified as a critical aspect of the development of language and communication. These facts suggest that the coordination of turn exchanges is a fundamental aspect of language. In spite of the primacy of this behaviour in many communication systems, much is unknown about the behavioural and neural representations needed to accomplish it. The approach taken in the proposed research is to quantify conversational behaviour in naturalistic situations and use innovative methods to manipulate aspects of the exchanges. The proposed studies include monitoring auditory-only and audiovisual conversations. In addition, unique perceptual and eye tracking studies will address what information aids rapid turn exchanges. Finally, our studies will use unique methods to produce real time perturbations of conversational dynamics. These methods include mapping the delay function between talking and listening and using real-time animation to modify the information that talkers display in conversation. By emphasizing the rich dynamics of conversation, the research will focus on the temporal constraints that shape our most common use of language. How time pressure and cognitive resource sharing determine the form and capacity of language use can only be truly studied by research about conversation. The methods that are required for this research involve non-invasive motion and acoustic measures of individuals talking naturally. New uses of animation and eye trackers will enhance research in this area. Understanding conversation has both engineering and basic science importance. The use of avatars and conversational agents is expanding rapidly and the importance of realism in these agents is obvious. The studies make novel contributions to language processing methods and research questions about language representation. Further, the studies provide the tools and statistical basis for understanding a number of clinical disorders of communication.