Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

McGill University

$80,000.00

Three dimensions of sentence prosody

EF 2022-23

Résumé
Speech synthesis has come a long way. Today's computers can produce words and sentences highly accurately, but if a computer reads out a novel text, the result is still often hard to listen to. A major reason is our lack of understanding of sentence prosody. Sentence prosody can be characterized as all those acoustic properties of an utterance that are not a function of the words it contains, but rather are due to other factors, and includes three separate dimensions: Intonation (e.g., falling intonation on assertions vs. rising intonation on questions), Phrasing (the way the words in a sentence group together), and Prominence (for example highly predictable or discourse given words are often reduced, while contrastive information is boosted). These three dimensions of sentence prosody (intonation, phrasing, prominence) are partly determined by the phonological representations of a particular language (e.g., declarative intonation in French sounds different than in English) and partly a direct reflex of on-line processing during speaking (e.g., complex constituents are often preceded by phrasing junctures). Once we understand the representational questions and can disentangle the three dimensions, sentence prosody can be used as a window into cognitive mechanisms underlying speech production. This proposal brings together several strands of research that my lab has contributed to in the past.The first step to a better understanding of sentence prosody is to disentangle the three mentioned dimensions in the signal. The syntactic and semantic functions (type of speech act, grouping, contrast) are orthogonal to each other, but whether their prosodic correlates (tune, phrasing, prominence) are remains controversial. Most current models of sentence prosody assume interactions or even conflate the dimensions. However, the reality of the assumed interactions between the dimensions has not been systematically established. An initial study, conducted for this proposal in my lab (Wagner & McAuliffe 2017, Interspeech), systematically crossed the three functional dimensions (speech act, syntax, contrast) in a factorial speech production experiment. The results show that we can in fact recover the three `dimensions' of prosody quite reliably from speakers' utterances, once we factor out the contribution of the other dimensions, as well as speaker differences. While we find limited interactions, they are not actually the ones that current models predict. This project consists of a series of production and perception experiments designed to establish the true interactions, and develops a more appropriate representational model. We make use of novel tools (e.g, The Montreal Forced Aligner, developed in my lab, Mcauliffe et al. 2017, Interspeech) and statistical modelling, to develop models that can disentangle the dimensions, just as humans do when processing speech.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2018-06153
Name nom
Wagner, Michael
Department département
Linguistics - Linguistics
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2018
Award amount
80000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
1210
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Psychology
Area of application fr
Psychologie
Research subject code
6300
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Psychology
Research subject fr
Psychologie
Installment
inst:5;6
Partie
2
Nb partie
6
Application title
Three dimensions of sentence prosody
Application summary
Speech synthesis has come a long way. Today's computers can produce words and sentences highly accurately, but if a computer reads out a novel text, the result is still often hard to listen to. A major reason is our lack of understanding of sentence prosody. Sentence prosody can be characterized as all those acoustic properties of an utterance that are not a function of the words it contains, but rather are due to other factors, and includes three separate dimensions: Intonation (e.g., falling intonation on assertions vs. rising intonation on questions), Phrasing (the way the words in a sentence group together), and Prominence (for example highly predictable or discourse given words are often reduced, while contrastive information is boosted). These three dimensions of sentence prosody (intonation, phrasing, prominence) are partly determined by the phonological representations of a particular language (e.g., declarative intonation in French sounds different than in English) and partly a direct reflex of on-line processing during speaking (e.g., complex constituents are often preceded by phrasing junctures). Once we understand the representational questions and can disentangle the three dimensions, sentence prosody can be used as a window into cognitive mechanisms underlying speech production. This proposal brings together several strands of research that my lab has contributed to in the past.The first step to a better understanding of sentence prosody is to disentangle the three mentioned dimensions in the signal. The syntactic and semantic functions (type of speech act, grouping, contrast) are orthogonal to each other, but whether their prosodic correlates (tune, phrasing, prominence) are remains controversial. Most current models of sentence prosody assume interactions or even conflate the dimensions. However, the reality of the assumed interactions between the dimensions has not been systematically established. An initial study, conducted for this proposal in my lab (Wagner & McAuliffe 2017, Interspeech), systematically crossed the three functional dimensions (speech act, syntax, contrast) in a factorial speech production experiment. The results show that we can in fact recover the three `dimensions' of prosody quite reliably from speakers' utterances, once we factor out the contribution of the other dimensions, as well as speaker differences. While we find limited interactions, they are not actually the ones that current models predict. This project consists of a series of production and perception experiments designed to establish the true interactions, and develops a more appropriate representational model. We make use of novel tools (e.g, The Montreal Forced Aligner, developed in my lab, Mcauliffe et al. 2017, Interspeech) and statistical modelling, to develop models that can disentangle the dimensions, just as humans do when processing speech.