Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Toronto

$43,000.00

Spreading the Word: The Theory of Distributed Representations in Speech and Natural Language Processing

FY 2019-20

Summary
Motivated by recent progress in the use of neural networks in areas such as speech recognition and machine translation, this grant will fund research into the application of neural networks to a wide variety of other tasks in language technology.****Although much of the popular excitement over neural networks arises from their alleged correspondence to human cognitive mechanisms, what excites engineers and computer scientists about them is their utility as very compact sequence classifiers - tools that can accurately label long sequences of data, such as speech sounds or words of text, given only examples to train on.****Undertaken by one of the research labs that pioneered the use of neural networks in the area of speech recognition, the projects funded by this grant will consider not merely the transcription of speech into text, but the understanding of what was said or written. This emphasis on meaning will enable a new generation of language technology applications that can, for example, summarize large newspaper articles into their most relevant 10 or 20 percent. A key challenge to doing this is determining how individual representations of words combine to form representations of phrases and whole sentences. There is a branch of applied mathematics that studies this sort of combination, called mathematical linguistics, which will play a crucial role in this research. We will study the use of neural networks in mimicking those combinations.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2015-04069
Name nom
Penn, Gerald
Department département
Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2015
Award amount
43000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2801
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Natural language and speech understanding
Research subject fr
Langage naturel et reconnaissance de la parole
Installment
inst:5 - 5
Partie
5
Nb partie
5
Application title
Spreading the Word: The Theory of Distributed Representations in Speech and Natural Language Processing
Keyword
NSERC
Application summary
Motivated by recent progress in the use of neural networks in areas such as speech recognition and machine translation, this grant will fund research into the application of neural networks to a wide variety of other tasks in language technology.****Although much of the popular excitement over neural networks arises from their alleged correspondence to human cognitive mechanisms, what excites engineers and computer scientists about them is their utility as very compact sequence classifiers - tools that can accurately label long sequences of data, such as speech sounds or words of text, given only examples to train on.****Undertaken by one of the research labs that pioneered the use of neural networks in the area of speech recognition, the projects funded by this grant will consider not merely the transcription of speech into text, but the understanding of what was said or written. This emphasis on meaning will enable a new generation of language technology applications that can, for example, summarize large newspaper articles into their most relevant 10 or 20 percent. A key challenge to doing this is determining how individual representations of words combine to form representations of phrases and whole sentences. There is a branch of applied mathematics that studies this sort of combination, called mathematical linguistics, which will play a crucial role in this research. We will study the use of neural networks in mimicking those combinations.