Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Research Tools and Instruments - Category 1 (<$150,000)

University of Toronto

$140,843.00

Massively parallel computing in natural language technology

EF 2009-10

Résumé
While the best known trend in speech and language processing over the last twenty years is probably still its adoption of statistical methods to crack open a variety of previously intractable computing applications (speech recognition, machine translation, web-page search, etc.), this field has recently turn another, very different, less celebrated, but equally transformative corner. State of the art research on many of these applications can now be spotted not so much by their radically new techniques, although innovations have of course still been forthcoming, as by their radically larger **scales**. A great many machine translation groups still essentially use IBM's models from the early 1990s, but trained over half a petabyte (a megabyte of megabytes) of data. The best text-to-speech synthesizers manipulate speech signals in about the same way as their predecessors did 15 years ago, in fact, but they paste together pieces of recorded speech from databases that are tens of thousands of times larger than they were back then. Bigger now does actually go a very long way towards producing better. What this means for top-ranked research groups such as University of Toronto's Computational Linguistics Lab is that it is now difficult if not impossible to remain competitive merely by carefully selecting research topics for post-graduate students that will not pit them against some better equipped laboratory in a race that is entirely determined by the quantity of resources thrown at the problem. Even genuinely cleverer, better ideas now need a comparable allocation of resources just to prove that they are better. The research strengths and ongoing research activities of our faculty and students revolve around several topics that simply require a larger scale of computing power than we can provide. Specifically, we are acquiring compute servers with the ability to conduct massively parallel searches and numerical computations, over large amounts of random-access and/or disk memory, in a short amount of time. These ongoing activities include our research in speech recognition and spoken information retrieval, language modelling, lexical and language acquisition, and influence detection.
Programme
Research Tools and Instruments - Category 1 (<$150,000)
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
389655-2010
Name nom
Penn, Gerald
Department département
Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2009
Competition year année de concours
2010
Award amount
140843
Program id
EQPEQ
Program nane en
Research Tools and Instruments - Category 1 (<$150,000)
Program name fr
Outils et instruments de recherche - catégorie 1 (<150 000$)
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2801
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Natural language and speech understanding
Research subject fr
Langage naturel et reconnaissance de la parole
Partie
1
Nb partie
1
Application title
Massively parallel computing in natural language technology
Keyword
NA
Application summary
While the best known trend in speech and language processing over the last twenty years is probably still its adoption of statistical methods to crack open a variety of previously intractable computing applications (speech recognition, machine translation, web-page search, etc.), this field has recently turn another, very different, less celebrated, but equally transformative corner. State of the art research on many of these applications can now be spotted not so much by their radically new techniques, although innovations have of course still been forthcoming, as by their radically larger **scales**. A great many machine translation groups still essentially use IBM's models from the early 1990s, but trained over half a petabyte (a megabyte of megabytes) of data. The best text-to-speech synthesizers manipulate speech signals in about the same way as their predecessors did 15 years ago, in fact, but they paste together pieces of recorded speech from databases that are tens of thousands of times larger than they were back then. Bigger now does actually go a very long way towards producing better. What this means for top-ranked research groups such as University of Toronto's Computational Linguistics Lab is that it is now difficult if not impossible to remain competitive merely by carefully selecting research topics for post-graduate students that will not pit them against some better equipped laboratory in a race that is entirely determined by the quantity of resources thrown at the problem. Even genuinely cleverer, better ideas now need a comparable allocation of resources just to prove that they are better. The research strengths and ongoing research activities of our faculty and students revolve around several topics that simply require a larger scale of computing power than we can provide. Specifically, we are acquiring compute servers with the ability to conduct massively parallel searches and numerical computations, over large amounts of random-access and/or disk memory, in a short amount of time. These ongoing activities include our research in speech recognition and spoken information retrieval, language modelling, lexical and language acquisition, and influence detection.