Grant: Discovery Grants Program - Individual
University of Guelph
$25,000.00
Deep Learning and Representation Learning for Sequential Data
FY 2013-14
Summary
The pervasiveness of computing has resulted in the production and storage of more data than ever before. Machine learning seeks to transform this deluge of data into intelligent systems that identify patterns and make decisions. It has revolutionized fields as diverse as computer vision, computational neuroscience, biology and the social sciences. But when faced with data that is increasingly complex, how does a machine know which parts are relevant? How does it structure the millions of components into organized units on which it can base decisions?Recent developments in machine learning, known as ""Deep Learning"", have answered these questions by showing how increasingly abstract layers of features can extract informative data representations without human guidance. But to-date, the field has focused on static as opposed to dynamic data: particularly images in the context of visual reasoning. Much of the real-world data we encounter in machine learning applications, however, has temporal dependencies that often extend over large time scales. Examples are human or robot motion, climate data, audio (e.g. music or speech), and finance. Modeling sequences is challenging: even the most sophisticated techniques fail to learn long-term structure. Sequences increase computational requirements as we attempt to untangle more complex explanatory factors underlying the data.I propose a research program that confronts these challenges through the discovery of algorithms and architectures that learn representations from sequences. I also aim to widen the adoption and increase the relevance of Deep Learning outside of academia through interdisciplinary collaborations that will impact fields such as biology, entertainment, and finance. I will train high-quality personnel who can satiate industry's growing demand for data scientists.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
436126-2013
Name nom
Taylor, Graham
Department département
Engineering, School of
Organization id
24
Institution établissement
University of Guelph
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2013
Competition year année de concours
2013
Award amount
25000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
1
Nb partie
5
Application title
Deep Learning and Representation Learning for Sequential Data
Keyword
NSERC
Application summary
The pervasiveness of computing has resulted in the production and storage of more data than ever before. Machine learning seeks to transform this deluge of data into intelligent systems that identify patterns and make decisions. It has revolutionized fields as diverse as computer vision, computational neuroscience, biology and the social sciences. But when faced with data that is increasingly complex, how does a machine know which parts are relevant? How does it structure the millions of components into organized units on which it can base decisions?Recent developments in machine learning, known as ""Deep Learning"", have answered these questions by showing how increasingly abstract layers of features can extract informative data representations without human guidance. But to-date, the field has focused on static as opposed to dynamic data: particularly images in the context of visual reasoning. Much of the real-world data we encounter in machine learning applications, however, has temporal dependencies that often extend over large time scales. Examples are human or robot motion, climate data, audio (e.g. music or speech), and finance. Modeling sequences is challenging: even the most sophisticated techniques fail to learn long-term structure. Sequences increase computational requirements as we attempt to untangle more complex explanatory factors underlying the data.I propose a research program that confronts these challenges through the discovery of algorithms and architectures that learn representations from sequences. I also aim to widen the adoption and increase the relevance of Deep Learning outside of academia through interdisciplinary collaborations that will impact fields such as biology, entertainment, and finance. I will train high-quality personnel who can satiate industry's growing demand for data scientists.