Grant: Discovery Grants Program - Individual
University of Toronto
$62,000.00
Machine learning to understand images and text
FY 2017-18
Summary
Machine learning research aims to build computer systems that extract useful information from data.Considerable progress has been made in the two main areas of learning. Supervised methods, which relyon having target labels for each input, have proved to be very powerful and widely applicable,particularly on classification problems, in which each input example is assigned to one of a small setof classes. These methods generally scale poorly with the number of training examples and classes.Unsupervised methods utilize unlabeled data, where no targets are provided, and attempt to constructrepresentations useful for many input-output mappings. These methods scale readily but are not aspowerful, because without labels considerable structure must be imposed to make the algorithms work.This proposal focuses on the development of learning methods that utilize both labeled and unlabeledexamples, addressing two fundamental problems. The first is extracting informative summaries ofstructured objects, which contain several inter-dependent components. Two very common structured objectsare images and documents. A sample task in this domain is scene analysis, which entails picking outmultiple items in visual input. For example, a video of a busy street recorded digitally as a stream ofcolor pixel-maps may be re-represented in terms of the cars and pedestrians and their motions. This isan essential and difficult problem, involving a combination of low-level image properties withhigh-level, object-specific knowledge.The second problem is rapid learning. The human ability to acquire a visual concept from a fewexamples, and to recognize instances in a complex scene, poses a central challenge to the fields ofcomputer vision, cognitive science, and machine learning. Improving machines' ability to acquire newconcepts readily has applications not only to vision, enabling analysis of scenes containing relativelynovel objects, but also to the domain of online interaction, as a rapid learning system can build anaccurate model of a user with just a few questions, or limited knowledge of the person's web-surfinghistory or product preferences.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2014-04783
Name nom
Zemel, Richard
Department département
Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2014
Award amount
62000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
4
Nb partie
5
Application title
Machine learning to understand images and text
Keyword
NSERC
Application summary
Machine learning research aims to build computer systems that extract useful information from data.Considerable progress has been made in the two main areas of learning. Supervised methods, which relyon having target labels for each input, have proved to be very powerful and widely applicable,particularly on classification problems, in which each input example is assigned to one of a small setof classes. These methods generally scale poorly with the number of training examples and classes.Unsupervised methods utilize unlabeled data, where no targets are provided, and attempt to constructrepresentations useful for many input-output mappings. These methods scale readily but are not aspowerful, because without labels considerable structure must be imposed to make the algorithms work.This proposal focuses on the development of learning methods that utilize both labeled and unlabeledexamples, addressing two fundamental problems. The first is extracting informative summaries ofstructured objects, which contain several inter-dependent components. Two very common structured objectsare images and documents. A sample task in this domain is scene analysis, which entails picking outmultiple items in visual input. For example, a video of a busy street recorded digitally as a stream ofcolor pixel-maps may be re-represented in terms of the cars and pedestrians and their motions. This isan essential and difficult problem, involving a combination of low-level image properties withhigh-level, object-specific knowledge.The second problem is rapid learning. The human ability to acquire a visual concept from a fewexamples, and to recognize instances in a complex scene, poses a central challenge to the fields ofcomputer vision, cognitive science, and machine learning. Improving machines' ability to acquire newconcepts readily has applications not only to vision, enabling analysis of scenes containing relativelynovel objects, but also to the domain of online interaction, as a rapid learning system can build anaccurate model of a user with just a few questions, or limited knowledge of the person's web-surfinghistory or product preferences.