Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Toronto

$62,000.00

Machine learning to understand images and text

FY 2018-19

Summary
Machine learning research aims to build computer systems that extract useful information from data.*Considerable progress has been made in the two main areas of learning. Supervised methods, which rely*on having target labels for each input, have proved to be very powerful and widely applicable,*particularly on classification problems, in which each input example is assigned to one of a small set*of classes. These methods generally scale poorly with the number of training examples and classes.*Unsupervised methods utilize unlabeled data, where no targets are provided, and attempt to construct*representations useful for many input-output mappings. These methods scale readily but are not as*powerful, because without labels considerable structure must be imposed to make the algorithms work.*This proposal focuses on the development of learning methods that utilize both labeled and unlabeled*examples, addressing two fundamental problems. The first is extracting informative summaries of*structured objects, which contain several inter-dependent components. Two very common structured objects*are images and documents. A sample task in this domain is scene analysis, which entails picking out*multiple items in visual input. For example, a video of a busy street recorded digitally as a stream of*color pixel-maps may be re-represented in terms of the cars and pedestrians and their motions. This is*an essential and difficult problem, involving a combination of low-level image properties with*high-level, object-specific knowledge.*The second problem is rapid learning. The human ability to acquire a visual concept from a few*examples, and to recognize instances in a complex scene, poses a central challenge to the fields of*computer vision, cognitive science, and machine learning. Improving machines' ability to acquire new*concepts readily has applications not only to vision, enabling analysis of scenes containing relatively*novel objects, but also to the domain of online interaction, as a rapid learning system can build an*accurate model of a user with just a few questions, or limited knowledge of the person's web-surfing*history or product preferences.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2014-04783
Name nom
Zemel, Richard
Department département
Computer Science (St. George Campus) - Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2014
Award amount
62000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
5
Nb partie
5
Application title
Machine learning to understand images and text
Keyword
NSERC
Application summary
Machine learning research aims to build computer systems that extract useful information from data.*Considerable progress has been made in the two main areas of learning. Supervised methods, which rely*on having target labels for each input, have proved to be very powerful and widely applicable,*particularly on classification problems, in which each input example is assigned to one of a small set*of classes. These methods generally scale poorly with the number of training examples and classes.*Unsupervised methods utilize unlabeled data, where no targets are provided, and attempt to construct*representations useful for many input-output mappings. These methods scale readily but are not as*powerful, because without labels considerable structure must be imposed to make the algorithms work.*This proposal focuses on the development of learning methods that utilize both labeled and unlabeled*examples, addressing two fundamental problems. The first is extracting informative summaries of*structured objects, which contain several inter-dependent components. Two very common structured objects*are images and documents. A sample task in this domain is scene analysis, which entails picking out*multiple items in visual input. For example, a video of a busy street recorded digitally as a stream of*color pixel-maps may be re-represented in terms of the cars and pedestrians and their motions. This is*an essential and difficult problem, involving a combination of low-level image properties with*high-level, object-specific knowledge.*The second problem is rapid learning. The human ability to acquire a visual concept from a few*examples, and to recognize instances in a complex scene, poses a central challenge to the fields of*computer vision, cognitive science, and machine learning. Improving machines' ability to acquire new*concepts readily has applications not only to vision, enabling analysis of scenes containing relatively*novel objects, but also to the domain of online interaction, as a rapid learning system can build an*accurate model of a user with just a few questions, or limited knowledge of the person's web-surfing*history or product preferences.