Grant: Discovery Grants Program - Individual
Université Laval
$82,000.00
Deep Learning with Little Labelled Data
FY 2023-24
Summary
Machine Learning (ML) is a field of Artificial Intelligence (AI) that aims at providing computers with learning abilities, by inferring models from observations and experience. Many of the recent advances of AI have stemmed from ML, in particular the subfield of Deep Learning (DL). DL aims at learning hierarchical structures, in order to extract features from unstructured raw data (e.g., images, sound, text), allowing significant improvements over the state-of-the-art for many well-studied tasks (e.g., object recognition, automatic translation). However, these techniques are data hungry, requiring huge annotated datasets to be able to efficiently learn how to accomplish some specific tasks. Although such datasets are available for some specific well-established tasks, collecting and annotating sufficiently large datasets for a novel application can be expensive, cost- and time-wise. We propose a research program investigating various approaches to improve the efficiency of ML and DL for solving problems where only small annotated datasets available. We are looking to build upon other related or satellite datasets having the same kind of data, but whose annotations, if they exist, are not adapted to the task. From it, we would produce a working model for our current task, by learning (or fine-tuning) on the small datasets with the task-related annotations. The program is organized around four objectives: 1) To investigate how to better learn models by exploiting knowledge extracted from different tasks, which can be reused or adapted to the current context; 2) To improve meta-learning methods that can learn new concepts from only few samples; 3) To develop new approaches to extract better general representations through unsupervised learning; 4) To apply the novel methods to real-world applications, in order to both assess the practicality of the proposed methods and achieve meaningful contributions in the application domain themselves. Methods investigated within this research program have the potential of making ML and DL usable in a variety of contexts where there are no available big datasets well adapted to the specific task at hand. These ML-based systems will assist humans to adapt quickly to a given task by exploiting similar historical tasks; they will have the capacity for a rapid customization to each user. We are aiming at learning better representations of some modalities (e.g., image, text, speech), usable for a variety of purposes. We will look for discovering mechanisms for AI to adapt to new learning tasks, being able to ramp up performance with only a few examples. Finally, we will apply our techniques to domains such as black-box optimization, super-resolution microscopy, and visual place recognition.
Program
Discovery Grants Program - Individual
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2019-06706
Name nom
Gagné, Christian
Department département
Génie électrique et génie informatique - Génie électrique et génie informatique
Organization id
51
Institution établissement
Université Laval
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2019
Award amount
82000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2605
Research subject group en
Robotics
Research subject group fr
Pattern analysis and machine intelligence
Research subject en
Robotique
Research subject fr
Analyse de formes et intelligence artificielle
Application title
Deep Learning with Little Labelled Data
Keyword
Anticipatory Learning; AutoML; Deep Learning; Machine Learning; Meta-learning; Multitask Learning; Representation Learning; Super-resolution Microscopy; Transfer Learning; Visual Place Recognition
Application summary
Machine Learning (ML) is a field of Artificial Intelligence (AI) that aims at providing computers with learning abilities, by inferring models from observations and experience. Many of the recent advances of AI have stemmed from ML, in particular the subfield of Deep Learning (DL). DL aims at learning hierarchical structures, in order to extract features from unstructured raw data (e.g., images, sound, text), allowing significant improvements over the state-of-the-art for many well-studied tasks (e.g., object recognition, automatic translation). However, these techniques are data hungry, requiring huge annotated datasets to be able to efficiently learn how to accomplish some specific tasks. Although such datasets are available for some specific well-established tasks, collecting and annotating sufficiently large datasets for a novel application can be expensive, cost- and time-wise. We propose a research program investigating various approaches to improve the efficiency of ML and DL for solving problems where only small annotated datasets available. We are looking to build upon other related or satellite datasets having the same kind of data, but whose annotations, if they exist, are not adapted to the task. From it, we would produce a working model for our current task, by learning (or fine-tuning) on the small datasets with the task-related annotations. The program is organized around four objectives: 1) To investigate how to better learn models by exploiting knowledge extracted from different tasks, which can be reused or adapted to the current context; 2) To improve meta-learning methods that can learn new concepts from only few samples; 3) To develop new approaches to extract better general representations through unsupervised learning; 4) To apply the novel methods to real-world applications, in order to both assess the practicality of the proposed methods and achieve meaningful contributions in the application domain themselves. Methods investigated within this research program have the potential of making ML and DL usable in a variety of contexts where there are no available big datasets well adapted to the specific task at hand. These ML-based systems will assist humans to adapt quickly to a given task by exploiting similar historical tasks; they will have the capacity for a rapid customization to each user. We are aiming at learning better representations of some modalities (e.g., image, text, speech), usable for a variety of purposes. We will look for discovering mechanisms for AI to adapt to new learning tasks, being able to ramp up performance with only a few examples. Finally, we will apply our techniques to domains such as black-box optimization, super-resolution microscopy, and visual place recognition.