Grant: Alliance Grants
McGill University
$45,000.00
Broader Self-Supervised Learning with applications in anomaly detection, tabular data, and visual reinforcement learning
FY 2024-25
Summary
Deep Learning methods have enabled massive progress to be made on challenges that seemed far out of reach just a few years ago, for example, effective and commercially viable object recognition, speech recognition, and machine translation. Many of these breakthroughs have been based on the supervised learning paradigm. Despite their great success these systems are imperfect and do not work in all cases, furthermore, a variety of applications have yet to be successfully addressed (e.g. tabular data). Fortunately, it has been repeatedly demonstrated that larger datasets and models can further improve performance. To scale deep learning methods to a wider variety of applications with economic and social benefits, the need for labels is a limiting factor. In recent years the unsupervised learning paradigm, long believed to be critical to the success of AI, has begun to yield promising results. Specifically, self-supervised learning, where unlabeled input data is used to form targets for supervised learning paradigms has shown to yield reusable representations for a variety of downstream tasks. However, a number of challenges remain in making self-supervised representation learning more broadly useful. This approach relies on a number of highly domain-specific algorithm constructions (e.g. image specific data-augmentation) and has been shown to yield features useful for specific downstream tasks (e.g. image classification) but not useful for others (e.g. reinforcement learning in visual environments). In the proposed 3-year research project we will develop new approaches that will aim to make these methods applicable to a new set of domains and tasks. We will target a key set of application areas including anomaly detection, tabular data, and visual reinforcement learning.
Program
Alliance Grants
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
577169-2022
Name nom
Armanfard, Narges N
Department département
Electrical and Computer Engineering
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
45000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2804
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Expert systems
Research subject fr
Systèmes experts
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Broader Self-Supervised Learning with applications in anomaly detection, tabular data, and visual reinforcement learning
Keywords
anomaly detection; deep learning; reinforcement learning; self supervised learning; tabular data analysis; visual reasoning
Application summary
Deep Learning methods have enabled massive progress to be made on challenges that seemed far out of reach just a few years ago, for example, effective and commercially viable object recognition, speech recognition, and machine translation. Many of these breakthroughs have been based on the supervised learning paradigm. Despite their great success these systems are imperfect and do not work in all cases, furthermore, a variety of applications have yet to be successfully addressed (e.g. tabular data). Fortunately, it has been repeatedly demonstrated that larger datasets and models can further improve performance. To scale deep learning methods to a wider variety of applications with economic and social benefits, the need for labels is a limiting factor. In recent years the unsupervised learning paradigm, long believed to be critical to the success of AI, has begun to yield promising results. Specifically, self-supervised learning, where unlabeled input data is used to form targets for supervised learning paradigms has shown to yield reusable representations for a variety of downstream tasks. However, a number of challenges remain in making self-supervised representation learning more broadly useful. This approach relies on a number of highly domain-specific algorithm constructions (e.g. image specific data-augmentation) and has been shown to yield features useful for specific downstream tasks (e.g. image classification) but not useful for others (e.g. reinforcement learning in visual environments). In the proposed 3-year research project we will develop new approaches that will aim to make these methods applicable to a new set of domains and tasks. We will target a key set of application areas including anomaly detection, tabular data, and visual reinforcement learning.