Grant: Discovery Grants Program - Individual
Université de Montréal
$89,000.00
Autonomous Deep Learning for AI
FY 2024-25
Summary
There has been impressive progress in artificial intelligence (AI) in the last few years thanks to the development of systems based on deep learning, the modern instantiation of artificial neural networks. These advances have been mostly on perception tasks, using supervised learning (often from human-labeled data), and for cognitive tasks - called system 1 tasks - which are performed fast, in an unconscious way, and associated with intuition (i.e., not easy to verbalize). Much remains to be done on the side of actions, as well as cognitive tasks - called system 2 tasks - which are performed slowly and sequentially, in a conscious way, and associated with reasoning and expressed verbally. Actions are important because they allow the learner to intervene in its environment, thus to more easily uncover causal relationships. Uncovering causal explanations is important to generalize far from the typical situations covered by the training data (and humans are much better at this than machines, currently). Actions are also important because they allow the learner to actively seek knowledge, to purposely explore its environment to better understand it. Finally, actual applications of AI of course often require machines to act in complicated ways, e.g., learn a policy, and not just perform a classification. In this context, the proposed research combines the following five interconnected research objectives: (1) explore grounded language learning methods based on jointly learning language and about the world to which it refers (2) explore agent-learning methods to acquire knowledge (including about cause and effect) about the environment that we wish the learner to refer to with natural language (3) develop new learning theory that does not rely on the assumption of a same training and test distribution to one where only the causal mechanisms need to be preserved (4) design deep learning architectures and training frameworks that exploit such a theory in order to learn independent causal mechanisms which, when combined, can be used for building causal explanations and for planning, as well as to lift deep learning from system 1 to joint system 1 and system 2 abilities, and (5) train such systems on grounded language learning and world modeling tasks in virtual environments with a fast research cycle.
Program
Discovery Grants Program - Individual
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2019-04822
Name nom
Bengio, Yoshua
Department département
Informatique et recherche opérationnelle - Informatique et recherche opérationnelle
Organization id
63
Institution établissement
Université de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2019
Award amount
89000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Autonomous Deep Learning for AI
Keywords
machine learning; deep learning; representation learning; agent learning; reinforcement learning; generative models; unsupervised learning; grounded language learning; artificial intelligence; neural networks
Application summary
There has been impressive progress in artificial intelligence (AI) in the last few years thanks to the development of systems based on deep learning, the modern instantiation of artificial neural networks. These advances have been mostly on perception tasks, using supervised learning (often from human-labeled data), and for cognitive tasks - called system 1 tasks - which are performed fast, in an unconscious way, and associated with intuition (i.e., not easy to verbalize). Much remains to be done on the side of actions, as well as cognitive tasks - called system 2 tasks - which are performed slowly and sequentially, in a conscious way, and associated with reasoning and expressed verbally. Actions are important because they allow the learner to intervene in its environment, thus to more easily uncover causal relationships. Uncovering causal explanations is important to generalize far from the typical situations covered by the training data (and humans are much better at this than machines, currently). Actions are also important because they allow the learner to actively seek knowledge, to purposely explore its environment to better understand it. Finally, actual applications of AI of course often require machines to act in complicated ways, e.g., learn a policy, and not just perform a classification. In this context, the proposed research combines the following five interconnected research objectives: (1) explore grounded language learning methods based on jointly learning language and about the world to which it refers (2) explore agent-learning methods to acquire knowledge (including about cause and effect) about the environment that we wish the learner to refer to with natural language (3) develop new learning theory that does not rely on the assumption of a same training and test distribution to one where only the causal mechanisms need to be preserved (4) design deep learning architectures and training frameworks that exploit such a theory in order to learn independent causal mechanisms which, when combined, can be used for building causal explanations and for planning, as well as to lift deep learning from system 1 to joint system 1 and system 2 abilities, and (5) train such systems on grounded language learning and world modeling tasks in virtual environments with a fast research cycle.