Grant: Discovery Grants Program - Individual
University of Toronto
$24,000.00
Causal Models for Generalizable Robot Learning
EF 2023-24
Résumé
This proposal aims to build intelligent machines to demonstrate cause-effect reasoning, particularly in novel environments. Humans are remarkably efficient learning systems! An argument in support of our learning efficiency is causality, that is, the ability to infer causation from mere observations. Causal models go beyond the representation of statistical dependence structures towards models that support intervention, planning, and reasoning, realizing Konrad Lorenz' notion of thinking as acting in an imagined space. The acquisition of this causal knowledge is supported by powerful learning mechanisms that allow us to effectively integrate novel evidence with prior beliefs, and generalize behavior to novel problems instances. Understanding and answering questions about the latent mechanisms by which observations take on values or predicting the change in observations based on manipulation of a subset of environment variables is the essence of causal inference. And constructing such causal models has been the focus of attention not only in computer science, but also in physical and biological sciences, as well as psychology and philosophy. However a number of these efforts have only focussed on observational data, and are limited in scale by the need for humans to perform controlled trials. Causal models are distinct from traditional statistical learning methods that study the joint distribution of a set of variables, P(X,Y) with the objective of approximates quantities such as E(Y|X) under a function class. However if such associations are learned disregarding the the underlying generative mechanism, we are left with spurious decisions such as an online system suggesting that we buy a car because we bought tires, since they are "frequently bought together". Causal learning considers a richer class of assumptions, and seeks to exploit the fact that the joint distribution possesses a causal factorization corresponding to the structural assignments. This results in more information for performing better generalization through intervention and counterfactual analysis which is not available to statistical learning models. Computationally efficient causal learning is a central problem driving the next decade of Interactive Robot Learning. - How to learn better from semi-supervised and self-supervised data? -How do we generalize concepts and skill policies to new domains? -How can we efficiently perform continual multi-task learning? -How can we leverage large offline observational datasets in RL?
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2021-04392
Name nom
Garg, Animesh
Department département
Mathematical and Computational Sciences
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2021
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1206
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Engineering
Area of application fr
Génie
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Learning and inference theories
Research subject en
Intelligence artificielle
Research subject fr
Théories de l'apprentissage et l'inférence
Application title
Causal Models for Generalizable Robot Learning
Keyword
Batch Reinforcement Learning; Causal Discovery; Causal Inference; Continual Learning; Imitation Learning; Meta-L Learning; Model Based Reinforcement Learning; Robot Learning,; Robot Manipulation; Transfer learning
Application summary
This proposal aims to build intelligent machines to demonstrate cause-effect reasoning, particularly in novel environments. Humans are remarkably efficient learning systems! An argument in support of our learning efficiency is causality, that is, the ability to infer causation from mere observations. Causal models go beyond the representation of statistical dependence structures towards models that support intervention, planning, and reasoning, realizing Konrad Lorenz' notion of thinking as acting in an imagined space. The acquisition of this causal knowledge is supported by powerful learning mechanisms that allow us to effectively integrate novel evidence with prior beliefs, and generalize behavior to novel problems instances. Understanding and answering questions about the latent mechanisms by which observations take on values or predicting the change in observations based on manipulation of a subset of environment variables is the essence of causal inference. And constructing such causal models has been the focus of attention not only in computer science, but also in physical and biological sciences, as well as psychology and philosophy. However a number of these efforts have only focussed on observational data, and are limited in scale by the need for humans to perform controlled trials. Causal models are distinct from traditional statistical learning methods that study the joint distribution of a set of variables, P(X,Y) with the objective of approximates quantities such as E(Y|X) under a function class. However if such associations are learned disregarding the the underlying generative mechanism, we are left with spurious decisions such as an online system suggesting that we buy a car because we bought tires, since they are "frequently bought together". Causal learning considers a richer class of assumptions, and seeks to exploit the fact that the joint distribution possesses a causal factorization corresponding to the structural assignments. This results in more information for performing better generalization through intervention and counterfactual analysis which is not available to statistical learning models. Computationally efficient causal learning is a central problem driving the next decade of Interactive Robot Learning. - How to learn better from semi-supervised and self-supervised data? -How do we generalize concepts and skill policies to new domains? -How can we efficiently perform continual multi-task learning? -How can we leverage large offline observational datasets in RL?