Grant: Alliance Grants
University of Toronto
$155,429.00
Transfer learning for continual learning in non-stationary environments
EF 2021-22
Résumé
Currently available artificial intelligence algorithms require re-training whenever their application environment undergoes fundamental changes and a new task is given. The ability to build an automated algorithm that can learn reliably under changing situations will therefore set new standards in the field. The main goal of this project is to develop new frameworks in which reinforcement learning algorithms can perform more stably and achieve higher sample and computational efficiency among a set of similar tasks in stochastic environment. That is, we intend to use transfer learning to address continual learning in non-stationary environments. To do so, we propose the following three objectives:1) We will build adaptive neural network-based reinforcement learning models that will construct a knowledge representation that fits the non-stationary environmental complexity. This can be understood as a particular type of continual learning.2) We will evaluate the performance of the developed frameworks/models in real-world applications which will be identified in collaboration with LG Electronics Canada. The identified problems may involve vision inspection data as inputs.3) We will investigate how these frameworks/models perform when transferred to new environments in terms of dynamics, rewards and goals. The transfer learning frameworks/models will be combined with the developed continual learning frameworks/models.To sum up, the proposed project is to advance the current state-of-the-art of reinforcement learning so as to improve the sample and computational efficiency across similarly configured tasks and to robustify its performance in non-stationary environment.
Programme
Alliance Grants
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
553522-2020
Name nom
Lee, Chi-Guhn
Department département
Mechanical and Industrial Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2021
Competition year année de concours
2020
Award amount
155429
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
405
Area of application group en
Environment
Area of application group fr
Environnement
Area of application en
Modelling and mathematical simulation of natural processes
Area of application fr
Modélisation et simulation mathématique des processus naturels
Research subject code
2803
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Knowledge representation
Research subject fr
Répresentation des connaissances
Installment
inst:2
Partie
1
Nb partie
2
Application title
Transfer learning for continual learning in non-stationary environments
Keyword
NSERC
Application summary
Currently available artificial intelligence algorithms require re-training whenever their application environment undergoes fundamental changes and a new task is given. The ability to build an automated algorithm that can learn reliably under changing situations will therefore set new standards in the field. The main goal of this project is to develop new frameworks in which reinforcement learning algorithms can perform more stably and achieve higher sample and computational efficiency among a set of similar tasks in stochastic environment. That is, we intend to use transfer learning to address continual learning in non-stationary environments. To do so, we propose the following three objectives:1) We will build adaptive neural network-based reinforcement learning models that will construct a knowledge representation that fits the non-stationary environmental complexity. This can be understood as a particular type of continual learning.2) We will evaluate the performance of the developed frameworks/models in real-world applications which will be identified in collaboration with LG Electronics Canada. The identified problems may involve vision inspection data as inputs.3) We will investigate how these frameworks/models perform when transferred to new environments in terms of dynamics, rewards and goals. The transfer learning frameworks/models will be combined with the developed continual learning frameworks/models.To sum up, the proposed project is to advance the current state-of-the-art of reinforcement learning so as to improve the sample and computational efficiency across similarly configured tasks and to robustify its performance in non-stationary environment.