Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Engage Grants Program

University of Manitoba

$24,913.00

Computer vision and deep learning: Bayesian Reinforcement Learning

EF 2017-18

Résumé
The proposed Engage grant will explore the utility of Bayesian Reinforcement Learning (BRL) and integrate it in to the High Performance computing (HPC) framework of Sightline. In general Reinforcement Learning (RL), is a class of machine learning (ML) methods in which a software agent interacts with an unknown environment, with the goal of learning or finding a policy, to optimize some performance metric. Underlying models include Markov Decision Processes and their variants. BRL is typically competitive and unsupervised with the objective of attempting to estimate a random variable X by producing a probability distribution for X. X is inferred through observations or samples of a related random variable Y. Compounding difficulty is noise associated with measurements or samples of Y. Although well-thought-out and well-designed, BRL has not been widely applied or adopted. Many believe that BRL is still in its infancy in spite of demonstrated successes and this aspect is of direct interest to Sightline who are approaching machine learning from the application perspective. It is anticipated that the combination of powerful models for policy approximation such as those associated with deep probabilistic networks in combination with a BRL approach can further facilitate better exploration-exploitation trade-offs associated with policy optimization. This Engage opportunity will provide Sightline with another ML offering to add to its suite of analytics tools and explore the underutilized and untapped potential of BRL.
Programme
Engage Grants Program
Emplacement
Manitoba, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
512242-2017
Name nom
McLeod, Robert
Department département
Electrical and Computer Engineering
Organization id
19
Institution établissement
University of Manitoba
Province en
Manitoba
Province fr
Manitoba
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2017
Award amount
24913
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1555
Committee name en
Prairie Internal Decision Committee
Committee name fr
Comité de décision interne pour les Prairies
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Partie
1
Nb partie
1
Application title
Computer vision and deep learning: Bayesian Reinforcement Learning
Keyword
NSERC
Application summary
The proposed Engage grant will explore the utility of Bayesian Reinforcement Learning (BRL) and integrate it in to the High Performance computing (HPC) framework of Sightline. In general Reinforcement Learning (RL), is a class of machine learning (ML) methods in which a software agent interacts with an unknown environment, with the goal of learning or finding a policy, to optimize some performance metric. Underlying models include Markov Decision Processes and their variants. BRL is typically competitive and unsupervised with the objective of attempting to estimate a random variable X by producing a probability distribution for X. X is inferred through observations or samples of a related random variable Y. Compounding difficulty is noise associated with measurements or samples of Y. Although well-thought-out and well-designed, BRL has not been widely applied or adopted. Many believe that BRL is still in its infancy in spite of demonstrated successes and this aspect is of direct interest to Sightline who are approaching machine learning from the application perspective. It is anticipated that the combination of powerful models for policy approximation such as those associated with deep probabilistic networks in combination with a BRL approach can further facilitate better exploration-exploitation trade-offs associated with policy optimization. This Engage opportunity will provide Sightline with another ML offering to add to its suite of analytics tools and explore the underutilized and untapped potential of BRL.