Grant: Discovery Grants Program - Individual
University of Toronto
$26,000.00
Assistive sequential decision making framework
EF 2019-20
Résumé
This research focuses on developing algorithms to maximize the impact of smart technologies when they are integrated into business processes. We will specifically investigate team decision making problems, in which only a sub-set of decision makers are capable of making decisions optimally to achieve the overarching goal of the entire team. The agents either optimal or sub-optimal make decisions over time as the system makes transitions through states. Upon reaching a decision, each agent will receive a reward conditional on the system state and actions taken by her as well as all other agents.******The proposed decision process is useful in a wide range of applications, from manufacturing to supply chain management to military operations. For instance, the decision process could maximize the productivity of a robotic assembly cell where two robots and a human operator work together to assemble a large automotive component. Rather than separating robots from human operators for safety, the proposed decision processes could help ensure the robots can plan their paths of movement so that they complement the operations done by the human operators while ensuring the safety of the human operators.******The proposed assistive decision process is an extension of the Markov decision processes to multi-agent scenarios as well as reinforcement learning. The presence of multiple decision makers poses challenges such as computational complexity, stability of the process and behavioural modeling of human decision makers. These challenges have resulted in the current literature severely lacking in this area despite the increasing importance of the topic as the society turns more and more automated. This program will tackle these three challenges using dimension reduction, optimal trade-offs between exploration and exploitation, and inverse reinforcement learning. ******This research is timely given the rapid adoption of artificial intelligence and autonomous systems. The assistive decision process can be used as the mathematical backbone in control systems to overcome the challenges that currently limit the use of autonomous multi-agent systems. This work will thus help Canada become a leader in autonomous manufacturing, transportation, surveillance and security, and communications. **
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2019-05460
Name nom
Lee, ChiGuhn
Department département
Mechanical and Industrial Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2019
Award amount
26000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
500
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Manufacturing processes and products
Area of application fr
Procédés et produits industriels
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Installment
inst:1 - 1
Partie
1
Nb partie
1
Application title
Assistive sequential decision making framework
Keyword
NSERC
Application summary
This research focuses on developing algorithms to maximize the impact of smart technologies when they are integrated into business processes. We will specifically investigate team decision making problems, in which only a sub-set of decision makers are capable of making decisions optimally to achieve the overarching goal of the entire team. The agents either optimal or sub-optimal make decisions over time as the system makes transitions through states. Upon reaching a decision, each agent will receive a reward conditional on the system state and actions taken by her as well as all other agents.******The proposed decision process is useful in a wide range of applications, from manufacturing to supply chain management to military operations. For instance, the decision process could maximize the productivity of a robotic assembly cell where two robots and a human operator work together to assemble a large automotive component. Rather than separating robots from human operators for safety, the proposed decision processes could help ensure the robots can plan their paths of movement so that they complement the operations done by the human operators while ensuring the safety of the human operators.******The proposed assistive decision process is an extension of the Markov decision processes to multi-agent scenarios as well as reinforcement learning. The presence of multiple decision makers poses challenges such as computational complexity, stability of the process and behavioural modeling of human decision makers. These challenges have resulted in the current literature severely lacking in this area despite the increasing importance of the topic as the society turns more and more automated. This program will tackle these three challenges using dimension reduction, optimal trade-offs between exploration and exploitation, and inverse reinforcement learning. ******This research is timely given the rapid adoption of artificial intelligence and autonomous systems. The assistive decision process can be used as the mathematical backbone in control systems to overcome the challenges that currently limit the use of autonomous multi-agent systems. This work will thus help Canada become a leader in autonomous manufacturing, transportation, surveillance and security, and communications. **