Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Launch Supplement

York University

$12,500.00

Leveraging AI-Enhanced Explainable Risk Aware Reinforcement Learning Model for Advancing Dynamic Decision Systems

FY 2024-25

Summary
Introduction: Reinforcement learning (RL) represents a transformative paradigm in the realm of machine learning, offering a dynamic approach to decision-making and optimization, distinct from traditional supervised and unsupervised methods. Our innovative approach, Longitudinal Adaptive Risk-Aware Reinforcement Learning (L-ARRL), takes RL to a new level by addressing decision-making scenarios characterized by multiple risks. Unlike classical RL strategies that prioritize reward maximization without considering evolving multi-risk factors, L-ARRL introduces a mechanism for incorporating risk awareness longitudinally into the decision-making process. This paradigm shift is crucial, particularly in real-world applications where a blind pursuit of rewards can lead to undesirable outcomes. L-ARRL's primary innovation lies in its adaptability, multi-risk assessment, and the ability to provide interpretable decision support. Objectives: The first aim of our project is to create an L-ARRL model that thrives in dynamic environments, effectively balances rewards and multiple risks and offers continuous risk assessment. This model signifies a significant breakthrough in reinforcement learning, with applications extending from personalized medication regimens to equitable resource allocation in various domains. Our second objective centers on demystifying the often-opaque nature of ML models by making L-ARRL predictions more interpretable. Through the integration of attention mechanisms, we aim to shed light on the factors influencing decisions, facilitating validation by experts. Additionally, our goal is to seamlessly integrate the model into a user-friendly web application, providing real-world benefits by assisting in complex decision-making processes. Novelty and Significance: The distinctive features of L-ARRL, including adaptability, multi-risk assessment, and enhanced interpretability, mark a significant advancement in reinforcement learning. Its applications span various domains, offering a bridge between system development and real-world implementation. Our Longitudinal Adaptive Risk-Aware Reinforcement Learning (L-ARRL) approach revolutionizes decision-making in complex, evolving, and risk-laden longitudinal data scenarios. Unlike conventional reinforcement learning, which often prioritizes reward maximization at the expense of real-time risk considerations, L-ARRL introduces a novel mechanism for personalized, risk-aware decision-making over time. This shift addresses critical real-world concerns where a sole focus on rewards can yield undesirable outcomes. L-ARRL's key innovation lies in its ability to provide transparent and adaptable solutions, enhancing decision-making across diverse domains, with healthcare as just one example. By tailoring treatment strategies to individual needs in dynamic healthcare settings, L-ARRL has the potential to promote fairness and responsive healthcare decisions.
Program
Discovery Launch Supplement
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
DGECR-2024-00191
Name nom
Sharma, Divya
Department département
Mathematics and Statistics - Mathematics and Statistics
Organization id
38
Institution établissement
York University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
12500
Program id
DGECR
Program name en
Discovery Launch Supplement
Program name fr
Supplément Tremplin vers la découverte
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1101
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Human health (including medically-related psychological research)
Area of application fr
Santé publique (y compris recherche psychologique liée à la médecine)
Research subject code
3005
Research subject group en
Statistics and probability
Research subject group fr
Statistique et probabilité
Research subject en
Biostatistics
Research subject fr
Biostatistiques
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Leveraging AI-Enhanced Explainable Risk Aware Reinforcement Learning Model for Advancing Dynamic Decision Systems
Keywords
machine learning; artificial intelligence; reinforcement learning; dynamic modeling; drug dosage prediction; immunosuppressants; liver transplant; personalized medicine; explainable modelling; risk prediction
Application summary
Introduction: Reinforcement learning (RL) represents a transformative paradigm in the realm of machine learning, offering a dynamic approach to decision-making and optimization, distinct from traditional supervised and unsupervised methods. Our innovative approach, Longitudinal Adaptive Risk-Aware Reinforcement Learning (L-ARRL), takes RL to a new level by addressing decision-making scenarios characterized by multiple risks. Unlike classical RL strategies that prioritize reward maximization without considering evolving multi-risk factors, L-ARRL introduces a mechanism for incorporating risk awareness longitudinally into the decision-making process. This paradigm shift is crucial, particularly in real-world applications where a blind pursuit of rewards can lead to undesirable outcomes. L-ARRL's primary innovation lies in its adaptability, multi-risk assessment, and the ability to provide interpretable decision support. Objectives: The first aim of our project is to create an L-ARRL model that thrives in dynamic environments, effectively balances rewards and multiple risks and offers continuous risk assessment. This model signifies a significant breakthrough in reinforcement learning, with applications extending from personalized medication regimens to equitable resource allocation in various domains. Our second objective centers on demystifying the often-opaque nature of ML models by making L-ARRL predictions more interpretable. Through the integration of attention mechanisms, we aim to shed light on the factors influencing decisions, facilitating validation by experts. Additionally, our goal is to seamlessly integrate the model into a user-friendly web application, providing real-world benefits by assisting in complex decision-making processes. Novelty and Significance: The distinctive features of L-ARRL, including adaptability, multi-risk assessment, and enhanced interpretability, mark a significant advancement in reinforcement learning. Its applications span various domains, offering a bridge between system development and real-world implementation. Our Longitudinal Adaptive Risk-Aware Reinforcement Learning (L-ARRL) approach revolutionizes decision-making in complex, evolving, and risk-laden longitudinal data scenarios. Unlike conventional reinforcement learning, which often prioritizes reward maximization at the expense of real-time risk considerations, L-ARRL introduces a novel mechanism for personalized, risk-aware decision-making over time. This shift addresses critical real-world concerns where a sole focus on rewards can yield undesirable outcomes. L-ARRL's key innovation lies in its ability to provide transparent and adaptable solutions, enhancing decision-making across diverse domains, with healthcare as just one example. By tailoring treatment strategies to individual needs in dynamic healthcare settings, L-ARRL has the potential to promote fairness and responsive healthcare decisions.