Grant: Discovery Grants Program - Individual
University of Waterloo
$62,000.00
Data-driven stochastic dynamic programming approaches for optimal planning of disease screening and chronic disorder management
EF 2022-23
Résumé
Given the transformation towards evidence-based and personalized decision making, powerful data-driven modeling approaches are needed to obtain personalized optimal intervention plans for practical engineering problems. We propose developing novel engineering tools based on stochastic dynamic programming and data analytics to address practical sequential decision making problems. Although proposed research will be applied to cancer screening and chronic-disease management, the focus is on developing engineering methodology.First, we propose a novel bicriteria partially observable Markov decision process (POMDP) to derive the optimal Pareto-efficient policies for particular screening problems. There is limited research on multicriteria POMDPs; the existing approaches are approximations based on methods including state discretization and machine learning. To solve our POMDP exactly, we propose a novel reformulation of the model as a constrained Markov decision process (MDP) by replacing the state space with a limited collection of historical screening observations. Under reasonable conditions, this reformulation provides a tractable model for which we aim to develop efficient solution procedures by reducing the state/action space via structural properties. Using clinical data from literature and Mayo Clinic, Rochester-MN, we will apply this formulation to determine the Pareto-efficient policies for colorectal cancer screening and surveillance. The proposed model may help develop insights to improve and personalize cancer screening practices, a significant contribution as cancer is the leading cause of death in Canada. The proposed approach will also improve the engineering knowledge on POMDPs for other engineering applications.Second, we propose a novel data-driven approach for modeling the progression of irreversibly deteriorating systems (e.g., chronic diseases) and their management. Many systems are monitored by complex scoring systems based on test/inspection results or scores from technical assessments. The proposed data analytics approach will process data from longitudinal records of inspections to identify critical events (tollgates) and estimate future progression of deterioration through these tollgates, by using methods including supervised machine learning, classification, and prediction models. The findings from these proposed prescriptive/predictive analytics tools will then be used to derive an MDP model to optimize the timing of palliative/assistive interventions to decrease the disutility due to deterioration. The proposed methodology will be applied to predict amyotrophic lateral sclerosis (ALS) progression, optimize the timing of ordering assistive devices, and maximize wellbeing of ALS patients using data from Mayo Clinic, Rochester.The proposed research will be extended to consider more general settings.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2018-06596
Name nom
Erenay, Fatih
Department département
Management Sciences - Management Sciences
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2018
Award amount
62000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
520
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Production and operations management
Area of application fr
Production et gestion des opérations
Research subject code
1600
Research subject group en
Industrial engineering
Research subject group fr
Génie industriel
Research subject en
Industrial engineering
Research subject fr
Génie industriel
Installment
inst:5;6
Partie
2
Nb partie
6
Application title
Data-driven stochastic dynamic programming approaches for optimal planning of disease screening and chronic disorder management
Application summary
Given the transformation towards evidence-based and personalized decision making, powerful data-driven modeling approaches are needed to obtain personalized optimal intervention plans for practical engineering problems. We propose developing novel engineering tools based on stochastic dynamic programming and data analytics to address practical sequential decision making problems. Although proposed research will be applied to cancer screening and chronic-disease management, the focus is on developing engineering methodology.First, we propose a novel bicriteria partially observable Markov decision process (POMDP) to derive the optimal Pareto-efficient policies for particular screening problems. There is limited research on multicriteria POMDPs; the existing approaches are approximations based on methods including state discretization and machine learning. To solve our POMDP exactly, we propose a novel reformulation of the model as a constrained Markov decision process (MDP) by replacing the state space with a limited collection of historical screening observations. Under reasonable conditions, this reformulation provides a tractable model for which we aim to develop efficient solution procedures by reducing the state/action space via structural properties. Using clinical data from literature and Mayo Clinic, Rochester-MN, we will apply this formulation to determine the Pareto-efficient policies for colorectal cancer screening and surveillance. The proposed model may help develop insights to improve and personalize cancer screening practices, a significant contribution as cancer is the leading cause of death in Canada. The proposed approach will also improve the engineering knowledge on POMDPs for other engineering applications.Second, we propose a novel data-driven approach for modeling the progression of irreversibly deteriorating systems (e.g., chronic diseases) and their management. Many systems are monitored by complex scoring systems based on test/inspection results or scores from technical assessments. The proposed data analytics approach will process data from longitudinal records of inspections to identify critical events (tollgates) and estimate future progression of deterioration through these tollgates, by using methods including supervised machine learning, classification, and prediction models. The findings from these proposed prescriptive/predictive analytics tools will then be used to derive an MDP model to optimize the timing of palliative/assistive interventions to decrease the disutility due to deterioration. The proposed methodology will be applied to predict amyotrophic lateral sclerosis (ALS) progression, optimize the timing of ordering assistive devices, and maximize wellbeing of ALS patients using data from Mayo Clinic, Rochester.The proposed research will be extended to consider more general settings.