Grant: Discovery Grants Program - Individual
University of British Columbia
$17,000.00
Nonhomogeneous Markov decision processes in medical decision making
EF 2007-08
Résumé
The purpose of this proposal is to develop a mathematical framework for sequential stochastic decision making when the set of available actions, and their effects, changes over time. Modeled as nonhomogeneous Markov decision processes (MDPs), such situations apply to decisions about equipment replacement, facility location, and workforce planning. Our motivation comes from medical decision making questions. For example, when should a patient initiate or switch drug therapies when billions of dollars are invested annually in the research and development (R&D) of new therapies? Standard decision models do not consider this dynamic, yet websites have recently been created to disseminate information to physicians and their patients on clinical trials under way and results from trials already completed. Presumably, models that explicitly consider the uncertainty around effective therapies becoming available in the future would yield different results than models that do not consider this uncertainty. The proposed research aims to quantify differences between models that do not consider evolving actions and effects, and models that do consider these dynamics. In doing this, we will develop methods for estimating model parameters that describe R&D, such as probabilities of therapies becoming available at different times in the future, along with their effects. Other methodological contributions will include discovering structural properties of optimal solutions and finding efficient solution algorithms. The overall contributions of this research are both in the practical applications to medical decision making problems as well as the discovery of fundamental insights when considering time-varying action sets in MDPs.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
341415-2007
Name nom
Shechter, Steven
Department département
Sauder School of Business
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2007
Competition year année de concours
2007
Award amount
17000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
20
Committee name en
Industrial Engineering
Committee name fr
Génie industriel
Area of application code
1205
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Mathematical sciences
Area of application fr
Sciences mathématiques
Research subject code
1601
Research subject group en
Industrial engineering
Research subject group fr
Génie industriel
Research subject en
Operations research and management science
Research subject fr
Recherche opérationnelle et science de la gestion
Partie
1
Nb partie
5
Application title
Nonhomogeneous Markov decision processes in medical decision making
Keyword
NA
Application summary
The purpose of this proposal is to develop a mathematical framework for sequential stochastic decision making when the set of available actions, and their effects, changes over time. Modeled as nonhomogeneous Markov decision processes (MDPs), such situations apply to decisions about equipment replacement, facility location, and workforce planning. Our motivation comes from medical decision making questions. For example, when should a patient initiate or switch drug therapies when billions of dollars are invested annually in the research and development (R&D) of new therapies? Standard decision models do not consider this dynamic, yet websites have recently been created to disseminate information to physicians and their patients on clinical trials under way and results from trials already completed. Presumably, models that explicitly consider the uncertainty around effective therapies becoming available in the future would yield different results than models that do not consider this uncertainty. The proposed research aims to quantify differences between models that do not consider evolving actions and effects, and models that do consider these dynamics. In doing this, we will develop methods for estimating model parameters that describe R&D, such as probabilities of therapies becoming available at different times in the future, along with their effects. Other methodological contributions will include discovering structural properties of optimal solutions and finding efficient solution algorithms. The overall contributions of this research are both in the practical applications to medical decision making problems as well as the discovery of fundamental insights when considering time-varying action sets in MDPs.