Grant: Discovery Grants Program - Individual
University of Ottawa
$18,000.00
Large scale markov decision processes in healthcare management
FY 2014-15
Summary
The purpose of this research is to develop a mathematical framework for solving large scale stochastic decision problems and capacity planning within healthcare management. Such decisions include the scheduling of patients to a specific resource and the daily decisions around hospital congestion and ward capacity. A shortage of resources in Canadian hospitals is a chronic and steadily worsening challenge. Thus, the efficient use of what resources are available is becoming increasingly critical. We seek to develop a model that will concurrently determine the optimal decision policy and the optimal capacity allocation. We will look to analyse the impact of available surge capacity (i.e. overtime) and determine the appropriate balance between surge and base capacity. Markov decision processes (MDPs) are an ideal method for solving stochastic decision problems but suffer from two deficiencies. First, MDPs generally solve the decision problem and the capacity planning problem in sequence rather than in parallel. This does not take into account the inter-related nature of these two problems. Second, MDPs are limited in the size of decision problem they can handle. We seek to apply and improve the methodologies of approximate dynamic programming (ADP) that allow the use of MDP theory for large scale stochastic decision problems. The overall contributions of this research are both in the practical applications to healthcare management (in improved resource utilization and evidence-based capacity planning) as well as the discovery of fundamental insights into the inter-related nature of decision policies and capacity planning and the improvement of ADP theory in solving large scale stochastic decision problems.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
355579-2008
Name nom
Patrick, Jonathan
Department département
Telfer School of Management
Organization id
28
Institution établissement
University of Ottawa
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2014
Competition year année de concours
2008
Award amount
18000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
20
Committee name en
Industrial Engineering
Committee name fr
Génie industriel
Area of application code
1205
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Mathematical sciences
Area of application fr
Sciences mathématiques
Research subject code
1601
Research subject group en
Industrial engineering
Research subject group fr
Génie industriel
Research subject en
Operations research and management science
Research subject fr
Recherche opérationnelle et science de la gestion
Partie
7
Nb partie
7
Application title
Large scale markov decision processes in healthcare management
Keyword
NSERC
Application summary
The purpose of this research is to develop a mathematical framework for solving large scale stochastic decision problems and capacity planning within healthcare management. Such decisions include the scheduling of patients to a specific resource and the daily decisions around hospital congestion and ward capacity. A shortage of resources in Canadian hospitals is a chronic and steadily worsening challenge. Thus, the efficient use of what resources are available is becoming increasingly critical. We seek to develop a model that will concurrently determine the optimal decision policy and the optimal capacity allocation. We will look to analyse the impact of available surge capacity (i.e. overtime) and determine the appropriate balance between surge and base capacity. Markov decision processes (MDPs) are an ideal method for solving stochastic decision problems but suffer from two deficiencies. First, MDPs generally solve the decision problem and the capacity planning problem in sequence rather than in parallel. This does not take into account the inter-related nature of these two problems. Second, MDPs are limited in the size of decision problem they can handle. We seek to apply and improve the methodologies of approximate dynamic programming (ADP) that allow the use of MDP theory for large scale stochastic decision problems. The overall contributions of this research are both in the practical applications to healthcare management (in improved resource utilization and evidence-based capacity planning) as well as the discovery of fundamental insights into the inter-related nature of decision policies and capacity planning and the improvement of ADP theory in solving large scale stochastic decision problems.