Grant: Discovery Grants Program - Individual
McMaster University
$43,000.00
Hedging Predictions for Operational Decision Making
FY 2023-24
Summary
Over the past several years, with the growing availability of data, there has been an explosion in research on using machine learning (and statistical) techniques to make predictions. However, less attention has been paid to how to effectively use these predictions to make effective operational decisions, where the predictions are related to demand (processing times, demand quantities). In particular, the stochastic modelling literature is almost exclusively concerned with scenarios where predictions are error-free or where no predictions are available (decisions are based only on distributional information). This proposal addresses this gap in the literature in two directions. The first major focus is on quantifying the "price of misprediction", the cost of naively using predicted values in place of true values, measured against the cost of using only distributional information (no predictions). When the price of misprediction is high, it then becomes of interest to design operational decision policies that extract useful information from the noisy predictions while hedging against the potential negative impacts of prediction errors. The design of such policies is the second major focus of this proposal. To gain insight into these issues, two of the most popular stochastic models will be considered. The first, queueing models, will be studied when predictions of processing times are available. Of particular interest will be the effect of scaling up the size of the system (number of servers) on the price of misprediction and the design of effective server scheduling and job routing strategies. We believe that larger systems are less sensitive to prediction errors. The second, inventory models, will be studied when demand predictions are available. We will study the impact of the prediction accuracy and sensitivity of the impact of prediction error to the cost function being considered, in particular suggesting approaches to determine safety stocks to hedge against prediction errors. For both of these models, implementability will be a key concern. Optimal policies may become quite complicated, so the identification of simple, near optimal policies will be an important consideration that will allow this work to be translated to practice. Beyond addressing gaps in the academic literature, this work is expected to have practical impact. We are already involved in projects for inventory management for blood products, and have seen that demand for some products can be more accurately predicted than others, so our results should inform effective inventory management practices in this domain. Healthcare, retail sales, manufacturing and information systems are other examples of areas that are data-rich and predictions of underlying quantities related to demand are possible (or are already being performed). As such, they are all potential beneficiaries of the proposed research.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2022-05007
Name nom
Down, Douglas
Department département
Department of Computing and Software
Organization id
27
Institution établissement
McMaster University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
43000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
520
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Production and operations management
Area of application fr
Production et gestion des opérations
Research subject code
9999
Research subject group en
Not available
Research subject group fr
Not available
Research subject en
Non disponible
Research subject fr
Non disponible
Application title
Hedging Predictions for Operational Decision Making
Keyword
demand prediction; inventory management; Markov decision processes; prediction errors; processor scheduling; queueing theory; stochastic models
Application summary
Over the past several years, with the growing availability of data, there has been an explosion in research on using machine learning (and statistical) techniques to make predictions. However, less attention has been paid to how to effectively use these predictions to make effective operational decisions, where the predictions are related to demand (processing times, demand quantities). In particular, the stochastic modelling literature is almost exclusively concerned with scenarios where predictions are error-free or where no predictions are available (decisions are based only on distributional information). This proposal addresses this gap in the literature in two directions. The first major focus is on quantifying the "price of misprediction", the cost of naively using predicted values in place of true values, measured against the cost of using only distributional information (no predictions). When the price of misprediction is high, it then becomes of interest to design operational decision policies that extract useful information from the noisy predictions while hedging against the potential negative impacts of prediction errors. The design of such policies is the second major focus of this proposal. To gain insight into these issues, two of the most popular stochastic models will be considered. The first, queueing models, will be studied when predictions of processing times are available. Of particular interest will be the effect of scaling up the size of the system (number of servers) on the price of misprediction and the design of effective server scheduling and job routing strategies. We believe that larger systems are less sensitive to prediction errors. The second, inventory models, will be studied when demand predictions are available. We will study the impact of the prediction accuracy and sensitivity of the impact of prediction error to the cost function being considered, in particular suggesting approaches to determine safety stocks to hedge against prediction errors. For both of these models, implementability will be a key concern. Optimal policies may become quite complicated, so the identification of simple, near optimal policies will be an important consideration that will allow this work to be translated to practice. Beyond addressing gaps in the academic literature, this work is expected to have practical impact. We are already involved in projects for inventory management for blood products, and have seen that demand for some products can be more accurately predicted than others, so our results should inform effective inventory management practices in this domain. Healthcare, retail sales, manufacturing and information systems are other examples of areas that are data-rich and predictions of underlying quantities related to demand are possible (or are already being performed). As such, they are all potential beneficiaries of the proposed research.