Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Western Ontario

$22,000.00

Machine learning for non-myopic decision support and knowledge discovery

EF 2017-18

Résumé
The goal of our proposed research is to develop methods for using data to help humans make good long-term decisions. As a motivating example, consider choosing a medical treatment for a patient with a chronic disorder: in practice, treatment decisions are made based on knowledge about the state of the patient, knowledge about the treatment options currently available, and knowledge about how future decisions will be influenced by the patient's progress over time. Another example is the control of a water reservoir: decisions about how much water to use to generate power or irrigate crops are made based on knowledge about current demand, the state of the reservoir, and about the potential useage decisions that might be made in the future. We say a decision is ""non-myopic"" if it is made based on knowledge of the potential for future decision-making. In both of these examples, ultimately the final decision rests in human hands; however, there is enormous potential for that decision to be guided by sources of sequential data that are becoming more and more ubiquitous. For example, we are now seeing the development of databases that record how thousands or even millions of patients respond to different sequences of treatments over time, and these have the potential to inform non-myopic medical decision making more effectively than previous studies. However, rigorous analysis methods for constructing non-myopic decision aids from data are still in their infancy. Analysis methods in reinforcement learning and machine learning have enormous potential, but in many ways are not suited to decision aid construction: current methods do not effectively account for user preferences, they do not provide appropriate measures of confidence in their recommendations, and they do not account for the cost of gathering new data. My research aims to develop new methods without these shortcomings that can be applied to produce useful decision aids from sequential data. In the long term, as the depth and breadth of sequential medical data increases, the methods will improve the delivery of health care in Canada by providing our medical doctors with new, high-quality evidence to aid them in choosing the best treatments for their patients.
Programme
Discovery Grants Program - Individual
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
418645-2012
Name nom
Lizotte, Daniel
Department département
Computer Science
Organization id
36
Institution établissement
University of Western Ontario
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2012
Award amount
22000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1211
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Medical and health sciences
Area of application fr
Sciences médicales et de la santé
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Partie
6
Nb partie
6
Application title
Machine learning for non-myopic decision support and knowledge discovery
Keyword
NSERC
Application summary
The goal of our proposed research is to develop methods for using data to help humans make good long-term decisions. As a motivating example, consider choosing a medical treatment for a patient with a chronic disorder: in practice, treatment decisions are made based on knowledge about the state of the patient, knowledge about the treatment options currently available, and knowledge about how future decisions will be influenced by the patient's progress over time. Another example is the control of a water reservoir: decisions about how much water to use to generate power or irrigate crops are made based on knowledge about current demand, the state of the reservoir, and about the potential useage decisions that might be made in the future. We say a decision is ""non-myopic"" if it is made based on knowledge of the potential for future decision-making. In both of these examples, ultimately the final decision rests in human hands; however, there is enormous potential for that decision to be guided by sources of sequential data that are becoming more and more ubiquitous. For example, we are now seeing the development of databases that record how thousands or even millions of patients respond to different sequences of treatments over time, and these have the potential to inform non-myopic medical decision making more effectively than previous studies. However, rigorous analysis methods for constructing non-myopic decision aids from data are still in their infancy. Analysis methods in reinforcement learning and machine learning have enormous potential, but in many ways are not suited to decision aid construction: current methods do not effectively account for user preferences, they do not provide appropriate measures of confidence in their recommendations, and they do not account for the cost of gathering new data. My research aims to develop new methods without these shortcomings that can be applied to produce useful decision aids from sequential data. In the long term, as the depth and breadth of sequential medical data increases, the methods will improve the delivery of health care in Canada by providing our medical doctors with new, high-quality evidence to aid them in choosing the best treatments for their patients.