Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Guelph

$48,000.00

Yielding and Exploiting Confidence in Deep Learning

FY 2020-21

Summary
The scale of research and application of deep learning continues to accelerate. In our work and our daily lives, we see more dependence on these systems for making predictions. In some cases, they are automated, and in others, they involve humans "in-the-loop". Unfortunately, these systems can fail silently. Examples of failure include erroneous yet highly confident predictions, as well as susceptibility to adversarial attacks and so-called fooling images. One way to build more fault-tolerant machine learning systems is to calibrate their confidence or uncertainty measures for interpretation by humans or other systems. Such measures are useful, for example, to refer data points to a human expert or another system for further processing. Proposing different techniques for estimating confidence or uncertainty is an active area of research. Most approaches aim to either estimate or re-calibrate a confidence measure after training; however, there are many uses for confidence throughout learning. Examples include choosing additional data points for annotation (active learning), selecting which examples to visit next (self-paced learning), and learning with a reject option. I propose a research program that will focus on novel and efficient ways of expressing, quantifying, and channeling confidence, both in training and deploying machine learning systems. The long-term goal is toward systems with more responsibility in their autonomy and improved collaboration with humans. It will span three activities. Modulating the learning experience We will compare and develop different confidence measures to: 1) enable a system to optimally ask for "hints" from an oracle; 2) modulate the type and amount of data augmentation applied to an input; and 3) choose among auxiliary tasks. Our goal is to learn faster with less human-labeled examples. Confidence and conditional computation We will investigate dynamic network architectures whose processing depends on the input through confidence estimates. For example, during training, a simple example could require very little computation, a moderate example could require more computation, and a difficult example could be ignored and revisited at a future epoch. Our goal is to optimize computation during training and deployment. Evaluation and cross-discipline collaboration In reporting performance, typical machine learning benchmarks do not consider that some tasks are more costly than others. Moreover, confidence estimates are rarely evaluated directly: they use proxies like out-of-distribution or adversarial example detection. We will work with neuroscientists to assess methods for quantifying confidence in human decision making and gain a better understanding of its role in human learning. We will develop a standard benchmark for the use of confidence in machine learning. This research program will develop more robust, efficient, and transparent deep learning models designed to improve life.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2019-04737
Name nom
Taylor, Graham
Department département
School of Engineering
Organization id
24
Institution établissement
University of Guelph
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2019
Award amount
48000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2805
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Learning and inference theories
Research subject fr
Théories de l'apprentissage et l'inférence
Installment
inst:2-5
Partie
4
Nb partie
5
Application title
Yielding and Exploiting Confidence in Deep Learning
Keyword
NSERC
Application summary
The scale of research and application of deep learning continues to accelerate. In our work and our daily lives, we see more dependence on these systems for making predictions. In some cases, they are automated, and in others, they involve humans "in-the-loop". Unfortunately, these systems can fail silently. Examples of failure include erroneous yet highly confident predictions, as well as susceptibility to adversarial attacks and so-called fooling images. One way to build more fault-tolerant machine learning systems is to calibrate their confidence or uncertainty measures for interpretation by humans or other systems. Such measures are useful, for example, to refer data points to a human expert or another system for further processing. Proposing different techniques for estimating confidence or uncertainty is an active area of research. Most approaches aim to either estimate or re-calibrate a confidence measure after training; however, there are many uses for confidence throughout learning. Examples include choosing additional data points for annotation (active learning), selecting which examples to visit next (self-paced learning), and learning with a reject option. I propose a research program that will focus on novel and efficient ways of expressing, quantifying, and channeling confidence, both in training and deploying machine learning systems. The long-term goal is toward systems with more responsibility in their autonomy and improved collaboration with humans. It will span three activities. Modulating the learning experience We will compare and develop different confidence measures to: 1) enable a system to optimally ask for "hints" from an oracle; 2) modulate the type and amount of data augmentation applied to an input; and 3) choose among auxiliary tasks. Our goal is to learn faster with less human-labeled examples. Confidence and conditional computation We will investigate dynamic network architectures whose processing depends on the input through confidence estimates. For example, during training, a simple example could require very little computation, a moderate example could require more computation, and a difficult example could be ignored and revisited at a future epoch. Our goal is to optimize computation during training and deployment. Evaluation and cross-discipline collaboration In reporting performance, typical machine learning benchmarks do not consider that some tasks are more costly than others. Moreover, confidence estimates are rarely evaluated directly: they use proxies like out-of-distribution or adversarial example detection. We will work with neuroscientists to assess methods for quantifying confidence in human decision making and gain a better understanding of its role in human learning. We will develop a standard benchmark for the use of confidence in machine learning. This research program will develop more robust, efficient, and transparent deep learning models designed to improve life.
University of Guelph - $48,000 Grant (2020-21) | Canada Spends