Grant: Discovery Grants Program - Individual
University of Guelph
$48,000.00
Yielding and Exploiting Confidence in Deep Learning
EF 2022-23
Résumé
The scale of research and application of deep learning continues to accelerate. In our work and our daily lives, we see more dependence on these systems for making predictions. In some cases, they are automated, and in others, they involve humans "in-the-loop". Unfortunately, these systems can fail silently. Examples of failure include erroneous yet highly confident predictions, as well as susceptibility to adversarial attacks and so-called fooling images. One way to build more fault-tolerant machine learning systems is to calibrate their confidence or uncertainty measures for interpretation by humans or other systems. Such measures are useful, for example, to refer data points to a human expert or another system for further processing. Proposing different techniques for estimating confidence or uncertainty is an active area of research. Most approaches aim to either estimate or re-calibrate a confidence measure after training; however, there are many uses for confidence throughout learning. Examples include choosing additional data points for annotation (active learning), selecting which examples to visit next (self-paced learning), and learning with a reject option. I propose a research program that will focus on novel and efficient ways of expressing, quantifying, and channeling confidence, both in training and deploying machine learning systems. The long-term goal is toward systems with more responsibility in their autonomy and improved collaboration with humans. It will span three activities. Modulating the learning experience We will compare and develop different confidence measures to: 1) enable a system to optimally ask for "hints" from an oracle; 2) modulate the type and amount of data augmentation applied to an input; and 3) choose among auxiliary tasks. Our goal is to learn faster with less human-labeled examples. Confidence and conditional computation We will investigate dynamic network architectures whose processing depends on the input through confidence estimates. For example, during training, a simple example could require very little computation, a moderate example could require more computation, and a difficult example could be ignored and revisited at a future epoch. Our goal is to optimize computation during training and deployment. Evaluation and cross-discipline collaboration In reporting performance, typical machine learning benchmarks do not consider that some tasks are more costly than others. Moreover, confidence estimates are rarely evaluated directly: they use proxies like out-of-distribution or adversarial example detection. We will work with neuroscientists to assess methods for quantifying confidence in human decision making and gain a better understanding of its role in human learning. We will develop a standard benchmark for the use of confidence in machine learning. This research program will develop more robust, efficient, and transparent deep learning models designed to improve life.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2019-04737
Name nom
Taylor, Graham
Department département
Engineering, School of - Engineering, School of
Organization id
24
Institution établissement
University of Guelph
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2019
Award amount
48000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Installment
inst:4
Partie
1
Nb partie
5
Application title
Yielding and Exploiting Confidence in Deep Learning
Application summary
The scale of research and application of deep learning continues to accelerate. In our work and our daily lives, we see more dependence on these systems for making predictions. In some cases, they are automated, and in others, they involve humans "in-the-loop". Unfortunately, these systems can fail silently. Examples of failure include erroneous yet highly confident predictions, as well as susceptibility to adversarial attacks and so-called fooling images. One way to build more fault-tolerant machine learning systems is to calibrate their confidence or uncertainty measures for interpretation by humans or other systems. Such measures are useful, for example, to refer data points to a human expert or another system for further processing. Proposing different techniques for estimating confidence or uncertainty is an active area of research. Most approaches aim to either estimate or re-calibrate a confidence measure after training; however, there are many uses for confidence throughout learning. Examples include choosing additional data points for annotation (active learning), selecting which examples to visit next (self-paced learning), and learning with a reject option. I propose a research program that will focus on novel and efficient ways of expressing, quantifying, and channeling confidence, both in training and deploying machine learning systems. The long-term goal is toward systems with more responsibility in their autonomy and improved collaboration with humans. It will span three activities. Modulating the learning experience We will compare and develop different confidence measures to: 1) enable a system to optimally ask for "hints" from an oracle; 2) modulate the type and amount of data augmentation applied to an input; and 3) choose among auxiliary tasks. Our goal is to learn faster with less human-labeled examples. Confidence and conditional computation We will investigate dynamic network architectures whose processing depends on the input through confidence estimates. For example, during training, a simple example could require very little computation, a moderate example could require more computation, and a difficult example could be ignored and revisited at a future epoch. Our goal is to optimize computation during training and deployment. Evaluation and cross-discipline collaboration In reporting performance, typical machine learning benchmarks do not consider that some tasks are more costly than others. Moreover, confidence estimates are rarely evaluated directly: they use proxies like out-of-distribution or adversarial example detection. We will work with neuroscientists to assess methods for quantifying confidence in human decision making and gain a better understanding of its role in human learning. We will develop a standard benchmark for the use of confidence in machine learning. This research program will develop more robust, efficient, and transparent deep learning models designed to improve life.