Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Victoria

$25,000.00

Expressive data augmentation in deep learning

EF 2022-23

Résumé
Deep learning is a subfield of machine learning, a type of artificial intelligence, whose goal is to automatically learn how to solve problems using data. For example, a typical task in deep learning is called "image classification", and consists of learning how to categorize images into different categories (e.g. "cat", "dog", "human") when given a dataset of images labeled with their corresponding category. For a human, this task is easy, but since computers can only "see" an image as a bunch of ones and zeros, it is hard to encode how to solve the problem into an algorithm, a set of mechanical instructions that a computer can follow. In recent years, deep learning has enabled new applications where designing such algorithms is difficult, making advances on tasks involving images, audio, and language, among a variety of others. One key limitation of deep learning is that it typically requires a large amount of data in order to work well. In image classification, for example, several thousand to several million labeled images are required for reasonable performance, a prohibitive cost for most applications. To help compensate, it is common to artificially generate new data from existing data, a process known as "data augmentation". A basic example of this is to randomly make slight alterations to an image's brightness while maintaining its label - an image of a cat is still an image of a cat, even if the brightness is changed by a small amount. Data augmentation has the effect of expanding the effective size of the dataset used to learn algorithms without requiring the costly collection of new data. Despite its large utility, a number of challenges exist when using data augmentation, which my research intends to solve. When applying it to a new problem, for example, one needs to define its basic operations (e.g. the random brightness change itself) and decide on their precise strengths, which may be costly. My research will define augmentation operations automatically by learning operations that vary the precise appearance of images while preserving their desired labels. Then, to tune the strength of each operation, my research will investigate the learned behavior of algorithms trained without data augmentation; if algorithm output varies greatly with respect to a particular operation, then it is likely that using strong amounts of it as data augmentation will improve an algorithm's robustness to it. If successful, my research will allow for the automatic creation of expressive data augmentation policies, substantially reducing the amount of data required to unlock new applications of deep learning throughout both research and industry in Canada. One particularly exciting application of this is in medicine, since the data available for most medical tasks is limited. Ideally, the development of both improved and novel diagnostics may be possible, advancing Canadian medical research and eventually the health of the Canadian public as a whole.
Programme
Discovery Grants Program - Individual
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2022-04651
Name nom
Summers, Cecilia
Department département
Computer Science - Computer Science
Organization id
7
Institution établissement
University of Victoria
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2022
Award amount
25000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Intelligence artificielle
Research subject en
Artificial intelligence (computer vision, use2603)
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Installment
inst:1
Partie
1
Nb partie
5
Application title
Expressive data augmentation in deep learning
Application summary
Deep learning is a subfield of machine learning, a type of artificial intelligence, whose goal is to automatically learn how to solve problems using data. For example, a typical task in deep learning is called "image classification", and consists of learning how to categorize images into different categories (e.g. "cat", "dog", "human") when given a dataset of images labeled with their corresponding category. For a human, this task is easy, but since computers can only "see" an image as a bunch of ones and zeros, it is hard to encode how to solve the problem into an algorithm, a set of mechanical instructions that a computer can follow. In recent years, deep learning has enabled new applications where designing such algorithms is difficult, making advances on tasks involving images, audio, and language, among a variety of others. One key limitation of deep learning is that it typically requires a large amount of data in order to work well. In image classification, for example, several thousand to several million labeled images are required for reasonable performance, a prohibitive cost for most applications. To help compensate, it is common to artificially generate new data from existing data, a process known as "data augmentation". A basic example of this is to randomly make slight alterations to an image's brightness while maintaining its label - an image of a cat is still an image of a cat, even if the brightness is changed by a small amount. Data augmentation has the effect of expanding the effective size of the dataset used to learn algorithms without requiring the costly collection of new data. Despite its large utility, a number of challenges exist when using data augmentation, which my research intends to solve. When applying it to a new problem, for example, one needs to define its basic operations (e.g. the random brightness change itself) and decide on their precise strengths, which may be costly. My research will define augmentation operations automatically by learning operations that vary the precise appearance of images while preserving their desired labels. Then, to tune the strength of each operation, my research will investigate the learned behavior of algorithms trained without data augmentation; if algorithm output varies greatly with respect to a particular operation, then it is likely that using strong amounts of it as data augmentation will improve an algorithm's robustness to it. If successful, my research will allow for the automatic creation of expressive data augmentation policies, substantially reducing the amount of data required to unlock new applications of deep learning throughout both research and industry in Canada. One particularly exciting application of this is in medicine, since the data available for most medical tasks is limited. Ideally, the development of both improved and novel diagnostics may be possible, advancing Canadian medical research and eventually the health of the Canadian public as a whole.