Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Collaborative Research and Development Grants

University of Toronto

$93,989.00

Efficient Distributed DNN Training and Inference_x000d_ _x000d_ _x000d_

EF 2020-21

Résumé
In recent years, deep learning has attracted tremendous attention in the machine learning community and beyond by achieving notable success across a wide spectrum of tasks such as computer vision, machine translationand speech recognition. Training these models, however, take days to weeks or sometimes even months to finish because of the high degree of computational complexity, large number of parameters and large datasets iteratively processed. This high computation cost necessitates distributed training to keep the training time reasonable and also require powerful hardware accelerators such as General Purpose GPUs (graphics processing units) and TPUs (tensor processing units). In this project we aim to investigate several major ways to improve the performance and energy efficiency of DNN training and inference through: (i) data encoding and compression in training; (ii) data encoding and compression in inference; (iii) networking efficiency improvements in distributed DNN training; (iv) training parallelism model research. We will also going to explore the possibility of using domain-specific ML accleration using Huawei NPU training cluster.
Programme
Collaborative Research and Development Grants
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
543833-2019
Name nom
Pekhimenko, Gennady
Department département
Computer and Mathematical Sciences (Scarborough)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2019
Award amount
93989
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Installment
inst:2 - 2
Partie
1
Nb partie
2
Application title
Efficient Distributed DNN Training and Inference_x000d_ _x000d_ _x000d_
Keyword
NSERC
Application summary
In recent years, deep learning has attracted tremendous attention in the machine learning community and beyond by achieving notable success across a wide spectrum of tasks such as computer vision, machine translationand speech recognition. Training these models, however, take days to weeks or sometimes even months to finish because of the high degree of computational complexity, large number of parameters and large datasets iteratively processed. This high computation cost necessitates distributed training to keep the training time reasonable and also require powerful hardware accelerators such as General Purpose GPUs (graphics processing units) and TPUs (tensor processing units). In this project we aim to investigate several major ways to improve the performance and energy efficiency of DNN training and inference through: (i) data encoding and compression in training; (ii) data encoding and compression in inference; (iii) networking efficiency improvements in distributed DNN training; (iv) training parallelism model research. We will also going to explore the possibility of using domain-specific ML accleration using Huawei NPU training cluster.