Grant: Collaborative Research and Development Grants
University of Toronto
$93,989.00
Efficient Distributed DNN Training and Inference
FY 2019-20
Summary
In recent years, deep learning has attracted tremendous attention in the machine learning community and beyond by achieving notable success across a wide spectrum of tasks such as computer vision, machinetranslationand speech recognition. Training these models, however, take days to weeks or sometimes even months to finish because of the high degree of computational complexity, large number of parameters andlarge datasets iteratively processed. This high computation cost necessitates distributed training to keep the training time reasonable and also require powerful hardware accelerators such as General Purpose GPUs (graphics processing units) and TPUs (tensor processing units).In this project we aim to investigate several major ways to improve the performance and energy efficiency of DNN training and inference through: (i) data encoding and compression in training; (ii) data encoding and compression in inference; (iii) networking efficiency improvements in distributed DNN training; (iv) training parallelism model research. We will also going to explore the possibility of using domain-specific ML accleration using Huawei NPU training cluster.
Program
Collaborative Research and Development Grants
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
543833-2019
Name nom
Pekhimenko, Gennady
Department département
Computer and Mathematical Sciences (Scarborough)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2019
Award amount
93989
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Installment
inst:1 - 1
Partie
1
Nb partie
1
Application title
Efficient Distributed DNN Training and Inference
Keyword
NSERC
Application summary
In recent years, deep learning has attracted tremendous attention in the machine learning community and beyond by achieving notable success across a wide spectrum of tasks such as computer vision, machinetranslationand speech recognition. Training these models, however, take days to weeks or sometimes even months to finish because of the high degree of computational complexity, large number of parameters andlarge datasets iteratively processed. This high computation cost necessitates distributed training to keep the training time reasonable and also require powerful hardware accelerators such as General Purpose GPUs (graphics processing units) and TPUs (tensor processing units).In this project we aim to investigate several major ways to improve the performance and energy efficiency of DNN training and inference through: (i) data encoding and compression in training; (ii) data encoding and compression in inference; (iii) networking efficiency improvements in distributed DNN training; (iv) training parallelism model research. We will also going to explore the possibility of using domain-specific ML accleration using Huawei NPU training cluster.