Grant: Idea to Innovation
University of Toronto
$112,500.00
Phase I: laconic: a deep learning accelerator for energy efficiency and high-performance for edge devices
FY 2018-19
Summary
Machine Learning is transforming commerce, medicine, science, and virtually every aspect of modern life. Canada has been at the forefront of innovation in Machine Learning as we have been steadily investing in the area for decades. Machine learning would not have been possible without the computing power that modern commodity hardware was able to deliver. Further innovation will have to rely heavily in advances in computational power and thus efficiency.* Over the course of 4+ years we have been developing computing hardware concepts and device designs that deliver an order of magnitude faster data processing capability and energy efficiency than commodity hardware for Deep Learning (DL). With our 20+ years of experience in designing techniques for high-performance computing systems, we leapfrogged over first generation optimizations and instead invested in high-risk complementary techniques. Our approach was to identify and exploit typical yet fundamental properties of the value stream of Deep Learning. The results surpassed our expectations.* Our efforts culminated into Laconic, a design that outperforms other accelerators by an order of magnitude. Laconic exploits fundamental low-level value properties in Deep Learning models and requires no help from the programmer. While Laconic can be configured to target multiple market segments, we will target ""edge"" (embedded/mobile) applications as our previously-funded NSERC Market Assessment has shown great potential there. Our key competitive advantage is that Laconic will allow: 1) the deployment of more sophisticated and accurate DL networks, 2) a drastic reduction in energy consumption and thus improvement in up-time for mobile devices while making the system more portable and usable in a variety of scenarios. We have proven the potential of Laconic through industry standard methodologies for early design exploration. We are seeking Phase I support to build a proof-of-concept demonstration prototype which is essential for attracting interest from partner and investment organizations (some already express strong interest).*
Program
Idea to Innovation
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
530383-2018
Name nom
Moshovos, Andreas
Department département
Electrical & Computer Engineering, Edward S. Rogers Sr. Department of
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
112500
Program id
I2IPJ
Program name en
Idea to Innovation
Program name fr
De l'idée à l'innovation
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
513
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Electrical and electronic machinery and equipment (including computer hardware)
Area of application fr
Machinerie et équipement électriques et électroniques (y compris matériel informatique)
Research subject code
2719
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer architecture and design
Research subject fr
Architecture d'ordinateur et conception
Partie
1
Nb partie
1
Application title
Phase I: laconic: a deep learning accelerator for energy efficiency and high-performance for edge devices
Keyword
NSERC
Application summary
Machine Learning is transforming commerce, medicine, science, and virtually every aspect of modern life. Canada has been at the forefront of innovation in Machine Learning as we have been steadily investing in the area for decades. Machine learning would not have been possible without the computing power that modern commodity hardware was able to deliver. Further innovation will have to rely heavily in advances in computational power and thus efficiency.* Over the course of 4+ years we have been developing computing hardware concepts and device designs that deliver an order of magnitude faster data processing capability and energy efficiency than commodity hardware for Deep Learning (DL). With our 20+ years of experience in designing techniques for high-performance computing systems, we leapfrogged over first generation optimizations and instead invested in high-risk complementary techniques. Our approach was to identify and exploit typical yet fundamental properties of the value stream of Deep Learning. The results surpassed our expectations.* Our efforts culminated into Laconic, a design that outperforms other accelerators by an order of magnitude. Laconic exploits fundamental low-level value properties in Deep Learning models and requires no help from the programmer. While Laconic can be configured to target multiple market segments, we will target ""edge"" (embedded/mobile) applications as our previously-funded NSERC Market Assessment has shown great potential there. Our key competitive advantage is that Laconic will allow: 1) the deployment of more sophisticated and accurate DL networks, 2) a drastic reduction in energy consumption and thus improvement in up-time for mobile devices while making the system more portable and usable in a variety of scenarios. We have proven the potential of Laconic through industry standard methodologies for early design exploration. We are seeking Phase I support to build a proof-of-concept demonstration prototype which is essential for attracting interest from partner and investment organizations (some already express strong interest).*