Canada Spends Logo

Explore our Budget 2026 analysis

Grant: DND/NSERC Discovery Grant Supplement

University of Toronto

$40,000.00

Deep Learning Hardware: Enabling the next wave of applications and innovation

FY 2017-18

Summary
Over the past few years we have been witnessing unprecedented advances on what computing can do for us. It is suddenly possible to reliably talk to our phones, or to look up information. Online translation between languages have become very reliable and useful. There are vehicles that can drive themselves with very little human supervision, and there are constant news stories about how computers are being put to test to help with many difficult tasks such as medical diagnosis. The one technology behind all these innovations is Deep Learning , a class of computing algorithms that allow computers to learn on their own given enough examples. The core technology behind Deep Learning has been around for decades. However, it is only recently that access to vast amounts of online information became available and computing hardware performance has reached levels that allowed the first practical applications of Deep Learning. While existing hardware was sufficient for these first breakthroughs in Deep Learning, it is not capable enough to sustain innovation. Even worse, while in the past computing hardware performance was improving predictably over the years due to advances in semiconductor technology, this is no longer possible due to fundamental challenges in this technology. One way to deliver the hardware performance increases that will enable further innovation in Deep Learning is to build specialized hardware. This five year research program will investigate such specialized hardware designs enabling Deep Learning researchers to further innovate and to bring us closer to truly intelligent machines. The core concept behind our specialized hardware is that it takes advantage of the values calculated upon during Deep Learning processing. The result will be a programmable, yet specialized architecture that will deliver at least three orders of performance improvements over commodity solutions and that can be tailored to various use scenarios from large scale installations such as data centers to mobile and embedded devices.
Program
DND/NSERC Discovery Grant Supplement
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
DGDND-2017-00010
Name nom
Moshovos, Andreas
Department département
Electrical & Computer Engineering - Electrical & Computer Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2017
Award amount
40000
Program id
DGDND
Program name en
DND/NSERC Discovery Grant Supplement
Program name fr
Supplément aux subventions à la découverte MDN-CRSNG
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
513
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Electrical and electronic machinery and equipment (including computer hardware)
Area of application fr
Machinerie et équipement électriques et électroniques (y compris matériel informatique)
Research subject code
2719
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer architecture and design
Research subject fr
Architecture d'ordinateur et conception
Partie
1
Nb partie
3
Application title
Deep Learning Hardware: Enabling the next wave of applications and innovation
Keyword
NSERC
Application summary
Over the past few years we have been witnessing unprecedented advances on what computing can do for us. It is suddenly possible to reliably talk to our phones, or to look up information. Online translation between languages have become very reliable and useful. There are vehicles that can drive themselves with very little human supervision, and there are constant news stories about how computers are being put to test to help with many difficult tasks such as medical diagnosis. The one technology behind all these innovations is Deep Learning , a class of computing algorithms that allow computers to learn on their own given enough examples. The core technology behind Deep Learning has been around for decades. However, it is only recently that access to vast amounts of online information became available and computing hardware performance has reached levels that allowed the first practical applications of Deep Learning. While existing hardware was sufficient for these first breakthroughs in Deep Learning, it is not capable enough to sustain innovation. Even worse, while in the past computing hardware performance was improving predictably over the years due to advances in semiconductor technology, this is no longer possible due to fundamental challenges in this technology. One way to deliver the hardware performance increases that will enable further innovation in Deep Learning is to build specialized hardware. This five year research program will investigate such specialized hardware designs enabling Deep Learning researchers to further innovate and to bring us closer to truly intelligent machines. The core concept behind our specialized hardware is that it takes advantage of the values calculated upon during Deep Learning processing. The result will be a programmable, yet specialized architecture that will deliver at least three orders of performance improvements over commodity solutions and that can be tailored to various use scenarios from large scale installations such as data centers to mobile and embedded devices.