Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Toronto

$54,000.00

Toward More Energy-Efficient Datacenters with Enhanced Programmable Silicon

FY 2019-20

Summary
The ability to fabricate ever more transistors on a semiconductor chip has enabled ever more computation, transforming society with ubiquitous communications, advanced medical imaging, on-demand entertainment delivery and more. We have become accustomed to the cost and energy of computation dropping exponentially over time, enabling new applications and societal benefits that motivate investment in raising computational capabilities further. This virtuous cycle is now under threat as the energy required for a computation no longer drops sufficiently with improved manufacturing of conventional processors (CPUs). There is an alternative: configure specialized hardware into Field Programamble Gate Array (FPGA) chips instead of controlling general CPU hardware with software instructions. This allows FPGAs to use 10% or less of the energy required by a CPU for many computations.***However, FPGAs face their own challenges. First, it is harder to design an application to run on an FPGA than on a CPU, and as improved manufacturing continually increases the logic capacity of FPGAs it is becoming very time-consuming to complete designs that fully utilize them. Second, increasingly computation is moving from special purpose systems such as cell phone base stations, which often employ FPGAs, to centralized data centers, which today almost exclusively use CPUs. Moving computation to data centers enables centralized administration and hardware sharing but Data centers consume tremendous amounts of power (~2% of US electricity demand). They could greatly benefit from the energy-efficiency of FPGAs, but the difficulty of FPGA application design and sharing between applications have limited their use in data centers.****We will make today's high-capacity FPGAs easier to use by creating new modular software tools that let engineers easily connect smaller hardware blocks to create a full application. We will also investigate embedding a communication network in the FPGA chip to make it easier still for hardware blocks to communicate. We will create a new design style that allows applications to be interrupted and swapped in and out of an FPGA over time so it can be shared. Finally, we will scale an FPGA-accelerated simulator and optimizer for light-activated chemotherapy to data center scale, and show how our new tools, FPGA architectures and swappable design style benefit this application. This will both validate our FPGA improvements and help make a promising new cancer therapy practical.***Together the innovations we propose will enable wider use of FPGAs in the data center, reducing energy, operating costs and environmental impact. Furthermore, as energy is the limiting factor in computation today, making more energy-efficient computing practical in data centers is essential for further scaling of computational capabilities, and the new applications and benefits it will enable.**
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2016-05537
Name nom
Betz, Vaughn
Department département
Electrical & Computer Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2016
Award amount
54000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
513
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Electrical and electronic machinery and equipment (including computer hardware)
Area of application fr
Machinerie et équipement électriques et électroniques (y compris matériel informatique)
Research subject code
2504
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Integrated circuits
Research subject fr
Circuits intégrés
Installment
inst:4 - 5
Partie
4
Nb partie
5
Application title
Toward More Energy-Efficient Datacenters with Enhanced Programmable Silicon
Keyword
NSERC
Application summary
The ability to fabricate ever more transistors on a semiconductor chip has enabled ever more computation, transforming society with ubiquitous communications, advanced medical imaging, on-demand entertainment delivery and more. We have become accustomed to the cost and energy of computation dropping exponentially over time, enabling new applications and societal benefits that motivate investment in raising computational capabilities further. This virtuous cycle is now under threat as the energy required for a computation no longer drops sufficiently with improved manufacturing of conventional processors (CPUs). There is an alternative: configure specialized hardware into Field Programamble Gate Array (FPGA) chips instead of controlling general CPU hardware with software instructions. This allows FPGAs to use 10% or less of the energy required by a CPU for many computations.***However, FPGAs face their own challenges. First, it is harder to design an application to run on an FPGA than on a CPU, and as improved manufacturing continually increases the logic capacity of FPGAs it is becoming very time-consuming to complete designs that fully utilize them. Second, increasingly computation is moving from special purpose systems such as cell phone base stations, which often employ FPGAs, to centralized data centers, which today almost exclusively use CPUs. Moving computation to data centers enables centralized administration and hardware sharing but Data centers consume tremendous amounts of power (~2% of US electricity demand). They could greatly benefit from the energy-efficiency of FPGAs, but the difficulty of FPGA application design and sharing between applications have limited their use in data centers.****We will make today's high-capacity FPGAs easier to use by creating new modular software tools that let engineers easily connect smaller hardware blocks to create a full application. We will also investigate embedding a communication network in the FPGA chip to make it easier still for hardware blocks to communicate. We will create a new design style that allows applications to be interrupted and swapped in and out of an FPGA over time so it can be shared. Finally, we will scale an FPGA-accelerated simulator and optimizer for light-activated chemotherapy to data center scale, and show how our new tools, FPGA architectures and swappable design style benefit this application. This will both validate our FPGA improvements and help make a promising new cancer therapy practical.***Together the innovations we propose will enable wider use of FPGAs in the data center, reducing energy, operating costs and environmental impact. Furthermore, as energy is the limiting factor in computation today, making more energy-efficient computing practical in data centers is essential for further scaling of computational capabilities, and the new applications and benefits it will enable.**