Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Toronto

$110,000.00

Software-Specified Hardware Acceleration for Energy-Efficient Computing

FY 2023-24

Summary
Whether it be Uber ride-sharing, social media, or Netflix video streaming, data centre (cloud) computing is the "workhorse" behind countless applications we depend on in today's digital connected society. Data centres represent about 3% of the world's total energy consumption, however, a recent study predicted that they may account for an astounding ~7% of the world's electricity consumed by 2030. The majority of computational work in data centres is done by standard microprocessors. While such processors benefit from logic density increases afforded by Moore's Law, energy efficiency has not improved at the same rate. A proven approach to raise energy efficiency is to customize the computing hardware to the computing task, eliminating the overheads incurred by a generic microprocessor, such as fetching/decoding instructions. Field-programmable gate arrays (FPGAs) are programmable chips that can be configured to realize any digital circuit. FPGAs are thus an ideal media on which to implement custom compute accelerators in data centres, and have been shown to produce orders-of-magnitude improvements in energy efficiency. Major cloud-computing providers have recently announced the deployment of FPGAs in their data centres -- a "game changer" for what was once seen as a niche technology. FPGAs are now a part of the sharing economy: from anywhere in the world, one can rent a cloud FPGA for accelerated energy-efficient custom computing.    FPGAs are poised for a prominent role in energy-efficient data centre computing, however, a challenge is that they are difficult to use by software engineers for two primary reasons: 1) implementing a circuit on an FPGA has historically required knowledge of hardware design, where the circuit is described at a low level of abstraction in a hardware description language, such as VHDL or Verilog, and 2) compiling a design for an FPGA is time intensive, taking up to hours or days, preventing the real-time design -> debug -> execute iterative cycle that software engineers are accustomed to. What is needed is for FPGAs to be software programmable, with the desired behaviour specified at a high level of abstraction, and new approaches and architectures that permit such specifications to be rapidly compiled into the underlying FPGA hardware.    A first thrust undertaken to address the FPGA usability challenge is the application of machine learning techniques within high-level synthesis (HLS). HLS is the automated synthesis of a hardware circuit from a software program. Presently, the quality of circuit (power, performance, area) produced by HLS tools is inferior to human-expert designed hardware. HLS tools are by nature heuristic approaches, and we propose to apply machine learning algorithms, within HLS itself, to raise circuit quality. A second research thrust concerns the architecture of the target FPGA. We propose to attack today's lengthy compile times through compile-time-friendly architectural changes.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2019-05785
Name nom
Anderson, Jason
Department département
Electrical & Computer Engineering - Electrical & Computer Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2019
Award amount
110000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
513
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Electrical and electronic machinery and equipment (including computer hardware)
Area of application fr
Machinerie et équipement électriques et électroniques (y compris matériel informatique)
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Information technology
Research subject en
Technologie de l'information
Research subject fr
Technologie de l'information
Application title
Software-Specified Hardware Acceleration for Energy-Efficient Computing
Keyword
Acceleration; Field-programmable gate arrays; Hardware; High-level synthesis; Integrated circuit; Overlays; Performance; Power
Application summary
Whether it be Uber ride-sharing, social media, or Netflix video streaming, data centre (cloud) computing is the "workhorse" behind countless applications we depend on in today's digital connected society. Data centres represent about 3% of the world's total energy consumption, however, a recent study predicted that they may account for an astounding ~7% of the world's electricity consumed by 2030. The majority of computational work in data centres is done by standard microprocessors. While such processors benefit from logic density increases afforded by Moore's Law, energy efficiency has not improved at the same rate. A proven approach to raise energy efficiency is to customize the computing hardware to the computing task, eliminating the overheads incurred by a generic microprocessor, such as fetching/decoding instructions. Field-programmable gate arrays (FPGAs) are programmable chips that can be configured to realize any digital circuit. FPGAs are thus an ideal media on which to implement custom compute accelerators in data centres, and have been shown to produce orders-of-magnitude improvements in energy efficiency. Major cloud-computing providers have recently announced the deployment of FPGAs in their data centres -- a "game changer" for what was once seen as a niche technology. FPGAs are now a part of the sharing economy: from anywhere in the world, one can rent a cloud FPGA for accelerated energy-efficient custom computing.    FPGAs are poised for a prominent role in energy-efficient data centre computing, however, a challenge is that they are difficult to use by software engineers for two primary reasons: 1) implementing a circuit on an FPGA has historically required knowledge of hardware design, where the circuit is described at a low level of abstraction in a hardware description language, such as VHDL or Verilog, and 2) compiling a design for an FPGA is time intensive, taking up to hours or days, preventing the real-time design -> debug -> execute iterative cycle that software engineers are accustomed to. What is needed is for FPGAs to be software programmable, with the desired behaviour specified at a high level of abstraction, and new approaches and architectures that permit such specifications to be rapidly compiled into the underlying FPGA hardware.    A first thrust undertaken to address the FPGA usability challenge is the application of machine learning techniques within high-level synthesis (HLS). HLS is the automated synthesis of a hardware circuit from a software program. Presently, the quality of circuit (power, performance, area) produced by HLS tools is inferior to human-expert designed hardware. HLS tools are by nature heuristic approaches, and we propose to apply machine learning algorithms, within HLS itself, to raise circuit quality. A second research thrust concerns the architecture of the target FPGA. We propose to attack today's lengthy compile times through compile-time-friendly architectural changes.