Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Collaborative Research and Development Grants

University of Alberta

$51,000.00

Code Generation for Specialized Hardware-Supported Functional Units

FY 2019-20

Summary
Advances in Graphics Processing Units (GPU) started a major trend in the industry towards specialized accelerators. These accelerators were then repurposed for extensive usage in other domains that can benefit from similar hardware architecture design. The effective use of GPUs for the training of Deep Convolution Networks led to the design of Tensor Processing Units (TPUs), also known by different names in offerings by other vendors, which have specific architecture features for matrix operations. This proposal is based on the idea that the functional units originally designed for TPUs can also be repurposed for general-purpose numerical computing and that there might be performance and energy/performance gains in doing so. Thus, the main objectives of the proposed research include: - To investigate the repurposing of functional units originally designed for TPUs for general-purpose high-performance numerical computation.- To study multiple possible configurations of specialized functional units for the execution of numerical-computing loop nests.- To determine which program analysis, and compiler-based code transformations, are necessary to port code written in programming models with, or without, parallel annotations and to make them suitable to benefit from execution in such functional units.- To design profitability functions that can be used to determine which code transformations should be applied to loop nests to make them performant in the functional units and also to enable runtime decisions of when a given computation should be executed in one such functional unit.The proposed research will support the development of solutions that may result in higher performance for scientific and data-analytics applications. The process of developing these solutions will also attempt to leverage emerging automated learning techniques and to integrate them in the code-generation process.
Program
Collaborative Research and Development Grants
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
537432-2018
Name nom
Amaral, Jose
Department département
Computing Science
Organization id
9
Institution établissement
University of Alberta
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2018
Award amount
51000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2719
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer architecture and design
Research subject fr
Architecture d'ordinateur et conception
Installment
inst:1 - 1
Partie
1
Nb partie
1
Application title
Code Generation for Specialized Hardware-Supported Functional Units
Keyword
NSERC
Application summary
Advances in Graphics Processing Units (GPU) started a major trend in the industry towards specialized accelerators. These accelerators were then repurposed for extensive usage in other domains that can benefit from similar hardware architecture design. The effective use of GPUs for the training of Deep Convolution Networks led to the design of Tensor Processing Units (TPUs), also known by different names in offerings by other vendors, which have specific architecture features for matrix operations. This proposal is based on the idea that the functional units originally designed for TPUs can also be repurposed for general-purpose numerical computing and that there might be performance and energy/performance gains in doing so. Thus, the main objectives of the proposed research include: - To investigate the repurposing of functional units originally designed for TPUs for general-purpose high-performance numerical computation.- To study multiple possible configurations of specialized functional units for the execution of numerical-computing loop nests.- To determine which program analysis, and compiler-based code transformations, are necessary to port code written in programming models with, or without, parallel annotations and to make them suitable to benefit from execution in such functional units.- To design profitability functions that can be used to determine which code transformations should be applied to loop nests to make them performant in the functional units and also to enable runtime decisions of when a given computation should be executed in one such functional unit.The proposed research will support the development of solutions that may result in higher performance for scientific and data-analytics applications. The process of developing these solutions will also attempt to leverage emerging automated learning techniques and to integrate them in the code-generation process.