Grant: Collaborative Research and Development Grants
University of Alberta
$51,000.00
Code Generation for Specialized Hardware-Supported Functional Units
EF 2023-24
Résumé
Advances in Graphics Processing Units (GPU) started a major trend in the industry towards specialized accelerators. These accelerators were then repurposed for extensive usage in other domains that can benefit from similar hardware architecture design. The effective use of GPUs for the training of Deep Convolution Networks led to the design of Tensor Processing Units (TPUs), also known by different names in offerings by other vendors, which have specific architecture features for matrix operations. This proposal is based on the idea that the functional units originally designed for TPUs can also be repurposed for general-purpose numerical computing and that there might be performance and energy/performance gains in doing so. Thus, the main objectives of the proposed research include: - To investigate the repurposing of functional units originally designed for TPUs for general-purpose high-performance numerical computation.- To study multiple possible configurations of specialized functional units for the execution of numerical-computing loop nests.- To determine which program analysis, and compiler-based code transformations, are necessary to port code written in programming models with, or without, parallel annotations and to make them suitable to benefit from execution in such functional units.- To design profitability functions that can be used to determine which code transformations should be applied to loop nests to make them performant in the functional units and also to enable runtime decisions of when a given computation should be executed in one such functional unit.The proposed research will support the development of solutions that may result in higher performance for scientific and data-analytics applications. The process of developing these solutions will also attempt to leverage emerging automated learning techniques and to integrate them in the code-generation process.
Programme
Collaborative Research and Development Grants
Bénéficiaire
Emplacement
Alberta, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
537432-2018
Name nom
Amaral, Jose N
Department département
Computing Science
Organization id
9
Institution établissement
University of Alberta
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2018
Award amount
51000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Computer systems software
Research subject en
Technologie de l'information
Research subject fr
Logiciel de systèmes informatiques
Application title
Code Generation for Specialized Hardware-Supported Functional Units
Keyword
code generation; compiler; computer accelerators; computer architecture; high-performance computing; program analysis
Application summary
Advances in Graphics Processing Units (GPU) started a major trend in the industry towards specialized accelerators. These accelerators were then repurposed for extensive usage in other domains that can benefit from similar hardware architecture design. The effective use of GPUs for the training of Deep Convolution Networks led to the design of Tensor Processing Units (TPUs), also known by different names in offerings by other vendors, which have specific architecture features for matrix operations. This proposal is based on the idea that the functional units originally designed for TPUs can also be repurposed for general-purpose numerical computing and that there might be performance and energy/performance gains in doing so. Thus, the main objectives of the proposed research include: - To investigate the repurposing of functional units originally designed for TPUs for general-purpose high-performance numerical computation.- To study multiple possible configurations of specialized functional units for the execution of numerical-computing loop nests.- To determine which program analysis, and compiler-based code transformations, are necessary to port code written in programming models with, or without, parallel annotations and to make them suitable to benefit from execution in such functional units.- To design profitability functions that can be used to determine which code transformations should be applied to loop nests to make them performant in the functional units and also to enable runtime decisions of when a given computation should be executed in one such functional unit.The proposed research will support the development of solutions that may result in higher performance for scientific and data-analytics applications. The process of developing these solutions will also attempt to leverage emerging automated learning techniques and to integrate them in the code-generation process.