Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Toronto

$33,000.00

Automating Matrix Code Optimization for Performance and Portability

EF 2022-23

Résumé
The scalability and performance of many large-scale scientific and data analytics codes for applications in machine learning and physics simulations depend heavily on the optimizations and parallel implementations used to operate on large matrices. The emergence of new applications with stupendously large data has rendered the classical approaches to optimizing matrix computations, such as using specialized libraries and classical mathematical methods, inadequate in many situations. Mathematical methods are also often inherently unscalable and introduce data dependencies in matrix computations. Hand-written specialized libraries apply limited optimizations to maintain generality, must be manually ported to new architectures, and may stagnate with architectural advances. Also, complex dependence structures in matrix algorithms limit the optimizations that a compiler can apply to these codes. The project takes an integrated approach that combines efforts in mathematical reformulation, high-performance algorithm design, and compiler and system design to build high-performance and scalable software frameworks for large-scale simulations. For sparse matrix computations, we plan to analyze the non-zero patterns, i.e. symbolic information, along with the numerical algorithm so that our framework can detect computation patterns in the sparse matrix methods. As a result, our framework will automatically generate high-performance sparse matrix codes by fully decoupling the symbolic analysis from numeric computation. For big data applications that manipulate large dense matrix inputs, our framework will support approximate matrix computations. Approximate matrix algorithms reduce the computation and storage complexity of matrix computations with the objective of beating deterministic algorithms in terms of accuracy, speed, and robustness. We will also formulate scalable matrix algorithms for large optimization models used in "big data" machine learning and build a cluster-computing engine to be used for distributed implementations of these algorithms. As evidenced by interest from our industrial and academic collaborators, we believe this research will be broadly used by domain experts to replace hand-optimized library codes and significantly improve the performance of matrix computations in large-scale simulations.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2019-06516
Name nom
Mehri Dehnavi, Maryam
Department département
Computer Science (St. George Campus) - Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2019
Award amount
33000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Installment
inst:4
Partie
1
Nb partie
5
Application title
Automating Matrix Code Optimization for Performance and Portability
Application summary
The scalability and performance of many large-scale scientific and data analytics codes for applications in machine learning and physics simulations depend heavily on the optimizations and parallel implementations used to operate on large matrices. The emergence of new applications with stupendously large data has rendered the classical approaches to optimizing matrix computations, such as using specialized libraries and classical mathematical methods, inadequate in many situations. Mathematical methods are also often inherently unscalable and introduce data dependencies in matrix computations. Hand-written specialized libraries apply limited optimizations to maintain generality, must be manually ported to new architectures, and may stagnate with architectural advances. Also, complex dependence structures in matrix algorithms limit the optimizations that a compiler can apply to these codes. The project takes an integrated approach that combines efforts in mathematical reformulation, high-performance algorithm design, and compiler and system design to build high-performance and scalable software frameworks for large-scale simulations. For sparse matrix computations, we plan to analyze the non-zero patterns, i.e. symbolic information, along with the numerical algorithm so that our framework can detect computation patterns in the sparse matrix methods. As a result, our framework will automatically generate high-performance sparse matrix codes by fully decoupling the symbolic analysis from numeric computation. For big data applications that manipulate large dense matrix inputs, our framework will support approximate matrix computations. Approximate matrix algorithms reduce the computation and storage complexity of matrix computations with the objective of beating deterministic algorithms in terms of accuracy, speed, and robustness. We will also formulate scalable matrix algorithms for large optimization models used in "big data" machine learning and build a cluster-computing engine to be used for distributed implementations of these algorithms. As evidenced by interest from our industrial and academic collaborators, we believe this research will be broadly used by domain experts to replace hand-optimized library codes and significantly improve the performance of matrix computations in large-scale simulations.