Grant: Discovery Grants Program - Individual
University of Toronto
$62,000.00
Computer Systems for Efficient and Scalable Machine Learning
EF 2024-25
Résumé
Machine learning (ML) is radically transforming many branches of science and industry, permeating most aspects of society. Applications range from finance to manufacturing, weather prediction, agriculture, transportation, law, healthcare, and genomics. This research program is motivated by a critical gap in the Canadian ML landscape that must
be bridged to fully realize the potential of the investments in these areas. Breakthroughs in two areas have enabled the ongoing revolution in ML: (1) advances in ML algorithms and (2) advances in computer systems hardware and software enabling the efficient processing of vast amounts of data
required by many of these algorithms.
While a massive amount of research in the GTA, and more broadly in Canada, is dedicated to advancing ML algorithms and methods, little research is focused on advances in computer systems to support running these data-intensive applications at scale, which is the key of making machine learning practical in real world applications. To the best of our knowledge, no other Canadian research group tightly couples research on ML and computer systems. The goal of the proposed research program is to fill this
gap in an emerging area we refer to as ML+Systems.
Research on computer systems for ML will catalyze for burgeoning ML ecosystem in Ontario and Canada and will secure Canada's place at the forefront of this research internationally. Investing in this type of research is particularly important now as we are at an inflection point in computer systems: disruptive new technologies are starting to enter the market (e.g., ML accelerators: Google TPUs, Amazon Trainium).These devices have the potential to speed up ML applications tremendously. However, they present a major departure from current system design and will require a complete rethinking and redesign of the systems software to exploit their potential and address the associated challenges.
Dr. Pekhimenko possesses a distinct combination of skills and expertise to carry out this research in ML+Systems area efficiently. His group already produces top HQPs for Ontario and Canada and is the world leader in this emerging area.\footnote{For example, Pekhimenko's research group has the highest number of published papers (eight) in the world at the Machine Learning and Systems conference - top-tier venue in this area. In addition, Dr. Pekhimenko's team created a new company, called CentML, that successfully commercializes this research ideas in real products (with more than 40M CAD in funding, and over 30 employees).
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2024-06017
Name nom
Pekhimenko, Gennady
Department département
Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
62000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2702
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems organization
Research subject fr
Organisation des systèmes informatiques
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Computer Systems for Efficient and Scalable Machine Learning
Keywords
computer systems; compilers; computer architecture; optimization; deep neural networks; machine learning; distributed systems; memory systems
Application summary
Machine learning (ML) is radically transforming many branches of science and industry, permeating most aspects of society. Applications range from finance to manufacturing, weather prediction, agriculture, transportation, law, healthcare, and genomics. This research program is motivated by a critical gap in the Canadian ML landscape that must
be bridged to fully realize the potential of the investments in these areas. Breakthroughs in two areas have enabled the ongoing revolution in ML: (1) advances in ML algorithms and (2) advances in computer systems hardware and software enabling the efficient processing of vast amounts of data
required by many of these algorithms.
While a massive amount of research in the GTA, and more broadly in Canada, is dedicated to advancing ML algorithms and methods, little research is focused on advances in computer systems to support running these data-intensive applications at scale, which is the key of making machine learning practical in real world applications. To the best of our knowledge, no other Canadian research group tightly couples research on ML and computer systems. The goal of the proposed research program is to fill this
gap in an emerging area we refer to as ML+Systems.
Research on computer systems for ML will catalyze for burgeoning ML ecosystem in Ontario and Canada and will secure Canada's place at the forefront of this research internationally. Investing in this type of research is particularly important now as we are at an inflection point in computer systems: disruptive new technologies are starting to enter the market (e.g., ML accelerators: Google TPUs, Amazon Trainium).These devices have the potential to speed up ML applications tremendously. However, they present a major departure from current system design and will require a complete rethinking and redesign of the systems software to exploit their potential and address the associated challenges.
Dr. Pekhimenko possesses a distinct combination of skills and expertise to carry out this research in ML+Systems area efficiently. His group already produces top HQPs for Ontario and Canada and is the world leader in this emerging area.\footnote{For example, Pekhimenko's research group has the highest number of published papers (eight) in the world at the Machine Learning and Systems conference - top-tier venue in this area. In addition, Dr. Pekhimenko's team created a new company, called CentML, that successfully commercializes this research ideas in real products (with more than 40M CAD in funding, and over 30 employees).