Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Toronto

$96,000.00

A data-driven approach to improving data center efficiency

EF 2024-25

Résumé
Large-scale processing and storage of data has become the underpinning of our modern society. Nearly all industry sectors depend on efficient data management and storage as the engine that moves their business and end-users have grown dependent on services enabled by large-scale processing and storing of information. Consequently, it is maybe not surprising that a staggering amount of resources (both monetary as well as environmental) are dedicated to the storage and management of data. For example, a recent study concludes that managing the `Tsunami of data' could consume one fifth of global electricity by 2025. As a result, making optimal use of systems for processing and storing data at large scale is critical both in terms of future economic success and environmental impact. Of course, the problem of efficiency in compute clusters and data centers is not new. Much research in recent years has focused on many different facets of the problem, too many in fact to include an exhaustive survey in this proposal. Some examples include more energy-efficient hardware and energy-proportional servers, optimizations to the data center cooling system to improve airflow, increasing data center temperatures, new storage media, flexible and scalable schedulers, disaggregated storage to allow separate scaling of storage and compute resources, more light-weight virtualization mechanisms, continuous improvements in the efficiency of ML and AI algorithms and many more. The key observation motivating this proposal is that even today we are still making terribly inefficient use of data center and cluster resources. The advent of server virtualization and hyper-scale data centers, which are optimized for high density, and the rich academic literature on the topic create the impression that today's compute infrastructure is generally efficiently utilized. In contrast, the PI's recent discussions with several large companies operating their own data centers revealed that data centers are still greatly under-utilized, with typical utilization levels in the 5-25% range, even for hyper-scale data centers. For smaller systems utilization is believed to be even worse. The long-term goal of the work in this proposal is to identify, characterize and remove major sources of inefficiency in today's storage and compute infrastructures, and increase their utilization. The methodology will follow the PI's signature approach to research: form collaborations with industry to gain access to real data from production machines, analyze said data to characterize and identify problems, and use rigorous statistical and algorithmic methods to tackle core problems. The proposal outlines a set of specific near-term objectives that the PI identified in her recent work and plans to address over a 5-year horizon. She expects the results will open up new threads of research that will inform a longer term research agenda.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2020-05969
Name nom
Schroeder, Bianca
Department département
Computer and Mathematical Sciences
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2020
Award amount
96000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
A data-driven approach to improving data center efficiency
Keywords
empirical analysis; field data; system utilization; storage; data centers; cloud systems; resource allocation and management; system reliability; system efficiency
Application summary
Large-scale processing and storage of data has become the underpinning of our modern society. Nearly all industry sectors depend on efficient data management and storage as the engine that moves their business and end-users have grown dependent on services enabled by large-scale processing and storing of information. Consequently, it is maybe not surprising that a staggering amount of resources (both monetary as well as environmental) are dedicated to the storage and management of data. For example, a recent study concludes that managing the `Tsunami of data' could consume one fifth of global electricity by 2025. As a result, making optimal use of systems for processing and storing data at large scale is critical both in terms of future economic success and environmental impact. Of course, the problem of efficiency in compute clusters and data centers is not new. Much research in recent years has focused on many different facets of the problem, too many in fact to include an exhaustive survey in this proposal. Some examples include more energy-efficient hardware and energy-proportional servers, optimizations to the data center cooling system to improve airflow, increasing data center temperatures, new storage media, flexible and scalable schedulers, disaggregated storage to allow separate scaling of storage and compute resources, more light-weight virtualization mechanisms, continuous improvements in the efficiency of ML and AI algorithms and many more. The key observation motivating this proposal is that even today we are still making terribly inefficient use of data center and cluster resources. The advent of server virtualization and hyper-scale data centers, which are optimized for high density, and the rich academic literature on the topic create the impression that today's compute infrastructure is generally efficiently utilized. In contrast, the PI's recent discussions with several large companies operating their own data centers revealed that data centers are still greatly under-utilized, with typical utilization levels in the 5-25% range, even for hyper-scale data centers. For smaller systems utilization is believed to be even worse. The long-term goal of the work in this proposal is to identify, characterize and remove major sources of inefficiency in today's storage and compute infrastructures, and increase their utilization. The methodology will follow the PI's signature approach to research: form collaborations with industry to gain access to real data from production machines, analyze said data to characterize and identify problems, and use rigorous statistical and algorithmic methods to tackle core problems. The proposal outlines a set of specific near-term objectives that the PI identified in her recent work and plans to address over a 5-year horizon. She expects the results will open up new threads of research that will inform a longer term research agenda.