Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Engage Grants Program

University of Waterloo

$21,223.00

An RDMA-based memory management architecture for large-scale distributed computation frameworks

EF 2014-15

Résumé
Extracting knowledge from Big Data sources can be the key to the next big technological breakthrough. Current Big Data processing approaches rely on high-performance, distributed computation frameworks that leverage the combined resources of a large computing cluster to reduce the required processing time. Unfortunately, current frameworks manage resources from individual machines separately and are therefore unable to take full advantage of a cluster's resources. In this research proposal, we investigate a new approach to manage resources in distributed computation frameworks that takes advantage of high-speed datacenter networks to allow resources across machines to be managed as a single resource pool. By more effectively using resources, our approach can avoid recomputing intermediate results and minimize the use of slow persistent storage systems. This can lead to significant performance improvements that can enable processing of new Big Data sources that are beyond our current capabilities. In addition to changes to the memory management system, this work will also investigate the use of more efficient network communication methods that can reduce the data communication overhead between servers in a computation cluster. Overall, this work can help Canadian IT companies by improving their ability to process Big Data sources, which can give them a significant competitive advantage over their competitors.
Programme
Engage Grants Program
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
474648-2014
Name nom
Wong, Bernard
Department département
Computer Science, David R. Cheriton School of
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2014
Competition year année de concours
2014
Award amount
21223
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1553
Committee name en
Ontario Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Ontario
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Partie
1
Nb partie
1
Application title
An RDMA-based memory management architecture for large-scale distributed computation frameworks
Keyword
NSERC
Application summary
Extracting knowledge from Big Data sources can be the key to the next big technological breakthrough. Current Big Data processing approaches rely on high-performance, distributed computation frameworks that leverage the combined resources of a large computing cluster to reduce the required processing time. Unfortunately, current frameworks manage resources from individual machines separately and are therefore unable to take full advantage of a cluster's resources. In this research proposal, we investigate a new approach to manage resources in distributed computation frameworks that takes advantage of high-speed datacenter networks to allow resources across machines to be managed as a single resource pool. By more effectively using resources, our approach can avoid recomputing intermediate results and minimize the use of slow persistent storage systems. This can lead to significant performance improvements that can enable processing of new Big Data sources that are beyond our current capabilities. In addition to changes to the memory management system, this work will also investigate the use of more efficient network communication methods that can reduce the data communication overhead between servers in a computation cluster. Overall, this work can help Canadian IT companies by improving their ability to process Big Data sources, which can give them a significant competitive advantage over their competitors.