Grant: Collaborative Research and Development Grants
University of Toronto
$96,500.00
Performance optimization for multi-datacenter cloud platforms
EF 2016-17
Résumé
In the era of cloud computing, large volumes of data are located in geographically distributed datacenters around the world, and need to be analyzed with machine learning algorithms in data analytic applications. Traditionally, jobs in these data analytic applications are supported by data parallel frameworks within a single cluster. Yet, since the data to be analyzed are located in multiple geographically distributed datacenters, it becomes necessary to deploy jobs in data analytic applications across these datacenters. Such a research trend is motivated by the fact that migrating large volumes of data to the same datacenter over a wide-area network is exceedingly slow, and will dramatically affect application performance. In this project, we seek to design and build a new system to optimize the performance of data analytic applications spanning multiple geographically distributed datacenters. We will design new algorithms for job scheduling, as well as new proactive push mechanisms for deploying data analytic jobs across datacenters. These new strategies will be implemented in a new real-world system framework based on the prevalent big data processing framework, Apache Spark, and experimentally evaluated across multiple geographically distributed datacenters.
Programme
Collaborative Research and Development Grants
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
499448-2016
Name nom
Li, Baochun
Department département
Electrical & Computer Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2016
Award amount
96500
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Partie
1
Nb partie
1
Application title
Performance optimization for multi-datacenter cloud platforms
Keyword
NSERC
Application summary
In the era of cloud computing, large volumes of data are located in geographically distributed datacenters around the world, and need to be analyzed with machine learning algorithms in data analytic applications. Traditionally, jobs in these data analytic applications are supported by data parallel frameworks within a single cluster. Yet, since the data to be analyzed are located in multiple geographically distributed datacenters, it becomes necessary to deploy jobs in data analytic applications across these datacenters. Such a research trend is motivated by the fact that migrating large volumes of data to the same datacenter over a wide-area network is exceedingly slow, and will dramatically affect application performance. In this project, we seek to design and build a new system to optimize the performance of data analytic applications spanning multiple geographically distributed datacenters. We will design new algorithms for job scheduling, as well as new proactive push mechanisms for deploying data analytic jobs across datacenters. These new strategies will be implemented in a new real-world system framework based on the prevalent big data processing framework, Apache Spark, and experimentally evaluated across multiple geographically distributed datacenters.