Grant: Collaborative Research and Development Grants
University of Toronto
$149,272.00
Enabling a highly-scalable, cloud-based microservices architecture
FY 2020-21
Summary
The goals of this research are to design, build and evaluate mechanisms that enable a highly-scalable, cloud-based microservices architecture to support future, cloud-based enterprise applications. Here, enterprise applications will be instances of microservices architectures that are comprised of many services. The future scale of operation will measure hundreds of thousands of service instances.
Cloud customers desire infinite computing needs for their applications but cloud provides have finite computing resources to work with. It is not uncommon that data centers are reaching their physical limitations in terms of space and operating cost. Today, the pragmatic solution applied by cloud providers to satisfy high-value customers is to provide them with dedicated, highly expensive, and powerful hardware, while other hardware resources remain heavily shared among other customers. However, computing needs of customers, whether high-value or other, are often over-stated, either inadvertently or on purpose, such that expensive physical resources may sit around idle at times, while other close by resources in the same data center are pushed to their limits. Also, not all hosted applications are expected to experience peak load at all times, such that some degree of physical resource over-provisioning is possible.
In our approach services will be encapsulated in containers. Containers are lightweight virtual machines. They offer isolation, fast on demand start-up, and live migration, at a low resource footprint, as compared to their heavier weight virtual machine counterparts. Our approach will leverage novel hybrid scaling techniques that dynamically scale the compute, networking and storage resources of containers up and down in order to meet the performance expectations expressed by customers on their applications, while minimizing physical resource usage for the cloud provider.
Program
Collaborative Research and Development Grants
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
513199-2017
Name nom
Jacobsen, Hans-Arno
Department département
Electrical & Computer Engineering, Edward S. Rogers Sr. Department of
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2017
Award amount
149272
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Installment
inst:3 - 5
Partie
3
Nb partie
5
Application title
Enabling a highly-scalable, cloud-based microservices architecture
Keyword
NSERC
Application summary
The goals of this research are to design, build and evaluate mechanisms that enable a highly-scalable, cloud-based microservices architecture to support future, cloud-based enterprise applications. Here, enterprise applications will be instances of microservices architectures that are comprised of many services. The future scale of operation will measure hundreds of thousands of service instances.
Cloud customers desire infinite computing needs for their applications but cloud provides have finite computing resources to work with. It is not uncommon that data centers are reaching their physical limitations in terms of space and operating cost. Today, the pragmatic solution applied by cloud providers to satisfy high-value customers is to provide them with dedicated, highly expensive, and powerful hardware, while other hardware resources remain heavily shared among other customers. However, computing needs of customers, whether high-value or other, are often over-stated, either inadvertently or on purpose, such that expensive physical resources may sit around idle at times, while other close by resources in the same data center are pushed to their limits. Also, not all hosted applications are expected to experience peak load at all times, such that some degree of physical resource over-provisioning is possible.
In our approach services will be encapsulated in containers. Containers are lightweight virtual machines. They offer isolation, fast on demand start-up, and live migration, at a low resource footprint, as compared to their heavier weight virtual machine counterparts. Our approach will leverage novel hybrid scaling techniques that dynamically scale the compute, networking and storage resources of containers up and down in order to meet the performance expectations expressed by customers on their applications, while minimizing physical resource usage for the cloud provider.