Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Toronto

$55,000.00

A Platform for Next Generation Applications on the Hierarchical Cloud

EF 2024-25

Résumé
Interconnected Internet of Things (IoT) devices, including sensors, smartphones, and cameras are expected to generate 79.4 Zettabytes of data in 2025. This surge in data generation is accompanied by a growing demand for real-time data processing and analytics in applications such as smart factories, healthcare systems, augmented/virtual reality, and transportation. However, relying solely on wide-area cloud computing, where all devices connect to the cloud as their primary storage provider, is inadequate due to issues of latency and bandwidth utilization.  In response, cloud providers are building a new form of hierarchical cloud computing that expands their traditional wide-area datacenters with additional smaller but more numerous datacenters close to the network edge. For example, Amazon Wavelength extends the AWS infrastructure to telecom networks, enabling developers to build and deploy applications that require low latency to mobile and connected devices at the edge of the 5G network. The hierarchical deployment of datacenters introduces, however, additional layers of infrastructure and management that increases application development complexity. Developers must account for the distributed nature of the system, ensuring seamless coordination and synchronization across edge nodes. They need to design robust communication protocols, handle data replication and consistency, and address challenges related to fault tolerance and scalability.  To address the above challenges, my group has conducted research on new frameworks that simplify the application deployment and data management in hierarchical cloud environments.  This work has lead to the development Shepherd, a stream processing framework that enables efficient processing and analysis of real-time data flows; and PathStore, a hierarchical eventually-consistent tabular data management system that enables transparent communication between application components deployed across the datacenter hierarchy.   This proposal puts forward a comprehensive research program focused on the creation of novel system abstractions and frameworks designed to streamline development and deployment of applications on hierarchical cloud datacenters.  The research proposal has four main thrusts: 1) Enhancing the Shepherd stream processing framework to enable distributed learning, allowing users to control model version dissemination and gradient update mergers; 2) Developing an adaptive storage engine that optimizes performance across different data center workloads, enabling automatic selection of data structures based on workload nature; 3) Expanding PathStore for strong consistency without compromising edge deployment latency; and 4) Introducing novel control methods to manage infrastructure in multi-stakeholder datacenters.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2024-05696
Name nom
de Lara, Eyal
Department département
Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
55000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
A Platform for Next Generation Applications on the Hierarchical Cloud
Keywords
edge computing; hierarchical cloud; data systems; mobile computing
Application summary
Interconnected Internet of Things (IoT) devices, including sensors, smartphones, and cameras are expected to generate 79.4 Zettabytes of data in 2025. This surge in data generation is accompanied by a growing demand for real-time data processing and analytics in applications such as smart factories, healthcare systems, augmented/virtual reality, and transportation. However, relying solely on wide-area cloud computing, where all devices connect to the cloud as their primary storage provider, is inadequate due to issues of latency and bandwidth utilization.  In response, cloud providers are building a new form of hierarchical cloud computing that expands their traditional wide-area datacenters with additional smaller but more numerous datacenters close to the network edge. For example, Amazon Wavelength extends the AWS infrastructure to telecom networks, enabling developers to build and deploy applications that require low latency to mobile and connected devices at the edge of the 5G network. The hierarchical deployment of datacenters introduces, however, additional layers of infrastructure and management that increases application development complexity. Developers must account for the distributed nature of the system, ensuring seamless coordination and synchronization across edge nodes. They need to design robust communication protocols, handle data replication and consistency, and address challenges related to fault tolerance and scalability.  To address the above challenges, my group has conducted research on new frameworks that simplify the application deployment and data management in hierarchical cloud environments.  This work has lead to the development Shepherd, a stream processing framework that enables efficient processing and analysis of real-time data flows; and PathStore, a hierarchical eventually-consistent tabular data management system that enables transparent communication between application components deployed across the datacenter hierarchy.   This proposal puts forward a comprehensive research program focused on the creation of novel system abstractions and frameworks designed to streamline development and deployment of applications on hierarchical cloud datacenters.  The research proposal has four main thrusts: 1) Enhancing the Shepherd stream processing framework to enable distributed learning, allowing users to control model version dissemination and gradient update mergers; 2) Developing an adaptive storage engine that optimizes performance across different data center workloads, enabling automatic selection of data structures based on workload nature; 3) Expanding PathStore for strong consistency without compromising edge deployment latency; and 4) Introducing novel control methods to manage infrastructure in multi-stakeholder datacenters.