Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Toronto

$29,000.00

Architectural frameworks to leverage new hardware technologies for emerging data-intensive applications

EF 2023-24

Résumé
Important emerging data-intensive applications in machine learning and robotics utilize computing systems at different levels: datacenters, edge devices, and on resource-constrained autonomous vehicles (e.g., drones). These applications require processing significant amounts of data under various system constraints and their scale and complexity are today limited by constraints in memory, compute, and network capabilities. Advances in hardware technologies such as disaggregated memory, near-data processing, and application-specific acceleration offer promising opportunities to address these bottlenecks. Leveraging these technologies effectively requires co-designing algorithms, systems, and architectures. This research program aims to develop new architectural frameworks and cross-layer solutions to leverage new hardware technologies in three contexts: data centers, edge devices, and low-power autonomous vehicles. The proposed research aims to tackle the following major thrusts. First, we aim to investigate the system challenges to efficiently incorporate memory disaggregation in datacenters. Disaggregation rethinks the traditional notion of datacenters comprising monolithic servers with memory attached over the memory bus. Instead processors are connected to network-attached pools of memory that are independently operated. Disaggregation offers an opportunity to meet the significant memory needs of emerging data-intensive applications such training of large-scale machine learning models at low cost. Second, we aim to investigate the implications of the push towards edge-based computing in large-scale data-intensive applications. Important applications for machine learning in health care, mobile applications, financial institutions require privacy of user data, necessitating partial training of data on edge devices/servers. These applications typically use federated and incremental training to train machine learning models while preserving the privacy of user data. We aim to tackle the architectural and programmability challenges associated with efficient deployment of federated learning in edge devices. Third, we aim to investigate the architectural challenges of supporting robotics tasks on resource-constrained autonomous vehicles such as Unmanned Aerial Vehicles (UAVs) and vehicles for micromobility. These systems are projected to have tremendous growth in demand with use cases in healthcare, rescue, delivery, and mobility. These vehicles are required to support data-intensive tasks such as processing sensor data from LIDAR, cameras, etc., complex localization and mapping, and DNN inference, while still being heavily constrained in power and compute capability. This thrust will involve 1) investigating key compute bottlenecks for each task; 2) developing infrastructure to enable cross-layer research for each application domain; 3) developing hardware-software co-designs to enable efficient processing of these tasks.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2021-03542
Name nom
Vijaykumar, Nandita
Department département
Department of Computer Science
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2021
Award amount
29000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2702
Research subject group en
Information technology
Research subject group fr
Computer systems organization
Research subject en
Technologie de l'information
Research subject fr
Organisation des systèmes informatiques
Application title
Architectural frameworks to leverage new hardware technologies for emerging data-intensive applications
Keyword
Accelerators; Data centers; Disaggregated systems; Machine learning training; Programming models; Robotics
Application summary
Important emerging data-intensive applications in machine learning and robotics utilize computing systems at different levels: datacenters, edge devices, and on resource-constrained autonomous vehicles (e.g., drones). These applications require processing significant amounts of data under various system constraints and their scale and complexity are today limited by constraints in memory, compute, and network capabilities. Advances in hardware technologies such as disaggregated memory, near-data processing, and application-specific acceleration offer promising opportunities to address these bottlenecks. Leveraging these technologies effectively requires co-designing algorithms, systems, and architectures. This research program aims to develop new architectural frameworks and cross-layer solutions to leverage new hardware technologies in three contexts: data centers, edge devices, and low-power autonomous vehicles. The proposed research aims to tackle the following major thrusts. First, we aim to investigate the system challenges to efficiently incorporate memory disaggregation in datacenters. Disaggregation rethinks the traditional notion of datacenters comprising monolithic servers with memory attached over the memory bus. Instead processors are connected to network-attached pools of memory that are independently operated. Disaggregation offers an opportunity to meet the significant memory needs of emerging data-intensive applications such training of large-scale machine learning models at low cost. Second, we aim to investigate the implications of the push towards edge-based computing in large-scale data-intensive applications. Important applications for machine learning in health care, mobile applications, financial institutions require privacy of user data, necessitating partial training of data on edge devices/servers. These applications typically use federated and incremental training to train machine learning models while preserving the privacy of user data. We aim to tackle the architectural and programmability challenges associated with efficient deployment of federated learning in edge devices. Third, we aim to investigate the architectural challenges of supporting robotics tasks on resource-constrained autonomous vehicles such as Unmanned Aerial Vehicles (UAVs) and vehicles for micromobility. These systems are projected to have tremendous growth in demand with use cases in healthcare, rescue, delivery, and mobility. These vehicles are required to support data-intensive tasks such as processing sensor data from LIDAR, cameras, etc., complex localization and mapping, and DNN inference, while still being heavily constrained in power and compute capability. This thrust will involve 1) investigating key compute bottlenecks for each task; 2) developing infrastructure to enable cross-layer research for each application domain; 3) developing hardware-software co-designs to enable efficient processing of these tasks.