Grant: Discovery Grants Program - Individual
Carleton University
$56,000.00
Parallel Algorithms and Systems for Applications in Data Analytics
EF 2024-25
Résumé
The main goal of parallel computing research is to create enabling technology for solving data intensive and/or computationally hard problems in the Natural Sciences, Engineering, Medical Sciences, Business, and Social Sciences. My proposed research topics are:
(1) Parallel Algorithms And Systems For Real-Time Data Aggregation On High Velocity Data
Modern data analytics systems rely heavily on data aggregation typically implemented as binary associative aggregation queries (for example, sum or max) over a specified subset of the data items stored in the database. In contrast to queries for traditional transaction processing systems which typically access only a small portion of the database (e.g. update a customer record), aggregation queries for data analytics may need to aggregate large portions of the database (e.g. calculate the total sales of a certain type of items as a function of time). This can lead to significant performance issues for large data sets. In addition, applications that continuously monitor new events in high velocity data streams (e.g. stock exchange data streams) require the ability to analyze streaming data as it arrives, in real-time. We propose to study the use of hybrid parallel architectures (clusters/clouds comprised of compute nodes with CPUs and GPUs) for real-time data aggregation on high velocity data.
(2) Auto-Tuning YARN
Many data analytics applications are built on top of key technologies such as Hadoop map-reduce and Spark, both of which use YARN as resource manager. The installation of such systems on a given hardware platform involves tuning many parameters. Manual tuning often results in sub-optimal and brittle performance because parameters that are optimal for one job (input data set) may not be well suited to another. Auto-tuned parallel systems are portable systems that adapt automatically to different and/or changing hardware configurations and input data sets. We propose to study how to auto-tune YARN for cloud architectures.
(3) Parallel Algorithms And Systems For Protein Analytics
Protein-protein interactions (PPIs) are essential molecular interactions that define the biology of a cell. PPIs are thought to involve important targets for drug discovery and are linked to a number of cellular conditions and diseases. Designing synthetic proteins with a given set of PPIs (drug targets) is called protein engineering. We propose to develop a new parallel protein engineering system for large scale hybrid parallel architectures (clusters/clouds comprised of compute nodes with CPUs and GPUs).
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2018-05302
Name nom
Dehne, Frank
Department département
School of Computer Science
Organization id
23
Institution établissement
Carleton University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2018
Award amount
56000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2713
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Algorithms
Research subject fr
Algorithmes
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Parallel Algorithms and Systems for Applications in Data Analytics
Keywords
parallel algorithms; cluster computing; multi-core processors; many-core processors (gpus); hybrid processor clusters; auto-tuning; parallel graph algorithms; data aggregation; map-reduce; protein analytics
Application summary
The main goal of parallel computing research is to create enabling technology for solving data intensive and/or computationally hard problems in the Natural Sciences, Engineering, Medical Sciences, Business, and Social Sciences. My proposed research topics are:
(1) Parallel Algorithms And Systems For Real-Time Data Aggregation On High Velocity Data
Modern data analytics systems rely heavily on data aggregation typically implemented as binary associative aggregation queries (for example, sum or max) over a specified subset of the data items stored in the database. In contrast to queries for traditional transaction processing systems which typically access only a small portion of the database (e.g. update a customer record), aggregation queries for data analytics may need to aggregate large portions of the database (e.g. calculate the total sales of a certain type of items as a function of time). This can lead to significant performance issues for large data sets. In addition, applications that continuously monitor new events in high velocity data streams (e.g. stock exchange data streams) require the ability to analyze streaming data as it arrives, in real-time. We propose to study the use of hybrid parallel architectures (clusters/clouds comprised of compute nodes with CPUs and GPUs) for real-time data aggregation on high velocity data.
(2) Auto-Tuning YARN
Many data analytics applications are built on top of key technologies such as Hadoop map-reduce and Spark, both of which use YARN as resource manager. The installation of such systems on a given hardware platform involves tuning many parameters. Manual tuning often results in sub-optimal and brittle performance because parameters that are optimal for one job (input data set) may not be well suited to another. Auto-tuned parallel systems are portable systems that adapt automatically to different and/or changing hardware configurations and input data sets. We propose to study how to auto-tune YARN for cloud architectures.
(3) Parallel Algorithms And Systems For Protein Analytics
Protein-protein interactions (PPIs) are essential molecular interactions that define the biology of a cell. PPIs are thought to involve important targets for drug discovery and are linked to a number of cellular conditions and diseases. Designing synthetic proteins with a given set of PPIs (drug targets) is called protein engineering. We propose to develop a new parallel protein engineering system for large scale hybrid parallel architectures (clusters/clouds comprised of compute nodes with CPUs and GPUs).