Grant: Discovery Grants Program - Individual
University of Waterloo
$48,000.00
Adaptive Data Systems
EF 2021-22
Résumé
Data (management) systems have become a critical part of serving transactional requests from applications in many sectors such as science, business and health. Data systems are typically subjected to highly variable workloads in terms of transactional requests and load spikes. For example, e-commerce sites are subject to heavy and variable loads during holiday shopping sales while the sudden popularity of particular items can overwhelm the data system serving these requests. Provisioning more resources to boost system performance is a time-consuming process and takes much longer than the timespan over which the system load can increase. To deliver good performance in the face of unanticipated workload changes, it is crucial that data systems automatically adapt their behaviour to meet the variable workload demands of their clients. To deliver good performance through adaptivity, data systems need to understand the characteristics of the workloads that they execute. This research program proposes to address these challenges. A dynamic data replication architecture will be developed and implemented to allow flexible, dynamic, allocation of resources without incurring the cost of data movement. For online transaction processing (OLTP) applications, this design incorporates algorithms that identify servers or sites where transactions can execute without distributed coordination while having enough resources to execute quickly. The challenge here is to identify which sites can offer better performance to particular transactions while ensuring that adequate resources are provisioned at that site. This adaptation will support dynamic mastership of data while maintaining even load distribution throughout the system. This proposal advocates the need to understand the behavioural patterns of systems that execute data system workloads. This task entails the collection and analysis of system resource execution data for workload requests and their behaviour. The objective is to understand the conditions under which a system made particular algorithmic and resource usage decisions and to understand their effect on system performance, which would allow the configuration of the system to be optimized to deliver the best possible performance for workloads. Achieving this goal would enable the system to deliver superior performance over its un-optimized configurations that abound in most real-world data system deployments and require expensive, and extensive, manual tuning effort.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2019-05630
Name nom
Daudjee, Khuzaima
Department département
Computer Science, David R. Cheriton School of - Computer Science, David R. Cheriton School of
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2021
Competition year année de concours
2019
Award amount
48000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Installment
inst:3
Partie
1
Nb partie
5
Application title
Adaptive Data Systems
Keyword
NSERC
Application summary
Data (management) systems have become a critical part of serving transactional requests from applications in many sectors such as science, business and health. Data systems are typically subjected to highly variable workloads in terms of transactional requests and load spikes. For example, e-commerce sites are subject to heavy and variable loads during holiday shopping sales while the sudden popularity of particular items can overwhelm the data system serving these requests. Provisioning more resources to boost system performance is a time-consuming process and takes much longer than the timespan over which the system load can increase. To deliver good performance in the face of unanticipated workload changes, it is crucial that data systems automatically adapt their behaviour to meet the variable workload demands of their clients. To deliver good performance through adaptivity, data systems need to understand the characteristics of the workloads that they execute. This research program proposes to address these challenges. A dynamic data replication architecture will be developed and implemented to allow flexible, dynamic, allocation of resources without incurring the cost of data movement. For online transaction processing (OLTP) applications, this design incorporates algorithms that identify servers or sites where transactions can execute without distributed coordination while having enough resources to execute quickly. The challenge here is to identify which sites can offer better performance to particular transactions while ensuring that adequate resources are provisioned at that site. This adaptation will support dynamic mastership of data while maintaining even load distribution throughout the system. This proposal advocates the need to understand the behavioural patterns of systems that execute data system workloads. This task entails the collection and analysis of system resource execution data for workload requests and their behaviour. The objective is to understand the conditions under which a system made particular algorithmic and resource usage decisions and to understand their effect on system performance, which would allow the configuration of the system to be optimized to deliver the best possible performance for workloads. Achieving this goal would enable the system to deliver superior performance over its un-optimized configurations that abound in most real-world data system deployments and require expensive, and extensive, manual tuning effort.