Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Collaborative Research and Development Grants

University of Waterloo

$56,200.00

Continuous and Adaptive Optimization in Query Processing

FY 2006-07

Summary
Data fluctuations, unexpected delays and frequent disconnections have become distinctive characteristics of modern computing environments. These new environments pose many challenges to current query processing and optimization techniques in database management systems. For example, spending a considerable amount of time optimizing a user query may result in a query evaluation plan (strategy) that will soon become sub-optimal, due to the continuously changing execution conditions. Moreover, accurate modeling of the underlying system parameters becomes significantly harder in these ubiquitous and "less predictable" environments. Hence, cost parameters such as selectivity and correlation information need to be collected and updated in a more adaptive and scalable fashion. Many emerging applications and development environments will suffer from the inadequacy of current database management systems to deal with these new challenges. In this project, we study enhancing the capabilities for current query processors and optimizers to cope with the continuously changing computing environments. As the first phase of this project, we concentrate on real-world relational database engines. We define the following research tasks in terms of milestones: (1) modeling cost estimation errors due to lack of statistics and meta-data and using these models to take judicious decisions on statistics collection; (2) designing efficient on-line and on-the-fly statistics collection techniques for relational query optimizers; and (3) developing highly adaptive query execution frameworks that allow for continuous optimization of long running queries to respond to fluctuations, unexpected system changes and large cost estimation error. The second phase of this project focuses on long term goals where we investigate: (1) adaptive processing for non-relational data models (such as text and semi-structured data); and (2) query processing in peer-to-peer databases as a new trend to implement highly distributed and scalable solutions.
Program
Collaborative Research and Development Grants
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
321443-2005
Name nom
Ilyas, Ihab
Department département
Computer Science, School of
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2006
Competition year année de concours
2005
Award amount
56200
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2711
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Database management
Research subject fr
Gestion de bases de données
Partie
2
Nb partie
3
Application title
Continuous and Adaptive Optimization in Query Processing
Keyword
NA
Application summary
Data fluctuations, unexpected delays and frequent disconnections have become distinctive characteristics of modern computing environments. These new environments pose many challenges to current query processing and optimization techniques in database management systems. For example, spending a considerable amount of time optimizing a user query may result in a query evaluation plan (strategy) that will soon become sub-optimal, due to the continuously changing execution conditions. Moreover, accurate modeling of the underlying system parameters becomes significantly harder in these ubiquitous and "less predictable" environments. Hence, cost parameters such as selectivity and correlation information need to be collected and updated in a more adaptive and scalable fashion. Many emerging applications and development environments will suffer from the inadequacy of current database management systems to deal with these new challenges. In this project, we study enhancing the capabilities for current query processors and optimizers to cope with the continuously changing computing environments. As the first phase of this project, we concentrate on real-world relational database engines. We define the following research tasks in terms of milestones: (1) modeling cost estimation errors due to lack of statistics and meta-data and using these models to take judicious decisions on statistics collection; (2) designing efficient on-line and on-the-fly statistics collection techniques for relational query optimizers; and (3) developing highly adaptive query execution frameworks that allow for continuous optimization of long running queries to respond to fluctuations, unexpected system changes and large cost estimation error. The second phase of this project focuses on long term goals where we investigate: (1) adaptive processing for non-relational data models (such as text and semi-structured data); and (2) query processing in peer-to-peer databases as a new trend to implement highly distributed and scalable solutions.