Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Collaborative Research and Development Grants

University of Toronto

$41,620.00

An Incremental Data Management System for Big Data Analytics

EF 2015-16

Résumé
Big data analytics is of vast importance in science and industry. Widespread availability of compute resources, in the form of cloud computing, gives unprecedented ability to analyze and cross-correlate information from multiple domains, including scientific, social, and corporate data sources. Big data brings new insights and allows optimizations of processes across all aspects of modern enterprise, science, and public services. The abundance of data and its volume creates a pressing need for improved performance during the execution of complex analytical tasks on such data. The aim of this project is to develop technology and a system to support advanced statistical and analytical modelling functionality on top of large (multi-terabyte) data sets. Data analysts typically rely on statistical packages such as R to analyze data and extract accurate models that drive predictions and expose new insights, but such statistical analysis scales poorly to large datasets. Typical analytical workflows on big data are iterative: An analyst builds a model using some data set, then repeatedly refines the model based on the outcome of the previous analysis. These iterative computations become more expensive as data sizes increase, and a single analysis can easily consume many compute-hours of a large cluster. Across such model refinements there exist many opportunity for optimization. For example if the first model and the subsequently refined model, differ by very little, there is no need to recompute the second model from scratch. Adjusting the first model incrementally can offer a precise solution much faster. We wish to make the concept of such incremental computations a first class citizen in our system design. We will develop a system that would be as feature rich as R but at the same time operate on top of ubiquitous data managers supporting incremental computations for improved performance
Programme
Collaborative Research and Development Grants
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
455415-2013
Name nom
Koudas, Nick
Department département
Computer and Mathematical Sciences (Scarborough)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2013
Award amount
41620
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2711
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Database management
Research subject fr
Gestion de bases de données
Partie
2
Nb partie
3
Application title
An Incremental Data Management System for Big Data Analytics
Keyword
NSERC
Application summary
Big data analytics is of vast importance in science and industry. Widespread availability of compute resources, in the form of cloud computing, gives unprecedented ability to analyze and cross-correlate information from multiple domains, including scientific, social, and corporate data sources. Big data brings new insights and allows optimizations of processes across all aspects of modern enterprise, science, and public services. The abundance of data and its volume creates a pressing need for improved performance during the execution of complex analytical tasks on such data. The aim of this project is to develop technology and a system to support advanced statistical and analytical modelling functionality on top of large (multi-terabyte) data sets. Data analysts typically rely on statistical packages such as R to analyze data and extract accurate models that drive predictions and expose new insights, but such statistical analysis scales poorly to large datasets. Typical analytical workflows on big data are iterative: An analyst builds a model using some data set, then repeatedly refines the model based on the outcome of the previous analysis. These iterative computations become more expensive as data sizes increase, and a single analysis can easily consume many compute-hours of a large cluster. Across such model refinements there exist many opportunity for optimization. For example if the first model and the subsequently refined model, differ by very little, there is no need to recompute the second model from scratch. Adjusting the first model incrementally can offer a precise solution much faster. We wish to make the concept of such incremental computations a first class citizen in our system design. We will develop a system that would be as feature rich as R but at the same time operate on top of ubiquitous data managers supporting incremental computations for improved performance