Grant: Collaborative Research and Development Grants
McMaster University
$68,000.00
A dynamic and user-centric data cleaning system for Watson Analytics
FY 2017-18
Summary
Poor data quality is a serious and costly problem affecting organizations across all industries. Real data is often dirty, containing missing, erroneous, incomplete, and duplicate values. It is estimated that poor data quality cost organizations between 15% and 25% of their operating budget. Existing data cleaning solutions focus on identifying inconsistencies that do not conform to prescribed data formats assuming the data remains relatively static. As modern applications move towards more dynamic search and analytics, new data quality solutions that support dynamic and adaptive data cleaning are needed.An increasing number of data analysis tools, such as Watson Analytics, provide flexible data browsing and querying abilities. In order to ensure reliable, trusted and relevant data analysis, dynamic data cleaning solutions that adapt to users' data analytic tasks are required. In particular, current data quality tools fail to adapt to: (1) individual user query preferences and specific data analytic tasks; (2) provide users with detailed data quality metrics that indicate the level of data cleanliness across different dimensions; and (3) utilize industry specific terminology, concepts, policies that can refine data quality recommendations for greater accuracy and relevance.In this project, we will develop a system for dynamic data cleaning that adapts to a user's analytical intentions and considers industry specific models for improved data quality.
Program
Collaborative Research and Development Grants
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
490788-2015
Name nom
Chiang, FeiYen
Department département
Computing and Software
Organization id
27
Institution établissement
McMaster University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2015
Award amount
68000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2711
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Database management
Research subject fr
Gestion de bases de données
Partie
2
Nb partie
3
Application title
A dynamic and user-centric data cleaning system for Watson Analytics
Keyword
NSERC
Application summary
Poor data quality is a serious and costly problem affecting organizations across all industries. Real data is often dirty, containing missing, erroneous, incomplete, and duplicate values. It is estimated that poor data quality cost organizations between 15% and 25% of their operating budget. Existing data cleaning solutions focus on identifying inconsistencies that do not conform to prescribed data formats assuming the data remains relatively static. As modern applications move towards more dynamic search and analytics, new data quality solutions that support dynamic and adaptive data cleaning are needed.An increasing number of data analysis tools, such as Watson Analytics, provide flexible data browsing and querying abilities. In order to ensure reliable, trusted and relevant data analysis, dynamic data cleaning solutions that adapt to users' data analytic tasks are required. In particular, current data quality tools fail to adapt to: (1) individual user query preferences and specific data analytic tasks; (2) provide users with detailed data quality metrics that indicate the level of data cleanliness across different dimensions; and (3) utilize industry specific terminology, concepts, policies that can refine data quality recommendations for greater accuracy and relevance.In this project, we will develop a system for dynamic data cleaning that adapts to a user's analytical intentions and considers industry specific models for improved data quality.