Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

Simon Fraser University

$36,000.00

Crowdsourced Data Cleaning

FY 2019-20

Summary
Data cleaning is the process of detecting and correcting dirty (inconsistent, inaccurate, or incomplete) values from a database. Real-world data is often dirty. Analyses without data cleaning can be very risky, which may result in poor decision-making, and have a significant negative impact on applications. For example, in 2014, Statistics Canada under-reported the country's job creation in July by more than 41000, based on an analysis of dirty data. This news was reported by hundreds of TV and Internet Media outlets around the world, resulting in various negative effects on Canada.******Although there has already been a long line of work on machine-based data cleaning techniques, many cleaning tasks are too challenging for machine only solutions. Recently, the advance of crowdsourcing techniques and platforms (e.g., Amazon Mechanical Turk) provides a highly promising way to involve humans and computers in solving complex problems at low cost. In view of this great opportunity, this proposal will study crowdsourced data cleaning, intelligently combining humans and computers to address challenging data-cleaning problem.******This work will not only open up a new research area in the database field, but also benefit a lot of other scientific fields, such as library science or sociology, which often require to conduct data analysis on real-world datasets. Furthermore, with the rise of big data, the world is moving towards a more data-driven environment. Data cleaning has long been considered as a bottleneck for extracting value from data. Crowdsourced data cleaning, which has the potential of significantly improving data quality at low cleaning cost, will have an increasing number of applications in this new environment, such as cleaning customer information for reliable market analysis, and cleaning patients' medical history for accurate disease diagnosis.
Program
Discovery Grants Program - Individual
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2016-05555
Name nom
Wang, Jiannan
Department département
Computing Science, School of
Organization id
5
Institution établissement
Simon Fraser University
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2016
Award amount
36000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2711
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Database management
Research subject fr
Gestion de bases de données
Installment
NA
Partie
0
Nb partie
NA
Application title
Crowdsourced Data Cleaning
Keyword
NSERC
Application summary
Data cleaning is the process of detecting and correcting dirty (inconsistent, inaccurate, or incomplete) values from a database. Real-world data is often dirty. Analyses without data cleaning can be very risky, which may result in poor decision-making, and have a significant negative impact on applications. For example, in 2014, Statistics Canada under-reported the country's job creation in July by more than 41000, based on an analysis of dirty data. This news was reported by hundreds of TV and Internet Media outlets around the world, resulting in various negative effects on Canada.******Although there has already been a long line of work on machine-based data cleaning techniques, many cleaning tasks are too challenging for machine only solutions. Recently, the advance of crowdsourcing techniques and platforms (e.g., Amazon Mechanical Turk) provides a highly promising way to involve humans and computers in solving complex problems at low cost. In view of this great opportunity, this proposal will study crowdsourced data cleaning, intelligently combining humans and computers to address challenging data-cleaning problem.******This work will not only open up a new research area in the database field, but also benefit a lot of other scientific fields, such as library science or sociology, which often require to conduct data analysis on real-world datasets. Furthermore, with the rise of big data, the world is moving towards a more data-driven environment. Data cleaning has long been considered as a bottleneck for extracting value from data. Crowdsourced data cleaning, which has the potential of significantly improving data quality at low cleaning cost, will have an increasing number of applications in this new environment, such as cleaning customer information for reliable market analysis, and cleaning patients' medical history for accurate disease diagnosis.