Grant: Discovery Grants Program - Individual
University of Western Ontario
$28,000.00
Testing and Debugging: Connecting Research with Practice
FY 2012-13
Summary
The overall objectives of the proposed research are to create and analyze tools and techniques for testing and debugging high-quality software, and to make those tools and techniques available to a large number of people. The research is in four specific areas: randomized unit testing, adequacy criteria, effectiveness measurement and fault localization.
1. Randomized unit testing: This is a family of techniques for testing software, in which random choice is applied judiciously to generate and run tests of small portions of programs. My research team will build leading-edge randomized unit testing tools that give software creators quick, easy generation of highly effective test input. This will in turn improve the quality and time to market of their software.
2. Adequacy criteria: These are criteria for deciding when enough testing has been done. Many adequacy criteria have been proposed, but few have been formally evaluated and compared scientifically. We will propose innovative new criteria, evaluate and document the effectiveness of both old and new criteria for the first time, and incorporate the best criteria in our test input generation tools.
3. Effectiveness measurement: My team has shown that automatically generated mutants (faulty variants of correct programs) can be used to accurately assess the effectiveness of adequacy criteria: researchers generate mutants, and then see how many of them are detected by a criterion. My team will expand this technique to allow more dimensions of data to be collected and reported.
4. Fault localization: Many researchers recently have proposed competing ""fault localization"" tools, which take as input data about test cases, and yield as output predictions of where faults are in the source code of the software. My team will gather many such tools and incorporate them in a single tool, a ""one-stop shop"" that provides predictions of faulty program locations together with a confidence rating about the prediction.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
203247-2012
Name nom
Andrews, James
Department département
Computer Science
Organization id
36
Institution établissement
University of Western Ontario
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2012
Competition year année de concours
2012
Award amount
28000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2706
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Software engineering
Research subject fr
Génie logiciel
Partie
1
Nb partie
5
Application title
Testing and Debugging: Connecting Research with Practice
Keyword
NSERC
Application summary
The overall objectives of the proposed research are to create and analyze tools and techniques for testing and debugging high-quality software, and to make those tools and techniques available to a large number of people. The research is in four specific areas: randomized unit testing, adequacy criteria, effectiveness measurement and fault localization.
1. Randomized unit testing: This is a family of techniques for testing software, in which random choice is applied judiciously to generate and run tests of small portions of programs. My research team will build leading-edge randomized unit testing tools that give software creators quick, easy generation of highly effective test input. This will in turn improve the quality and time to market of their software.
2. Adequacy criteria: These are criteria for deciding when enough testing has been done. Many adequacy criteria have been proposed, but few have been formally evaluated and compared scientifically. We will propose innovative new criteria, evaluate and document the effectiveness of both old and new criteria for the first time, and incorporate the best criteria in our test input generation tools.
3. Effectiveness measurement: My team has shown that automatically generated mutants (faulty variants of correct programs) can be used to accurately assess the effectiveness of adequacy criteria: researchers generate mutants, and then see how many of them are detected by a criterion. My team will expand this technique to allow more dimensions of data to be collected and reported.
4. Fault localization: Many researchers recently have proposed competing ""fault localization"" tools, which take as input data about test cases, and yield as output predictions of where faults are in the source code of the software. My team will gather many such tools and incorporate them in a single tool, a ""one-stop shop"" that provides predictions of faulty program locations together with a confidence rating about the prediction.