Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Collaborative Research and Development Grants

University of Waterloo

$40,000.00

Leveraging text analytics to improve software testing

FY 2015-16

Summary
Software testing is the common practice to ensure software correctness and discover as many bugs before software release. A fundamental challenge of software testing is that the number of execution paths grow exponentially as the program size increases and can be infinite. For most real-world programs, it is impossible to test all execution paths. In practice, one needs to use search heuristics to prioritize execution paths, compromise accuracy by combining paths, and use other techniques to test programs. Valid program inputs typically need to follow certain constraints. Focusing on valid or close-to-valid inputs (for boundary cases) can help test the core functionalities of the program, which improves testing coverage and effectiveness. Traditional software testing techniques are unaware of input constraints, and thus unaware of which paths lead to the processing of valid inputs. This project will automatically extract input constraints from documents by using text analytics techniques. It will then use these input constraints to favour execution paths that execute a program's core functionalities during software testing. Testing with invalid inputs is also very important, e.g., to check error-handling code or find defects due to malformed inputs. Therefore, strategies to negate the constraints efficiently for testing error-handling code will also be explored. Regardless of what inputs (valid or invalid) to focus on, one cannot do so without knowing what inputs are valid and what are not. The proposed approach enables this choice by extracting input constraints from software documents automatically. In addition, new approaches will be designed to analyze other software text to guide software testing to focus on code regions that are more likely to contain defects. These approaches will enhance the effectiveness of automatic test generation and bug detection.
Program
Collaborative Research and Development Grants
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
479579-2015
Name nom
Tan, Lin
Department département
Electrical & Computer Engineering
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2015
Award amount
40000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2706
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Software engineering
Research subject fr
Génie logiciel
Partie
1
Nb partie
3
Application title
Leveraging text analytics to improve software testing
Keyword
NSERC
Application summary
Software testing is the common practice to ensure software correctness and discover as many bugs before software release. A fundamental challenge of software testing is that the number of execution paths grow exponentially as the program size increases and can be infinite. For most real-world programs, it is impossible to test all execution paths. In practice, one needs to use search heuristics to prioritize execution paths, compromise accuracy by combining paths, and use other techniques to test programs. Valid program inputs typically need to follow certain constraints. Focusing on valid or close-to-valid inputs (for boundary cases) can help test the core functionalities of the program, which improves testing coverage and effectiveness. Traditional software testing techniques are unaware of input constraints, and thus unaware of which paths lead to the processing of valid inputs. This project will automatically extract input constraints from documents by using text analytics techniques. It will then use these input constraints to favour execution paths that execute a program's core functionalities during software testing. Testing with invalid inputs is also very important, e.g., to check error-handling code or find defects due to malformed inputs. Therefore, strategies to negate the constraints efficiently for testing error-handling code will also be explored. Regardless of what inputs (valid or invalid) to focus on, one cannot do so without knowing what inputs are valid and what are not. The proposed approach enables this choice by extracting input constraints from software documents automatically. In addition, new approaches will be designed to analyze other software text to guide software testing to focus on code regions that are more likely to contain defects. These approaches will enhance the effectiveness of automatic test generation and bug detection.