Grant: Discovery Grants Program - Individual
University of British Columbia
$46,000.00
Improving Software Quality With Introspective Testing
EF 2016-17
Résumé
The long-term objective of my research program is to help industrial software engineers improve the quality and reliability of their software systems by providing them novel tools and techniques for analyzing and strengthening their test suites.
Software engineers have managed to build systems of incredible size and utility that play a crucial role in modern society; however, as these systems have grown in complexity, so has our expectations for the quality of these systems. This has resulted in increased scrutiny of software quality and intolerance for system failure; failures also have a direct economic cost, estimated at in excess of $60B per year.
Developers predominantly use software testing to confirm that their systems behave as they expect. Unfortunately, the tools and techniques software engineers have at their disposal for validating the 'strength' of their test suites are insufficient for modern software systems.
The research methodology employed in this program will include continual industrial involvement to ensure our approaches improve shortcomings in industrial practice and scale to the complexity of real software systems. The research program will produce novel techniques for characterizing the sensitivity of software tests, a means to assess test criticality by mapping test executions to real user executions, and mechanisms for assessing the severity of any identified faults. Finally, we will develop new ways to automatically strengthen tests that represent weaknesses in existing suites. Our approaches will be evaluated in both empirical lab studies and through validations with our industrial partners (which will comprise of both quantitative experiments and qualitative case studies).
Ultimately, the goal of this research program is to help software engineers assess and improve the quality of their test suites which will in turn lead to improved overall quality for the software systems we use every day.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2016-04362
Name nom
Holmes, Reid
Department département
Computer Science - Computer Science
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2016
Award amount
46000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2706
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Software engineering
Research subject fr
Génie logiciel
Partie
1
Nb partie
5
Application title
Improving Software Quality With Introspective Testing
Keyword
NSERC
Application summary
The long-term objective of my research program is to help industrial software engineers improve the quality and reliability of their software systems by providing them novel tools and techniques for analyzing and strengthening their test suites.
Software engineers have managed to build systems of incredible size and utility that play a crucial role in modern society; however, as these systems have grown in complexity, so has our expectations for the quality of these systems. This has resulted in increased scrutiny of software quality and intolerance for system failure; failures also have a direct economic cost, estimated at in excess of $60B per year.
Developers predominantly use software testing to confirm that their systems behave as they expect. Unfortunately, the tools and techniques software engineers have at their disposal for validating the 'strength' of their test suites are insufficient for modern software systems.
The research methodology employed in this program will include continual industrial involvement to ensure our approaches improve shortcomings in industrial practice and scale to the complexity of real software systems. The research program will produce novel techniques for characterizing the sensitivity of software tests, a means to assess test criticality by mapping test executions to real user executions, and mechanisms for assessing the severity of any identified faults. Finally, we will develop new ways to automatically strengthen tests that represent weaknesses in existing suites. Our approaches will be evaluated in both empirical lab studies and through validations with our industrial partners (which will comprise of both quantitative experiments and qualitative case studies).
Ultimately, the goal of this research program is to help software engineers assess and improve the quality of their test suites which will in turn lead to improved overall quality for the software systems we use every day.