Grant: Discovery Grants Program - Individual
University of Waterloo
$82,000.00
The Last Mile: Adapting Software Analytics into Developers' Context
EF 2022-23
Résumé
The software analytics research area has greatly improved what we might call the "science" of software development, such as understanding latent relationships in the artifact space and the likely accuracy of different prediction methods. However, this research area has also been criticized for a lack of practical results, tools, and techniques that might be deemed "actionable'' by developers and managers. For example, the topic of defect prediction ---- where statistical models based on history and/or program structure are employed to predict which files are the likeliest to contain bugs ---- has perhaps the strongest body of research results in this field. While the usual stated motivation for defect prediction might seem sound ---- extra resources may be devoted to source files marked as defect prone ---- in practice, industry has been slow to adopt these approaches, seeing little practical value to the knowledge gained. Furthermore, while much research effort has been spent exploring various complex relationships among artifacts using heavyweight analysis techniques such as machine learning and natural language processing, the real success stories of industrial software analytics ---- such as are evident on GitHub and the web pages of major open source projects ---- have been in creating simple dashboards based on straightforward metrics, such as tracking developer activities on maintenance tasks. Fundamentally, there is a disconnect between what software analytics researchers spend their time exploring and what information needs industrial developers have; this disconnect is well known within the software analytics research community. The goal of this research program is twofold: to improve modelling and understanding of the information needs of developers and managers, and, by example, to build bridges from these models to techniques from the software analytics research community. In so doing, we will help to span the "last mile" between research practice and industrial needs. This work will aid the Canadian software industry to become more effective in their work processes; developers will be better able to exploit their working context in solving their day-to-day problems, since the tools will be more finely tuned to their actual information needs. In turn, this will result in better informed decision-making by developers, less time wasted, and higher quality software systems overall.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2018-04183
Name nom
Godfrey, Michael
Department département
Computer Science, David R. Cheriton School of - Computer Science, David R. Cheriton School of
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2018
Award amount
82000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Installment
inst:5;6
Partie
2
Nb partie
6
Application title
The Last Mile: Adapting Software Analytics into Developers' Context
Application summary
The software analytics research area has greatly improved what we might call the "science" of software development, such as understanding latent relationships in the artifact space and the likely accuracy of different prediction methods. However, this research area has also been criticized for a lack of practical results, tools, and techniques that might be deemed "actionable'' by developers and managers. For example, the topic of defect prediction ---- where statistical models based on history and/or program structure are employed to predict which files are the likeliest to contain bugs ---- has perhaps the strongest body of research results in this field. While the usual stated motivation for defect prediction might seem sound ---- extra resources may be devoted to source files marked as defect prone ---- in practice, industry has been slow to adopt these approaches, seeing little practical value to the knowledge gained. Furthermore, while much research effort has been spent exploring various complex relationships among artifacts using heavyweight analysis techniques such as machine learning and natural language processing, the real success stories of industrial software analytics ---- such as are evident on GitHub and the web pages of major open source projects ---- have been in creating simple dashboards based on straightforward metrics, such as tracking developer activities on maintenance tasks. Fundamentally, there is a disconnect between what software analytics researchers spend their time exploring and what information needs industrial developers have; this disconnect is well known within the software analytics research community. The goal of this research program is twofold: to improve modelling and understanding of the information needs of developers and managers, and, by example, to build bridges from these models to techniques from the software analytics research community. In so doing, we will help to span the "last mile" between research practice and industrial needs. This work will aid the Canadian software industry to become more effective in their work processes; developers will be better able to exploit their working context in solving their day-to-day problems, since the tools will be more finely tuned to their actual information needs. In turn, this will result in better informed decision-making by developers, less time wasted, and higher quality software systems overall.