Grant: Discovery Grants Program - Individual
University of Waterloo
$36,000.00
Rigorous Empirical Performance Analysis of Embedded Systems
EF 2014-15
Résumé
Empirical systems research is facing a dilemma: getting accurate measurements is difficult and time consuming. Minor aspects of an experimental setup can have a significant impact on performance measurements and potentially invalidate conclusions drawn. The growth in complexity and size of modern systems will further exacerbate this dilemma. So how can one trust any reported empirical analysis of a new idea or concept in computer science?The long-term objective of the applicant's research is to understand how to create reproducible, robust, and reliable performance experiments with reasonable effort for the embedded domain. This work is important because, as computer science matures, even more subareas will report lower improvement rates and hence our evaluation techniques must increase in accuracy to distinguish real innovation from flukes. Towards this long-term goal, we propose a program to develop a systematic approach to identify hidden factors influencing performance analysis across the system stack, investigate their interaction, and study transferability of results, and integrate the results into our experimentation infrastructure. This program targets the domain of embedded software, because embedded systems are usually resource constrained (e.g., low memory, low processing power, battery driven) and thus have a particular need for performance analysis. However, the results such as newly found factors and the tools will also be applicable to general systems.The program will have significant impact through its practical results and also the developed tools. Our research targets a critically needed technology (i.e., enabling accurate performance measurements). Canada's Information and Communiation Technology (ICT) needs this to make decisions on sound data.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
357121-2013
Name nom
Fischmeister, Sebastian
Department département
Electrical & Computer Engineering
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2014
Competition year année de concours
2013
Award amount
36000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2720
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Computer systems software
Research subject fr
Logiciel de systèmes informatiques
Partie
2
Nb partie
5
Application title
Rigorous Empirical Performance Analysis of Embedded Systems
Keyword
NSERC
Application summary
Empirical systems research is facing a dilemma: getting accurate measurements is difficult and time consuming. Minor aspects of an experimental setup can have a significant impact on performance measurements and potentially invalidate conclusions drawn. The growth in complexity and size of modern systems will further exacerbate this dilemma. So how can one trust any reported empirical analysis of a new idea or concept in computer science?The long-term objective of the applicant's research is to understand how to create reproducible, robust, and reliable performance experiments with reasonable effort for the embedded domain. This work is important because, as computer science matures, even more subareas will report lower improvement rates and hence our evaluation techniques must increase in accuracy to distinguish real innovation from flukes. Towards this long-term goal, we propose a program to develop a systematic approach to identify hidden factors influencing performance analysis across the system stack, investigate their interaction, and study transferability of results, and integrate the results into our experimentation infrastructure. This program targets the domain of embedded software, because embedded systems are usually resource constrained (e.g., low memory, low processing power, battery driven) and thus have a particular need for performance analysis. However, the results such as newly found factors and the tools will also be applicable to general systems.The program will have significant impact through its practical results and also the developed tools. Our research targets a critically needed technology (i.e., enabling accurate performance measurements). Canada's Information and Communiation Technology (ICT) needs this to make decisions on sound data.