Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Toronto

$26,000.00

Formalizing and Automating Technology Maturity Assessment

EF 2023-24

Résumé
Would you apply a 40-year old method or tool to advance a cutting-edge engineering project? Would you use a method developed at another organization, in a different field, without an understanding of the generalizability of the method's results? Current best practice in technology maturity assessment is the Technology Readiness Level (TRL) scale, which was developed by NASA in the 1970s. Today, TRL assessments are used to make multi-million-dollar decisions at organizations in the manufacturing, energy and transportation industries, and at major grant agencies and regulatory bodies worldwide. The TRL is not sufficiently validated in established fields of application, and is little studied in new fields where technology-intensive start-ups are blossoming. The TRLs rely on expert-assessments, which have been shown to be highly subjective. My recent progress has established the limitations of current best practices in such assessments, serving as a foundation for the proposed work. With increasing access to data and automated classification techniques, an important opportunity exists to improve the reliability of technology maturity assessments. My long-term vision is to revolutionize the technology maturity assessment process, and I therefore propose a research program to formalize and automate this process, with three short-term objectives: 1.Establish a formal understanding of inter-human agreement on TRL assessment in engineering-intensive organizations. Design an experimental method to collect TRL assessments, to formally establish a measure of expert disagreement in various industry contexts. 2.Generate an automated classification model for TRL. Collect and analyze publicly available data sets of TRL assessments, including one from NASA, as well as scientific publications, patents, and venture funding. Build a conceptual model of technology maturity to inform the development of a machine-learning technology-maturity classifier. 3.Develop and validate a novel Technology Maturity Assessment Analytics Tool for decision support. Incorporate expert and data-driven knowledge to assess technology maturity. Embody this tool in a publicly accessible online portal such that ongoing data collection can be conducted, stimulating future research and sparking future collaboration. The novel tool proposed for technology maturity assessment will boost innovation through better-informed decisions at organizations that involve: engineering-intensive development, venture capital investment, and the granting of public funds. The application of state-of-the-art machine learning techniques will influence the broad field of systems engineering decision-making to re-think critical processes, many of which currently rely solely on experts. HQP, including undergraduate summer researchers and graduate students, will gain skills not only in technical engineering design but also data analytics and behavioural studies, currently in critical shortage in Canada.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2020-06031
Name nom
Olechowski, Alison
Department département
Mechanical & Industrial Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2020
Award amount
26000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
703
Area of application group en
Transportation systems and services
Area of application group fr
Services et systèmes de transport
Area of application en
Aerospace
Area of application fr
Aérospatial
Research subject code
1700
Research subject group en
Design and manufacturing
Research subject group fr
Design and manufacturing
Research subject en
Conception et fabrication
Research subject fr
Conception et fabrication
Application title
Formalizing and Automating Technology Maturity Assessment
Keyword
decision-making; design process; engineering design; systems engineering; technology management; technology maturity assessment
Application summary
Would you apply a 40-year old method or tool to advance a cutting-edge engineering project? Would you use a method developed at another organization, in a different field, without an understanding of the generalizability of the method's results? Current best practice in technology maturity assessment is the Technology Readiness Level (TRL) scale, which was developed by NASA in the 1970s. Today, TRL assessments are used to make multi-million-dollar decisions at organizations in the manufacturing, energy and transportation industries, and at major grant agencies and regulatory bodies worldwide. The TRL is not sufficiently validated in established fields of application, and is little studied in new fields where technology-intensive start-ups are blossoming. The TRLs rely on expert-assessments, which have been shown to be highly subjective. My recent progress has established the limitations of current best practices in such assessments, serving as a foundation for the proposed work. With increasing access to data and automated classification techniques, an important opportunity exists to improve the reliability of technology maturity assessments. My long-term vision is to revolutionize the technology maturity assessment process, and I therefore propose a research program to formalize and automate this process, with three short-term objectives: 1.Establish a formal understanding of inter-human agreement on TRL assessment in engineering-intensive organizations. Design an experimental method to collect TRL assessments, to formally establish a measure of expert disagreement in various industry contexts. 2.Generate an automated classification model for TRL. Collect and analyze publicly available data sets of TRL assessments, including one from NASA, as well as scientific publications, patents, and venture funding. Build a conceptual model of technology maturity to inform the development of a machine-learning technology-maturity classifier. 3.Develop and validate a novel Technology Maturity Assessment Analytics Tool for decision support. Incorporate expert and data-driven knowledge to assess technology maturity. Embody this tool in a publicly accessible online portal such that ongoing data collection can be conducted, stimulating future research and sparking future collaboration. The novel tool proposed for technology maturity assessment will boost innovation through better-informed decisions at organizations that involve: engineering-intensive development, venture capital investment, and the granting of public funds. The application of state-of-the-art machine learning techniques will influence the broad field of systems engineering decision-making to re-think critical processes, many of which currently rely solely on experts. HQP, including undergraduate summer researchers and graduate students, will gain skills not only in technical engineering design but also data analytics and behavioural studies, currently in critical shortage in Canada.