Grant: Discovery Launch Supplement
University of Calgary
$12,500.00
From Trust Management to Safe and Reliable Human-Autonomy Teaming
FY 2024-25
Summary
Artificial Intelligence (AI) holds the promise of delivering both incremental and profound changes in our societies. To fully benefit from AI-enabled autonomous systems, garnering and maintaining trust in AI systems is problematic and requires solutions to encouraging acceptance by the general public. The problem of trust in these autonomous systems is complex and multidimensional. It is largely dependent on both effective human-machine interaction and robust and reliable autonomy. To address this issue, a trust homeostasis model was proposed based on a previously established conceptual trust model IMPACTS with seven essential system requirements of an AI system, namely intention, measurability, performance, adaptivity, communication, transparency, and security. Its objective is to guide the development of a unified and powerful intelligent adaptive trust management system (TMS) towards objective criteria for trustworthiness of AI systems and thus effective human-autonomy teaming (HAT).
Based on a model-based systems engineering approach with considerations of all TMS functional components, two essential trust models as a part of IMPACTS homeostasis trust model are critical for the formulation of intelligent adaptation strategies to optimize the fit of trust level for maximizing HAT performance and ensure safety. They are human-to-autonomy and autonomy-to-human trust models. Then, the specific objective of this research is to develop and validate these two models in both a simulation and human-in-the-loop experimentation environments by four highly qualified personnel (HQP) including two PhD and two MASc students.
These validated trust models will support the development of the IMPACTS homeostasis TMS that captures the dynamic, transactional, socio-technical, and bi-directional HAT nature. The associated evaluation criteria will guide the verification and validation of the AI systems with the optimized HAT trust and promote public acceptance and then further contribute to maintaining Canada's leading position in this area. The practical technological solutions developed here will improve the competitiveness of Canadian industry and benefit Canadian economic expansion and innovative savings in socio-technical autonomous systems. Additionally, all HQP involved in the project will be trained in both theoretical and hands-on marketable modeling, experimentation, and analytical skills that are sought after by Canadian research community and industry. The research will help spring new communities of research contributors, and practitioners, around specific interests in human-AI symbiotic partnership.
Program
Discovery Launch Supplement
Recipient
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
DGECR-2024-00130
Name nom
Hou, Ming
Department département
Electrical and Software Engineering
Organization id
11
Institution établissement
University of Calgary
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
12500
Program id
DGECR
Program name en
Discovery Launch Supplement
Program name fr
Supplément Tremplin vers la découverte
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
1206
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Engineering
Area of application fr
Génie
Research subject code
1605
Research subject group en
Industrial engineering
Research subject group fr
Génie industriel
Research subject en
Human factors engineering
Research subject fr
Génie des facteurs humains
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
From Trust Management to Safe and Reliable Human-Autonomy Teaming
Keywords
trust; trust management; trust optimization; trust modeling; human-autonomy teaming; human-ai teaming; human-ai symbiosis; human-autonomation interaction; human-machine system; human factors
Application summary
Artificial Intelligence (AI) holds the promise of delivering both incremental and profound changes in our societies. To fully benefit from AI-enabled autonomous systems, garnering and maintaining trust in AI systems is problematic and requires solutions to encouraging acceptance by the general public. The problem of trust in these autonomous systems is complex and multidimensional. It is largely dependent on both effective human-machine interaction and robust and reliable autonomy. To address this issue, a trust homeostasis model was proposed based on a previously established conceptual trust model IMPACTS with seven essential system requirements of an AI system, namely intention, measurability, performance, adaptivity, communication, transparency, and security. Its objective is to guide the development of a unified and powerful intelligent adaptive trust management system (TMS) towards objective criteria for trustworthiness of AI systems and thus effective human-autonomy teaming (HAT).
Based on a model-based systems engineering approach with considerations of all TMS functional components, two essential trust models as a part of IMPACTS homeostasis trust model are critical for the formulation of intelligent adaptation strategies to optimize the fit of trust level for maximizing HAT performance and ensure safety. They are human-to-autonomy and autonomy-to-human trust models. Then, the specific objective of this research is to develop and validate these two models in both a simulation and human-in-the-loop experimentation environments by four highly qualified personnel (HQP) including two PhD and two MASc students.
These validated trust models will support the development of the IMPACTS homeostasis TMS that captures the dynamic, transactional, socio-technical, and bi-directional HAT nature. The associated evaluation criteria will guide the verification and validation of the AI systems with the optimized HAT trust and promote public acceptance and then further contribute to maintaining Canada's leading position in this area. The practical technological solutions developed here will improve the competitiveness of Canadian industry and benefit Canadian economic expansion and innovative savings in socio-technical autonomous systems. Additionally, all HQP involved in the project will be trained in both theoretical and hands-on marketable modeling, experimentation, and analytical skills that are sought after by Canadian research community and industry. The research will help spring new communities of research contributors, and practitioners, around specific interests in human-AI symbiotic partnership.