Grant: Alliance Grants
University of Calgary
$50,000.00
EMOGENT: Developing emotionally communicative mixed reality agent for empathic social interaction
EF 2024-25
Résumé
Intelligent Virtual Agents (IVAs), depicted in many science fiction films, are becoming a reality in our everyday lives due to advancements in Artificial Intelligence (AI) technology. Although current commercial IVAs like Amazon Alexa, Apple Siri, and Google Assistant allow voice commands, they lack non-verbal cues and context awareness. Such IVAs are typically unable to detect user emotions and respond empathetically, which can result in interactions that feel impersonal and less engaging. This limitation becomes critical in various human-agent interaction and collaboration settings, including training and operations where effective communication and situational awareness are vital.
To address this, the proposed research aims to enhance IVA interactions using Mixed Reality (MR) technologies, enabling multimodal human analysis and visual embodiment to support social relationships, improve the quality of communication, and bolster performance in collaborative scenarios, such as decision-making and situational awareness. To that end, the overarching goal of this research includes (1) developing emotionally responsive empathic MR agents that can sense/interact with the real world through integration with the Internet of Things (IoT), and (2) studying the impacts on user experience, communication quality, and performance in human-agent interaction. Our project aligns with emerging Information and Communications Technologies (ICT) research topics that NSERC Alliance - Alberta Innovates Advance Program targets: IoT/machine-to-machine systems, advanced data management and analytics, and human interaction with digital media in general.
The project's diverse portfolio of MR agent prototypes and notable research accomplishments, e.g., academic publications, is expected to draw globally recognized researchers for potential collaborations. The project has the potential to attract private investments from technology companies and investors interested in MR and AI applications, spanning various sectors such as healthcare, education, training, and entertainment.
Programme
Alliance Grants
Bénéficiaire
Emplacement
Alberta, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
590555-2023
Name nom
Kim, Kangsoo K
Department département
Electrical and Software Engineering
Organization id
11
Institution établissement
University of Calgary
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2023
Award amount
50000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2716
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Virtual reality and related simulations
Research subject fr
Réalité virtuelle et simulations connexes
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
EMOGENT: Developing emotionally communicative mixed reality agent for empathic social interaction
Keywords
embodied interaction; human-agent interaction; internet of things; perception and cognition; social interaction; user experience; user studies; virtual/augmented/mixed reality; virtual avatars and agents
Application summary
Intelligent Virtual Agents (IVAs), depicted in many science fiction films, are becoming a reality in our everyday lives due to advancements in Artificial Intelligence (AI) technology. Although current commercial IVAs like Amazon Alexa, Apple Siri, and Google Assistant allow voice commands, they lack non-verbal cues and context awareness. Such IVAs are typically unable to detect user emotions and respond empathetically, which can result in interactions that feel impersonal and less engaging. This limitation becomes critical in various human-agent interaction and collaboration settings, including training and operations where effective communication and situational awareness are vital.
To address this, the proposed research aims to enhance IVA interactions using Mixed Reality (MR) technologies, enabling multimodal human analysis and visual embodiment to support social relationships, improve the quality of communication, and bolster performance in collaborative scenarios, such as decision-making and situational awareness. To that end, the overarching goal of this research includes (1) developing emotionally responsive empathic MR agents that can sense/interact with the real world through integration with the Internet of Things (IoT), and (2) studying the impacts on user experience, communication quality, and performance in human-agent interaction. Our project aligns with emerging Information and Communications Technologies (ICT) research topics that NSERC Alliance - Alberta Innovates Advance Program targets: IoT/machine-to-machine systems, advanced data management and analytics, and human interaction with digital media in general.
The project's diverse portfolio of MR agent prototypes and notable research accomplishments, e.g., academic publications, is expected to draw globally recognized researchers for potential collaborations. The project has the potential to attract private investments from technology companies and investors interested in MR and AI applications, spanning various sectors such as healthcare, education, training, and entertainment.