Grant: Discovery Grants Program - Individual
Concordia University
$31,000.00
Improving User Motor Performance and User Experience in Virtual Reality and Augmented Reality Training Systems
FY 2023-24
Summary
Low-cost head-mounted displays (HMDs) for Virtual Reality (VR) and Augmented Reality (AR) applications are becoming more affordable and accessible. Based on this trend, software developers, engineers, and practitioners in various fields including medicine, sports, and first responders are increasingly using HMDs in VR/AR training systems to help trainees to train or maintain their professional skills. Immersive headsets are often preferred for such training, as they create a controllable environment, enable remote collaboration, detailed data collection, and task repetition control. Yet, the current technology used in low-cost VR/AR HMDs still restricts user performance and the user experience. Further, proposed solutions to mitigate these restrictions are primarily targeted at daily VR/AR users, not trainees. The long-term objective of this research program is to create efficient VR/AR training systems that offer the same outcomes on the individuals' performance as conventional ones, but with better accessibility. The specific focus is to increase motor performance and the user experience of the trainees in such virtual environments using HMDs. In the short term, I am planning three major projects to help trainers and trainees who use VR/AR HMDs in training systems. These projects are 1) design of novel mid-air interaction techniques for trainees using VR/AR HMDs, 2) applying cognitive science insights to provide better feedback to trainees, and 3) integrating intelligent avatars to provide feedback to improve training outcomes. Within an Human-Computer Interaction (HCI) research framework, we will conduct user studies and compare existing solutions with the proposed methods. We aim to create efficient and effective VR/AR HMD-based training systems. We will identify shortcomings, limitations, and drawbacks of VR/AR HMD technology and propose methods to overcome them. We will design new mid-air interaction techniques that take the trainee's cognitive load into account during skill acquisition. Using task features and human movements, we will propose accurate user performance assessment criteria to decrease the users' training time. We will improve the user experience while the trainee interacts with asynchronous intelligent avatars that are tailored to those in outlying Canadian regions with minimal resources. The results of this proposal are expected to be used in various VR/AR training systems, help trainees to learn required skills at low cost and help Canadian companies have access to larger pools of skilled personnel and ultimately increase their revenue. It will also help us to train Indigenous people living in remote areas. Furthermore, the proposed solutions can be used in other fields, such as immersive analytics and VR/AR games. The research will not only support VR/AR training systems and simulators but also help us to understand the human sensorimotor system during complex task execution within immersive environments.
Program
Discovery Grants Program - Individual
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2023-05642
Name nom
Batmaz, Anil
Department département
Computer Science
Organization id
70
Institution établissement
Concordia University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2023
Award amount
31000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2716
Research subject group en
Information technology
Research subject group fr
Virtual reality and related simulations
Research subject en
Technologie de l'information
Research subject fr
Réalité virtuelle et simulations connexes
Application title
Improving User Motor Performance and User Experience in Virtual Reality and Augmented Reality Training Systems
Keyword
3D User Interfaces; Augmented Reality; Intelligent Avatars; Motor Performance; Performance Assessment; Training Systems; User Experience; User Interaction; Virtual Reality
Application summary
Low-cost head-mounted displays (HMDs) for Virtual Reality (VR) and Augmented Reality (AR) applications are becoming more affordable and accessible. Based on this trend, software developers, engineers, and practitioners in various fields including medicine, sports, and first responders are increasingly using HMDs in VR/AR training systems to help trainees to train or maintain their professional skills. Immersive headsets are often preferred for such training, as they create a controllable environment, enable remote collaboration, detailed data collection, and task repetition control. Yet, the current technology used in low-cost VR/AR HMDs still restricts user performance and the user experience. Further, proposed solutions to mitigate these restrictions are primarily targeted at daily VR/AR users, not trainees. The long-term objective of this research program is to create efficient VR/AR training systems that offer the same outcomes on the individuals' performance as conventional ones, but with better accessibility. The specific focus is to increase motor performance and the user experience of the trainees in such virtual environments using HMDs. In the short term, I am planning three major projects to help trainers and trainees who use VR/AR HMDs in training systems. These projects are 1) design of novel mid-air interaction techniques for trainees using VR/AR HMDs, 2) applying cognitive science insights to provide better feedback to trainees, and 3) integrating intelligent avatars to provide feedback to improve training outcomes. Within an Human-Computer Interaction (HCI) research framework, we will conduct user studies and compare existing solutions with the proposed methods. We aim to create efficient and effective VR/AR HMD-based training systems. We will identify shortcomings, limitations, and drawbacks of VR/AR HMD technology and propose methods to overcome them. We will design new mid-air interaction techniques that take the trainee's cognitive load into account during skill acquisition. Using task features and human movements, we will propose accurate user performance assessment criteria to decrease the users' training time. We will improve the user experience while the trainee interacts with asynchronous intelligent avatars that are tailored to those in outlying Canadian regions with minimal resources. The results of this proposal are expected to be used in various VR/AR training systems, help trainees to learn required skills at low cost and help Canadian companies have access to larger pools of skilled personnel and ultimately increase their revenue. It will also help us to train Indigenous people living in remote areas. Furthermore, the proposed solutions can be used in other fields, such as immersive analytics and VR/AR games. The research will not only support VR/AR training systems and simulators but also help us to understand the human sensorimotor system during complex task execution within immersive environments.