Grant: Alliance Grants
Institut national de la recherche scientifique
$50,000.00
Detection and prediction of cybersickness in virtual and mixed reality environments using wearables
EF 2023-24
Résumé
Virtual and mixed reality (VR/MR) systems have burgeoned over the last couple of years with applications in healthcare, gaming, telepresence, and skills training, to name a few. Within the skills training sector, for example, police/law enforcement training is an important application domain which has seen increased adoption worldwide. In Canada, Public Safety and the Royal Canadian Mounted Police (RCMP) have invested millions of dollars to set up state-of-the-art VR/MR facilities to train the next generation of law enforcement agents. VR allows for different scenes, conditions, and maneuvers to be tested in one single physical location, thus not only reducing training costs, but better equipping trainees to handle unknowns. While the potential is there, existing VR/MR systems are known to induce motion sickness - known as cybersickness - on a large proportion of the trainees, especially females. As such, cybersickness detection and prevention methods are drastically needed in order to provide a more inclusive training environment. This project aims to solve this problem via the use of multimodal signal processing of wearable device signals. When coupled with the Sensor Hub system developed by the industry partner, Thales Canada, the project proposes to quantify cybersickness under four different locomotion conditions and develop a cybersickness index that can be used in trainee evaluations. In particular, locomotion in VR via steering with controllers, teleporting, and physical movement will be compared against physical movement in mixed reality. Cybersickness indices will be developed based on signals measured in real-time from an in-house developed instrumented headset, a smartshirt, and a smartwatch. Anthropometric measures will also be explored in order to remove any potential biases that may be caused by biological sex. The tools developed herein will enable new applications for the industry partner's Sensor Hub, allowing them to reach a new clientele relying on emerging VR/MR applications, as well as provide invaluable insights and tools for Public Safety Canada and the RCMP to make their training and evaluation protocols more inclusive and equitable.
Programme
Alliance Grants
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
576732-2022
Name nom
Falk, Tiago TH
Department département
Énergie Matériaux Télécommunications, Centre - Montréal
Organization id
56
Institution établissement
Institut national de la recherche scientifique
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
50000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
1900
Research subject group en
Biomedical engineering
Research subject group fr
Biomedical engineering
Research subject en
Génie biomédical
Research subject fr
Génie biomédical
Application title
Detection and prediction of cybersickness in virtual and mixed reality environments using wearables
Keyword
biosignal enhancement; biosignal processing; brain-computer interface; cybersickness; human factors; immersive media experience; machine learning; mixed reality; sensor fusion; virtual reality
Application summary
Virtual and mixed reality (VR/MR) systems have burgeoned over the last couple of years with applications in healthcare, gaming, telepresence, and skills training, to name a few. Within the skills training sector, for example, police/law enforcement training is an important application domain which has seen increased adoption worldwide. In Canada, Public Safety and the Royal Canadian Mounted Police (RCMP) have invested millions of dollars to set up state-of-the-art VR/MR facilities to train the next generation of law enforcement agents. VR allows for different scenes, conditions, and maneuvers to be tested in one single physical location, thus not only reducing training costs, but better equipping trainees to handle unknowns. While the potential is there, existing VR/MR systems are known to induce motion sickness - known as cybersickness - on a large proportion of the trainees, especially females. As such, cybersickness detection and prevention methods are drastically needed in order to provide a more inclusive training environment. This project aims to solve this problem via the use of multimodal signal processing of wearable device signals. When coupled with the Sensor Hub system developed by the industry partner, Thales Canada, the project proposes to quantify cybersickness under four different locomotion conditions and develop a cybersickness index that can be used in trainee evaluations. In particular, locomotion in VR via steering with controllers, teleporting, and physical movement will be compared against physical movement in mixed reality. Cybersickness indices will be developed based on signals measured in real-time from an in-house developed instrumented headset, a smartshirt, and a smartwatch. Anthropometric measures will also be explored in order to remove any potential biases that may be caused by biological sex. The tools developed herein will enable new applications for the industry partner's Sensor Hub, allowing them to reach a new clientele relying on emerging VR/MR applications, as well as provide invaluable insights and tools for Public Safety Canada and the RCMP to make their training and evaluation protocols more inclusive and equitable.