Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

Ryerson University

$25,000.00

Stress assessment using multimodal learning in an augmented reality environment

FY 2018-19

Summary
Anxiety or stress before a complex pediatric procedure is detrimental to a child's health. It also adds cost to the*healthcare system by potentially prolonging the recovery period. Shaftesbury Development II Inc is developing*a a Positive Distraction Entertainment System (PDES) that can dynamically deliver game/media content to*alleviate the user's stress for maximum positive outcome. It can be used as a mean for non-pharmacological*anxiety reduction in children before a complex pediatric procedure. The PDES system dynamically adjusts the*media content (e.g. an interactive Virtual Reality (VR) game) based on the user's current stress level which can*be assessed through biomedical signals such as heart-rate, EEG. Currently, Shaftesbury is investigating how to*extend the current system into Augmented Reality (AR) headsets such as Microsoft Hololens, which will*provide the opportunity to develop collaborative experiences with multiple users. The camera input on such*devices also opens up the opportunity to incorporate behavioral signals (e.g. user's hand gesture, facial*expression) alongside biomedical signals to further strengthen the stress level and engagement assessment. In*this research project, we will employ state-of-the-art machine learning techniques to fuse multimodal*(behavioral and biomedical) signals to accurately assess the stress level of a user. Our proposed system will*depend on very little training data due to implementation of novel signal transformation and transfer learning*techniques. The system will be fully integrated with Shaftesbury's PDES so that game/media content can be*adjusted dynamically to reduce stress before a medical procedure.
Program
Engage Grants Program
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
528342-2018
Name nom
Khan, Naimul
Department département
Electrical, Computer and Biomedical Engineering
Organization id
43
Institution établissement
Ryerson University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1553
Committee name en
Ontario Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Ontario
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2514
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Digital signal processing
Research subject fr
Traitement des signaux numériques
Partie
1
Nb partie
1
Application title
Stress assessment using multimodal learning in an augmented reality environment
Keyword
NSERC
Application summary
Anxiety or stress before a complex pediatric procedure is detrimental to a child's health. It also adds cost to the*healthcare system by potentially prolonging the recovery period. Shaftesbury Development II Inc is developing*a a Positive Distraction Entertainment System (PDES) that can dynamically deliver game/media content to*alleviate the user's stress for maximum positive outcome. It can be used as a mean for non-pharmacological*anxiety reduction in children before a complex pediatric procedure. The PDES system dynamically adjusts the*media content (e.g. an interactive Virtual Reality (VR) game) based on the user's current stress level which can*be assessed through biomedical signals such as heart-rate, EEG. Currently, Shaftesbury is investigating how to*extend the current system into Augmented Reality (AR) headsets such as Microsoft Hololens, which will*provide the opportunity to develop collaborative experiences with multiple users. The camera input on such*devices also opens up the opportunity to incorporate behavioral signals (e.g. user's hand gesture, facial*expression) alongside biomedical signals to further strengthen the stress level and engagement assessment. In*this research project, we will employ state-of-the-art machine learning techniques to fuse multimodal*(behavioral and biomedical) signals to accurately assess the stress level of a user. Our proposed system will*depend on very little training data due to implementation of novel signal transformation and transfer learning*techniques. The system will be fully integrated with Shaftesbury's PDES so that game/media content can be*adjusted dynamically to reduce stress before a medical procedure.
Ryerson University - $25,000 Grant (2018-19) | Canada Spends