Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Research Tools and Instruments

Institut national de la recherche scientifique

$95,174.00

Multisensory immersive media and next-generation applications

FY 2020-21

Summary
Immersive communication aims to enable natural experiences and interactions with remote people and environments in ways that blur the line between real and virtual environments. Today, our need for more effective ways to communicate with remote people has never been greater. Existing immersive technologies and applications, however, rely only on two senses: vision and hearing. To enable true immersive communications, we need to involve other senses, such as olfaction, touch, and thermo(re)ception. Imagine yourself watching a movie where you feel the heat from an explosion; a videogame where you can feel the wind in your face as you are driving; TV ads where you can smell the food; multisensory virtual therapy for individuals with anxiety; or a videoconference, where you can "touch" the person on the other side of the call. In fact, Ericsson's ConsumerLab suggests that upcoming technological advances will move us from a screen-based world to a sense-based world by 2030. It is envisioned that the Internet of Things will become the Internet of Senses where mind, touch, smells, taste, sight and sound will all come together with the help of emerging 5G networks and Tactile Internet innovations. Canada, despite being known worldwide for innovations in virtual reality (VR), falls far behind Europe, for example, when it comes to multisensory immersive media research. This proposal aims to fill this gap. We request funds to purchase a multisensory immersive virtual reality booth - the first in Canada for research purposes. It is portable, wheelchair accessible, and comprises a programmable interface in which scents, hot/cold air, arm gestures, haptic feedback, immersive audio, and VR content can be presented for research purposes. This fundamental component will enable a new line of research in Canada, that of multisensory immersive media. When coupled with our award-winning instrumented virtual reality headset and user-aware human factor metrics for quality-of-experience monitoring, applications across multiple verticals will be developed that are optimized for each user. Within the healthcare sector, applications such as multisensory anxiety therapeutics and Alzheimer's disease diagnosis will be explored. For defense, it will enable next-generation training of soldiers and pilots in high-risk situations. For the entertainment sector, new paradigms in gaming, gamer experience, and remote tourism will be enabled. The requested equipment will not only open up a new research frontier for Canada, but will also expose existing and incoming highly qualified personnel to a highly interdisciplinary topic, thus providing young researchers with invaluable cross-disciplinary expertise in domains that are highly sought-after in the marketplace. Represenatative examples include human factors, immersive media, signal processing, serious gaming, neuropsychology, healthcare 4.0, information fusion, big data, and machine learning, to name a few.
Program
Research Tools and Instruments
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RTI-2021-00298
Name nom
Falk, Tiago
Department département
Energie, Materiaux, Telecommunications
Organization id
56
Institution établissement
Institut national de la recherche scientifique
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2020
Competition year année de concours
2021
Award amount
95174
Program id
RTI
Program name en
Research Tools and Instruments
Program name fr
Outils et instruments de recherche
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1610
Committee name en
Electrical and Computer Engineering (RTI)
Committee name fr
Génie électrique et infomatique (OIR)
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2514
Research subject group en
Electrical and electronic engineering
Research subject group fr
Génie électrique et électronique
Research subject en
Digital signal processing
Research subject fr
Traitement des signaux numériques
Installment
inst:1-1
Partie
1
Nb partie
1
Application title
Multisensory immersive media and next-generation applications
Keyword
NSERC
Application summary
Immersive communication aims to enable natural experiences and interactions with remote people and environments in ways that blur the line between real and virtual environments. Today, our need for more effective ways to communicate with remote people has never been greater. Existing immersive technologies and applications, however, rely only on two senses: vision and hearing. To enable true immersive communications, we need to involve other senses, such as olfaction, touch, and thermo(re)ception. Imagine yourself watching a movie where you feel the heat from an explosion; a videogame where you can feel the wind in your face as you are driving; TV ads where you can smell the food; multisensory virtual therapy for individuals with anxiety; or a videoconference, where you can "touch" the person on the other side of the call. In fact, Ericsson's ConsumerLab suggests that upcoming technological advances will move us from a screen-based world to a sense-based world by 2030. It is envisioned that the Internet of Things will become the Internet of Senses where mind, touch, smells, taste, sight and sound will all come together with the help of emerging 5G networks and Tactile Internet innovations. Canada, despite being known worldwide for innovations in virtual reality (VR), falls far behind Europe, for example, when it comes to multisensory immersive media research. This proposal aims to fill this gap. We request funds to purchase a multisensory immersive virtual reality booth - the first in Canada for research purposes. It is portable, wheelchair accessible, and comprises a programmable interface in which scents, hot/cold air, arm gestures, haptic feedback, immersive audio, and VR content can be presented for research purposes. This fundamental component will enable a new line of research in Canada, that of multisensory immersive media. When coupled with our award-winning instrumented virtual reality headset and user-aware human factor metrics for quality-of-experience monitoring, applications across multiple verticals will be developed that are optimized for each user. Within the healthcare sector, applications such as multisensory anxiety therapeutics and Alzheimer's disease diagnosis will be explored. For defense, it will enable next-generation training of soldiers and pilots in high-risk situations. For the entertainment sector, new paradigms in gaming, gamer experience, and remote tourism will be enabled. The requested equipment will not only open up a new research frontier for Canada, but will also expose existing and incoming highly qualified personnel to a highly interdisciplinary topic, thus providing young researchers with invaluable cross-disciplinary expertise in domains that are highly sought-after in the marketplace. Represenatative examples include human factors, immersive media, signal processing, serious gaming, neuropsychology, healthcare 4.0, information fusion, big data, and machine learning, to name a few.
Institut national de la recherche scientifique - $95,… | Canada Spends