Grant: Alliance Grants
Université de Sherbrooke
$37,500.00
Spatio-temporal reasoning in mixed reality with a hybrid approach to support scalability and development of virtuality-reality continnum software
FY 2022-23
Summary
Recent advances in technology have led to the introduction of a new class of computing devices that combine computer-generated information with the "physical" world in a reality-virtuality continuum, such as Mixed Reality (MR). MR relies on contextual information to integrate virtual content within the physical environment and recognize users' actions to foster intuitive and natural interactions. In this project, we work on a first challenge in MR which resides in improving spatiotemporal reasoning by recognizing objects in a 3D world and tracking them while the users interact in a reality-virtuality continuum. As a second challenge, we will work in supporting the knowledge transfers and the construction of a common representation of an environment in MR between several users and several local or remote physical spaces. The expected results of the project will consist in algorithms and models for MR that will be implemented in two MR based context-aware decision support application prototypes for the Industry 4.0 and healthcare, as well as experimental results collected during in labs and on the field tests with potential users in Industry 4.0 and healthcare. The industry partner in this project is VMware Canada, a leader in intelligent multi-cloud ecosystems. It is expected that the use case of Mixed Reality, which is considered in this project, will play a pivotal role in the next generation - namely 6G - of mobile networks, which is one of the key research areas for the VMWare Distributed Edge (DE). The research conducted in this project to enhance Mixed Reality experiences, its scability and its demonstration (in Industry 4.0 and in healthcare) in a jointly identified infrastructure is therefore of utmost interest for VMware.
Program
Alliance Grants
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
577627-2022
Name nom
Gouin-Vallerand, Charles C
Department département
Systèmes d'information et méthodes quantitatives de gestion
Organization id
68
Institution établissement
Université de Sherbrooke
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2022
Award amount
37500
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2716
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Virtual reality and related simulations
Research subject fr
Réalité virtuelle et simulations connexes
Installment
inst:1
Partie
1
Nb partie
1
Application title
Spatio-temporal reasoning in mixed reality with a hybrid approach to support scalability and development of virtuality-reality continnum software
Application summary
Recent advances in technology have led to the introduction of a new class of computing devices that combine computer-generated information with the "physical" world in a reality-virtuality continuum, such as Mixed Reality (MR). MR relies on contextual information to integrate virtual content within the physical environment and recognize users' actions to foster intuitive and natural interactions. In this project, we work on a first challenge in MR which resides in improving spatiotemporal reasoning by recognizing objects in a 3D world and tracking them while the users interact in a reality-virtuality continuum. As a second challenge, we will work in supporting the knowledge transfers and the construction of a common representation of an environment in MR between several users and several local or remote physical spaces. The expected results of the project will consist in algorithms and models for MR that will be implemented in two MR based context-aware decision support application prototypes for the Industry 4.0 and healthcare, as well as experimental results collected during in labs and on the field tests with potential users in Industry 4.0 and healthcare. The industry partner in this project is VMware Canada, a leader in intelligent multi-cloud ecosystems. It is expected that the use case of Mixed Reality, which is considered in this project, will play a pivotal role in the next generation - namely 6G - of mobile networks, which is one of the key research areas for the VMWare Distributed Edge (DE). The research conducted in this project to enhance Mixed Reality experiences, its scability and its demonstration (in Industry 4.0 and in healthcare) in a jointly identified infrastructure is therefore of utmost interest for VMware.