Grant: Engage Grants Program
École Polytechnique de Montréal
$25,000.00
The use of Augmented Reality to Enhance Training on Healthcare Patient Simulators
FY 2016-17
Summary
This project is about overlaying anatomical and reference information on a mannequin with proper visualocclusion in order to provide guidance and improved comprehension to a learner while performing medicaltask. It aims to augment the spatial immersion and the presence in the environment.Our main and most important goal is to provide proper automatic occlusion by nearby objects (ex.: hand,medical equipment) when they are present between the viewer and the intended location for the generatedimages. For example, passing a hand over the mannequin should block the corresponding intended projectionon the mannequin. Another example is the projection of a virtual table positioned on the other side of the bedthat should also be partially occluded by the patient or the bed. We believed that, by accessing the depthinformation created by the Kinect camera within the Hololens, we will be able to generate or recreate a depthmap of the scene to occlude every synthetic object when rendering the holographic 3D image.Solving the occlusion problem will clearly ameliorate the immersive quality and the presence of theenvironment. By taking into account the precise detection of mannequin position and extent, it will be possibleto add virtual objects in the AR scene, subject to various lighting conditions and shadowing (using the depthmap). This will open the way to adding human avatars acting as medical personnel and personal trainers.
Program
Engage Grants Program
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
507671-2016
Name nom
Ozell, Benoit
Department département
Génie informatique et génie logiciel
Organization id
64
Institution établissement
École Polytechnique de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2016
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1552
Committee name en
Quebec Internal Decision Committee
Committee name fr
Comité de décision interne pour le Québec
Area of application code
1211
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Medical and health sciences
Area of application fr
Sciences médicales et de la santé
Research subject code
2717
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Modelling and simulation studies
Research subject fr
Études de modélisation et de simulation
Partie
1
Nb partie
1
Application title
The use of Augmented Reality to Enhance Training on Healthcare Patient Simulators
Keyword
NSERC
Application summary
This project is about overlaying anatomical and reference information on a mannequin with proper visualocclusion in order to provide guidance and improved comprehension to a learner while performing medicaltask. It aims to augment the spatial immersion and the presence in the environment.Our main and most important goal is to provide proper automatic occlusion by nearby objects (ex.: hand,medical equipment) when they are present between the viewer and the intended location for the generatedimages. For example, passing a hand over the mannequin should block the corresponding intended projectionon the mannequin. Another example is the projection of a virtual table positioned on the other side of the bedthat should also be partially occluded by the patient or the bed. We believed that, by accessing the depthinformation created by the Kinect camera within the Hololens, we will be able to generate or recreate a depthmap of the scene to occlude every synthetic object when rendering the holographic 3D image.Solving the occlusion problem will clearly ameliorate the immersive quality and the presence of theenvironment. By taking into account the precise detection of mannequin position and extent, it will be possibleto add virtual objects in the AR scene, subject to various lighting conditions and shadowing (using the depthmap). This will open the way to adding human avatars acting as medical personnel and personal trainers.