Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

University of Victoria

$25,000.00

Full body tracking for immersive virtual reality experiences

FY 2016-17

Summary
In 2016 ""virtual reality"" (VR) devices and content reached the mass consumer market, with the commercialrelease of Facebook's Oculus Rift, HTC/Valve's SteamVR, Samsung's GearVR, Sony's PlayStation VR, andmore. Meanwhile, massive investments are being made by other entertainment industries in a new wave ofpremium VR technology and experiences far surpassing consumer-level products. The goal of this Engageproject is to research accessory VR technologies for ""dark rides"" - a category of amusement rides featuringtravel through simulated environments. Dark rides provide physical motion, air flow and temperature,vibration, and other haptic feedback to provide a vivid sense of reality. Replacing projected displays withhigh-end VR headsets can place each guest inside a fully 360-degree simulation. The remaining challenge isproviding believable, virtual, personal embodiment. This can be met by accurately measuring human bodymotion and dimensions, and reproducing them on a virtual avatar, without visible latency or tracking errors.Our technical solution describes a robust system leveraging multiple passive 3D body-tracking sensors, able tocope with isolated tracking errors or partial sensor occlusions. Project deliverables include: (1) a prototypealgorithm combining data from multiple 3D sensors to accurately track body motion without using ""markers"";(2) software tools to map sensor tracking points to a human skeletal model; and (3) a dataset for quantitativeevaluation of tracking results.
Program
Engage Grants Program
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
500958-2016
Name nom
Tagliasacchi, Andrea
Department département
Computer Science
Organization id
7
Institution établissement
University of Victoria
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2016
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1554
Committee name en
Pacific Internal Decision Committee
Committee name fr
Comité de décision interne pour le Pacifique
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2707
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Graphics
Research subject fr
Infographie
Partie
1
Nb partie
1
Application title
Full body tracking for immersive virtual reality experiences
Keyword
NSERC
Application summary
In 2016 ""virtual reality"" (VR) devices and content reached the mass consumer market, with the commercialrelease of Facebook's Oculus Rift, HTC/Valve's SteamVR, Samsung's GearVR, Sony's PlayStation VR, andmore. Meanwhile, massive investments are being made by other entertainment industries in a new wave ofpremium VR technology and experiences far surpassing consumer-level products. The goal of this Engageproject is to research accessory VR technologies for ""dark rides"" - a category of amusement rides featuringtravel through simulated environments. Dark rides provide physical motion, air flow and temperature,vibration, and other haptic feedback to provide a vivid sense of reality. Replacing projected displays withhigh-end VR headsets can place each guest inside a fully 360-degree simulation. The remaining challenge isproviding believable, virtual, personal embodiment. This can be met by accurately measuring human bodymotion and dimensions, and reproducing them on a virtual avatar, without visible latency or tracking errors.Our technical solution describes a robust system leveraging multiple passive 3D body-tracking sensors, able tocope with isolated tracking errors or partial sensor occlusions. Project deliverables include: (1) a prototypealgorithm combining data from multiple 3D sensors to accurately track body motion without using ""markers"";(2) software tools to map sensor tracking points to a human skeletal model; and (3) a dataset for quantitativeevaluation of tracking results.