Grant: Discovery Grants Program - Individual
University of Toronto
$38,000.00
Transcended Reality: Modeling, Fabrication, Interaction, Navigation and Perception in Immersive (AR/VR) Environments
FY 2016-17
Summary
Augmented and Virtual Reality (AR/VR) are experiencing an unprecedented resurgence, with the onset of consumer-grade AR/VR devices and real-time computer graphics, to deliver an immersive experience where the virtual and real blend indistinguishably together. This proposal ambitiously aims to take the promise of AR/VR further, to one of TR or Transcended Reality, where our real physical environment is not only added to as in AR but subtracted from, replicated, abstracted and transformed, or more generally transcended. The dream of VR thinkers since early science fiction writings, has not been to merely recreate our physical reality, but to go beyond, indeed to transcend it.
We will accomplish this by coupling a suite of devices that allow 3D shape and motion to co-exist in the digital and physical realm: combining AR/VR immersive displays (like the Oculus Rift, HTC/Valve Vive, Meta-AR or Microsoft HoloLens) and real-time 3D shape and motion acquisition devices (like the Microsoft Kinect or VICON motion capture), with robotic actuators, laser cutters and 3D printing.
Specifically, the proposed research will focus on three areas within immersive environments: modeling form and function of objects, character interaction and navigation; all grounded by the perceptual capabilities of the immersive setting.
Modeling and Fabrication: We expect 3D models in immersive environments to go beyond shape or form, to imbibe the functionality of physical objects, so that we may actively interact with them. In this proposal, we will thus focus on the simultaneous modeling of both 3D form and function. Digital designs using our research would thus instantly usable, both as digital models in an immersive setting, as 3D printed physical artifacts, or more interestingly as combinations of both.
Interaction: As more devices in our environment become ""internet aware"", TR will be a space where humans communicate with their physical environments via the ""internet of things"". Interactive communication between man and machine in an immersive setting will be another thread of this proposal.This proposal will further explore modeling and animation techniques that produce emotionally engaging avatars, on either side of the uncanny valley.
Navigation and Perception: Understanding the affordances and limitations of shape and motion perceived using stereoscopic and holographic projections continues to evolve with new AR/VR displays, and increased human exposure to these devices. Evaluating the perceptual impact of various immersive interaction and navigation techniques, is an important thread that will pervade our proposed research.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2016-06183
Name nom
Singh, Karan
Department département
Computer Science (St. George Campus) - Computer Science (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2016
Competition year année de concours
2016
Award amount
38000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2707
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Graphics
Research subject fr
Infographie
Partie
1
Nb partie
5
Application title
Transcended Reality: Modeling, Fabrication, Interaction, Navigation and Perception in Immersive (AR/VR) Environments
Keyword
NSERC
Application summary
Augmented and Virtual Reality (AR/VR) are experiencing an unprecedented resurgence, with the onset of consumer-grade AR/VR devices and real-time computer graphics, to deliver an immersive experience where the virtual and real blend indistinguishably together. This proposal ambitiously aims to take the promise of AR/VR further, to one of TR or Transcended Reality, where our real physical environment is not only added to as in AR but subtracted from, replicated, abstracted and transformed, or more generally transcended. The dream of VR thinkers since early science fiction writings, has not been to merely recreate our physical reality, but to go beyond, indeed to transcend it.
We will accomplish this by coupling a suite of devices that allow 3D shape and motion to co-exist in the digital and physical realm: combining AR/VR immersive displays (like the Oculus Rift, HTC/Valve Vive, Meta-AR or Microsoft HoloLens) and real-time 3D shape and motion acquisition devices (like the Microsoft Kinect or VICON motion capture), with robotic actuators, laser cutters and 3D printing.
Specifically, the proposed research will focus on three areas within immersive environments: modeling form and function of objects, character interaction and navigation; all grounded by the perceptual capabilities of the immersive setting.
Modeling and Fabrication: We expect 3D models in immersive environments to go beyond shape or form, to imbibe the functionality of physical objects, so that we may actively interact with them. In this proposal, we will thus focus on the simultaneous modeling of both 3D form and function. Digital designs using our research would thus instantly usable, both as digital models in an immersive setting, as 3D printed physical artifacts, or more interestingly as combinations of both.
Interaction: As more devices in our environment become ""internet aware"", TR will be a space where humans communicate with their physical environments via the ""internet of things"". Interactive communication between man and machine in an immersive setting will be another thread of this proposal.This proposal will further explore modeling and animation techniques that produce emotionally engaging avatars, on either side of the uncanny valley.
Navigation and Perception: Understanding the affordances and limitations of shape and motion perceived using stereoscopic and holographic projections continues to evolve with new AR/VR displays, and increased human exposure to these devices. Evaluating the perceptual impact of various immersive interaction and navigation techniques, is an important thread that will pervade our proposed research.