Grant: Discovery Grants Program - Individual
University of Waterloo
$41,000.00
Developing Technologies for Bringing Physical Objects into Virtual Reality
EF 2024-25
Résumé
Current virtual reality (VR) technologies provide immersive and visually impressive experiences via the use of head-mounted displays (HMDs). However, VR systems are still limited because we cannot see and use physical items in VR, as the HMD blocks our view of the surrounding physical world. In other words, we cannot bring anything with us into virtual reality.
This problem fundamentally limits the applications of VR, and solving it provides an incredible range of possibilities for training, education, work, healthcare, research, and beyond. Imagine, for instance, attending a practical training class in VR where you can bring your own physical tools, or moving your own physical workstation to a calming tropical island. Current approaches to such situations are limited and inaccessible to end users.
Therefore, the long-term goal of this research program is to create novel technologies and systems that enable the completely natural use of physical objects in VR. In this five-year Discovery Grant, the goal is to take the first steps towards creating the initial technologies for this purpose. This proposal consists of two main short-term objectives:
Objective 1: Development of Technologies for the Integration of Physical Objects with VR. This objective governs the development and testing of technologies that enable us to bring physical objects into virtual reality, ranging from tools and furniture to smartphones and laptops. The proposed technologies will be developed using computer vision (e.g., photogrammetry, object recognition), external trackers, and smart device capabilities (e.g., screencasting, accelerometers).
Objective 2: Development of Systems and Tools for the Creation of Physical VR Scenarios. The aim of this objective is to develop systems and tools that end users can use to set up and create their own virtual scenarios where they can access their desired physical objects, using the technologies developed in Objective 1. These systems must be flexible and easy to use.
The developed technologies and tools will be evaluated in empirical user studies to understand their effectiveness. The studies will follow proven practices in human-computer interaction (HCI), utilizing both quantitative and qualitative research methods.
The main outcomes of this research are the technologies that integrate physical objects into VR, the systems that make these technologies available for end users, and knowledge about the effectiveness of these technologies. These outcomes will create considerable possibilities with societal and economic impact, and will be made freely available to industry professionals, academics, students, and end users. Finally, this program will train up to eight students who will gain skills in virtual reality, software development, HCI, and more. Development and research expertise in VR will be in exceptionally high demand, as the global VR market is projected to grow more than tenfold by 2029.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2023-03725
Name nom
Mäkelä, Ville
Department département
Faculty of Arts
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2023
Award amount
41000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2716
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Virtual reality and related simulations
Research subject fr
Réalité virtuelle et simulations connexes
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Developing Technologies for Bringing Physical Objects into Virtual Reality
Keywords
virtual reality; tracking; tangible interaction; smart devices; real-world simulation; human-computer interaction; user experience
Application summary
Current virtual reality (VR) technologies provide immersive and visually impressive experiences via the use of head-mounted displays (HMDs). However, VR systems are still limited because we cannot see and use physical items in VR, as the HMD blocks our view of the surrounding physical world. In other words, we cannot bring anything with us into virtual reality.
This problem fundamentally limits the applications of VR, and solving it provides an incredible range of possibilities for training, education, work, healthcare, research, and beyond. Imagine, for instance, attending a practical training class in VR where you can bring your own physical tools, or moving your own physical workstation to a calming tropical island. Current approaches to such situations are limited and inaccessible to end users.
Therefore, the long-term goal of this research program is to create novel technologies and systems that enable the completely natural use of physical objects in VR. In this five-year Discovery Grant, the goal is to take the first steps towards creating the initial technologies for this purpose. This proposal consists of two main short-term objectives:
Objective 1: Development of Technologies for the Integration of Physical Objects with VR. This objective governs the development and testing of technologies that enable us to bring physical objects into virtual reality, ranging from tools and furniture to smartphones and laptops. The proposed technologies will be developed using computer vision (e.g., photogrammetry, object recognition), external trackers, and smart device capabilities (e.g., screencasting, accelerometers).
Objective 2: Development of Systems and Tools for the Creation of Physical VR Scenarios. The aim of this objective is to develop systems and tools that end users can use to set up and create their own virtual scenarios where they can access their desired physical objects, using the technologies developed in Objective 1. These systems must be flexible and easy to use.
The developed technologies and tools will be evaluated in empirical user studies to understand their effectiveness. The studies will follow proven practices in human-computer interaction (HCI), utilizing both quantitative and qualitative research methods.
The main outcomes of this research are the technologies that integrate physical objects into VR, the systems that make these technologies available for end users, and knowledge about the effectiveness of these technologies. These outcomes will create considerable possibilities with societal and economic impact, and will be made freely available to industry professionals, academics, students, and end users. Finally, this program will train up to eight students who will gain skills in virtual reality, software development, HCI, and more. Development and research expertise in VR will be in exceptionally high demand, as the global VR market is projected to grow more than tenfold by 2029.