Grant: Discovery Grants Program - Individual
Dalhousie University
$25,000.00
Characterizing Human Spatial Thinking When Designing 3D Objects.
EF 2024-25
Résumé
As current virtual reality (VR) and augmented reality (AR) technologies become affordable and accessible, their use has extended outside research labs into classrooms, design studios, and people's homes. One area that has become prevalent is using VR/AR for creative tasks, such as 3D sketching. 3D sketching is transforming design activities as it is a medium that provides designers with both the expressiveness, immediacy, and editability of traditional 2D sketching. Additionally, it supports the body-centered spatial awareness, presence, and multiple perspectives afforded by traditional 3D design tools, such as prototyping. There are already success stories of VR/AR sketching systems that designers use in their workflow, like Tiltbrush and GravitySketch. Besides the ability to directly sketch in 3D, these systems also incorporate tools from CAD software, like adaptive assistance in some scenarios, e.g., by automatically detecting the center of a shape or mirroring the user actions, making the design process even simpler. But the potential of new user interfaces (UIs) is currently held back by a lack of knowledge about how people think spatially when designing 3D objects. Spatial thinking creates a significant cognitive load for the user, which limits their effectiveness when designing an object.
My research program aims to create new adaptive and intelligent UIs for 3D design by identifying the actions and elements humans use when thinking spatially. I focus on spatial thinking as the key element in creative design that leads to cognitive load on the users, especially to those with lower spatial abilities. Here I propose three projects, each of which considers different elements inside the virtual environment, which will inform new UIs that optimize the user's flow. Project 1 will create VR UIs that automatically suggest a camera position and orientation by understanding the effect of a user's point of view on the design process. Project 2 is about designing AR UIs that use haptic and audio feedback to extend real-world objects to mid-air. For this, we will study the effect of reference frames (e.g., walls, tables, etc.) on the design process. Finally, Project 3 is about making AR and VR UIs that provide non-intrusive guides that enhance the user's spatial gestures in real-time. We will study the gestural actions that aid the spatial cognition of a person. These new intelligent UIs will allow users to focus more on being creative and less on understanding the virtual space, which will help democratize the use of 3D design tools by diminishing the cognitive load of the users. My research on spatial thinking extends to areas like education, spatial cognition, and data analysis. These are activities that rely on people making sense of complex environments or mentally visualizing the results of their actions, which depend on people's spatial abilities and spatial thinking. Researchers in these areas can use this knowledge to design intelligent UIs.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Nova Scotia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2022-03865
Name nom
Barrera Machuca, Mayra Donaji
Department département
Faculty of Computer Science
Organization id
79
Institution établissement
Dalhousie University
Province en
Nova Scotia
Province fr
Nouvelle-Écosse
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
25000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2716
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Virtual reality and related simulations
Research subject fr
Réalité virtuelle et simulations connexes
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Characterizing Human Spatial Thinking When Designing 3D Objects.
Keywords
human computer interaction; virtual reality; augmented reality; user interface; 3d sketching; computer aided design; spatial thinking
Application summary
As current virtual reality (VR) and augmented reality (AR) technologies become affordable and accessible, their use has extended outside research labs into classrooms, design studios, and people's homes. One area that has become prevalent is using VR/AR for creative tasks, such as 3D sketching. 3D sketching is transforming design activities as it is a medium that provides designers with both the expressiveness, immediacy, and editability of traditional 2D sketching. Additionally, it supports the body-centered spatial awareness, presence, and multiple perspectives afforded by traditional 3D design tools, such as prototyping. There are already success stories of VR/AR sketching systems that designers use in their workflow, like Tiltbrush and GravitySketch. Besides the ability to directly sketch in 3D, these systems also incorporate tools from CAD software, like adaptive assistance in some scenarios, e.g., by automatically detecting the center of a shape or mirroring the user actions, making the design process even simpler. But the potential of new user interfaces (UIs) is currently held back by a lack of knowledge about how people think spatially when designing 3D objects. Spatial thinking creates a significant cognitive load for the user, which limits their effectiveness when designing an object.
My research program aims to create new adaptive and intelligent UIs for 3D design by identifying the actions and elements humans use when thinking spatially. I focus on spatial thinking as the key element in creative design that leads to cognitive load on the users, especially to those with lower spatial abilities. Here I propose three projects, each of which considers different elements inside the virtual environment, which will inform new UIs that optimize the user's flow. Project 1 will create VR UIs that automatically suggest a camera position and orientation by understanding the effect of a user's point of view on the design process. Project 2 is about designing AR UIs that use haptic and audio feedback to extend real-world objects to mid-air. For this, we will study the effect of reference frames (e.g., walls, tables, etc.) on the design process. Finally, Project 3 is about making AR and VR UIs that provide non-intrusive guides that enhance the user's spatial gestures in real-time. We will study the gestural actions that aid the spatial cognition of a person. These new intelligent UIs will allow users to focus more on being creative and less on understanding the virtual space, which will help democratize the use of 3D design tools by diminishing the cognitive load of the users. My research on spatial thinking extends to areas like education, spatial cognition, and data analysis. These are activities that rely on people making sense of complex environments or mentally visualizing the results of their actions, which depend on people's spatial abilities and spatial thinking. Researchers in these areas can use this knowledge to design intelligent UIs.