Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Waterloo

$11,755.58

Reappearing Interfaces in an IoT World

EF 2022-23

Résumé
As computers become increasingly embedded into the world, the process of interacting with them increases in complexity for the user. The computation that users encounter (embedded technologies) and the computation that users bring with them (personal devices) would, ideally, support a seamless user experience that reveals itself intelligently, effectively supports learning both about services available and ways to access those services, and non-intrusively presents feedback to users, all while preserving the aesthetics of embedding in objects, artifacts and environments that we encounter. However, this compelling, intuitive experience often remains elusive, leaving users with questions such as 'what can I do?', 'how do I do it?' and 'did it work?'. Within the broad area of embedded interaction, the primary area of research of this grant is gestural input to augmented environments. Since Bolt's seminal work 30 years ago, gestures have been perceived to be a natural way to interact with augmented environments, but challenges in realizing rich interactions via gestures. I aim to explore challenges of both unencumbered interaction (where the user's bare hand motion is captured via external sensors in the environment, e.g., a Kinect, an optical camera, or some surface augmentation) and encumbered interaction (where a wearable or mobile device or custom hand-worn hardware captures input via on-board sensors). Over the five-year period of this grant, my primary focus will be on interaction in Projective Augmented Reality (P-AR) and ubiquitous computing (UbiComp) or Internet-of-Things (IoT) spaces. Early applications of this work will focus on P-AR and limited instances of UbiComp/IoT. As IoT artifacts increase in maturity, my research will naturally generalize. The long-term goal of my research is to explore gesture as a first-class input modality to augmented environments. With that overall goal in mind, there are three primary research objectives that I aim to pursue over the coming five-year period: 1. Gestural Interaction in Augmented Environments, including research on scalability, interactions with the physical world, and impacts of context on metrics for success. 2. Gesture Learning and Expertise, including research on the potential for mnemonics to enhance learning, the leveraging of kinematics to model expertise, and better techniques to activate learning. 3. Perception in and of Augmented Environments, including the use of ambient information and techniques from information visualization to enhance awareness of augmentation and perceptions of ownership and  an exploration of the uncanny valley of augmentation. Each of these objectives contributes directly to the goal of enriching gestural interaction in augmented spaces.
Programme
Discovery Grants Program - Individual
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2022-03739
Name nom
Lank, Edward
Department département
Computer Science, David R. Cheriton School of - Computer Science, David R. Cheriton School of
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2022
Award amount
11755.58
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Installment
inst:1
Partie
1
Nb partie
5
Application title
Reappearing Interfaces in an IoT World
Application summary
As computers become increasingly embedded into the world, the process of interacting with them increases in complexity for the user. The computation that users encounter (embedded technologies) and the computation that users bring with them (personal devices) would, ideally, support a seamless user experience that reveals itself intelligently, effectively supports learning both about services available and ways to access those services, and non-intrusively presents feedback to users, all while preserving the aesthetics of embedding in objects, artifacts and environments that we encounter. However, this compelling, intuitive experience often remains elusive, leaving users with questions such as 'what can I do?', 'how do I do it?' and 'did it work?'. Within the broad area of embedded interaction, the primary area of research of this grant is gestural input to augmented environments. Since Bolt's seminal work 30 years ago, gestures have been perceived to be a natural way to interact with augmented environments, but challenges in realizing rich interactions via gestures. I aim to explore challenges of both unencumbered interaction (where the user's bare hand motion is captured via external sensors in the environment, e.g., a Kinect, an optical camera, or some surface augmentation) and encumbered interaction (where a wearable or mobile device or custom hand-worn hardware captures input via on-board sensors). Over the five-year period of this grant, my primary focus will be on interaction in Projective Augmented Reality (P-AR) and ubiquitous computing (UbiComp) or Internet-of-Things (IoT) spaces. Early applications of this work will focus on P-AR and limited instances of UbiComp/IoT. As IoT artifacts increase in maturity, my research will naturally generalize. The long-term goal of my research is to explore gesture as a first-class input modality to augmented environments. With that overall goal in mind, there are three primary research objectives that I aim to pursue over the coming five-year period: 1. Gestural Interaction in Augmented Environments, including research on scalability, interactions with the physical world, and impacts of context on metrics for success. 2. Gesture Learning and Expertise, including research on the potential for mnemonics to enhance learning, the leveraging of kinematics to model expertise, and better techniques to activate learning. 3. Perception in and of Augmented Environments, including the use of ambient information and techniques from information visualization to enhance awareness of augmentation and perceptions of ownership and  an exploration of the uncanny valley of augmentation. Each of these objectives contributes directly to the goal of enriching gestural interaction in augmented spaces.