Grant: Engage Grants Program
University of New Brunswick
$25,000.00
Supporting deixis in remote augmented reality collaboration
EF 2018-19
Résumé
In face-to-face collaboration, we often take for granted the ease with which we can communicate with others,*and how the ease of communication plays a key role in the success of a collaboration. Recent technological*innovations have opened the possibility of working with others at a distance in new ways. However, remote*collaboration is still often slow, clumsy and awkward. One key, and often overlooked, aspect that makes*colocated collaborations fast and fluid are deictic gestures - the use of gestures, like pointing, to provide*context and information in verbal communication. Deictic gestures allow people to simply make statements*such as ""that thing there"", which is perfectly clear when combined with pointing at the object. However,*without adequate support for deixis the statement loses meaning, and collaboration can become cumbersome*and less effective.*Kognitiv Spark is a New Brunswick based business that is interested in how to better support the use of deictic*gestures in their flagship product, Remote Spark. Remote Spark is an augmented reality-based*tele-conferencing system that allows a worker to receive the guidance of a remote expert who could be located*anywhere in the world. Remote Spark uses see-through augmented reality glasses that allow a worker to view*and interact with computer graphics while still seeing the world around. This provides the technological basis*to allow workers to receive guidance in a way that is more tightly aligned with their work. However, how*deixis can be best integrated into Remote Spark is an open challenge.*In this project, we will build an understanding of the use of deixis in augmented reality collaborations. We will*create prototypes that provide alternative designs and approaches for the display and placement of pointing*gestures from a remote collaborator. We will also test new hand tracking algorithms to better allow the*production of pointing gestures by system users. Finally, we will perform an empirical study on the efficacy of*the created prototypes.
Programme
Engage Grants Program
Bénéficiaire
Emplacement
New Brunswick, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
530742-2018
Name nom
Bateman, Scott
Department département
Computer Science, Faculty of
Organization id
75
Institution établissement
University of New Brunswick
Province en
New Brunswick
Province fr
Nouveau-Brunswick
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1551
Committee name en
Atlantic Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Atlantique
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2710
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information systems design
Research subject fr
Conception de systèmes d'information
Partie
1
Nb partie
1
Application title
Supporting deixis in remote augmented reality collaboration
Keyword
NSERC
Application summary
In face-to-face collaboration, we often take for granted the ease with which we can communicate with others,*and how the ease of communication plays a key role in the success of a collaboration. Recent technological*innovations have opened the possibility of working with others at a distance in new ways. However, remote*collaboration is still often slow, clumsy and awkward. One key, and often overlooked, aspect that makes*colocated collaborations fast and fluid are deictic gestures - the use of gestures, like pointing, to provide*context and information in verbal communication. Deictic gestures allow people to simply make statements*such as ""that thing there"", which is perfectly clear when combined with pointing at the object. However,*without adequate support for deixis the statement loses meaning, and collaboration can become cumbersome*and less effective.*Kognitiv Spark is a New Brunswick based business that is interested in how to better support the use of deictic*gestures in their flagship product, Remote Spark. Remote Spark is an augmented reality-based*tele-conferencing system that allows a worker to receive the guidance of a remote expert who could be located*anywhere in the world. Remote Spark uses see-through augmented reality glasses that allow a worker to view*and interact with computer graphics while still seeing the world around. This provides the technological basis*to allow workers to receive guidance in a way that is more tightly aligned with their work. However, how*deixis can be best integrated into Remote Spark is an open challenge.*In this project, we will build an understanding of the use of deixis in augmented reality collaborations. We will*create prototypes that provide alternative designs and approaches for the display and placement of pointing*gestures from a remote collaborator. We will also test new hand tracking algorithms to better allow the*production of pointing gestures by system users. Finally, we will perform an empirical study on the efficacy of*the created prototypes.