Grant: Discovery Grants Program - Individual
University of Calgary
$13,396.00
Mixed-Reality Interfaces for Remote Collaboration
FY 2019-20
Summary
Conventional video chat provides audio and video connection between distance-separated collaborators. But conventional video chat tools are inadequate for remote collaboration tasks that focus on objects and environments. Such remote collaboration tasks will increasingly become commonplace, including assistance tasks (e.g. machine repair), guidance tasks (e.g. remote tour), and inspection tasks (e.g. design critique). Conventional video chat does a poor job of giving collaborators: (i) awareness information about what a remote collaborator is doing, such as where they are looking, or the hand gestures they are making as part of speech (e.g. pointing while saying “Look at this one”), and (ii) an understanding of the remote space. These interfaces are critical, because remote objects and locations have become be the main focus of collaboration enabled by mobile devices.******We will explore how to design Mixed Reality (MR) interfaces to support remote collaboration tasks. Such interfaces typically do two things: first, they visually anchor virtual content in the real world using augmented reality (e.g. projected visuals, head-mounted displays, or see-through displays), and second, they use sensors to capture aspects of environment (e.g. a depth camera scan/video capture of an environment) or collaborators' interactions with the environment (e.g. their gestures or what they are looking at). We will produce theories and prototypes that describe and illustrate how to design MR interfaces that capture awareness information about collaborators (such as gaze, view and gesture information), and allow collaborators to independently explore a digital remote environment.******This program is comprised of three sub-projects:******(1) Software infrastructure. We will design and implement new infrastructure that allows us to rapidly prototype new kinds of MR experiences.******(2) Capturing and visualizing awareness information. Our MR prototypes will focus on capturing collaborators' interactions with the environment (e.g. where are they looking, what are they pointing at, etc.), representing and visualizing this to remote collaborators.******(3) Enabling independent exploration. We will explore ways of digitally capturing and reconstructing remote environments to allow collaborators to independently view and explore these spaces.******Our research will result in new knowledge about how to design and build MR interfaces that allow distance-separated collaborators to work together effectively. We will identify and address challenges that arise in this design space including user interface design, ease of use and fluidity, and technical infrastructure. Our work will inform the research community on designing effective MR interfaces for remote collaboration. It will inform Canadian companies as they continue to develop technologies for remote and telework scenarios.
Program
Discovery Grants Program - Individual
Recipient
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2017-04883
Name nom
Tang, Anthony
Department département
Computer Science
Organization id
11
Institution établissement
University of Calgary
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2017
Award amount
13396
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
800
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information and communication services
Area of application fr
Services d'information et de télécommunications
Research subject code
2710
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information systems design
Research subject fr
Conception de systèmes d'information
Installment
inst:3 - 5
Partie
3
Nb partie
5
Application title
Mixed-Reality Interfaces for Remote Collaboration
Keyword
NSERC
Application summary
Conventional video chat provides audio and video connection between distance-separated collaborators. But conventional video chat tools are inadequate for remote collaboration tasks that focus on objects and environments. Such remote collaboration tasks will increasingly become commonplace, including assistance tasks (e.g. machine repair), guidance tasks (e.g. remote tour), and inspection tasks (e.g. design critique). Conventional video chat does a poor job of giving collaborators: (i) awareness information about what a remote collaborator is doing, such as where they are looking, or the hand gestures they are making as part of speech (e.g. pointing while saying “Look at this one”), and (ii) an understanding of the remote space. These interfaces are critical, because remote objects and locations have become be the main focus of collaboration enabled by mobile devices.******We will explore how to design Mixed Reality (MR) interfaces to support remote collaboration tasks. Such interfaces typically do two things: first, they visually anchor virtual content in the real world using augmented reality (e.g. projected visuals, head-mounted displays, or see-through displays), and second, they use sensors to capture aspects of environment (e.g. a depth camera scan/video capture of an environment) or collaborators' interactions with the environment (e.g. their gestures or what they are looking at). We will produce theories and prototypes that describe and illustrate how to design MR interfaces that capture awareness information about collaborators (such as gaze, view and gesture information), and allow collaborators to independently explore a digital remote environment.******This program is comprised of three sub-projects:******(1) Software infrastructure. We will design and implement new infrastructure that allows us to rapidly prototype new kinds of MR experiences.******(2) Capturing and visualizing awareness information. Our MR prototypes will focus on capturing collaborators' interactions with the environment (e.g. where are they looking, what are they pointing at, etc.), representing and visualizing this to remote collaborators.******(3) Enabling independent exploration. We will explore ways of digitally capturing and reconstructing remote environments to allow collaborators to independently view and explore these spaces.******Our research will result in new knowledge about how to design and build MR interfaces that allow distance-separated collaborators to work together effectively. We will identify and address challenges that arise in this design space including user interface design, ease of use and fluidity, and technical infrastructure. Our work will inform the research community on designing effective MR interfaces for remote collaboration. It will inform Canadian companies as they continue to develop technologies for remote and telework scenarios.