Grant: Discovery Grants Program - Individual
The University of British Columbia
$46,000.00
Enriching Online Collaboration with Multimodal Interactions
EF 2023-24
Résumé
The focus of my research is enhancing the communicative capacities of online collaboration systems, using human-computer interaction approaches. As knowledge work moves increasingly online, digital tools have become a baseline sociotechnical infrastructure that enables us to collaborate beyond the constraints of space and time, substituting some in-person meetings with distant and asynchronous mediated-communication. However, existing tools (e.g., email, annotations, Git) rely primarily on text, resulting in a lack of subtle nuances and emotions that are best conveyed through face-to-face meetings where people can talk, gaze, and gesture. My research uniquely addresses this deficit of expressivity by imbuing asynchronous collaboration tools with rich multimodal interactions, i.e., interactions through multiple input channels (e.g., recorded speech, stylus writing, captured gestures).The long-term goal is to build and study rich collaboration systems, a new genre of online tools that unites the advantages of both worlds, the flexibility and scalability of asynchronous digital communication together with the richness and expressivity of face-to-face multimodal interactions. This overarching agenda is broken down into the three research threads: (1) developing multimodal interactions that support efficient creation and editing of rich media messages, (2) helping people overcome psychological barriers of rich media-based communication (e.g., privacy concerns, speech anxiety) by transducing and anonymizing their multimodal messages while retaining the authentic richness of the messages, and (3) developing scalable multimodal interactions for a rich media-based online community that can host a large number of users.Enriching online collaboration to capture nuances and emotions has potential to make a transformative impact on the quality and speed of knowledge work. In addition to the immediate impact on academic research and industry practice, the proposed research will produce HQP armed with unique interdisciplinary skillsets, such as multimodal interaction design, multimedia software development, and ecological evaluation of collaboration tools. These future professionals can play a synergistic role in the interdisciplinary practices required to develop high-value products in Canadian companies, including those in and around the tech hubs of the British Columbia technology sectors and the Cascadia innovation corridor.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2018-04591
Name nom
Yoon, Dongwook
Department département
Computer Science
Organization id
2
Institution établissement
The University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2018
Award amount
46000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2710
Research subject group en
Information technology
Research subject group fr
Information systems design
Research subject en
Technologie de l'information
Research subject fr
Conception de systèmes d'information
Application title
Enriching Online Collaboration with Multimodal Interactions
Keyword
Asynchronous Collaboration; Data-Driven Approach; Educational Technology; Human-Computer Interaction; Interaction Design; Mediated Communication; Multimedia Editing; Multimodal Interaction; Speech and Gesture Interfaces; User Studies
Application summary
The focus of my research is enhancing the communicative capacities of online collaboration systems, using human-computer interaction approaches. As knowledge work moves increasingly online, digital tools have become a baseline sociotechnical infrastructure that enables us to collaborate beyond the constraints of space and time, substituting some in-person meetings with distant and asynchronous mediated-communication. However, existing tools (e.g., email, annotations, Git) rely primarily on text, resulting in a lack of subtle nuances and emotions that are best conveyed through face-to-face meetings where people can talk, gaze, and gesture. My research uniquely addresses this deficit of expressivity by imbuing asynchronous collaboration tools with rich multimodal interactions, i.e., interactions through multiple input channels (e.g., recorded speech, stylus writing, captured gestures).The long-term goal is to build and study rich collaboration systems, a new genre of online tools that unites the advantages of both worlds, the flexibility and scalability of asynchronous digital communication together with the richness and expressivity of face-to-face multimodal interactions. This overarching agenda is broken down into the three research threads: (1) developing multimodal interactions that support efficient creation and editing of rich media messages, (2) helping people overcome psychological barriers of rich media-based communication (e.g., privacy concerns, speech anxiety) by transducing and anonymizing their multimodal messages while retaining the authentic richness of the messages, and (3) developing scalable multimodal interactions for a rich media-based online community that can host a large number of users.Enriching online collaboration to capture nuances and emotions has potential to make a transformative impact on the quality and speed of knowledge work. In addition to the immediate impact on academic research and industry practice, the proposed research will produce HQP armed with unique interdisciplinary skillsets, such as multimodal interaction design, multimedia software development, and ecological evaluation of collaboration tools. These future professionals can play a synergistic role in the interdisciplinary practices required to develop high-value products in Canadian companies, including those in and around the tech hubs of the British Columbia technology sectors and the Cascadia innovation corridor.