Grant: Discovery Grants Program - Individual
University of Calgary
$56,000.00
Mechanisms of integrating haptic cues for VR-based interactive analytics of complex data
FY 2024-25
Summary
PROBLEM: Many scientific/engineering applications yield increasingly complex data in multiple dimensions and variates. Although application-specific algorithms can extract certain ill-defined patterns of the data, the intricate characteristics of these patterns require experts (users) with various competencies to analyze them interactively and collaboratively (i.e., interactive analytics) for decision-making. High-end computers usually display the patterns as 3-dimensional objects in intertwisted shapes (local attributes) and interlinkages (global relationships). Routinely, the users interact with the objects via keyboards/mice while viewing them on screens. This practice deters the users from conducting interactive analytics efficiently, due to difficulties in relying solely on the sense of vision for decoding the interconnection between the local attributes and global relationships. A solution might employ the sense of touch to explore the local attributes, while maintaining the view of the global relationships. The solution involves the human ability of using both senses to interact with objects for achieving cognitive responses. Rendering visual and haptic (touch by force and vibrotactile) cues to stimulate both senses, a computer platform based on advanced Virtual Reality (VR) technologies has a potential for catalyzing interactive analytics. Impediments are however two major deficiencies in the current knowledgebase: (a) the lack of robust schemes for associating the haptic cues with the local attributes of the patterns, and (b) the unavailability of adequate models for integrating the cues to foster neuro-ergonomic interaction.
OBJECTIVE: The long-term objective of this program is to address the deficiencies by creating computational mechanisms for integrating the haptic cues, hence catalysing VR-based interactive analytics. The short-term objectives of the program are to establish schemes of force and vibrotactile cues (Theme A) and to build models of integrating the cues (Theme B).
IMPACT: It is challenging to invent cue-integration mechanisms in complying with behavioural and neural responses for fostering neuro-ergonomic interaction. Collaborating with national and international researchers, the program meets the challenge by achieving two innovative elements: (i) a methodology of creating cue schemes from pattern attributes, and (ii) an optimization of ensuring the cue-integration. The achievement signifies a knowledge gain to permit the use of haptic cues for facilitating interactive analytics, and a technical advancement to enable a viable VR-based platform for benefiting Canadian economy by promoting experts' actions in applications including: planning public safety (e.g., flood mitigation), boosting industrial competitiveness (e.g., reactor design), innovating trustable human-machine interfaces (e.g., human-robot defense systems), and inventing practical brain-machine interaction (e.g., object manipulation via neural signals).
Program
Discovery Grants Program - Individual
Recipient
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2020-04052
Name nom
Hu, Yaoping
Department département
Dept. of Electrical and Computer Engineering
Organization id
11
Institution établissement
University of Calgary
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2020
Award amount
56000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2716
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Virtual reality and related simulations
Research subject fr
Réalité virtuelle et simulations connexes
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Mechanisms of integrating haptic cues for VR-based interactive analytics of complex data
Keywords
haptics; virtual environments; neuro-ergonomics; signal processing; 3d visualization; human-computer interaction
Application summary
PROBLEM: Many scientific/engineering applications yield increasingly complex data in multiple dimensions and variates. Although application-specific algorithms can extract certain ill-defined patterns of the data, the intricate characteristics of these patterns require experts (users) with various competencies to analyze them interactively and collaboratively (i.e., interactive analytics) for decision-making. High-end computers usually display the patterns as 3-dimensional objects in intertwisted shapes (local attributes) and interlinkages (global relationships). Routinely, the users interact with the objects via keyboards/mice while viewing them on screens. This practice deters the users from conducting interactive analytics efficiently, due to difficulties in relying solely on the sense of vision for decoding the interconnection between the local attributes and global relationships. A solution might employ the sense of touch to explore the local attributes, while maintaining the view of the global relationships. The solution involves the human ability of using both senses to interact with objects for achieving cognitive responses. Rendering visual and haptic (touch by force and vibrotactile) cues to stimulate both senses, a computer platform based on advanced Virtual Reality (VR) technologies has a potential for catalyzing interactive analytics. Impediments are however two major deficiencies in the current knowledgebase: (a) the lack of robust schemes for associating the haptic cues with the local attributes of the patterns, and (b) the unavailability of adequate models for integrating the cues to foster neuro-ergonomic interaction.
OBJECTIVE: The long-term objective of this program is to address the deficiencies by creating computational mechanisms for integrating the haptic cues, hence catalysing VR-based interactive analytics. The short-term objectives of the program are to establish schemes of force and vibrotactile cues (Theme A) and to build models of integrating the cues (Theme B).
IMPACT: It is challenging to invent cue-integration mechanisms in complying with behavioural and neural responses for fostering neuro-ergonomic interaction. Collaborating with national and international researchers, the program meets the challenge by achieving two innovative elements: (i) a methodology of creating cue schemes from pattern attributes, and (ii) an optimization of ensuring the cue-integration. The achievement signifies a knowledge gain to permit the use of haptic cues for facilitating interactive analytics, and a technical advancement to enable a viable VR-based platform for benefiting Canadian economy by promoting experts' actions in applications including: planning public safety (e.g., flood mitigation), boosting industrial competitiveness (e.g., reactor design), innovating trustable human-machine interfaces (e.g., human-robot defense systems), and inventing practical brain-machine interaction (e.g., object manipulation via neural signals).