Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

McGill University

$55,000.00

Multimodal information communication to overcome environmental, sensory, and computer mediation limitations

EF 2024-25

Résumé
The proposed research program leverages computer-mediation to improve human capabilities in interpreting, communicating, and responding to information, following a human-centered focus. Broadly, this research program sees information technology in synergy with human capability, working in tandem to help us achieve our goals. The program involves two themes: 1) addressing communication needs of individuals living with vision loss, and 2) providing critical information to workers in high-consequence environments such as hospital operating rooms and power plants. Each theme will involve design and evaluation of a progressively refined series of interfaces, in employing the modalities of audition (sound) and haptics (sense of touch), and for the second theme, also leveraging visual displays. For the first theme, we will build on our IMAGE project software architecture that makes internet graphics accessible through rich audio, combined with dynamic haptic displays that support nearly immediate rendering of tactile or kinesthetic representations that can be explored interactively. For the second theme, our intent to develop general principles that guide the design of improved interfaces to support situational awareness requirements motivates us to consider a variety of application domains with disparate environmental conditions and user needs. These may include hospital operating rooms, power plants, and aircraft flight decks, the last of which we are already working in through a separate research program. It is expected that the knowledge we gain through the experience of iteratively designing, evaluating, and refining such displays, tailored to the specific information needs of each group, can inform the strategies that benefit the other and lead to more generalized knowledge outcomes.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
RGPIN-2024-04729
Name nom
Cooperstock, Jeremy
Department département
Electrical and Computer Engineering
Organization id
61
Institution établissement
McGill University
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
55000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2721
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Multimedia systems and networks
Research subject fr
Systèmes et réseaux multimédias
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Multimodal information communication to overcome environmental, sensory, and computer mediation limitations
Keywords
multimodal communication; accessible technology; sensory substitution; telepresence
Application summary
The proposed research program leverages computer-mediation to improve human capabilities in interpreting, communicating, and responding to information, following a human-centered focus. Broadly, this research program sees information technology in synergy with human capability, working in tandem to help us achieve our goals. The program involves two themes: 1) addressing communication needs of individuals living with vision loss, and 2) providing critical information to workers in high-consequence environments such as hospital operating rooms and power plants. Each theme will involve design and evaluation of a progressively refined series of interfaces, in employing the modalities of audition (sound) and haptics (sense of touch), and for the second theme, also leveraging visual displays. For the first theme, we will build on our IMAGE project software architecture that makes internet graphics accessible through rich audio, combined with dynamic haptic displays that support nearly immediate rendering of tactile or kinesthetic representations that can be explored interactively. For the second theme, our intent to develop general principles that guide the design of improved interfaces to support situational awareness requirements motivates us to consider a variety of application domains with disparate environmental conditions and user needs. These may include hospital operating rooms, power plants, and aircraft flight decks, the last of which we are already working in through a separate research program. It is expected that the knowledge we gain through the experience of iteratively designing, evaluating, and refining such displays, tailored to the specific information needs of each group, can inform the strategies that benefit the other and lead to more generalized knowledge outcomes.