Grant: Discovery Grants Program - Individual
Queen's University
$50,000.00
Participation requires communication: Developing accessible communication devices
EF 2024-25
Résumé
Brain computer interfaces (BCI), eye-tracking devices, and physiological response systems are engineered as methods to enable a person with limited verbal communication ability to interact with their environments. People with severe motor control deficits, the population for whom these systems are designed, often have neurophysiological differences relative to the general (typically-developed) population. Unless systems are tailored to the individual, these devices are ineffective. There are over 440,000 Canadians with significant communication disabilities and an additional three in five within the intensive care unit who have short-term communication difficulties due to intubation. The Accessible Canada Act (ACA) creates a need to meet new standards in inclusion, diversity, and equity for persons with disabilities, recognizing access to communication as a pillar of that Act. My long-term vision is to develop a high-tech assistive device that uses neural networks to integrate and prioritize signals from brain computer interfacing, eye-tracking, and physiological responses (respiration-RESP, galvanic skin response-GSR, and photoplethysmography-PPG) to enable computer access and communication for persons with disabilities. A hybrid system that can learn from the user to dynamically update methods of communication could enhance the lives of people with communication impairments and provide a connection to family members for people within intensive care. In the short-term, I seek to: develop BCIs using electroencephalography (EEG) and functional, near-infrared spectroscopy (fNIRS) signals that adapt and are individualized to the user by optimizing electrode placement based on location of highest brain activity; develop algorithms for dynamic dwell times of eye-tracking systems to reduce fixation times and make the system more dynamic and usable; and to design and implement techniques through neural networking and deep learning that integrate physiological signals to identify and display emotions, providing a means of communication for people who cannot express their emotions to unfamiliar persons that may include doctors, new caregivers, or potential friends. Recognizing limitations of current datasets that have been gathered from WEIRD (western, educated, industrialized, rich, and democratic) populations, this research will integrate signal processing techniques that account for pigmentation differences in fNIRS and PPG. The algorithms and devices developed through this work using individual modalities of BCI, eye-tracking, and physiological emotion detection will provide robust starting points for the design of a modular, hybrid system that interprets intent and adapts to the needs of the user. More broadly, this research program will involve the development of open-source datasets that account for diverse populations and intersectionality, accounting for colorimetry and disability, to better inform artificial intelligence models in the future.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2023-05354
Name nom
Davies, Theresa
Department département
Mechanical Engineering
Organization id
29
Institution établissement
Queen's University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2023
Award amount
50000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
1901
Research subject group en
Biomedical engineering
Research subject group fr
Génie biomédical
Research subject en
Biomedical technology
Research subject fr
Technologie biomédicale
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Participation requires communication: Developing accessible communication devices
Keywords
augmentative and alternative communication; brain computer interfacing; eye-tracking; physiological measures; human interaction; assistive technology
Application summary
Brain computer interfaces (BCI), eye-tracking devices, and physiological response systems are engineered as methods to enable a person with limited verbal communication ability to interact with their environments. People with severe motor control deficits, the population for whom these systems are designed, often have neurophysiological differences relative to the general (typically-developed) population. Unless systems are tailored to the individual, these devices are ineffective. There are over 440,000 Canadians with significant communication disabilities and an additional three in five within the intensive care unit who have short-term communication difficulties due to intubation. The Accessible Canada Act (ACA) creates a need to meet new standards in inclusion, diversity, and equity for persons with disabilities, recognizing access to communication as a pillar of that Act. My long-term vision is to develop a high-tech assistive device that uses neural networks to integrate and prioritize signals from brain computer interfacing, eye-tracking, and physiological responses (respiration-RESP, galvanic skin response-GSR, and photoplethysmography-PPG) to enable computer access and communication for persons with disabilities. A hybrid system that can learn from the user to dynamically update methods of communication could enhance the lives of people with communication impairments and provide a connection to family members for people within intensive care. In the short-term, I seek to: develop BCIs using electroencephalography (EEG) and functional, near-infrared spectroscopy (fNIRS) signals that adapt and are individualized to the user by optimizing electrode placement based on location of highest brain activity; develop algorithms for dynamic dwell times of eye-tracking systems to reduce fixation times and make the system more dynamic and usable; and to design and implement techniques through neural networking and deep learning that integrate physiological signals to identify and display emotions, providing a means of communication for people who cannot express their emotions to unfamiliar persons that may include doctors, new caregivers, or potential friends. Recognizing limitations of current datasets that have been gathered from WEIRD (western, educated, industrialized, rich, and democratic) populations, this research will integrate signal processing techniques that account for pigmentation differences in fNIRS and PPG. The algorithms and devices developed through this work using individual modalities of BCI, eye-tracking, and physiological emotion detection will provide robust starting points for the design of a modular, hybrid system that interprets intent and adapts to the needs of the user. More broadly, this research program will involve the development of open-source datasets that account for diverse populations and intersectionality, accounting for colorimetry and disability, to better inform artificial intelligence models in the future.