Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

York University

$25,000.00

Assessment of an on-device eye-tracking communication implementation using the iPhone/iPad capabilities**

FY 2018-19

Summary
Stephen Hawking was a brilliant scientist who helped shape our understanding of physics and the universe, while reliant on assistive technologies due to ALS. Such technologies generally rely on expensive special hardware and software. Cameras on every smartphone provides the possibility for a widespread consumer solution for assistive eye tracking for people with limited mobility. The iPhone X TrueDepth camera incorporates face-tracking and eye-tracking for use in iOS applications, which may provide the first real low-cost alternative for assistive technology. First, we will determine how to maximize the effectiveness of the new gaze tracking system on the iPhone X in terms of distance and angles for a wheelchair mounted camera. This will determine the best placement of the smartphone. The information about the resolution and robustness of the gaze tracking will be integrated into the development of Cognixion's Speakprose app to make the leap from a touch-based to a gaze-based interface. Next, we will investigate the usability of the gaze tracking in locked-in individuals engaged in a normal social interaction. We will record the eye movements while the system is being used to exchange pleasantries at the start of a physiotherapy session. We will also measure the user's comfort and fatigue levels when using the system. Together, these metrics will provide Cognixion with a measure of how usable the system is in a real-world environment, which can be used to evaluate how future changes to their system improves or impairs the user experience. This will allow for development of a system that meets the needs of the mobility impaired. This project combines vision research on human factors for limited mobility individuals with technological solutions to provide more accessible assistive device solutions. The objectives are to 1) characterize Apple's new gaze tracking system for use in assistive applications; and 2) develop metrics to assess the usability of the gaze system by individuals with limited mobility. The results will have significant impact on developing low-cost assistive gaze tracking solutions.*
Program
Engage Grants Program
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
537573-2018
Name nom
Fallah, Mazyar
Department département
Kinesiology and Health Science, School of
Organization id
38
Institution établissement
York University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2018
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1553
Committee name en
Ontario Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Ontario
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
6308
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Behavioural neuroscience
Research subject fr
Neurologie du comportement
Partie
1
Nb partie
1
Application title
Assessment of an on-device eye-tracking communication implementation using the iPhone/iPad capabilities**
Keyword
NSERC
Application summary
Stephen Hawking was a brilliant scientist who helped shape our understanding of physics and the universe, while reliant on assistive technologies due to ALS. Such technologies generally rely on expensive special hardware and software. Cameras on every smartphone provides the possibility for a widespread consumer solution for assistive eye tracking for people with limited mobility. The iPhone X TrueDepth camera incorporates face-tracking and eye-tracking for use in iOS applications, which may provide the first real low-cost alternative for assistive technology. First, we will determine how to maximize the effectiveness of the new gaze tracking system on the iPhone X in terms of distance and angles for a wheelchair mounted camera. This will determine the best placement of the smartphone. The information about the resolution and robustness of the gaze tracking will be integrated into the development of Cognixion's Speakprose app to make the leap from a touch-based to a gaze-based interface. Next, we will investigate the usability of the gaze tracking in locked-in individuals engaged in a normal social interaction. We will record the eye movements while the system is being used to exchange pleasantries at the start of a physiotherapy session. We will also measure the user's comfort and fatigue levels when using the system. Together, these metrics will provide Cognixion with a measure of how usable the system is in a real-world environment, which can be used to evaluate how future changes to their system improves or impairs the user experience. This will allow for development of a system that meets the needs of the mobility impaired. This project combines vision research on human factors for limited mobility individuals with technological solutions to provide more accessible assistive device solutions. The objectives are to 1) characterize Apple's new gaze tracking system for use in assistive applications; and 2) develop metrics to assess the usability of the gaze system by individuals with limited mobility. The results will have significant impact on developing low-cost assistive gaze tracking solutions.*
York University - $25,000 Grant (2018-19) | Canada Spends