Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Discovery Grants Program - Individual

University of Waterloo

$33,120.00

Seeing by touch

EF 2007-08

Résumé
In order to interact with the world, people rely heavily on visual information.  Even though vision is  a dominant sense, individuals also make sense of the world via other modalities such as touch (skin), hearing (ears) and inertial (vestibular system).  We are specifically interested in the acquisition of environmental information in the application of wearable human-machine systems, as well as autonomous robotic systems for the purpose of real-time sensory substitution or augmentation, and the building of 3D models (maps) of our world, including the smaller scales such as inside the human body.  With regards to playing back the information, our chief focus will be on synthesizing tactile sensations (haptics) using technology we have designed and developed.  A sensory substitution device provides sensory information from an artificial receptor to the user, utilizing an existing sensory modality as an interface.  A natural phenomenon, synesthesia - the capacity to "hear colours, taste shapes, or experience other equally strange sensory fusions" - is the figurative inspiration for investigating the possibility of artificially inducing spatial perception through touch (i.e., seeing by touch).  Key research questions surrounding the development and design of a successful visual to tactile sensory substitution device include: (1) what crucial information must be extracted from the camera? (2) how much spatial information can be conveyed in tactile form? and (3) what is an appropriate tactile mapping of visual information? Subsequently, the engineering challenge is to embed the sensory substitution system into an affordable, easy to learn, non-invasive, light, portable and wearable instantiation. The essense of the proposed research is two-fold: (1) in real-time, to extract the essential information from a visual sequence that is necessary and sufficient for interaction (e.g., navigation) with the world; and (2) to develop wearable (e.g., glove) haptic devices for purposes such as tactile communication, force feedback, rehabilitation, augmentation and telepresence.  The key application is a wayfinding assistive device for people who are blind, but other applications include pilot disorientation correction, non-invasive robotic surgery haptics, and rehabilitation.
Programme
Discovery Grants Program - Individual
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
205025-2006
Name nom
Zelek, John
Department département
Systems Design Engineering
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2007
Competition year année de concours
2006
Award amount
33120
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
335
Committee name en
Electromag. & Electr. Systems (H)
Committee name fr
Électromagn. et syst. électr. (H)
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2604
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Intelligent systems applications
Research subject fr
Applications de systèmes intelligents
Partie
2
Nb partie
5
Application title
Seeing by touch
Keyword
NA
Application summary
In order to interact with the world, people rely heavily on visual information.  Even though vision is  a dominant sense, individuals also make sense of the world via other modalities such as touch (skin), hearing (ears) and inertial (vestibular system).  We are specifically interested in the acquisition of environmental information in the application of wearable human-machine systems, as well as autonomous robotic systems for the purpose of real-time sensory substitution or augmentation, and the building of 3D models (maps) of our world, including the smaller scales such as inside the human body.  With regards to playing back the information, our chief focus will be on synthesizing tactile sensations (haptics) using technology we have designed and developed.  A sensory substitution device provides sensory information from an artificial receptor to the user, utilizing an existing sensory modality as an interface.  A natural phenomenon, synesthesia - the capacity to "hear colours, taste shapes, or experience other equally strange sensory fusions" - is the figurative inspiration for investigating the possibility of artificially inducing spatial perception through touch (i.e., seeing by touch).  Key research questions surrounding the development and design of a successful visual to tactile sensory substitution device include: (1) what crucial information must be extracted from the camera? (2) how much spatial information can be conveyed in tactile form? and (3) what is an appropriate tactile mapping of visual information? Subsequently, the engineering challenge is to embed the sensory substitution system into an affordable, easy to learn, non-invasive, light, portable and wearable instantiation. The essense of the proposed research is two-fold: (1) in real-time, to extract the essential information from a visual sequence that is necessary and sufficient for interaction (e.g., navigation) with the world; and (2) to develop wearable (e.g., glove) haptic devices for purposes such as tactile communication, force feedback, rehabilitation, augmentation and telepresence.  The key application is a wayfinding assistive device for people who are blind, but other applications include pilot disorientation correction, non-invasive robotic surgery haptics, and rehabilitation.