Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Waterloo

$21,000.00

Visual Perception of 3D Worlds for Haptic Exploration

FY 2013-14

Summary
We live in a very visual world; we rely chiefly on our eyes to tell us where we are and what is around us and then make decisions of where to go and how to get there based on that sensed information. Even traffic signs and indicators rely on us using our eyes. GPS (Global Positioning Sensors) have revolutionized personal navigation by providing us with another sensor for telling us where we are. Unfortunately a GPS requires a prior map as well as clear sight of at least 3 GPS satellites in order to triangulate our position. What if we had no map of our environment to begin with or we could not rely on a GPS to tell us where we were? A camera is a sensor that closely resembles our eyes. Visual SLAM (Simultaneous Localization And Mapping) is the problem of building a map and localizing at the same time without a prior map by only using a camera. Visual SLAM is a relatively new research area that has shown great promise but is hindered by the problem of robustness and being computational tractable. Current methods rely on single feature points which accumulate exponentially, especially in real world environments. We are proposing to use real world objects (or clusters of features) as the landmarks as opposed to feature points. We have already demonstrated that triads of feature points can lead to better object detection & recognition. Using these triads of points or the objects themselves can lead to meaningful compact SLAM maps and address current shortcomings. We also propose other improvements to visual SLAM that come from techniques used in Structure From Motion (SFM) techniques such as filtering or error modelling.Visual SLAM can be used as input for assistive navigation devices for people who are cognitively or perceptually challenged. One way to accomplish this is to convey the perceived visual world represented as a compact map in a haptic modality; as touch is an under-utilized primitive modality. Potential users include people with Alzheimer's and people who are blind. Other vertical applications of this technology include military soldiers, first responders, cognitive automobiles, augmented reality and recreational users.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
205025-2012
Name nom
Zelek, John
Department département
Systems Design Engineering
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2013
Competition year année de concours
2012
Award amount
21000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
2
Nb partie
5
Application title
Visual Perception of 3D Worlds for Haptic Exploration
Keyword
NSERC
Application summary
We live in a very visual world; we rely chiefly on our eyes to tell us where we are and what is around us and then make decisions of where to go and how to get there based on that sensed information. Even traffic signs and indicators rely on us using our eyes. GPS (Global Positioning Sensors) have revolutionized personal navigation by providing us with another sensor for telling us where we are. Unfortunately a GPS requires a prior map as well as clear sight of at least 3 GPS satellites in order to triangulate our position. What if we had no map of our environment to begin with or we could not rely on a GPS to tell us where we were? A camera is a sensor that closely resembles our eyes. Visual SLAM (Simultaneous Localization And Mapping) is the problem of building a map and localizing at the same time without a prior map by only using a camera. Visual SLAM is a relatively new research area that has shown great promise but is hindered by the problem of robustness and being computational tractable. Current methods rely on single feature points which accumulate exponentially, especially in real world environments. We are proposing to use real world objects (or clusters of features) as the landmarks as opposed to feature points. We have already demonstrated that triads of feature points can lead to better object detection & recognition. Using these triads of points or the objects themselves can lead to meaningful compact SLAM maps and address current shortcomings. We also propose other improvements to visual SLAM that come from techniques used in Structure From Motion (SFM) techniques such as filtering or error modelling.Visual SLAM can be used as input for assistive navigation devices for people who are cognitively or perceptually challenged. One way to accomplish this is to convey the perceived visual world represented as a compact map in a haptic modality; as touch is an under-utilized primitive modality. Potential users include people with Alzheimer's and people who are blind. Other vertical applications of this technology include military soldiers, first responders, cognitive automobiles, augmented reality and recreational users.