Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Engage Grants Program

University of Waterloo

$25,000.00

Using a mobile computing device to visually determine relative pose of known objects

FY 2012-13

Summary
This NSERC Engage project is the first collaboration between the Principal Investigator, David Wang, and Reseach in Motion (RIM). This work will focus on extending previous research at the University of Waterloo in the the area of visual servoing and pose estimation for robotics into a mobile computing device, using the RIM Playbook as the primary platform for a proof-of-concept application. In robotics, visual servoing can compensate for errors (such as uncertainties in joint measurements or deflection in the robot links), in the completion of tasks by using the relative position of the work piece obtained through camera measurements only. In this work, the approach is to use a mobile computing device, with its cameras, to determine the relative positions and orientations of a set of known objects and Playbook in real-time. For the purpose of this research project, a BlackBerry PlayBook will be used in real time to capture images of the object, calculate the relative position between the PlayBook and the object, and to display an augmented reality (AR) image onto the display. As the mobile computing device is moved, the AR objects can be changed accordingly to compensate for the new perspective. Additionally, it could be used to measure the six degress of freedom between each object in the set. This application and its approach could be used in future to superimpose additional required informational elements onto displays such as floor plans on images in a search and rescue scenario or animated instructions in surgical training applications.
Program
Engage Grants Program
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
431010-2012
Name nom
Wang, David
Department département
Electrical & Computer Engineering
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2012
Competition year année de concours
2012
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1553
Committee name en
Ontario Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Ontario
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
1
Nb partie
1
Application title
Using a mobile computing device to visually determine relative pose of known objects
Keyword
NSERC
Application summary
This NSERC Engage project is the first collaboration between the Principal Investigator, David Wang, and Reseach in Motion (RIM). This work will focus on extending previous research at the University of Waterloo in the the area of visual servoing and pose estimation for robotics into a mobile computing device, using the RIM Playbook as the primary platform for a proof-of-concept application. In robotics, visual servoing can compensate for errors (such as uncertainties in joint measurements or deflection in the robot links), in the completion of tasks by using the relative position of the work piece obtained through camera measurements only. In this work, the approach is to use a mobile computing device, with its cameras, to determine the relative positions and orientations of a set of known objects and Playbook in real-time. For the purpose of this research project, a BlackBerry PlayBook will be used in real time to capture images of the object, calculate the relative position between the PlayBook and the object, and to display an augmented reality (AR) image onto the display. As the mobile computing device is moved, the AR objects can be changed accordingly to compensate for the new perspective. Additionally, it could be used to measure the six degress of freedom between each object in the set. This application and its approach could be used in future to superimpose additional required informational elements onto displays such as floor plans on images in a search and rescue scenario or animated instructions in surgical training applications.