Grant: Engage Grants Program
University of Waterloo
$25,000.00
Using a mobile computing device to visually determine relative pose of known objects
EF 2012-13
Résumé
This NSERC Engage project is the first collaboration between the Principal Investigator, David Wang, and
Reseach in Motion (RIM). This work will focus on extending previous research at the University of Waterloo
in the the area of visual servoing and pose estimation for robotics into a mobile computing device, using the
RIM Playbook as the primary platform for a proof-of-concept application. In robotics, visual servoing can
compensate for errors (such as uncertainties in joint measurements or deflection in the robot links), in the
completion of tasks by using the relative position of the work piece obtained through camera measurements
only.
In this work, the approach is to use a mobile computing device, with its cameras, to determine the relative
positions and orientations of a set of known objects and Playbook in real-time. For the purpose of this
research project, a BlackBerry PlayBook will be used in real time to capture images of the object, calculate the
relative position between the PlayBook and the object, and to display an augmented reality (AR) image onto
the display. As the mobile computing device is moved, the AR objects can be changed accordingly to
compensate for the new perspective. Additionally, it could be used to measure the six degress of freedom
between each object in the set.
This application and its approach could be used in future to superimpose additional required informational
elements onto displays such as floor plans on images in a search and rescue scenario or animated instructions in
surgical training applications.
Programme
Engage Grants Program
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
431010-2012
Name nom
Wang, David
Department département
Electrical & Computer Engineering
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2012
Competition year année de concours
2012
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1553
Committee name en
Ontario Internal Decision Committee
Committee name fr
Comité de décision interne pour l'Ontario
Area of application code
1207
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Information, computer and communication technologies
Area of application fr
Technologie de l'information, des ordinateurs et des réseaux de communications
Research subject code
2603
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Computer vision
Research subject fr
Vision artificielle
Partie
1
Nb partie
1
Application title
Using a mobile computing device to visually determine relative pose of known objects
Keyword
NSERC
Application summary
This NSERC Engage project is the first collaboration between the Principal Investigator, David Wang, and
Reseach in Motion (RIM). This work will focus on extending previous research at the University of Waterloo
in the the area of visual servoing and pose estimation for robotics into a mobile computing device, using the
RIM Playbook as the primary platform for a proof-of-concept application. In robotics, visual servoing can
compensate for errors (such as uncertainties in joint measurements or deflection in the robot links), in the
completion of tasks by using the relative position of the work piece obtained through camera measurements
only.
In this work, the approach is to use a mobile computing device, with its cameras, to determine the relative
positions and orientations of a set of known objects and Playbook in real-time. For the purpose of this
research project, a BlackBerry PlayBook will be used in real time to capture images of the object, calculate the
relative position between the PlayBook and the object, and to display an augmented reality (AR) image onto
the display. As the mobile computing device is moved, the AR objects can be changed accordingly to
compensate for the new perspective. Additionally, it could be used to measure the six degress of freedom
between each object in the set.
This application and its approach could be used in future to superimpose additional required informational
elements onto displays such as floor plans on images in a search and rescue scenario or animated instructions in
surgical training applications.