Grant: Discovery Grants Program - Individual
University of Alberta
$25,000.00
Vision-based supervisory control and predictive display for uncalibrated tele-robotics
FY 2007-08
Summary
My research is in the intersection of computer vision, robotics and graphics. In particular I'm interested in how to use visual information and coordinate frames to encode and communicate spatial information, motion, and interactions. Among applications I work on are visual servoing for robot motion control and predictive display for operator visualization. Both of these combine into tele-robotics systems. A key idea is to work with visual (camera) spaces instead of Euclidean world coordinates as in conventional engineering. Deictic motions and gestures of a human in a scene can be viewed by cameras and interpreted in camera space w.r.t. that scene. Similarly, in tele-robotics, a human operator is immersed in a visualization of a remote scene and can gesture instructions w.r.t. the shared visual space between the remote and local sites. Using sensory frames instead of a conventional world coordinate frame brings up new issues in task and trajectory planning. Furthermore, robots operating in human settings face more varying tasks than currently in manufacturing. Achieving full autonomy in such challenging situations is difficult, and may not always be desirable. Instead our thrust is to endow the robot with the ability to carry out motions and small subtasks semi-autonomously, while under the guidance of a human, so called supervised control. The motions and tasks are built bottom up, from simple motions, reaching and fine manipulation to more complex subroutines, e.g. pick-and-place. Tasks we can implement include a light bulb exchange subroutine, setting a dinner table and solving a child's shape sorter puzzle. The routines are currently built by scripting, but we plan to look into learning from observing a human. A general way of visually instructing a robot has many applications from the high end e.g. in surgical assistive robotics, where the human surgeon can't interrupt the surgery to use a conventional keyboard interface, to everyday service robotics e.g. for the handicapped and elderly.
Program
Discovery Grants Program - Individual
Recipient
Location
Alberta, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
238784-2006
Name nom
Jagersand, Martin
Department département
Computing Science
Organization id
9
Institution établissement
University of Alberta
Province en
Alberta
Province fr
Alberta
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2007
Competition year année de concours
2006
Award amount
25000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
331
Committee name en
Computing and Information Sciences - B
Committee name fr
Informatique - B
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
2600
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Robotics
Research subject fr
Robotique
Partie
2
Nb partie
5
Application title
Vision-based supervisory control and predictive display for uncalibrated tele-robotics
Keyword
NA
Application summary
My research is in the intersection of computer vision, robotics and graphics. In particular I'm interested in how to use visual information and coordinate frames to encode and communicate spatial information, motion, and interactions. Among applications I work on are visual servoing for robot motion control and predictive display for operator visualization. Both of these combine into tele-robotics systems. A key idea is to work with visual (camera) spaces instead of Euclidean world coordinates as in conventional engineering. Deictic motions and gestures of a human in a scene can be viewed by cameras and interpreted in camera space w.r.t. that scene. Similarly, in tele-robotics, a human operator is immersed in a visualization of a remote scene and can gesture instructions w.r.t. the shared visual space between the remote and local sites. Using sensory frames instead of a conventional world coordinate frame brings up new issues in task and trajectory planning. Furthermore, robots operating in human settings face more varying tasks than currently in manufacturing. Achieving full autonomy in such challenging situations is difficult, and may not always be desirable. Instead our thrust is to endow the robot with the ability to carry out motions and small subtasks semi-autonomously, while under the guidance of a human, so called supervised control. The motions and tasks are built bottom up, from simple motions, reaching and fine manipulation to more complex subroutines, e.g. pick-and-place. Tasks we can implement include a light bulb exchange subroutine, setting a dinner table and solving a child's shape sorter puzzle. The routines are currently built by scripting, but we plan to look into learning from observing a human. A general way of visually instructing a robot has many applications from the high end e.g. in surgical assistive robotics, where the human surgeon can't interrupt the surgery to use a conventional keyboard interface, to everyday service robotics e.g. for the handicapped and elderly.