Grant: Discovery Grants Program - Individual
University of Waterloo
$34,000.00
Multimodal Sensory Integration and Control for Interactive Dexterous In-Hand Object Manipulation
FY 2017-18
Summary
Dexterous manipulation skills are one of the most remarkable features of human behavior. Even seemingly simple tasks of manipulating tools or objects embody feats of enormous complexity to process various sensory inputs and to make necessary adjustments all the while retrieving and updating motion vocabularies encoded in our brain. Traditionally, motion control for robot manipulators has pursued high-speed and high-accuracy trajectory tracking rather than natural, adaptable and dexterous movements. They enjoyed major success in factory environments (e.g. welding robots in automotive factories) but do not adequately apply to unstructured and dynamic environments that require interaction with random ?every-day? objects or with humans. This proposal will attempt to tackle these issues by reaching beyond conventional methods to leverage sensor technologies, exploit intelligent decision making and control theories, and carefully observe how human hand and arm movements are coordinated during critical stages of object manipulation tasks. This research will take a bio-inspired engineering approach in that we will employ advanced sensing techniques to investigate how high-fidelity tactile data are integrated with proprioceptive (position, force/torque) and visual data to achieve ?dexterity? during object manipulation tasks, e.g. how finger-tip forces are regulated and how the hand and arm muscles are coordinated. The technical objectives of this research include 1) to develop integrated multimodal state estimator for simultaneous estimation of the robot, the object and the environment, 2) to investigate stereotyped patterns of tactile and proprioceptive sensory responses of humans during interactive object manipulation tasks, 3) to apply this knowledge to developing novel reflex (low-level, feedback) and high-level (motion planning, force/torque) controllers to enhance the sophistication of controlled motion of a robotic arm and hand during interaction periods, and 4) to develop learning control policies that enable the completion of the full cycle of manipulation phases at faster speed and with smoother transitions. Understanding human sensorimotor control and synthesizing artificial systems of similar capabilities will profoundly impact a wide range of applications including agile manufacturing, home automation, medical robots, prosthetics, rehabilitation engineering, and technologies that support the public welfare for aging population. Furthermore, the scientific findings and engineering achievements pursued through this research will place Canada at the forefront of research in key areas of intelligent control, smart sensory data processing, next generation of robotic manipulation and bio-mechatronics, which will also inspire and train the next generation of highly qualified talent who will contribute directly to innovation in these key sectors.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2015-05273
Name nom
Jeon, Soo
Department département
Mechanical Engineering and Mechatronics - Mechanical Engineering and Mechatronic
Organization id
33
Institution établissement
University of Waterloo
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2015
Award amount
34000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1512
Committee name en
Mechanical Engineering
Committee name fr
Génie mécanique
Area of application code
500
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Manufacturing processes and products
Area of application fr
Procédés et produits industriels
Research subject code
2109
Research subject group en
Mechanical engineering
Research subject group fr
Génie mécanique
Research subject en
Mechanical systems and instrumentation
Research subject fr
Instrumentation et systèmes mécaniques
Partie
3
Nb partie
5
Application title
Multimodal Sensory Integration and Control for Interactive Dexterous In-Hand Object Manipulation
Keyword
NSERC
Application summary
Dexterous manipulation skills are one of the most remarkable features of human behavior. Even seemingly simple tasks of manipulating tools or objects embody feats of enormous complexity to process various sensory inputs and to make necessary adjustments all the while retrieving and updating motion vocabularies encoded in our brain. Traditionally, motion control for robot manipulators has pursued high-speed and high-accuracy trajectory tracking rather than natural, adaptable and dexterous movements. They enjoyed major success in factory environments (e.g. welding robots in automotive factories) but do not adequately apply to unstructured and dynamic environments that require interaction with random ?every-day? objects or with humans. This proposal will attempt to tackle these issues by reaching beyond conventional methods to leverage sensor technologies, exploit intelligent decision making and control theories, and carefully observe how human hand and arm movements are coordinated during critical stages of object manipulation tasks. This research will take a bio-inspired engineering approach in that we will employ advanced sensing techniques to investigate how high-fidelity tactile data are integrated with proprioceptive (position, force/torque) and visual data to achieve ?dexterity? during object manipulation tasks, e.g. how finger-tip forces are regulated and how the hand and arm muscles are coordinated. The technical objectives of this research include 1) to develop integrated multimodal state estimator for simultaneous estimation of the robot, the object and the environment, 2) to investigate stereotyped patterns of tactile and proprioceptive sensory responses of humans during interactive object manipulation tasks, 3) to apply this knowledge to developing novel reflex (low-level, feedback) and high-level (motion planning, force/torque) controllers to enhance the sophistication of controlled motion of a robotic arm and hand during interaction periods, and 4) to develop learning control policies that enable the completion of the full cycle of manipulation phases at faster speed and with smoother transitions. Understanding human sensorimotor control and synthesizing artificial systems of similar capabilities will profoundly impact a wide range of applications including agile manufacturing, home automation, medical robots, prosthetics, rehabilitation engineering, and technologies that support the public welfare for aging population. Furthermore, the scientific findings and engineering achievements pursued through this research will place Canada at the forefront of research in key areas of intelligent control, smart sensory data processing, next generation of robotic manipulation and bio-mechatronics, which will also inspire and train the next generation of highly qualified talent who will contribute directly to innovation in these key sectors.