Grant: Discovery Grants Program - Individual
École Polytechnique de Montréal
$25,000.00
A Biomimetic Approach based on Tactile Sensing for Stable Grasp and Manipulation using Biomechatronic Hand Prostheses and Assistive Robots
EF 2023-24
Résumé
Tactile sensing is a fundamental component of how humans interact with their environment. With the loss of a limb in the upper body, the amputees also lose their ability to explore, understand and interact with the surrounding world using their sense of touch. The active hand prostheses used by a variety of amputees are only able to provide crude control over object handling; The users cannot adjust their hand movement for grasping an object or handling a tool without closely looking at it. To increase the acceptance of artificial limbs by amputees, the users should be able to perform enhanced, intuitive motor control and simultaneously feel with their prosthetic limbs. When operating in an unknown environment, tactile sensitivity, in conjunction with other sensory sources, becomes vital for a safe and effective physical interaction and performing complex tasks. In the long-term, I aim to develop a cost-efficient biomechatronic prosthetic hand capable of stable object grasping and in-hand manipulation by incorporating tactile sensing and haptic feedback. This prosthesis will ideally help users through facilitating safe interactions with the environment in various activities of daily living. Inspired by the schemes that humans employ for grasping, handling and moving objects in their hand, this Discovery Grant will be used in a short-term window of 5 years to create a framework for object grasping and manipulation by robotic arms using tactile sensors. I hypothesize that understanding and mimicking the human way of incorporating information from the sense of touch into the process of object handling, will result in devising a more efficient planning and control approach. First, we will develop a machine learning model to learn, from demonstrations, how tactile sensitivity in non-amputee subjects works in collaboration with vision, and how it corresponds to muscle synergies creating motor actions for grasping and manipulating objects. Then, we will formulate an index to assess the stability of a grasp using tactile information without having prior knowledge about the objects and the environment. Using this index, we will subsequently design a reinforcement learning model to fine-tune the control model by learning from successful and failed attempts. Lastly, a haptic interface will be prototyped to control an assistive robotic hand using the developed AI models. At the end, we will validate the effectiveness of the proposed framework by performing grasping and manipulation tasks with both the training set and a set of unknown real-world objects. The haptic interface and control algorithm will directly benefit individuals with neuromuscular disorders and upper-limb amputation in their day-to-day activities, which will hopefully elevate Canada's place as an international leader in the field of assistive and prosthetic robotics.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Quebec, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2022-05226
Name nom
Mohebbi, Abolfazl
Department département
Mechanical Engineering
Organization id
64
Institution établissement
École Polytechnique de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
25000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1512
Committee name en
Mechanical Engineering
Committee name fr
Génie mécanique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
1901
Research subject group en
Biomedical engineering
Research subject group fr
Biomedical technology
Research subject en
Génie biomédical
Research subject fr
Technologie biomédicale
Application title
A Biomimetic Approach based on Tactile Sensing for Stable Grasp and Manipulation using Biomechatronic Hand Prostheses and Assistive Robots
Keyword
Applied Artificial Intelligence; Assistive Technologies; Bioinspired Design; Control systems; Prosthetics; Robotics; Tactile Sensing
Application summary
Tactile sensing is a fundamental component of how humans interact with their environment. With the loss of a limb in the upper body, the amputees also lose their ability to explore, understand and interact with the surrounding world using their sense of touch. The active hand prostheses used by a variety of amputees are only able to provide crude control over object handling; The users cannot adjust their hand movement for grasping an object or handling a tool without closely looking at it. To increase the acceptance of artificial limbs by amputees, the users should be able to perform enhanced, intuitive motor control and simultaneously feel with their prosthetic limbs. When operating in an unknown environment, tactile sensitivity, in conjunction with other sensory sources, becomes vital for a safe and effective physical interaction and performing complex tasks. In the long-term, I aim to develop a cost-efficient biomechatronic prosthetic hand capable of stable object grasping and in-hand manipulation by incorporating tactile sensing and haptic feedback. This prosthesis will ideally help users through facilitating safe interactions with the environment in various activities of daily living. Inspired by the schemes that humans employ for grasping, handling and moving objects in their hand, this Discovery Grant will be used in a short-term window of 5 years to create a framework for object grasping and manipulation by robotic arms using tactile sensors. I hypothesize that understanding and mimicking the human way of incorporating information from the sense of touch into the process of object handling, will result in devising a more efficient planning and control approach. First, we will develop a machine learning model to learn, from demonstrations, how tactile sensitivity in non-amputee subjects works in collaboration with vision, and how it corresponds to muscle synergies creating motor actions for grasping and manipulating objects. Then, we will formulate an index to assess the stability of a grasp using tactile information without having prior knowledge about the objects and the environment. Using this index, we will subsequently design a reinforcement learning model to fine-tune the control model by learning from successful and failed attempts. Lastly, a haptic interface will be prototyped to control an assistive robotic hand using the developed AI models. At the end, we will validate the effectiveness of the proposed framework by performing grasping and manipulation tasks with both the training set and a set of unknown real-world objects. The haptic interface and control algorithm will directly benefit individuals with neuromuscular disorders and upper-limb amputation in their day-to-day activities, which will hopefully elevate Canada's place as an international leader in the field of assistive and prosthetic robotics.