Grant: Engage Grants Program
University of British Columbia
$25,000.00
Robotic touchless interaction in surgery
FY 2015-16
Summary
Interventional radiologists are required to view and manipulate (zoom, scroll, pan, etc.) radiological images
during operations. Currently, this must be done by either a) scrubbing out of a case to enter the control room or
b) verbally directing a technologist to operate the workstation. These current methods cause two issues: 1)
scrubbing in and out of the sterile field increases the risk of intra-operative infections, and 2) task delegation
removes the radiologist's direct control of the images and negatively affects OR workflow. NZ Technologies
Inc. (NZT) has been developing a novel medical device, called 'Touchless Interaction with Picture and
Archiving Communication Systems (PACS) in Sterile Operations' (TIPSO). TIPSO employs real-time optical
3D sensing of the environment to enable radiologists to manipulate the images by using hand gestures and
motions in a fully sterile manner - directly from the OR. An adaptive light projection module enables
radiologists to intuitively interact with a 'virtual tactile' menu on the surgery bed. NZT proposes to mount
TIPSO on the end-effector of a robotic manipulator -greatly increasing TIPSO's ability to provide a seamless
human-machine interface in the sterile field. This Grant will investigate and simulate the application of a
robotic manipulator to carry a TIPSO device - moving wherever a surgeon requires, blending in with the OR's
workflow, and avoiding collisions with other OR equipment. The project will investigate simulation, control,
and trajectory planning aspects of the robotic manipulator - for a completely touchless solution. Within a
simulation environment, a smooth feedback control system, a collision-avoidance algorithm, and a unique
visual servoing technique will be designed, developed, and verified. This research will enable NZT to buy an
appropriate robotic arm and begin deployment in an OR environment. The technology developed, as the result
of this project, will replace conventional methods for image viewing and manipulation during minimally
invasive surgeries in the OR. This solution provides a simple, intuitive, and ergonomic interaction capability to
the surgeon - removing sources of intra-operative infections and allowing shorter surgeries.
Program
Engage Grants Program
Recipient
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
485412-2015
Name nom
VanderLoos, Hendrik
Department département
Mechanical Engineering
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2015
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1554
Committee name en
Pacific Internal Decision Committee
Committee name fr
Comité de décision interne pour le Pacifique
Area of application code
518
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Medical equipment and apparatus
Area of application fr
Appareils et instruments médicaux
Research subject code
2601
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Robotic control
Research subject fr
Systèmes de commande
Partie
1
Nb partie
1
Application title
Robotic touchless interaction in surgery
Keyword
NSERC
Application summary
Interventional radiologists are required to view and manipulate (zoom, scroll, pan, etc.) radiological images
during operations. Currently, this must be done by either a) scrubbing out of a case to enter the control room or
b) verbally directing a technologist to operate the workstation. These current methods cause two issues: 1)
scrubbing in and out of the sterile field increases the risk of intra-operative infections, and 2) task delegation
removes the radiologist's direct control of the images and negatively affects OR workflow. NZ Technologies
Inc. (NZT) has been developing a novel medical device, called 'Touchless Interaction with Picture and
Archiving Communication Systems (PACS) in Sterile Operations' (TIPSO). TIPSO employs real-time optical
3D sensing of the environment to enable radiologists to manipulate the images by using hand gestures and
motions in a fully sterile manner - directly from the OR. An adaptive light projection module enables
radiologists to intuitively interact with a 'virtual tactile' menu on the surgery bed. NZT proposes to mount
TIPSO on the end-effector of a robotic manipulator -greatly increasing TIPSO's ability to provide a seamless
human-machine interface in the sterile field. This Grant will investigate and simulate the application of a
robotic manipulator to carry a TIPSO device - moving wherever a surgeon requires, blending in with the OR's
workflow, and avoiding collisions with other OR equipment. The project will investigate simulation, control,
and trajectory planning aspects of the robotic manipulator - for a completely touchless solution. Within a
simulation environment, a smooth feedback control system, a collision-avoidance algorithm, and a unique
visual servoing technique will be designed, developed, and verified. This research will enable NZT to buy an
appropriate robotic arm and begin deployment in an OR environment. The technology developed, as the result
of this project, will replace conventional methods for image viewing and manipulation during minimally
invasive surgeries in the OR. This solution provides a simple, intuitive, and ergonomic interaction capability to
the surgeon - removing sources of intra-operative infections and allowing shorter surgeries.