Grant: Engage Grants Program
University of British Columbia
$25,000.00
Perspective correction for interactive projection during surgery
FY 2015-16
Summary
Surgeons need better computer interfaces to interact with medical images during surgery. To navigate through a
set of medical images and manipulate them (zoom, pan, scroll, etc.), surgeons are currently constrained to use a
traditional mouse and keyboard in the control room just outside the sterile surgical field. In each interaction
with these unsterile devices, the surgeon has to either (1) ""scrub out"" to enter the control room and ""scrub back
in"" afterwards or (2) verbally instruct a technologist to operate the workstation. Scrubbing in and out of the
sterile field is time-consuming and involves contamination risks and issuing instructions to an assistant
removes direct control from the surgeon. NZ Technologies Inc. (NZTech) has been developing a novel medical
device, called 'Touchless Interaction with Picture and Archiving Communication Systems (PACS) in Sterile
Operations' (TIPSO). TIPSO employs real-time optical 3D sensing of the environment to enable surgeons to
manipulate the images by using hand gestures and motions in a fully sterile manner - directly from the OR. An
adaptive light projection module enables surgeons to intuitively interact with a 'virtual tactile' menu that is
projected over the surgery bed. It is enhanced with a visual feedback mechanism such that the surgeon receives
intuitive confirmation of these manipulation actions. This grant aims to develop a new homographic correction
model for pre-adjusting the projected graphic contents in such a way that they appears undistorted from the
perspective of the surgeon. This model will compensate for deformations and irregularities on the projection
surface. The technology developed as a result of this project mitigates the possibility of infection and avoids
delays in therapeutic plan formulation, thereby improving patient safety and decreasing healthcare costs and
related complications. This solution facilitates a more intuitive and efficient image manipulation workflow in a
surgery environment, while also becoming an important stepping stone in refining the existing human-machine
interaction paradigms that form the forefront of machine vision research today.
Program
Engage Grants Program
Recipient
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
487368-2015
Name nom
Rohling, Robert
Department département
Electrical and Computer Engineering
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2015
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1554
Committee name en
Pacific Internal Decision Committee
Committee name fr
Comité de décision interne pour le Pacifique
Area of application code
518
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Medical equipment and apparatus
Area of application fr
Appareils et instruments médicaux
Research subject code
1900
Research subject group en
Biomedical engineering
Research subject group fr
Génie biomédical
Research subject en
Biomedical engineering
Research subject fr
Génie biomédical
Partie
1
Nb partie
1
Application title
Perspective correction for interactive projection during surgery
Keyword
NSERC
Application summary
Surgeons need better computer interfaces to interact with medical images during surgery. To navigate through a
set of medical images and manipulate them (zoom, pan, scroll, etc.), surgeons are currently constrained to use a
traditional mouse and keyboard in the control room just outside the sterile surgical field. In each interaction
with these unsterile devices, the surgeon has to either (1) ""scrub out"" to enter the control room and ""scrub back
in"" afterwards or (2) verbally instruct a technologist to operate the workstation. Scrubbing in and out of the
sterile field is time-consuming and involves contamination risks and issuing instructions to an assistant
removes direct control from the surgeon. NZ Technologies Inc. (NZTech) has been developing a novel medical
device, called 'Touchless Interaction with Picture and Archiving Communication Systems (PACS) in Sterile
Operations' (TIPSO). TIPSO employs real-time optical 3D sensing of the environment to enable surgeons to
manipulate the images by using hand gestures and motions in a fully sterile manner - directly from the OR. An
adaptive light projection module enables surgeons to intuitively interact with a 'virtual tactile' menu that is
projected over the surgery bed. It is enhanced with a visual feedback mechanism such that the surgeon receives
intuitive confirmation of these manipulation actions. This grant aims to develop a new homographic correction
model for pre-adjusting the projected graphic contents in such a way that they appears undistorted from the
perspective of the surgeon. This model will compensate for deformations and irregularities on the projection
surface. The technology developed as a result of this project mitigates the possibility of infection and avoids
delays in therapeutic plan formulation, thereby improving patient safety and decreasing healthcare costs and
related complications. This solution facilitates a more intuitive and efficient image manipulation workflow in a
surgery environment, while also becoming an important stepping stone in refining the existing human-machine
interaction paradigms that form the forefront of machine vision research today.