Canada Spends Logo

Explorez notre analyse du budget 2026

Grant: Engage Grants Program

University of British Columbia

$25,000.00

Perspective correction for interactive projection during surgery

EF 2015-16

Résumé
Surgeons need better computer interfaces to interact with medical images during surgery. To navigate through a set of medical images and manipulate them (zoom, pan, scroll, etc.), surgeons are currently constrained to use a traditional mouse and keyboard in the control room just outside the sterile surgical field. In each interaction with these unsterile devices, the surgeon has to either (1) ""scrub out"" to enter the control room and ""scrub back in"" afterwards or (2) verbally instruct a technologist to operate the workstation. Scrubbing in and out of the sterile field is time-consuming and involves contamination risks and issuing instructions to an assistant removes direct control from the surgeon. NZ Technologies Inc. (NZTech) has been developing a novel medical device, called 'Touchless Interaction with Picture and Archiving Communication Systems (PACS) in Sterile Operations' (TIPSO). TIPSO employs real-time optical 3D sensing of the environment to enable surgeons to manipulate the images by using hand gestures and motions in a fully sterile manner - directly from the OR. An adaptive light projection module enables surgeons to intuitively interact with a 'virtual tactile' menu that is projected over the surgery bed. It is enhanced with a visual feedback mechanism such that the surgeon receives intuitive confirmation of these manipulation actions. This grant aims to develop a new homographic correction model for pre-adjusting the projected graphic contents in such a way that they appears undistorted from the perspective of the surgeon. This model will compensate for deformations and irregularities on the projection surface. The technology developed as a result of this project mitigates the possibility of infection and avoids delays in therapeutic plan formulation, thereby improving patient safety and decreasing healthcare costs and related complications. This solution facilitates a more intuitive and efficient image manipulation workflow in a surgery environment, while also becoming an important stepping stone in refining the existing human-machine interaction paradigms that form the forefront of machine vision research today.
Programme
Engage Grants Program
Emplacement
British Columbia, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data

Tel que publié

Application id
487368-2015
Name nom
Rohling, Robert
Department département
Electrical and Computer Engineering
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2015
Competition year année de concours
2015
Award amount
25000
Program id
EGP
Program name en
Engage Grants Program
Program name fr
Programme de subventions d'engagement partenariat
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
1554
Committee name en
Pacific Internal Decision Committee
Committee name fr
Comité de décision interne pour le Pacifique
Area of application code
518
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Medical equipment and apparatus
Area of application fr
Appareils et instruments médicaux
Research subject code
1900
Research subject group en
Biomedical engineering
Research subject group fr
Génie biomédical
Research subject en
Biomedical engineering
Research subject fr
Génie biomédical
Partie
1
Nb partie
1
Application title
Perspective correction for interactive projection during surgery
Keyword
NSERC
Application summary
Surgeons need better computer interfaces to interact with medical images during surgery. To navigate through a set of medical images and manipulate them (zoom, pan, scroll, etc.), surgeons are currently constrained to use a traditional mouse and keyboard in the control room just outside the sterile surgical field. In each interaction with these unsterile devices, the surgeon has to either (1) ""scrub out"" to enter the control room and ""scrub back in"" afterwards or (2) verbally instruct a technologist to operate the workstation. Scrubbing in and out of the sterile field is time-consuming and involves contamination risks and issuing instructions to an assistant removes direct control from the surgeon. NZ Technologies Inc. (NZTech) has been developing a novel medical device, called 'Touchless Interaction with Picture and Archiving Communication Systems (PACS) in Sterile Operations' (TIPSO). TIPSO employs real-time optical 3D sensing of the environment to enable surgeons to manipulate the images by using hand gestures and motions in a fully sterile manner - directly from the OR. An adaptive light projection module enables surgeons to intuitively interact with a 'virtual tactile' menu that is projected over the surgery bed. It is enhanced with a visual feedback mechanism such that the surgeon receives intuitive confirmation of these manipulation actions. This grant aims to develop a new homographic correction model for pre-adjusting the projected graphic contents in such a way that they appears undistorted from the perspective of the surgeon. This model will compensate for deformations and irregularities on the projection surface. The technology developed as a result of this project mitigates the possibility of infection and avoids delays in therapeutic plan formulation, thereby improving patient safety and decreasing healthcare costs and related complications. This solution facilitates a more intuitive and efficient image manipulation workflow in a surgery environment, while also becoming an important stepping stone in refining the existing human-machine interaction paradigms that form the forefront of machine vision research today.