Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of British Columbia

$76,000.00

Transparency and semi-autonomy in teleoperation

FY 2022-23

Summary
My research program is in the areas of teleoperation and medical robotics. Results from our previous NSERC Discovery Grant include: (A) for robot-assisted surgery, instrument force and surgeon's hand force sensing, as well as advanced teleoperation controllers that work on a full bi-manual surgical system, the da Vinci medical robotics system, (B) a new endoscopic camera that provides better visualization, methods for tissue tracking in camera views, an eye gaze tracker for the da Vinci system, and methods for planning surgical robot motion, and (C) an approach and system to enable a human novice to easily copy the hand motion of a mentor, the novice behaving as if it were a robot controlled by the expert. The long-term objective of my research program is to improve the surgeon's interface for robot-assisted procedures. For this granting period, our short-term objectives are: A. Force feedback. We will develop methods to provide to the surgeon a feeling of the forces that the instruments encounter during surgery. The instrument and surgeon's forces will be used to research new methods of robot teleoperation control that have superior performance than possible without force sensing. B. Automated camera and third-arm assistance. When operating, surgeons have to move the 3D camera so they can observe the surgical sight from an appropriate angle and distance. To move the camera, they need to switch from controlling the robotic instruments to controlling the camera, then back, and so on. This is inefficient. Methods to automatically move our new camera within the body for best view of the surgical site will be developed. The third arm could become very useful if used with ultrasound so that the surgeon can see underneath the tissue surface shown by the camera. We will develop methods to move the ultrasound transducer automatically where it can provide a view of the tissue that is useful to the surgeon, e.g. to avoid perforating a blood vessel by mistake. C. Human teleoperation. In teleoperated ultrasound, an ultrasound probe is mounted on a robot controlled by an expert from a distance. To set up the robot and insure safety, this approach requires an assistant. The role of the robot can be taken by a novice person, wearing translucent "mixed reality" glasses that can display a virtual ultrasound probe that is controlled by the expert. By moving the real probe to coincide with the virtual one, the novice takes the role of a remote robot, and copies the hand movements of the expert. We will study various aspects of such a novel system, including how to provide force feedback to the expert. Robotics and teleoperation are having an increasing impact on our lives. The users of this research include other researchers, medical robotics companies and ultrasound imaging companies. Our program will train the next generation of HQP in teleoperation and medical robotics.
Program
Discovery Grants Program - Individual
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2022-04544
Name nom
Salcudean, Septimiu
Department département
Electrical and Computer Engineering - Electrical and Computer Engineering
Organization id
2
Institution établissement
University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2022
Award amount
76000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1510
Committee name en
Electrical and Computer Engineering
Committee name fr
Génie électrique et informatique
Area of application code
1102
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Biomedical engineering
Area of application fr
Génie biomédical
Research subject code
2600
Research subject group en
Robotics
Research subject group fr
Robotique
Research subject en
Robotics
Research subject fr
Robotique
Installment
inst:1
Partie
1
Nb partie
5
Application title
Transparency and semi-autonomy in teleoperation
Application summary
My research program is in the areas of teleoperation and medical robotics. Results from our previous NSERC Discovery Grant include: (A) for robot-assisted surgery, instrument force and surgeon's hand force sensing, as well as advanced teleoperation controllers that work on a full bi-manual surgical system, the da Vinci medical robotics system, (B) a new endoscopic camera that provides better visualization, methods for tissue tracking in camera views, an eye gaze tracker for the da Vinci system, and methods for planning surgical robot motion, and (C) an approach and system to enable a human novice to easily copy the hand motion of a mentor, the novice behaving as if it were a robot controlled by the expert. The long-term objective of my research program is to improve the surgeon's interface for robot-assisted procedures. For this granting period, our short-term objectives are: A. Force feedback. We will develop methods to provide to the surgeon a feeling of the forces that the instruments encounter during surgery. The instrument and surgeon's forces will be used to research new methods of robot teleoperation control that have superior performance than possible without force sensing. B. Automated camera and third-arm assistance. When operating, surgeons have to move the 3D camera so they can observe the surgical sight from an appropriate angle and distance. To move the camera, they need to switch from controlling the robotic instruments to controlling the camera, then back, and so on. This is inefficient. Methods to automatically move our new camera within the body for best view of the surgical site will be developed. The third arm could become very useful if used with ultrasound so that the surgeon can see underneath the tissue surface shown by the camera. We will develop methods to move the ultrasound transducer automatically where it can provide a view of the tissue that is useful to the surgeon, e.g. to avoid perforating a blood vessel by mistake. C. Human teleoperation. In teleoperated ultrasound, an ultrasound probe is mounted on a robot controlled by an expert from a distance. To set up the robot and insure safety, this approach requires an assistant. The role of the robot can be taken by a novice person, wearing translucent "mixed reality" glasses that can display a virtual ultrasound probe that is controlled by the expert. By moving the real probe to coincide with the virtual one, the novice takes the role of a remote robot, and copies the hand movements of the expert. We will study various aspects of such a novel system, including how to provide force feedback to the expert. Robotics and teleoperation are having an increasing impact on our lives. The users of this research include other researchers, medical robotics companies and ultrasound imaging companies. Our program will train the next generation of HQP in teleoperation and medical robotics.
University of British Columbia - $76,000 Grant (2022-… | Canada Spends