Surgical subtask automation - Soft tissue retraction

Tamas D. Nagy, Marta Takacs, I. Rudas, Tamas Haidegger

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Robot-assisted surgery is becoming standard-of-care in minimally invasive surgery. Given the intense development in this area, many believe that the next big step is surgical subtask automation, the partial automation of certain elements of the procedure. Autonomous execution at lower task levels has the potential to safely improve one element of a surgical process. Automation by artificial intelligence may significantly improve surgery with better accuracy and targeting, that can shorten the recovering time of the patient. Furthermore, partial automation can also help surgeons efficiently by reducing the fatigue in the case of time-consuming operations. In this paper, we present the automation of soft tissue retraction, an often recurring subtask of surgical interventions. Soft tissue retraction plays an important role in laparoscopic cholecystectomy, e.g., during the exploration of the Calot triangle, automatic retraction would streamline the procedure. The presented method only relies on a stereo camera image feed, and therefore does not put additional overhead on the already crowded operating room. We developed and tested multiple control methods for soft tissue retraction built on each other: a simple proportional control for reference, one using Hidden Markov Models for state estimation, and one employing fuzzy logic. Our method was tested comparatively with all three controllers in a simplified phantom environment.

Original languageEnglish
Title of host publicationSAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages55-60
Number of pages6
Volume2018-February
ISBN (Electronic)9781538647721
DOIs
Publication statusPublished - Mar 23 2018
Event16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, SAMI 2018 - Kosice, Herl'any, Slovakia
Duration: Feb 7 2018Feb 10 2018

Other

Other16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, SAMI 2018
CountrySlovakia
CityKosice, Herl'any
Period2/7/182/10/18

Fingerprint

Retraction
Soft Tissue
Automation
Tissue
Surgery
Minimally Invasive Surgery
Operating rooms
Partial
State Estimation
State estimation
Hidden Markov models
Streamlines
Phantom
Fatigue
Markov Model
Fuzzy Logic
Fuzzy logic
Artificial intelligence
Triangle
Artificial Intelligence

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Control and Optimization
  • Artificial Intelligence

Cite this

Nagy, T. D., Takacs, M., Rudas, I., & Haidegger, T. (2018). Surgical subtask automation - Soft tissue retraction. In SAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings (Vol. 2018-February, pp. 55-60). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SAMI.2018.8323986

Surgical subtask automation - Soft tissue retraction. / Nagy, Tamas D.; Takacs, Marta; Rudas, I.; Haidegger, Tamas.

SAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings. Vol. 2018-February Institute of Electrical and Electronics Engineers Inc., 2018. p. 55-60.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nagy, TD, Takacs, M, Rudas, I & Haidegger, T 2018, Surgical subtask automation - Soft tissue retraction. in SAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings. vol. 2018-February, Institute of Electrical and Electronics Engineers Inc., pp. 55-60, 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, SAMI 2018, Kosice, Herl'any, Slovakia, 2/7/18. https://doi.org/10.1109/SAMI.2018.8323986
Nagy TD, Takacs M, Rudas I, Haidegger T. Surgical subtask automation - Soft tissue retraction. In SAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings. Vol. 2018-February. Institute of Electrical and Electronics Engineers Inc. 2018. p. 55-60 https://doi.org/10.1109/SAMI.2018.8323986
Nagy, Tamas D. ; Takacs, Marta ; Rudas, I. ; Haidegger, Tamas. / Surgical subtask automation - Soft tissue retraction. SAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings. Vol. 2018-February Institute of Electrical and Electronics Engineers Inc., 2018. pp. 55-60
@inproceedings{0ea17505252d41778bc5b6c86197ad1d,
title = "Surgical subtask automation - Soft tissue retraction",
abstract = "Robot-assisted surgery is becoming standard-of-care in minimally invasive surgery. Given the intense development in this area, many believe that the next big step is surgical subtask automation, the partial automation of certain elements of the procedure. Autonomous execution at lower task levels has the potential to safely improve one element of a surgical process. Automation by artificial intelligence may significantly improve surgery with better accuracy and targeting, that can shorten the recovering time of the patient. Furthermore, partial automation can also help surgeons efficiently by reducing the fatigue in the case of time-consuming operations. In this paper, we present the automation of soft tissue retraction, an often recurring subtask of surgical interventions. Soft tissue retraction plays an important role in laparoscopic cholecystectomy, e.g., during the exploration of the Calot triangle, automatic retraction would streamline the procedure. The presented method only relies on a stereo camera image feed, and therefore does not put additional overhead on the already crowded operating room. We developed and tested multiple control methods for soft tissue retraction built on each other: a simple proportional control for reference, one using Hidden Markov Models for state estimation, and one employing fuzzy logic. Our method was tested comparatively with all three controllers in a simplified phantom environment.",
author = "Nagy, {Tamas D.} and Marta Takacs and I. Rudas and Tamas Haidegger",
year = "2018",
month = "3",
day = "23",
doi = "10.1109/SAMI.2018.8323986",
language = "English",
volume = "2018-February",
pages = "55--60",
booktitle = "SAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Surgical subtask automation - Soft tissue retraction

AU - Nagy, Tamas D.

AU - Takacs, Marta

AU - Rudas, I.

AU - Haidegger, Tamas

PY - 2018/3/23

Y1 - 2018/3/23

N2 - Robot-assisted surgery is becoming standard-of-care in minimally invasive surgery. Given the intense development in this area, many believe that the next big step is surgical subtask automation, the partial automation of certain elements of the procedure. Autonomous execution at lower task levels has the potential to safely improve one element of a surgical process. Automation by artificial intelligence may significantly improve surgery with better accuracy and targeting, that can shorten the recovering time of the patient. Furthermore, partial automation can also help surgeons efficiently by reducing the fatigue in the case of time-consuming operations. In this paper, we present the automation of soft tissue retraction, an often recurring subtask of surgical interventions. Soft tissue retraction plays an important role in laparoscopic cholecystectomy, e.g., during the exploration of the Calot triangle, automatic retraction would streamline the procedure. The presented method only relies on a stereo camera image feed, and therefore does not put additional overhead on the already crowded operating room. We developed and tested multiple control methods for soft tissue retraction built on each other: a simple proportional control for reference, one using Hidden Markov Models for state estimation, and one employing fuzzy logic. Our method was tested comparatively with all three controllers in a simplified phantom environment.

AB - Robot-assisted surgery is becoming standard-of-care in minimally invasive surgery. Given the intense development in this area, many believe that the next big step is surgical subtask automation, the partial automation of certain elements of the procedure. Autonomous execution at lower task levels has the potential to safely improve one element of a surgical process. Automation by artificial intelligence may significantly improve surgery with better accuracy and targeting, that can shorten the recovering time of the patient. Furthermore, partial automation can also help surgeons efficiently by reducing the fatigue in the case of time-consuming operations. In this paper, we present the automation of soft tissue retraction, an often recurring subtask of surgical interventions. Soft tissue retraction plays an important role in laparoscopic cholecystectomy, e.g., during the exploration of the Calot triangle, automatic retraction would streamline the procedure. The presented method only relies on a stereo camera image feed, and therefore does not put additional overhead on the already crowded operating room. We developed and tested multiple control methods for soft tissue retraction built on each other: a simple proportional control for reference, one using Hidden Markov Models for state estimation, and one employing fuzzy logic. Our method was tested comparatively with all three controllers in a simplified phantom environment.

UR - http://www.scopus.com/inward/record.url?scp=85050959280&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050959280&partnerID=8YFLogxK

U2 - 10.1109/SAMI.2018.8323986

DO - 10.1109/SAMI.2018.8323986

M3 - Conference contribution

VL - 2018-February

SP - 55

EP - 60

BT - SAMI 2018 - IEEE 16th World Symposium on Applied Machine Intelligence and Informatics Dedicated to the Memory of Pioneer of Robotics Antal (Tony) K. Bejczy, Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -