Busca avançada
Ano de início
Entree
(Referência obtida automaticamente do Web of Science, por meio da informação sobre o financiamento pela FAPESP e o número do processo correspondente, incluída na publicação pelos autores.)

Laparoscopy with augmented reality adaptations

Texto completo
Autor(es):
Zorzal, Ezequiel Roberto [1, 2] ; Campos Gomes, Jose Miguel [1] ; Sousa, Mauricio [1, 3] ; Belchior, Pedro [1] ; da Silva, Pedro Garcia [3] ; Figueiredo, Nuno [3] ; Lopes, Daniel Simoes [1] ; Jorge, Joaquim [1]
Número total de Autores: 8
Afiliação do(s) autor(es):
[1] Univ Lisbon, INESC ID Lisboa, Inst Super Tecn, Lisbon - Portugal
[2] Univ Fed Sao Paulo, Inst Ciencia & Tecnol, UNIFESP, Sao Paulo - Brazil
[3] Champalimaud Fdn, Lisbon - Portugal
Número total de Afiliações: 3
Tipo de documento: Artigo Científico
Fonte: JOURNAL OF BIOMEDICAL INFORMATICS; v. 107, JUL 2020.
Citações Web of Science: 0
Resumo

One of the most promising applications of Optical See-Through Augmented Reality is minimally laparoscopic surgery, which currently suffers from problems such as surgeon discomfort and fatigue caused by looking at a display positioned outside the surgeon's visual field, made worse by the length of the procedure. This fatigue is especially felt on the surgeon's neck, as it is strained from adopting unnatural postures in order to visualise the laparoscopic video feed. Throughout this paper, we will present work in Augmented Reality, as well as developments in surgery and Augmented Reality applied to both surgery in general and laparoscopy in particular to address these issues. We applied user and task analysis methods to learn about practices performed in the operating room by observing surgeons in their working environment in order to understand, in detail, how they performed their tasks and achieved their intended goals. Drawing on observations and analysis of video recordings of laparoscopic surgeries, we identified relevant constraints and design requirements. Besides proposals to approach the ergonomic issues, we present a design and implementation of a multimodal interface to enhance the laparoscopic procedure. Our method makes it more comfortable for surgeons by allowing them to keep the laparoscopic video in their viewing area regardless of neck posture. Also, our interface makes it possible to access patient imaging data without interrupting the operation. It also makes it possible to communicate with team members through a pointing reticle. We evaluated how surgeons perceived the implemented prototype, in terms of usefulness and usability, via a think-aloud protocol to conduct qualitative evaluation sessions which we describe in detail in this paper. In addition to checking the advantages of the prototype as compared to traditional laparoscopic settings, we also conducted a System Usability Scale questionnaire for measuring its usability, and a NASA Task Load Index questionnaire to rate perceived workload and to assess the prototype effectiveness. Our results show that surgeons consider that our prototype can improve surgeon-to-surgeon communication using head pose as a means of pointing. Also, surgeons believe that our approach can afford a more comfortable posture throughout the surgery and enhance hand-eye coordination, as physicians no longer need to twist their necks to look at screens placed outside the field of operation. (AU)

Processo FAPESP: 18/20358-0 - Realidade Aumentada Adaptativa Móvel com Técnicas de Gamificação Aplicada no Ensino
Beneficiário:Ezequiel Roberto Zorzal
Modalidade de apoio: Bolsas no Exterior - Pesquisa