Evaluation of how users interface with holographic augmented reality surgical scenes: Interactive planning MR-Guided prostate biopsies

Jose D. Velazco-Garcia, Nikhil V. Navkar, Shidin Balakrishnan, Georges Younes, Julien Abi-Nahed, Khalid Al-Rumaihi, Adham Darweesh, Mohamed S.M. Elakkad, Abdulla Al-Ansari, Eftychios G. Christoforou, Mansour Karkoub, Ernst L. Leiss, Panagiotis Tsiamyrtzis, Nikolaos V. Tsekos

Research output: Contribution to journalArticlepeer-review

29 Scopus citations

Abstract

Background: User interfaces play a vital role in the planning and execution of an interventional procedure. The objective of this study is to investigate the effect of using different user interfaces for planning transrectal robot-assisted MR-guided prostate biopsy (MRgPBx) in an augmented reality (AR) environment. Method: End-user studies were conducted by simulating an MRgPBx system with end- and side-firing modes. The information from the system to the operator was rendered on HoloLens as an output interface. Joystick, mouse/keyboard, and holographic menus were used as input interfaces to the system. Results: The studies indicated that using a joystick improved the interactive capacity and enabled operator to plan MRgPBx in less time. It efficiently captures the operator's commands to manipulate the augmented environment representing the state of MRgPBx system. Conclusions: The study demonstrates an alternative to conventional input interfaces to interact and manipulate an AR environment within the context of MRgPBx planning.

Original languageEnglish (US)
Article numbere2290
JournalInternational Journal of Medical Robotics and Computer Assisted Surgery
Volume17
Issue number5
DOIs
StatePublished - Oct 2021

Keywords

  • augmented reality
  • MR-guided transrectal prostate biopsy
  • user interfaces for planning interventions

ASJC Scopus subject areas

  • Surgery
  • Biophysics
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Evaluation of how users interface with holographic augmented reality surgical scenes: Interactive planning MR-Guided prostate biopsies'. Together they form a unique fingerprint.

Cite this