Towards Automated Performance Assessment using Velocity-based Motion Quality Metrics

Barathwaj Murali, Viony M. Belvroy, Shivam Pandey, Michael D. Byrne, Jean Bismuth, Marcia K. Omalley

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations


Acquiring proficiency in endovascular surgery requires a significant investment of time and resources, both from trainees who are developing skills and from experienced surgeons who must serve as evaluators. These experienced surgeons typically provide feedback to trainees using structured grading scales that offer a qualitative and subjective assessment of performance. To address these limitations, we previously established that spectral arc length (SPARC), a frequency-domain measure of movement smoothness, was a quantitative and objective indicator of surgical experience. Still, trainees have indicated that performance feedback based on SPARC is not intuitive or easily understandable. In this work, we evaluate the potential of alternative quantitative measures of endovascular tool navigation proficiency. One set of metrics is available from a commercial endovascular surgical simulator, and another set of metrics is derived from tool tip velocity profiles. Results indicate that average guidewire tip velocities and idle times (the amount of time the guidewire remains stationary) are significantly different across experience groups. In contrast, only one of the performance metrics currently implemented on the simulator shows significant differences across experience groups. Subsequent analysis showed that average velocity and idle time correlate strongly with SPARC for these tasks. These results support the potential of metrics based on tool tip velocity for real-Time objective assessment of endovascular skill. Further, these metrics, which correlate strongly to movement smoothness, are likely to be easier for participants to interpret than feedback based on spectral arc length, which could positively effect training effectiveness.

Original languageEnglish (US)
Title of host publication2020 International Symposium on Medical Robotics, ISMR 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages7
ISBN (Electronic)9781728154886
StatePublished - Nov 18 2020
Event2020 International Symposium on Medical Robotics, ISMR 2020 - Atlanta, United States
Duration: Nov 18 2020Nov 20 2020

Publication series

Name2020 International Symposium on Medical Robotics, ISMR 2020


Conference2020 International Symposium on Medical Robotics, ISMR 2020
Country/TerritoryUnited States

ASJC Scopus subject areas

  • Artificial Intelligence
  • Biomedical Engineering
  • Control and Optimization
  • Surgery


Dive into the research topics of 'Towards Automated Performance Assessment using Velocity-based Motion Quality Metrics'. Together they form a unique fingerprint.

Cite this