TY - JOUR
T1 - Velocity-domain motion quality measures for surgical performance evaluation and feedback
AU - Murali, Barathwaj
AU - Belvroy, Viony M.
AU - Pandey, Shivam
AU - Bismuth, Jean
AU - Byrne, Michael D.
AU - O’Malley, Marcia K.
N1 - Funding Information:
• National Science Foundation (Grant No. IIS1638073; Funder ID: 10.13039/100000001).
Funding Information:
• This work was supported by BOTH the GRFP and the NSF grant.
Publisher Copyright:
Copyright VC 2021 by ASME
Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.
PY - 2021/3
Y1 - 2021/3
N2 - Endovascular navigation proficiency requires a significant amount of manual dexterity from surgeons. Objective performance measures derived from endovascular tool tip kinematics have been shown to correlate with expertise; however, such metrics have not yet been used during training as a basis for real-time performance feedback. This paper evaluates a set of velocity-based performance measures derived from guidewire motion to determine their suitability for online performance evaluation and feedback. We evaluated the endovascular navigation skill of 75 participants using three metrics (spectral arc length, average velocity, and idle time) as they steered tools to anatomical targets using a virtual reality simulator. First, we examined the effect of navigation task and experience level on performance and found that novice performance was significantly different from intermediate and expert performance. Then we computed correlations between measures calculated online and spectral arc length, our “gold standard” metric, calculated offline (at the end of the trial, using data from the entire trial). Our results suggest that average velocity and idle time calculated online are strongly and consistently correlated with spectral arc length computed offline, which was not the case when comparing spectral arc length computed online and offline. Average velocity and idle time, both time-domain based performance measures, are therefore more suitable measures than spectral arc length, a frequency-domain based metric, to use as the basis of online performance feedback. Future work is needed to determine how to best provide real-time performance feedback to endovascular surgery trainees based on these metrics.
AB - Endovascular navigation proficiency requires a significant amount of manual dexterity from surgeons. Objective performance measures derived from endovascular tool tip kinematics have been shown to correlate with expertise; however, such metrics have not yet been used during training as a basis for real-time performance feedback. This paper evaluates a set of velocity-based performance measures derived from guidewire motion to determine their suitability for online performance evaluation and feedback. We evaluated the endovascular navigation skill of 75 participants using three metrics (spectral arc length, average velocity, and idle time) as they steered tools to anatomical targets using a virtual reality simulator. First, we examined the effect of navigation task and experience level on performance and found that novice performance was significantly different from intermediate and expert performance. Then we computed correlations between measures calculated online and spectral arc length, our “gold standard” metric, calculated offline (at the end of the trial, using data from the entire trial). Our results suggest that average velocity and idle time calculated online are strongly and consistently correlated with spectral arc length computed offline, which was not the case when comparing spectral arc length computed online and offline. Average velocity and idle time, both time-domain based performance measures, are therefore more suitable measures than spectral arc length, a frequency-domain based metric, to use as the basis of online performance feedback. Future work is needed to determine how to best provide real-time performance feedback to endovascular surgery trainees based on these metrics.
UR - http://www.scopus.com/inward/record.url?scp=85108000346&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85108000346&partnerID=8YFLogxK
U2 - 10.1115/1.4049310
DO - 10.1115/1.4049310
M3 - Article
AN - SCOPUS:85108000346
VL - 15
JO - Journal of Medical Devices, Transactions of the ASME
JF - Journal of Medical Devices, Transactions of the ASME
SN - 1932-6181
IS - 1
M1 - 011107
ER -