TY - JOUR
T1 - Development of performance and learning rate evaluation models in robot-assisted surgery using electroencephalography and eye-tracking
AU - Shafiei, Somayeh B.
AU - Shadpour, Saeed
AU - Sasangohar, Farzan
AU - Mohler, James L.
AU - Attwood, Kristopher
AU - Jing, Zhe
N1 - Funding Information:
The research reported in this publication was supported by the National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health under grant number R01EB029398. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. This work was supported by the National Cancer Institute (NCI) grant P30CA016056, involving the use of Roswell Park Comprehensive Cancer Center’s shared resources (Comparative Oncology and the Applied Technology Laboratory for Advanced Surgery Shared Resources). The authors would like to thank all the study subjects.
Publisher Copyright:
© 2024, The Author(s).
PY - 2024/1/20
Y1 - 2024/1/20
N2 - The existing performance evaluation methods in robot-assisted surgery (RAS) are mainly subjective, costly, and affected by shortcomings such as the inconsistency of results and dependency on the raters’ opinions. The aim of this study was to develop models for an objective evaluation of performance and rate of learning RAS skills while practicing surgical simulator tasks. The electroencephalogram (EEG) and eye-tracking data were recorded from 26 subjects while performing Tubes, Suture Sponge, and Dots and Needles tasks. Performance scores were generated by the simulator program. The functional brain networks were extracted using EEG data and coherence analysis. Then these networks, along with community detection analysis, facilitated the extraction of average search information and average temporal flexibility features at 21 Brodmann areas (BA) and four band frequencies. Twelve eye-tracking features were extracted and used to develop linear random intercept models for performance evaluation and multivariate linear regression models for the evaluation of the learning rate. Results showed that subject-wise standardization of features improved the R2 of the models. Average pupil diameter and rate of saccade were associated with performance in the Tubes task (multivariate analysis; p-value = 0.01 and p-value = 0.04, respectively). Entropy of pupil diameter was associated with performance in Dots and Needles task (multivariate analysis; p-value = 0.01). Average temporal flexibility and search information in several BAs and band frequencies were associated with performance and rate of learning. The models may be used to objectify performance and learning rate evaluation in RAS once validated with a broader sample size and tasks.
AB - The existing performance evaluation methods in robot-assisted surgery (RAS) are mainly subjective, costly, and affected by shortcomings such as the inconsistency of results and dependency on the raters’ opinions. The aim of this study was to develop models for an objective evaluation of performance and rate of learning RAS skills while practicing surgical simulator tasks. The electroencephalogram (EEG) and eye-tracking data were recorded from 26 subjects while performing Tubes, Suture Sponge, and Dots and Needles tasks. Performance scores were generated by the simulator program. The functional brain networks were extracted using EEG data and coherence analysis. Then these networks, along with community detection analysis, facilitated the extraction of average search information and average temporal flexibility features at 21 Brodmann areas (BA) and four band frequencies. Twelve eye-tracking features were extracted and used to develop linear random intercept models for performance evaluation and multivariate linear regression models for the evaluation of the learning rate. Results showed that subject-wise standardization of features improved the R2 of the models. Average pupil diameter and rate of saccade were associated with performance in the Tubes task (multivariate analysis; p-value = 0.01 and p-value = 0.04, respectively). Entropy of pupil diameter was associated with performance in Dots and Needles task (multivariate analysis; p-value = 0.01). Average temporal flexibility and search information in several BAs and band frequencies were associated with performance and rate of learning. The models may be used to objectify performance and learning rate evaluation in RAS once validated with a broader sample size and tasks.
UR - http://www.scopus.com/inward/record.url?scp=85182636513&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85182636513&partnerID=8YFLogxK
U2 - 10.1038/s41539-024-00216-y
DO - 10.1038/s41539-024-00216-y
M3 - Article
C2 - 38242909
AN - SCOPUS:85182636513
SN - 2056-7936
VL - 9
SP - 3
JO - npj Science of Learning
JF - npj Science of Learning
IS - 1
M1 - 3
ER -