TY - JOUR
T1 - Are General Surgery Residents Accurate Assessors of Their Own Flexible Endoscopy Skills?
AU - Vyasa, Parth
AU - Willis, Ross E.
AU - Dunkin, Brian J.
AU - Gardner, Aimee K.
N1 - Publisher Copyright:
© 2016 Association of Program Directors in Surgery
PY - 2017/1/1
Y1 - 2017/1/1
N2 - Background Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents’ assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions—practice only (PO), self-observation (SO), or expert observation (EO)—on self-assessment accuracy. Methods Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. Results Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). Discussion Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. Summary Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.
AB - Background Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents’ assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions—practice only (PO), self-observation (SO), or expert observation (EO)—on self-assessment accuracy. Methods Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. Results Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). Discussion Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. Summary Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.
KW - Patient Care
KW - Practice-Based Learning and Improvement
KW - Systems-Based Practice
KW - education
KW - endoscopy
KW - residents
KW - self-assessment
KW - video review
UR - http://www.scopus.com/inward/record.url?scp=84981725658&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84981725658&partnerID=8YFLogxK
U2 - 10.1016/j.jsurg.2016.06.018
DO - 10.1016/j.jsurg.2016.06.018
M3 - Article
C2 - 27522346
AN - SCOPUS:84981725658
SN - 1931-7204
VL - 74
SP - 23
EP - 29
JO - Journal of Surgical Education
JF - Journal of Surgical Education
IS - 1
ER -