title: A role for error training in surgical technical skill instruction and evaluation.
abstract: BACKGROUND
  During the evaluation of many instances of the same basic surgical skill, we observed that there were several errors that occurred frequently. Two studies were undertaken to examine the use of these errors for improving the instruction and evaluation of the skill.
  
  
  METHODS
  For both studies, two types of rater training videotapes were developed. One involved the use of examples of common errors (error) and the other demonstrated the skill being performed correctly (correct). A testing videotape was created consisting of 24 performances of the skill that ranged in quality of the performance. The first study was designed to assess the impact of error instruction on skill acquisition. In this study, a group of 30 senior medical students were randomly assigned to one of four different training groups: none, error only, correct only, and error+correct. Subjects were videotaped performing the skill before and after the training and three experts evaluated these performances independently using a 7-point rating scale. The second study was designed to assess the impact of error training on skill evaluation and was done using both novice and expert raters. The same group of 30 senior medical students used in the first study was used as novice raters. Following training in one of the four training groups, each subject rated the 24 performances on the testing videotape and interrater reliability was assessed for each group. Surgical faculty served as expert raters in this study and were randomly assigned to receive either error training or no training. Each subject viewed the testing videotape, rating the performances and giving "feedback" commentary. Interrater reliability was calculated for the two groups and the precision of the feedback was assessed.
  
  
  RESULTS
  Significant improvement in posttest performance scores was seen only in the "error+correct" training group. Interrater reliability was somewhat lower for the "correct only" and "error only" training groups in both the student and faculty studies. Faculty raters receiving error training had a higher proportion of specific comments than the group that received no training although this difference was not statistically significant.
  
  
  CONCLUSIONS
  Instruction about common errors, when combined with instruction about the correct performance enhanced the acquisition of this surgical skill. This suggests a role for the use of errors in surgical technical skill instruction. Our study provides no support for a role for error training in improving skill evaluation.
authors.affiliation: Department of Surgery, Southern Illinois University School of Medicine, P.O. Box 19655, Springfield, IL 62794-9655, USA. drogers@siumed.edu
authors.forename: David A
authors.initials: DA
authors.lastname: Rogers
authors.forename: Glenn
authors.initials: G
authors.lastname: Regehr
authors.forename: Jeannie
authors.initials: J
authors.lastname: MacDonald
mesh_terms: D000704:Analysis of Variance; D002983:Clinical Competence; D004504:Education, Medical, Undergraduate / Q000592:standards* / Q000639:trends; D004521:Educational Measurement; D005260:Female; D013502:General Surgery / Q000193:education*; D006801:Humans; D008297:Male; D011336:Probability; D018570:Risk Assessment; D012680:Sensitivity and Specificity; D013663:Teaching / Q000379:methods*; D014743:Videotape Recording