title: Head-camera video recordings of trauma core competency procedures can evaluate surgical resident's technical performance as well as colocated evaluators.
abstract: Unbiased evaluation of trauma core competency procedures is necessary to determine if residency and predeployment training courses are useful. We tested whether a previously validated individual procedure score (IPS) for individual procedure vascular exposure and fasciotomy (FAS) performance skills could discriminate training status by comparing IPS of evaluators colocated with surgeons to blind video evaluations.
  
  
  
  Performance of axillary artery (AA), brachial artery (BA), and femoral artery (FA) vascular exposures and lower extremity FAS on fresh cadavers by 40 PGY-2 to PGY-6 residents was video-recorded from head-mounted cameras. Two colocated trained evaluators assessed IPS before and after training. One surgeon in each pretraining tertile of IPS for each procedure was randomly identified for blind video review. The same 12 surgeons were video-recorded repeating the procedures less than 4 weeks after training. Five evaluators independently reviewed all 96 randomly arranged deidentified videos. Inter-rater reliability/consistency, intraclass correlation coefficients were compared by colocated versus video review of IPS, and errors. Study methodology and bias were judged by Medical Education Research Study Quality Instrument and the Quality Assessment of Diagnostic Accuracy Studies criteria.
  
  
  
  There were no differences (p ≥ 0.5) in IPS for AA, FA, FAS, whether evaluators were colocated or reviewed video recordings. Evaluator consistency was 0.29 (BA) - 0.77 (FA). Video and colocated evaluators were in total agreement (p = 1.0) for error recognition. Intraclass correlation coefficient was 0.73 to 0.92, dependent on procedure. Correlations video versus colocated evaluations were 0.5 to 0.9. Except for BA, blinded video evaluators discriminated (p < 0.002) whether procedures were performed before training versus after training. Study methodology by Medical Education Research Study Quality Instrument criteria scored 15.5/19, Quality Assessment of Diagnostic Accuracy Studies 2 showed low bias risk.
  
  
  
  Video evaluations of AA, FA, and FAS procedures with IPS are unbiased, valid, and have potential for formative assessments of competency.
  
  
  
  Prognostic study, level II.
authors.affiliation: Shock Trauma Anesthesiology Research Center (C.F.M., G.G., G.H., S.A.T.), University of Maryland School of Medicine (C.F.M., H.C., N.L., S.A.T.), Baltimore, Maryland; US Air Force C-STARS (J.P.), Baltimore, Maryland; Department of Anatomy (E.G.), University of Arizona College of Medicine, Tucson, Arizona; Institute for Surgical Research (S.S.), Fort Sam Houston, San Antonio, Texas; Department of Epidemiology and Public Health (H.C., N.L.), Department of Surgery (K.P.), Uniformed Services University of Health Sciences, Bethesda, Maryland; and Department of Surgery (S.A.T.), University of Maryland School of Medicine, Baltimore, Maryland.
authors.forename: Colin F
authors.initials: CF
authors.lastname: Mackenzie
authors.forename: Jason
authors.initials: J
authors.lastname: Pasley
authors.forename: Evan
authors.initials: E
authors.lastname: Garofalo
authors.forename: Stacy
authors.initials: S
authors.lastname: Shackelford
authors.forename: Hegang
authors.initials: H
authors.lastname: Chen
authors.forename: Nyaradzo
authors.initials: N
authors.lastname: Longinaker
authors.forename: Guinevere
authors.initials: G
authors.lastname: Granite
authors.forename: Kristy
authors.initials: K
authors.lastname: Pugh
authors.forename: George
authors.initials: G
authors.lastname: Hagegeorge
authors.forename: Samuel A
authors.initials: SA
authors.lastname: Tisherman
mesh_terms: D000328:Adult; D002102:Cadaver; D002983:Clinical Competence; D004503:Education, Medical, Graduate; D004521:Educational Measurement; D000071938:Fasciotomy / Q000193:education*; D005260:Female; D006801:Humans; D007396:Internship and Residency; D008297:Male; D011795:Surveys and Questionnaires; D014194:Traumatology / Q000193:education*; D014656:Vascular Surgical Procedures / Q000193:education*; D014741:Video Recording