title: Notes From the Field: Direct Observation Versus Rating by Videos for the Assessment of Central Venous Catheterization Skills.
abstract: Blinded assessments of technical skills using video-recordings may offer more objective assessments than direct observations. This study seeks to compare these two modalities. Two trained assessors independently assessed 18 central venous catheterization performances by direct observation and video-recorded assessments using two tools. Although sound quality was deemed adequate in all videos, portions of the video for wire handling and drape handling were frequently out of view (n = 13, 72% for wire-handling; n = 17, 94% for drape-handling). There were no differences in summary global rating scores, checklist scores, or pass/fail decisions for either modality (p > 0.05). Inter-rater reliability was acceptable for both modalities. Of the 26 discrepancies identified between direct observation and video-recorded assessments, three discrepancies (12%) were due to inattention during video review, while one (4%) discrepancy was due to inattention during direct observation. In conclusion, although scores did not differ between the two assessment modalities, techniques of video-recording may significantly impact individual items of assessments.
authors.affiliation: Department of Medicine, University of Calgary, Calgary, Canada W21C, University of Calgary, Calgary, Canada ima@ucalgary.ca.
authors.forename: Irene W Y
authors.initials: IW
authors.lastname: Ma
authors.affiliation: Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.
authors.forename: Nadia
authors.initials: N
authors.lastname: Zalunardo
authors.affiliation: Department of Surgery, University of Calgary, Calgary, Canada.
authors.forename: Mary E
authors.initials: ME
authors.lastname: Brindle
authors.affiliation: Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.
authors.forename: Rose
authors.initials: R
authors.lastname: Hatala
authors.affiliation: Department of Medicine, University of Calgary, Calgary, Canada.
authors.forename: Kevin
authors.initials: K
authors.lastname: McLaughlin
mesh_terms: D002170:Canada; D002405:Catheterization, Central Venous / Q000592:standards*; D057189:Checklist; D002983:Clinical Competence; D004501:Education, Medical / Q000379:methods*; D004521:Educational Measurement; D006801:Humans; D008348:Manikins; D019370:Observation; D017064:Process Assessment, Health Care; D015203:Reproducibility of Results; D014741:Video Recording
keywords: assessment; catheterization; central venous; observation; simulation; videotape recording