title: Spine adverse events severity system: content validation and interobserver reliability assessment.
abstract: METHODS
  A prospective validation study, preliminary single-center report.
  
  
  OBJECTIVE
  The purpose of this study was to assess the content validity and interobserver reliability of a simple severity classification system for adverse events (AEs) associated with spinal surgery.
  
  
  BACKGROUND
  In the surgical literature what is defined as an AE, the severity of an AE, and the reporting of AEs are variable. Consequently, valid comparison of AEs within or among specialties or surgical centers for the same or different procedures is often impossible.
  
  
  METHODS
  Since 2002, a Spine Adverse Events Severity system (SAVES) has been locally developed and prospectively used. AEs were graded as I (requires none/minimal treatment, minimal effect [<1-2 days] on length of stay [LOS]), II (requires treatment and/or increases LOS [3-7 days] with no long-term sequelae), III (requires treatment and/or increased LOS [>7 days] with long-term sequelae [>6 months]), and IV (death). Content validity of the grading system was assessed using the hospital chart abstraction (current defacto gold standard) compared with the SAVES from 200 randomly selected patients. Interobserver reliability was assessed in consecutive operative cases for 1 spine surgeon during a 1-year period (2006) using 3 raters (staff surgeon, fellow, and/or resident).
  
  
  RESULTS
  The prospectively administered form reported a higher number of surgical AEs (n = 43 vs. n = 30) and a similar number of medical AEs (n = 31 vs. n = 27). Compared with the chart, the AE form displayed substantial agreement for number (70%; weighted Kappa [wK] = 0.60) and type (75%; wK = 0.67) of AE. The interobserver reliability was near perfect (kappa = 0.8) for the actual grade of AE and moderate (kappa = 0.5) for the criteria behind the grading (i.e., clinical effect of the AE or the effect of the AE on LOS or both).
  
  
  CONCLUSIONS
  The result of this study demonstrates improved capture of surgical AEs using SAVES. Excellent interobserver reliability between surgeons at different level of training was demonstrated with minimal education or training regarding the use of SAVES.
authors.affiliation: Division of Orthopaedic and Neurosurgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada. raja.rampersaud@uhn.on.ca
authors.forename: Yoga Raja
authors.initials: YR
authors.lastname: Rampersaud
authors.forename: Mary Ann
authors.initials: MA
authors.lastname: Neary
authors.forename: Kevin
authors.initials: K
authors.lastname: White
mesh_terms: D006801:Humans; D008499:Medical Records; D015588:Observer Variation; D019637:Orthopedic Procedures / Q000009:adverse effects*; D017063:Outcome Assessment, Health Care / Q000592:standards*; D011446:Prospective Studies; D015203:Reproducibility of Results; D013131:Spine / Q000601:surgery*