title: Recorded criteria as a "gold standard" for sensitivity and specificity estimates of surveillance of nosocomial infection: a novel method to measure job performance.
abstract: OBJECTIVE
  To compare the accuracy of infection control practitioners' (ICPs') classifications of operative site infection in Florida Consortium for Infection Control (FCIC) hospitals, in two time periods, 1990 to 1991 and 1991 to 1992, and to estimate the effect of duration of surveillance experience on that accuracy.
  
  
  METHODS
  Medical record reviewers examined records of all patients classified by an ICP as infected, to distinguish false-positives from true infections based on evidence of standard infection criteria and the ICP's contemporaneous clinical observations. Reviewers also examined a random sample of 100 records from patients classified as noninfected for evidence of undetected infections (false-negatives). These observations permitted estimates of the sensitivity and specificity of each ICP's classification of infection status.
  
  
  METHODS
  Fourteen FCIC community hospitals at which performance of 16 ICPs was monitored.
  
  
  RESULTS
  There was a strong linear trend relating increasing sensitivity to numbers of years of ICP surveillance experience (P < .001). For ICPs with < 4 years of experience, satisfactory sensitivity (> or = 80%) was reached in only one of 10 ICP-years of observation. For ICPs with > or = 4 years' experience, satisfactory sensitivity was achieved for 14 of 18 person-years (P = .001). Estimated specificity was 97% to 100% for all ICP-years observed.
  
  
  CONCLUSIONS
  ICPs with < 4 years of surveillance experience in FCIC community hospitals rarely achieved a satisfactory sensitivity estimate, whereas ICPs with > or = 4 years' experience generally did. Monitoring ICP surveillance accuracy through retrospective medical record audits offers an objective approach to evaluating ICP performance and to interpreting infection rates at different hospitals.
authors.affiliation: Florida Consortium for Infection Control, University of Miami School of Medicine, South Miami, Florida, USA.
authors.forename: N J
authors.initials: NJ
authors.lastname: Ehrenkranz
authors.forename: J M
authors.initials: JM
authors.lastname: Shultz
authors.forename: E L
authors.initials: EL
authors.lastname: Richter
mesh_terms: D016022:Case-Control Studies; D003428:Cross Infection / Q000517:prevention & control*; D004650:Employee Performance Appraisal / Q000379:methods*; D004651:Employment; D005431:Florida; D006801:Humans; D017053:Infection Control / Q000592:standards*; D016014:Linear Models; D008485:Medical Audit; D015588:Observer Variation; D011159:Population Surveillance; D011897:Random Allocation; D012015:Reference Standards; D012189:Retrospective Studies; D012680:Sensitivity and Specificity; D013997:Time Factors