title: NIHSS training and certification using a new digital video disk is reliable.
abstract: OBJECTIVE
  NIH Stroke Scale certification is required for participation in modern stroke clinical trials and as part of good clinical care in stroke centers. The existing training and certification videotapes, however, are more than 10 years old and do not contain an adequate balance of patient findings.
  
  
  METHODS
  After producing a new NIHSS training and demonstration DVD, we selected 18 patients representing all possible scores on 15 scale items for a new certification DVD. Patients were divided into 3 certification groups of 6 patients each, balanced for lesion side, distribution of scale item findings, and total score. We sought to measure interrater reliability of the certification DVD using methodology previously published for the original videotapes. Raters were recruited from 3 experienced stroke centers. Each rater watched the new training DVD and then evaluated one of the 3 certification groups.
  
  
  RESULTS
  Responses were received from 112 raters: 26.2% of all responses came from stroke nurses, 34.1% from emergency departments/other physicians, and 39.6% from neurologists. One half (50%) of raters were previously NIHSS-certified. Item responses were tabulated, scoring performed as previously published, and agreement measured with unweighted kappa coefficients for individual items and an intraclass correlation coefficient for the overall score. kappa ranged from 0.21+/-0.05 (ataxia) to 0.92+/-0.09 (LOC-C questions). Of 15 items, 2 showed poor, 11 moderate, and 2 excellent agreement based on kappa scores. The intraclass correlation coefficient for total score was 0.94 (95% confidence interval, 0.84 to 1.00). Reliability scores were similar among specialists and centers, and there were no differences between nurses and physicians. kappa scores trended higher among raters previously certified.
  
  
  CONCLUSIONS
  These certification DVDs are reliable for NIHSS certification, and scoring sheets have been posted on a web site for real-time, online certification.
authors.affiliation: Department of Neurosciences, UCSD School of Medicine, and Neurology, Veterans Administration Medical Center, San Diego, California, USA. plyden@ucsd.edu
authors.forename: Patrick
authors.initials: P
authors.lastname: Lyden
authors.forename: Rema
authors.initials: R
authors.lastname: Raman
authors.forename: Lin
authors.initials: L
authors.lastname: Liu
authors.forename: James
authors.initials: J
authors.lastname: Grotta
authors.forename: Joseph
authors.initials: J
authors.lastname: Broderick
authors.forename: Scott
authors.initials: S
authors.lastname: Olson
authors.forename: Sandi
authors.initials: S
authors.lastname: Shaw
authors.forename: Judith
authors.initials: J
authors.lastname: Spilker
authors.forename: Brett
authors.initials: B
authors.lastname: Meyer
authors.forename: Marian
authors.initials: M
authors.lastname: Emr
authors.forename: Margo
authors.initials: M
authors.lastname: Warren
authors.forename: John
authors.initials: J
authors.lastname: Marler
mesh_terms: D002561:Cerebrovascular Disorders / Q000175:diagnosis; D002568:Certification; D002986:Clinical Trials as Topic; D004185:Disability Evaluation; D006801:Humans; D009316:National Institutes of Health (U.S.); D009462:Neurology / Q000193:education* / Q000592:standards*; D009726:Nurses; D015588:Observer Variation; D010820:Physicians; D012046:Rehabilitation / Q000193:education*; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D020521:Stroke / Q000175:diagnosis*; D013997:Time Factors; D014481:United States; D014743:Videotape Recording