NIHSS training and certification using a new digital video disk is reliable.
OBJECTIVE
NIH Stroke Scale certification is required for participation in modern stroke clinical trials and as part of good clinical care in stroke centers. The existing training and certification videotapes, however, are more than 10 years old and do not contain an adequate balance of patient findings.


METHODS
After producing a new NIHSS training and demonstration DVD, we selected 18 patients representing all possible scores on 15 scale items for a new certification DVD. Patients were divided into 3 certification groups of 6 patients each, balanced for lesion side, distribution of scale item findings, and total score. We sought to measure interrater reliability of the certification DVD using methodology previously published for the original videotapes. Raters were recruited from 3 experienced stroke centers. Each rater watched the new training DVD and then evaluated one of the 3 certification groups.


RESULTS
Responses were received from 112 raters: 26.2% of all responses came from stroke nurses, 34.1% from emergency departments/other physicians, and 39.6% from neurologists. One half (50%) of raters were previously NIHSS-certified. Item responses were tabulated, scoring performed as previously published, and agreement measured with unweighted kappa coefficients for individual items and an intraclass correlation coefficient for the overall score. kappa ranged from 0.21+/-0.05 (ataxia) to 0.92+/-0.09 (LOC-C questions). Of 15 items, 2 showed poor, 11 moderate, and 2 excellent agreement based on kappa scores. The intraclass correlation coefficient for total score was 0.94 (95% confidence interval, 0.84 to 1.00). Reliability scores were similar among specialists and centers, and there were no differences between nurses and physicians. kappa scores trended higher among raters previously certified.


CONCLUSIONS
These certification DVDs are reliable for NIHSS certification, and scoring sheets have been posted on a web site for real-time, online certification.
Lyden
Patrick
P
Department of Neurosciences, UCSD School of Medicine, and Neurology, Veterans Administration Medical Center, San Diego, California, USA. plyden@ucsd.edu
Raman
Rema
R
Liu
Lin
L
Grotta
James
J
Broderick
Joseph
J
Olson
Scott
S
Shaw
Sandi
S
Spilker
Judith
J
Meyer
Brett
B
Emr
Marian
M
Warren
Margo
M
Marler
John
J
D002561:Cerebrovascular Disorders / Q000175:diagnosis; D002568:Certification; D002986:Clinical Trials as Topic; D004185:Disability Evaluation; D006801:Humans; D009316:National Institutes of Health (U.S.); D009462:Neurology / Q000193:education* / Q000592:standards*; D009726:Nurses; D015588:Observer Variation; D010820:Physicians; D012046:Rehabilitation / Q000193:education*; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D020521:Stroke / Q000175:diagnosis*; D013997:Time Factors; D014481:United States; D014743:Videotape Recording