Internal and external validation of the NOSEP prediction score for nosocomial sepsis in neonates.
OBJECTIVE
To evaluate the performance of a scoring system (NOSEP) to predict nosocomial sepsis in neonates at the hospital where the score was developed (internal validation) and in an independent data set from other centers (external validation).


METHODS
Multiple center prospective cohort study.


METHODS
Six neonatal intensive care units from the Flanders in Belgium.


METHODS
We analyzed two groups of patients: 62 episodes of presumed nosocomial sepsis in the internal validation cohort and 93 episodes of presumed nosocomial sepsis in a multiple center external validation cohort.


METHODS
Assessment of the predictive power of the NOSEP score 24 hrs preceding sepsis workup and the patients' basic demographic characteristics and co-morbidity was performed. Diagnosis of nosocomial sepsis and the microbiology results were registered.


RESULTS
The NOSEP score's discriminative capability was very good in the internal validation (area under receiver operating characteristic curve = 0.73 +/- 0.08 [sem]). The NOSEP score performed satisfactory in the external validation (area under receiver operating characteristic curve = 0.66 +/- 0.06). The calibration capability in both validation sets as measured by goodness-of-fit tests (internal validation, p =.56; external validation, p =.48) was good. An improvement of the NOSEP score was obtained for the external centers by redefining the cut-off of the items of the NOSEP score (area under receiver operating characteristic curve for NOSEP-NEW-I = 0.71 +/- 0.05) or adding co-morbidity factors (area under receiver operating characteristic curve for NOSEP-NEW-II = 0.82 +/- 0.04), with good calibration performance (goodness-of-fit test, p >.50). Finally, the fit of the NOSEP score demonstrated no significant variation across subgroups of patients.


CONCLUSIONS
The predictive power of the original NOSEP score is very good in neonates at the original neonatal intensive care unit. In other neonatal intensive care units, its discriminatory performance is satisfactory but could be improved after modification of the variables in the model or adding additional variables. To use such a NOSEP score in other neonatal intensive care units, its accuracy has to be validated and adjusted if necessary.
Department of Pediatrics, Division of Neonatology, University Hospital of Antwerp, Antwerp, Belgium.
Ludo M
LM
Mahieu
Jozef J
JJ
De Dooy
Veerle R
VR
Cossey
Linde L
LL
Goossens
Sabine L
SL
Vrancken
Ann Y
AY
Jespers
Christina T
CT
Vandeputte
Aimé O
AO
De Muynck
D003428:Cross Infection / Q000175:diagnosis*; D005260:Female; D006305:Health Status Indicators; D006801:Humans; D007231:Infant, Newborn; D008297:Male; D011237:Predictive Value of Tests; D011446:Prospective Studies; D018805:Sepsis / Q000175:diagnosis*