Prediction of mortality in an Indian intensive care unit. Comparison between APACHE II and artificial neural networks.
OBJECTIVE
To compare hospital outcome prediction using an artificial neural network model, built on an Indian data set, with the APACHE II (Acute Physiology and Chronic Health Evaluation II) logistic regression model.


METHODS
Analysis of a database containing prospectively collected data.


METHODS
Medical-neurological ICU of a university hospital in Mumbai, India.


METHODS
Two thousand sixty-two consecutive admissions between 1996 and 1998.


METHODS
None.


RESULTS
The 22 variables used to obtain day-1 APACHE II score and risk of death were recorded. Data from 1,962 patients were used to train the neural network using a back-propagation algorithm. Data from the remaining 1,000 patients were used for testing this model and comparing it with APACHE II. There were 337 deaths in these 1,000 patients; APACHE II predicted 246 deaths while the neural network predicted 336 deaths. Calibration, assessed by the Hosmer-Lemeshow statistic, was better with the neural network (H=22.4) than with APACHE II (H=123.5) and so was discrimination (area under receiver operating characteristic curve =0.87 versus 0.77, p=0.002). Analysis of information gain due to each of the 22 variables revealed that the neural network could predict outcome using only 15 variables. A new model using these 15 variables predicted 335 deaths, had calibration (H=27.7) and discrimination (area under receiver operating characteristic curve =0.88) which was comparable to the 22-variable model (p=0.87) and superior to the APACHE II equation (p<0.001).


CONCLUSIONS
Artificial neural networks, trained on Indian patient data, used fewer variables and yet outperformed the APACHE II system in predicting hospital outcome.
Nimgaonkar
Ashish
A
Children's Hospital Informatics Program, Ender's Building, 5th Floor, 320 Longwood Avenue, Boston, Massachusetts, USA. ashish@chip.org.|Division of Health Sciences and Technology, Harvard University and MIT, Cambridge, Massachusetts, USA. ashish@chip.org.|School of Biomedical Engineering, Indian Institute of Technology, Powai, Mumbai, India. ashish@chip.org.
Karnad
Dilip R
DR
Medical Intensive Care Unit, Department of Medicine, KEM Hospital, Parel, Mumbai, India.
Sudarshan
S
S
Department of Computer Science and Engineering, Indian Institute of Technology, Powai, Mumbai, India.
Ohno-Machado
Lucila
L
Division of Health Sciences and Technology, Harvard University and MIT, Cambridge, Massachusetts, USA.|Decision Systems Group, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Kohane
Isaac
I
Children's Hospital Informatics Program, Ender's Building, 5th Floor, 320 Longwood Avenue, Boston, Massachusetts, USA.|Division of Health Sciences and Technology, Harvard University and MIT, Cambridge, Massachusetts, USA.
D018806:APACHE; D000293:Adolescent; D000328:Adult; D005260:Female; D017052:Hospital Mortality / Q000639:trends*; D006801:Humans; D007194:India; D007362:Intensive Care Units / Q000706:statistics & numerical data*; D016015:Logistic Models; D008297:Male; D008875:Middle Aged; D011336:Probability; D011446:Prospective Studies