Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: a clinical example.
OBJECTIVE
To illustrate the effects of different methods for handling missing data--complete case analysis, missing-indicator method, single imputation of unconditional and conditional mean, and multiple imputation (MI)--in the context of multivariable diagnostic research aiming to identify potential predictors (test results) that independently contribute to the prediction of disease presence or absence.


METHODS
We used data from 398 subjects from a prospective study on the diagnosis of pulmonary embolism. Various diagnostic predictors or tests had (varying percentages of) missing values. Per method of handling these missing values, we fitted a diagnostic prediction model using multivariable logistic regression analysis.


RESULTS
The receiver operating characteristic curve area for all diagnostic models was above 0.75. The predictors in the final models based on the complete case analysis, and after using the missing-indicator method, were very different compared to the other models. The models based on MI did not differ much from the models derived after using single conditional and unconditional mean imputation.


CONCLUSIONS
In multivariable diagnostic research complete case analysis and the use of the missing-indicator method should be avoided, even when data are missing completely at random. MI methods are known to be superior to single imputation methods. For our example study, the single imputation methods performed equally well, but this was most likely because of the low overall number of missing values.
van der Heijden
Geert J M G
GJ
Julius Center for Health Sciences and Primary Care, University Medical Center, P.O. Box 80035, 3508 GA Utrecht, The Netherlands. g.vanderheijden@umcutrecht.nl
Donders
A Rogier T
AR
Stijnen
Theo
T
Moons
Karel G M
KG
D000328:Adult; D000368:Aged; D015982:Bias; D004812:Epidemiologic Methods; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D011655:Pulmonary Embolism / Q000175:diagnosis* / Q000209:etiology; D012107:Research Design