A general, prediction error-based criterion for selecting model complexity for high-dimensional survival models.
When fitting predictive survival models to high-dimensional data, an adequate criterion for selecting model complexity is needed to avoid overfitting. The complexity parameter is typically selected by the predictive partial log-likelihood (PLL) estimated via cross-validation. As an alternative criterion, we propose a relative version of the integrated prediction error curve (IPEC), which can be stably estimated via bootstrap resampling. The IPEC has the advantage of being applicable for models and fitting techniques where the PLL is not available. To investigate the performance of this new criterion, a simulation study is carried out, mimicking microarray survival data. Additionally, model selection by predictive PLL, estimated via bootstrap resampling instead of cross-validation, is examined. It is seen that this mostly results in similar prediction performance of the selected models, compared to estimates based on cross-validation. Model selection by bootstrap estimates of the IPEC performs about as well as selection by cross-validation estimates of the PLL. Therefore, it is expected to be a reasonable alternative in cases where there is no PLL. Similar results are seen in the analysis of a microarray survival data set from patients with diffuse large-B-cell lymphoma.
Porzelius
Christine
C
Institute of Medical Biometry and Medical Informatics, University Medical Center Freiburg, 79104 Freiburg, Germany. cp@imbi.uni-freiburg.de
Schumacher
Martin
M
Binder
Harald
H
D015982:Bias; D014408:Biomarkers, Tumor / Q000032:analysis; D056808:Biostatistics; D003198:Computer Simulation / Q000706:statistics & numerical data; D006801:Humans; D016013:Likelihood Functions; D016403:Lymphoma, Large B-Cell, Diffuse / Q000401:mortality; D015233:Models, Statistical; D015999:Multivariate Analysis; D016019:Survival Analysis
D014408:Biomarkers, Tumor