title: Improved Prediction by Dynamic Modeling: An Exploratory Study in the Adult Cardiac Surgery Database of the Netherlands Association for Cardio-Thoracic Surgery.
abstract: BACKGROUND
  The predictive performance of static risk prediction models such as EuroSCORE deteriorates over time. We aimed to explore different methods for continuous updating of EuroSCORE (dynamic modeling) to improve risk prediction.
  
  
  RESULTS
  Data on adult cardiac surgery from 2007 to 2012 (n=95 240) were extracted from the Netherlands Association for Cardio-Thoracic Surgery database. The logistic EuroSCORE predicting in-hospital death was updated using 6 methods: recalibrating the intercept of the logistic regression model; recalibrating the intercept and joint effects of the prognostic factors; re-estimating all prognostic factor effects, re-estimating all prognostic factor effects, and applying shrinkage of the estimates; applying a test procedure to select either of these; and a Bayesian learning strategy. Models were updated with 1 or 3 years of data, in all cardiac surgery or within operation subgroups. Performance was tested in the subsequent year according to discrimination (area under the receiver operating curve, area under the curve) and calibration (calibration slope and calibration-in-the-large). Compared with the original EuroSCORE, all updating methods resulted in improved calibration-in-the-large (range -0.17 to 0.04 versus -1.13 to -0.97, ideally 0.0). Calibration slope (range 0.92-1.15) and discrimination (area under the curve range 0.83-0.87) were similar across methods. In small subgroups, such as aortic valve replacement and aortic valve replacement+coronary artery bypass grafting, extensive updating using 1 year of data led to poorer performance than using the original EuroSCORE. The choice of updating method had little effect on benchmarking results of all cardiac surgery.
  
  
  CONCLUSIONS
  Several methods for dynamic modeling may result in good discrimination and superior calibration compared with the original EuroSCORE. For large populations, all methods are appropriate. For smaller subgroups, it is recommended to use data from multiple years or a Bayesian approach.
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.). s.siregar@lumc.nl.
authors.forename: Sabrina
authors.initials: S
authors.lastname: Siregar
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.).
authors.forename: Daan
authors.initials: D
authors.lastname: Nieboer
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.).
authors.forename: Yvonne
authors.initials: Y
authors.lastname: Vergouwe
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.).
authors.forename: Michel I M
authors.initials: MI
authors.lastname: Versteegh
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.).
authors.forename: Luc
authors.initials: L
authors.lastname: Noyez
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.).
authors.forename: Alexander B A
authors.initials: AB
authors.lastname: Vonk
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.).
authors.forename: Ewout W
authors.initials: EW
authors.lastname: Steyerberg
authors.affiliation: From the Department of Cardio-Thoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands (S.S., M.I.M.V.); Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (D.N., Y.V., E.W.S.); Department of Cardio-Thoracic Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands (L.N.); Department of Cardio-Thoracic Surgery, VU Medical Center, Amsterdam, The Netherlands (A.B.A.V.); and Department of Cardio-Thoracic Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands (J.J.M.T.).
authors.forename: Johanna J M
authors.initials: JJ
authors.lastname: Takkenberg
mesh_terms: D000367:Age Factors; D019540:Area Under Curve; D001499:Bayes Theorem; D006348:Cardiac Surgical Procedures / Q000009:adverse effects / Q000401:mortality; D057225:Data Mining; D016208:Databases, Factual; D003661:Decision Support Techniques; D006801:Humans; D016015:Logistic Models; D009426:Netherlands; D017064:Process Assessment, Health Care; D012372:ROC Curve; D018570:Risk Assessment; D012307:Risk Factors; D013997:Time Factors; D016896:Treatment Outcome
keywords: Euroscore; database; epidemiology; outcome; risk prediction; statistics; surgery