title: Validation, updating and impact of clinical prediction rules: a review.
abstract: OBJECTIVE
  To provide an overview of the research steps that need to follow the development of diagnostic or prognostic prediction rules. These steps include validity assessment, updating (if necessary), and impact assessment of clinical prediction rules.
  
  
  METHODS
  Narrative review covering methodological and empirical prediction studies from primary and secondary care.
  
  
  RESULTS
  In general, three types of validation of previously developed prediction rules can be distinguished: temporal, geographical, and domain validations. In case of poor validation, the validation data can be used to update or adjust the previously developed prediction rule to the new circumstances. These update methods differ in extensiveness, with the easiest method a change in model intercept to the outcome occurrence at hand. Prediction rules -- with or without updating -- showing good performance in (various) validation studies may subsequently be subjected to an impact study, to demonstrate whether they change physicians' decisions, improve clinically relevant process parameters, patient outcome, or reduce costs. Finally, whether a prediction rule is implemented successfully in clinical practice depends on several potential barriers to the use of the rule.
  
  
  CONCLUSIONS
  The development of a diagnostic or prognostic prediction rule is just a first step. We reviewed important aspects of the subsequent steps in prediction research.
authors.affiliation: Julius Center for Health Sciences and Primary care, University Medical Center Utrecht, Utrecht, The Netherlands.
authors.forename: D B
authors.initials: DB
authors.lastname: Toll
authors.forename: K J M
authors.initials: KJ
authors.lastname: Janssen
authors.forename: Y
authors.initials: Y
authors.lastname: Vergouwe
authors.forename: K G M
authors.initials: KG
authors.lastname: Moons
mesh_terms: D015982:Bias; D003661:Decision Support Techniques; D004059:Diffusion of Innovation; D019317:Evidence-Based Medicine / Q000379:methods; D006801:Humans; D016920:Meningitis, Bacterial / Q000175:diagnosis; D011237:Predictive Value of Tests; D011379:Prognosis; D015203:Reproducibility of Results