title: Validation of probabilistic predictions.
abstract: Current advances in high-speed computing and increased availability of statistical software have led to widespread use of statistical methods for the development of computerized protocols predictive of binary health outcomes. If these predictive algorithms are to be used in settings other than those for which they were developed, e.g., applied in a different geographic setting or extrapolated for use in a slightly different population, then they should be carefully validated to ensure appropriate application. Miller et al. (Stat Med. 1991) provided a comprehensive methodology for external validation of logistic prediction models, and applied these methods in a temporal validation setting. In this article, the authors emphasize how these methods can be applied to general forms of probabilistic predictions and provide several SAS macros for computation of the desired statistics.
authors.affiliation: Begenstrief Institute for Health Care, Indiana University Department of Medicine, Indianapolis.
authors.forename: M E
authors.initials: ME
authors.lastname: Miller
authors.forename: C D
authors.initials: CD
authors.lastname: Langefeld
authors.forename: W M
authors.initials: WM
authors.lastname: Tierney
authors.forename: S L
authors.initials: SL
authors.lastname: Hui
authors.forename: C J
authors.initials: CJ
authors.lastname: McDonald
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D000465:Algorithms; D001581:Benzothiadiazines; D002985:Clinical Protocols; D004232:Diuretics; D006801:Humans; D007008:Hypokalemia / Q000188:drug therapy*; D016015:Logistic Models; D008875:Middle Aged; D008954:Models, Biological; D015233:Models, Statistical; D011336:Probability; D011379:Prognosis; D015203:Reproducibility of Results; D049993:Sodium Chloride Symporter Inhibitors / Q000627:therapeutic use*; D012984:Software
chemical_list: D001581:Benzothiadiazines; D004232:Diuretics; D049993:Sodium Chloride Symporter Inhibitors