title: Sequential testing approach as an efficient and easier alternative for the validation of new predictive technologies in the clinic.
abstract: OBJECTIVE
  When clinicians contemplate the use of a new predictive technology in their practice, such as a nomogram, there is always a question of whether the new test is beneficial to their own clinical population. Unfortunately, traditional validation methods require a large number of subjects for validation testing and delay the decision-making process. We present an efficient and easy-to-use method based on the concept of sequential data analysis.
  
  
  METHODS
  We illustrate with an example determining the validity of a technology for predicting Gleason score upgrading from biopsy to postprostatectomy (the Chun nomogram) in a clinical population different from the one used to initially validate the technology. Clinical data required by the Chun nomogram were available from 201 patients from the Cooperative Prostate Cancer Tissue Resource.
  
  
  RESULTS
  Of 124 patients predicted by the Chun nomogram to have an upgrading event, 47 actually did. The positive predictive value (PPV) of the model was therefore 38% and significantly (P < .05) less than the value of 80% which we considered to be the smallest clinically useful PPV in this situation. Had the sequential methods introduced in this article been employed prospectively in this cohort, the same conclusion would have been reached using data from only the first 15 patients.
  
  
  CONCLUSIONS
  In-clinic validation of predictive technologies will help the clinician adopt truly beneficial technologies and avoid the adoption of technologies which provide no significant benefit to their local patient population. For this task, sequential methods offer clear advantages.
authors.affiliation: Division of Epidemiology and Biostatistics, School of Public Health, 1603 W Taylor St, Chicago, IL 60612, USA. cbeam@uic.edu
authors.forename: Craig A
authors.initials: CA
authors.lastname: Beam
authors.forename: Weihua
authors.initials: W
authors.lastname: Gao
authors.forename: Virgilia
authors.initials: V
authors.lastname: Macias
authors.forename: Weimin
authors.initials: W
authors.lastname: Liang
authors.forename: André
authors.initials: A
authors.lastname: Kajdacsy Balla
mesh_terms: D003661:Decision Support Techniques; D006801:Humans; D008297:Male; D015233:Models, Statistical; D009369:Neoplasms / Q000473:pathology* / Q000601:surgery; D049451:Nomograms; D011237:Predictive Value of Tests; D011379:Prognosis; D011468:Prostatectomy; D011471:Prostatic Neoplasms / Q000473:pathology; D015203:Reproducibility of Results; D012107:Research Design; D013673:Technology Assessment, Biomedical / Q000706:statistics & numerical data*