title: Validation of the Patient-Reported Outcome Mortality Prediction Tool (PROMPT).
abstract: BACKGROUND
  The Patient-Reported Outcome Mortality Prediction Tool (PROMPT) estimates six-month mortality risk in elderly patients with declining health, but its external validity has not been established.
  
  
  OBJECTIVE
  To prospectively validate the PROMPT in an independent patient cohort and explore its clinical utility.
  
  
  METHODS
  The study cohort comprised a diverse sample of 467 patients aged 65 years and older. Model calibration and discrimination were assessed on the original PROMPT and in two updated models. Clinical utility of the final updated PROMPT was examined using decision curve analysis.
  
  
  RESULTS
  The validation cohort had a lower six-month mortality rate than the derivation cohort (6.9% vs. 15.0%). Discrimination was virtually unchanged (area under the curve 0.73 compared with 0.75), but calibration was suboptimal (P < 0.05 for the Hosmer-Lemeshow test). The PROMPT, therefore, was updated with a new intercept and slope parameter that significantly improved calibration (Hosmer-Lemeshow statistic of 0.66). Specificity of the PROMPT was high (92% and 97%, respectively, at the 10% and 20% mortality risk thresholds), although sensitivity was modest (53% and 44% at the corresponding thresholds), consistent with diagnostic performance in the derivation sample. Decision curve analysis demonstrated greater net benefit of the updated PROMPT than "treat all" or "treat none" strategies, especially at low to moderate risk thresholds.
  
  
  CONCLUSIONS
  The PROMPT demonstrated good discrimination but poor calibration in an independent heterogeneous clinical population. Model updating improved calibration and diagnostic performance and decision curve analysis demonstrated potential clinical utility of the PROMPT for initiating advance care planning rather than hospice referrals.
authors.affiliation: Center for Outcomes Research and Evaluation, Maine Medical Center Research Institute, Portland; Department of Family Medicine, Maine Medical Center, Portland; Geriatric Medicine, Maine Medical Center, Portland, Maine, USA. Electronic address: duartc@mmc.org.
authors.forename: Christine W
authors.initials: CW
authors.lastname: Duarte
authors.affiliation: Center for Outcomes Research and Evaluation, Maine Medical Center Research Institute, Portland; Department of Family Medicine, Maine Medical Center, Portland; Geriatric Medicine, Maine Medical Center, Portland, Maine, USA.
authors.forename: Adam W
authors.initials: AW
authors.lastname: Black
authors.affiliation: Center for Outcomes Research and Evaluation, Maine Medical Center Research Institute, Portland; Department of Family Medicine, Maine Medical Center, Portland; Geriatric Medicine, Maine Medical Center, Portland, Maine, USA.
authors.forename: Kimberly
authors.initials: K
authors.lastname: Murray
authors.affiliation: Center for Outcomes Research and Evaluation, Maine Medical Center Research Institute, Portland; Department of Family Medicine, Maine Medical Center, Portland; Geriatric Medicine, Maine Medical Center, Portland, Maine, USA.
authors.forename: Amy E
authors.initials: AE
authors.lastname: Haskins
authors.affiliation: Center for Outcomes Research and Evaluation, Maine Medical Center Research Institute, Portland; Department of Family Medicine, Maine Medical Center, Portland; Geriatric Medicine, Maine Medical Center, Portland, Maine, USA.
authors.forename: Lee
authors.initials: L
authors.lastname: Lucas
authors.affiliation: Center for Outcomes Research and Evaluation, Maine Medical Center Research Institute, Portland; Department of Family Medicine, Maine Medical Center, Portland; Geriatric Medicine, Maine Medical Center, Portland, Maine, USA.
authors.forename: Sarah
authors.initials: S
authors.lastname: Hallen
authors.affiliation: Center for Outcomes Research and Evaluation, Maine Medical Center Research Institute, Portland; Department of Family Medicine, Maine Medical Center, Portland; Geriatric Medicine, Maine Medical Center, Portland, Maine, USA.
authors.forename: Paul K J
authors.initials: PK
authors.lastname: Han
mesh_terms: D000368:Aged; D002138:Calibration; D003661:Decision Support Techniques; D059026:Diagnostic Self Evaluation; D005260:Female; D015577:Geriatric Assessment / Q000379:methods; D006801:Humans; D007297:Inpatients; D008297:Male; D063868:Patient Outcome Assessment; D011446:Prospective Studies; D012372:ROC Curve; D057566:Self Report; D012680:Sensitivity and Specificity; D016019:Survival Analysis; D013727:Terminal Care / Q000379:methods*
keywords: Predictive modeling; clinical prediction models; decision curves; end-of-life care; hospice care; net benefit