Pretest probability estimates: a pitfall to the clinical utility of evidence-based medicine?
OBJECTIVE
The Bayesian application of likelihood ratios has become incorporated into evidence-based medicine (EBM). This approach uses clinicians' pretest estimates of disease along with the results of diagnostic tests to generate individualized posttest disease probabilities for a given patient. To date, there is minimum scientific validation for the clinical application of this approach. This study is designed to evaluate variability in the initial step of this process, clinicians' estimates of pretest probability of disease, to assess whether this approach can be expected to yield consistent posttest disease estimates.


METHODS
This cross-sectional cohort study was conducted at an urban county teaching hospital by using a sample of emergency and internal medicine residents and faculty, as well as emergency department (ED) midlevel practitioners. Participants read clinical vignettes designed to raise consideration for common ED disorders and were asked to estimate the likelihood of the suggested diagnosis based on the history and physical examination findings alone. No information about laboratory results or imaging studies was provided.


RESULTS
Mean pretest probability estimates of disease ranged from 42% (95% confidence interval [95% CI] = 36.6% to 47.4%) to 77% (95% CI = 72.9% to 81.1%). The smallest difference in pretest probability magnitude for a single vignette was 70% (range 30-100%; interquartile range [IQR] 64-80%), whereas the largest was 95% (range 3-98%; IQR 30-60%).


CONCLUSIONS
Wide variability in clinicians' pretest probability estimates of disease may present a possible concern about decision-making models based on Bayes' theorem, because it may ultimately yield inconsistent posttest disease estimates.
Phelps
Molly A
MA
Department of Emergency Medicine, Alameda County Medical Center-Highland Campus, Oakland, CA 94602, USA.
Levitt
M Andrew
MA
D001499:Bayes Theorem; D002140:California; D015331:Cohort Studies; D003430:Cross-Sectional Studies; D004635:Emergency Medicine / Q000193:education / Q000706:statistics & numerical data; D019317:Evidence-Based Medicine / Q000379:methods* / Q000706:statistics & numerical data; D006801:Humans; D007396:Internship and Residency / Q000379:methods / Q000706:statistics & numerical data; D016013:Likelihood Functions; D011336:Probability