title: Bayesian clinical reasoning: does intuitive estimation of likelihood ratios on an ordinal scale outperform estimation of sensitivities and specificities?
abstract: BACKGROUND
  Bedside use of Bayes' theorem for estimating probabilities of diseases is cumbersome. An alternative approach based on five categories of powers of tests from 'useless' to 'very strong' has been proposed. The performance of clinicians using it was assessed.
  
  
  METHODS
  Fifty clinicians attending a course of tropical medicine estimated powers of tests and post-test probabilities using the classical vs. the categorical Bayesian approach. The estimation of post-test probability was assessed for real and dummy diseases in order to avoid the bias of previous knowledge. Accuracy of answers was measured by the difference with reference values obtained from an expert system (Kabisa).
  
  
  RESULTS
  Clinicians estimated positive likelihood ratios (LRs) a median of -1.07 log(10) lower than Kabisa [interquartile range (IQR): -1.47; -0.80] when derived classically and -0.17 (IQR: -0.42; +0.04) when estimated categorically (P < 0.001). For negative LRs the median was +0.39 log(10) higher (IQR: +0.71; +0.08) when derived classically and -0.18 log(10) lower (IQR: +0.03; -0.36) when estimated categorically (P < 0.001). Twenty (40%) disclosed not being able to calculate post-test probabilities using sensitivities and specificities. Regardless the approach post-test probabilities were overestimated both for real and dummy diseases [respectively +1.23 log(10) (IQR: +0,67; +2.08) and +2.03 log(10) (IQR: +0.49; +2.42)] (P = 0277), but the range was wider for the latter (P = 0.001).
  
  
  CONCLUSIONS
  Participants were more accurate in estimating powers with a categorical approach than with sensitivities and specificities. Post-test probabilities were overestimated with both approaches. Knowledge of the disease did not influence the estimation of post-test probabilities. A categorical approach might be an interesting instructional tool, but the effect of training with this approach needs assessment.
authors.affiliation: Centro de Epidemiología Comunitaria y Medicina Tropical (CECOMET), Esmeraldas, Ecuador. jmoreira@itg.be
authors.forename: Juan
authors.initials: J
authors.lastname: Moreira
authors.forename: Zeno
authors.initials: Z
authors.lastname: Bisoffi
authors.forename: Alberto
authors.initials: A
authors.lastname: Narváez
authors.forename: Jef
authors.initials: J
authors.lastname: Van den Ende
mesh_terms: D000328:Adult; D000349:Africa / Q000453:epidemiology; D000704:Analysis of Variance; D001064:Appendicitis / Q000175:diagnosis / Q000453:epidemiology; D001499:Bayes Theorem; D001530:Belgium; D002983:Clinical Competence / Q000592:standards*; D019937:Diagnostic Techniques and Procedures / Q000592:standards*; D004813:Epidemiology / Q000193:education; D005103:Expert Systems; D005260:Female; D006801:Humans; D019545:Intuition; D016013:Likelihood Functions; D008297:Male; D011247:Pregnancy; D011271:Pregnancy, Ectopic / Q000175:diagnosis / Q000453:epidemiology; D011336:Probability; D011655:Pulmonary Embolism / Q000175:diagnosis / Q000453:epidemiology; D012680:Sensitivity and Specificity; D012984:Software; D018709:Statistics, Nonparametric; D011795:Surveys and Questionnaires; D014330:Tropical Medicine / Q000193:education / Q000379:methods; D014397:Tuberculosis, Pulmonary / Q000175:diagnosis / Q000453:epidemiology