Correlation between clinicians-assigned weights to findings and their diagnostic odd ratio; case of congestive heart failure.
BACKGROUND
Incorrect estimation of pretest probability and misinterpretation of test results can change post-test probability in medical decision making. The aim of this study was to evaluate how physicians assess weight of findings of congestive heart failure (CHF) and how much their estimation is correlated with findings' Diagnostic Odd Ratio (DOR).


METHODS
The participants were asked to answer a questionnaire based on a scenario of a patient having dyspnea. Eighteen findings in 3 categories including: history, examination and radiographic findings were inserted along a column and a row as a matrix. The respondents had to compare each finding in the column with all other findings in the row and insert a mark in boxes below the findings of the row that had greater weight compared to the finding in the column. The weight of each finding was considered as total number of "marked boxes" in front of that finding. DOR of findings was calculated using their positive and negative likelihood ratios (LRs) based on current best evidence. Findings ranked in the order of their DOR and were compared with the ranking in the order of participants-assigned weights. We examined correlation between average weights assigned by physicians and DOR of findings. In subgroup analysis correlations between average weights assigned by physicians and DOR of history, examination and radiographic findings were examined.


RESULTS
Seventy five physicians completed the questionnaire. Correlation between ranking in the order of findings' DOR and ranking in the order of clinicians-assigned weights was significant (p-value = 0.005 r = 0.64). In contrast correlations between participants-assigned weights and DOR of history, examination and radiographic findings were positive but non- significant (r = 0.181, p-value = 0.7, r = 0.343, p-value = 0.506 and r = 0.219, p-value = 0.723 respectively).


CONCLUSIONS
Our result show that although correlation between clinicians-assigned weights and DOR of entire findings was significant, correlations between clinicians-assigned weights to the different categories of findings and their DOR were not significant. Reevaluating probabilistic reasoning by emphasis on using LRs can make pretest probability estimating and interpretation of test results more objective and would ultimate in more precise and homogenous post-test probabilities.
Evidence-Based Medicine & Critical Thinking Working Team, Endocrinology and Metabolism Research Institute, Tehran University of Medical Sciences, Tehran, Iran.
Akbar
A
Soltani
Endocrinology and Metabolism Research Center, Endocrinology and Metabolism Clinical Sciences Institute, Tehran University of Medical Sciences, Tehran, Iran.
Farzane
F
Saeidifard
Endocrinology and Metabolism Clinical Sciences Institute of Tehran University of medical sciences, EMRI, Tehran, Iran.
Abbasali
A
Keshtkar
Radiology Department of Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran.
Fatemeh
F
Shakki Katouli
Congestive heart failure; Evidence based medicine; Likelihood ratio
Am J Med. 2008 May;121(5 Suppl):S2-23
18440350
Ann Emerg Med. 2008 Jan;51(1):87-90
18175378
Lancet. 2005 Apr 23-29;365(9469):1500-5
15850636
QJM. 2003 Oct;96(10):763-9
14500863
BMC Fam Pract. 2010 Feb 16;11:13
20158908
Acad Emerg Med. 2004 Jun;11(6):692-4
15175211
J Clin Epidemiol. 2005 Nov;58(11):1211-6
16223666
Acad Med. 2002 Oct;77(10):981-92
12377672
J Clin Epidemiol. 2003 Nov;56(11):1129-35
14615004
J Coll Physicians Surg Pak. 2011 Sep;21(9):548-52
21914412
Arch Intern Med. 2005 Jul 11;165(13):1493-9
16009864
BMJ. 2004 Jul 17;329(7458):168-9
15258077
BMJ. 2002 Mar 23;324(7339):729-32
11909793
JAMA. 1994 Mar 2;271(9):703-7
8309035
J Am Dent Assoc. 2010 Jun;141(6):656-66
20516095
Int J Med Inform. 1998 Aug-Sep;51(2-3):91-105
9794326
Ann Saudi Med. 2006 May-Jun;26(3):211-5
16861864
Med J Aust. 2004 May 3;180(9):449-54
15115422
Med Decis Making. 1986 Oct-Dec;6(4):216-23
3773651
Acta Paediatr. 2007 Apr;96(4):487-91
17306009
Ann Emerg Med. 2006 May;47(5):447
16631984
Acad Med. 2003 Aug;78(8):775-80
12915363
J Exp Psychol Gen. 1991 Sep;120(3):278-87
1836491
Arch Intern Med. 1981 Dec;141(13):1831-7
7032440
Med Decis Making. 2009 Jan-Feb;29(1):116-24
18812583
J Cancer Educ. 1993 Winter;8(4):297-307
8186081
J Gen Intern Med. 2000 Mar;15(3):204-6
10718903