Validity versus feasibility for quality of care indicators: expert panel results from the MI-Plus study.
BACKGROUND
In the choice and definition of quality of care indicators, there may be an inherent tension between feasibility, generally enhanced by simplicity, and validity, generally enhanced by accounting for clinical complexity.


OBJECTIVE
To study the process of developing quality indicators using an expert panel and analyze the tension between feasibility and validity.


METHODS
A multidisciplinary panel of 12 expert physicians was engaged in two rounds of modified Delphi process to refine and choose a smaller subset from 36 indicators; these were developed by a research team studying the quality of care in ambulatory post-myocardial infarction patients with co-morbidities. We studied the correlation between validity/feasibility ranks provided by the expert panel. The correlation between the quality indicators ranks on validity and feasibility scale and variance of experts' responses was also individually studied.


RESULTS
Ten of 36 indicators were ranked in both the highest validity and feasibility groups. The strength of association between validity and feasibility of indicators measured by Kendall tau-b was 0.65. In terms of validity, a strong negative correlation was observed between the ranks of indicators and the variability in expert panel responses (Spearman's rho, r = -0.85). A weak correlation was found between the ranks of feasibility and the variability of expert panel responses (Spearman's rho, r = 0.23).


CONCLUSIONS
There was an unexpectedly strong association between the validity and feasibility of quality indicators, with a high level of consensus among experts regarding both feasibility and validity for indicators rated highly on each of these attributes.
Peña
Adolfo
A
C-SMART Center for Surgical, Medical Acute Care Research and Transitions, Birmingham VA Medical Center, 700 South 19th Street, Birmingham, AL 35233, USA. adolfope@uab.edu
Virk
Sandeep S
SS
Shewchuk
Richard M
RM
Allison
Jeroan J
JJ
Williams
O Dale
OD
Kiefe
Catarina I
CI
D003697:Delphi Technique; D019983:Guideline Adherence; D006801:Humans; D009203:Myocardial Infarction / Q000628:therapy; D017410:Practice Guidelines as Topic; D019984:Quality Indicators, Health Care / Q000458:organization & administration; D011787:Quality of Health Care / Q000458:organization & administration*; D016032:Randomized Controlled Trials as Topic; D015203:Reproducibility of Results
BMJ. 2003 Apr 12;326(7393):816-9
12689983
Int J Qual Health Care. 2001 Dec;13(6):489-96
11769752
Mov Disord. 2004 Feb;19(2):136-50
14978668
Arthritis Rheum. 2004 Apr 15;51(2):193-202
15077259
Int J Qual Health Care. 2003 Dec;15(6):523-30
14660535
Med Care. 2001 Aug;39(8 Suppl 2):II46-54
11583121
Clin Infect Dis. 2008 Mar 1;46(5):703-11
18230045
Arthritis Rheum. 2004 Mar;50(3):937-43
15022337
Neurology. 2007 Nov 20;69(21):2020-7
17928576
Ann Fam Med. 2009 Jan-Feb;7(1):71-9
19139452
Stroke. 2001 Sep;32(9):2058-74
11546898
J Am Med Dir Assoc. 2004 Sep-Oct;5(5):297-309
15357887
Health Aff (Millwood). 2005 Jan-Feb;24(1):18-28
15647212
CMAJ. 2008 Oct 21;179(9):909-15
18936456
J Public Health Med. 1998 Dec;20(4):414-21
9923948
JAMA. 2000 Dec 6;284(21):2748-54
11105180
Ann Intern Med. 2001 Oct 16;135(8 Pt 2):647-52
11601947
Health Aff (Millwood). 2007 Mar-Apr;26(2):w119-21
17259192