title: Validity versus feasibility for quality of care indicators: expert panel results from the MI-Plus study.
abstract: BACKGROUND
  In the choice and definition of quality of care indicators, there may be an inherent tension between feasibility, generally enhanced by simplicity, and validity, generally enhanced by accounting for clinical complexity.
  
  
  OBJECTIVE
  To study the process of developing quality indicators using an expert panel and analyze the tension between feasibility and validity.
  
  
  METHODS
  A multidisciplinary panel of 12 expert physicians was engaged in two rounds of modified Delphi process to refine and choose a smaller subset from 36 indicators; these were developed by a research team studying the quality of care in ambulatory post-myocardial infarction patients with co-morbidities. We studied the correlation between validity/feasibility ranks provided by the expert panel. The correlation between the quality indicators ranks on validity and feasibility scale and variance of experts' responses was also individually studied.
  
  
  RESULTS
  Ten of 36 indicators were ranked in both the highest validity and feasibility groups. The strength of association between validity and feasibility of indicators measured by Kendall tau-b was 0.65. In terms of validity, a strong negative correlation was observed between the ranks of indicators and the variability in expert panel responses (Spearman's rho, r = -0.85). A weak correlation was found between the ranks of feasibility and the variability of expert panel responses (Spearman's rho, r = 0.23).
  
  
  CONCLUSIONS
  There was an unexpectedly strong association between the validity and feasibility of quality indicators, with a high level of consensus among experts regarding both feasibility and validity for indicators rated highly on each of these attributes.
authors.affiliation: C-SMART Center for Surgical, Medical Acute Care Research and Transitions, Birmingham VA Medical Center, 700 South 19th Street, Birmingham, AL 35233, USA. adolfope@uab.edu
authors.forename: Adolfo
authors.initials: A
authors.lastname: Peña
authors.forename: Sandeep S
authors.initials: SS
authors.lastname: Virk
authors.forename: Richard M
authors.initials: RM
authors.lastname: Shewchuk
authors.forename: Jeroan J
authors.initials: JJ
authors.lastname: Allison
authors.forename: O Dale
authors.initials: OD
authors.lastname: Williams
authors.forename: Catarina I
authors.initials: CI
authors.lastname: Kiefe
mesh_terms: D003697:Delphi Technique; D019983:Guideline Adherence; D006801:Humans; D009203:Myocardial Infarction / Q000628:therapy; D017410:Practice Guidelines as Topic; D019984:Quality Indicators, Health Care / Q000458:organization & administration; D011787:Quality of Health Care / Q000458:organization & administration*; D016032:Randomized Controlled Trials as Topic; D015203:Reproducibility of Results
references.citation: BMJ. 2003 Apr 12;326(7393):816-9
references.pmid: 12689983
references.citation: Int J Qual Health Care. 2001 Dec;13(6):489-96
references.pmid: 11769752
references.citation: Mov Disord. 2004 Feb;19(2):136-50
references.pmid: 14978668
references.citation: Arthritis Rheum. 2004 Apr 15;51(2):193-202
references.pmid: 15077259
references.citation: Int J Qual Health Care. 2003 Dec;15(6):523-30
references.pmid: 14660535
references.citation: Med Care. 2001 Aug;39(8 Suppl 2):II46-54
references.pmid: 11583121
references.citation: Clin Infect Dis. 2008 Mar 1;46(5):703-11
references.pmid: 18230045
references.citation: Arthritis Rheum. 2004 Mar;50(3):937-43
references.pmid: 15022337
references.citation: Neurology. 2007 Nov 20;69(21):2020-7
references.pmid: 17928576
references.citation: Ann Fam Med. 2009 Jan-Feb;7(1):71-9
references.pmid: 19139452
references.citation: Stroke. 2001 Sep;32(9):2058-74
references.pmid: 11546898
references.citation: J Am Med Dir Assoc. 2004 Sep-Oct;5(5):297-309
references.pmid: 15357887
references.citation: Health Aff (Millwood). 2005 Jan-Feb;24(1):18-28
references.pmid: 15647212
references.citation: CMAJ. 2008 Oct 21;179(9):909-15
references.pmid: 18936456
references.citation: J Public Health Med. 1998 Dec;20(4):414-21
references.pmid: 9923948
references.citation: JAMA. 2000 Dec 6;284(21):2748-54
references.pmid: 11105180
references.citation: Ann Intern Med. 2001 Oct 16;135(8 Pt 2):647-52
references.pmid: 11601947
references.citation: Health Aff (Millwood). 2007 Mar-Apr;26(2):w119-21
references.pmid: 17259192