Consistency of performance indicators for cardiovascular risk management across procedures and panels.
BACKGROUND
Delphi procedures are frequently used to develop performance indicators, but little is known about the validity of this method. We aimed to examine the consistency of indicator selection across different procedures and across different panels.


METHODS
Analysis of three indicator set development procedures: the EPA Cardio project, which used international GP panels; the UniRap project, a Dutch GP indicator project; and the Vitale Vaten project, which used a national multidisciplinary health professional panel and a stakeholder panel.


RESULTS
With respect to clinical indicators, consistency between procedures varied according to the origin of the indicators. In Vitale Vaten the multidisciplinary panel of health professionals validated 63% from the international EPA Cardio indicators again. From the UniRap GP set only 13% was rated valid again. Considering organisational indicators, 27 indicators were rated in both EPA Cardio and Vitale Vaten. In the Vitale Vaten project 17 indicators (63%) were validated, including eight of the nine indicators validated in EPA Cardio. Consistency between panels was moderate, giving a decisive role to the health professional panel, being the most critical.


CONCLUSIONS
The consistency of selected performance indicators varied across procedures and panels. Further research is needed to identify underlying determinants of this variation.
Scientific Institute for Quality of Healthcare, Radboud University Nijmegen Medical Centre, PO Box 9101, 114 IQ healthcare, Nijmegen 6500 HB, The Netherlands. j.vanlieshout@iq.umcn.nl
Jan
J
van Lieshout
Elvira
E
Nouwens
Margriet
M
Bouma
Cor
C
Spreeuwenberg
Michel
M
Wensing
D002318:Cardiovascular Diseases / Q000628:therapy*; D003697:Delphi Technique; D006801:Humans; D033183:Interdisciplinary Communication; D009426:Netherlands; D019984:Quality Indicators, Health Care; D012308:Risk Management