Acceptability of an online modified Delphi panel approach for developing health services performance measures: results from 3 panels on arthritis research.
OBJECTIVE
Online modified Delphi (OMD) panel approaches can be used to engage large and diverse groups of clinical experts and stakeholders in developing health services performance measures. Such approaches are increasing in popularity among health researchers. However, information about their acceptability to participating experts and stakeholders is lacking but important to determine before recommending widespread use of online approaches. Therefore, the objective of this paper is to explore acceptability of the OMD panel approach from the participants' perspective.


METHODS
We use data from participants in three OMD panels designed to develop performance measures for use in arthritis research and quality improvement efforts. At the end of each online panel, we surveyed clinical experts and stakeholders who shared their experiences with the OMD process by answering 13 close-ended questions using 7-point Likert-type scales. A mean of 5 or higher on a given question was treated as an indication of acceptability.


RESULTS
Ninety-eight clinical experts and stakeholders (92% participation rate) answered survey questions about the online process. They considered the OMD panel approach to be acceptable, particularly the ease of using the online system (mean = 5.3, standard deviation = 1.3) and the understanding gained from online discussions (mean = 5.2, standard deviation = 1.0). Participants also felt that participation in the Delphi study was interesting (mean = 5.6, standard deviation =1.1).


CONCLUSIONS
These findings illustrate likely acceptability and a potential for a more widespread use of OMD panel approaches by stakeholders in developing health services performance measures.
RAND, Santa Monica, USA.
Dmitry
D
Khodyakov
RAND, Santa Monica, USA.
Sean
S
Grant
University of Calgary; Arthritis Research Centre Canada, Calgary, Canada.
Claire E H
CE
Barber
University of Calgary; Arthritis Research Centre Canada, Calgary, Canada.
Deborah A
DA
Marshall
Arthritis Research Centre Canada, Richmond, Canada.
John M
JM
Esdaile
Arthritis Research Centre Canada, Richmond, Canada.
Diane
D
Lacaille
D000416:Alberta; D001168:Arthritis / Q000628:therapy*; D003697:Delphi Technique; D006302:Health Services Research / Q000458:organization & administration; D006801:Humans; D020407:Internet; D058996:Quality Improvement / Q000458:organization & administration* / Q000592:standards; D019984:Quality Indicators, Health Care / Q000458:organization & administration* / Q000592:standards
Delphi; expert panel; health care; health services research; online modified Delphi; performance measures