Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation.
Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific region. The study is described followed by a discussion of the difficulties in participant recruitment and selection, sample size, instrumentation, data collection and analysis and attempts to resolve them. Some of these problems are generic to the Delphi whereas others related to the specifics of the investigation. What we learned should be useful for future Delphis with a similar focus.
Hung
Hsin-Ling
HL
Evaluation Services Center, University of Cincinnati, PO Box 21015, One Edwards Center, Cincinnati, OH 45221-0105, USA.
Altschuld
James W
JW
Lee
Yi-Fang
YF
D001208:Asia; D003697:Delphi Technique; D004493:Education; D006801:Humans; D007407:Interviews as Topic; D044349:Oceania; D015397:Program Evaluation / Q000379:methods*; D011795:Surveys and Questionnaires