Evolution of a multilevel framework for health program evaluation.
A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.
Centre for Health Service Development, Australian Health Services Research Institute, Building 234 (iC Enterprise 1), Innovation Campus, University of Wollongong, Wollongong, NSW 2522, Australia. Email:.
Malcolm
M
Masso
Centre for Health Service Development, Australian Health Services Research Institute, Building 234 (iC Enterprise 1), Innovation Campus, University of Wollongong, Wollongong, NSW 2522, Australia. Email:.
Karen
K
Quinsey
Centre for Health Service Development, Australian Health Services Research Institute, Building 234 (iC Enterprise 1), Innovation Campus, University of Wollongong, Wollongong, NSW 2522, Australia. Email:.
Dave
D
Fildes
D001315:Australia; D057191:Capacity Building; D003153:Community Health Services / Q000458:organization & administration*; D003695:Delivery of Health Care / Q000458:organization & administration*; D004059:Diffusion of Innovation; D006302:Health Services Research; D006801:Humans; D010043:Outcome and Process Assessment, Health Care; D016730:Program Development; D015397:Program Evaluation / Q000379:methods*