Conceptual model of comprehensive research metrics for improved human health and environment.
OBJECTIVE
Federal, state, and private research agencies and organizations have faced increasing administrative and public demand for performance measurement. Historically, performance measurement predominantly consisted of near-term outputs measured through bibliometrics. The recent focus is on accountability for investment based on long-term outcomes. Developing measurable outcome-based metrics for research programs has been particularly challenging, because of difficulty linking research results to spatially and temporally distant outcomes. Our objective in this review is to build a logic model and associated metrics through which to measure the contribution of environmental health research programs to improvements in human health, the environment, and the economy.


METHODS
We used expert input and literature research on research impact assessment.


METHODS
With these sources, we developed a logic model that defines the components and linkages between extramural environmental health research grant programs and the outputs and outcomes related to health and social welfare, environmental quality and sustainability, economics, and quality of life.


RESULTS
The logic model focuses on the environmental health research portfolio of the National Institute of Environmental Health Sciences (NIEHS) Division of Extramural Research and Training. The model delineates pathways for contributions by five types of institutional partners in the research process: NIEHS, other government (federal, state, and local) agencies, grantee institutions, business and industry, and community partners.


CONCLUSIONS
The model is being applied to specific NIEHS research applications and the broader research community. We briefly discuss two examples and discuss the strengths and limits of outcome-based evaluation of research programs.
Engel-Cox
Jill A
JA
Battelle Memorial Institute, Arlington, VA 22201, USA. engelcoxj@battelle.org
Van Houten
Bennett
B
Phelps
Jerry
J
Rose
Shyanika W
SW
D004782:Environmental Health; D008962:Models, Theoretical; D054585:National Institute of Environmental Health Sciences (U.S.); D015397:Program Evaluation; D012107:Research Design; D014481:United States