Results from a psychometric assessment of a new tool for measuring evidence-based decision making in public health organizations.
In order to better understand how to improve evidence-based decision making (EBDM) in state health departments, measurement tools are needed to evaluate changes in EBDM. The purpose of this study was to test the psychometric properties of a new measurement tool to assess EBDM in public health practice settings.



A questionnaire was developed, pilot-tested and refined in an iterative process with the input of public health practitioners with the aim of identifying a set of specific measures representing different components of EBDM. Data were collected in a national survey of state health department chronic disease practitioners. The final dataset (n=879) for psychometric testing was comprised of 19 EBDM items that were first examined using exploratory factor analysis, and then confirmatory factor analysis.



The final model from confirmatory factor analysis includes five latent factors representing components of EBDM: capacity for evaluation, expectations and incentives for EBDM, access to evidence and resources for EBDM, participatory decision making, and leadership support and commitment.



This study addresses the need for empirically tested and theory-aligned measures that may be used to assess the extent to which EBDM is currently implemented, and further, to gauge the success of strategies to improve EBDM, in public health settings. This EBDM measurement tool may help identify needed supports for enhanced capacity and implementation of effective strategies.
Department of Epidemiology, College for Public Health & Social Justice, Saint Louis University, 3545 Lafayette Avenue, St. Louis, MO 63130, United States. Electronic address: kstamata@slu.edu.
Katherine A
KA
Stamatakis
Department of Physical Education, School of Health and Biosciences, Pontifícia Universidade Católica do Paraná, Curitiba, PR, Brazil. Electronic address: akira.hino@pucpr.br.
Adriano Akira
AA
Ferreira Hino
Prevention Research Center in St. Louis, Brown School, Washington University in St. Louis, One Brookings Drive, St. Louis, MO 63130, United States. Electronic address: pegallen@wustl.edu.
Peg
P
Allen
Health Communications Research Laboratory, Washington University in St. Louis, 700 Rosedale Avenue, St. Louis, MO 63112, United States. Electronic address: amcqueen@dom.wustl.edu.
Amy
A
McQueen
Prevention Research Center in St. Louis, Brown School, Washington University in St. Louis, One Brookings Drive, St. Louis, MO 63130, United States. Electronic address: rebekahjacob@wustl.edu.
Rebekah R
RR
Jacob
Department of Behavioral Science and Health Education, College for Public Health and Social Justice, Saint Louis University, 3545 Lafayette Ave., St Louis, MO 63130, United States. Electronic address: bakerpa@slu.edu.
Elizabeth A
EA
Baker
Prevention Research Center in St. Louis, Brown School, Washington University in St. Louis, One Brookings Drive, St. Louis, MO 63130, United States. Electronic address: rbrownson@brownschool.wustl.edu.
Ross C
RC
Brownson
D000328:Adult; D002908:Chronic Disease / Q000628:therapy; D003657:Decision Making; D055317:Evidence-Based Practice; D005163:Factor Analysis, Statistical; D006801:Humans; D033181:Information Dissemination / Q000379:methods; D008297:Male; D008875:Middle Aged; D015397:Program Evaluation / Q000379:methods*; D011594:Psychometrics; D011635:Public Health Administration / Q000379:methods* / Q000592:standards*; D011795:Surveys and Questionnaires / Q000592:standards*; D014481:United States; D055815:Young Adult
Confirmatory factor analysis; Evidence-based decision making; Measurement; Public health
BMC Public Health. 2012 Feb 20;12:137
22348688
Health Educ Behav. 2005 Apr;32(2):195-207
15749966
J Public Health Manag Pract. 2016 Nov-Dec;22(6):542-9
26910874
Implement Sci. 2013 Dec 13;8:141
24330729
Prev Chronic Dis. 2013;10:E41
23517584
Am J Public Health. 2015 Apr;105 Suppl 2:e15-22
25689211
Am J Prev Med. 2014 Jan;46(1):49-57
24355671
Implement Sci. 2014 Feb 24;9:29
24565228
J Public Health (Oxf). 2013 Dec;35(4):624-7
24293453
Implement Sci. 2011 Jan 05;6:1
21208425
Annu Rev Public Health. 2014;35:255-74
24641560
Health Educ Behav. 2003 Jun;30(3):267-82; discussion 283-6
19731496
Implement Sci. 2009 Aug 07;4:50
19664226
Am J Prev Med. 2012 Sep;43(3):337-50
22898128
Prev Chronic Dis. 2014 May 08;11:E76
24809362
Nurs Outlook. 2010 Nov-Dec;58(6):287-300
21074646
Prev Chronic Dis. 2012;9:E116
22721501
BMC Health Serv Res. 2012 Mar 09;12:57
22405439
J Public Health Manag Pract. 2013 Mar-Apr;19(2):153-61
23358294
Implement Sci. 2012 Jul 16;7:65
22800294
Int J Occup Saf Ergon. 2013;19(1):41-62
23498710
PLoS Med. 2012;9(3):e1001187
22448147
Bull World Health Organ. 2009 Mar;87(3):164
19377706
J Public Health Manag Pract. 2010 Nov-Dec;16(6):E9-E15
20885175
Annu Rev Public Health. 2009;30:175-201
19296775
Am J Prev Med. 2012 Sep;43(3):309-19
22898125
Public Health Rep. 2010 Sep-Oct;125(5):736-42
20873290
Int J Technol Assess Health Care. 2001 Fall;17(4):467-78
11758291
Implement Sci. 2015 Apr 21;10:53
25895742
Implement Sci. 2009 Sep 23;4:61
19775439
BMC Health Serv Res. 2014 Nov 14;14:564
25398652
Am J Prev Med. 2004 Dec;27(5):417-21
15556743
Health Res Policy Syst. 2011 Jun 24;9:29
21702956