title: Development and validation of SEER (Seeking, Engaging with and Evaluating Research): a measure of policymakers' capacity to engage with and use research.
abstract: BACKGROUND
  Capacity building strategies are widely used to increase the use of research in policy development. However, a lack of well-validated measures for policy contexts has hampered efforts to identify priorities for capacity building and to evaluate the impact of strategies. We aimed to address this gap by developing SEER (Seeking, Engaging with and Evaluating Research), a self-report measure of individual policymakers' capacity to engage with and use research.
  
  
  METHODS
  We used the SPIRIT Action Framework to identify pertinent domains and guide development of items for measuring each domain. Scales covered (1) individual capacity to use research (confidence in using research, value placed on research, individual perceptions of the value their organisation places on research, supporting tools and systems), (2) actions taken to engage with research and researchers, and (3) use of research to inform policy (extent and type of research use). A sample of policymakers engaged in health policy development provided data to examine scale reliability (internal consistency, test-retest) and validity (relation to measures of similar concepts, relation to a measure of intention to use research, internal structure of the individual capacity scales).
  
  
  RESULTS
  Response rates were 55% (150/272 people, 12 agencies) for the validity and internal consistency analyses, and 54% (57/105 people, 9 agencies) for test-retest reliability. The individual capacity scales demonstrated adequate internal consistency reliability (alpha coefficients > 0.7, all four scales) and test-retest reliability (intra-class correlation coefficients > 0.7 for three scales and 0.59 for fourth scale). Scores on individual capacity scales converged as predicted with measures of similar concepts (moderate correlations of > 0.4), and confirmatory factor analysis provided evidence that the scales measured related but distinct concepts. Items in each of these four scales related as predicted to concepts in the measurement model derived from the SPIRIT Action Framework. Evidence about the reliability and validity of the research engagement actions and research use scales was equivocal.
  
  
  CONCLUSIONS
  Initial testing of SEER suggests that the four individual capacity scales may be used in policy settings to examine current capacity and identify areas for capacity building. The relation between capacity, research engagement actions and research use requires further investigation.
authors.affiliation: School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia. sue.brennan@monash.edu.
authors.forename: Sue E
authors.initials: SE
authors.lastname: Brennan
authors.affiliation: School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.
authors.forename: Joanne E
authors.initials: JE
authors.lastname: McKenzie
authors.affiliation: School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.
authors.forename: Tari
authors.initials: T
authors.lastname: Turner
authors.affiliation: Sax Institute, Sydney, Australia.
authors.forename: Sally
authors.initials: S
authors.lastname: Redman
authors.affiliation: Sax Institute, Sydney, Australia.
authors.forename: Steve
authors.initials: S
authors.lastname: Makkar
authors.affiliation: Sax Institute, Sydney, Australia.
authors.forename: Anna
authors.initials: A
authors.lastname: Williamson
authors.affiliation: Sax Institute, Sydney, Australia.|School of Public Health, University of Sydney, Sydney, Australia.
authors.forename: Abby
authors.initials: A
authors.lastname: Haynes
authors.affiliation: School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.
authors.forename: Sally E
authors.initials: SE
authors.lastname: Green
mesh_terms: D000288:Administrative Personnel; D055317:Evidence-Based Practice; D005240:Feasibility Studies; D006291:Health Policy; D006801:Humans; D010865:Pilot Projects; D011050:Policy Making; D011364:Professional Practice; D012106:Research / Q000706:statistics & numerical data*; D057566:Self Report; D011795:Surveys and Questionnaires; D057170:Translational Research, Biomedical
keywords: Capacity building; Capacity to use research; Conceptual framework; Evidence-informed policy; Health policy; Knowledge exchange; Knowledge translation; Measurement instrument; Questionnaire; Research utilisation