title: Methodological Credibility: An Empirical Investigation of the Public's Perception of Evaluation Findings and Methods.
abstract: When evaluations are broadly disseminated, the public can use them to support a program or to advocate for change.
  
  
  
  To explore how evaluations are perceived and used by the public, individuals in a sample of 425 people in the United States were recruited through an online crowdsourcing service called Mechanical Turk (www.mturk.com). Participants were randomly assigned to receive different versions of a press release describing a summative evaluation of a program. Each condition contained a unique combination of methods (e.g., randomized controlled design) and findings (positive or negative) to describe the evaluation and its findings. Participants in each condition responded to questions about their trust in the content of the evaluation findings and their attitudes toward the program.
  
  
  
  Results indicated that the type of evaluation methods and the direction of the findings both influenced the credibility of the findings and that the credibility of the findings moderated the relationship between the direction of the evaluation findings and attitudes toward the evaluated program. Additional evaluation factors to explore in future research with the public are recommended.
authors.affiliation: Claremont Graduate University, Claremont, CA, USA jacobson.miriam@gmail.com.
authors.forename: Miriam R
authors.initials: MR
authors.lastname: Jacobson
authors.affiliation: Claremont Graduate University, Claremont, CA, USA.
authors.forename: Tarek
authors.initials: T
authors.lastname: Azzam
mesh_terms: D000328:Adult; D001290:Attitude; D063045:Crowdsourcing / Q000379:methods*; D006801:Humans; D008875:Middle Aged; D010465:Perception; D015397:Program Evaluation; D011639:Public Opinion; D036301:Qualitative Research; D016032:Randomized Controlled Trials as Topic; D011795:Surveys and Questionnaires; D014481:United States; D055815:Young Adult
keywords: credibility; evaluation influence; evaluation methodology; evaluation use