title: Crowdsourcing for quantifying transcripts: An exploratory study.
abstract: This exploratory study attempts to demonstrate the potential utility of crowdsourcing as a supplemental technique for quantifying transcribed interviews. Crowdsourcing is the harnessing of the abilities of many people to complete a specific task or a set of tasks. In this study multiple samples of crowdsourced individuals were asked to rate and select supporting quotes from two different transcripts. The findings indicate that the different crowdsourced samples produced nearly identical ratings of the transcripts, and were able to consistently select the same supporting text from the transcripts. These findings suggest that crowdsourcing, with further development, can potentially be used as a mixed method tool to offer a supplemental perspective on transcribed interviews.
authors.affiliation: Claremont Graduate University, United States. Electronic address: tarek.azzam@cgu.edu.
authors.forename: Tarek
authors.initials: T
authors.lastname: Azzam
authors.affiliation: Claremont Graduate University, United States.
authors.forename: Elena
authors.initials: E
authors.lastname: Harman
mesh_terms: D000328:Adult; D063045:Crowdsourcing / Q000592:standards*; D000068598:Data Accuracy; D005260:Female; D006801:Humans; D020407:Internet; D007407:Interviews as Topic / Q000592:standards*; D008297:Male; D015397:Program Evaluation; D036301:Qualitative Research; D012107:Research Design; D012959:Socioeconomic Factors
keywords: Crowdsourcing; MTurk; Mechanical Turk; Qualitative analysis; Stability; Transcript coding; Transcript rating