title: An examination of the equivalency of self-report measures obtained from crowdsourced versus undergraduate student samples.
abstract: Increasingly, researchers have begun to explore the potential of the Internet to reach beyond the traditional undergraduate sample. In the present study, we sought to compare the data obtained from a conventional undergraduate college-student sample to data collected via two online survey recruitment platforms. In order to examine whether the data sampled from the three populations were equivalent, we conducted a test of equivalency using inferential confidence intervals-an approach that differs from the more traditional null hypothesis significance testing. The results showed that the data obtained via the two online recruitment platforms, the Amazon Mechanical Turk crowdsourcing site and the virtual environment of Second Life, were statistically equivalent to the data obtained from the college sample, on the basis of means of standardized measures of psychological stress and sleep quality. Additionally, correlations between the sleep and stress measures were not statistically different between the groups. These results, along with practical considerations for the use of these recruitment platforms, are discussed, and recommendations for other researchers who may be considering the use of these platforms are provided.
authors.affiliation: Department of Psychological Science, The University of Texas Rio Grande Valley, 1201 W. University Drive, Edinburg, 78539, Texas, USA.
authors.forename: Elizabeth M
authors.identifier: 0000-0003-4374-7369
authors.initials: EM
authors.lastname: Briones
authors.affiliation: Department of Psychological Science, The University of Texas Rio Grande Valley, 1201 W. University Drive, Edinburg, 78539, Texas, USA. grant.benham@utrgv.edu.
authors.forename: Grant
authors.initials: G
authors.lastname: Benham
mesh_terms: D000328:Adult; D063045:Crowdsourcing / Q000379:methods / Q000592:standards; D005260:Female; D006801:Humans; D020407:Internet; D008297:Male; D017063:Outcome Assessment, Health Care / Q000592:standards*; D018579:Patient Selection; D057566:Self Report / Q000592:standards*; D000070263:Sleep Hygiene; D013315:Stress, Psychological / Q000175:diagnosis / Q000523:psychology; D013334:Students / Q000523:psychology / Q000706:statistics & numerical data; D011795:Surveys and Questionnaires; D014584:User-Computer Interface
keywords: Amazon Mechanical Turk; Crowdsourcing; Equivalence testing; Second Life; Sleep; Stress