title: Using UnGraph to extract data from image files: verification of reliability and validity.
abstract: Certain research tasks require extracting data points from graphs and charts. Using 91 graphs that presented results from single-case designs, we investigated whether pairs of coders extract similar data from the same graphs (reliability), and whether the extracted data match numerical descriptions of the graph that the original author may have presented in tables or text (validity). Coders extracted data using the UnGraph computer program. Extraction proved highly reliable over several different kinds of analyses. Coders nearly always extracted identical numbers of data points, and the values they assigned to those data points were nearly identical. Extraction also proved highly valid, with the means of extracted data correlating nearly perfectly with means reported in tables or text and with very few discrepancies in any single case. These results suggest that researchers can use extracted data with a high degree of confidence that they are nearly identical to the original data.
authors.affiliation: University of California Merced, P.O. Box 2039, 95344, Merced, CA. wshadish@ucmerced.edu.
authors.forename: William R
authors.initials: WR
authors.lastname: Shadish
authors.affiliation: University of California Merced, P.O. Box 2039, 95344, Merced, CA.
authors.forename: Isabel C C
authors.initials: ICC
authors.lastname: Brasil
authors.affiliation: University of California Merced, P.O. Box 2039, 95344, Merced, CA.
authors.forename: David A
authors.initials: DA
authors.lastname: Illingworth
authors.affiliation: University of California Merced, P.O. Box 2039, 95344, Merced, CA.
authors.forename: Kristen D
authors.initials: KD
authors.lastname: White
authors.affiliation: University of California Merced, P.O. Box 2039, 95344, Merced, CA.
authors.forename: Rodolfo
authors.initials: R
authors.lastname: Galindo
authors.affiliation: City University of New York, New York, New York.
authors.forename: Eden D
authors.initials: ED
authors.lastname: Nagler
authors.affiliation: City University of New York, New York, New York.
authors.forename: David M
authors.initials: DM
authors.lastname: Rindskopf
mesh_terms: D006801:Humans; D015203:Reproducibility of Results; D012106:Research / Q000295:instrumentation; D012984:Software