Using UnGraph to extract data from image files: verification of reliability and validity.
Certain research tasks require extracting data points from graphs and charts. Using 91 graphs that presented results from single-case designs, we investigated whether pairs of coders extract similar data from the same graphs (reliability), and whether the extracted data match numerical descriptions of the graph that the original author may have presented in tables or text (validity). Coders extracted data using the UnGraph computer program. Extraction proved highly reliable over several different kinds of analyses. Coders nearly always extracted identical numbers of data points, and the values they assigned to those data points were nearly identical. Extraction also proved highly valid, with the means of extracted data correlating nearly perfectly with means reported in tables or text and with very few discrepancies in any single case. These results suggest that researchers can use extracted data with a high degree of confidence that they are nearly identical to the original data.
Shadish
William R
WR
University of California Merced, P.O. Box 2039, 95344, Merced, CA. wshadish@ucmerced.edu.
Brasil
Isabel C C
ICC
University of California Merced, P.O. Box 2039, 95344, Merced, CA.
Illingworth
David A
DA
University of California Merced, P.O. Box 2039, 95344, Merced, CA.
White
Kristen D
KD
University of California Merced, P.O. Box 2039, 95344, Merced, CA.
Galindo
Rodolfo
R
University of California Merced, P.O. Box 2039, 95344, Merced, CA.
Nagler
Eden D
ED
City University of New York, New York, New York.
Rindskopf
David M
DM
City University of New York, New York, New York.
D006801:Humans; D015203:Reproducibility of Results; D012106:Research / Q000295:instrumentation; D012984:Software