title: Cognitive Difficulty and Format of Exams Predicts Gender and Socioeconomic Gaps in Exam Performance of Students in Introductory Biology Courses.
abstract: Recent reform efforts in undergraduate biology have recommended transforming course exams to test at more cognitively challenging levels, which may mean including more cognitively challenging and more constructed-response questions on assessments. However, changing the characteristics of exams could result in bias against historically underserved groups. In this study, we examined whether and to what extent the characteristics of instructor-generated tests impact the exam performance of male and female and middle/high- and low-socioeconomic status (SES) students enrolled in introductory biology courses. We collected exam scores for 4810 students from 87 unique exams taken across 3 yr of the introductory biology series at a large research university. We determined the median Bloom's level and the percentage of constructed-response questions for each exam. Despite controlling for prior academic ability in our models, we found that males and middle/high-SES students were disproportionately favored as the Bloom's level of exams increased. Additionally, middle/high-SES students were favored as the proportion of constructed-response questions on exams increased. Given that we controlled for prior academic ability, our findings do not likely reflect differences in academic ability level. We discuss possible explanations for our findings and how they might impact how we assess our students.
authors.affiliation: School of Life Sciences, Arizona State University, Tempe, AZ 85287.
authors.forename: Christian D
authors.initials: CD
authors.lastname: Wright
authors.affiliation: Texas Institute for Discovery Education in Science, University of Texas at Austin, Austin, TX 78705.
authors.forename: Sarah L
authors.initials: SL
authors.lastname: Eddy
authors.affiliation: Department of Biology, University of Washington, Seattle, WA 98195.
authors.forename: Mary Pat
authors.initials: MP
authors.lastname: Wenderoth
authors.affiliation: Department of Biology, University of Washington, Seattle, WA 98195.
authors.forename: Elizabeth
authors.initials: E
authors.lastname: Abshire
authors.affiliation: Department of Biology, University of Washington, Seattle, WA 98195.
authors.forename: Margaret
authors.initials: M
authors.lastname: Blankenbiller
authors.affiliation: School of Life Sciences, Arizona State University, Tempe, AZ 85287 sara.brownell@asu.edu.
authors.forename: Sara E
authors.initials: SE
authors.lastname: Brownell
mesh_terms: D001695:Biology / Q000193:education*; D003071:Cognition; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D017145:Models, Educational; D012044:Regression Analysis; D012737:Sex Factors; D012959:Socioeconomic Factors; D013334:Students / Q000523:psychology*