title: Development and Validation of a Rubric for Diagnosing Students' Experimental Design Knowledge and Difficulties.
abstract: It is essential to teach students about experimental design, as this facilitates their deeper understanding of how most biological knowledge was generated and gives them tools to perform their own investigations. Despite the importance of this area, surprisingly little is known about what students actually learn from designing biological experiments. In this paper, we describe a rubric for experimental design (RED) that can be used to measure knowledge of and diagnose difficulties with experimental design. The development and validation of the RED was informed by a literature review and empirical analysis of undergraduate biology students' responses to three published assessments. Five areas of difficulty with experimental design were identified: the variable properties of an experimental subject; the manipulated variables; measurement of outcomes; accounting for variability; and the scope of inference appropriate for experimental findings. Our findings revealed that some difficulties, documented some 50 yr ago, still exist among our undergraduate students, while others remain poorly investigated. The RED shows great promise for diagnosing students' experimental design knowledge in lecture settings, laboratory courses, research internships, and course-based undergraduate research experiences. It also shows potential for guiding the development and selection of assessment and instructional activities that foster experimental design.
authors.affiliation: *Department of Biological Sciences, Purdue University, West Lafayette, IN 47907.
authors.forename: Annwesa P
authors.initials: AP
authors.lastname: Dasgupta
authors.affiliation: Divisions of Chemical Education and Biochemistry, Department of Chemistry, Purdue University, West Lafayette, IN 47907.
authors.forename: Trevor R
authors.initials: TR
authors.lastname: Anderson
authors.affiliation: *Department of Biological Sciences, Purdue University, West Lafayette, IN 47907 npelaez@purdue.edu.
authors.forename: Nancy
authors.initials: N
authors.lastname: Pelaez
mesh_terms: D004521:Educational Measurement / Q000379:methods* / Q000592:standards*; D006801:Humans; D019359:Knowledge; D007858:Learning; D015203:Reproducibility of Results; D013334:Students / Q000523:psychology*