title: The best of both worlds: Building on the COPUS and RTOP observation protocols to easily and reliably measure various levels of reformed instructional practice.
abstract: Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instructional practices between courses, monitoring changes over time, and mapping observed practices to research-based teaching. While increasingly common observation protocols (Reformed Teaching Observation Protocol [RTOP] and Classroom Observation Protocol in Undergraduate STEM [COPUS]) at the postsecondary level help achieve some of these goals, they also suffer from weaknesses that limit their applicability. In this study, we leverage the strengths of these protocols to provide an easy method that enables the reliable and valid characterization of instructional practices. This method was developed empirically via a cluster analysis using observations of 269 individual class periods, corresponding to 73 different faculty members, 28 different research-intensive institutions, and various STEM disciplines. Ten clusters, called COPUS profiles, emerged from this analysis; they represent the most common types of instructional practices enacted in the classrooms observed for this study. RTOP scores were used to validate the alignment of the 10 COPUS profiles with reformed teaching. Herein, we present a detailed description of the cluster analysis method, the COPUS profiles, and the distribution of the COPUS profiles across various STEM courses at research-intensive universities.
authors.affiliation: *Department of Natural Sciences, Oregon Institute of Technology, Klamath Falls, OR 97601.
authors.forename: Travis J
authors.initials: TJ
authors.lastname: Lund
authors.affiliation: Department of Chemistry and Biochemistry, Rowan University, Glassboro, NJ 08028.
authors.forename: Matthew
authors.initials: M
authors.lastname: Pilarz
authors.affiliation: Department of Chemistry, University of Nebraska-Lincoln, Lincoln, NE 68588.
authors.forename: Jonathan B
authors.initials: JB
authors.lastname: Velasco
authors.affiliation: Biology Education, IPN Leibniz Institute for Science and Mathematics Education, Kiel, Germany.
authors.forename: Devasmita
authors.initials: D
authors.lastname: Chakraverty
authors.affiliation: Department of Chemistry, University of Nebraska-Lincoln, Lincoln, NE 68588.
authors.forename: Kaitlyn
authors.initials: K
authors.lastname: Rosploch
authors.affiliation: Department of Chemistry, University of Nebraska-Lincoln, Lincoln, NE 68588.
authors.forename: Molly
authors.initials: M
authors.lastname: Undersander
authors.affiliation: Department of Chemistry, University of Nebraska-Lincoln, Lincoln, NE 68588 mstains2@unl.edu.
authors.forename: Marilyne
authors.initials: M
authors.lastname: Stains
mesh_terms: D016000:Cluster Analysis; D004521:Educational Measurement; D004738:Engineering / Q000193:education*; D006801:Humans; D008433:Mathematics / Q000193:education*; D012106:Research / Q000193:education; D012586:Science / Q000193:education*; D013334:Students; D013663:Teaching; D013672:Technology / Q000193:education*