title: Educational testing and validity of conclusions in the scholarship of teaching and learning.
abstract: Validity and its integral evidence of reliability are fundamentals for educational and psychological measurement, and standards of educational testing. Herein, we describe these standards of educational testing, along with their subtypes including internal consistency, inter-rater reliability, and inter-rater agreement. Next, related issues of measurement error and effect size are discussed. This article concludes with a call for future authors to improve reporting of psychometrics and practical significance with educational testing in the pharmacy education literature. By increasing the scientific rigor of educational research and reporting, the overall quality and meaningfulness of SoTL will be improved.
authors.affiliation: College of Pharmacy and Pharmaceutical Sciences, University of Toledo, Toledo, Ohio.
authors.forename: Michael J
authors.initials: MJ
authors.lastname: Peeters
authors.forename: Svetlana A
authors.initials: SA
authors.lastname: Beltyukova
authors.forename: Beth A
authors.initials: BA
authors.lastname: Martin
mesh_terms: D004512:Education, Pharmacy / Q000458:organization & administration* / Q000592:standards; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007858:Learning; D015588:Observer Variation; D011594:Psychometrics; D015203:Reproducibility of Results; D013663:Teaching / Q000458:organization & administration; D054928:Validation Studies as Topic
keywords: educational testing; psychometrics; reliability; scholarship of teaching and learning; validity