Standard-setting methodology: Establishing performance standards and setting cut-scores to assist score interpretation.
A critical step in the development and use of tests of physical fitness for employment purposes (e.g., fitness for duty) is to establish 1 or more cut points, dividing the test score range into 2 or more ordered categories reflecting, for example, fail/pass decisions. Over the last 3 decades elaborated theories and methods have evolved focusing on the process of establishing 1 or more cut-scores on a test. This elaborated process is widely referred to as "standard-setting". As such, the validity of the test score interpretation hinges on the standard-setting, which embodies the purpose and rules according to which the test results are interpreted. The purpose of this paper is to provide an overview of standard-setting methodology. The essential features, key definitions and concepts, and various novel methods of informing standard-setting will be described. The focus is on foundational issues with an eye toward informing best practices with new methodology. Throughout, a case is made that in terms of best practices, establishing a test standard involves, in good part, setting a cut-score and can be conceptualized as evidence/data-based policy making that is essentially tied to test validity and an evidential trail.
Department of Educational and Counseling Psychology, and Special Education (ECPS), University of British Columbia, Vancouver, BC V6T 1Z4, Canada.|Department of Educational and Counseling Psychology, and Special Education (ECPS), University of British Columbia, Vancouver, BC V6T 1Z4, Canada.
Bruno D
BD
Zumbo
D004651:Employment / Q000592:standards*; D006801:Humans; D016272:Occupational Health / Q000592:standards*; D010808:Physical Examination; D010809:Physical Fitness; D015203:Reproducibility of Results
cut-score; normalisation; normes de performance; pass-score; performance standards; physical fitness testing; psychometrics; psychométrie; seuil de coupure; seuil de réussite; standard-setting; test validity; validité du test; évaluation de la condition physique