Portfolios for determining initial licensure competency.
BACKGROUND
Because attempts to improve initial licensure examinations have not been grounded in measurement theory, partial and inadequate remedies have led to a cycle of refutations, defenses and political polarization.


METHODS
The author reviewed the psychometric literature, focusing on high-stakes professional decisions. Editorials in the dental literature and position papers of involved organizations often use words from this literature without incorporating its fundamental concepts.


RESULTS
The reliability of one-shot initial licensure examinations is estimated to be approximately r = .40, which is a value well under the standard for such tests in other professions. Validity has not been investigated rigorously, but the one-shot format and proposals to remove live patients certainly would reduce validity. The use of portfolios--a small number of evaluations in several realistic task domains--is a viable means of achieving psychometric standards for initial licensure decisions.


CONCLUSIONS
Boards are charged with making valid and reliable licensure decisions, not with conducting examinations. At a minimum, they must define the competencies of beginning practitioners and establish the psychometric criteria for their decisions (neither of which are done currently). Gathering data then can be delegated to whoever is best qualified to meet these standards.
School of Dentistry, University of the Pacific, San Francisco, Calif. 94115, USA. dchambers@pacific.edu
David W
DW
Chambers
D002983:Clinical Competence / Q000592:standards*; D003162:Competency-Based Education; D003657:Decision Making; D004497:Education, Dental; D004521:Educational Measurement / Q000379:methods; D006801:Humans; D008005:Licensure, Dental / Q000592:standards*; D011594:Psychometrics; D015203:Reproducibility of Results; D013044:Specialty Boards; D014481:United States