Development of a reliable, valid annual skills mastery assessment examination.
OBJECTIVE
To develop a methodology for a reliable, valid annual skills mastery assessment examination to provide formative student feedback, inform curricular review, and comply with the Accreditation Council for Pharmacy Education (ACPE) Standards 2007.


METHODS
A sample of program-level ability-based outcomes skills were chosen for the examination. Test items were written, underwent quality control, and were scored for level of difficulty. Versions of the examination for first-, second-, third-, and fourth-year pharmacy students were developed and administered, the results were analyzed, reliability and validity were evaluated, and reports were generated. Item-writing guidelines, quality control procedures, and examination production steps were codified to create a criterion-referenced examination. Students and faculty advisors received detailed score reports and results were used to guide student performance and stimulate a review of curricular outcomes.


RESULTS
Content, criterion, and construct validity were analyzed as defined in the literature for the intended use of this assessment tool. Data suggest the Annual Skills Mastery Assessment (ASMA) examination is both reliable and valid. Students and faculty members were surveyed regarding the usefulness of the examination. Results indicate general satisfaction with the assessment program.


CONCLUSIONS
A reasonably reliable, reasonably valid multiple-choice annual skills mastery assessment for selected outcomes statements providing formative feedback and informed curricular review was developed.
Alston
Gregory L
GL
Wingate University School of Pharmacy, Wingate, NC 28174, USA. galston@wingate.edu
Love
Bryan L
BL
D004512:Education, Pharmacy / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D011361:Professional Competence; D015203:Reproducibility of Results
J Exp Psychol Learn Mem Cogn. 2005 Sep;31(5):1155-9
16248758
Am J Pharm Educ. 2007 Aug 15;71(4):66
17806209
Am J Pharm Educ. 2008 Oct 15;72(5):101
19214255
Med Educ. 1983 May;17(3):165-71
6865814