Investigating the use of written and performance-based testing to summarize competence on the case management component of the NBCE part IV-national practical examination.
BACKGROUND
Large-scale performance-based examinations are logistically complex and costly to run. Scores based solely on performance-based stations require extended testing time to achieve acceptable generalizability.


OBJECTIVE
Combining scores from performance-based formats and written formats may improve test generalizability.


METHODS
Data from 718 test-takers on the standardized patient-based portion of the National Board of Chiropractic Examiners Part IV examination were analyzed using a generalizability framework.


RESULTS
The written and performance scores displayed a moderate universe score correlation indicating each component provided unique information about related clinical skills and the examinee's ability to manage a case. Combining the two scores provided a summary score that was more generalizable than either of the two measures individually.


CONCLUSIONS
These results provide guidance for improving the generalizability of the standardized patient-based stations by combining the scores on the performance and written components using appropriate weighting procedures.
Townsend
Paul D
PD
Department of Practical Testing Research and Development, National Board of Chiropractic Examiners, Greeley, Colorado, USA.
Christensen
Mark G
MG
Kreiter
Clarence D
CD
zumBrunnen
James R
JR
D019090:Case Management / Q000592:standards*; D002684:Chiropractic / Q000193:education*; D002983:Clinical Competence / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D015203:Reproducibility of Results; D013647:Task Performance and Analysis