Accuracy in scoring vignettes using the mini mental state examination and the short orientation memory concentration test.
OBJECTIVE
To compare the accuracy in scoring of vignettes of 2 cognitive screening tests-the Mini Mental State Examination (MMSE) and the Short Orientation Memory Concentration Test (S-OMC).


METHODS
Within group comparison.


METHODS
Academic institution.


METHODS
A total of 74 student nurses.


METHODS
Participants received instruction on the scoring of each test and were then asked to score 6 videotaped clinical vignettes.


METHODS
Scores allocated by participants on the vignettes for the MMSE and S-OMC.


RESULTS
The proportion of participants assigning the correct total score to the vignettes was low (MMSE 53.2%, S-OMC 66.7%), and the difference in accuracy between tests was significant (P = .005). The total scores that were assigned resulted in misclassification across all 4 caseness cutoffs within each test (MMSE 0.9%-5.9%; S-OMC 1.4%-2.7%). The differences in correct caseness placement between the 2 tests were significant only for the moderate impairment cutoff, where the S-OMC achieved greater correct caseness placement.


CONCLUSIONS
The high proportion of scoring mistakes overall has implications for the use of both the tests in routine clinical practice but in particular for the MMSE. An increased awareness is needed in clinical settings and among tests developers, of the likelihood of, and implications arising from, variations in scoring accuracy. In the current study, the S-OMC was scored more accurately than the MMSE.
Queally
Victoria R
VR
Lancashire Care NHS Foundation Trust, Ribbleton Hospital, Preston, United Kingdom. vicky.queally@lancashirecare.nhs.uk
Evans
Jonathan J
JJ
McMillan
Thomas M
TM
D001288:Attention / Q000502:physiology; D003072:Cognition Disorders / Q000175:diagnosis / Q000523:psychology; D006801:Humans; D008568:Memory / Q000502:physiology*; D008609:Mental Status Schedule; D009483:Neuropsychological Tests / Q000592:standards*; D015588:Observer Variation; D009949:Orientation / Q000502:physiology*; D011597:Psychomotor Performance / Q000502:physiology; D015203:Reproducibility of Results