Assessing the criterion validity of four highly abbreviated measures from the Minimal Assessment of Cognitive Function in Multiple Sclerosis (MACFIMS).
OBJECTIVE
Cognitive dysfunction is prevalent in multiple sclerosis. As self-reported cognitive functioning is unreliable, brief objective screening measures are needed. Utilizing widely used full-length neuropsychological tests, this study aimed to establish the criterion validity of highly abbreviated versions of the Brief Visuospatial Memory Test - Revised (BVMT-R), Symbol Digit Modalities Test (SDMT), Delis-Kaplan Executive Function System (D-KEFS) Sorting Test, and Controlled Oral Word Association Test (COWAT) in order to begin developing an MS-specific screening battery.


METHODS
Participants from Holy Name Medical Center and the Kessler Foundation were administered one or more of these four measures. Using test-specific criterion to identify impairment at both -1.5 and -2.0 SD, receiver-operating-characteristic (ROC) analyses of BVMT-R Trial 1, Trial 2, and Trial 1 + 2 raw data (N = 286) were run to calculate the classification accuracy of the abbreviated version, as well as the sensitivity and specificity. The same methods were used for SDMT 30-s and 60-s (N = 321), D-KEFS Sorting Free Card Sort 1 (N = 120), and COWAT letters F and A (N = 298).


RESULTS
Using these definitions of impairment, each analysis yielded high classification accuracy (89.3 to 94.3%).


CONCLUSIONS
BVMT-R Trial 1, SDMT 30-s, D-KEFS Free Card Sort 1, and COWAT F possess good criterion validity in detecting impairment on their respective overall measure, capturing much of the same information as the full version. Along with the first two trials of the California Verbal Learning Test - Second Edition (CVLT-II), these five highly abbreviated measures may be used to develop a brief screening battery.
a Department of Psychology , VA Connecticut Healthcare System , West Haven , CT , USA.|b Department of Psychiatry , Yale School of Medicine , New Haven , CT , USA.
Elizabeth S
ES
Gromisch
c Ferkauf Graduate School of Psychology , Yeshiva University , Bronx , NY , USA.
Vance
V
Zemon
c Ferkauf Graduate School of Psychology , Yeshiva University , Bronx , NY , USA.|d Department of Neurology , Albert Einstein College of Medicine , Bronx , NY , USA.
Roee
R
Holtzer
e Kessler Foundation , West Orange , NJ , USA.|f Department of Physical Medicine and Rehabilitation , Rutgers New Jersey Medical School , Newark , NJ , USA.
Nancy D
ND
Chiaravalloti
e Kessler Foundation , West Orange , NJ , USA.|f Department of Physical Medicine and Rehabilitation , Rutgers New Jersey Medical School , Newark , NJ , USA.|g Department of Physical Medicine and Rehabilitation , The Johns Hopkins School of Medicine , Baltimore , MD , USA.
John
J
DeLuca
g Department of Physical Medicine and Rehabilitation , The Johns Hopkins School of Medicine , Baltimore , MD , USA.
Meghan
M
Beier
h Institute of Neurology and Neurosurgery , Saint Barnabas Hospital , Livingston , NJ , USA.
Eileen
E
Farrell
i Mount Sinai Hospital , New York , NY , USA.
Stacey
S
Snyder
j VA NY Harbor Healthcare System , New York , NY , USA.
Laura C
LC
Schairer
c Ferkauf Graduate School of Psychology , Yeshiva University , Bronx , NY , USA.
Lisa
L
Glukhovsky
c Ferkauf Graduate School of Psychology , Yeshiva University , Bronx , NY , USA.
Jason
J
Botvinick
c Ferkauf Graduate School of Psychology , Yeshiva University , Bronx , NY , USA.
Jessica
J
Sloan
k Holy Name Medical Center Multiple Sclerosis Center , Teaneck , NJ , USA.
Mary Ann
MA
Picone
l Department of Rehabilitation Medicine , NYU School of Medicine , New York , NY , USA.|m Department of Neurology , NYU School of Medicine , New York , NY , USA.
Sonya
S
Kim
c Ferkauf Graduate School of Psychology , Yeshiva University , Bronx , NY , USA.|k Holy Name Medical Center Multiple Sclerosis Center , Teaneck , NJ , USA.
Frederick W
FW
Foley
D000328:Adult; D010054:Brief Psychiatric Rating Scale / Q000592:standards*; D003071:Cognition; D003072:Cognition Disorders / Q000175:diagnosis / Q000523:psychology*; D056344:Executive Function; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D009103:Multiple Sclerosis / Q000175:diagnosis / Q000523:psychology*; D009483:Neuropsychological Tests / Q000592:standards*; D015995:Prevalence
MS; cognition; executive function; memory; neuropsychology