title: Reliability of classifying multiple sclerosis disease activity using magnetic resonance imaging in a multiple sclerosis clinic.
abstract: OBJECTIVE
  To assess the reliability of new magnetic resonance imaging (MRI) lesion counts by clinicians in a multiple sclerosis specialty clinic.
  
  
  METHODS
  An observational study.
  
  
  METHODS
  A multiple sclerosis specialty clinic.
  
  
  METHODS
  Eighty-five patients with multiple sclerosis participating in a National Institutes of Health–supported longitudinal study were included.
  
  
  METHODS
  Each patient had a brain MRI scan at entry and 6 months later using a standardized protocol.
  
  
  METHODS
  The number of new T2 lesions, newly enlarging T2 lesions, and gadolinium-enhancing lesions were measured on the 6-month MRI using a computer-based image analysis program for the original study. For this study, images were reanalyzed by an expert neuroradiologist and 3 clinician raters. The neuroradiologist evaluated the original image pairs; the clinicians evaluated image pairs that were modified to simulate clinical practice. New lesion counts were compared across raters, as was classification of patients as MRI active or inactive.
  
  
  RESULTS
  Agreement on lesion counts was highest for gadolinium-enhancing lesions, intermediate for new T2 lesions, and poor for enlarging T2 lesions. In 18% to 25% of the cases, MRI activity was classified differently by the clinician raters compared with the neuroradiologist or computer program. Variability among the clinical raters for estimates of new T2 lesions was affected most strongly by the image modifications that simulated low image quality and different head position.
  
  
  CONCLUSIONS
  Between-rater variability in new T2 lesion counts may be reduced by improved standardization of image acquisitions, but this approach may not be practical in most clinical environments. Ultimately, more reliable, robust, and accessible image analysis methods are needed for accurate multiple sclerosis disease-modifying drug monitoring and decision making in the routine clinic setting.
authors.affiliation: Cleveland Clinic Mellen Center for Multiple Sclerosis Treatment and Research, 9500 Euclid Ave, Cleveland, OH 44195-5244, USA. rudickr@ccf.org
authors.forename: Edru
authors.initials: E
authors.lastname: Erbayat Altay
authors.forename: Elizabeth
authors.initials: E
authors.lastname: Fisher
authors.forename: Stephen E
authors.initials: SE
authors.lastname: Jones
authors.forename: Claire
authors.initials: C
authors.lastname: Hara-Cleaver
authors.forename: Jar-Chi
authors.initials: JC
authors.lastname: Lee
authors.forename: Richard A
authors.initials: RA
authors.lastname: Rudick
mesh_terms: D000328:Adult; D000554:Ambulatory Care Facilities / Q000592:standards*; D015331:Cohort Studies; D005260:Female; D006801:Humans; D008137:Longitudinal Studies; D008279:Magnetic Resonance Imaging / Q000592:standards*; D008297:Male; D008875:Middle Aged; D009103:Multiple Sclerosis / Q000145:classification* / Q000473:pathology*; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D055815:Young Adult