title: Operational definitions for the NINDS-AIREN criteria for vascular dementia: an interobserver study.
abstract: OBJECTIVE
  Vascular dementia (VaD) is thought to be the most common cause of dementia after Alzheimer's disease. The commonly used International Workshop of the National Institute of Neurological Disorders and Stroke (NINDS) and the Association Internationale pour la Recherche et l'Enseignement en Neurosciences (AIREN) criteria for VaD necessitate evidence of vascular disease on CT or MRI of the brain. The purposes of our study were to operationalize the radiological part of the NINDS-AIREN criteria and to assess the effect of this operationalization on interobserver agreement.
  
  
  METHODS
  Six experienced and 4 inexperienced observers rated a set of 40 MRI studies of patients with clinically suspected VaD twice using the NINDS-AIREN set of radiological criteria. After the first reading session, operational definitions were conceived, which were subsequently used in the second reading session. Interobserver reproducibility was measured by Cohen's kappa.
  
  
  RESULTS
  Overall agreement at the first reading session was poor (kappa=0.29) and improved slightly after application of the additional definitions (kappa=0.38). Raters in the experienced group improved their agreement from almost moderate (kappa=0.39) to good (0.62). The inexperienced group started out with poor agreement (kappa=0.17) and did not improve (kappa=0.18). The experienced group improved in both the large- and small-vessel categories, whereas the inexperienced group improved generally in the extensive white matter hyperintensities categories.
  
  
  CONCLUSIONS
  Considerable interobserver variability exists for the assessment of the radiological part of the NINDS-AIREN criteria. Use of operational definitions improves agreement but only for already experienced observers.
authors.affiliation: Department of Neurology and Alzheimer Center, VU Medical Center, De Boelelaan 1117, PO Box 7057, 1007 MB Amsterdam, Netherlands. i.vanstraaten@vumc.nl
authors.forename: Elisabeth C W
authors.initials: EC
authors.lastname: van Straaten
authors.forename: Philip
authors.initials: P
authors.lastname: Scheltens
authors.forename: Dirk L
authors.initials: DL
authors.lastname: Knol
authors.forename: Mark A
authors.initials: MA
authors.lastname: van Buchem
authors.forename: Ewout J
authors.initials: EJ
authors.lastname: van Dijk
authors.forename: Paul A M
authors.initials: PA
authors.lastname: Hofman
authors.forename: Giorgos
authors.initials: G
authors.lastname: Karas
authors.forename: Olafur
authors.initials: O
authors.lastname: Kjartansson
authors.forename: Frank-Erik
authors.initials: FE
authors.lastname: de Leeuw
authors.forename: Niels D
authors.initials: ND
authors.lastname: Prins
authors.forename: Reinhold
authors.initials: R
authors.lastname: Schmidt
authors.forename: Marieke C
authors.initials: MC
authors.lastname: Visser
authors.forename: Henry C
authors.initials: HC
authors.lastname: Weinstein
authors.forename: Frederik
authors.initials: F
authors.lastname: Barkhof
mesh_terms: D001921:Brain / Q000098:blood supply; D015140:Dementia, Vascular / Q000175:diagnosis* / Q000453:epidemiology*; D006801:Humans; D008279:Magnetic Resonance Imaging / Q000592:standards / Q000706:statistics & numerical data*; D009426:Netherlands / Q000453:epidemiology; D015588:Observer Variation; D015203:Reproducibility of Results