title: Normative comparisons for large neuropsychological test batteries: User-friendly and sensitive solutions to minimize familywise false positives.
abstract: BACKGROUND
  In neuropsychological research and clinical practice, a large battery of tests is often administered to determine whether an individual deviates from the norm. We formulate three criteria for such large battery normative comparisons. First, familywise false-positive error rate (i.e., the complement of specificity) should be controlled at, or below, a prespecified level. Second, sensitivity to detect genuine deviations from the norm should be high. Third, the comparisons should be easy enough for routine application, not only in research, but also in clinical practice. Here we show that these criteria are satisfied for current procedures used to assess an overall deviation from the norm-that is, a deviation given all test results. However, we also show that these criteria are not satisfied for current procedures used to assess test-specific deviations, which are required, for example, to investigate dissociations in a test profile. We therefore propose several new procedures to assess such test-specific deviations. These new procedures are expected to satisfy all three criteria.
  
  
  METHODS
  In Monte Carlo simulations and in an applied example pertaining to Parkinson disease, we compare current procedures to assess test-specific deviations (uncorrected and Bonferroni normative comparisons) to new procedures (Holm, one-step resampling, and step-down resampling normative comparisons).
  
  
  RESULTS
  The new procedures are shown to: (a) control familywise false-positive error rate, whereas uncorrected comparisons do not; (b) have higher sensitivity than Bonferroni corrected comparisons, where especially step-down resampling is favorable in this respect; (c) be user-friendly as they are implemented in a user-friendly normative comparisons website, and as the required normative data are provided by a database.
  
  
  CONCLUSIONS
  These new normative comparisons procedures, especially step-down resampling, are valuable additional tools to assess test-specific deviations from the norm in large test batteries.
authors.affiliation: a Department of Psychology , University of Amsterdam , Amsterdam , The Netherlands.|b Amsterdam Brain and Cognition Center , University of Amsterdam , Amsterdam , The Netherlands.|c Research Priority Area Yield , University of Amsterdam , Amsterdam , The Netherlands.
authors.forename: Hilde M
authors.initials: HM
authors.lastname: Huizenga
authors.affiliation: a Department of Psychology , University of Amsterdam , Amsterdam , The Netherlands.
authors.forename: Joost A
authors.initials: JA
authors.lastname: Agelink van Rentergem
authors.affiliation: a Department of Psychology , University of Amsterdam , Amsterdam , The Netherlands.|b Amsterdam Brain and Cognition Center , University of Amsterdam , Amsterdam , The Netherlands.
authors.forename: Raoul P P P
authors.initials: RP
authors.lastname: Grasman
authors.affiliation: d Department of Medical Psychology , Groene Hart Hospital , Gouda , The Netherlands.
authors.forename: Dino
authors.initials: D
authors.lastname: Muslimovic
authors.affiliation: a Department of Psychology , University of Amsterdam , Amsterdam , The Netherlands.|b Amsterdam Brain and Cognition Center , University of Amsterdam , Amsterdam , The Netherlands.|e Department of Medical Psychology , Academic Medical Center , Amsterdam , The Netherlands.
authors.forename: Ben
authors.initials: B
authors.lastname: Schmand
mesh_terms: D003072:Cognition Disorders / Q000175:diagnosis* / Q000209:etiology; D003627:Data Interpretation, Statistical; D006801:Humans; D009483:Neuropsychological Tests / Q000592:standards*; D009484:Neuropsychology / Q000592:standards*; D010300:Parkinson Disease / Q000150:complications; D012107:Research Design / Q000592:standards*; D012680:Sensitivity and Specificity
keywords: Bonferroni and Holm; Criteria for abnormality in neuropsychology; familywise false-positive error rate; normative comparisons; one-step and step-down resampling; simulations