title: Problems of reliability and validity with similarity derived from category fluency.
abstract: This study aims to assess the reliability and the validity of exemplar similarity derived from category fluency tasks. A homogeneous sample of 21 healthy participants completed a category fluency task twice with an interval of one week. They also rated pairs comprised of the most frequently generated exemplars in terms of similarity. Similarities were derived from the fluency data by determining the average distance between generated exemplars and correcting it for repetitions and response sequence length. We calculated the correlation between the similarities derived from the two sessions of the fluency task and between the derived similarities and the directly rated similarities. Spatial representations of the similarities were constructed using multidimensional scaling to visualize the differences between both sessions of the fluency task and the pairwise rating task. We find that the derived similarities are not stable in time and show little correspondence with directly rated similarities. The differences between similarities derived from category fluency tasks in healthy participants, indicate that similar differences between healthy controls and patients with mental disorders, do not necessarily point to a semantic impairment of the latter, but rather reflect the unreliability of the data.
authors.forename: Anne
authors.initials: A
authors.lastname: White
authors.forename: Wouter
authors.initials: W
authors.lastname: Voorspoels
authors.forename: Gert
authors.initials: G
authors.lastname: Storms
authors.forename: Steven
authors.initials: S
authors.lastname: Verheyen
mesh_terms: D000293:Adolescent; D000328:Adult; D000544:Alzheimer Disease / Q000175:diagnosis / Q000523:psychology; D005260:Female; D006801:Humans; D007807:Language Tests / Q000706:statistics & numerical data*; D008297:Male; D009483:Neuropsychological Tests / Q000706:statistics & numerical data*; D011594:Psychometrics / Q000706:statistics & numerical data; D012016:Reference Values; D015203:Reproducibility of Results; D012660:Semantics; D013068:Speech Production Measurement / Q000706:statistics & numerical data; D013223:Statistics as Topic; D014825:Vocabulary; D055815:Young Adult