title: Is there much variation in variation? Revisiting statistics of small area variation in health services research.
abstract: BACKGROUND
  The importance of Small Area Variation Analysis for policy-making contrasts with the scarcity of work on the validity of the statistics used in these studies. Our study aims at 1) determining whether variation in utilization rates between health areas is higher than would be expected by chance, 2) estimating the statistical power of the variation statistics; and 3) evaluating the ability of different statistics to compare the variability among different procedures regardless of their rates.
  
  
  METHODS
  Parametric bootstrap techniques were used to derive the empirical distribution for each statistic under the hypothesis of homogeneity across areas. Non-parametric procedures were used to analyze the empirical distribution for the observed statistics and compare the results in six situations (low/medium/high utilization rates and low/high variability). A small scale simulation study was conducted to assess the capacity of each statistic to discriminate between different scenarios with different degrees of variation.
  
  
  RESULTS
  Bootstrap techniques proved to be good at quantifying the difference between the null hypothesis and the variation observed in each situation, and to construct reliable tests and confidence intervals for each of the variation statistics analyzed. Although the good performance of Systematic Component of Variation (SCV), Empirical Bayes (EB) statistic shows better behaviour under the null hypothesis, it is able to detect variability if present, it is not influenced by the procedure rate and it is best able to discriminate between different degrees of heterogeneity.
  
  
  CONCLUSIONS
  The EB statistics seems to be a good alternative to more conventional statistics used in small-area variation analysis in health service research because of its robustness.
authors.affiliation: Instituto Aragonés de Ciencias de la Salud, Zaragoza, Spain. ibanez@bioef.org
authors.forename: Berta
authors.initials: B
authors.lastname: Ibáñez
authors.forename: Julián
authors.initials: J
authors.lastname: Librero
authors.forename: Enrique
authors.initials: E
authors.lastname: Bernal-Delgado
authors.forename: Salvador
authors.initials: S
authors.lastname: Peiró
authors.forename: Beatriz González
authors.initials: BG
authors.lastname: López-Valcarcel
authors.forename: Natalia
authors.initials: N
authors.lastname: Martínez
authors.forename: Felipe
authors.initials: F
authors.lastname: Aizpuru