title: Replication and contradiction of highly cited research papers in psychiatry: 10-year follow-up.
abstract: BACKGROUND
  Contradictions and initial overestimates are not unusual among highly cited studies. However, this issue has not been researched in psychiatry. Aims: To assess how highly cited studies in psychiatry are replicated by subsequent studies.
  
  
  METHODS
  We selected highly cited studies claiming effective psychiatric treatments in the years 2000 through 2002. For each of these studies we searched for subsequent studies with a better-controlled design, or with a similar design but a larger sample.
  
  
  RESULTS
  Among 83 articles recommending effective interventions, 40 had not been subject to any attempt at replication, 16 were contradicted, 11 were found to have substantially smaller effects and only 16 were replicated. The standardised mean differences of the initial studies were overestimated by 132%. Studies with a total sample size of 100 or more tended to produce replicable results.
  
  
  CONCLUSIONS
  Caution is needed when a study with a small sample size reports a large effect.
authors.affiliation: Aran Tajika, MD, Yusuke Ogawa, MD, MPH, PhD, Nozomi Takeshima, MD, Yu Hayasaka, MD, Toshi A. Furukawa, MD, PhD, Department of Health Promotion and Human Behaviour, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan aran.tajika28@gmail.com.
authors.forename: Aran
authors.initials: A
authors.lastname: Tajika
authors.affiliation: Aran Tajika, MD, Yusuke Ogawa, MD, MPH, PhD, Nozomi Takeshima, MD, Yu Hayasaka, MD, Toshi A. Furukawa, MD, PhD, Department of Health Promotion and Human Behaviour, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan.
authors.forename: Yusuke
authors.initials: Y
authors.lastname: Ogawa
authors.affiliation: Aran Tajika, MD, Yusuke Ogawa, MD, MPH, PhD, Nozomi Takeshima, MD, Yu Hayasaka, MD, Toshi A. Furukawa, MD, PhD, Department of Health Promotion and Human Behaviour, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan.
authors.forename: Nozomi
authors.initials: N
authors.lastname: Takeshima
authors.affiliation: Aran Tajika, MD, Yusuke Ogawa, MD, MPH, PhD, Nozomi Takeshima, MD, Yu Hayasaka, MD, Toshi A. Furukawa, MD, PhD, Department of Health Promotion and Human Behaviour, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan.
authors.forename: Yu
authors.initials: Y
authors.lastname: Hayasaka
authors.affiliation: Aran Tajika, MD, Yusuke Ogawa, MD, MPH, PhD, Nozomi Takeshima, MD, Yu Hayasaka, MD, Toshi A. Furukawa, MD, PhD, Department of Health Promotion and Human Behaviour, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan.
authors.forename: Toshi A
authors.initials: TA
authors.lastname: Furukawa
mesh_terms: D015706:Bibliometrics; D010506:Periodicals as Topic / Q000706:statistics & numerical data*; D011570:Psychiatry; D018401:Sample Size