title: A scale for rating the quality of psychological trials for pain.
abstract: This paper reports the development of a scale for assessing the quality of reports of randomised controlled trials for psychological treatments. The Delphi method was used in which a panel of 15-12 experts generated statements relating to treatment and design components of trials. After three rounds, statements with high consensus agreement were reviewed by a second expert panel and rewritten as a scale. Evidence to support the reliability and validity of the scale is reported. Three expert and five novice raters assessed sets of 31 and 25 published trials to establish scale reliability (ICC ranges from 0.91 to 0.41 for experts and novices, respectively) and item reliability (Kappa and inter-rater agreement). The total scale score discriminated between trials globally judged as good and poor by experts, and trial quality was shown to be a function of year of publication. Uses for the scale are suggested.
authors.affiliation: Academic Unit of Psychiatry and Behavioural Sciences, University of Leeds, 15 Hyde Terrace, Leeds LS2 9JT, UK Pain Management Unit, University of Bath, Bath, UK Department of Psychology, University College London, London, UK.
authors.forename: Shona L
authors.initials: SL
authors.lastname: Yates
authors.forename: Stephen
authors.initials: S
authors.lastname: Morley
authors.forename: Christopher
authors.initials: C
authors.lastname: Eccleston
authors.forename: Amanda C
authors.initials: AC
authors.lastname: de C Williams
mesh_terms: D006801:Humans; D015201:Meta-Analysis as Topic; D010146:Pain / Q000523:psychology / Q000534:rehabilitation*; D010147:Pain Measurement; D011613:Psychotherapy; D011786:Quality Control; D016032:Randomized Controlled Trials as Topic / Q000592:standards*; D012044:Regression Analysis; D015203:Reproducibility of Results; D014894:Weights and Measures