title: Analysis of scientific truth status in controlled rehabilitation trials.
abstract: OBJECTIVE
  Systematic reviews, meta-analyses and clinical guidelines (reviews) are intended to inform clinical practice, and in this sense can be thought of as scientific truthmakers. High-quality controlled trials should align to this truth, and method quality markers should predict truth status. We sought to determine in what way controlled trial quality relates to scientific truth, and to determine predictive utility of trial quality and bibliographic markers.
  
  
  METHODS
  A sample of reviews in rehabilitation medicine was examined. Two scientific truth dimensions were established based on review outcomes. Quality and bibliographic markers were extracted from associated trials for use in a regression analysis of their predictive utility for trial truth status. Probability analysis was undertaken to examine judgments of future trial truth status.
  
  
  RESULTS
  Of the 93 trials included in contemporaneous reviews, overall, n = 45 (48%) were true. Randomization was found more in true trials than false trials in one truth dimension (P = 0.03). Intention-to-treat analysis was close to significant in one truth dimension (P = 0.058), being more commonly used in false trials. There were no other significant differences in quality or bibliographic variables between true and false trials. Regression analysis revealed no significant predictors of trial truth status. Probability analysis reported that the reasonable chance of future trials being true was between 2 and 5%, based on a uniform prior.
  
  
  CONCLUSIONS
  The findings are at odds with what is considered gold-standard research methods, but in line with previous reports. Further work should focus on scientific dynamics within healthcare research and evidence-based practice constructs.
authors.affiliation: Division of Physiotherapy Education, University of Nottingham, Nottingham, UK. roger.kerry@nottingham.ac.uk
authors.forename: Roger
authors.initials: R
authors.lastname: Kerry
authors.forename: Aurélien
authors.initials: A
authors.lastname: Madouasse
authors.forename: Antony
authors.initials: A
authors.lastname: Arthur
authors.forename: Stephen D
authors.initials: SD
authors.lastname: Mumford
mesh_terms: D015706:Bibliometrics; D055317:Evidence-Based Practice / Q000592:standards*; D006801:Humans; D026741:Physical Therapy Modalities / Q000458:organization & administration* / Q000592:standards; D016032:Randomized Controlled Trials as Topic / Q000592:standards*; D012044:Regression Analysis; D015203:Reproducibility of Results; D012107:Research Design