Randomized, controlled clinical trials in sepsis: has methodological quality improved over time?
OBJECTIVE
To systematically evaluate the methodological quality of randomized clinical trials and to determine whether randomized clinical trials of sepsis improved in methodological quality over time.


METHODS
Computerized MEDLINE search of articles published in any language from 1966 to 1998 combined with a manual search of bibliographies of published articles and communication with known experts in the field.


METHODS
All randomized clinical trials of sepsis, severe sepsis, and septic shock performed in adults and published as full articles.


METHODS
Abstracts of all retrieved records were reviewed and the inclusion criteria were applied. All selected articles were classified into (a) trials designed to detect differences in mortality as the primary end point, or (b) trials focusing on surrogate outcome measures (i.e., physiological or biochemical parameters). All retrieved trials were then graded for methodological quality using an objective grading scheme developed specifically for this study. The data selection and extraction process was carried out independently by two of the authors; any disagreement was resolved by discussion.


RESULTS
Seventy-four randomized clinical trials involving septic patients qualified for inclusion in this study (40 reporting mortality outcomes, 34 reporting other surrogate outcomes). Trials reporting mortality as the primary outcome had significantly higher quality scores compared with trials reporting surrogate outcome measures (29.6 +/- 1.0 vs. 24.3 +/- 0.8, p =.0006). From 1976 to 1998, trial methodology improved significantly over time (an average of 0.36 points per year, p =.021). Mortality outcome trials improved an average of 0.58 points per year (p =.0011) whereas surrogate outcome trials did not demonstrate an improvement in methodological quality over time (p =.249).


CONCLUSIONS
The methodological limitations identified in this article can help to target further improvement in trial design to enhance the validity of findings from future randomized clinical trials of sepsis.
Graf
Jürgen
J
Medical Clinic I, Department of Cardiology, University Hospital Aachen, Aachen, Germany. jgraf@gmx.de
Doig
Gordon S
GS
Cook
Deborah J
DJ
Vincent
Jean-Louis
JL
Sibbald
William J
WJ
D000328:Adult; D017322:Clinical Trials, Phase II as Topic / Q000379:methods / Q000592:standards; D017326:Clinical Trials, Phase III as Topic / Q000379:methods / Q000592:standards; D003627:Data Interpretation, Statistical; D006801:Humans; D018579:Patient Selection; D011786:Quality Control; D016032:Randomized Controlled Trials as Topic / Q000379:methods* / Q000401:mortality / Q000592:standards*; D012107:Research Design; D018805:Sepsis / Q000628:therapy*; D016896:Treatment Outcome