Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid.
OBJECTIVE
To test the reliability and validity of specific instructions to classify blinding, when unclearly reported in randomized trials, as "probably done" or "probably not done."


METHODS
We assessed blinding of patients, health care providers, data collectors, outcome adjudicators, and data analysts in 233 randomized trials in duplicate and independently using detailed instructions. The response options were "definitely yes," "probably yes," "probably no," and "definitely no." We contacted authors for data verification (46% response). For each of the five questions, we assessed reliability by calculating the agreement between the two reviewers and validity by calculating the agreement between reviewers' consensus and verified data.


RESULTS
The percentage with unclear blinding status varied between 48.5% (patients) and 84.1% (data analysts). Reliability was moderate for blinding of outcome adjudicators (κ=0.52) and data analysts (κ=0.42) and substantial for blinding of patients (κ=0.71), providers (κ=0.68), and data collectors (κ=0.65). The raw agreement between the consensus record and the author-verified record varied from 84.1% (blinding of data analysts) to 100% (blinding of health care providers).


CONCLUSIONS
With the possible exception of blinding of data analysts, use of "probably yes" and "probably no" instead of "unclear" may enhance the assessment of blinding in trials.
Department of Medicine, State University of New York at Buffalo, Buffalo, NY 14215, USA. elieakl@buffalo.edu
Elie A
EA
Akl
Xin
X
Sun
Jason W
JW
Busse
Bradley C
BC
Johnston
Matthias
M
Briel
Sohail
S
Mulla
John J
JJ
You
Dirk
D
Bassler
Francois
F
Lamontagne
Claudio
C
Vera
Mohamad
M
Alshurafa
Christina M
CM
Katsios
Diane
D
Heels-Ansdell
Qi
Q
Zhou
Ed
E
Mills
Gordon H
GH
Guyatt
D000465:Algorithms; D015982:Bias; D032921:Consensus; D004311:Double-Blind Method; D015340:Epidemiologic Research Design; D019983:Guideline Adherence; D017408:Guidelines as Topic; D006801:Humans; D016032:Randomized Controlled Trials as Topic / Q000379:methods* / Q000592:standards* / Q000706:statistics & numerical data; D012107:Research Design; D012196:Review Literature as Topic; D016037:Single-Blind Method