Evaluation of internal reliability in the presence of inconsistent responses.
BACKGROUND
We aimed to assess the impact of inconsistent responses on the internal reliability of a multi-item scale by developing a procedure to adjust Cronbach's alpha.


METHODS
A procedure for adjusting Cronbach's alpha when there are inconsistent responses was developed and used to assess the impact of inconsistent responses on internal reliability by evaluating the standard Chinese 12-item Short Form Health Survey in adolescents.


RESULTS
Contrary to common belief, random responses may inflate Cronbach's alpha when their mean differ from that of the true responses. Fixed responses inflate Cronbach's alpha except in scales with both positive and negative polarity items. In general, the bias in Cronbach's alpha due to inconsistent responses may change from negative to positive with an increasing number of items in a scale, but the effect of additional items beyond around 10 becomes small. The number of response categories does not have much influence on the impact of inconsistent responses.


CONCLUSIONS
Cronbach's alpha can be biased when there are inconsistent responses, and an adjustment is recommended for better assessment of the internal reliability of a multi-item scale.
Fong
Daniel Y T
DY
School of Nursing, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam Road, Hong Kong. dytfong@hku.hk
Ho
S Y
SY
Lam
T H
TH
D000293:Adolescent; D006306:Health Surveys / Q000379:methods / Q000592:standards*; D006801:Humans; D011594:Psychometrics; D019057:Quality-Adjusted Life Years; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires / Q000592:standards*