Rating scales, scales of measurement, issues of reliability: resolving some critical issues for clinicians and researchers.
We focus upon several broad issues that are of concern to clinicians and clinical researchers in the areas of biobehavioral and biomedical research, including, but not limited to, the fields of psychiatry, psychology, neuropsychology, and neurology. These issues are the critical reassessment of S. S. Stevens' quadripartite conceptualization of scales of measurement; the application of criteria to determine the clinical significance of reliability estimates; the detection of subsets of reliable and unreliable raters, when the overall level is of little clinical import; and finally, the application of Kappa statistics when multiple raters evaluate a single case.
Cicchetti
Domenic
D
Department of Biometry, Yale University School of Medicine, New Haven, Connecticut, USA.
Bronen
Richard
R
Spencer
Susan
S
Haut
Sheryl
S
Berg
Anne
A
Oliver
Patricia
P
Tyrer
Peter
P
D035841:Behavioral Research / Q000379:methods / Q000706:statistics & numerical data; D035843:Biomedical Research / Q000379:methods / Q000706:statistics & numerical data; D001699:Biometry / Q000379:methods; D003866:Depressive Disorder / Q000145:classification / Q000175:diagnosis / Q000523:psychology; D017408:Guidelines as Topic; D006801:Humans; D015588:Observer Variation; D011569:Psychiatric Status Rating Scales / Q000706:statistics & numerical data*; D011594:Psychometrics; D015203:Reproducibility of Results; D012107:Research Design / Q000592:standards / Q000706:statistics & numerical data*