Improving the measurement accuracy of the effort-reward imbalance scales.
BACKGROUND
The effort-reward imbalance (ERI) scale items are answered in a two-step process, but the justification is questioned for the formulation of summary measure by combining information rated in two steps.


OBJECTIVE
To examine whether the basic prerequisites of the ERI scales are empirically satisfied and to seek ways to improve the rating procedure.


METHODS
A polytomous item response theory (IRT) model was applied to the responses of 20,256 workers who completed the ERI scales. To determine the most appropriate statistical justification, three alternative scoring algorithms were compared with regard to the test properties revealed by the IRT analyses and efficiencies of screening performance and criterion validity against depressive symptomatology.


RESULTS
The rated raw-score units did not reflect the hypothesized order of lowest stress levels to highest stress levels. Exchanging or collapsing the lowest two categories of a Likert scaled item, where data of different quality are combined, solved this problem, thereby making the test content more appropriate. The modified rating improved the efficiencies of screening performance and the correlation of the stress summary measures against health criterion, i.e., depression.


CONCLUSIONS
An avoidable measurement error exists in the current ERI scales. Modifying the rating procedure can improve the measurement accuracy.
Tsutsumi
Akizumi
A
Occupational Health Training Center, University of Occupational and Environmental Health, Noboru Iwata, Japan. . tsutsumi@med.uoeh-u.ac.jp
Iwata
Noboru
N
Wakita
Takafumi
T
Kumagai
Ryuichi
R
Noguchi
Hiroyuki
H
Kawakami
Norito
N
D000328:Adult; D000368:Aged; D000465:Algorithms; D003469:Culture; D005260:Female; D006801:Humans; D007588:Job Satisfaction; D008297:Male; D008875:Middle Aged; D010555:Personality Inventory / Q000706:statistics & numerical data*; D005082:Physical Exertion; D011594:Psychometrics / Q000706:statistics & numerical data; D015203:Reproducibility of Results; D012201:Reward; D012931:Social Environment; D013315:Stress, Psychological / Q000150:complications / Q000523:psychology; D016526:Workload / Q000523:psychology