Comparison of expert-rater methods for assessing psychosocial job strain.
OBJECTIVE
This study tested the reliability and validity of industry- and mill-level expert methods for measuring psychosocial work conditions in British Columbia sawmills using the demand-control model.


METHODS
In the industry-level method 4 sawmill job evaluators estimated psychosocial work conditions at a generic sawmill. In the mill-level method panels of experienced sawmill workers estimated psychosocial work conditions at 3 sawmills. Scores for psychosocial work conditions were developed using both expert methods and applied to job titles in a sawmill worker database containing self-reported health status and heart disease. The interrater reliability and the concurrent and predictive validity of the expert rater methods were assessed.


RESULTS
The interrater reliability and concurrent reliability were higher for the mill-level method than for the industry-level method. For all the psychosocial variables the reliability for the mill-level method was greater than 0.90. The predictive validity results were inconclusive.


CONCLUSIONS
The greater reliability and concurrent validity of the mill-level method indicates that panels of experienced workers should be considered as potential experts in future studies measuring psychosocial work conditions.
Department of Health Care and Epidemiology, Vancouver, Canada. ostry@interchange.ubc.ca
A S
AS
Ostry
S A
SA
Marion
P A
PA
Demers
R
R
Hershler
S
S
Kelly
K
K
Teschke
C
C
Mustard
C
C
Hertzman
D000328:Adult; D001955:British Columbia; D016001:Confidence Intervals; D003625:Data Collection; D005260:Female; D016468:Forestry; D006801:Humans; D016015:Logistic Models; D008297:Male; D008875:Middle Aged; D009784:Occupational Diseases / Q000175:diagnosis*; D016272:Occupational Health; D016017:Odds Ratio; D011237:Predictive Value of Tests; D011584:Psychology; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013315:Stress, Psychological / Q000175:diagnosis*; D013647:Task Performance and Analysis; D016526:Workload