title: The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings.
abstract: Although research has shown that individual job performance changes over time, the extent of such changes is unknown. In this article, the authors define and distinguish between the concepts of temporal consistency, stability, and test-retest reliability when considering individual job performance ratings over time. Furthermore, the authors examine measurement type (i.e., subjective and objective measures) and job complexity in relation to temporal consistency, stability, and test-retest reliability. On the basis of meta-analytic results, the authors found that the test-retest reliability of these ratings ranged from .83 for subjective measures in low-complexity jobs to .50 for objective measures in high-complexity jobs. The stability of these ratings over a 1-year time lag ranged from .85 to .67. The analyses also reveal that correlations between performance measures decreased as the time interval between performance measurements increased, but the estimates approached values greater than zero.
authors.affiliation: School of Hotel Administration, Cornell University, Ithaca, NY 14853, USA. mcs5@cornell.edu
authors.forename: Michael C
authors.initials: MC
authors.lastname: Sturman
authors.forename: Robin A
authors.initials: RA
authors.lastname: Cheramie
authors.forename: Luke H
authors.initials: LH
authors.lastname: Cashen
mesh_terms: D004650:Employee Performance Appraisal; D006801:Humans; D008137:Longitudinal Studies; D008962:Models, Theoretical; D009790:Occupations; D015203:Reproducibility of Results; D013647:Task Performance and Analysis; D013997:Time Factors