Jackson, D. and Michaelides, G. and Dewberry, Chris and Schwenke, B. and Toms, S. (2020) The implications of unconfounding multisource performance ratings. Journal of Applied Psychology 105 (3), pp. 312-329. ISSN 0021-9010.
|
Text
27809.pdf - Author's Accepted Manuscript Download (1MB) | Preview |
Abstract
The reliability of job performance ratings is a divisive topic in applied psychology because commonly reported reliability estimates are low and because such reliability estimates are often used to correct validity coefficients (LeBreton, Scherer, & James, 2014). In previous research, attention has been given to the multifaceted nature of multisource job performance ratings. However, measurement-design-relevant effects have been confounded in previous research on this topic. In separate samples from 2 different applications and measurement designs, we unconfounded effects relevant to multisource performance ratings using a Bayesian generalizability theory approach. Our results suggest that the main contributors to reliability in multisource ratings are source-related and general performance effects. Conservative estimates for reliability based on our results were in the range of .81 to .84. We raise questions for future research about corrections for validity coefficients based on criterion unreliability and about reconsidering the measurement design formally applied to multisource ratings.
Metadata
| Item Type: | Article |
|---|---|
| Additional Information: | ©American Psychological Association 2019. This paper is not the copy of record and may not exactly replicate the authoritative document published in the APA journal. Please do not copy or cite without author's permission. The final article is available, upon publication, at the DOI cited above. |
| School: | Birkbeck Faculties and Schools > Faculty of Business and Law > Birkbeck Business School |
| Depositing User: | Chris Dewberry |
| Date Deposited: | 12 Jun 2019 11:08 |
| Last Modified: | 02 Aug 2023 17:51 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/27809 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
