BIROn - Birkbeck Institutional Research Online

    The internal structure of situational judgement tests reflects candidate main effects: not dimensions or situations

    Jackson, Duncan and LoPilato, A.C. and Guenole, N. and Hughes, D. and Ali, S. (2016) The internal structure of situational judgement tests reflects candidate main effects: not dimensions or situations. Journal of Occupational and Organizational Psychology 90 (1), pp. 1-27. ISSN 0963-1798.

    This is the latest version of this item.

    [img]
    Preview
    Text
    15503.pdf - Author's Accepted Manuscript
    Available under License Creative Commons Attribution Non-commercial.

    Download (1MB) | Preview

    Abstract

    Despite their popularity and capacity to predict performance, there is no clear consensus on the internal measurement characteristics of situational judgement tests (SJTs). Contemporary propositions in the literature focus on treating SJTs as methods, as measures of dimensions, or as measures of situational responses. However, empirical evidence relating to the internal structure of SJT scores is lacking. Using generalizability theory, we decomposed multiple sources of variance for three different SJTs used with different samples of job candidates (N1 = 2,320; N2 = 989; N3 = 7,934). Results consistently indicated that (a) the vast majority of reliable observed score variance reflected SJT-specific candidate main effects, analogous to a general judgment factor and that (b) the contribution of dimensions and situations to reliable SJT variance was, in relative terms, negligible. These findings do not align neatly with any of the proposals in the contemporary literature; however they do suggest an internal structure for SJTs.

    Metadata

    Item Type: Article
    Additional Information: This is the peer reviewed version of the article, which has been published in final form at the link above. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.
    Keyword(s) / Subject(s): generalizability theory, reliability, internal measurement characteristics, situational judgment tests
    School: Birkbeck Schools and Departments > School of Business, Economics & Informatics > Organizational Psychology
    Depositing User: Duncan Jackson
    Date Deposited: 08 Jul 2016 13:06
    Last Modified: 08 Feb 2020 06:32
    URI: http://eprints.bbk.ac.uk/id/eprint/15503

    Available Versions of this Item

    • The internal structure of situational judgement tests reflects candidate main effects: not dimensions or situations. (deposited 08 Jul 2016 13:06) [Currently Displayed]

    Statistics

    Downloads
    Activity Overview
    130Downloads
    105Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item