BIROn - Birkbeck Institutional Research Online

    Does it work? Using a meta-impact score to examine global effects in quasi-experimental intervention studies

    Doyle, Nancy and McDowall, Almuth and Randall, R. and Knight, K. (2022) Does it work? Using a meta-impact score to examine global effects in quasi-experimental intervention studies. PLoS One 17 (3), e0265312. ISSN 1932-6203.

    [img]
    Preview
    Text
    47767a.pdf - Published Version of Record
    Available under License Creative Commons Attribution.

    Download (510kB) | Preview

    Abstract

    The evaluation of applied psychological interventions in the workplace or elsewhere is challenging. Randomisation and matching are difficult to achieve and this often results in substantial heterogeneity within intervention and control groups. As a result, traditional comparison of group means using null hypothesis significance testing may mask effects experienced by some participants. Using longitudinal studies of coaching interventions designed to provide support for dyslexic employees, this study describes and evaluates a different approach using a Meta-Impact score. We offer a conceptual rationale for our method, illustrate how this score is calculated and analysed, and show how it highlights person-specific variations in how participants react and respond to interventions. We argue that Meta-Impact is an incremental supplement to traditional variable-centric group-wise comparisons and can more accurately demonstrate in practice the extent to which an intervention worked. Such methods are needed for applied research, where personalized intervention protocols may require impact analysis for policy, legal and ethical purposes, despite modest sample sizes.

    Metadata

    Item Type: Article
    School: School of Business, Economics & Informatics > Organizational Psychology
    Depositing User: Almuth McDowall
    Date Deposited: 18 May 2022 10:07
    Last Modified: 19 May 2022 22:38
    URI: https://eprints.bbk.ac.uk/id/eprint/47767

    Statistics

    Activity Overview
    6 month trend
    12Downloads
    6 month trend
    11Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item