BIROn - Birkbeck Institutional Research Online

    Does it work? Using a meta-impact score to examine global effects in quasi-experimental intervention studies

    Doyle, Nancy and McDowall, Almuth and Randall, R. and Knight, K. (2022) Does it work? Using a meta-impact score to examine global effects in quasi-experimental intervention studies. PLoS One 17 (3), e0265312. ISSN 1932-6203.

    47767a.pdf - Published Version of Record
    Available under License Creative Commons Attribution.

    Download (510kB) | Preview


    The evaluation of applied psychological interventions in the workplace or elsewhere is challenging. Randomisation and matching are difficult to achieve and this often results in substantial heterogeneity within intervention and control groups. As a result, traditional comparison of group means using null hypothesis significance testing may mask effects experienced by some participants. Using longitudinal studies of coaching interventions designed to provide support for dyslexic employees, this study describes and evaluates a different approach using a Meta-Impact score. We offer a conceptual rationale for our method, illustrate how this score is calculated and analysed, and show how it highlights person-specific variations in how participants react and respond to interventions. We argue that Meta-Impact is an incremental supplement to traditional variable-centric group-wise comparisons and can more accurately demonstrate in practice the extent to which an intervention worked. Such methods are needed for applied research, where personalized intervention protocols may require impact analysis for policy, legal and ethical purposes, despite modest sample sizes.


    Item Type: Article
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Psychological Sciences
    Research Centres and Institutes: Neurodiversity At Work, Centre for
    Depositing User: Almuth McDowall
    Date Deposited: 18 May 2022 10:07
    Last Modified: 07 Aug 2023 16:12


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item