Doyle, Nancy and McDowall, Almuth and Randall, R. and Knight, K. (2022) Does it work? Using a meta-impact score to examine global effects in quasi-experimental intervention studies. PLoS One 17 (3), e0265312. ISSN 1932-6203.
|
Text
47767a.pdf - Published Version of Record Available under License Creative Commons Attribution. Download (510kB) | Preview |
Abstract
The evaluation of applied psychological interventions in the workplace or elsewhere is challenging. Randomisation and matching are difficult to achieve and this often results in substantial heterogeneity within intervention and control groups. As a result, traditional comparison of group means using null hypothesis significance testing may mask effects experienced by some participants. Using longitudinal studies of coaching interventions designed to provide support for dyslexic employees, this study describes and evaluates a different approach using a Meta-Impact score. We offer a conceptual rationale for our method, illustrate how this score is calculated and analysed, and show how it highlights person-specific variations in how participants react and respond to interventions. We argue that Meta-Impact is an incremental supplement to traditional variable-centric group-wise comparisons and can more accurately demonstrate in practice the extent to which an intervention worked. Such methods are needed for applied research, where personalized intervention protocols may require impact analysis for policy, legal and ethical purposes, despite modest sample sizes.
Metadata
| Item Type: | Article |
|---|---|
| School: | Birkbeck Faculties and Schools > Faculty of Science > School of Psychological Sciences |
| Research Centres and Institutes: | Neurodiversity At Work, Centre for |
| Depositing User: | Almuth Mcdowall |
| Date Deposited: | 18 May 2022 10:07 |
| Last Modified: | 07 Aug 2023 16:12 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/47767 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
