BIROn - Birkbeck Institutional Research Online

    Beyond experiments

    Northcott, Robert and Diener, E. and Zyphur, M. and West, S. (2021) Beyond experiments. Perspectives on Psychological Science , ISSN 1745-6916. (In Press)

    [img]
    Preview
    Text (Reuse is restricted to non-commercial and no derivative uses)
    Diener-Beyond-Experiments-final.pdf - Author's Accepted Manuscript

    Download (362kB) | Preview

    Abstract

    It is often claimed that only experiments can support strong causal inferences and therefore they should be privileged in the behavioral sciences. We disagree. Overvaluing experiments results in their overuse both by researchers and decision-makers, and in an underappreciation of their shortcomings. Neglecting other methods often follows. Experiments can suggest whether X causes Y in a specific experimental setting; however, they often fail to elucidate either the mechanisms responsible for an effect, or the strength of an effect in everyday natural settings. In this paper, we consider two overarching issues. First, experiments have important limitations. We highlight problems with: external, construct, statistical conclusion, and internal validity; replicability; and with conceptual issues associated with simple X-causes-Y thinking. Second, quasi-experimental and non-experimental methods are absolutely essential. As well as themselves estimating causal effects, these other methods can provide information and understanding that goes beyond that provided by experiments. A research program progresses best when experiments are not treated as privileged but instead are combined with these other methods.

    Metadata

    Item Type: Article
    School: School of Social Sciences, History and Philosophy > Philosophy
    Depositing User: Robert Northcott
    Date Deposited: 20 Jul 2021 09:29
    Last Modified: 20 Aug 2021 00:10
    URI: https://eprints.bbk.ac.uk/id/eprint/45063

    Statistics

    Downloads
    Activity Overview
    0Downloads
    0Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item