BIROn - Birkbeck Institutional Research Online

    The Scene Perception & Event Comprehension Theory (SPECT) applied to visual narratives

    Loschky, L.C. and Larson, A.M. and Smith, Tim J. and Magliano, J.P. (2020) The Scene Perception & Event Comprehension Theory (SPECT) applied to visual narratives. Topics in Cognitive Science 12 (1), pp. 311-351. ISSN 1756-8757.

    [img]
    Preview
    Text
    29054.pdf - Published Version of Record
    Available under License Creative Commons Attribution.

    Download (5MB) | Preview

    Abstract

    Understanding how people comprehend visual narratives (including picture stories, comics, and film) requires the combination of traditionally separate theories that span the initial sensory and perceptual processing of complex visual scenes, the perception of events over time, and comprehension of narratives. Existing piecemeal approaches fail to capture the interplay between these levels of processing. Here, we propose the Scene Perception & Event Comprehension Theory (SPECT), as applied to visual narratives, which distinguishes between front‐end and back‐end cognitive processes. Front‐end processes occur during single eye fixations and are comprised of attentional selection and information extraction. Back‐end processes occur across multiple fixations and support the construction of event models, which reflect understanding of what is happening now in a narrative (stored in working memory) and over the course of the entire narrative (stored in long‐term episodic memory). We describe relationships between front‐ and back‐end processes, and medium‐specific differences that likely produce variation in front‐end and back‐end processes across media (e.g., picture stories vs. film). We describe several novel research questions derived from SPECT that we have explored. By addressing these questions, we provide greater insight into how attention, information extraction, and event model processes are dynamically coordinated to perceive and understand complex naturalistic visual events in narratives and the real world.

    Metadata

    Item Type: Article
    Keyword(s) / Subject(s): Scene perception, Event perception, Narrative comprehension, Visual narratives, Film, Comics, Eye movements, Attention
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Psychological Sciences
    Depositing User: Administrator
    Date Deposited: 23 Sep 2019 09:36
    Last Modified: 02 Aug 2023 17:54
    URI: https://eprints.bbk.ac.uk/id/eprint/29054

    Statistics

    Activity Overview
    6 month trend
    388Downloads
    6 month trend
    402Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item
    Edit/View Item