BIROn - Birkbeck Institutional Research Online

    Corpus-based visual synthesis

    Mital, P.K. and Grierson, M. and Smith, Tim J. (2013) Corpus-based visual synthesis. In: UNSPECIFIED (ed.) Proceedings of the ACM Symposium on Applied Perception - SAP '13. New York, U.S.: Association For Computing Machinery, pp. 51-58. ISBN 9781450322621.

    Full text not available from this repository.


    We investigate an approach to the artistic stylization of photographic images and videos that uses an understanding of the role of abstract representations in art and perception. We first learn a database of representations from a corpus of images or image sequences. Using this database, our approach synthesizes a target image or video by matching geometric representations in the target to the closest matches in the database based on their shape and color similarity. We show how changing a few parameters of the synthesis process can result in stylizations that represent aesthetics associated with Impressionist, Cubist, and Abstract Expressionist paintings. As the stylization process is fast enough to work in real-time, our approach can also be used to learn and synthesize the same camera image, even aggregating the database with each new video frame in real-time, a process we call "Memory Mosaicing". Finally, we report the user feedback of 21 participants using an augmented reality version of "Memory Mosaicing" in an installation called Augmented Reality Hallucinations, where the target scene and database came from a camera mounted on augmented reality goggles. This information was collected during an exhibition of 15,000 participants at the Digital Design Weekend at the Victoria and Albert Museum (co-located during the London Design Festival).


    Item Type: Book Section
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Psychological Sciences
    Research Centres and Institutes: Moving Image, Birkbeck Institute for the (BIMI), Brain and Cognitive Development, Centre for (CBCD)
    Depositing User: Administrator
    Date Deposited: 29 Jul 2015 12:41
    Last Modified: 02 Aug 2023 17:18


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item