Mital, P.K. and Grierson, M. and Smith, Tim J. (2013) Corpus-based visual synthesis. In: UNSPECIFIED (ed.) Proceedings of the ACM Symposium on Applied Perception - SAP '13. New York, U.S.: Association For Computing Machinery, pp. 51-58. ISBN 9781450322621.
Abstract
We investigate an approach to the artistic stylization of photographic images and videos that uses an understanding of the role of abstract representations in art and perception. We first learn a database of representations from a corpus of images or image sequences. Using this database, our approach synthesizes a target image or video by matching geometric representations in the target to the closest matches in the database based on their shape and color similarity. We show how changing a few parameters of the synthesis process can result in stylizations that represent aesthetics associated with Impressionist, Cubist, and Abstract Expressionist paintings. As the stylization process is fast enough to work in real-time, our approach can also be used to learn and synthesize the same camera image, even aggregating the database with each new video frame in real-time, a process we call "Memory Mosaicing". Finally, we report the user feedback of 21 participants using an augmented reality version of "Memory Mosaicing" in an installation called Augmented Reality Hallucinations, where the target scene and database came from a camera mounted on augmented reality goggles. This information was collected during an exhibition of 15,000 participants at the Digital Design Weekend at the Victoria and Albert Museum (co-located during the London Design Festival).
Metadata
| Item Type: | Book Section |
|---|---|
| School: | Birkbeck Faculties and Schools > Faculty of Science > School of Psychological Sciences |
| Research Centres and Institutes: | Moving Image, Birkbeck Institute for the (BIMI), Brain and Cognitive Development, Centre for (CBCD) |
| Depositing User: | Administrator |
| Date Deposited: | 29 Jul 2015 12:41 |
| Last Modified: | 02 Aug 2023 17:18 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/12600 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
