BIROn - Birkbeck Institutional Research Online

    Early language as multimodal learning

    Althaus, Nadja and Mareschal, Denis (2010) Early language as multimodal learning. In: Davelaar, Eddy J. (ed.) Progress in Neural Processing: Volume 20. Connectionist Models of Neurocognition and Emergent Behavior From Theory to Applications (Proceedings of the 12th Neural Computation and Psychology Workshop). London, UK: World Scientific, pp. 110-123. ISBN 9789814340342.

    Full text not available from this repository.


    We introduce a model of word learning in infants based on cross-modal interactions. Our model employs an architecture consisting of two Self-organizing maps (SOMs), representing the visual and auditory modalities, which are connected by Hebbian links. In contrast to previous models using a similar architecture, our model employs active Hebbian connections which propagate activation between the visual and auditory maps during learning. Our results show that categorical perception emerges from these early audio-visual interactions in both domains. We argue that the learning mechanism introduced in our model could be behind the facilitation of infants categorization through verbal labelling reported in the literature.


    Item Type: Book Section
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Natural Sciences
    Research Centres and Institutes: Brain and Cognitive Development, Centre for (CBCD)
    Depositing User: Sarah Hall
    Date Deposited: 24 Mar 2015 16:56
    Last Modified: 02 Aug 2023 17:15


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item