Early language as multimodal learning
Althaus, Nadja and Mareschal, Denis (2010) Early language as multimodal learning. In: Davelaar, Eddy J. (ed.) Progress in Neural Processing: Volume 20. Connectionist Models of Neurocognition and Emergent Behavior From Theory to Applications (Proceedings of the 12th Neural Computation and Psychology Workshop). London, UK: World Scientific, pp. 110-123. ISBN 9789814340342.
We introduce a model of word learning in infants based on cross-modal interactions. Our model employs an architecture consisting of two Self-organizing maps (SOMs), representing the visual and auditory modalities, which are connected by Hebbian links. In contrast to previous models using a similar architecture, our model employs active Hebbian connections which propagate activation between the visual and auditory maps during learning. Our results show that categorical perception emerges from these early audio-visual interactions in both domains. We argue that the learning mechanism introduced in our model could be behind the facilitation of infants categorization through verbal labelling reported in the literature.
|Item Type:||Book Section|
|School:||Birkbeck Schools and Departments > School of Science > Biological Sciences|
|Research Centre:||Brain and Cognitive Development, Centre for (CBCD)|
|Depositing User:||Sarah Hall|
|Date Deposited:||24 Mar 2015 16:56|
|Last Modified:||02 Dec 2016 11:09|
Additional statistics are available via IRStats2.