BIROn - Birkbeck Institutional Research Online

    Hearing faces: how the infant brain matches the face it sees with the speech it hears

    Bristow, D. and Dehaene-Lambertz, G. and Mattout, J. and Soares, C. and Gliga, Teodora and Baillet, S. and Mangin, F. (2009) Hearing faces: how the infant brain matches the face it sees with the speech it hears. Journal of Cognitive Neuroscience 21 (5), pp. 905-921. ISSN 0898-929X.

    [img]
    Preview
    Text (Refereed)
    Hearing faces.pdf - Published Version

    Download (1MB) | Preview

    Abstract

    Speech is not a purely auditory signal. From around 2 months of age, infants are able to correctly match the vowel they hear with the appropriate articulating face. However, there is no behavioral evidence of integrated audiovisual perception until 4 months of age, at the earliest, when an illusory percept can be created by the fusion of the auditory stimulus and of the facial cues (McGurk effect). To understand how infants initially match the articulatory movements they see with the sounds they hear, we recorded high-density ERPs in response to auditory vowels that followed a congruent or incongruent silently articulating face in 10-week-old infants. In a first experiment, we determined that auditory–visual integration occurs during the early stages of perception as in adults. The mismatch response was similar in timing and in topography whether the preceding vowels were presented visually or aurally. In the second experiment, we studied audiovisual integration in the linguistic (vowel perception) and nonlinguistic (gender perception) domain. We observed a mismatch response for both types of change at similar latencies. Their topographies were significantly different demonstrating that cross-modal integration of these features is computed in parallel by two different networks. Indeed, brain source modeling revealed that phoneme and gender computations were lateralized toward the left and toward the right hemisphere, respectively, suggesting that each hemisphere possesses an early processing bias. We also observed repetition suppression in temporal regions and repetition enhancement in frontal regions. These results underscore how complex and structured is the human cortical organization which sustains communication from the first weeks of life on.

    Metadata

    Item Type: Article
    School: Birkbeck Schools and Departments > School of Science > Psychological Sciences
    Research Centre: Brain and Cognitive Development, Centre for (CBCD)
    Depositing User: Sarah Hall
    Date Deposited: 14 Jan 2016 09:36
    Last Modified: 02 Dec 2016 11:44
    URI: http://eprints.bbk.ac.uk/id/eprint/13975

    Statistics

    Downloads
    Activity Overview
    121Downloads
    50Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item