A self-organized artificial neural network architecture that generates the McGurk effect

A neural network architecture, subjected to incon-gruent stimuli in the form of lip reading of spoken syllables and listening to different spoken syllables, is shown to generate the well-known McGurk effect, e.g. visual /ga/ and auditory /ba/ is perceived as /da/ by the network. The neural network is based on an architecture which has previously been successfully applied to sensory integration of congruent stimuli and is here extended to take into account that lip reading groups consonants into equivalence classes, bilabial, dento-labial and nonlabial consonants, rather than distinguishing between individual consonants.