Share Email Print

Proceedings Paper

The oscillatory activities and its synchronization in auditory-visual integration as revealed by event-related potentials to bimodal stimuli
Author(s): Jia Guo; Peng Xu; Li Yao; Hua Shu; Xiaojie Zhao
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Neural mechanism of auditory-visual speech integration is always a hot study of multi-modal perception. The articulation conveys speech information that helps detect and disambiguate the auditory speech. As important characteristic of EEG, oscillations and its synchronization have been applied to cognition research more and more. This study analyzed the EEG data acquired by unimodal and bimodal stimuli using time frequency and phase synchrony approach, investigated the oscillatory activities and its synchrony modes behind evoked potential during auditory-visual integration, in order to reveal the inherent neural integration mechanism under these modes. It was found that beta activity and its synchronization differences had relationship with gesture N1-P2, which happened in the earlier stage of speech coding to pronouncing action. Alpha oscillation and its synchronization related with auditory N1-P2 might be mainly responsible for auditory speech process caused by anticipation from gesture to sound feature. The visual gesture changing enhanced the interaction of auditory brain regions. These results provided explanations to the power and connectivity change of event-evoked oscillatory activities which matched ERPs during auditory-visual speech integration.

Paper Details

Date Published: 20 February 2012
PDF: 7 pages
Proc. SPIE 8291, Human Vision and Electronic Imaging XVII, 82911P (20 February 2012); doi: 10.1117/12.905842
Show Author Affiliations
Jia Guo, Beijing Normal Univ. (China)
Peng Xu, General Hospital Armed Police Forces (China)
Li Yao, Beijing Normal Univ. (China)
Hua Shu, Beijing Normal Univ. (China)
Xiaojie Zhao, Beijing Normal Univ. (China)

Published in SPIE Proceedings Vol. 8291:
Human Vision and Electronic Imaging XVII
Bernice E. Rogowitz; Thrasyvoulos N. Pappas; Huib de Ridder, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?