Exploring the mechanism of multimodal integration using multimodal illusion and EEG experiment

カテゴリ: 部門大会

論文No: TC4-2-9

グループ名: 【C】2024年電気学会電子・情報・システム部門大会

発行日: 2024/08/28

タイトル(英語): Exploring the mechanism of multimodal integration using multimodal illusion and EEG experiment

著者名: 許 鶴馨（東京大学）,Huang Yiyuan（東京大学 ニューロインテリジェンス国際研究機構）,Yaron Amit（東京大学 ニューロインテリジェンス国際研究機構）,白松（磯口） 知世（東京大学）,Chao Zenas（東京大学 ニューロインテリジェンス国際研究機構）,高橋 宏知（東京大学）

著者名(英語): Hexin Xu (The University of Tokyo),Yiyuan Huang (The University of Tokyo),Amit Yaron (The University of Tokyo),Tomoyo Shiramatsu Isoguchi (The University of Tokyo),Zenas Chao (The University of Tokyo),Hirokazu Takahashi (The University of Tokyo)

キーワード: 多感覚錯覚|オッドボール課題|多感覚統合|ミスマッチ陰性電位|個人差感覚モダリティ|multimodal illusion|oddball paradigm|multimodal integration|mismatch negativity|individual differencesensory modality

要約(日本語): Multimodal illusion, happens when conflict information from different sensory modalities were received, serves as an optimal paradigm for multisensory integration studies. In this context, we refined an auditory-dominant illusion and proved that the dominant sensory modality could be changed by modulating the intensity of auditory stimuli. Moreover, individual differences were observed in the psychophysical experiment.
Building on these psychophysical results, we further conducted an EEG study using auditory, visual, and audiovisual oddball paradigms. The EEG study aims to find connections between behavioral results and brain wave features and holds promise in fields of neural and cognition science if the possibility of using MMN as an indicator of multimodal integration is proven.