多感覚AR-BCIの開発に向けた基礎的研究

カテゴリ: 論文誌(論文単位)

グループ名: 【C】電子・情報・システム部門

発行日: 2016/09/01

タイトル(英語): Basic Research for Development of a Multimodal AR-BCI

著者名: 関本　正志（東京大学大学院工学系研究科），下野　勇希（東京大学大学院新領域創成科学研究科），赤尾　旭彦（東京大学大学院新領域創成科学研究科），磯村　拓哉（東京大学大学院新領域創成科学研究科），小川　雄太郎（東京大学大学院新領域創成科学研究科），黄　琦（東京大学大学院工学系研究科／Harbin Institute of Technology），小谷　潔（東京大学先端科学技術研究センター／独立行政法人科学技術振興機構, さきがけ），神保　泰彦（東京大学大学院工学系研究科）

著者名(英語): Masashi Sekimoto (Graduate School of Engineering, The University of Tokyo), Yuki Shimono (Graduate School of Frontier Sciences, The University of Tokyo), Akihiko Akao (Graduate School of Frontier Sciences, The University of Tokyo), Takuya Isomura (Graduate School of Frontier Sciences, The University of Tokyo), Yutaro Ogawa (Graduate School of Frontier Sciences, The University of Tokyo), Huang Qi (Graduate School of Engineering, The University of Tokyo/Harbin Institute of Technology), Kiyoshi Kotani (Research Center for Advanced Science and Technology, The University of Tokyo/JST, PRESTO), Yasuhiko Jimbo (Graduate School of Engineering, The University of Tokyo)

キーワード: ブレイン・コンピュータ・インターフェース，拡張現実感技術，P300，脳波，多感覚　　Brain-Computer Interface，Augmented Reality，P300，Electroencephalogram，Multimodal

要約(英語): A Brain-Computer Interface (BCI) enables users who cannot move their own body freely to manipulate machines. Recently, a system which is a combination of BCI and Augmented Reality (AR) is proposed. This system can link real machines to augmented markers and realize an intuitive interface. However, conventional AR-BCI system uses only visual stimuli, so a user cannot operate machines behind him/her. To deal with this problem, we propose a multisensory AR-BCI using three dimensional stereophonic sound, which provides choices behind users by generating sounds including position information. First, we investigate the amplitude and latency of event-related potential (ERP) induced by three dimensional stereophonic sound. The result shows the latency of ERP is longer (650 ms) than conventional BCI. This result suggests that the feature should be extracted with a longer time window. Second, we compare the accuracy of separate classification with combined one under the mixed visual and auditory stimuli. The result shows separate classification is better than combined one (p<0.05). Therefore, our research proposes separate classification method which comes from the basic features of ERPs under multisensory AR-BCI system and shows the appropriateness of proposed method.

本誌: 電気学会論文誌C（電子・情報・システム部門誌） Vol.136 No.9 （2016） 特集：神経工学・サイバネティックス・生体工学

本誌掲載ページ: 1291-1297 p

原稿種別: 論文／日本語

電子版へのリンク: https://www.jstage.jst.go.jp/article/ieejeiss/136/9/136_1291/_article/-char/ja/