音声と画像シーンを用いた潜在意味解析に基づくタスク推定

カテゴリ: 論文誌(論文単位)

グループ名: 【C】電子・情報・システム部門

発行日: 2012/09/01

タイトル(英語): Task Estimation Using Latent Semantic Analysis of Visual Scenes and Spoken Words

著者名: 木村　優志（豊橋技術科学大学大学院工学研究科），澤田　心大（豊橋技術科学大学大学院工学研究科），入部　百合絵（豊橋技術科学大学大学院工学研究科），桂田　浩一（豊橋技術科学大学大学院工学研究科），新田　恒雄（豊橋技術科学大学大学院工学研究科／早稲田大学 グリーン・コンピューティング・システム研究機構）

著者名(英語): Masashi Kimura (Graduated School of Engineering, Toyohashi University of Technology), Shinta Sawada (Graduated School of Engineering, Toyohashi University of Technology), Yurie Iribe (Graduated School of Engineering, Toyohashi University of Technology), Kouichi Katsurada (Graduated School of Engineering, Toyohashi University of Technology), Tsuneo Nitta (Graduated School of Engineering, Toyohashi University of Technology/Green Computing System Research Organization, Waseda University)

キーワード: タスク推定，潜在意味解析，マルチモーダル処理　　Task Estimation，Latent Semantic Analysis，Multi-modal Processing

要約(英語): In this paper, we propose a task estimation method based on multiple subspaces extracted from multi-modal information of image objects in visual scenes and spoken words in dialog appeared in the same task. The multiple subspaces are obtained by using latent semantic analysis (LSA). In the proposed method, a task vector composed of spoken words and the frequencies of image-object appearances are extracted first, and then similarities among the input task vector and reference sub-spaces of different tasks are compared. Experiments are conducted on the identification of game tasks. Experimental results show that the proposed method with multi-modal information outperforms the method in which only single modality of image or spoken dialog is applied. Moreover, the proposed method achieved accurate performance even if less spoken dialog is applied.

本誌: 電気学会論文誌C（電子・情報・システム部門誌） Vol.132 No.9 （2012） 特集：有機半導体－材料・デバイス・評価技術

本誌掲載ページ: 1473-1480 p

原稿種別: 論文／日本語

電子版へのリンク: https://www.jstage.jst.go.jp/article/ieejeiss/132/9/132_1473/_article/-char/ja/