オプティカルフローと韻律情報を用いた発話態度の識別

カテゴリ: 論文誌(論文単位)

グループ名: 【C】電子・情報・システム部門

発行日: 2016/03/01

タイトル(英語): Discrimination of Positive/Negative Attitude using Optical flow and Prosody Information

著者名: 小林　勇太（金沢大学大学院 自然科学研究科），中村　宗広（名古屋工業大学大学院 工学研究科 おもひ領域），南保　英孝（金沢大学大学院 自然科学研究科），木村　春彦（金沢大学大学院 自然科学研究科）

著者名(英語): Yuta Kobayashi (Graduate school of Natural Science and Technology, Kanazawa University), Munehiro Nakamura (Graduate School of Engineering, Nagoya Institute of Technology), Hidetaka Nambo (Graduate school of Natural Science and Technology, Kanazawa University), Haruhiko Kimura (Graduate school of Natural Science and Technology, Kanazawa University)

キーワード: 表情認識，オプティカルフロー，識別器，韻律情報　　facial expression，optical flow，classifier，prosody information

要約(英語): Nonlinguistic information such as facial expression, gesture, and tone of voice plays an essential rule in communication between humans. However, most human-machine interfaces are not designed to utilize nonlinguistic information. In order to develop a natural human-machine interface, this paper presents a system for discriminating positive-negative attitudes from nonlinguistic information. Our system utilizes prosody information and natural facial expression observed in a dialogue. For example, the questioner asks a subject to do something, e.g. “Won't you go shopping with me?”. And then, the subject shows an ambiguous response, e.g. “Umm, shopping. .. ”. The proposed system analyzes the prosody information and facial expression obtained from the subject. The system combines optical flows and prosody information to increase the accuracy in the discrimination. Evaluation experiments using 678 videos obtained from 23 subjects have shown that our system achieved 81.4% accuracy, which is 4.8% higher in the case when only optical flows were used as training data and 13.8% higher in the case when only prosody information was used as training data.

本誌: 電気学会論文誌C（電子・情報・システム部門誌） Vol.136 No.3 （2016） 特集：機械学習が拓くシステムイノベーション

本誌掲載ページ: 401-408 p

原稿種別: 論文／日本語

電子版へのリンク: https://www.jstage.jst.go.jp/article/ieejeiss/136/3/136_401/_article/-char/ja/