カテゴリ: 論文誌(論文単位)
グループ名: 【C】電子・情報・システム部門
発行日: 2016/11/01
タイトル(英語): Gestural Interface for Conducting Virtual Concerts
著者名: Rasika Ranaweera (Spatial Media Group, University of Aizu), Michael Cohen (Spatial Media Group, University of Aizu)
著者名(英語): Rasika Ranaweera (Spatial Media Group, University of Aizu), Michael Cohen (Spatial Media Group, University of Aizu)
キーワード: Mixed reality，gesture interpretation，animation，computer music
要約(英語): We have created a mixed reality concert application using Alice, a 3d rapid prototyping programming environment, in which musical instruments are arranged around a virtual conductor (in this case the user) located at their center. A user-conductor can use a smartphone as a simplified baton, pointing at a preferred instrument and tapping a button to start playing. The volume and panning of a selected instrument can be adjusted by simply tilting and rolling the smartphone. When selected, an instrument is jiggled or its components dilated and contracted, and a spotlight illuminates it until the instrument is muted, providing conductor and audience with visual cues about the ensemble. Unlike other systems, ours does not require user or equipment to be placed at specific locations (contrasted with Kinect, Wii sensors, or camera-based tracking systems), and there is no issue regarding room lighting (such as digital camera-based tracking systems or Kinect), nor interference with other players or obstacles. The goal of using different equipment as a conductor's baton is to allow nonexpert users to lead a realtime concert within a cyberworld. Synchronization of gestures with music and animation has been one of the biggest challenges in many systems we surveyed, although ours showed only minimal delays. We compared user experience with a contemporary commercial game, receiving acceptable ratings from the participants.
本誌: 電気学会論文誌C（電子・情報・システム部門誌） Vol.136 No.11 （2016） 特集：電気関係学会関西連合大会
本誌掲載ページ: 1567-1573 p
原稿種別: 論文／英語
電子版へのリンク: https://www.jstage.jst.go.jp/article/ieejeiss/136/11/136_1567/_article/-char/ja/
