Multi-order Rule Accumulation for an Agent Control Problem in Non-Markov Environments

カテゴリ: 論文誌(論文単位)

グループ名: 【C】電子・情報・システム部門

発行日: 2012/11/01

タイトル(英語): Multi-order Rule Accumulation for an Agent Control Problem in Non-Markov Environments

著者名: Lutao Wang (Graduate School of Information, Production and Systems, Waseda University), Shingo Mabu (Graduate School of Information, Production and Systems, Waseda University), Kotaro Hirasawa (Graduate School of Information, Production and Systems, Wased

著者名(英語): Lutao Wang (Graduate School of Information, Production and Systems, Waseda University), Shingo Mabu (Graduate School of Information, Production and Systems, Waseda University), Kotaro Hirasawa (Graduate School of Information, Production and Systems, Waseda University)

キーワード: Non-Markov Environment，POMDP，GNP，Multi-order Rule，Multi-agent System，Tile-world

要約(英語): Multi-agent control in non-Markov environments is difficult because the environment information is partially observable. Agents suffer from the perceptual aliasing problem and couldn't take proper actions. In order to solve this problem, this paper proposes a rule-based model named “multi-order rule accumulation” to guide agent's actions in non-Markov environments. The advantages are, firstly, each multi-order rule memorizes the past environment information and agent's actions, which serves as the additional information to distinguish the aliasing situations, secondly, multi-order rules are very general, so that they are competent for guiding agents' actions in Partial Observable Markov Decision Process (POMDP), thirdly, multi-order rules are accumulated throughout the generations, which could cover many situations experienced in different generations. This also helps agents to take proper actions. Simulations on the tile-world problem prove that this rule-based model outperforms the conventional methods and the previous research.

本誌: 電気学会論文誌C（電子・情報・システム部門誌） Vol.132 No.11 （2012） 特集：電気関係学会関西連合大会

本誌掲載ページ: 1819-1828 p

原稿種別: 論文／英語

電子版へのリンク: https://www.jstage.jst.go.jp/article/ieejeiss/132/11/132_1819/_article/-char/ja/