Reinforcement Learning with Autonomous Segmentation for Continuous State and Action Spaces

DOI Web Site 1 Citations 15 References
  • YAMADA Kazuaki
    Research Center for Advanced Science and Technology, The University of Tokyo
  • OHKURA Kazuhiro
    Faculty of Engineering, Kobe University
  • UEDA Kanji
    Research into Artifacts, Center for Engineering, The University of Tokyo

Bibliographic Information

Other Title
  • 連続な状態・行動空間の自律的分割機構を持つ強化学習法
  • レンゾク ナ ジョウタイ コウドウ クウカン ノ ジリツテキ ブンカツ キコウ オ モツ キョウカ ガクシュウホウ

Search this article

Description

One of major research topics for behavior-based AI is to construct an appropriate sensor-motor, relation for an autonomous moving robot in an embedded environment, hopefully, with less preliminary setting by an autonomous robot designer. This paper proposes a new reinforcement learning algorithm, which is called the Continuous Space Classifier Generator (CSCG), for this problem. The major attraction of CSCG is that the state space and the action space of a learning agent are segmented simultaneously with the process of its behavior rule acquisition in the embedded environment. This means that a robot designer can be released from the segmentation of those two spaces, which is often crucial to the success of reinforcement learning. After showing the detail of CSCG, not only computer simulations but also experiments using a small real robot are conducted in order to illustrate the learning process of the proposed method.

Journal

Citations (1)*help

See more

References(15)*help

See more

Keywords

Details 詳細情報について

Report a problem

Back to top