Controlling an Autonomous Agent for Exploring Unknown Environments using Switching Prelearned Modules

  • Hata Takahito
    Graduate School of Environment and Information Sciences, Yokohama National University
  • Suganuma Masanori
    Graduate School of Environment and Information Sciences, Yokohama National University
  • Nagao Tomoharu
    Graduate School of Environment and Information Sciences, Yokohama National University

Bibliographic Information

Other Title
  • 既学習モジュールの切替による未知環境探索エージェントの行動制御
  • キガクシュウ モジュール ノ キリカエ ニ ヨル ミチ カンキョウ タンサク エージェント ノ コウドウ セイギョ

Search this article

Abstract

<p>In this paper, we try to acquire various behavior patterns of autonomous exploration agent using several learning environments. In case of previous learning methods using a single behavior rule set, it is hard to acquire the behavior that covers all learning environments. In our method, we divide learning environments into some primitive environments whose properties differ each other, and then generate modules that are specialized for each primitive environment. To optimize behavior rules of agents, we adopt Graph Structured Program Evolution (GRAPE) which can automatically generates graph structured programs. In unknown environments, each module is switched by a program named “switcher”. The switcher selects the module that acts better in a neighboring environment. Through several experiments, our method achieved higher exploration rate in unknown environments compared to simple GRAPE, random search, and the method that switches modules randomly.</p>

Journal

References(5)*help

See more

Details 詳細情報について

Report a problem

Back to top