This Article Full Text (PDF) Multimedia References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Sproewitz, A. Articles by Ijspeert, A. J. Search for Related Content Social Bookmarking                         What's this?

Learning to Move in Modular Robots using Central Pattern Generators and Online Optimization

School of Computer and Communication Science Ecole Polytechnique Fédérale de Lausanne Station 14, CH-1015 Lausanne, Switzerland

Rico Moeckel

School of Computer and Communication Science Ecole Polytechnique Fédérale de Lausanne Station 14, CH-1015 Lausanne, Switzerland

Jérôme Maye

School of Computer and Communication Science Ecole Polytechnique Fédérale de Lausanne Station 14, CH-1015 Lausanne, Switzerland

Auke Jan Ijspeert

School of Computer and Communication Science Ecole Polytechnique Fédérale de Lausanne Station 14, CH-1015 Lausanne, Switzerland, Auke.Ijspeert{at}epfl.ch

This article addresses the problem of how modular robotics systems, i.e. systems composed of multiple modules that can be configured into different robotic structures, can learn to locomote. In particular, we tackle the problems of online learning, that is, learning while moving, and the problem of dealing with unknown arbitrary robotic structures. We propose a framework for learning locomotion controllers based on two components: a central pattern generator (CPG) and a gradient-free optimization algorithm referred to as Powell's method. The CPG is implemented as a system of coupled nonlinear oscillators in our YaMoR modular robotic system, with one oscillator per module. The nonlinear oscillators are coupled together across modules using Bluetooth communication to obtain specific gaits, i.e. synchronized patterns of oscillations among modules. Online learning involves running the Powell optimization algorithm in parallel with the CPG model, with the speed of locomotion being the criterion to be optimized. Interesting aspects of the optimization include the fact that it is carried out online, the robots do not require stopping or resetting and it is fast. We present results showing the interesting properties of this framework for a modular robotic system. In particular, our CPG model can readily be implemented in a distributed system, it is computationally cheap, it exhibits limit cycle behavior (temporary perturbations are rapidly forgotten), it produces smooth trajectories even when control parameters are abruptly changed and it is robust against imperfect communication among modules. We also present results of learning to move with three different robot structures. Interesting locomotion modes are obtained after running the optimization for less than 60 minutes.

Key Words: central pattern generators • modular robotics • online learning • locomotion • Powell's method • bluetooth

The International Journal of Robotics Research, Vol. 27, No. 3-4, 423-443 (2008)
DOI: 10.1177/0278364907088401


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?