Empirical Inference

Learning elementary movements jointly with a higher level task

2011

Conference Paper

ei


Many motor skills consist of many lower level elementary movements that need to be sequenced in order to achieve a task. In order to learn such a task, both the primitive movements as well as the higher-level strategy need to be acquired at the same time. In contrast, most learning approaches focus either on learning to combine a fixed set of options or to learn just single options. In this paper, we discuss a new approach that allows improving the performance of lower level actions while pursuing a higher level task. The presented approach is applicable to learning a wider range motor skills, but in this paper, we employ it for learning games where the player wants to improve his performance at the individual actions of the game while still performing well at the strategy level game. We propose to learn the lower level actions using Cost-regularized Kernel Regression and the higher level actions using a form of Policy Iteration. The two approaches are coupled by their transition probabilities. We evaluate the approach on a side-stall-style throwing game both in simulation and with a real BioRob.

Author(s): Kober, J. and Peters, J.
Pages: 338-343
Year: 2011
Month: September
Day: 0
Editors: Amato, N.M.
Publisher: IEEE

Department(s): Empirical Inference
Bibtex Type: Conference Paper (inproceedings)

DOI: 10.1109/IROS.2011.6094834
Event Name: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2011)
Event Place: San Francisco, CA, USA

Address: Piscataway, NJ, USA
Digital: 0
ISBN: 978-1-61284-454-1

Links: PDF
Web

BibTex

@inproceedings{KoberP2011,
  title = {Learning elementary movements jointly with a higher level task },
  author = {Kober, J. and Peters, J.},
  pages = {338-343 },
  editors = {Amato, N.M.},
  publisher = {IEEE},
  address = {Piscataway, NJ, USA},
  month = sep,
  year = {2011},
  doi = {10.1109/IROS.2011.6094834  },
  month_numeric = {9}
}