Header logo is ei

Learning Dynamic Tactile Sensing with Robust Vision-based Training




Dynamic tactile sensing is a fundamental ability to recognize materials and objects. However, while humans are born with partially developed dynamic tactile sensing and quickly master this skill, today's robots remain in their infancy. The development of such a sense requires not only better sensors but the right algorithms to deal with these sensors' data as well. For example, when classifying a material based on touch, the data are noisy, high-dimensional, and contain irrelevant signals as well as essential ones. Few classification methods from machine learning can deal with such problems. In this paper, we propose an efficient approach to infer suitable lower dimensional representations of the tactile data. In order to classify materials based on only the sense of touch, these representations are autonomously discovered using visual information of the surfaces during training. However, accurately pairing vision and tactile samples in real-robot applications is a difficult problem. The proposed approach, therefore, works with weak pairings between the modalities. Experiments show that the resulting approach is very robust and yields significantly higher classification performance based on only dynamic tactile sensing.

Author(s): Kroemer, O. and Lampert, CH. and Peters, J.
Journal: IEEE Transactions on Robotics
Volume: 27
Number (issue): 3
Pages: 545-557
Year: 2011
Month: June
Day: 0

Department(s): Empirical Inference
Research Project(s): Robot Skill Learning
Bibtex Type: Article (article)

Digital: 0
DOI: 10.1109/TRO.2011.2121130
Language: en
Organization: Max-Planck-Gesellschaft
School: Biologische Kybernetik

Links: Web


  title = {Learning Dynamic Tactile Sensing with Robust Vision-based Training},
  author = {Kroemer, O. and Lampert, CH. and Peters, J.},
  journal = {IEEE Transactions on Robotics},
  volume = {27},
  number = {3},
  pages = {545-557 },
  organization = {Max-Planck-Gesellschaft},
  school = {Biologische Kybernetik},
  month = jun,
  year = {2011},
  month_numeric = {6}