direkt zum Inhalt springen

direkt zum Hauptnavigationsmenü

Sie sind hier

TU Berlin

Page Content

The Physical Exploration Challenge

Robots Learning to Discover, Actuate and Explore Degrees of Freedom in the World

Lupe [1]

Project Leaders:

  • Oliver Brock (Berlin) [2]
  • Marc Toussaint (Stuttgart) [3]
  • Peter Englert (Stuttgart) [4]
  • Manuel Baum (Berlin) [5]
Researchers - Alumni: 
  • Johannes Kulick (Stuttgart) [6]
  • Sebastian Höfer (Berlin) [7]
  • Roberto Martin Martin (Berlin) [8]
  • Elizabeth Ball (Berlin) [9]
  • Carola Stahl (Stuttgart) [10]
  • Shlomo Zilberstein (Massachusetts) [11]

This project addresses a fundamental challenge in the intersection of machine learning and robotics. The machine learning community has developed formal methods to generate behaviour for agents that learn from their own actions. However, several fundamental questions are raised when trying to realize such behaviour on real-world robotics systems that shall learn to perceive, actuate and explore degrees of freedom (DoF) in the world.
These questions pertain to basic theoretical aspects as well as the tight dependencies between exploration strategies and the perception and motor skills used to realize them. The goal of this project is to equip real-world robotic systems with one of the most  interesting aspects of intelligence: an internal drive to learn, i.e., the ability to organize their behavior so as to maximize learning progress towards an objective.
If successful, we believe that this will make a transitional change in the way such systems behave, in their autonomy of learning, in the way they ground acquired knowledge, and eventually also in the way they will interact with humans and play their part in application in industry and in the private sector. To examine the interplay between these building blocks, we built a mechanical device we call lock-box. This device features multiple mechanical joints that can lock each other. It is a rich testbed to research how motor and perceptual skills can be used for exploration of a complex physical environment.
The robot has to cope with a very high degree of uncertainty in this domain. If it tried to move an object and that object did not move, then there can be multiple explanations for this: the object can be rigidly attached to the environment, the object can be part of a mechanism that only temporarily locked, or the robot could have moved the mechanism but did not perform the right action. We want to find out how a robot can resolve this issue.
We already have some answers to the questions that surfaced on the way to our goal. Interactive Perception can be used to detect joints between movable objects.  Coupled Learning of Action Parameters and Forward Models for Manipulation,  can give the robot the ability to learn models for its own actions and the kinematic structure of its environment simultaneously.

The project is funded by DFG's Priority Programme 1527 Autonomous Learning


<< previous [12]
next >> [17]

Dov Katz and Yuri Pyuro and Oliver Brock. Learning to Manipulate Articulated Objects in Unstructured Environments Using a Grounded Relational Representation [21]. Proceedings of Robotics: Science and Systems IV, pp. 254-261, 2008.

Download Bibtex entry [22]

Dov Katz and Oliver Brock. A Factorization Approach to Manipulation in Unstructured Environments [23]. 14th International Symposium of Robotics Research. Springer Verlag, pp. 1-16, 2009.

Download Bibtex entry [24]

Dov Katz and Andreas Orthey and Oliver Brock. Interactive Perception of Articulated Objects [25]. 12th International Symposium of Experimental Robotics, pp. 01-15, 2010.

Download Bibtex entry [26]

Andreas Orthey. 3D Joint Detection [27]. Bachelor's thesis, Department of Electrical Engineering and Computer Science, Berlin University of Technology, Berlin, Germany, 2011. Download Bibtex entry [28]

Sebastian Höfer and Oliver Brock. Learning Compact Relational Models for the Exploration of Articulated Objects [29]. Proceedings of the ICRA Mobile Manipulation Workshop on Interactive Perception (ICRA), 2013.

Download Bibtex entry [30]

<< previous [31]
next >> [36]
------ Links: ------

Zusatzinformationen / Extras

Quick Access:

Schnellnavigation zur Seite über Nummerneingabe

Copyright TU Berlin 2008