Header logo is ei

Combining active learning and reactive control for robot grasping




Grasping an object is a task that inherently needs to be treated in a hybrid fashion. The system must decide both where and how to grasp the object. While selecting where to grasp requires learning about the object as a whole, the execution only needs to reactively adapt to the context close to the grasp’s location. We propose a hierarchical controller that reflects the structure of these two sub-problems, and attempts to learn solutions that work for both. A hybrid architecture is employed by the controller to make use of various machine learning methods that can cope with the large amount of uncertainty inherent to the task. The controller’s upper level selects where to grasp the object using a reinforcement learner, while the lower level comprises an imitation learner and a vision-based reactive controller to determine appropriate grasping motions. The resulting system is able to quickly learn good grasps of a novel object in an unstructured environment, by executing smooth reaching motions and preshapin g the hand depending on the object’s geometry. The system was evaluated both in simulation and on a real robot.

Author(s): Kroemer, O. and Detry, R. and Piater, J. and Peters, J.
Journal: Robotics and Autonomous Systems
Volume: 58
Number (issue): 9
Pages: 1105-1116
Year: 2010
Month: September
Day: 0

Department(s): Empirical Inference
Bibtex Type: Article (article)

Digital: 0
DOI: 10.1016/j.robot.2010.06.001
Language: en
Organization: Max-Planck-Gesellschaft
School: Biologische Kybernetik

Links: PDF


  title = {Combining active learning and reactive control for robot grasping},
  author = {Kroemer, O. and Detry, R. and Piater, J. and Peters, J.},
  journal = {Robotics and Autonomous Systems},
  volume = {58},
  number = {9},
  pages = {1105-1116},
  organization = {Max-Planck-Gesellschaft},
  school = {Biologische Kybernetik},
  month = sep,
  year = {2010},
  month_numeric = {9}