AUTHOR=Leitner Jürgen , Harding Simon , Förster Alexander , Corke Peter TITLE=A Modular Software Framework for Eye–Hand Coordination in Humanoid Robots JOURNAL=Frontiers in Robotics and AI VOLUME=3 YEAR=2016 URL=https://www.frontiersin.org/journals/robotics-and-ai/articles/10.3389/frobt.2016.00026 DOI=10.3389/frobt.2016.00026 ISSN=2296-9144 ABSTRACT=

We describe our software system enabling a tight integration between vision and control modules on complex, high-DOF humanoid robots. This is demonstrated with the iCub humanoid robot performing visual object detection and reaching and grasping actions. A key capability of this system is reactive avoidance of obstacle objects detected from the video stream while carrying out reach-and-grasp tasks. The subsystems of our architecture can independently be improved and updated, for example, we show that by using machine learning techniques we can improve visual perception by collecting images during the robot’s interaction with the environment. We describe the task and software design constraints that led to the layered modular system architecture.