AUTHOR=Deng Zhen , Gao Ge , Frintrop Simone , Sun Fuchun , Zhang Changshui , Zhang Jianwei TITLE=Attention Based Visual Analysis for Fast Grasp Planning With a Multi-Fingered Robotic Hand JOURNAL=Frontiers in Neurorobotics VOLUME=13 YEAR=2019 URL=https://www.frontiersin.org/journals/neurorobotics/articles/10.3389/fnbot.2019.00060 DOI=10.3389/fnbot.2019.00060 ISSN=1662-5218 ABSTRACT=

We present an attention based visual analysis framework to compute grasp-relevant information which helps to guide grasp planning using a multi-fingered robotic hand. Our approach uses a computational visual attention model to locate regions of interest in a scene and employ a deep convolutional neural network to detect grasp type and grasp attention point for a sub-region of the object in a region of interest. We demonstrate the proposed framework with object grasping tasks, in which the information generated from the proposed framework is used as prior information to guide grasp planning. The effectiveness of the proposed approach is evaluated in both simulation experiments and real-world experiments. Experimental results show that the proposed framework can not only speed up grasp planning with more stable configurations, but also handle unknown objects. Furthermore, our framework can handle cluttered scenarios. A new Grasp Type Dataset (GTD) which includes six commonly used grasp types and covers 12 household objects is also presented.