AUTHOR=Kreiser Raphaela , Renner Alpha , Leite Vanessa R. C. , Serhan Baris , Bartolozzi Chiara , Glover Arren , Sandamirskaya Yulia TITLE=An On-chip Spiking Neural Network for Estimation of the Head Pose of the iCub Robot JOURNAL=Frontiers in Neuroscience VOLUME=14 YEAR=2020 URL=https://www.frontiersin.org/journals/neuroscience/articles/10.3389/fnins.2020.00551 DOI=10.3389/fnins.2020.00551 ISSN=1662-453X ABSTRACT=

In this work, we present a neuromorphic architecture for head pose estimation and scene representation for the humanoid iCub robot. The spiking neuronal network is fully realized in Intel's neuromorphic research chip, Loihi, and precisely integrates the issued motor commands to estimate the iCub's head pose in a neuronal path-integration process. The neuromorphic vision system of the iCub is used to correct for drift in the pose estimation. Positions of objects in front of the robot are memorized using on-chip synaptic plasticity. We present real-time robotic experiments using 2 degrees of freedom (DoF) of the robot's head and show precise path integration, visual reset, and object position learning on-chip. We discuss the requirements for integrating the robotic system and neuromorphic hardware with current technologies.