Visual Target Sequence Prediction via Hierarchical Temporal Memory Implemented on the iCub Robot

In this article, we present our initial work on sequence prediction of a visual target by implementing a cortically inspired method, namely Hierarchical Temporal Memory (HTM). As a preliminary test, we employ HTM on periodic functions to quantify prediction performance with respect to prediction steps. We then perform simulation experiments on the iCub humanoid robot simulated in the Neurorobotics Platform. We use the robot as embodied agent which enables HTM to receive sequences of visual target position from its camera in order to predict target positions in different trajectories such as horizontal, vertical and sinusoidal. The obtained results indicate that HTM based method can be customized for robotics applications that require adaptation of spatiotemporal changes in the environment and acting accordingly.