Midoriko Chatbot: LSTM-Based Emotional 3D Avatar

In this work, we developed a new model of chat robot with facial expression interaction. Different from the voice assistant that only interacts with text and voice, we let the chat robot interact with the user with a specific role play. A text-sentiment-analysis network is added to this system to recognize the emotion of the response sentences. Moreover, we created a 3D-constructed anime character “Midoriko” to have the image of the chat robot more vivid. Our goal is to provide better experience to users. The technical parts of this work is based on neural network techniques.