Application of Educational Emotion Inference via Speech and Agent Interaction

This paper brings together speech recognition, emotion inference and virtual agents to implement a system for student interaction in an educational environment. By analyzing the capture speech, we can perceive an indication of the emotion status of the target student. Using the inference results, an agent can choose the suitable dialogue to interact with the student. Our experiments indicate that there is a lot of potential for such a system to be applied in other situations as well.