Interactivity of an Affective Puppet

This paper describes a computer-animated puppet responding to multimodal and affective inputs from a group of spectators in order to engage them in the visit to a science museum. In order to compute the emotional state of the audience, our system allows fusion of information acquired from microphone and camera input. The objective of our demonstration is to put forth a mechanism for using emotions for group interaction and to provide an example of real world application of this technology.