Appearance control in dynamic light environments with a projector-camera system

Appearance of objects change from their original colors according to a lighting condition. Nowadays, a projector-camera system can act a tool to control colors or textures of objects in each small area divided in pixel level by light projection onto their physical surfaces. Conventional system can change the appearance in realtime under constant environmental lights. However, the change of environmental lights also influence the appearance. Therefore, we propose an advanced appearance control method considering the change of the environmental lights. In particular, we use a projector-camera system consisting of two cameras and one 3D projector. In addition, we apply liquid crystal shutter filters in order to estimate reflectances and variations of environmental lights separately simultaneously in real-time. In this paper, we show our theory for the estimation and results under different conditions of environmental lights.