An acquisition method of 3-dimensional video components for image-based virtual studio

We are studying an image-based virtual studio. This type of virtual studio makes it possible to reconstruct realistic synthesized video by extracting shape, texture, and other necessary information (called video components) from each object in the subject video for use on the set. When using video components made up of shape and texture information to reconstruct natural-looking video under any lighting conditions, lighting effects like highlights and shading that are present at the time of measurement must be removed from texture information. For this purpose, the authors have proposed a technique that uses polarized light on the lighting side and a polarized filter on the camera side, and have confirmed its effectiveness by experiments.