Virtual Glasses Try-on Based on Large Pose Estimation

Abstract Virtual glasses try-on displays the front and side effects of the glasses to the user by loading the virtual glasses model onto the user’s photos or videos. Currently, virtual glasses try-on methods are either inaccurate or depending on sophisticated equipment, and cannot be applied to a large-scale rotation situation. In this paper, we design and implement a novel virtual glasses try-on method based on large-scale head pose estimation, using 3D face reconstruction and pose estimation techniques, to estimate the continuous pose angle of a face, and then rotates the glasses model synchronously, in order to realize the accurate matching of glasses and face. Compared with other methods, the proposed method does not depend on sophisticated equipment, and also can be applied to the large-scale rotation situation.