Adaptive projection augmented reality with object recognition based on deep learning

This study describes an Adaptive Projection Augmented Reality (AR) system that can provide information in real-time using object recognition. This approach is based on deep-learning through the construction of a 3D space from the real world. Through single system, a projector-camera unit with pan-tilt mechanism,, the 360-degree space of user surroundings can be built into a 3-dimensional space and accomplish object and user recognition. a projection AR environment can be generated instantaneously. Information relevant to real-world objects can be provided through real-time interactions between the user and objects. Using spatial interaction, it also allows for achieving intuitive interactions with projection information, user interface (UI), and contents without touch sensors. Several scenarios for the use of this system are described below.