Watch and Buy: A Practical Solution for Real-time Fashion Product Identification in Live Stream

"Watch and Buy: Multimodal Product Identification(WAB)" challenge is a new task in the field of cross-modal retrieval, which aims to retrieve the relevant products when users watching live streamers selling fashion products. In practice, it is very hard to get the product items accurately and quickly because of large deformations, occlusions and motion blur of product items in a real-world live streaming environment. In this paper, our solution for WAB challenge is presented, which includes the model and training methods of fashion product localization and identification, as well as the detailed strategy for optimization, model assembly, and post-process rank. Experiments show that our strategies for data enhancement, model fusion and result ranking can lead to a better result. Finally, our model is small and efficient with competitive results and attains 0.4915 on test B in the final season, ranking 5th. And our model attains 0.5604 on test A, ranking 1st in the late submission.