A BRMF-based model for missing-data estimation of image sequence

Abstract How to effectively deal with occlusion is an important step of structure from motion. In this paper, an accurate missing data estimation method is proposed by combining Bayesian robust matrix factorization (BRMF) and particle swarm optimization (PSO). As BRMF is primely designed for outlier detection, in the proposed method, the missing entries of the observation matrix are firstly replaced by the values that are significantly larger than the non-missing entries. Then, the low-rank factorization matrices are computed via the BRMF to recover the observations. One issue of the BRMF model is that the fluctuation of output results caused by the variation of rank values. Analogously to the classifier-committee learning algorithm, a BRMF-based weaker estimator is constructed to alleviate the unfavorable condition. Moreover, a PSO-based weighting strategy is devised to integrate the outputs of weaker estimators. Experimental results on several widely used image sequences demonstrate the effectiveness and feasibility of the proposed algorithm.