Improving surface soil moisture retrievals through a novel assimilation algorithm to estimate both model and observation errors

Abstract Soil moisture controls the land surface water and energy budget and plays a crucial role in land surface processes. Based on certain mathematical rules, data assimilation can merge satellite observations and land surface models, and produce spatiotemporally continuous profile soil moisture. The two mainstream assimilation algorithms (variational-based and sequential-based) both need model error and observation error estimates, which greatly impact the assimilation results. Moreover, the performance of land data assimilation relies heavily on the specification of model parameters. However, it is always challenging to specify these errors and model parameters. In this study, a dual-cycle assimilation algorithm was proposed for addressing the above issue. In the inner cycle, the Ensemble Kalman Filter (EnKF) is run with parameters of both model and observation operators and their errors, which are provided by the outer cycle. Both the analyzed state variable and the innovation are reserved at each analysis moment. In the outer cycle, the innovation time series kept by the inner cycle are fed into a likelihood function to adjust the values of parameters of both the model and observation operators and their errors through an optimization algorithm. A series of assimilation experiments were first performed based on the Lorenz-63 model. The results illustrate that the performance of the dual-cycle algorithm substantially surpasses those of both the classical parameter calibration and the standard EnKF. Subsequently, the Advanced Microwave Scanning Radiometer of earth Observing System (AMSR-E) brightness temperatures were assimilated into the simple biosphere model scheme version 2 (SiB2) with a radiative transfer model as the observation operator in two experimental areas, namely Naqu on the Tibetan Plateau and a Coordinate Enhanced Observing (CEOP) reference site in Mongolia. The results indicate that the dual-cycle assimilation algorithm can simultaneously estimate model parameters, observation operator parameters, model error, and observation error, thus improving surface soil moisture estimation in comparison with other assimilation algorithms. Since the dual-cycle assimilation algorithm can estimate the observation errors, it provides the potential for assimilating multi-source remote sensing data to generate physically consistent land surface state and flux estimates.