End-to-End Method with Transformer for 3D Detection of Oil Tank from Single SAR Image

In recent years, deep learning has been successfully applied in the field of SAR (Synthetic Aperture Radar) image object detection. However, unlike ships and tanks targets, the oil tank targets in SAR image are usually dense and compact with more overlaps and discrete scattering centers, which greatly increases the difficulty of extracting location and structural parameters. Most of the existing methods transfer the methods suitable for natural image to the SAR image field, without considering the unique characteristics of SAR image. Therefore, in this article, we propose an improved model based on the end-to-end Transformer network, which is the first model introducing Transformer network to 3D detection of oil tank targets from single SAR image. We input the incidence angle into the Transformer model as a priori token. Then we propose feature description operator based on the scattering centers which are used as an aid to improve the precision of predictions. In addition, we also propose a cylinder IOU as a more suitable evaluation metric for 3D detection of oil tank. Finally, we evaluate our model on a SAR image dataset which contain SAR images from RADARSAT-2, TerraSAR-X, GF-3 with different incidence angles. Our experiments demonstrate that our proposed model achieves AP of 77.6% compared with 60.8% of baseline, which proves the effectiveness of the introduction of observation conditions, cylinder IOU loss and the feature description operator based on the scattering centers in our model and is appealing for 3D detection of oil tank.