Fusion attention-ASPP and context semantic for complex scene semantic segmentation

Abstract

Semantic segmentation is widely used in remote sensing data extraction and classification. Existing semantic segmentation networks focus on capturing contextual information in many different ways, simply fusing features at different levels, and ultimately improving the accuracy of semantic segmentation. However, low-level semantic features lack spatial context guidance, and high-level semantic features tend to encode large objects with coarse spatial details, making segmentation results prone to losing fine details. In this paper, we analyze the advantages and disadvantages of different levels of feature maps, and enhance the feature representation from two aspects to solve this problem. On the one hand, inspired by the architectural idea of atrous spatial pyramic pooling (ASPP), we adjust the structure of ASPP module and add the attention module to ASPP, and a new Attention-ASPP(AASPP) module is constructed in this paper. On the other hand, feature information such as boundary contours is enhanced by channel attention modeling, thereby improving local detail representation. Comprehensive experimental results show that our model framework achieves excellent segmentation performance on two public datasets, WHU building dataset and ISPRS Potsdam dataset.