高级检索

多视角双流交互融合的遥感图像语义分割

XIE Ailian1, QUAN Sixiang2, Qian Jing3, ZHANG Yalu1, LIU Jun1, TANG Xianlong2, ZHANG Tai2, WANG Zhihui1*, PENG Yingying1, XIAO Xiaoxia1

  • 摘要: 摘要: 遥感图像语义分割是遥感图像处理的重要任务。由于复杂遥感场景中地物尺度变化显著、空间结构复杂,现有单一特征提取方式在局部结构细节与全局上下文信息处理上有限。现有CNN–Transformer混合模型虽能兼顾局部结构与全局语义信息,但异构特征交互不足,限制了特征融合效果。为此,本文提出一种多视角双流交互融合的遥感图像语义分割网络。首先,采用ResNet-50和SwinTransformer并行提取局部与全局特征;其次,通过分组卷积与逐点卷积促进双分支特征交互,并利用分组特征聚合与全局语义感知增强高层语义表示;最后,利用多尺度门控注意力优化特征选择,抑制背景噪声干扰。在Potsdam、LoveDA和UAVid三个公开数据集上的实验中,本文方法分别取得了87.3%、53.3%和70.2%的mIoU,验证了所提方法的有效性。

     

    Abstract: Abstract: Semantic segmentation of remote sensing images is an important task in remote sensing image processing. However, significant variations in object scales and complex spatial structures in remote sensing scenes limit the ability of existing single feature extraction approaches to adequately capture both local structural details and global contextual information. Although existing CNN–Transformer hybrid models can capture local structures and global semantic information simultaneously, insufficient interaction between heterogeneous features limits effective feature fusion. To address these issues, a multi-view dual-stream interactive fusion network is proposed for remote sensing image semantic segmentation. First, ResNet-50 and SwinTransformer are employed in parallel to extract local and global features, respectively. Second, grouped convolution and pointwise convolution are introduced to facilitate feature interaction between the two branches, while grouped feature aggregation and global semantic perception are employed to enhance high-level semantic representations. Finally, multi-scale gated attention is used to optimize feature selection and suppress background noise. Experiments on three public datasets, including Potsdam, LoveDA, and UAVid, show that the proposed method achieves mIoU values of 87.3%, 53.3%, and 70.2%, respectively, demonstrating its effectiveness for remote sensing image semantic segmentation.

     

/

返回文章
返回