标题: SCT-CR: A synergistic convolution-transformer modeling method using SAR-optical data fusion for cloud removal

作者: Ma, JS (Ma, Jianshen); Chen, YM (Chen, Yumin); Pan, J (Pan, Jun); Xu, JG (Xu, Jiangong); Li, ZH (Li, Zhanghui); Xu, R (Xu, Rui); Chen, RX (Chen, Ruoxuan)

来源出版物: INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION 卷: 130 文献号: 103909 DOI: 10.1016/j.jag.2024.103909 Published Date: 2024 JUN

摘要: Traditional CNNs struggle with SAR and optical image fusion cloud removal due to SAR image noise, feature space differences and random cloud distribution. This often leads to blurred results with less texture information. This paper proposes a synergistic convolution-transformer cloud removal method (SCT-CR), which is based on a specially designed synergistic convolution module that enables the synergistic fusion of SAR and optical imagery. The proposed network employs a transformer module in the high-dimensional section to better perceive the contextual information of the image and achieve intelligent extraction of global image features. The proposed SCT-CR network successfully addresses the problem of image blur in generated images and makes full use of the texture information present in SAR images. The SCT-CR model is tested on the spectral properties and recovery of visual effects. The experimental results on public datasets SEN12MS-CR and LuojiaSET-OSFCR show that the proposed model has stable and optimal performance. On the SEN12MS-CR dataset, the proposed model improves the SSIM metrics by 15.7 %, 10.2 %, 4.9 %, and 0.5 % compared to the SAR2OPT, SarOptcAGN, DSen2-CR, and GLF-CR models, respectively. On the LuojiaSET-OSFCR dataset, it was improved by 20.0 %, 10.0 %, 6.6 %, and 1.9 %, respectively.

作者关键词: Cloud removal; Data fusion; SAR; Synergistic Convolution; Transformer

KeyWords Plus: NETWORK; GAN

地址: [Ma, Jianshen; Chen, Yumin; Li, Zhanghui; Xu, Rui; Chen, Ruoxuan] Wuhan Univ, Sch Resource & Environm Sci, Wuhan, Peoples R China.

[Pan, Jun; Xu, Jiangong] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan, Peoples R China.

通讯作者地址: Chen, YM (通讯作者)，Wuhan Univ, Sch Resource & Environm Sci, Wuhan, Peoples R China.

Pan, J (通讯作者)，Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan, Peoples R China.

电子邮件地址: ymchen@whu.edu.cn; panjun1215@whu.edu.cn

影响因子：7.6