联合混合CNN和相似性评估的异源影像无监督变化检测方法
庄会富(1990— ),男,山东费县人,博士,讲师,硕士生导师,主要研究方向为遥感影像智能化处理及变化检测。E-mail: huifuzhuang@163.com |
Copy editor: 黄光玉 , 蒋树芳
收稿日期: 2024-09-26
修回日期: 2024-12-27
网络出版日期: 2025-01-24
基金资助
国家自然科学基金项目(42401539)
国家自然科学基金项目(U23A20598)
自然资源部国土卫星遥感应用重点实验室开放基金(KLSMNR-G202205)
Unsupervised Change Detection Method for Heterogeneous Image Combining Hybrid CNN and Similarity Assessment
Received date: 2024-09-26
Revised date: 2024-12-27
Online published: 2025-01-24
Supported by
National Natural Science Foundation of China(42401539)
National Natural Science Foundation of China(U23A20598)
Key Laboratory of Land Satellite Remote Sensing Application, Ministry of Natural Resources of the People's Republic of China(KLSMNR-G202205)
【目的】 异源影像变化检测是遥感领域的研究热点,现有研究通常先把异源影像通过域迁移方法得到伪同源影像,再从伪同源影像中提取变化信息,存在异源影像中地物特征的互补信息利用不充分问题。本文围绕域迁移得到的多时相异源影像对(每个时相都有一对异源影像)开展变化检测,为解决多时相异源影像对的时相-空间-频谱联合特征融合提取,并在无标注样本情况下进行无监督变化检测等极具挑战性的问题,提出了一种联合混合卷积网络和相似性评估的异源影像无监督变化检测方法。【方法】 首先利用本文提出的基于斑块相似性评估的伪标签样本数据集生成方法,克服深度学习变化检测模型对人工标注样本数据的依赖。然后,构建了融合异源影像的2维、3维混合卷积神经网络模型,用于提取变化信息。【结果】 该模型不仅可充分利用异源影像之间的特征互补优势,还可有效提取多时相异源影像对的时相-空间-频谱联合特征,可在伪标签样本数据驱动下实现无监督变化检测。为了验证本文提出方法的有效性,在基于循环一致生成对抗网络获取的多时相异源影像对数据上进行了实验,包括曙光和格洛斯特数据集,并与传统方法、深度学习方法和本文方法的消融方法进行了定性和定量比较。【结论】 本文方法通过样本数据的无监督选取,提高了异源影像变化检测的自动化程度;同时,与前述对比方法中最好的变化检测结果相比,本文方法在2个数据集上的平均F1-Score提高了2.54%,有效提高了变化检测结果的可靠性。
庄会富 , 郭建林 , 薛倩 , 张宇 . 联合混合CNN和相似性评估的异源影像无监督变化检测方法[J]. 地球信息科学学报, 2025 , 27(2) : 507 -521 . DOI: 10.12082/dqxxkx.2025.240535
[Objectives] Change detection in heterogeneous images is a research hotspot in the field of remote sensing. Existing studies typically obtain pseudo-homogeneous images from heterogeneous images through domain adaptation methods and then extract change information from these pseudo-homogeneous images, which often leads to insufficient utilization of complementary information from features in heterogeneous images. This study focuses on change detection using multi-temporal heterogeneous image pairs (each time having a pair of heterogeneous images) obtained through domain adaptation. To address the challenging issues including the temporal-spatial-spectral joint features fusion extraction from multi-temporal heterogeneous image pairs and perform unsupervised change detection without labeled samples. This study proposes an unsupervised change detection method for heterogeneous images that combines a hybrid convolutional network with similarity assessment. [Methods] To overcome the dependence of deep learning change detection models on manually labeled sample data, this method first utilizes a pseudo-labeled samples generation method based on patch similarity assessment proposed in this study. Then, a 2D-3D hybrid convolutional neural network model that integrates heterogeneous images is constructed to extract change information. [Results] This model can not only fully utilize the complementary advantages of features between heterogeneous images but also effectively extract the temporal-spatial-spectral joint features from multi-temporal heterogeneous image pairs, enabling unsupervised change detection driven by pseudo-labeled sample data. To validate the effectiveness of the proposed method, experiments were conducted on Shuguang and Gloucester datasets. Qualitative and quantitative comparisons were made with traditional methods, deep learning methods, and ablation methods derived from the proposed method. [Conclusions] The experimental results show that the proposed method enhances the automation level of change detection in heterogeneous images through unsupervised selection of sample data. Meanwhile, compared to the best change detection results among the aforementioned comparison methods, the average F1 Score of the proposed method is improved by 2.54% on both datasets, effectively enhancing the reliability of the change detection results.
[1] |
|
[2] |
|
[3] |
|
[4] |
|
[5] |
|
[6] |
|
[7] |
|
[8] |
张祖勋, 姜慧伟, 庞世燕, 等. 多时相遥感影像的变化检测研究现状与展望[J]. 测绘学报, 2022, 51(7):1091-1107.
[
|
[9] |
眭海刚, 冯文卿, 李文卓, 等. 多时相遥感影像变化检测方法综述[J]. 武汉大学学报(信息科学版), 2018, 43(12):1885-1898.
[
|
[10] |
赵忠明, 高连如, 陈东, 等. 卫星遥感及图像处理平台发展[J]. 中国图象图形学报, 2019, 24(12): 2098-2110.
[
|
[11] |
|
[12] |
|
[13] |
|
[14] |
|
[15] |
|
[16] |
|
[17] |
|
[18] |
|
[19] |
|
[20] |
|
[21] |
韩特, 汤玉奇, 邹滨, 等. 基于分层极限学习机影像转换的多源影像变化检测方法[J]. 地球信息科学学报, 2022, 24(11):2212-2224.
[
|
[22] |
|
[23] |
|
[24] |
|
[25] |
|
[26] |
|
[27] |
|
[28] |
|
[29] |
|
[30] |
|
[31] |
|
[32] |
|
[33] |
|
[34] |
|
[35] |
|
[36] |
|
[37] |
|
[38] |
卢元兵, 李华朋, 张树清. 基于混合3D-2D CNN的多时相遥感农作物分类[J]. 农业工程学报, 2021, 37(13):142-151.
[
|
[39] |
|
[40] |
|
[41] |
|
/
〈 |
|
〉 |