Journal of Geo-information Science

Figure/Table detail

Remote Sensing Image Segmentation Based on Multi-modal Feature Extraction and Hierarchical Perception

ZHANG Yinsheng, SHAN Mengjiao, CHEN Xin, CHEN Ge, TONG Junyi, JI Ru, SHAN Huilin

Journal of Geo-information Science, 2024, 26(12): 2741-2758. DOI: 10.12082/dqxxkx.2024.240488

模型	OA/%	P/%	R/%	F1/%	MIoU/%	FPS/(帧/s)	Kappa	FWIoU/%
B	86.26	86.74	76.59	81.35	78.69	92.97	0.74	84.12
+C	88.95	89.31	78.26	83.42	81.12	97.14	0.77	85.03
+D	86.70	87.22	76.84	81.79	79.06	98.31	0.76	82.55
+H	88.42	88.84	77.87	82.90	80.22	96.82	0.79	86.87
+M	87.64	88.03	77.39	82.36	79.47	96.09	0.78	83.65
+CD	89.48	89.93	78.98	83.16	81.52	98.83	0.77	87.57
+CDH	90.42	90.71	79.48	83.85	81.93	108.48	0.79	87.72
+CHM	90.94	91.50	80.03	84.43	82.68	106.21	0.83	86.92
+CDHM	92.21	92.66	80.51	87.94	83.24	113.11	0.85	89.24

Tab. 8 Ablation experiments of each module (Vaihingen)

Other figure/table from this article

Fig. 1 The model structure of MFEHPNet
Fig. 2 The model of multi-modal feature extraction
Fig. 3 The mechanism of Coordinate Attention
Fig. 4 The structure of Dual-path Bottleneck Block
Tab. 1 The network structure of MobileNetV3
Fig. 5 The model of Hierarchical Perceptual Network
Fig. 6 The model structure of attention
Fig. 7 The structure of dual fusion
Fig. 8 The model of multi-scale-feature aggregation
Tab. 2 Experimental configuration information
Fig. 9 Examples of ISPRS Vaihingen dataset
Fig. 10 Examples of ISPRS Potsdam dataset
Fig. 11 Difficulties of remote sensing image segmentation
Tab. 3 Experimental comparison of multi-modal fusion methods (Vaihingen) (%)
Tab. 4 Experimental comparison of input different modes (Vaihingen) (%)
Fig. 12 Comparison of input DSM effects
Tab. 5 Comparison of backbone network feature extraction (Vaihingen)
Tab. 6 Comparison of abstract deep feature extraction (Vaihingen) (%)
Tab. 7 Experimental comparison of decoding method extraction (Vaihingen) (%)
Fig. 13 Visualization results of ablation experiments
Tab. 9 Comparison of model calculation time
Tab. 10 Comparative experiments of different models (Vaihingen)
Tab. 11 Comparative experiments of different models (Potsdam)
Fig. 14 Segmentation results of low vegetation and trees in Vaihingen
Fig. 15 Segmentation results of buildings and roads in Vaihingen
Fig. 16 Segmentation results of cars in Vaihinge
Fig. 17 Segmentation results in Potsdam

模态框（Modal）标题

Figure/Table detail