Journal of Geo-information Science

Figure/Table detail

Remote Sensing Image Segmentation Based on Multi-modal Feature Extraction and Hierarchical Perception

ZHANG Yinsheng, SHAN Mengjiao, CHEN Xin, CHEN Ge, TONG Junyi, JI Ru, SHAN Huilin

Journal of Geo-information Science, 2024, 26(12): 2741-2758. DOI: 10.12082/dqxxkx.2024.240488

模型	F1/%					OA/%	MIoU/%	Kappa	FWIoU
模型	建筑物	低矮植被	树木	汽车	不透明表面	OA/%	MIoU/%	Kappa	FWIoU
C3Net	92.89	86.86	88.01	89.45	90.45	90.07	79.21	0.71	83.50
AMM	92.35	86.13	87.76	89.14	89.34	89.89	80.04	0.70	85.37
MMFNet	93.23	87.39	88.90	89.02	90.68	90.34	79.92	0.74	84.42
CMFet	93.56	87.66	89.12	89.76	90.23	90.72	81.29	0.79	85.69
CIMFNet	94.17	88.30	90.08	90.08	90.91	91.21	81.66	0.78	86.41
EDGNet	94.55	88.67	89.83	90.56	91.64	91.57	82.57	0.84	88.62
HFESANet	95.01	89.42	90.30	91.79	92.34	93.45	83.94	0.85	90.12

Tab. 11 Comparative experiments of different models (Potsdam)

Other figure/table from this article

Fig. 1 The model structure of MFEHPNet
Fig. 2 The model of multi-modal feature extraction
Fig. 3 The mechanism of Coordinate Attention
Fig. 4 The structure of Dual-path Bottleneck Block
Tab. 1 The network structure of MobileNetV3
Fig. 5 The model of Hierarchical Perceptual Network
Fig. 6 The model structure of attention
Fig. 7 The structure of dual fusion
Fig. 8 The model of multi-scale-feature aggregation
Tab. 2 Experimental configuration information
Fig. 9 Examples of ISPRS Vaihingen dataset
Fig. 10 Examples of ISPRS Potsdam dataset
Fig. 11 Difficulties of remote sensing image segmentation
Tab. 3 Experimental comparison of multi-modal fusion methods (Vaihingen) (%)
Tab. 4 Experimental comparison of input different modes (Vaihingen) (%)
Fig. 12 Comparison of input DSM effects
Tab. 5 Comparison of backbone network feature extraction (Vaihingen)
Tab. 6 Comparison of abstract deep feature extraction (Vaihingen) (%)
Tab. 7 Experimental comparison of decoding method extraction (Vaihingen) (%)
Tab. 8 Ablation experiments of each module (Vaihingen)
Fig. 13 Visualization results of ablation experiments
Tab. 9 Comparison of model calculation time
Tab. 10 Comparative experiments of different models (Vaihingen)
Fig. 14 Segmentation results of low vegetation and trees in Vaihingen
Fig. 15 Segmentation results of buildings and roads in Vaihingen
Fig. 16 Segmentation results of cars in Vaihinge
Fig. 17 Segmentation results in Potsdam

模态框（Modal）标题

Figure/Table detail