Journal of Geo-information Science

Figure/Table detail

Remote Sensing Image Segmentation Based on Multi-modal Feature Extraction and Hierarchical Perception

ZHANG Yinsheng, SHAN Mengjiao, CHEN Xin, CHEN Ge, TONG Junyi, JI Ru, SHAN Huilin

Journal of Geo-information Science, 2024, 26(12): 2741-2758. DOI: 10.12082/dqxxkx.2024.240488

模型	F1/%					OA /%	MIoU/%	Kappa	FWIoU/%
模型	建筑物	低矮植被	树木	汽车	不透明表面	OA /%	MIoU/%	Kappa	FWIoU/%
C3Net	89.04	80.52	85.53	84.77	88.92	86.50	78.41	0.65	82.56
AMM	89.63	82.29	86.51	85.46	89.35	87.44	79.68	0.70	84.37
MMFNet	90.55	82.79	86.83	85.54	89.53	88.01	78.93	0.78	82.69
CMFet	91.14	83.00	87.05	86.44	90.41	88.63	80.89	0.79	85.48
CIMFNet	92.37	83.74	87.26	87.72	90.64	89.38	80.42	0.82	84.82
EDGNet	93.65	84.11	88.68	88.85	90.87	89.94	82.31	0.80	86.68
HFESANet	93.89	85.71	89.14	89.78	91.19	92.21	83.24	0.85	89.24

Tab. 10 Comparative experiments of different models (Vaihingen)

Other figure/table from this article

Fig. 1 The model structure of MFEHPNet
Fig. 2 The model of multi-modal feature extraction
Fig. 3 The mechanism of Coordinate Attention
Fig. 4 The structure of Dual-path Bottleneck Block
Tab. 1 The network structure of MobileNetV3
Fig. 5 The model of Hierarchical Perceptual Network
Fig. 6 The model structure of attention
Fig. 7 The structure of dual fusion
Fig. 8 The model of multi-scale-feature aggregation
Tab. 2 Experimental configuration information
Fig. 9 Examples of ISPRS Vaihingen dataset
Fig. 10 Examples of ISPRS Potsdam dataset
Fig. 11 Difficulties of remote sensing image segmentation
Tab. 3 Experimental comparison of multi-modal fusion methods (Vaihingen) (%)
Tab. 4 Experimental comparison of input different modes (Vaihingen) (%)
Fig. 12 Comparison of input DSM effects
Tab. 5 Comparison of backbone network feature extraction (Vaihingen)
Tab. 6 Comparison of abstract deep feature extraction (Vaihingen) (%)
Tab. 7 Experimental comparison of decoding method extraction (Vaihingen) (%)
Tab. 8 Ablation experiments of each module (Vaihingen)
Fig. 13 Visualization results of ablation experiments
Tab. 9 Comparison of model calculation time
Tab. 11 Comparative experiments of different models (Potsdam)
Fig. 14 Segmentation results of low vegetation and trees in Vaihingen
Fig. 15 Segmentation results of buildings and roads in Vaihingen
Fig. 16 Segmentation results of cars in Vaihinge
Fig. 17 Segmentation results in Potsdam

模态框（Modal）标题

Figure/Table detail