地球信息科学学报 ›› 2020, Vol. 22 ›› Issue (8): 1702-1713.doi: 10.12082/dqxxkx.2020.200086

• 遥感科学与应用技术 • 上一篇    下一篇

机载多光谱影像语义分割模型在农田防护林提取中的应用

王学文1,2(), 赵庆展1,2,*(), 韩峰1,2, 马永建1,2, 龙翔2,3, 江萍2,3   

  1. 1.石河子大学信息科学与技术学院,石河子 832003
    2.兵团空间信息工程技术研究中心,石河子 832003
    3.石河子大学机械电气工程学院,石河子 832003
  • 收稿日期:2020-02-23 修回日期:2020-03-25 出版日期:2020-08-25 发布日期:2020-10-25
  • 通讯作者: 赵庆展 E-mail:wangxuewen@stu.shzu.edu.cn;zqz_inf@shzu.edu.cn
  • 作者简介:王学文(1996— ),男,江苏南通人,硕士生,主要从事农业信息化技术及应用、深度学习与遥感影像处理研究。 E-mail:wangxuewen@stu.shzu.edu.cn
  • 基金资助:
    新疆生产建设兵团科技计划项目(2017DB005);兵团空间信息工程技术研究中心创建项目(2016BA001);中央引导地方科技发展专项资金项目(201610011)

Application of Airborne Multispectral Image Semantic Segmentation Model in Farmland Shelterbelt Extraction

WANG Xuewen1,2(), ZHAO Qingzhan1,2,*(), HAN Feng1,2, MA Yongjian1,2, LONG Xiang2,3, JIANG Ping2,3   

  1. 1. College of Information Science & Technology, Shihezi University, Shihezi 832003, China
    2. Geospatial Information Engineering Research Center, Xinjiang Production and Construction Corps, Shihezi 832003, China
    3. College of Mechanical and Electrical Engineering, Shihezi University, Shihezi 832003, China
  • Received:2020-02-23 Revised:2020-03-25 Online:2020-08-25 Published:2020-10-25
  • Contact: ZHAO Qingzhan E-mail:wangxuewen@stu.shzu.edu.cn;zqz_inf@shzu.edu.cn
  • Supported by:
    Xinjiang Production and Construction Corps Science and Technology Project(2017DB005);Geospatial Information Engineering Research Center To Create, Xin-jiang Production and Construction Corps(2016BA001);The Central Government Directs Local Science and Technology Development Special Funds(201610011)

摘要:

农田防护林是农田生态系统的屏障,其健康状况的监测与评估在我国北方农田林网管理中尤为重要。本文以新疆生产建设兵团第三师51团为研究区,使用复合翼无人机CW-20搭载Micro MCA12 Snap多光谱相机获取农田防护林的多光谱影像,经辐射校正、裁剪等预处理,通过优选有效特征和模型比较,提出农田防护林提取的有效方法。首先,基于原始12波段,依据相关性系数矩阵和最佳指数因子(Optimum Index Factor,OIF)选取最优3波段和植被指数特征进行组合,构建8种农田防护林提取方案;然后,通过建立语义分割Deeplabv3+模型进行精度评价,得到最优3波段组合6(波长710 nm)、8(波长800 nm)、 11(波长900 nm)波段为最佳特征组合;最后,以最优3波段为基础,将Deeplabv3+模型与U-Net、ENVINet5模型进行对比分析。结果表明:Deeplabv3+模型能够更深层次的挖掘光谱中潜在的信息,相比其他模型,能够较好地处理正负样本不均衡问题,获得最高MIoU值85.54%,比U-Net、ENVINet5的MIoU值则分别高出21.21%、27.19%。该研究结果可为基于多光谱遥感影像的语义分割在农田防护林提取及健康状况监测的应用提供借鉴和参考。

关键词: 无人机, 多光谱影像, 农田防护林提取, 最佳指数因子, 植被指数, 特征选择, 语义分割, Deeplabv3+

Abstract:

Farmland shelterbelt is the barrier of a farmland ecosystem. Monitoring and assessing the health condition of farmland shelterbelt are significant for farmland forests management in North China. This paper selects the farmland shelterbelt in the 3th Division of Xinjiang Production and Construction Crops as the experimental example. In July and August of 2019, we used the CW-20 fixed-wing drone which was equipped with a SONY-A7RII camera and a Micro MCA12 Snap camera to capture visible light images and multispectral images. Four targets on the ground with different reflectance (3%, 22%, 48%, and 64%) were set up for radiometric correction. we collected field data by Aowei software. Optimal bands were selected base on the Optimum Index Factor (OIF) and correlation coefficient. By integrating appropriate vegetation indices, eight different extraction schemes were constructed to select an effective method for final farmland shelterbelt extraction. In this study, when the flight mission was completed, we collated the exported POS and image data correspondingly. High resolution visible light images with 0.08 m resolution and high resolution multispectral images with 0.149 m resolution were first mosaiced using Pix4Dmapper. Four ground targets were then used for radiometric correction of mosaiced images using linear fitting model. The final experimental data was extracted using clipping method. Because each multispectral image was displayed in gray scale, which was not easy for direct data interpretation. High-resolution visible light images and multispectral images were registered together through ArcGIS software. We labeled 8030 samples based on visible light images through ENVI 5.5 software. We separated the training dataset and verification dataset according to the ratio of 4:1. Specifically, 112 512 pixel×512 pixel slices were taken as the training dataset, and 28 512 pixel×512 pixel slices were taken as the verification dataset. Based on eight extraction schemes, model accuracy of Deeplabv3+semantic segmentation model was evaluated. Three optimal bands that had the best model performance were selected including band 6 (wavelength 710 nm), band 8 (wavelength 800 nm), and band 11 (wavelength 900 nm) based on OIF. Based on these three optimal bands, we further compared the Deeplabv3+ model with U-Net and ENVINet5 model. Our results show that Deeplabv3 + model can capture the potential information in the images at a deeper level with fewer parameters. The MIoU derived from Deeplabv3+, U-Net, and ENVINet5 was 85.54%, 21.21%, and 27.19%, respectively. Also, Deeplabv3 + model solved the problem of sample unbalance. Our results provide a reference for the application of semantic segmentation using multispectral remote sensing data in farmland areas.

Key words: The Unmanned Aerial Vehicle (UAV), multispectral image, farmland shelterbelt extraction, optimum index factor, vegetation index, feature combination, semantic segmentation, Deeplabv3+