地球信息科学学报 ›› 2020, Vol. 22 ›› Issue (9): 1860-1867.doi: 10.12082/dqxxkx.2020.190351

• 遥感科学与应用技术 • 上一篇    下一篇

基于ODC的国产卫星影像存储与应用研究

李俊杰1(), 陈舒博2, 张文1, 余长慧1, 张志远1,3, 孟令奎1,*()   

  1. 1.武汉大学遥感信息工程学院,武汉 430079
    2.中国地质大学(武汉)数学与物理学院,武汉 430074
    3.水利部信息中心,北京100053
  • 收稿日期:2019-07-03 修回日期:2019-10-16 出版日期:2020-09-25 发布日期:2020-11-25
  • 通讯作者: 孟令奎 E-mail:junjieli@whu.edu.cn;lkmeng@whu.edu.cn
  • 作者简介:李俊杰(1996— ),男,湖北宜昌人,硕士,主要从事水利遥感监测研究。E-mail:junjieli@whu.edu.cn
  • 基金资助:
    国家重点研发计划项目(2017YFC0405806)

Management and Application of Domestic Satellite Imagery based on Open Data Cube

LI Junjie1(), CHEN Shubo2, ZHANG Wen1, YU Changhui1, ZHANG Zhiyuan1,3, MENG Lingkui1,*()   

  1. 1. School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China
    2. School of Mathematics and Physics, China University of Geosciences, Wuhan 430074, China
    3. Information Center (Hydrology Monitor and Forecast Center), Ministry of Water Resources, Beijing 100053, China;
  • Received:2019-07-03 Revised:2019-10-16 Online:2020-09-25 Published:2020-11-25
  • Contact: MENG Lingkui E-mail:junjieli@whu.edu.cn;lkmeng@whu.edu.cn
  • Supported by:
    National Key Research and Development Pro gram of China(2017YFC0405806)

摘要:

随着地球观测进入大数据时代,传统的数据管理技术已经难以适应大数据需求, Open Data Cube (ODC)作为新型的开源的地球观测数据管理与分析平台,适合进行时间序列数据的高性能计算和探索性数据分析,是亚大区域综合地球观测系统AOGEOSS的重要技术支撑平台。但当前ODC对国产卫星影像支持不友好,缺乏自动化管理和数据组织工具,使用ODC进行国产卫星影像数据管理的技术不成熟。因此,本文以高分一号卫星影像为例,通过开发ODC_GFTool中间件和自定义高分卫星影像产品格式探索ODC框架下国产影像数据自动化管理流程,最后以鄱阳湖为试验区,进行了基于ODC框架的水体提取应用实验,论证了ODC框架下国产卫星数据存取的可行性,研究结果表明相较于传统的数据处理工具ODC具有明显的效率优势,能够为AOGEOSS基础设施建设和国产卫星影像数据管理提供一定的参考。

关键词: Open Data Cube, ODC, 国产影像, 数据管理, 影像存储, 高分一号, 鄱阳湖

Abstract:

As earth observation enters the big data era, the traditional data management technology has often become insufficient in meeting research needs. As a new open source earth observation data management and analysis platform, Open Data Cube (ODC) is suitable for high-performance computing and exploratory data analysis of time series data. It's an important technical support platform for Asia-Oceania Global Earth Observation System of Systems (AOGEOSS). However, few attempts have been made on domestic satellite imagery data management using ODC. The current ODC lacks automated data organization tools for China's satellite imagery. Therefore, this paper took the domestic GF-1 imagery as an example to explore the automated management of domestic imagery data under the ODC framework by developing middleware called ODC_GFTool. The middleware's development environment is .NET Framework 4.0, which supports the current mainstream Windows 10 operating system. Based on GDAL, YamlDotNet and other components, ODC_GFTool achieves spectral information, band information, spatial reference, and other contents from high-resolution image files. In addition, with the strong matrix computing ability of the Matlab software, ODC_GFTool realizes high score image processing and visualization through mixed programming. The main processes of importing domestic satellite data into ODC using ODC_GFTool include defining GF-1 image products, building indexes, and ingesting data. For demenstration, the paper took Poyang Lake as the test area and did an experimental water extraction. Results show that ODC has obvious efficiency advantage compared with traditional data processing tools. The use of ODC for domestic satellite imagery management increased the storage space by 7.2% and reduced the processing time to one third of the traditional methods. In addition, compared to Google Earth Engine and EarthServer, ODC has the following advantages: (1) ODC supports localized database storage, considering the security of some satellite imagery, data storage and computing need to be local, not in the cloud. (b) As an open source earth observation data management framework, ODC facilitates integration and secondary development according to actual project requirements. Research on ODC data management and application for domestic satellite imagery not only can enrich new ways of domestic image data management in China and increase the practical application value of ODC in the world, but also promote international cooperation and respond to the national earth observation infrastructure construction.

Key words: Open Data Cube, ODC, domestic satellite images, data management, image storage, GF-1, Poyang Lake