面向网页文本的地理要素变化检测

doi:10.3724/SP.J.1047.2013.00625

地球信息科学学报 ›› 2013, Vol. 15 ›› Issue (5): 625-634.doi: 10.3724/SP.J.1047.2013.00625

• 地球信息科学理论与方法 • 下一篇

面向网页文本的地理要素变化检测

王曙¹, 吉雷静², 张雪英², 赵仁亮³, 陈晓丹², 余浩⁴

1. 英国利兹大学地理学院, 利兹 LS2 9JT;
2. 南京师范大学虚拟地理环境教育部重点实验室, 南京 210046;
3. 中国国家基础地理信息中心, 北京 100830;
4. 南京邮电大学计算机学院, 南京 210003

收稿日期:2013-06-07 修回日期:2013-07-05 出版日期:2013-09-29 发布日期:2013-09-29
通讯作者: 张雪英(1970-),女,四川人,博士,教授,主要从事地理信息系统、地理信息智能处理和服务等方面研究。E-mail:zhangsnowy@163.com E-mail:zhangsnowy@163.com
作者简介:王曙(1989-),男,山西人,硕士生,主要从事地理信息智能数据处理、地理信息系统等方面研究。E-mail:shuwang8951@hotmail.com
基金资助:
国家测绘科技项目“网络地理信息变化检测技术研究”;国家自然科学基金项目(40971231);“863”计划项目(2007AA12Z221)

Change Detection of Geographic Features Based on Web Pages

WANG Shu¹, JI Leijing², ZHANG Xueying², ZHAO Renliang³, CHEN Xiaodan², YU Hao⁴

1. School of Geography, The University of Leeds, LS2 9JT, United Kingdom;
2. Key Laboratory of Virtual Geographical Environment, Ministry of Education, Nanjing Normal University, Nanjing 210046, China;
3. National Geomatics Center of China, Beijing 100830, China;
4. School of Computer Science, Nanjing University of Posts and Telecommunication, Nanjing 210003, China

Received:2013-06-07 Revised:2013-07-05 Online:2013-09-29 Published:2013-09-29

摘要/Abstract

摘要：

地理要素变化检测已成为国家地理信息“十二五”规划和全国地理国情普查的重要组成部分。网页文本中蕴含海量的地理要素信息,尤其是新闻、政府、社交平台等网站的网页文本更新频繁,可为地理要素变化检测提供现势性的数据源。本文针对网页文本中地理要素变化的语言描述特点,构建了表达地理要素变化的语义知识库,设计了搜索引擎和通用主题相结合的网页爬虫,实现了相关网页文本的高效获取;采用规则模型和条件随机场模型,分别进行网页文本中地理要素变化信息抽取,包括地理要素名称、位置(地名)、时间和属性等。实验结果显示,本文设计的网页爬虫具有较高的相关网页文本获取能力,地理要素变化信息抽取的准确率能够达到70%以上,但是,语义知识库的完备程度对于信息抽取性能具有较大影响。研究成果表明,以网页文本为数据源的地理要素变化信息获取方法,能提供一种快速检测地理要素变化的新途径,与实地调绘和遥感影像检测等方法结合应用具有较好的优势互补性,可作为有力的辅助手段解决地理要素的持续更新和实时更新问题。

关键词: 信息抽取, 文本解析, 网页文本, 网页爬虫, 地理要素变化

Abstract:

Geographic features change detection has became a vital component of the national geographical information 12th Five-Year-Plan and the national geographic general survey. In web pages, billions of geographic feature changes were contained, especially in government official websites, news homepages, social portals and etc. The web pages of these websites update frequently, which could provide the latest data for geographic infor-mation change detection. Considering the complex characteristics of the web geographic information description, this paper did some valuable achievements. First of all, the geographic information knowledge base was established by summarizing the geographic information words and phrases, which could give the great supports to geographic information semantics change detection. Then, the web geographic information was obtained using two kinds of web crawler technologies. Combining the Google Custom Search crawler and general topic crawler, the web geographic information obtainment could be more complete in both scope and depth. Thirdly, the geographic information was parsed and extracted from the web text, which showed users the related features, place names, times and attributes. Last but not least, the prototype system was finally developed and the results were analyzed. The experiments indicated that the accuracy of related web pages obtainment and features change detection were over 74% and 70% respectively. In addition, the results of geographic information change detection highly relied on the integrity of knowledge base, which need to be completed further. Moreover, the uncertainty and fuzziness of web geographic information also limited the change detection results. Therefore, the web page based geographic information change detection could be a supplementary method of geographic information change detection. Combining the traditional surveying detection and remote-sensing imagery detection methods, it could solve the problems of continuous updating and timely updating of geographic information efficiently.

Key words: web crawler, text parsing, geographic feature changes, web text, information extraction

王曙, 吉雷静, 张雪英, 赵仁亮, 陈晓丹, 余浩. 面向网页文本的地理要素变化检测[J]. 地球信息科学学报, 2013, 15(5): 625-634.DOI:10.3724/SP.J.1047.2013.00625

WANG Shu, JI Lei-Jing, ZHANG Xue-Yang, DIAO Ren-Liang, CHEN Xiao-Dan, TU Gao. Change Detection of Geographic Features Based on Web Pages[J]. , 2013, 15(5): 625-634.DOI:10.3724/SP.J.1047.2013.00625

参考文献

[1] 钱育华.数字城镇的数据更新[J].地球信息科学,2002,4(3): 64-67.

[2] Chen J, Zhao R L ,Wang D H. Dynatmic updating system for national fundamental GIS: Concepts and research agenda[J]. GeomaticsWorld, 2007,5(5):4-9.

[3] Heipke C. Updating geospatial databases from images[C].//Li Z L, Chen J, Baltsavias E (Eds.). Advances in Photogrammetry, Remote Sensing and Spatial Information Sciences: 2008 ISPRS Congress Book, Boca Raton: CRC Press, 2008,355-362.

[4] Badard T. Towards a generic updating tool for geographic databases[C]. Proceedings of GIS/LIS'98 Annual Exposition and Conference. USA, 1998,352-363.

[5] 陈军,王东华,商瑶玲.国家1:50000数据库更新工程总体设计研究与技术创新[J].测绘学报,2010,39(1):7-10.

[6] 王迪伟.基于PDA的1:10000比例尺地形图野外调绘[J]. 测绘通报,2010(7):59-61.

[7] 李冰,曹宏文,曹歆宏.大比例尺地理信息数据库建设刍论 [J].科技创新与生产力,2010,195(7):83-85.

[8] 王帅.初探首次全国地理国情普查[J].3S News Weekly, 2013(5):30-33.

[9] Palkowsky B, MetaCarta I. A new approach to information discovery——Geography really does matter[C]. Proceedings of the SPE Annual Technical Conference and Exhibition, 2005.

[10] Ai T. Constraints of progressive transmission of spatial data on the web[J]. Geo-spatial Information Science, 2010, 13(2):85-92.

[11] 容伟杰.网络信息存在的几大问题[J].图书馆学研究, 2003(2):48-49.

[12] 孙瑞英.网络数据内容分析研究[J].图书馆学研究,2005 (5):35-39.

[13] Wu M L, Li W J L, Lu Q, et al. CTEMP: A Chinese temporal parser for extracting and normalizing temporal information[C]. Natural Language Processing—IJCNLP 2005, Second International Joint Conference, Korea, 2005:694-706.

[14] 赵国荣.中文新闻语料中的时间短语识别方法研究[D]. 太原:山西大学,2006.

[15] 逯万辉,马建霞.基于条件随机场模型的复杂时间信息抽取研究[J].现代图书情报技术,2011(10):29-33.

[16] 宋洋,徐蔚然.基于条件随机场的事件起止时间表达式的识别[J].中国科技论文在线,2012(1):1-8.

[17] 俞鸿魁,张华平,刘群,等.基于层叠隐马尔可夫模型的中文命名实体识别[J].通信学报,2006,27(2):87-94.

[18] 钱晶,张杰,张涛.基于最大熵的汉语人名地名识别方法研究[J].小型微型计算机系统,2006,27(9):1761-1764.

[19] 张雪英,闾国年,李伯秋,等.基于规则的中文地址要素解析方法[J].地球信息科学学报,2010,12(2):9-16.

[20] 李丽双,党延忠,廖文平,等.CRF与规则相结合的中文地名识别[J].大连理工大学学报,2012,52(2):285-289.

[21] 李丽双,黄德根,陈春荣.SVM与规则相结合的中文地名自动识别[J].中文信息学报,2006,20(5):27-51.

[22] Mark M D, Comas D, Egenhofer M J, et al. Evaluating and refining computational models of spatial relations through cross-linguistic human-subjects testing[C].//Frank A and Kuhn W (Eds.). Spatial Information Theory -A Theoretical Basis for GIS, International Conference COSIT, Semmering, Austria, Lecture Notesin Computer Science. Berlin: Springer-Verlag,1995,553-568.

[23] Egenhofer M J. Locational SQL: Syntax extensions, surveying engineering program[D]. Orono: University of Maine,1987.

[24] Coyne B, Sproat R. WordsEye: An automatic textto-scene conversion system[C]. Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA, New York, 2001:487-496.

[25] Le X Q, Yang C J, Yu W Y. Spatial concept extraction based on spatial semantic role in natural language[J]. Geomatics and Information Science of Wuhan University, 2005,30(12):1100-1103.

[26] Zhang X Y, Lv G N. Natural-language spatial relations and their applications in GIS[J]. Geo-information Science, 2007,9(6):77-81.

[27] 朱少楠,张雪英,张春菊.地理空间关系描述的句法模式识别[C]. Proceedings of 2010 International Conference on Broadcast Technology and Multimedia Communication, 2010(4):355-357.

[28] 蒋文明.面向中文文本的空间方位关系抽取方法研究[D].南京:南京师范大学,2010.

[29] 高文利. IERDL——基于关键词驱动的信息抽取系统的规则描述语言[J].软件导刊,2009,10(8):67-69.

[30] Ravi S, Pa?ca M. Using structured text for large-scale attribute extraction[C]. Proceedings of the 17th ACM Conference on Information and Knowledge Management, ACM, 2008:1183-1192.

[31] Soderland S. Learning information extraction rules for semi-structured and free text[J]. Machine Learning, 1999, 34(1-3):233-272.

[32] 刘臻煕.中文文本中地理实体属性信息抽取方法研究[D].南京:南京师范大学,2010.

[33] 张春菊.面向特定时间的Web文本时刻属性信息挖掘方法[D].南京:南京师范大学,2013.

[34] 周立,邓云青.城市地理信息系统数据更新方式研究[J]. 地理空间信息,2008,6(5):45-47.

[35] 曾文华,黄桦.基于网页信息检索的地理信息变化检测方法[J].计算机应用,2010(4):1132-1134.

[36] 闫会杰,赵巍.服务于地理信息数据动态更新的网络蜘蛛[J].测绘技术装备,2012(2):21-22.

[37] Metzger M J. Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research[J]. Journal of the American Society for Information Science and Technology, 2007,58 (13):2078-2091.

[38] 李丽双,党延忠,廖文平,等.CRF与规则相结合的中文地名识别[J].大连理工大学学报,2012,52(2):285-289.

面向网页文本的地理要素变化检测

Change Detection of Geographic Features Based on Web Pages

PDF (PC)

赞

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 6

Metrics

本文评价

推荐阅读 0

[1]	贾梦姝, 张宇, 潘婷婷, 吴文周, 苏奋振. 面向互联网信息抽取的海洋环境灾害链本体构建——以台风灾害为例[J]. 地球信息科学学报, 2020, 22(12): 2289-2303.
[2]	裴韬, 郭思慧, 袁烨城, 张雪英, 袁文, 高昂, 赵志远, 薛存金. 面向公共安全事件的网络文本大数据结构化研究[J]. 地球信息科学学报, 2019, 21(1): 2-13.
[3]	王姬卜, 陆锋, 吴升, 余丽. 基于自动回标的地理实体关系语料库构建方法[J]. 地球信息科学学报, 2018, 20(7): 871-879.
[4]	陆锋, 余丽, 仇培元. 论地理知识图谱[J]. 地球信息科学学报, 2017, 19(6): 723-734.
[5]	仇培元, 张恒才, 陆锋. 互联网文本蕴含道路交通信息抽取的模式匹配方法[J]. 地球信息科学学报, 2015, 17(4): 416-422.
[6]	余丽, 陆锋, 张恒才. 网络文本蕴涵地理信息抽取：研究进展与展望[J]. 地球信息科学学报, 2015, 17(2): 127-134.