一种运动恢复结构和航位推算结合的室内行人视觉定位方法

doi:10.3724/SP.J.1047.2017.00744

地球信息科学学报 ›› 2017, Vol. 19 ›› Issue (6): 744-753.doi: 10.3724/SP.J.1047.2017.00744

• 地球信息科学理论与方法 • 上一篇下一篇

一种运动恢复结构和航位推算结合的室内行人视觉定位方法

刘涛^1,²(), 张星^1,^*(), 李清泉^1,³, 方志祥³, 李秋萍⁴

1. 深圳大学土木工程学院深圳市空间信息智能感知与服务重点实验室,深圳 518060
2. 河南财经政法大学资环与环境学院,郑州 450046
3. 武汉大学测绘遥感信息工程国家重点实验室,武汉 430079
4. 中山大学地理科学与规划学院综合地理信息研究中心,广州 510275

收稿日期:2016-10-20 修回日期:2017-03-01 出版日期:2017-06-20 发布日期:2017-06-20
作者简介:
作者简介：刘涛（1989-）,男,河南濮阳人,博士生,主要从事室内定位和行人导航等研究。E-mail: liuzimo@whu.edu.cn
基金资助:
国家自然科学基金项目（41301511、41371377、41371420、41501424）;国家重点研发计划项目（2016YFB0502203）;深圳市科技计划项目(JCYJ20140418095735587);深圳大学科研启动基金资助项目(2016064)

An Indoor Pedestrian Positioning Approach Based on the Integration of SFM and PDR

LIU Tao^1,²(), ZHANG Xing^1,^*(), LI Qingquan^1,³, FANG Zhixiang³, LI Qiuping⁴

1. Shenzhen Key Laboratory of Spatial Information Smart Sensing and Services, Shenzhen University, Shenzhen 518060, China
2. College of Resources and Environment, Henan University of Economics and Law, Zhengzhou 450046, China
3. State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China
4. School of Geography and Planning, Sun Yat-Sen University, Guangzhou 510275, China

Received:2016-10-20 Revised:2017-03-01 Online:2017-06-20 Published:2017-06-20
Contact: ZHANG Xing

摘要/Abstract

摘要：

商业和工业领域中,室内行人、车辆、机器人的位置信息正逐渐成为人们关注的热点,并随之产生了大量的室内定位技术和方法,如使用无线信号、地磁、超宽带和超声波等方式进行室内定位。然而,目前的这些室内定位方法大多需要额外辅助设备的支撑,增加了定位成本和硬件开销。视觉定位作为一种目前较为流行的定位方式,具有实施成本低、不依赖任何外界辅助设备等优势。其中,构建带有位置标签的图像数据库是视觉定位方法的关键环节,而传统的构建图像数据库方法人力开销大、时耗长。因此,本文提出一种运动恢复结构（SFM）和航位推算结合的视觉定位方法,能够快速构建图像位置数据库、大大降低人力开销。该方法主要包括2个阶段：离线阶段和在线阶段。离线阶段主要实现图像序列位置的自动标注,通过采集行走路线上的手机内置传感器信息和视频信息,提出一种多约束图像匹配方法用于视频图像的连续匹配,将匹配结果用于SFM方法,可以得到相邻图像间的运动角度,使用行人航位推算（PDR）方法标注图像序列的轨迹坐标。在线阶段使用提出的图像匹配方法计算查询图像与数据库影像间的匹配点数量,将匹配点最多的K个数据库影像位置坐标加权平均作为查询图像的定位结果。最后,分别在2种典型的室内环境下进行实验,结果表明本文方法在离线阶段位置标注的平均误差为0.58 m,在线阶段图像匹配定位的误差范围在0.2~1.4 m。

关键词: 室内定位, 手机传感器, 图像匹配, 运动恢复结构, 航位推算

Abstract:

Currently, the localization of users, such as people, vehicles or robots, in indoor spaces is a common issue in many commercial and industrial applications. A number of technologies have been proposed for indoor localization based on different principles such as RF (Radio Frequency), magnetic fields, ultra wide band (UWB) and ultrasound. Among these up-to-date indoor positioning technologies, most of them depend on special infrastructures or devices, which limit the commercial application of indoor localization. As one of the state-of-art indoor localization method, visual-based positioning scheme do not rely on any external auxiliary equipment and consequently has the advantage of low cost. However, the construction of geo-tagged image database, one of the most important parts for visual-based localization, is quite labor-intensive and time consuming. The automatic collection of geo-tagged indoor image data is an essential bottleneck for application of visual-based indoor localization systems. This paper proposed a visual-based indoor positioning approach which can automatically collect geo-tagged images based on the integration of structure from motion (SFM) and pedestrian dead rocking (PDR). The main idea of this method is to collect video frames as well as inertial data (by using smartphones) when people are walking in indoor environments. A method is designed to estimate the location (i.e., geo-tags) of images for the construction of geo-tagged image database. There are two phases for this approach: offline phase and online phase. During offline phase, the proposed method is used to estimate the location of the images extracted from video frames. A multi-constrain image matching algorithm was also developed to improve the performance of location estimation. There are three constraints in this multi-constrain image matching algorithm: ratio constraint, symmetry constraint and RANSAC constraint. Based on this image matching algorithm, a SFM process can be conducted to estimate the heading angle of a walking trajectory. After that, the coordinate of sampling points from the walking trajectory can be estimated by using the PDR method and the geo-tagged image database can be constructed. During the online phase, an indoor localization method is proposed to estimate the location of a pedestrian by finding the best matching images of a query image (taken by the pedestrian) from the image database. The multi-constraint image matching algorithm can be used to compute the number of matched key-points between query images and database images. The images with the most matched key-points are selected as the candidates. A weighted average function is used to estimate the location of the query image based on the selected images. In order to evaluate the performance of the visual-based indoor localization approach, two types of indoor environment are selected as the study area: an office building and a hospital. The experimental result showed that the average location estimation error of the geo-tagged images was 0.58 m. Based on the constructed image database, the error of the proposed localization approach ranged from 0.2 to 1.4 m. The performance of this approach indicated that visual information contribute to the construction of geo-tagged image database. This approach can be used in various indoor environments without any infrastructures or extra devices, which can reduce the difficulty in applying this approach to practical use.

Key words: indoor positioning, smartphone sensors, image matching, structure from motion, pedestrian dead rocking.

刘涛, 张星, 李清泉, 方志祥, 李秋萍. 一种运动恢复结构和航位推算结合的室内行人视觉定位方法[J]. 地球信息科学学报, 2017, 19(6): 744-753.DOI:10.3724/SP.J.1047.2017.00744

LIU Tao,ZHANG Xing,LI Qingquan,FANG Zhixiang,LI Qiuping. An Indoor Pedestrian Positioning Approach Based on the Integration of SFM and PDR[J]. Journal of Geo-information Science, 2017, 19(6): 744-753.DOI:10.3724/SP.J.1047.2017.00744

图/表 11

图1

图2

图3

图4

图5

图6

图7

图8

图9

图10

表1

参考文献 28

[1]	Chen X H, Pang J.Protecting query privacy in location based services[J]. GeoInformatica, 2014,18(1):95-133. doi: 10.1007/s10707-013-0192-0
[2]	Kwon O H, Song H J, Park S.The effects of stitching orders in Patch-and-stitch WSN localization algorithms[J]. IEEE Transactions on Parallel and Distributed Systems, 2009, 20(9): 1380-1391. doi: 10.1109/TPDS.2008.226
[3]	Fang S H, Lin T N, Lee K C.A novel algorithm for multipath fingerprinting in indoor WLAN environments[J]. IEEE Transactions on Wireless Communications, 2008,7(9):3579-3588. doi: 10.1109/TWC.2008.070373
[4]	Kotanen A, HÄNNIKÄINEN M, LEPPÄKOSKI H, HÄMÄLÄINEN T. D. Experiments on local positioning with Bluetooth[C]// IEEE International Conference on Information Technology: Coding and Computing [Computers and Communications], ITCC, 2003:297-303.
[5]	Harter A, Hopper A.A distributed location system for the active office[J]. IEEE Network, 1994,8(1):62-70. doi: 10.1109/65.260080
[6]	Ni L M, Liu Y, Lau Y C, et al.LANDMARC: Indoor location sensing using active RFID[J]. Wireless networks, 2004,10(6):701-710. doi: 10.1023/B:WINE.0000044029.06344.dd
[7]	Schroth G, Huitl R, Chen D, et al.Mobile visual location recognition[J]. IEEE Signal Processing Magazine, 2011, 28(4):77-89. doi: 10.1109/MSP.2011.940882
[8]	Ravi N, Shankar P, Frankel A, et al.Indoor localization using camera phones[C]//Mobile Computing Systems and Applications, 2006. WMCSA'06. Proceedings. 7th IEEE Workshop on. IEEE, 2006:49-49.
[9]	Liu T, Li Q, Zhang X. Automatic construction of Wi-Fi radio map using smartphones[J]. ISPRS-International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2016,XLI-B4:309-312. doi: 10.5194/isprsarchives-XLI-B4-309-2016
[10]	Ruotsalainen L, Kuusniemi H, Bhuiyan M Z H, et al. A two-dimensional pedestrian navigation solution aided with a visual gyroscope and a visual odometer[J]. Gps Solutions, 2013,17(4):575-586. doi: 10.1007/s10291-012-0302-8
[11]	Liang J Z, Corso N, Turner E, et al.Image based localization in indoor environments[C]// IEEE International Conference on Computing for Geospatial Research and Application (COM. Geo), 2013:70-75.
[12]	Beauregard S, Haas H.Pedestrian dead reckoning: A basis for personal positioning[C]//Proceedings of the 3rd Workshop on Positioning, Navigation and Communication. 2006:27-35.
[13]	周宝定,李清泉,毛庆洲,等.用户行为感知辅助的室内行人定位[J].武汉大学学报·信息科学版,2014,39(6):719-723. doi: 10.13203/j.whugis20140100
	[ Zhou B D,Li Q Q,Mao Q Z,et al.User activity awareness assisted indoor pedestrian localization[J]. Geomatics and Information Science of Wuhan Univers, 2014,39(6):719-723. ] doi: 10.13203/j.whugis20140100
[14]	Zhou B, Li Q, Mao Q, et al.Activity sequence-based indoor pedestrian localization using smartphones[J]. IEEE Transactions on Human-Machine Systems, 2015,45(5):562-574. doi: 10.1109/THMS.2014.2368092
[15]	刘涛, 张星,李清泉,等.顾及地标可视性的室内导航路径优化算法[J].武汉大学学报·信息科学版,2017,42(1):43-48. doi: 10.13203/j.whugis20150387
	[ Liu T, Zhang X, Li Q Q, et al.An indoor pedestrian route planning algorithm based on landmark visibility[J]. Geomatics and Information Science of Wuhan Univers, 2017,42(1):43-48. ] doi: 10.13203/j.whugis20150387
[16]	陈国良,张言哲,汪云甲,等. WiFi-PDR 室内组合定位的无迹卡尔曼滤波算法[J].测绘学报,2015,44(12):1314-1321. doi: 10.11947/j.AGCS.2015.20140691
	[ Chen G L, Zhang Y Z, Wang Y J, et al.Unscented kalman filter algorithm for WiFi-PDR integrated indoor positioning[J]. Acta Geodaetica et Cartographica Sinica, 2015,44(12):1314-1321. ] doi: 10.11947/j.AGCS.2015.20140691
[17]	田辉,夏林元,莫志明,等.泛在无线信号辅助的室内外无缝定位方法与关键技术[J].武汉大学学报·信息科学版,2009,34(11):1372-1376.
	[ Tian H, Xia L Y, Esmond M, et al.Signal of opportunity assisted ubiquitous positioning and its key elements for outdoor/indoor environment[J]. Geomatics and Information Science of Wuhan University, 2009,34(11):1372-1376. ]
[18]	Evennou F, Marx F, Novakov E.Map-aided indoor mobile positioning system using particle filter[C]//Wireless Communications and Networking Conference, 2005 IEEE. IEEE, 2005,4:2490-2494.
[19]	吴东金,夏林元.面向室内WLAN定位的动态自适应模型[J].测绘学报,2015,44(12):1322-1330. doi: 10.11947/j.AGCS.2015.20130780
	[ Wu D J, Xia L Y.Dynamic adaptive model for indoor WLAN localization[J]. Acta Geodaetica et Cartographica Sinica, 2015,44(12):1322-1330. ] doi: 10.11947/j.AGCS.2015.20130780
[20]	Sturm P, Triggs B.A factorization based algorithm for multi-image projective structure and motion[M]//Computer Vision-ECCV'96. Springer Berlin Heidelberg, 1996:709-720.
[21]	Harris C, Stephens M.A combined corner and edge detector[C]//Alvey vision conference. 1988.
[22]	Lowe D G.Distinctive image features from scale-invariant keypoints[J]. International journal of computer vision, 2004,60(2):91-110. doi: 10.1023/B:VISI.0000029664.99615.94
[23]	Bay H, Tuytelaars T, Van Gool L.Surf: Speeded up robust features[M]//Computer vision-ECCV 2006. Springer Berlin Heidelberg, 2006:404-417.
[24]	Fischler M A, Bolles R C.Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981,24(6):381-395. doi: 10.1145/358669.358692
[25]	Faugeras O D, Lustman F.Motion and structure from motion in a piecewise planar environment[J]. International Journal of Pattern Recognition and Artificial Intelligence, 1988,2(3):485-508. doi: 10.1142/S0218001488000285
[26]	Golub G H, Reinsch C.Singular value decomposition and least squares solutions[J]. Numerische mathematik, 1970,14(5):403-420. doi: 10.1007/978-3-662-39778-7_10
[27]	Mladenov M, MockM. “A step counter service for java-enabled devices using a built-in accelerometer,” in Proc. 1st Int[C]. Workshop Context-Aware Middleware Services, Afﬁliated 4th Int. Conf. Commun. Syst. Softw. Middleware, 2009:1-5.
[28]	Rai A, Chintalapudi K K, Padmanabhan V N, et al.Zee: zero-effort crowdsourcing for indoor localization[C]//Proceedings of the 18th annual international conference on Mobile computing and networking. ACM, 2012:293-304.

匹配指标	匹配正确率/%	平均定位误差	时间开销/s
本文方法	94	0.6 m	3
文献[8]方法	80	房间级别	4.1
文献[11]方法	94	1 m	10-12

一种运动恢复结构和航位推算结合的室内行人视觉定位方法

An Indoor Pedestrian Positioning Approach Based on the Integration of SFM and PDR

RichHTML

PDF (PC)

赞

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 11

参考文献 28

相关文章 2

Metrics

本文评价

推荐阅读 0

[1]	承达瑜, 秦坤, 裴韬, 欧阳, 王蒙, 徐连明. 基于室内定位数据的群体时空行为可视化分析[J]. 地球信息科学学报, 2019, 21(1): 36-45.
[2]	黄正宇, 陈益强, 刘军发, 蒋鑫龙, 胡春雨. 基于众包数据的室内定位方法和平台[J]. 地球信息科学学报, 2016, 18(11): 1476-1784.