基于结构化场景的单幅图像建筑物三维重建

doi:10.3724/SP.J.1047.2016.01022

摘要/Abstract

摘要：

针对无法利用激光扫描或多张图像实现三维重建的已损或不复存在的建筑,本文提出了一种基于结构化场景的单张图像建筑物三维重建方法。该方法先基于RANSAC算法及最小距离法分别解算灭点直线和灭点;然后基于平行平面、包含平行信息的任意平面和包含垂直信息的任意平面的平面模型解算三维坐标。本文以现存某高校图书馆为例,重建了三维模型,并分析了模型精度。结果表明,重建误差最小为0,最大为5.8%,模型整体精度在1.9%左右,符合三维重建精度要求。在四川省白鹿领报修院教堂的三维重建应用中,建立了已损建筑物的三维模型,获得了较好的重建效果。该方法适用于包含平行、垂直、灭点和平面结构的建筑物场景,可得到建筑物三维几何线框模型,几何细节采用纹理映射替代,可应用于现存建筑和文化遗存遗址的三维重建。

关键词: 单幅图像, 三维重建, 平面重建, 建筑物

Abstract:

For the damaged or disappeared buildings which cannot be reconstructed by laser scanning technique or from multi-pictures, this paper proposed a method for the single view architecture's reconstruction based on the structured scene. Firstly, the vanishing lines and vanishing points were calculated and extracted based on the RANSAC algorithm and minimum distance method. Then, their three dimensional coordinates were calculated from the parallel plane or any plane that contains the parallel lines or vertical lines. Experiments were undertaken to evaluate the validities of the proposed method with two datasets, one of which is featured by a university's library and the other is the Sichuan Bailu Lingbao Seminary Church. The minimum reconstruction error of the university library is 0 while the maximum is 5.8%, and the overall accuracy is about 1.9%, which satisfies the accuracy requirement. At the same time, this method was applied for reconstructing the damaged buildings, which provides a good reconstruction result for Sichuan Lingbao Seminary Church's three dimensional reconstruction and modeling. This method is applicable to building scenarios containing the parallel, perpendicular, vanishing point and plane structure, which is used to obtain the three-dimensional geometric wireframe building model. Furthermore, the geometric details are replaced by texture mapping. This method also can be applied to the three-dimensional reconstruction of the existing buildings and ancient cultural relics.

Key words: single view, 3D reconstruction, plane reconstruction, architecture

王思洁, 方莉娜, 陈崇成, 黄明伟. 基于结构化场景的单幅图像建筑物三维重建[J]. 地球信息科学学报, 2016, 18(8): 1022-1029.DOI:10.3724/SP.J.1047.2016.01022

WANG Sijie,FANG Lina,CHEN Chongcheng,HUANG Mingwei. A Single View Type 3D Reconstructive Method for Architecture Based on Structured Scene[J]. Journal of Geo-information Science, 2016, 18(8): 1022-1029.DOI:10.3724/SP.J.1047.2016.01022

图/表 13

图1

图2

图3

图4

图5

图7

图6

表1

表2

表3

表4

实验一相机标定结果"

内参数/像元		外参数矩阵		投影矩阵P
u₀	2152.94	$R = 0.68 0.24 0.69 - 0.73 0.25 0.63 - 0.02 - 0.94 0.35$	$t = 0.23 0.19 1$	$P = 3942.72 - 1284.83 680.41 2979.00 1921.82 1846.55 - 2864.79 2210.00 0.69 0.63 0.35 1.00$
v₀	1512.12
f	3608.83

表4

表5

图8

参考文献 18

[18]	[ Zhu J G, Li Y J, Ye S H, et al.Study on single camera simulating stereo vision·measurement technology[J]. Acta Optica Sinica, 2005,25(7):943-948. ] doi: 10.3321/j.issn:0253-2239.2005.07.016
[19]	胡春海,刘斌.基于镜像几何约束的单摄像机三维重构[J].中国激光,2010(10):2576-2581. doi: 10.3788/cjl20103710.2576
	[ Hu C H, Liu B.Three-dimensional reconstruction method using single CCD based on geometric constraint of bilateral symmetry[J]. Chinese Journal of Lasers, 2010,10:2576-2581. ] doi: 10.3788/cjl20103710.2576
[20]	张桂梅,储珺,王丽.利用直线参数信息的建筑物灭点检测方法[J].计算机应用,2013,33(2):515-538. doi: 10.3724/SP.J.1087.2013.00515
	[ Zhang G M, Chu J, Wang L.Building's vanishing points detection method with line parameter information[J]. Journal of Computer Applications, 2013,33(2):515-538. ] doi: 10.3724/SP.J.1087.2013.00515
[21]	Cipolla R, Robertson D.3D models of architectural scenes from uncalibrated images and vanishing points[C]. Proceedings of the IEEE International Conference on Image Analysis and Processing, 1999:824-829.
[22]	刘亚文. 利用数码像机进行房产测量与建筑物的精细三维重建[D].武汉:武汉大学,2006.
	[ Liu Y W.Real estate measuring and 3d building fine reconstrution based on digital camera[D]. Wuhan: Wuhan University, 2006. ]
[1]	高剑. 三维重建应用系统研究[D].济南:山东大学,2009.
	[ Gao J.A research on application system of 3d reconstruction[D]. Jinan: Shandong University, 2009. ]
[2]	彭国均,池天河,唐丽玉,等.数字城市的三维图形构建技术[J]. 地球信息科学,2003,5(3):84-88. doi: 10.3969/j.issn.1560-8999.2003.01.017
	[ Peng G J, Chi T H, Tang L Y, et al.Discussion on the technique of constructing three-dimensional graphics in digital city[J]. Geo-Information Science, 2003,5(3):84-88. ] doi: 10.3969/j.issn.1560-8999.2003.01.017
[3]	林珲,胡明远,陈富龙.文化遗产多源探测技术与环境重建展望[J].地球信息科学学报,2014(5):673-680. doi: 10.3724/SP.J.1047.2014.00673
	[ Lin H, Hu M Y, Chen F L.Review on multi-source detection technology and environment reconstruction of cultural heritage[J]. Journal of Geo-Information Science, 2014,5:673-680. ] doi: 10.3724/SP.J.1047.2014.00673
[4]	Criminisi A, Reid I, Zisserman A.Single view metrology[J]. International Journal of Computer Vision, 2000,40(2):123-148.
[5]	Horn B K.Shape from shading: A method for obtaining the shape of a smooth opaque object from one view[R]. Cambridge, MA: Massachusetts Institute of Technology, 1970.
[6]	Kawasaki H, Furukawa R.Shape reconstruction and camera self-calibration using cast shadows and scene geometries[J]. International Journal of Computer Vision, 2009,83(2):135-148. doi: 10.1007/s11263-008-0188-7
[7]	Saxena A, Sun M, Ng A Y.Make3d: Learning 3d scene structure from a single still image[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009,31(5):824-840. doi: 10.1109/TPAMI.2008.132 pmid: 19299858243
[8]	Saxena A, Chung S H, Ng A Y.3-d depth reconstruction from a single still image[J]. International Journal of Computer Vision, 2008,76(1):53-69. doi: 10.1007/s11263-007-0071-y
[9]	Debevec P E, Taylor C J, Malik J.Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach[C]. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques: ACM, 1996:11-20.
[10]	Guillou E, Meneveaux D, Maisel E, et al.Using vanishing points for camera calibration and coarse 3d reconstruction from a single image[J]. The Visual Computer, 2000,16(7):396-410. doi: 10.1007/PL00013394
[11]	王茹,周明全,耿国华.基于二维透视图像的建筑物基本体素三维重建[J].计算机应用与软件,2009,26(9):7-9. doi: 10.3969/j.issn.1000-386X.2009.09.003
	[ Wang R, Zhou M Q, Geng G H.3D reconstruction of architecture's basic element based on 2d perspective image[J]. Computer Applications and Software, 2009,26(9):7-9. ] doi: 10.3969/j.issn.1000-386X.2009.09.003
[12]	Payne B R, Lay J F, Hitz M A.Automatic 3d object reconstruction from a single image[C]. Proceedings of the 2014 ACM Southeast Regional Conference: ACM, 2014,31.
[13]	Garcia-Gago J, Gomez-Lahoz J, Rodríguez-Méndez J, et al.Historical single image-based modeling: The case of Gobierna Tower, Zamora (Spain)[J]. Remote Sensing, 2014,6(2):1085-1101. doi: 10.3390/rs6021085
[14]	Sturm P, Maybank S.A method for interactive 3d reconstruction of piecewise planar objects from single images[C]. The 10th British Machine Vision Conference (BMVC'99): The British Machine Vision Association (BMVA), 1999:265-274.
[15]	Coughlan J M, Yuille A L.Manhattan world: Compass direction from a single image by bayesian inference[C]. Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999:941-947.
[16]	Delage E, Lee H, Ng A Y.Automatic single-image 3d reconstructions of indoor manhattan world scenes[M]. Robotics Research. Berlin: Springer Berlin Heidelberg, 2007:305-321.
[17]	Wang G, Tsui H-T, Hu Z, et al.Camera calibration and 3d reconstruction from a single view based on scene constraints[J]. Image and Vision Computing, 2005,23(3):311-323. doi: 10.1016/j.imavis.2004.07.008
[18]	邾继贵,李艳军,叶声华,等.单摄像机虚拟立体视觉测量技术研究[J].光学学报,2005,25(7):943-948. doi: 10.3321/j.issn:0253-2239.2005.07.016

	V_X/像元	V_Y/像元	V_Z/像元
x	5695.02	-2008.18	1974.29
y	2777.26	2913.39	-8404.50
SD	0.63	1.74	12.97

	V_X/像元	V_Y/像元	V_Z/像元
x	5665.14	-1999.87	1942.98
y	2761.56	2903.03	-8666.43
SD	1.46	3.67	8.73

	真实值	计算值	误差
自动法	20.00	19.94	0.0029
手动法	20.00	19.91	0.0047

线段	模型长度/m	实际长度/m	绝对误差
L1	38.759	38.707	0.001
L2	23.920	24.428	0.021
L3	13.937	14.212	0.019
L4	38.951	38.951	0.000
L5	24.764	25.450	0.027
L6	11.956	12.399	0.036
L7	14.859	14.038	0.058
L8	15.040	15.379	0.001