地球信息科学学报 ›› 2018, Vol. 20 ›› Issue (8): 1055-1063.doi: 10.12082/dqxxkx.2018.180082

• 地球信息科学理论与方法 • 上一篇    下一篇

虚拟地理环境中沉浸式多人协同交互技术研究及实现

袁帅1,2(), 陈斌1,*(), 易超1, 徐丙立3   

  1. 1. 北京大学遥感与地理信息系统研究所,北京 100871
    2. 中国人民武装警察部队警种学院,北京 102202
    3. 陆军装甲兵工程学院,北京 100072
  • 收稿日期:2018-01-31 修回日期:2018-04-18 出版日期:2018-08-25 发布日期:2018-08-24
  • 作者简介:

    作者简介:袁帅(1987-),男,硕士生,主要从事虚拟地理环境研究。E-mail: gisyuanshuai@pku.edu.cn

  • 基金资助:
    装备发展部预研项目(315050501);国家自然科学基金项目(41771442、41271402)

Research and Implementation of Immersive Multi-User Collaborative Interaction Technology in Virtual Geographic Environment

YUAN Shuai1,2(), CHEN Bin1,*(), YI Chao1, XU Bingli3   

  1. 1. Institute of Remote Sensing and GIS, Peking University, Beijing 100871, China
    2. Specialized Forces College of Chinese People's Armed Police Force, Beijing 102202, China
    3. Academy of Armored Force Engineering, Beijing 100072, China
  • Received:2018-01-31 Revised:2018-04-18 Online:2018-08-25 Published:2018-08-24
  • Contact: CHEN Bin
  • Supported by:
    Pre-research Project of Equipment Development Department, No.315050501;National Natural Science Foundation of China, No.41771442, 41271402.

摘要:

在VGE的发展过程中,自然高效的人机交互一直是其研究的核心内容之一,但在当前众多VGE应用案例中,用户仍然是基于传统的人机交互界面与VGE进行交流,这导致了:① 用户的沉浸感不高;② 多人在VGE中协同交互的需求无法得到有效满足。因此,为了实现VGE中的沉浸式多人协同交互,本文首先综述了VGE中人机交互技术研究和应用现状,并简要阐述了动作捕捉技术发展历程、基本原理及其在提高VGE用户交互沉浸感上的优势。在此基础上,对VGE中沉浸式多人协同交互系统进行了重点设计,主要包括分析了基于动作捕捉技术的沉浸式多人协同交互模式及其对应的交互动作语义,提出了多人协同冲突控制机制,以及着重介绍了VGE中沉浸式多人协同交互系统的结构和功能。最后,以北京大学为例开发了虚拟燕园辅助规划设计原型系统,并进行了实验。研究结果表明,沉浸式多人协同交互技术的交互效果受到用户认可,它在提高化身之间及化身与VGE之间的协同交互方面具有明显的优势,可应用于地学教育、城市规划、应急救援和军事指挥等领域,具有良好的应用前景。

关键词: 虚拟地理环境, 动作捕捉, 人机交互, 多人协同, 沉浸感

Abstract:

In the development of virtual geographic environment (VGE), natural and efficient human-computer interactions have always been one of the core contents of its research. However, users still communicate with VGE based on the traditional human-computer interaction interface in many current VGE application cases. This leads to two problems: (1) the immersive feeling of the users is poor; (2) the requirements for multi-users to interact in VGE cannot be effectively satisfied. It is crucial to take advantage of the latest achievements of human-computer interaction technology in order to solve these problems to meet the immersive multi-user collaborative interaction requirements in VGE. In this paper, the status of research and application of the human-computer interaction technology in VGE was reviewed. The development process and basic principle of motion capture technology and its advantages in improving the interactive immersion of VGE users were briefly described. Next, focusing on the design of immersive multi-user collaborative interaction system in VGE, the immersive multi-user collaborative interaction model based on motion capture technology and the corresponding interactive semantics of its interactive actions were analyzed. A multi-user collaborative conflict control mechanism was proposed. The structure and function of the immersive multi-user collaborative interaction system in VGE were introduced emphatically. Moreover, the Virtual Yanyuan Auxiliary Planning Prototype System (VYAPPS) adopting Peking University campus as a case study was developed by using Javascript and Python language. The experiments based on VYAPPS were carried out. Questionnaire statistical results show that the interactive effects of the immersive multi-user collaborative interaction technology in VGE are recognized by users. The results also showed that the advantages of the immersive multi-user collaborative interaction technology in improving multi-user immersion make it have a good application prospect. For example, it can be applied to geography education, urban planning, emergency rescue, military command fields and so on.

Key words: VGE, motion capture, human-computer interaction, multi-user collaboration, immersion