论文标题
Microsoft Bing 3D城市和基于无人机的摄影测量数据的语义分割和数据融合
Semantic Segmentation and Data Fusion of Microsoft Bing 3D Cities and Small UAV-based Photogrammetric Data
论文作者
论文摘要
借助最先进的传感和摄影测量技术,Microsoft Bing Maps团队创建了来自11个不同国家的125个高度详细的3D城市,这些国家覆盖了数十万平方公里。 3D城市模型是使用带有高分辨率图像的摄影测量技术创建的,这些技术是由飞机安装的摄像机捕获的。如此大的3D城市数据库引起了美国陆军的注意,以创建虚拟模拟环境来支持军事行动。但是,3D城市模型没有建筑物,植被和地面等语义信息,并且不能允许复杂的用户级和系统级交互。在I/ITSEC 2019上,作者提出了一个完全自动化的数据分割和对象信息提取框架,用于使用基于无人机的摄影数据来创建模拟地形。本文讨论了扩展我们设计的数据分割框架的下一步,用于细分3D城市数据。在这项研究中,作者首先研究了应用于Bing数据的现有框架的优势和局限性。突出显示了基于无人机的基于无人机和基于飞机的摄影测量数据之间的主要差异。确定了基于飞机的摄影数据质量问题,可能会对细分性能产生负面影响。根据发现,工作流程专门用于在考虑其特征的同时分割Bing数据。此外,由于最终目标是结合使用小型无人机(UAV)收集的数据和在虚拟仿真环境中的BING数据的使用,因此需要将这两个源的数据对齐和注册。为此,作者还提出了一个数据注册工作流,该工作流利用了提取的语义信息,利用传统的迭代最接近点(ICP)。
With state-of-the-art sensing and photogrammetric techniques, Microsoft Bing Maps team has created over 125 highly detailed 3D cities from 11 different countries that cover hundreds of thousands of square kilometer areas. The 3D city models were created using the photogrammetric technique with high-resolution images that were captured from aircraft-mounted cameras. Such a large 3D city database has caught the attention of the US Army for creating virtual simulation environments to support military operations. However, the 3D city models do not have semantic information such as buildings, vegetation, and ground and cannot allow sophisticated user-level and system-level interaction. At I/ITSEC 2019, the authors presented a fully automated data segmentation and object information extraction framework for creating simulation terrain using UAV-based photogrammetric data. This paper discusses the next steps in extending our designed data segmentation framework for segmenting 3D city data. In this study, the authors first investigated the strengths and limitations of the existing framework when applied to the Bing data. The main differences between UAV-based and aircraft-based photogrammetric data are highlighted. The data quality issues in the aircraft-based photogrammetric data, which can negatively affect the segmentation performance, are identified. Based on the findings, a workflow was designed specifically for segmenting Bing data while considering its characteristics. In addition, since the ultimate goal is to combine the use of both small unmanned aerial vehicle (UAV) collected data and the Bing data in a virtual simulation environment, data from these two sources needed to be aligned and registered together. To this end, the authors also proposed a data registration workflow that utilized the traditional iterative closest point (ICP) with the extracted semantic information.