论文标题
在失去沟通中学习车辆到车辆合作的看法
Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communication
论文作者
论文摘要
深度学习已被广泛用于智能车辆驾驶的感知(例如3D对象检测)。由于有益的车辆到车辆(V2V)通信,可以将基于其他代理的深度学习特征共享到自我车辆,从而提高对自我车辆的看法。它在V2V研究中被称为合作感,其算法最近已大大提高。但是,所有现有的合作感知算法都假定理想的V2V通信,而无需考虑可能具有损失的共享特征,这是因为有损的交流(LC)在复杂的现实世界驾驶场景中很常见。在本文中,我们首先通过V2V合作感中的有损沟通来研究副作用(例如检测性能下降),然后我们提出了一种新型的中间LC-Aware特征融合方法,以减轻LC-Awan Away Away Repair Network(LCRN)和其他特色车辆之间的相互作用的副作用,并增强了EGO工具的相互作用,并增强了EGO设计的互动(V2 V1),该工具是通过特色车辆进行的(V2 VAR)的相互作用自我媒介物和不确定性感知车辆间注意力的车内注意力。关于公共合作感知数据集OPV2V(基于数字 - twin carla Simulator)的广泛实验表明,在有损失的V2V通信下,所提出的方法对基于合作点云的3D对象检测非常有效。
Deep learning has been widely used in the perception (e.g., 3D object detection) of intelligent vehicle driving. Due to the beneficial Vehicle-to-Vehicle (V2V) communication, the deep learning based features from other agents can be shared to the ego vehicle so as to improve the perception of the ego vehicle. It is named as Cooperative Perception in the V2V research, whose algorithms have been dramatically advanced recently. However, all the existing cooperative perception algorithms assume the ideal V2V communication without considering the possible lossy shared features because of the Lossy Communication (LC) which is common in the complex real-world driving scenarios. In this paper, we first study the side effect (e.g., detection performance drop) by the lossy communication in the V2V Cooperative Perception, and then we propose a novel intermediate LC-aware feature fusion method to relieve the side effect of lossy communication by a LC-aware Repair Network (LCRN) and enhance the interaction between the ego vehicle and other vehicles by a specially designed V2V Attention Module (V2VAM) including intra-vehicle attention of ego vehicle and uncertainty-aware inter-vehicle attention. The extensive experiment on the public cooperative perception dataset OPV2V (based on digital-twin CARLA simulator) demonstrates that the proposed method is quite effective for the cooperative point cloud based 3D object detection under lossy V2V communication.