论文标题

ving:学习具有视觉目标的开放世界导航

ViNG: Learning Open-World Navigation with Visual Goals

论文作者

Shah, Dhruv, Eysenbach, Benjamin, Kahn, Gregory, Rhinehart, Nicholas, Levine, Sergey

论文摘要

我们提出了一个基于学习的导航系统,用于达到视觉指示的目标,并在真实的移动机器人平台上演示该系统。学习为机器人导航提供了一种吸引人的替代方法:与其在几何图形和地图方面对环境进行推理,还可以使机器人能够了解导航负担能力,而是了解哪些类型的障碍(例如,高草)(例如,墙壁)(例如,墙壁),并在环境中概括。但是,与传统的计划算法不同,在部署过程中更难改变学习政策的目标更加困难。我们提出了一种学习导航到所需目的地的目标图像的方法。通过将学习的策略与以前观察到的数据构建的拓扑图相结合,我们的系统即使在存在可变外观和照明的情况下,也可以确定如何达到此视觉指示的目标。三个关键见解,路点建议,图形修剪和负面挖掘,使我们的方法能够仅使用离线数据在现实世界环境中进行导航,这是先前方法挣扎的设置。我们将方法实例化在真正的户外地面机器人上,并表明我们称之为VING的系统优于先前提出的目标强化学习方法,包括包括增强学习和搜索的其他方法。我们还研究了\ syname如何推广到看不见的环境,并评估其适应经验不断增长的环境的能力。最后,我们演示了许多现实世界应用程序,例如最后一英里交付和仓库检查。我们鼓励读者访问项目网站以获取我们的实验和演示网站的视频。

We propose a learning-based navigation system for reaching visually indicated goals and demonstrate this system on a real mobile robot platform. Learning provides an appealing alternative to conventional methods for robotic navigation: instead of reasoning about environments in terms of geometry and maps, learning can enable a robot to learn about navigational affordances, understand what types of obstacles are traversable (e.g., tall grass) or not (e.g., walls), and generalize over patterns in the environment. However, unlike conventional planning algorithms, it is harder to change the goal for a learned policy during deployment. We propose a method for learning to navigate towards a goal image of the desired destination. By combining a learned policy with a topological graph constructed out of previously observed data, our system can determine how to reach this visually indicated goal even in the presence of variable appearance and lighting. Three key insights, waypoint proposal, graph pruning and negative mining, enable our method to learn to navigate in real-world environments using only offline data, a setting where prior methods struggle. We instantiate our method on a real outdoor ground robot and show that our system, which we call ViNG, outperforms previously-proposed methods for goal-conditioned reinforcement learning, including other methods that incorporate reinforcement learning and search. We also study how \sysName generalizes to unseen environments and evaluate its ability to adapt to such an environment with growing experience. Finally, we demonstrate ViNG on a number of real-world applications, such as last-mile delivery and warehouse inspection. We encourage the reader to visit the project website for videos of our experiments and demonstrations sites.google.com/view/ving-robot.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源