论文标题
来自单个互联网图片的自适应多层图像生成
Adaptive Multiplane Image Generation from a Single Internet Picture
论文作者
论文摘要
在过去的几年中,几项作品解决了从立体声图像甚至单一图片中的新型视图综合问题。但是,以前的方法在计算上是昂贵的,特别是用于高分辨率图像。在本文中,我们解决了从单个高分辨率图片中生成多层图像(MPI)的问题。我们介绍自适应MPI表示,该表示允许具有低计算要求的新型视图。为此,我们提出了一种自适应切片算法,该算法产生具有可变数量图像平面的MPI。我们提出了一个新的轻质CNN,以供深度估计,这是通过从较大网络中蒸馏出来的。自适应MPI中的遮挡区域也被轻巧的CNN所覆盖。我们表明,与以前的方法相比,我们的方法能够产生高质量预测的参数。我们方法的鲁棒性在互联网的挑战性图片中得到了证明。
In the last few years, several works have tackled the problem of novel view synthesis from stereo images or even from a single picture. However, previous methods are computationally expensive, specially for high-resolution images. In this paper, we address the problem of generating a multiplane image (MPI) from a single high-resolution picture. We present the adaptive-MPI representation, which allows rendering novel views with low computational requirements. To this end, we propose an adaptive slicing algorithm that produces an MPI with a variable number of image planes. We present a new lightweight CNN for depth estimation, which is learned by knowledge distillation from a larger network. Occluded regions in the adaptive-MPI are inpainted also by a lightweight CNN. We show that our method is capable of producing high-quality predictions with one order of magnitude less parameters compared to previous approaches. The robustness of our method is evidenced on challenging pictures from the Internet.