论文标题
黑暗的闪光灯摄像机
A Dark Flash Normal Camera
论文作者
论文摘要
休闲摄影通常是在不受控制的照明中进行的，这会导致低质量的图像并降低下游处理的性能。我们考虑了尽管有这些条件的情况，我们考虑了描绘人们的表面正常图和反射图的问题，它通过补充了可用的可见照明，并使用单个近红外（NIR）光源和相机，这是所谓的“ Dark Flash图像”。我们的方法将在任意可见照明下捕获的单个颜色图像和在同一视点处被控制的前灯NIR照明下捕获的单个深闪光图像，并计算一个正常地图，一个漫射的反照率映射和场景的镜面强度图。由于很难捕获地面真理正常和反射率图，因此我们提出了一种新颖的训练技术，该技术结合了两个随时可用的信息和互补的来源：立体声深度信号和光度遮蔽线索。我们在各种主题和照明条件下评估我们的方法，并描述两个应用：优化立体声几何并填充图像中的阴影。
Casual photography is often performed in uncontrolled lighting that can result in low quality images and degrade the performance of downstream processing. We consider the problem of estimating surface normal and reflectance maps of scenes depicting people despite these conditions by supplementing the available visible illumination with a single near infrared (NIR) light source and camera, a so-called "dark flash image". Our method takes as input a single color image captured under arbitrary visible lighting and a single dark flash image captured under controlled front-lit NIR lighting at the same viewpoint, and computes a normal map, a diffuse albedo map, and a specular intensity map of the scene. Since ground truth normal and reflectance maps of faces are difficult to capture, we propose a novel training technique that combines information from two readily available and complementary sources: a stereo depth signal and photometric shading cues. We evaluate our method over a range of subjects and lighting conditions and describe two applications: optimizing stereo geometry and filling the shadows in an image.
