Light Field Imaging through Household Optics

David Bommes, Tobias Ritschel und Thomas Schultz (Editoren)
Alexander Wender, Julian Iseringhausen, Bastian Goldlücke, Martin Fuchs und Matthias B. Hullin
In proceedings of Vision, Modeling & Visualization, pages 159-166, The Eurographics Association, 2015
 

Abstract

Although light fields are well-established as a tool in image-based rendering and computer vision, their capture is still at a relatively early stage. In this article, we search for imaging situations similar to uncalibrated integral optics, noticing that they are common in everyday life. We investigate light field capturing scenarios which are provided by commonly available items like cutlery as optical building blocks. Using a generic calibration approach based on structured light, we reconstruct the light path providing an unorthodox light field capturing setup. As the resulting data is unstructured and poorly sampled and thus unsuited for standard image-based rendering pipelines, we propose techniques for the processing of such light fields. Additionally, we have implemented a novel depth estimation scheme to guide the rendering process. We demonstrate the potential of these techniques on different scenes, both static and dynamic, recorded by combining a DSLR camera with household items.

Bilder

Bibtex

@INPROCEEDINGS{wender:2015,
     author = {Wender, Alexander and Iseringhausen, Julian and Goldl{\"u}cke, Bastian and Fuchs, Martin and Hullin,
               Matthias B.},
     editor = {Bommes, David and Ritschel, Tobias and Schultz, Thomas},
      pages = {159--166},
      title = {Light Field Imaging through Household Optics},
  booktitle = {Vision, Modeling {\&} Visualization},
       year = {2015},
  publisher = {The Eurographics Association},
   abstract = {Although light fields are well-established as a tool in image-based rendering and computer vision,
               their capture is still at a relatively early stage. In this article, we search for imaging
               situations similar to uncalibrated integral optics, noticing that they are common in everyday life.
               We investigate light field capturing scenarios which are provided by commonly available items like
               cutlery as optical building blocks. Using a generic calibration approach based on structured light,
               we reconstruct the light path providing an unorthodox light field capturing setup. As the resulting
               data is unstructured and poorly sampled and thus unsuited for standard image-based rendering
               pipelines, we propose techniques for the processing of such light fields. Additionally, we have
               implemented a novel depth estimation scheme to guide the rendering process. We demonstrate the
               potential of these techniques on different scenes, both static and dynamic, recorded by combining a
               DSLR camera with household items.},
       isbn = {978-3-905674-95-8},
        doi = {10.2312/vmv.20151271}
}