Exploring Material Recognition for Estimating Reflectance and Illumination From a Single Image

In proceedings of Workshop on Material Appearance Modeling, The Eurographics Association, 2016
 

Abstract

In this paper, we propose a novel approach for recovering illumination and reflectance from a single image. Our approach relies on the assumption that the surface geometry has already been reconstructed and a-priori knowledge in form of a database of digital material models is available. The first step of our technique consists in recognizing the respective material in the image using synthesized training data based on the given material database. Subsequently, the illumination conditions are estimated based on the recognized material and the surface geometry. Using this novel strategy we demonstrate that reflectance and illumination can be estimated reliably for several materials that are beyond simple Lambertian surface reflectance behavior because of exhibiting mesoscopic effects such as interreflections and shadows.

Bibtex

@INPROCEEDINGS{weinmann-2016-MAM,
     author = {Weinmann, Michael and Klein, Reinhard},
      title = {Exploring Material Recognition for Estimating Reflectance and Illumination From a Single Image},
  booktitle = {Workshop on Material Appearance Modeling},
       year = {2016},
  publisher = {The Eurographics Association},
   abstract = {In this paper, we propose a novel approach for recovering illumination and reflectance from a single
               image. Our approach relies on the assumption that the surface geometry has already been
               reconstructed and a-priori knowledge in form of a database of digital material models is available.
               The first step of our technique consists in recognizing the respective material in the image using
               synthesized training data based on the given material database. Subsequently, the illumination
               conditions are estimated based on the recognized material and the surface geometry. Using this novel
               strategy we demonstrate that reflectance and illumination can be estimated reliably for several
               materials that are beyond simple Lambertian surface reflectance behavior because of exhibiting
               mesoscopic effects such as interreflections and shadows.},
       issn = {2309-5059},
       isbn = {978-3-03868-007-9}
}