Data-driven Local Coordinate Systems for Image-Based Rendering

E. Gröller and L. Szirmay-Kalos (Editors)
In: Computer Graphics Forum (Sept. 2006), 25:3
Presented at Eurographics 2006
 

Abstract

Image-based representations of an object profit from known geometry. The more accurate this geometry is known, the better corresponding pixels in the different images can be aligned, which leads to less artifacts and better compression performance. For opaque objects the per-pixel data can then be interpreted as a sampling of the BRDF at the respective surface point. In order to parameterize this sampled data a coordinate frame has to be defined. In previous work this coordinate frame was either the global frame or a local frame derived from the base geometry. Both approaches lead to misalignments between sample vectors: Features of basically very similar BRDFs will be shifted to different regions in the sample vector leading to poor compression performance. In order to improve alignment between the sampled BRDFs in image-based rendering, we propose an optimization algorithm which determines consistent coordinate frames for every sample point on the object surface. This way we efficiently align the features even of anisotropic reflection functions and reconstruct approximate local coordinate frames without performing an explicit 3D-reconstruction. The optimization is calculated efficiently by exploiting the Fourier-shift theorem for spherical harmonics. In order to deal with different materials in a scene, the technique is combined with a clustering algorithm. We demonstrate the utility of our method by applying it to BTFs and 6D surface reflectance fields.

Images

Download Paper

Download Paper

Bibtex

@ARTICLE{mueller-2006-data-driven,
        author = {M{\"u}ller, Gero and Sarlette, Ralf and Klein, Reinhard},
        editor = {Gr{\"o}ller, E. and Szirmay-Kalos, L.},
         title = {Data-driven Local Coordinate Systems for Image-Based Rendering},
       journal = {Computer Graphics Forum},
        volume = {25},
        number = {3},
          year = {2006},
         month = sep,
     publisher = {Blackwell Publishing},
  organization = {Eurographics Association},
      abstract = {Image-based representations of an object profit from known geometry.
                  The more accurate this geometry is known, the better corresponding
                  pixels in the different images can be aligned, which leads to less
                  artifacts and better compression performance. For opaque objects the
                  per-pixel data can then be interpreted as a sampling of the BRDF at
                  the respective surface point. In order to parameterize this sampled
                  data a coordinate frame has to be defined. In previous work this
                  coordinate frame was either the global frame or a local frame
                  derived from the base geometry. Both approaches lead to
                  misalignments between sample vectors: Features of basically very
                  similar BRDFs will be shifted to different regions in the sample
                  vector leading to poor compression performance. In order to improve
                  alignment between the sampled BRDFs in image-based rendering, we
                  propose an optimization algorithm which determines consistent
                  coordinate frames for every sample point on the object surface. This
                  way we efficiently align the features even of anisotropic reflection
                  functions and reconstruct approximate local coordinate frames
                  without performing an explicit 3D-reconstruction. The optimization
                  is calculated efficiently by exploiting the Fourier-shift theorem
                  for spherical harmonics. In order to deal with different materials
                  in a scene, the technique is combined with a clustering algorithm.
                  We demonstrate the utility of our method by applying it to BTFs and
                  6D surface reflectance fields.},
    conference = {Eurographics 2006}
}