Bonn Appearance Benchmark

The Eurographics Association, 2020
 

Abstract

There is a general shortage of standardized comparisons in the field of appearance modeling. We therefore introduce a benchmark for assessing the quality of reflectance models on a dataset of high quality material measurements obtained with a commercial appearance scanner. The dataset currently consists of 56 fabric materials which are measured as radiometrically calibrated HDR images together with a precise surface geometry. We pose a public challenge to attract further participation and spark new research. Participants evaluate their models on provided directional light and view sampling to recreate the appearance of a set of unseen images per material. The results are automatically evaluated under various image metrics and ranked in a public leaderboard. Our benchmark provides standardized testing and thus enables fair comparisons between related works. We also release baseline SVBRDF material fits.

Images

Download Paper

Download Paper

Bibtex

@INPROCEEDINGS{merzbach2020bonn,
     author = {Merzbach, Sebastian and Klein, Reinhard},
      title = {Bonn Appearance Benchmark},
    journal = {Workshop on Material Appearance Modeling},
       year = {2020},
  publisher = {The Eurographics Association},
   abstract = {There is a general shortage of standardized comparisons in the field of appearance modeling. We
               therefore introduce a benchmark for assessing the quality of reflectance models on a dataset of high
               quality material measurements obtained with a commercial appearance scanner. The dataset currently
               consists of 56 fabric materials which are measured as radiometrically calibrated HDR images together
               with a precise surface geometry. We pose a public challenge to attract further participation and
               spark new research. Participants evaluate their models on provided directional light and view
               sampling to recreate the appearance of a set of unseen images per material. The results are
               automatically evaluated under various image metrics and ranked in a public leaderboard. Our
               benchmark provides standardized testing and thus enables fair comparisons between related works. We
               also release baseline SVBRDF material fits.}
}