Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

In: ACM Trans. Graph. (Jan. 2020), 39:1
 

Abstract

Being able to see beyond the direct line of sight is an intriguing prospective and could benefit a wide variety of important applications. Recent work has demonstrated that time-resolved measurements of indirect diffuse light contain valuable information for reconstructing shape and reflectance properties of objects located around a corner. In this paper, we introduce a novel reconstruction scheme that, by design, produces solutions that are consistent with state-of-the-art physically-based rendering. Our method combines an efficient forward model (a custom renderer for time-resolved three-bounce indirect light transport) with an optimization framework to reconstruct object geometry in an analysis-by-synthesis sense. We evaluate our algorithm on a variety of synthetic and experimental input data, and show that it gracefully handles uncooperative scenes with high levels of noise or non-diffuse material reflectance.

Keywords: analysis by synthesis, inverse light transport, plenoptic imaging

Images

Download Paper

Download Paper

Bibtex

@ARTICLE{iseringhausen:2018,
    author = {Iseringhausen, Julian and Hullin, Matthias B.},
     title = {Non-Line-of-Sight Reconstruction using Efficient Transient Rendering},
   journal = {ACM Trans. Graph.},
    volume = {39},
    number = {1},
      year = {2020},
     month = jan,
  keywords = {analysis by synthesis, inverse light transport, plenoptic imaging},
  abstract = {Being able to see beyond the direct line of sight is an intriguing prospective and could benefit a
              wide variety of important applications. Recent work has demonstrated that time-resolved measurements
              of indirect diffuse light contain valuable information for reconstructing shape and reflectance
              properties of objects located around a corner. In this paper, we introduce a novel reconstruction
              scheme that, by design, produces solutions that are consistent with state-of-the-art
              physically-based rendering. Our method combines an efficient forward model (a custom renderer for
              time-resolved three-bounce indirect light transport) with an optimization framework to reconstruct
              object geometry in an analysis-by-synthesis sense. We evaluate our algorithm on a variety of
              synthetic and experimental input data, and show that it gracefully handles uncooperative scenes with
              high levels of noise or non-diffuse material reflectance.},
      issn = {0730-0301},
       doi = {https://doi.org/10.1145/3368314}
}