GMLight: Lighting Estimation via Geometric Distribution Approximation
| Autor: | Fangneng Zhan, Yingchen Yu, Changgong Zhang, Rongliang Wu, Wenbo Hu, Shijian Lu, Feiying Ma, Xuansong Xie, Ling Shao |
|---|---|
| Přispěvatelé: | School of Computer Science and Engineering |
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
Lighting Estimation Computer Vision and Pattern Recognition (cs.CV) Computer Science - Computer Vision and Pattern Recognition ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Computer science and engineering [Engineering] Image Synthesis Computer Graphics and Computer-Aided Design Software ComputingMethodologies_COMPUTERGRAPHICS |
| DOI: | 10.48550/arxiv.2102.10244 |
| Popis: | Inferring the scene illumination from a single image is an essential yet challenging task in computer vision and computer graphics. Existing works estimate lighting by regressing representative illumination parameters or generating illumination maps directly. However, these methods often suffer from poor accuracy and generalization. This paper presents Geometric Mover's Light (GMLight), a lighting estimation framework that employs a regression network and a generative projector for effective illumination estimation. We parameterize illumination scenes in terms of the geometric light distribution, light intensity, ambient term, and auxiliary depth, which can be estimated by a regression network. Inspired by the earth mover's distance, we design a novel geometric mover's loss to guide the accurate regression of light distribution parameters. With the estimated light parameters, the generative projector synthesizes panoramic illumination maps with realistic appearance and high-frequency details. Extensive experiments show that GMLight achieves accurate illumination estimation and superior fidelity in relighting for 3D object insertion. The codes are available at \href{https://github.com/fnzhan/Illumination-Estimation}{https://github.com/fnzhan/Illumination-Estimation}. Comment: 11 pages, 12 figures |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|