X-Fields
Autor: | Tobias Ritschel, Hans-Peter Seidel, Karol Myszkowski, Mojtaba Bemana |
---|---|
Rok vydání: | 2020 |
Předmět: |
FOS: Computer and information sciences
Computer science Computer Vision and Pattern Recognition (cs.CV) 3D projection Computer Science - Computer Vision and Pattern Recognition ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 02 engineering and technology Rendering (computer graphics) symbols.namesake Computer Science - Graphics Position (vector) 0202 electrical engineering electronic engineering information engineering Image scaling Computer vision Graphics ComputingMethodologies_COMPUTERGRAPHICS Pixel business.industry 020207 software engineering Computer Graphics and Computer-Aided Design Graphics (cs.GR) Jacobian matrix and determinant symbols Artificial intelligence business Interpolation |
Zdroj: | ACM Transactions on Graphics Proceedings of ACM SIGGRAPH Asia 2020 |
ISSN: | 1557-7368 0730-0301 |
Popis: | We suggest to represent an X-Field -a set of 2D images taken across different view, time or illumination conditions, i.e., video, light field, reflectance fields or combinations thereof-by learning a neural network (NN) to map their view, time or light coordinates to 2D images. Executing this NN at new coordinates results in joint view, time or light interpolation. The key idea to make this workable is a NN that already knows the "basic tricks" of graphics (lighting, 3D projection, occlusion) in a hard-coded and differentiable form. The NN represents the input to that rendering as an implicit map, that for any view, time, or light coordinate and for any pixel can quantify how it will move if view, time or light coordinates change (Jacobian of pixel position with respect to view, time, illumination, etc.). Our X-Field representation is trained for one scene within minutes, leading to a compact set of trainable parameters and hence real-time navigation in view, time and illumination. 15 pages, 19 figures, accepted at SIGGRAPH Asia 2020, project webpage: https://xfields.mpi-inf.mpg.de/ |
Databáze: | OpenAIRE |
Externí odkaz: |