A full photometric and geometric model for attached webcam/matte screen devices

Autor: Yvain Quéau, Pierre Gurdjos, Jean-Denis Durou, Richard Modrzejewski
Přispěvatelé: Real Expression Artificial Life (IRIT-REVA), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Institut National Polytechnique de Toulouse - INPT (FRANCE), Centre National de la Recherche Scientifique - CNRS (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
Jazyk: angličtina
Rok vydání: 2016
Předmět:
Computer science
Photometric stereo
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
Extended sources
02 engineering and technology
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Camera calibration
Traitement des images
Planar
[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing
Computer graphics (images)
0202 electrical engineering
electronic engineering
information engineering

Calibration
Traitement du signal et de l'image
Point (geometry)
Computer vision
Electrical and Electronic Engineering
Synthèse d'image et réalité virtuelle
Lighting
ComputingMethodologies_COMPUTERGRAPHICS
business.industry
[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]
020207 software engineering
Vision par ordinateur et reconnaissance de formes
Intelligence artificielle
[INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR]
[INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV]
Signal Processing
020201 artificial intelligence & image processing
Augmented reality
Computer Vision and Pattern Recognition
Artificial intelligence
business
Geometric modeling
Software
Zdroj: Signal Processing: Image Communication
Signal Processing: Image Communication, Elsevier, 2016, 40, pp.65-81. ⟨10.1016/j.image.2015.11.006⟩
ISSN: 0923-5965
1879-2677
DOI: 10.1016/j.image.2015.11.006⟩
Popis: We present a thorough photometric and geometric study of the multimedia devices composed of both a matte screen and an attached camera, where it is shown that the light emitted by an image displayed on the monitor can be expressed in closed-form at any point facing the screen, and that the geometric calibration of the camera attached to the screen can be simplified by introducing simple geometric constraints. These theoretical contributions are experimentally validated in a photometric stereo application with extended sources, where a colored scene is reconstructed while watching a collection of graylevel images displayed on the screen, providing a cheap and entertaining way to acquire realistic 3D-representations for, e.g., augmented reality. HighlightsWe provide a closed-form expression for the lighting emitted by an infinitely small planar light source.This infinitesimal model is extended to arbitrary extended planar illuminants.The lighting model can be used to model light emitted by a screen displaying graylevel images.A thorough geometrical study of webcam/screen devices is provided.Both photometric and geometric applications are validated in a photometric stereo application with extended sources.
Databáze: OpenAIRE