Motion Adaptive Deblurring with Single-Photon Cameras
| Autor: | Atul Ingle, Andreas Velten, Martin Laurenzis, Trevor Seets |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Deblurring
Computer science ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 02 engineering and technology Translation (geometry) I.4.1 I.3.3 01 natural sciences FOS: Electrical engineering electronic engineering information engineering 0202 electrical engineering electronic engineering information engineering Computer vision ComputingMethodologies_COMPUTERGRAPHICS Pixel business.industry Image and Video Processing (eess.IV) 010401 analytical chemistry Motion blur Electrical Engineering and Systems Science - Image and Video Processing 0104 chemical sciences Lidar Computer Science::Computer Vision and Pattern Recognition Trajectory 020201 artificial intelligence & image processing Artificial intelligence Timestamp business Rotation (mathematics) |
| Zdroj: | WACV |
| DOI: | 10.1109/wacv48630.2021.00199 |
| Popis: | Single-photon avalanche diodes (SPADs) are a rapidly developing image sensing technology with extreme low-light sensitivity and picosecond timing resolution. These unique capabilities have enabled SPADs to be used in applications like LiDAR, non-line-of-sight imaging and fluorescence microscopy that require imaging in photon-starved scenarios. In this work we harness these capabilities for dealing with motion blur in a passive imaging setting in low illumination conditions. Our key insight is that the data captured by a SPAD array camera can be represented as a 3D spatio-temporal tensor of photon detection events which can be integrated along arbitrary spatio-temporal trajectories with dynamically varying integration windows, depending on scene motion. We propose an algorithm that estimates pixel motion from photon timestamp data and dynamically adapts the integration windows to minimize motion blur. Our simulation results show the applicability of this algorithm to a variety of motion profiles including translation, rotation and local object motion. We also demonstrate the real-world feasibility of our method on data captured using a 32x32 SPAD camera. 23 pages, 21 figures, official peer reviewed version to appear in WACV 2021 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|