High-Resolution 3-Dimensional Contact Deformation Tracking for FingerVision Sensor With Dense Random Color Pattern
| Autor: | Yazhan Zhang, Guanlan Zhang, Yipai Du, Michael Yu Wang |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Control and Optimization
Computer science Feature extraction ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Biomedical Engineering Optical flow 02 engineering and technology Deformation (meteorology) Tracking (particle physics) 01 natural sciences Artificial Intelligence Depth map Computer vision Monocular business.industry Mechanical Engineering 010401 analytical chemistry 021001 nanoscience & nanotechnology 0104 chemical sciences Computer Science Applications Human-Computer Interaction Control and Systems Engineering Displacement field Computer Vision and Pattern Recognition Artificial intelligence 0210 nano-technology business Tactile sensor |
| Zdroj: | IEEE Robotics and Automation Letters. 6:2147-2154 |
| ISSN: | 2377-3774 |
| DOI: | 10.1109/lra.2021.3061306 |
| Popis: | Recent studies on vision-based tactile sensing have shown promising results on the perception of contact information, which could improve the performance of dexterous manipulations. However, 3-dimensional contact deformation tracking at a higher resolution is desired and remains a challenge for vision-based tactile sensors with monocular configurations. In this work, a similar hardware structure to our previous FingerVision sensor is adopted. The dot markers are replaced with a novel random color pattern as the sensor's tracking target and a dense optical flow algorithm is used to track the deformation of its elastic contact interface. This results in a more accurate 2-dimensional deformation field estimation at a higher resolution in comparison with that obtained using sparse dot markers. Additionally, the denser and more accurate deformation field enables depth estimation with better fidelity. To achieve depth estimation purely from the optical flow field, Gaussian density feature extraction and processing framework are proposed. The resulting depth map can be used independently as a tactile sensing modality, or jointly with the accurate in-plane displacement field as a more complete deformation tracking of contact interfaces for vision-based tactile sensors. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|