Intent-based Object Grasping by a Robot using Deep Learning
| Autor: | Himanshu Shekhar, Aditya Powale, Souvik Sen, Debadutta Godnaik, Faheem Hassan Zunjani, Gora Chand Nandi |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2018 |
| Předmět: |
0209 industrial biotechnology
Artificial neural network business.industry Computer science Deep learning GRASP 020206 networking & telecommunications 02 engineering and technology Object (computer science) Convolutional neural network Object detection 020901 industrial engineering & automation 0202 electrical engineering electronic engineering information engineering Robot Computer vision Rectangle Artificial intelligence business |
| DOI: | 10.13140/rg.2.2.12758.50242 |
| Popis: | A robot needs to predict an ideal rectangle for optimal object grasping based on the intent for that grasp. Mask Regional - Convolutional Neural Network (Detectron) can be used to generate the object mask and for object detection and a Convolutional Neural Network (CNN) can be used for ideal grasp rectangle prediction according to the supplied intent, as described in this paper. The masked image obtained from Detectron along with the metadata of the intent type has been fed to the Fully-Connected layers of the CNN which would generate the desired optimal rectangle for the specific intent and object. Before settling for a CNN for optimal rectangle prediction, conventional Neural Networks with different hidden layers have been tried and the accuracy achieved was low. A CNN has then been developed and tested with different layers and sizes of pool and strides to settle on the final CNN model that has been discussed here. The optimal predicted rectangle is then fed to a robot, ROS simulation of Baxter robot in this case, to perform the actual grasping of the object at the predicted location. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|