Attention-Net: An Ensemble Sketch Recognition Approach Using Vector Images
| Autor: | Suransh Chopra, Shivang Chopra, Anil Singh Parihar, Gaurav Jain |
|---|---|
| Rok vydání: | 2022 |
| Předmět: |
Sequence
Contextual image classification Computer science business.industry Sketch recognition Intelligent decision support system Notation Machine learning computer.software_genre Convolution (computer science) Sketch Vector graphics Artificial Intelligence Artificial intelligence business computer Software |
| Zdroj: | IEEE Transactions on Cognitive and Developmental Systems. 14:136-145 |
| ISSN: | 2379-8939 2379-8920 |
| Popis: | – For the past few decades, machines have replaced humans in several disciplines. However, machine cognition still lags behind the human capabilities. We address the machines’ ability to recognize human drawn sketches in this work. Visual representations such as sketches have long been a medium of communication for humans. For artificially intelligent systems to effectively immerse in interactive environments, it is required that machines understand such notations. The abstract nature and varied artistic styling of these sketches make automatic recognition of drawings more challenging than other areas of image classification. In this paper, we use sketches represented as a sequence of strokes, i.e., as vector images, to effectively capture the long-term temporal dependencies in hand-drawn sketches. The proposed approach combines the self-attention capabilities of Transformers while effectively utilizing the long-term temporal dependencies through Temporal Convolution Networks (TCN) for sketch recognition. The confidence scores obtained from the two techniques are combined using triangular-norm (T-norm). Attention heat-maps are plotted to isolate the discriminating parts of a sketch that contribute to sketch classification. The extensive quantitative and qualitative evaluation confirms that the proposed network performs favorably against state-of-the-art techniques. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|