Scene Graph Generation via Convolutional Message Passing and Class-Aware Memory Embeddings
| Autor: | Yunhong Wang, Yuanfang Guo, Yidong Zhang |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Backbone network
Theoretical computer science Computer science Message passing 02 engineering and technology 010501 environmental sciences 01 natural sciences Graph Memory module 0202 electrical engineering electronic engineering information engineering Graph (abstract data type) 020201 artificial intelligence & image processing Scene graph 0105 earth and related environmental sciences |
| Zdroj: | Lecture Notes in Computer Science ISBN: 9783030305079 ICANN (3) |
| Popis: | Detecting visual relationships between objects in an image still remains challenging, because the relationships are difficult to be modeled and the class imbalance problem tends to jeopardize the predictions. To alleviate these problems, we propose an end-to-end approach for scene graph generations. The proposed method employs the ResNet as the backbone network to extract the appearance features of the objects and relationships. An attention based graph convolutional network is exploited and modified to extract the contextual information. Language and geometric priors are also utilized and fused with the visual features to better describe the relationships. At last, a novel memory module is designed to alleviate the class imbalance problem. Experimental results demonstrate the validity of our model and our superiority compared to our baseline technique. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|