Attentive Sequential Auto-Encoding Towards Unsupervised Object-centric Scene Modeling

Autor: Yarkın Deniz ÇETİN, Ramazan Gökberk CİNBİŞ
Jazyk: English<br />Turkish
Rok vydání: 2022
Předmět:
Zdroj: Gazi Üniversitesi Fen Bilimleri Dergisi, Vol 10, Iss 4, Pp 1127-1142 (2022)
Druh dokumentu: article
ISSN: 2147-9526
DOI: 10.29109/gujsc.1139701
Popis: This paper describes an unsupervised sequential auto-encoding model targeting multi-object scenes. The proposed model uses an attention-based formulation, with reconstruction-driven losses. The main model relies on iteratively writing regions onto a canvas, in a differentiable manner. To enforce attention to objects and/or parts, the model uses a convolutional localization network, a region level bottleneck auto-encoder and a loss term that encourages reconstruction within a limited number of iterations. An extended version of the model incorporates a background modeling component that aims at handling scenes with complex backgrounds. The model is evaluated on two separate datasets: a synthetic dataset that is constructed by composing MNIST digit instances together, and the MS-COCO dataset. The model achieves high reconstruction ability on MNIST based scenes. The extended model shows promising results on the complex and challenging MS-COCO scenes.
Databáze: Directory of Open Access Journals