Emotion Attention-Aware Collaborative Deep Reinforcement Learning for Image Cropping
| Autor: | Xiaoyan Zhang, Zhuopeng Li, Jianmin Jiang |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Computer science
business.industry Color image Intersection (set theory) Feature extraction ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 02 engineering and technology Machine learning computer.software_genre Computer Science Applications Visualization Signal Processing 0202 electrical engineering electronic engineering information engineering Media Technology Benchmark (computing) Reinforcement learning 020201 artificial intelligence & image processing Artificial intelligence Electrical and Electronic Engineering Zoom business Cropping computer |
| Zdroj: | IEEE Transactions on Multimedia. 23:2545-2560 |
| ISSN: | 1941-0077 1520-9210 |
| Popis: | This paper proposes a collaborative deep reinforcement learning model for automatic image cropping (called CDRL-IC). By modeling image cropping as a decision-making process of reinforcement learning, our model could generate optimal cropping result in a few moving and zooming steps. An image with good composition is a comprehensive result by considering the relative importance of objects and also the spatial organization of visual elements. Therefore, emotion attention information which indicates the relationship and importance between objects is applied together with contextual information of color image for image cropping. In order to sufficiently use the emotion attention map and the color image, they are processed by two collaborative agents. The two agents make their primary learning separately and then share information through an information interaction module for making joint action prediction. In order to efficiently evaluate the cropping quality in the reward function, weighted Intersection Over Union (WIoU) is designed by integrating emotion attention map in the traditional IoU. Our CDRL-IC model is tested on a variety of datasets for both image cropping and thumbnail generation. The experiments show that our CDRL-IC model outperforms state-of-the-art methods on these benchmark datasets. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|