OutdoorSent: Sentiment Analysis of Urban Outdoor Images by Using Semantic and Deep Features
| Autor: | Rodrigo Minetto, Wyverson B. de Oliveira, Leyza Baldo Dorini, Thiago H. Silva |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Social and Information Networks (cs.SI)
FOS: Computer and information sciences Median income Class (computer programming) Information retrieval Generalization Computer science business.industry Deep learning Computer Vision and Pattern Recognition (cs.CV) Sentiment analysis Computer Science - Computer Vision and Pattern Recognition Context (language use) Image processing Computer Science - Social and Information Networks 02 engineering and technology General Business Management and Accounting Computer Science Applications 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Artificial intelligence Semantic information business Information Systems |
| DOI: | 10.48550/arxiv.1906.02331 |
| Popis: | Opinion mining in outdoor images posted by users during different activities can provide valuable information to better understand urban areas. In this regard, we propose a framework to classify the sentiment of outdoor images shared by users on social networks. We compare the performance of state-of-the-art ConvNet architectures, and one specifically designed for sentiment analysis. We also evaluate how the merging of deep features and semantic information derived from the scene attributes can improve classification and cross-dataset generalization performance. The evaluation explores a novel dataset, namely OutdoorSent, and other datasets publicly available. We observe that the incorporation of knowledge about semantic attributes improves the accuracy of all ConvNet architectures studied. Besides, we found that exploring only images related to the context of the study, outdoor in our case, is recommended, i.e., indoor images were not significantly helpful. Furthermore, we demonstrated the applicability of our results in the city of Chicago, USA, showing that they can help to improve the knowledge of subjective characteristics of different areas of the city. For instance, particular areas of the city tend to concentrate more images of a specific class of sentiment, which are also correlated with median income, opening up opportunities in different fields. Comment: Accepted on the ACM Transactions on Information Systems (TOIS) |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|