On the order of processing of humorous tweets with visual and verbal elements
| Autor: | Nabiha El Khatib, Phillip Hamrick, María Simarro Vázquez, Salvatore Attardo |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
050101 languages & linguistics
Linguistics and Language Computer Networks and Communications business.industry media_common.quotation_subject 05 social sciences computer.software_genre Gaze Language and Linguistics Order (business) Reading (process) 0502 economics and business Frame (artificial intelligence) Eye tracking 050211 marketing 0501 psychology and cognitive sciences Artificial intelligence Psychology business computer Natural language processing media_common |
| Zdroj: | Pragmatics, Humour and the Internet. 4:150-175 |
| ISSN: | 2542-386X 2542-3851 |
| DOI: | 10.1075/ip.00060.sim |
| Popis: | In this paper we examine the order of processing of multimodal tweets (text + image). Using an eye tracker, we collected a sample of 36 participants reading 25 humorous tweets. Our conclusions show that the processing of multimodal humorous tweets is in line with the processing of other multimodal texts. The participants were significantly more likely to start from the image, followed by the caption. Other elements, such as the tweet’s “author” (the user name) or elements outside the tweet’s frame, attracted significantly less and later attention. The participants spent significantly more time gazing at the caption, before moving on to another area. The longer the participants spent looking at the tweet, the less predictable their gaze direction became. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|