Gated Convolutional Neural Networks for Domain Adaptation
| Autor: | Vijjini Anvesh Rao, Avinash Madasu |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Domain adaptation
business.industry Computer science 05 social sciences Sentiment analysis Pattern recognition Filter (signal processing) 010501 environmental sciences Specific knowledge 01 natural sciences Convolutional neural network Convolution Domain (software engineering) Task (computing) 0502 economics and business Artificial intelligence 050207 economics business 0105 earth and related environmental sciences |
| Zdroj: | Natural Language Processing and Information Systems ISBN: 9783030232801 NLDB |
| DOI: | 10.1007/978-3-030-23281-8_10 |
| Popis: | Domain Adaptation explores the idea of how to maximize performance on a target domain, distinct from source domain, upon which the model was trained. This idea has been explored for the task of sentiment analysis extensively. The training of reviews pertaining to one domain and evaluation on another domain is widely studied for modeling a domain independent algorithm. This further helps in understanding corelation of information between domains. In this paper, we show that Gated Convolutional Neural Networks (GCN) perform effectively at learning sentiment analysis in a manner where domain dependant knowledge is filtered out using its gates. We perform our experiments on multiple gate architectures: Gated Tanh ReLU Unit (GTRU), Gated Tanh Unit (GTU) and Gated Linear Unit (GLU). Extensive experimentation on two standard datasets relevant to the task, reveal that training with Gated Convolutional Neural Networks give significantly better performance on target domains than regular convolution and recurrent based architectures. While complex architectures like attention, filter domain specific knowledge as well, their complexity order is remarkably high as compared to gated architectures. GCNs rely on convolution hence gaining an upper hand through parallelization. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|