Attention with Long-Term Interval-Based Gated Recurrent Units for Modeling Sequential User Behaviors
Autor: | Donghui Ding, Shouling Ji, Zhao Li, Chenyi Lei, Jianliang Gao, Zehong Hu, Pengcheng Zou, Shichang Hu |
---|---|
Rok vydání: | 2020 |
Předmět: |
050101 languages & linguistics
business.industry Computer science User modeling 05 social sciences Markov process 02 engineering and technology Machine learning computer.software_genre symbols.namesake Recurrent neural network Premise 0202 electrical engineering electronic engineering information engineering symbols Leverage (statistics) 020201 artificial intelligence & image processing 0501 psychology and cognitive sciences Artificial intelligence business computer |
Zdroj: | Database Systems for Advanced Applications ISBN: 9783030594091 DASFAA (1) |
Popis: | Recommendations based on sequential User behaviors have become more and more common. Traditional methods depend on the premise of Markov processes and consider user behavior sequences as interests. However, they usually ignore the mining and representation of implicit features. Recently, recurrent neural networks (RNNs) have been adopted to leverage their power in modeling sequences and consider the dynamics of user behaviors. In order to better locate user preference, we design a network featuring Attention with Long-term Interval-based Gated Recurrent Units (ALI-GRU) to model temporal sequences of user actions. In the network, we propose a time interval-based GRU architecture to better capture long-term preferences and short-term intents when encoding user actions rather than the original GRU. And a specially matrix-form attention function is designed to learn weights of both long-term preferences and short-term user intents automatically. Experimental results on two well-known public datasets show that the proposed ALI-GRU achieves significant improvement than state-of-the-art RNN-based methods. |
Databáze: | OpenAIRE |
Externí odkaz: |