Skip to main content

ORIGINAL RESEARCH article

Front. Neurorobot.
Volume 18 - 2024 | doi: 10.3389/fnbot.2024.1456192
This article is part of the Research Topic Machine Learning and Applied Neuroscience: Volume II View all 4 articles

Feature Interaction Dual Self-Attention Network for Sequential Recommendation

Provisionally accepted
Yunfeng Zhu Yunfeng Zhu 1*Shuchun Yao Shuchun Yao 1Xun Sun Xun Sun 2
  • 1 Suzhou Industrial Park Institute of Services Outsourcing, Suzhou, China
  • 2 Suzhou Vocational University, Suzhou, Jiangsu Province, China

The final, formatted version of the article will be published soon.

    Combining item feature information helps extract comprehensive sequential patterns, thereby improving the accuracy of sequential recommendations. However, existing methods usually combine features of each item using a vanilla attention mechanism. We argue that such a combination ignores the interactions between features and does not model integrated feature representations. In this paper, we propose a novel Feature Interaction Dual Self-attention network (FIDS) model for sequential recommendation, which utilizes dual self-attention to capture both feature interactions and sequential transition patterns. Specifically, we first model the feature interactions for each item to form meaningful higher-order feature representations using a multihead attention mechanism. Then, we adopt two independent self-attention networks to capture the transition patterns in both the item sequence and the integrated feature sequence, respectively. Moreover, we stack multiple self-attention blocks and add residual connections at each block for all self-attention networks. Finally, we combine the feature-wise and item-wise sequential patterns into a fully-connected layer for the next item recommendation. We conduct experiments on two real-world datasets, and our experimental results show that the proposed FIDS method outperforms state-of-the-art recommendation models.

    Keywords: Sequential recommendation, Self-attention, Feature Interaction, dual self-attention, Sequential transition patterns

    Received: 28 Jun 2024; Accepted: 31 Jul 2024.

    Copyright: © 2024 Zhu, Yao and Sun. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Yunfeng Zhu, Suzhou Industrial Park Institute of Services Outsourcing, Suzhou, China

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.