Skip to main content

ORIGINAL RESEARCH article

Front. Neurorobot.
Volume 18 - 2024 | doi: 10.3389/fnbot.2024.1443432
This article is part of the Research Topic Towards a Novel Paradigm in Brain-Inspired Computer Vision View all 6 articles

Sports-ACtrans Net: Research on multimodal robotic sports action recognition driven via ST-GCN

Provisionally accepted
  • Henan Polytechnic University Physical Education Institute Jiaozuo Henan,P.R.China 454000, Jiaozuo, China

The final, formatted version of the article will be published soon.

    Accurately recognizing and understanding human motion actions presents a key challenge in the development of intelligent sports robots. Traditional methods often encounter significant drawbacks, such as high computational resource requirements and suboptimal real-time performance. To address these limitations, this study proposes a novel approach called Sports-ACtrans Net. In this approach, the Swin Transformer processes visual data to extract spatial features, while the Spatio-Temporal Graph Convolutional Network (ST-GCN) models human motion as graphs to handle skeleton data. By combining these outputs, a comprehensive representation of motion actions is created. Reinforcement learning is employed to optimize the action recognition process, framing it as a sequential decision-making problem. Deep Q-learning is utilized to learn the optimal policy, thereby enhancing the robot's ability to accurately recognize and engage in motion. Experiments demonstrate significant improvements over state-of-theart methods. This research advances the fields of neural computation, computer vision, and neuroscience, aiding in the development of intelligent robotic systems capable of understanding and participating in sports activities.

    Keywords: neural computing, Computer Vision, swin transformer, ST-GCN, reinforcement learning , multi-modal robot, sports action recognition

    Received: 04 Jun 2024; Accepted: 12 Aug 2024.

    Copyright: © 2024 Qi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Lu Qi, Henan Polytechnic University Physical Education Institute Jiaozuo Henan,P.R.China 454000, Jiaozuo, China

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.