Skip to main content

ORIGINAL RESEARCH article

Front. Clim.
Sec. Predictions and Projections
Volume 6 - 2024 | doi: 10.3389/fclim.2024.1464241

Investigation of a Transformer-Based Hybrid Artificial Neural Networks for Climate Data Prediction and Analysis

Provisionally accepted
Ke Liu Ke Liu 1Ke Liu Ke Liu 2*Zheng Wang Zheng Wang 3*Yuanyuan Liu Yuanyuan Liu 3*Bin Bai Bin Bai 3*Rui Zhao Rui Zhao 3*
  • 1 Shandong Chengxin Engineering Construction & Consulting Co.Ltd, Shandong, China
  • 2 Shandong Chengxin Engineering Construction & Consulting Co.Ltd,Jinan,Shangdong,250100,China, Jinan, China
  • 3 State Grid Ningxia Electric Power Co.Ltd,Eco-tech Research Institute,Yinchuan, Ningxia, China

The final, formatted version of the article will be published soon.

    Climate change is one of the major challenges facing the world today, causing frequent extreme weather events that significantly impact human production, life, and the ecological environment.Traditional climate prediction models largely rely on the simulation of physical processes. While they have achieved some success, these models still face issues such as complexity, high computational cost, and insufficient handling of multivariable nonlinear relationships. In light of this, this paper proposes a hybrid deep learning model based on Transformer-Convolutional Neural Network (CNN)-Long Short-Term Memory (LSTM) to improve the accuracy of climate predictions. Firstly, the Transformer model is introduced to capture the complex patterns in climate data time series through its powerful sequence modeling capabilities. Secondly, CNN is utilized to extract local features and capture short-term changes. Lastly, LSTM is adept at handling long-term dependencies, ensuring the model can remember and utilize information over extended time spans. Experiments conducted on temperature data from Guangdong Province in China validate the performance of the proposed model. Compared to four different climate prediction decomposition methods, the proposed hybrid model with the Transformer method performs the best. The results also show that the Transformer-CNN-LSTM hybrid model outperforms other hybrid models on five evaluation metrics, indicating that the proposed model provides more accurate predictions and more stable fitting results.

    Keywords: Climate prediction, Sequentially, Hybrid deep learning, CNN, LSTM, transformer

    Received: 13 Jul 2024; Accepted: 06 Nov 2024.

    Copyright: © 2024 Liu, Liu, Wang, Liu, Bai and Zhao. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence:
    Ke Liu, Shandong Chengxin Engineering Construction & Consulting Co.Ltd,Jinan,Shangdong,250100,China, Jinan, China
    Zheng Wang, State Grid Ningxia Electric Power Co.Ltd,Eco-tech Research Institute,Yinchuan, Ningxia, China
    Yuanyuan Liu, State Grid Ningxia Electric Power Co.Ltd,Eco-tech Research Institute,Yinchuan, Ningxia, China
    Bin Bai, State Grid Ningxia Electric Power Co.Ltd,Eco-tech Research Institute,Yinchuan, Ningxia, China
    Rui Zhao, State Grid Ningxia Electric Power Co.Ltd,Eco-tech Research Institute,Yinchuan, Ningxia, China

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.