Leveraging transformer models for enhanced temperature forecasting: a comparative analysis in the Beni Mellal region

Hamza Jdi, Noureddine Falih

Abstract


The remarkable impact of transformers in artificial intelligence, exemplified by applications like GPT-3 in language processing, has sparked interest in their potential for time series analysis. This study aims to explore whether transformers, specifically temporal fusion transformers (TFT), can outperform conventional methods in this domain. The research question is whether TFT exhibits superior performance compared to conventional recurrent neural network (RNN) methods, specifically gated recurrent unit (GRU), and traditional machine learning approaches, notably autoregressive integrated moving average (ARIMA), in the context of time series analysis and temperature prediction. A comparative analysis is conducted among three models: ARIMA, GRU, and TFT. The study utilizes time series data spanning from 1984 to the end of 2022. The models’ performances are evaluated using multiple metrics: mean absolute error (MAE), root mean square error (RMSE), mean absolute percentage error (MAPE), and the coefficient of determination (R2). The TFT model achieves the lowest MAE, indicating high accuracy in its predictions. It outperforms both the RNN and traditional machine learning in temperature prediction tasks. Integrating the TFT model with the FAO penman-monteith method could improve irrigation scheduling due to more accurate temperature predictions, potentially enhancing water efficiency and crop yields.

Keywords


Machine learning; Recurrent neural networks; Temperature forecast; Temporal fusion transformers; Time series

Full Text:

PDF


DOI: http://doi.org/10.11591/ijeecs.v36.i3.pp1694-1700

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Indonesian Journal of Electrical Engineering and Computer Science (IJEECS)
p-ISSN: 2502-4752, e-ISSN: 2502-4760
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).

shopify stats IJEECS visitor statistics