Title:FreqTSF: Time Series Forecasting Via Capturing Intra- and Inter-Variable Variations in the frequency domain

Abstract:Time series forecasting (TSF) is immensely important in extensive applications, such as electricity transformation, medical monitoring, and smart agriculture. Although deep learning methods have been proposed to handle time series data and achieved superior performances, their ability to predict long-term time series is limited due to overlooking intra- and inter-variable variations in the frequency domain. To address this problem, we propose the FreqBlock, where we obtain frequency representations through the Frequency Transform Module. Subsequently, inspired by the inherent Kramer-Kronig relations (KKRs) in the frequency domain, the Frequency Cross Attention between the real and imaginary parts is designed to obtian enhanced frequency representations and capture intra-variable variations. And then we use inception blocks to mix information to capture correlations between variables. Our backbone network, FreqTSF, adopts a residual structure by concatenating multiple FreqBlocks to avoid degradation problems. On a theoretical level, we demonstrate that the proposed two modules can significantly reduce the time and memory complexity from $\mathcal{O}(L^2)$ to $\mathcal{O}(L)$ for each FreqBlock computation. Empirical studies on three benchmark datasets show that FreqTSF achieves an overall relative MSE reduction of 15\% and an overall relative MAE reduction of 11\% compared to the state-of-the-art methods. The code is available at \url{this https URL}.