Document detail
ID
oai:arXiv.org:2404.06198
Topic
Computer Science - Machine Learnin...Author
Ehrig, Claudia Sonnleitner, Benedikt Neumann, Ursula Cleophas, Catherine Forestier, GermainCategory
Computer Science
Year
2024
listing date
7/10/2024
Keywords
transfer bias learning source similarity diversity forecastingAbstract
Pre-trained models have become pivotal in enhancing the efficiency and accuracy of time series forecasting on target data sets by leveraging transfer learning.
While benchmarks validate the performance of model generalization on various target data sets, there is no structured research providing similarity and diversity measures to explain which characteristics of source and target data lead to transfer learning success.
Our study pioneers in systematically evaluating the impact of source-target similarity and source diversity on zero-shot and fine-tuned forecasting outcomes in terms of accuracy, bias, and uncertainty estimation.
We investigate these dynamics using pre-trained neural networks across five public source datasets, applied to forecasting five target data sets, including real-world wholesales data.
We identify two feature-based similarity and diversity measures, finding that source-target similarity reduces forecasting bias, while source diversity improves forecasting accuracy and uncertainty estimation, but increases the bias.
Ehrig, Claudia,Sonnleitner, Benedikt,Neumann, Ursula,Cleophas, Catherine,Forestier, Germain, 2024, The impact of data set similarity and diversity on transfer learning success in time series forecasting
