Statistical and economic evaluation of forecasts in electricity markets: beyond RMSE and MAE

In recent years, a rapid development of forecasting methods has led to an increase in the accuracy of predictions. In the literature, forecasts are typically ev...
Abstract
In recent years, a rapid development of forecasting methods has led to an increase in the accuracy of predictions. In the literature, forecasts are typically evaluated using metrics such as Root Mean Squared Error (RMSE) and Mean Absolute Error (MAE). While appropriate for statistical assessment, these measures do not adequately reflect the economic value of forecasts. This study addresses the decision-making problem faced by a battery energy storage system, which must determine optimal charging and discharging times based on day-ahead electricity price forecasts. To explore the relationship between forecast accuracy and economic value, we generate a pool of 192 forecasts. These are evaluated using seven statistical metrics that go beyond RMSE and MAE, capturing various characteristics of the predictions and associated errors. We calculate the dynamic correlation between the statistical measures and gained profits to reveal that both RMSE and MAE are only weakly correlated with revenue. In contrast, measures that assess the alignment between predicted and actual daily price curves have a stronger relationship with profitability and are thus more effective for selecting optimal forecasts.
Access Full Paper
This research paper is available on arXiv, an open-access archive for academic preprints.
Citation
Katarzyna Maciejowska. "Statistical and economic evaluation of forecasts in electricity markets: beyond RMSE and MAE." arXiv preprint. 2025-11-17. http://arxiv.org/abs/2511.13616v1
About arXiv
arXiv is a free distribution service and open-access archive for scholarly articles in physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering, systems science, and economics.
Disclaimer: This article is for informational purposes only and does not constitute financial advice. Consult a licensed financial advisor before making investment decisions.
Related Articles
Disclaimer
This article is for informational purposes only and does not constitute financial, legal, or tax advice. SwissFinanceAI is not a licensed financial services provider. Always consult a qualified professional before making financial decisions.
References
- [1]ResearchCredibility: 9/10Katarzyna Maciejowska. "Statistical and economic evaluation of forecasts in electricity markets: beyond RMSE and MAE." arXiv.org. November 17, 2025. Accessed November 18, 2025.
Transparency Notice: This article may contain AI-assisted content. All citations link to verified sources. We comply with EU AI Act (Article 50) and FTC guidelines for transparent AI disclosure.
Original Source
This article is based on Statistical and economic evaluation of forecasts in electricity markets: beyond RMSE and MAE (arXiv.org)


