Optimal Control Strategies for Seasonal Thermal Energy Storage Systems with Market Interaction

Reference

J. Lago, G. Suryanarayana, E. Sogancioglu, and B. De Schutter, "Optimal control strategies for seasonal thermal energy storage systems with market interaction," IEEE Transactions on Control Systems Technology, vol. 29, no. 5, pp. 1891-1906, Sept. 2021.

Abstract

Seasonal thermal energy storage systems (STESSs) can shift the delivery of renewable energy sources and mitigate their uncertainty problems. However, to maximize the operational profit of STESSs and to ensure their long-term profitability, control strategies that allow them to trade on wholesale electricity markets are required. While control strategies for STESSs have been proposed before, none of them addressed electricity market interaction and trading. In particular, due to the seasonal nature of STESSs, accounting for the long-term uncertainty in electricity prices has been very challenging. In this paper, we develop the first control algorithms to control STESSs when interacting with different wholesale electricity markets. As different control solutions have different merits, we propose solutions based on model predictive control and solutions based on reinforcement learning. We show that this is critical since different markets require different control strategies: MPC strategies are better for day-ahead markets due to the flexibility of MPC whereas RL strategies are better for real-time markets because of fast computation times and better risk modeling. To study the proposed algorithms in a real-life setup, we consider a real STESS interacting with the day-ahead and imbalance markets in The Netherlands and Belgium. Based on the obtained results we show that: (1) the developed controllers successfully maximize the profits of STESSs due to market trading; (2) the developed control strategies make STESSs important players in the energy transition: by optimally controlling STESSs and reacting to imbalances, STESSs help to reduce grid imbalances.

Publisher page

Access full text

Downloads

PDF of corresponding technical report (1.45 MB)

BibTeX

@article{LagSur:20-003,
   author  = {Lago, Jesus and Suryanarayana, Gowri and Sogancioglu, Ecem and De
              Schutter, Bart},
   title   = {Optimal Control Strategies for Seasonal Thermal Energy Storage
              Systems with Market Interaction},
   journal = {IEEE Transactions on Control Systems Technology},
   volume  = {29},
   number  = {5},
   pages   = {1891--1906},
   month   = sep,
   year    = {2021}
   }

Download BibTeX entry