Review of modeling and control strategy of thermostatically controlled loads for virtual energy storage system

Abstract

The increasing penetration of renewable energy sources (RESs) brings more power generation fluctuations into power systems, which puts forward higher requirement on the regulation capacities for maintaining the power balance between supply and demand. In addition to traditional generators for providing regulation capacities, the progressed information and communication technologies enable an alternative method by controlling flexible loads, especially thermostatically controlled loads (TCLs) for regulation services. This paper investigates the modeling and control strategies of aggregated TCLs as the virtual energy storage system (VESS) for demand response. First, TCLs are modeled as VESSs and compared with the traditional energy storage system (ESS) to analyze their characteristic differences. Then, the control strategies of VESS are investigated in microgrid and main grid aspects, respectively. It shows that VESS control strategies can play important roles in frequency regulation and voltage regulation for power systems’ stability. Finally, future research directions of VESS are prospected, including the schedulable potential evaluation, modeling of TCLs, hierarchical control strategies of VESS considering ESSs and RESs and reliability and fast response in frequency control for VESS.

1 Introduction

The rapidly growing economy nowadays is consuming more fossil energies, causing a worldwide environmental pollution [1]. Therefore, renewable energy sources (RESs) are paid more attention to and deployed rapidly around the world [2, 3]. For example, the cumulative installed capacities of wind power and photovoltaic (PV) in China have increased to 184GW and 174GW by 2018, respectively [4, 5]. However, the power generation by wind power and PV is affected significantly by real-time wind and weather, which have lots of uncertainties and bring more intermittence and fluctuations to power systems [6]. As a result, more traditional power plants (e.g., thermal power plants) need to be built to provide more regulation power for reducing fluctuation risks brought by RESs, and maintaining the power balance between supply and demand.

Thermostatically controlled loads (TCLs), such as air conditionings (ACs), are consuming more electricity [7]. For example, according to the statistics [8], ACs have accounted for around 30~40% of peak loads during summer in China, even 50% in Shanghai and Beijing. Besides, the progressed information and communication technologies nowadays have provided better infrastructure to provide regulation services for power systems by adjusting the power consumption of TCLs remotely or autonomously [9], named as demand response (DR) [10]. It has been proved in many previous studies that DR plays a significant role in reducing power systems’ fluctuation risks caused by uncertainties of RESs’ output [11]. Therefore, to some extent, DR can replace the construction of new power plants to meet higher requirement of regulation capacities. With the phasing out of traditional power plants, the DR will become more important [12].

Previously, many studies have been done on the modeling and control of TCLs. In terms of modeling, Qi et al. model the aggregated TCLs consisting of electric water heaters based on the thermodynamic process to provide frequency regulation for power systems [13]. The electricity consumption model of aggregated ACs is proposed in [14] by Monte Carlo method based on the principle of heat balance. This model can help ACs provide reserve capacity for the power system. Reference [15] studies the virtual energy storage system (VESS) model of TCLs based on the heat storage capacity of buildings to participate in DR. Besides, many papers also propose the TCL model based on the principle of building thermal balance [16,17,18].

Moreover, based on the above modeling methods, the control strategies of TCLs are also studied. For example, the two-layer flexible optimal strategy is proposed by Wang et al., who minimize the users’ electricity charges and maximize the overall coefficient of performance (COP) of chillers, considering the ambient temperature, the electricity price information and the users’ comfort [19]. In [20], the hybrid control strategy consisting of dead band control and hysteresis control is presented to provide frequency regulation service for the power system. Moreover, reference [21] establishes the multi-objective optimal scheduling model considering ACs and batteries to reduce the peak-valley difference of loads and the operating cost of the distribution network. In [22], a dynamic economic dispatch strategy is proposed by equating TCL to the VESS to reduce operation cost and ensure users’ comfort at the same time.

However, even though many studies have been done on the modeling and control methods of TCLs, the equivalence methods of TCL to VESS is insufficient. It is just this paper attempt to investigate and fill.

As the overall structure of this paper in Fig. 1, the remaining of this paper is organized as follows. Section 2 analyses the equivalent models of the TCL to the VESS, including the individual TCL and aggregated TCLs. Section 3 focuses on the control strategies of VESS. Suggestions on VESS are put forward for future research in Section 4. Section 5 concludes this paper.

Fig. 1

Overall structure of this paper

2 Modeling of virtual energy storage system

2.1 Modeling of energy storage system

Energy storage systems (ESSs) can store electricity energy and deliver it to loads when needed. It means that the ESS can transfer energy from one time to another, or from one place to another. Therefore, the ESS is regarded as an important device to shift peak loads, improve the power quality and enhance the power system reliability [23, 24].

The energy transfer process of the ESS meets energy conservation formula [25], and it can be expressed as

$$ {Q}_t^j={Q}_o^j+{\eta}_{ch}^j\cdot \sum \limits_{i=1}^t{Q}_{ch,i}^j-\sum \limits_{i=1}^t{Q}_{dis,i}^j $$

(1)

where ${Q}_t^j$ and ${Q}_o^j$ are the stored energy in the j-th ESS at time t and the initial time, respectively. ${Q}_{ch,i}^j$ and ${Q}_{dis,i}^j$ are the charging energy and discharging energy of the j-th ESS for the i-th time, respectively. ${\eta}_{ch}^j$ is the charging efficiency of the j-th ESS. Therefore, based on the Eq. (1), the energy increment of the j-th ESS depends on the difference between the charging energy and the discharging energy of the ESS.

Moreover, in order to ensure the safety operation, the ESS is subject to some constraints [26], including the power constraints and the state of charge (SOC) constraints, which can be expressed as

$$ \underset{\_}{P_{ch}^j}\le {P}_{t, ch}^j\le \overline{P_{ch}^j} $$

(2)

$$ \underset{\_}{P_{dis}^j}\le {P}_{t, dis}^j\le \overline{P_{dis}^j} $$

(3)

$$ \underset{\_}{SO{C}^j}\le SO{C}_t^j\le \overline{SO{C}^j} $$

(4)

where ${P}_{t, ch}^j$ and ${P}_{t, dis}^j$ are the charging and discharging power of the j-th ESS at time t. $\underset{\_}{P_{ch}^j}$ and $\underset{\_}{P_{dis}^j}$ are the minimum values of the charging and discharging power of the j-th ESS. $\overline{P_{ch}^j}$ and $\overline{P_{dis}^j}$ are the maximum values of the charging and discharging power of the j-th ESS. $\underset{\_}{SO{C}^j}$ and $\overline{SO{C}^j}$ are the minimum and maximum values of the SOC for the j-th ESS. $SO{C}_t^j$ is the state of charge of the j-th ESS at time t, which represents the percentage of remaining electricity of the ESS. It can be expressed as [27].

$$ SO{C}_t^j=\frac{Q_t^j}{Q_n^j} $$

(5)

where ${Q}_n^j$ is the rated capacity of the j-th ESS.

2.2 ETP model of the TCL

The equivalent thermal parameter (ETP) model [28,29,30,31] has been widely used in the modeling of the thermostatically controlled load (TCL), which depicts the transfer and dissipation of heat energy in a room. The first order ETP model can be expressed by an equivalent circuit, as shown in Fig. 2. It equates the heat transfer to the electricity transfer [31]. Therefore, these physical quantities can be calculated by ohm’s law. Q_TCL is the refrigerating or heating capacity of the TCL. T_in and T_o are the internal temperature and ambient temperature, respectively. R_TCL and C_TCL are the equivalent thermal resistance and thermal capacity, respectively.

Fig. 2

First order ETP model

Based on the circuit principle, the ETP model in Fig. 2 can be described as

$$ \frac{d{T}_{in}(t)}{dt}=\frac{Q_{TCL}(t)}{C_{TCL}}-\frac{T_{in}(t)-{T}_o}{R_{TCL}\cdot {C}_{TCL}} $$

(6)

On this basis, the varying curves of the indoor temperature and the TCL’s power consumption in heating mode can be calculated, as shown in Fig. 3. It is assumed that the initial indoor temperature is equal to the ambient temperature T_o. When the TCL is turned on, the indoor temperature T_in will go up until it reaches the upper limit T_up. Then the TCL will turn off at time t_up, and the indoor temperature will begin to drop down. When the indoor temperature decrease to the lower limit T_low at time t_low, the TCL will start again to maintain the indoor temperature in the dead band [T_low, T_up] [32]. In fact, T_up and T_low are related to the set temperature T_set, which can be expressed as

$$ {T}_{low}={T}_{set}-\delta $$

(7)

$$ {T}_{up}={T}_{set}+\delta $$

(8)

where δ is the maximum deviation range of the indoor temperature.

Fig. 3

Operation characteristics of the TCL in heating mode: (a) the varying curves of the indoor temperature and (b) the varying curves of the TCL’s power consumption

As shown in Fig. 3, the TCL’s power depends on the indoor temperature, which can be expressed as

$$ {P}_{TCL}^{dy}(t)=\left\{\right\{{\displaystyle \begin{array}{l}{P}_{rate},\kern1em {T}_{in} rises\\ {}0,\kern2.3em {T}_{in} drops\kern2.2em \end{array}} $$

(9)

where P_rate is the rated power of the TCL [33].

If the indoor temperature reaches the dead band [T_low, T_up], the heat transfer process can be regarded as reaching the steady state [34]. It means that the average heat output of the TCL is equal to the average heat dissipation during steady state. Based on the Eq. (6), the average heat output of the TCL in the steady state can be expressed as

$$ {Q}_{TCL}^{ss}=\frac{T_{set}-{T}_o}{R_{TCL}} $$

(10)

Therefore, the average power of the TCL in the steady state can be calculated as

$$ {P}_{TCL}^{ss}(t)=\frac{Q_{TCL}^{ss}}{\eta }=\frac{T_{\mathrm{set}}-{T}_o}{R_{TCL}\eta } $$

(11)

where η is the coefficient of performance (COP) [8], also known as the energy efficiency ratio (EER).

For ACs, the typical values [35] of the thermal parameters of the TCLs are in Table 1.

Table 1 The typical values of the thermal parameters

2.3 Equivalence of the individual TCL to VESS

Based on the ETP model in subsection 2.2, the operating power of the TCL can also be changed to provide regulation power by adjusting the set temperature or switching the operating state from on to off. Due to the thermal characteristics of the room [36], the indoor temperature will not be impacted seriously if the TCL’s operating power is adjusted within short period of time. Therefore, the room and the TCL (i.e., the ETP model) can be regarded as an ESS to provide regulation services for the power system, named as virtual energy storage system (VESS) in this paper.

As shown in Figs. 4 and 5, it is assumed that the indoor temperature has been in a steady state before changing the set temperature, i.e., the period [t₀, t₁]. Therefore, the power consumption of the TCL can be expressed as Eq. (11).

Fig. 4

Charging process of the VESS in heating mode: (a) the varying curve of the indoor temperature and (b) the varying curve of the VESS’ power consumption

Fig. 5

Discharging process of the VESS in heating mode: (a) the varying curve of the indoor temperature and (b) the varying curve of the VESS’ power consumption

A. Charging process of the VESS.

As shown in Fig. 4, after receiving the control signal from the user or the aggregator at t₁, the TCL’s set temperature is changed from T_set0 to T_set1. Because the indoor temperature T_set0 is below T_set1, the TCL will start running at the rated power to raise the indoor temperature until T_set1. From the perspective of the power system, the operating power of the TCL raises from ${P}_{set0}^{ss}$ to P_rate. This process can be regarded as the charging process of the VESS.

The average operating power of the new steady state at T_set1 is ${P}_{set1}^{ss}$. According to Eq. (11), ${P}_{set1}^{ss}$ is larger than ${P}_{set0}^{ss}$ since T_set1 is larger than T_set0. It can be regarded that the charging power is ${P}_{set1}^{ss}-{P}_{set0}^{ss}$ during the new steady state.

When the TCL reaches the maximal participation time in the regulation service at t₃, the set temperature will be reset to the original set point T_set0 [37]. At that time, the charging process is over, and the TCL enters the recovery process. Finally, the indoor temperature recovers to the original set point T_set0 at t₄. It can be considered that the charging energy during t₁~t₃ dissipates in the period of t₃~t₄.

Therefore, the charging power of the VESS has two stages and can be described as

$$ {P}_{ch}(t)=\Big\{{\displaystyle \begin{array}{l}{P}_{rate}-{P}_{set0}^{ss},\kern1.9em {t}_1\le t\le {t}_2\\ {}{P}_{set1}^{ss}-{P}_{set0}^{ss},\kern2em {t}_2\le t\le {t}_3\kern0.1em \end{array}} $$

(12)

Based on the Eq. (12), the charging energy of the VESS can be expressed as

$$ {E}_{ch}(t)=\Big\{{\displaystyle \begin{array}{l}\left({P}_{rate}-{P}_{set0}^{ss}\right)\cdot \left(t-{t}_1\right),\kern5.5em {t}_1\le t<{t}_2\\ {}\left({P}_{rate}-{P}_{set0}^{ss}\right)\cdot \left({t}_2-{t}_1\right)+\left({P}_{set1}^{ss}-{P}_{set0}^{ss}\right)\cdot \left(t-{t}_2\right),\\ {}\kern13.35em {t}_2\le t<{t}_3\end{array}} $$

(13)

The maximal charging time is from t₁ to t₃. Therefore, the maximal charging energy of the VESS can be calculated as

$$ {E}_{ch}^{\mathrm{max}}=\left({P}_{rate}-{P}_{set0}^{ss}\right)\cdot \left({t}_2-{t}_1\right)+\left({P}_{set1}^{ss}-{P}_{set0}^{ss}\right)\cdot \left({t}_3-{t}_2\right) $$

(14)

Based on the Eq. (13) and Eq. (14), the state of charge (SOC) of the VESS during the charging process can be described as

$$ SO{C}_{ch}=\frac{E_{ch}}{E_{ch}^{\mathrm{max}}} $$

(15)

During the charging process, some heat will dissipate due to temperature difference between the indoor and outdoor. Therefore, the energy brought by thermostatically controlled loads (TCLs) cannot be completely converted into indoor heat. Assuming the total dissipated energy during the charging process is ${E}_{ch}^{dissip}$, the charging efficiency ${\eta}_{ch}^{VESS}$ can be expressed as

$$ {\eta}_{ch}^{VESS}=\frac{E_{ch}^{\mathrm{max}}-{E}_{ch}^{dissip}}{E_{ch}^{\mathrm{max}}} $$

(16)

where ${E}_{ch}^{dissip}$ is related to the characteristics of the VESS such as the equivalent thermal resistance R_TCL and thermal capacity C_TCL and temperature difference between the indoor and outdoor. Because the temperature difference between the indoor and outdoor is always changing during charging process, ${\eta}_{ch}^{VESS}$ will not be constant.

B. Discharging process of the VESS.

As shown in Fig. 5, similar to the charging process, when the control signal is received at t₁, the set temperature is reduced from T_set0 to T_set2. Because the indoor temperature T_set0 is higher than T_set2, the TCL is switched off and the operating power is decreased to zero. This process can be regarded that the VESS is discharging to the power system.

When the indoor temperature reaches T_set2 at t₂, the TCL enters the new steady state. According to Eq. (11), ${P}_{set2}^{ss}$ is smaller than ${P}_{set0}^{ss}$. It means that the discharging power is ${P}_{set0}^{ss}-{P}_{set2}^{ss}$ during the new steady state. Similar to Fig. 4, the discharging process is over at t₃ and the TCL begins to recover to the original state.

Therefore, the discharging power of the VESS can be described as

$$ {P}_{dis}(t)=\Big\{{\displaystyle \begin{array}{l}{P}_{set0}^{ss}\kern4.599998em {t}_1\le t\le {t}_2\\ {}{P}_{set0}^{ss}-{P}_{set2}^{ss}\kern2em {t}_2\le t\le {t}_3\kern0.1em \end{array}} $$

(17)

On this basis, the discharging energy can be expressed as

$$ {E}_{dis}(t)=\Big\{{\displaystyle \begin{array}{l}{P}_{set0}^{ss}\cdot \left(t-{t}_1\right),\kern5.25em {t}_1\le t<{t}_2\\ {}{P}_{set0}^{ss}\cdot \left({t}_2-{t}_1\right)+\left({P}_{set0}^{ss}-{P}_{set2}^{ss}\right)\cdot \left(t-{t}_2\right),\\ {}\kern10.5em {t}_2\le t\le {t}_3\end{array}} $$

(18)

The maximal charging energy of the VESS is

$$ {E}_{dis}^{\mathrm{max}}={P}_{set0}^{ss}\cdot \left({t}_2-{t}_1\right)+\left({P}_{set0}^{ss}-{P}_{set2}^{ss}\right)\cdot \left({t}_3-{t}_2\right) $$

(19)

Based on the Eq. (18) and Eq. (19), the SOC of the VESS during the discharging process can be described as

$$ SO{C}_{dis}=\frac{E_{dis}}{E_{dis}^{\mathrm{max}}} $$

(20)

During the discharging process, the set temperature will be reduced to T_set2 and the operating power will become 0. The energy stored in the VESS will dissipate to the outside until the indoor temperature reaches to T_set2. In other words, the discharging process is the heat dissipation process. Therefore, the discharging efficiency ${\eta}_{dis}^{VESS}$ is 100%.

In summary, the ETP model of the TCL can be equivalent to VESS. However, the above analysis is based the regular TCLs, whose motors are binary and can be controlled between on- and off-state. For TCLs with inverter and variable frequency functions [38], the operating power can be adjusted flexibly [39]. Therefore, the VESS of these TCLs with variable frequency functions can be modified and controlled more flexibly [40], which needs further study in the future.

2.4 The comparisons between the ESS, authentic TCL model and the VESS

A. ESS and VESS.

Based on the above analysis of the ESS in subsection 2.1 and the VESS in subsection 2.3, the ESS and VESS have lots of similar characteristics. However, there are still some differences between the ESS and VESS.

First, different from the ESS, the charging and discharging power of the VESS depends on the variation of the operating power of TCLs. Secondly, the ESS capacity is decided by its physical or chemical energy storage characteristics, while the VESS’ stored energy varies with the change of the set temperature and the participation time. Thirdly, the SOC of the ESS depends on how much energy has been stored [41]. However, the SOC of the VESS depends on the stored energy, the set temperature and the maximal participation time. Besides, the charging efficiency ${\eta}_{ch}^{VESS}$ and discharging efficiency ${\eta}_{dis}^{VESS}$ of ESS mainly depend on the physical characteristics itself and there is a big difference for the efficiency of VESS according to Section 2.3. In a word, the characteristic parameters of the VESS are more complex than those of the ESS. The comparisons are shown in detail in Table 2.

Table 2 The parameter comparisons between the ESS and the VESS

B. Authentic TCL model and VESS.

Authentic TCL model describes operating process of TCLs based on the change of indoor temperature, while the VESS model shows it from the perspective of indoor thermal energy. The VESS model has simpler and clearer formulas by comparing Eq. (6)–(11) of authentic TCL model with Eq. (12)–(20) of VESS. Therefore, the complexity of VESS model is lower.

The authentic TCL model is complex, and in order to control with ESS, many equivalence approaches (e.g. continuous state constraints-based method) need to be used. By contrast, the VESS model can explain operating process clearly, which helps researchers understand all kinds of states of ACs. It is also easier to study coordination control strategy with ESS by VESS model.

However, the VESS model is derived directly from the authentic TCL model without simplifying any computation process. The VESS model is built from the point of view of energy storage system to simplify the design and implementation of control strategies. Therefore, the authentic TCL model and the VESS model have the same accuracy.

2.5 Equivalence of the aggregated TCLs

The equivalent model of the individual TCL model has been obtained in subsection 2.2. However, the regulation power of the individual VESS is small for the power system, which must be aggregated to realize significant role in the power system. There are mainly three equivalent modeling methods of equating aggregated TCLs to the VESS.

A. Direct aggregation method.

The first method is the direct aggregation method, i.e., summarizing the individual TCL directly to calculate the total power of TCLs. Reference [15] establishes the VESS equivalent model by aggregating the power and the stored energy respectively. According to Eq. (12) and (17), the VESS power of the aggregated TCLs can be described as

$$ {P}_{TCLs}^{ch}(t)=\sum \limits_{i=1}^N{P}_{ch}^i(t)\cdot {s}_i(t) $$

(21)

$$ {P}_{TCLs}^{dis}(t)=\sum \limits_{i=1}^N{P}_{dis}^i(t)\cdot {s}_i(t) $$

(22)

where ${P}_{ch}^i(t)$ and ${P}_{dis}^i(t)$ are the charging and discharging power of the i-th TCL at time t, respectively. s_i(t) is equal to 1 when the TCL is participating in demand response, while s(t) is 0 when the TCL stops participating in demand response [42].

According to Eq. (13) and (18), the stored energy of the aggregated TCLs (i.e., the aggregated VESS) can be expressed as

$$ {E}_{TCLs}^{ch}(t)=\sum \limits_{i=1}^N{E}_{ch}^i(t)\cdot {s}_i(t) $$

(23)

$$ {E}_{TCLs}^{dis}(t)=\sum \limits_{i=1}^N{E}_{dis}^i(t)\cdot {s}_i(t) $$

(24)

where ${E}_{ch}^i(t)$ and ${E}_{dis}^i(t)$ are the charging and discharging energy of the i-th TCL at time t, respectively. Then this model is used to study the features of the VESS by Monte Carlo Simulation. Reference [43] proposes the VESS dynamic model of aggregated TCLs to explore features of the direct load control (DLC) in wind power accommodation. According to Eq. (6) and the total power of N (the number of TCLs) TCLs in Eq. (21) and (22), the aggregation model consists of N indoor temperature changing equations. Because each TCL physical parameters and operating state are different, the Monte Carlo Simulation can be used to show the characteristics of the VESS. It is proved that the VESS can serve as a buffer between supply and demand of the wind power, similar with the traditional ESS. Reference [44] classifies TCLs according to architectural environment and types. Each type of aggregated TCLs is equated to a kind of VESS to make the control easier.

B. Temperature priority list algorithm.

The second method uses temperature priority list (TPL) algorithm [45] to realize the VESS equivalence of the aggregated TCLs. This method divides all TCLs participating in demand response into two groups, the “open” group and the “close” group based on on-off state of the TCLs [46]. In the “open” group, TCLs are ranked from low to high according to their indoor temperature. In the “close” group, TCLs are ranked from high to low. When more TCLs are switched on, the number of the “open” group increases, which can be regarded as charging to the VESS. Otherwise, the VESS is discharging.

Reference [45, 47] equates the aggregated TCLs to the VESS by the TPL algorithm to smoothing the microgrid tie-line power fluctuations. Reference [47] defines virtual state of charge (VSOC) to describe the SOC of the VESS based on TPL. Reference [45] defines a state index as SOC to describe the VESS regulation capability based on TPL.

C. State space method.

Based on the Eq. (6), the state space model can also be used to make up the VESS equivalent model of the aggregated TCLs. The complex dynamic process of TCLs is abstracted as a state space expression, as follows.

$$ \dot{x}(t)=- ax(t)-u(t) $$

(25)

where x(t) ∈ ℝ, u(t) ∈ ℝ, and a > 0 is a constant. u(t) is the charging or discharging power. x(t) is the SOC of the VESS [48]. However, the parameter a is a big challenge for this method. Reference [49] presents an iterative method based on the Eq. (21) and (22) to identify the VESS model parameter a of TLCs in commercial buildings. Reference [50, 51] combines the state space expression and TPL algorithm to obtain the value of a.

The above three methods can achieve VESS aggregation. After loads finish participating in demand response and start running again, their operating power may exceed the original power before these loads are controlled, which is called the load rebound phenomenon [8]. During the charging process and the discharging process, the fast change of temperature settings will lead to load rebound of aggregated TCLs. Faced with this issue, some control methods are proposed to reduce load rebound [8].

3 Control strategies of the VESS in different applications

Based on the above analysis in section 2, the VESS can play a significant role in the microgrid and the main grid by changing its charging or discharging power. For example, the VESS can help smooth the tie-line power fluctuations, reduce operating costs and increase revenue of the microgrid. Moreover, the VESS is beneficial to regulate frequency, reduce uncertainty from the renewable energy and maintain voltage stability in the main network. However, in order to achieve the above beneficial effects, appropriate control strategies are essential. Several main control strategies are shown in Table 3.

Table 3 The main control strategies of VESS in the previous studies

3.1 Control strategies in the microgrid

Microgrids are composed of distributed micro-sources, power conversion equipment, loads and protection devices. Therefore, microgrids can achieve self-management and self-control [57]. The VESS of TCLs can consuming electricity (i.e. charging) as loads or produce electricity (i.e. discharging) as distributed micro-sources, when their set temperatures are adjusted. Therefore, as a flexible resource, the VESS can balance the deviation between electricity production and consumption to smooth the tie-line power and increase more economic dispatch.

A. Smoothing the tie-line power fluctuations.

Because the electricity generation uncertainties of the renewable energies and electricity consumption uncertainties of loads, there is always deviation of the tie-line power. Reference [52] proposes a coordination control strategy to smooth the tie-line power fluctuations. By setting Butterworth filters with different time constants to smooth the power fluctuations at high and low frequencies [45], the VESS and the ESS can achieve coordinated control. The control strategy guarantees both users’ comfort and batteries’ lifetime. This control strategy is a traditional filtering algorithm [58], the result of which is not optimal because of the disadvantage of setting time constants only by experience. Continuous state constraints-based optimal control strategy is presented in reference [47], whose objective function is

$$ J=\min \int {\left({y}_{ref}-y\right)}^2 dt $$

(26)

where y_ref is expectation deviation between power generation and power consumption and y is the actual value. The method realizes the optimal cooperative control between batteries and the VESS to ensure the micro-grid tie-line power is tracked accurately.

B. Economic dispatch.

Due to the energy storage characteristics, the VESS can effectively reduce the cost of power dispatching in the microgrid [59]. Reference [53] proposes an optimal dispatching strategy for the combined cooling-heating-power microgrid considering the VESS to reduce the operating cost of microgrid. Based on the thermal characteristics of buildings, this method adds the VESS model to the microgrid’s optimal dispatching model. Moreover, the indoor temperature is maintained within acceptable ranges to ensure users’ comfort [60] during economic dispatch.

In addition to considering users’ comfort, the price information in the microgrid also needs to be considered to increase economic benefits [61]. Reference [22] presents a dynamic economic dispatch model considering the users’ comfort and the real-time electricity price in the hybrid energy microgrid (H-Microgrid). The H-Microgrid is a microgrid integrated with schedulable distribution generators, renewable generations and low-carbon buildings. The dynamic economic dispatch method helps cut down operating costs, reduce times of startup and shutdown for the distribution generators and increase the free capacity of the distribution generators [62].

Due to the small quantity of individual TCL, the VESS in the individual microgrid has less capacity, lower power and greater uncertainty than those in the main network. In order to reduce these disadvantages, the VESS requires coordinated control with generators or other traditional energy storage devices such as the wind power, the photovoltaic and the batteries in the microgrid. Therefore, further research about coordinated control methods is needed.

3.2 Control strategies in the main network

Due to uncertainties of renewable energies, inaccuracy of load forecasting, and occurrence of power system failures, the frequency and voltage of the grid are difficult to maintain constant and always in fluctuations [63]. The fluctuation smoothing of frequency and voltage mainly depends on traditional power units and reactive power compensation devices. However, frequent adjustments of the generators and reactive power compensation devices will lead to decreasing their lifetime [64]. Therefore, the VESS proposed in this paper is an effective alternative to regulate frequency and maintain voltage stability.

A. Frequency regulation.

As the alternative of traditional frequency regulation tools, VESS can participate in frequency regulation by adjusting the charging and discharging power. A coordination control strategy for the VESS, considering both primary and secondary frequency regulations at the same time, is studied in the reference [54]. The distributed model predictive control is proposed to help the VESS participate in the primary frequency regulation, considering the indoor temperature constraint and switching time constraint. A non-cooperative game is applied to the secondary frequency regulation according to area control error (ACE) [65]. In reference [46], a priority-stack-based control scheme constrained by the VESS no-short-cycling constraint is proposed. The no-short-cycling constraint is the start-up and shutdown time constraints and climbing rate constraint of the VESS. The cases of the paper show this method has a great frequency regulation performance.

Many control strategies are proposed to coordinate the VESS with the traditional ESS. Reference [66] proposes a coordination control method to help the power system frequency regulation. This method firstly combines refrigerators and conventional flywheel energy storage systems into a distributed unit and this unit is equivalent to a VESS. Then all the units are coordinated to maintain the stability of the power system frequency. This control strategy can make the charging and discharging cycles of every VESS minimum to prolong the lifetime of the VESS. Reference [44] proposes a fuzzy control strategy to coordinate the VESS and batteries to regulate the frequency. In order to maintain the frequency stability, fuzzy controllers can adaptively adjust the time constant of filters to change TCLs’ set temperature and the output power of the batteries.

B. Reducing uncertainties from renewable energies.

Although the electricity generated by the renewable energies can contribute to energy conservation and emission reduction, their uncertainty reduces the reliability of power systems [67]. Studies show the VESS can help reduce uncertainty from the wind power and photovoltaic. Reference [55] proposes new demand response programs to reduce uncertainty from the renewable energy and improve the economy of the power system operation. The operating revenue equation is established as the objective function, which considers the operating income and cost, the uncertainty from the renewable energy and the prices of the renewable energy. Then the optimal operation mode is gotten by Particle Swarm Optimization method [68], which ensures reducing uncertainty threats by using the VESS can be more economical.

C. Maintaining voltage stability.

Distributed PV generation is susceptible to weather, which leads to voltage fluctuation in the low voltage distribution grids [69]. The VESS can help deal with the voltage fluctuation threat brought about by the distributed PV. A hierarchical dispatch strategy for the VESS is proposed to help maintain voltage stability of the low voltage grids with high solar PV penetration in the reference [56]. This control method includes two levels, the lower level and the upper level. At the lower level, all of VESSs are controlled by the aggregators and at the upper level, aggregators will be controlled by the power system according to the coordination control objective. The cases show that this method has lower cost to smooth the voltage fluctuation than the traditional ESS by making use of the buffering capacity of the VESS.

Besides, the VESS can also show excellent performance by DLC when an emergency occurs in the power system. However, because the demand response in emergency situations is strict about the response speed and the response time for the VESS [70], the control strategies should be improved to meet these requirements.

Many VESS control strategies are based on the assumption that the characteristics of all kinds of VESSs are similar [71, 72]. In fact, the VESS consists of many kinds of TCLs, such as ACs, refrigerators and heat pumps etc., among which they have much differences. Besides, in order to achieve better control results, the VESS is often controlled with traditional ESS to create greater flexibility. Therefore, coordination control strategies [73] between different kinds of VESSs and between the VESS and traditional ESS should be further studied.

4 Research prospects

4.1 Regulation potential estimation of the VESS

In order to make full use of the VESS, the regulation potential has to be estimated accurately. However, lots of factors can impact the regulation estimation, for example, the different users’ willingness, weekday or weekend day, the weather, the ambient temperature and so on [74]. Moreover, after assessing the total capacity of users’ TCLs, some subjective and objective factors should also be considered, including the users’ comfort [75], users’ revenue and power system’s control capabilities, etc.

However, the existing estimation methods [76, 77] are difficult to meet all the requirements. The potential assessment methods proposed in most previous papers have some limitations. Many methods of price-based demand response estimate ACs potential by electricity price elasticity [78, 79], while acquiring accurate price elasticity is a big challenge. The potential estimation methods of incentive-based demand response are mainly based on the direct load control rather than users’ willingness [76, 80]. Therefore, the regulation potential estimation algorithm should be further studied in the future to ensure the accuracy of results, rapidity of calculation and good adaptability.

4.2 Modeling of heat pumps and refrigerators for VESS

TCLs include ACs, heat pumps, and refrigerators. However, the studies on TCLs’ equivalence to VESS nowadays mainly focus on ACs, because ACs occupy a large proportion of the power consumption during the peak load period and have great regulation potential. Besides, most existing papers about AC models are based on ETP model [14,15,16], and several references focus on water heaters [13]. Few papers focus on modeling methods of other types of TCLs.

In fact, there is growing potential on heat pumps and refrigerators for residential users [81] and industrial and commercial users [82]. They can also play significant roles in peak shaving, valley filling, system frequency regulating, and uncertainty restraining brought by RESs, as what ACs have done [33]. The heat pumps and refrigerators have similar physical properties and dynamic processes with ACs. However, there still exists many differences between heat pumps, refrigerators and ACs. On one hand, the energy stored in hot water provided by heat pumps will be dissipated through pipes, and lost when hot water is used. This special energy transfer process increases complexity of heat balance equation. Besides, heat pumps are widely used in industry and commerce with high power but small quantity [83]. Refrigerators are mainly used by residential users with lower power but larger quantity. These result in differences of heat pumps, refrigerators and ACs in modeling and control strategies [84].

4.3 Hierarchical coordinated control methods of the VESS

At present, TCLs participate in demand response mainly by the centralized control method [85, 86], while decentralized control method is rarely used [87]. However, due to the limitation of communication capability [85], it is difficult to achieve centralized control of massive VESSs [86]. Faced with this issue, the hierarchical coordinated control method [88, 89] can probably solve this problem well.

The hierarchical coordinated control method usually divides the whole control process into two levers. In the lower level, all the VESS units are divided into different groups controlled by different aggregators. In the upper level, all the aggregators will receive control signal sent by the power system operator. This control mode can greatly reduce the demand for communication capacity since the power system only control aggregators rather than every VESS. However, how to choose the certain VESS units for a certain aggregator to reduce the control pressure of the lower lever is a challenge. Moreover, another difficulty is how to control VESS units or aggregators to participate in demand response more economically and more efficiently.

4.4 Control strategies considering VESS, ESS and RESs

The VESS modeling method makes it easier for TCLs to participate in DR. As a special ESS, VESS has similar external electrical characteristics with traditional ESS, which can achieve the time shift of power usage [51]. Besides, due to the increasing penetration of RES, it will be a hotspot to combine VESS with ESS from the point of view of ESS, considering the uncertainties of RESs.

However, there are still several challenges to be dealt with. Because the ESS is relatively centralized and has large capacity, fast control speed and high precision can be realized, which helps ESS participate in RES control [90,91,92]. However, it is geographically dispersed for the VESS. The control method considers not only the electrical limitations, but also the comfort and willingness of users. Due to more constraints and huger quantities, fast control of VESS is more difficult to achieve. Therefore, better control strategies need to be proposed to meet the requirements of the RES control.

4.5 Reliability and fast response in frequency control for VESS

As a special ESS, VESS has obvious advantages in the field of frequency control for power systems, considering two reasons: on one hand, the number of VESSs is huge and VESSs can provide huge power reserve, especially in summer and winter. On the other hand, because it can take advantage of a large number of existing TCLs, it is less expensive for VESS to participate in frequency control.

However, a series of problems still need to be solved [44, 46, 54, 65]. The VESS is geographically dispersed, and it is controlled through sophisticated communication systems to achieve fast response. Therefore, the most serious problem is the reliability of VESS as a reserve for frequency control since more components in the system will lead to lower reliability [93]. Besides, frequency control requires fast response and the communication delay should also be considered. Not only the progress of control strategies, but also the improvement of hardware needs to be focused on.

5 Conclusions

The penetration of RESs is increasing rapidly, while it brings more uncertainties and leads to power and voltage fluctuations. As an alternative to traditional generators, TCLs can provide regulation capacities to deal with these challenges by demand response. This paper focuses on summarizing the VESS equivalent modeling methods of the TCLs and the control strategies of the VESS. First, The VESS equivalence of the individual TCL and the aggregated TCLs are studied. The VESS is compared with traditional ESS about physical parameters. Then, the control strategies of the VESS in microgrids and the main network are showed. The VESS reveals excellent performance in frequency regulation, maintaining voltage stability and economic dispatch.

Although there are a lot of research on the VESS, the study of the VESS is still in its infancy, and many problems need to be solved. First, the accuracy of regulation potential estimation needs to be improved to make full use of the VESS. Besides, the VESS equivalent modeling method of the heat pumps and refrigerators should be studied since they have increasing potential to participate in the demand response. Then, hierarchical coordinated control strategies comprehensively considering VESS, ESS and RESs need to be studied further. Finally, reliability and fast response of VESS in frequency control should be focused on.