Next Article in Journal
Methane Oxidation Efficiency in Biofiltration Systems with Different Moisture Content Treating Diluted Landfill Gas
Next Article in Special Issue
Multiple Site Intraday Solar Irradiance Forecasting by Machine Learning Algorithms: MGGP and MLP Neural Networks
Previous Article in Journal
Computer Simulation as a Tool for Managing the Technical Development of Methods for Diagnosing the Technical Condition of a Vehicle
Previous Article in Special Issue
Enhanced Prediction of Solar Radiation Using NARX Models with Corrected Input Vectors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Models for Short-Term Wind Power Forecasting Based on Improved Artificial Neural Network Using Particle Swarm Optimization and Genetic Algorithms

1
University of Science and Technology, The University of Danang, 54 Nguyen Luong Bang St., Lien Chieu District, Danang 550000, Vietnam
2
Danang Power Company Ltd., 35 Phan Dinh Phung St., Danang 550000, Vietnam
3
Univ. Grenoble-Alpes, CEA-LITEN, INES, 50 avenue du Lac Léman, 73375 Le Bourget-du-Lac, France
*
Author to whom correspondence should be addressed.
Submission received: 7 May 2020 / Revised: 30 May 2020 / Accepted: 1 June 2020 / Published: 4 June 2020
(This article belongs to the Special Issue Solar and Wind Power and Energy Forecasting)

Abstract

:
As sources of conventional energy are alarmingly being depleted, leveraging renewable energy sources, especially wind power, has been increasingly important in the electricity market to meet growing global demands for energy. However, the uncertainty in weather factors can cause large errors in wind power forecasts, raising the cost of power reservation in the power system and significantly impacting ancillary services in the electricity market. In pursuance of a higher accuracy level in wind power forecasting, this paper proposes a double-optimization approach to developing a tool for forecasting wind power generation output in the short term, using two novel models that combine an artificial neural network with the particle swarm optimization algorithm and genetic algorithm. In these models, a first particle swarm optimization algorithm is used to adjust the neural network parameters to improve accuracy. Next, the genetic algorithm or another particle swarm optimization is applied to adjust the parameters of the first particle swarm optimization algorithm to enhance the accuracy of the forecasting results. The models were tested with actual data collected from the Tuy Phong wind power plant in Binh Thuan Province, Vietnam. The testing showed improved accuracy and that this model can be widely implemented at other wind farms.

Graphical Abstract

1. Introduction

Along with the requirements of the process of industrialization and modernization, together with increasing demands for economic growth and the exchange of goods and services across the globe, ensuring sufficient sources of energy has posed many challenges to countries worldwide. Traditional sources of energy such as coal, oil, and gas are increasingly exhausted, cause environmental pollution and uplift the greenhouse effects. To solve this problem, renewable energy has been widely encouraged with several alternative sources of energy being introduced and continuously developed. One of these is wind power, which is referred to as a clean source of energy with great potential for development. With the pace as it is now, wind power will soon occupy a large portion of the world energy market.
According to the Global Wind Report 2019 (GWEC), 60.4 GW of new installations brings the global cumulative wind power capacity up to 651 GW, as shown in Figure 1 [1].
Between 2010 and 2017, energy from wind power plants grew 3.3 times, from 342 terawatt-hours (TWh) to 1134 TWh, as illustrated in Figure 2 [2]. It also went up from 1260 TWh in 2018 to 1404 TWh in 2019 [3].
With the accelerating penetration of wind power into the power system, it is difficult for operators to predict the status of the power system. A sudden change in the generating capacity of wind power plants increases the uncertainty factors in operating the power system. Therefore, the power system control center often requires the backup capacity to increase, leading to additional costs for the whole system. While the level of penetration of wind power plants into the power system is still low, its influence on the power system is almost negligible. However, when penetration is high, there are several challenges to address including power imbalances as well as increased system reserves [4]. In order to overcome such problems, it is imperative to build models for wind power prediction with the lowest possible errors. Accurate forecasting of wind power generation can help enhance the stability of the power system, the reliability of power supply, and power quality. Furthermore, the calculation of power balance and economical operation in the power system will be more accurate, thus contributing to reducing its operating costs.
There has been a lot of research on wind power forecasting with different methods, among which statistical methods and artificial neural network (ANN) methods are quite commonly used [5]. For example, models of ANN have been proposed to predict wind power generation capacity, where the ANN is trained to be used in combination with genetic algorithms [6]. Another model was developed using ANN with Gaussian process approximation and adaptive Bayesian learning to predict wind power generation capacity in a short time with intervals such as 5 min, 10 min, 15 min, 20 min, and 30 min [7]. Other researchers have built models utilizing neural networks to predict the wind power generation capacity that can be applied to the power system and electricity market [8]. Various forecasting methods were combined including persistent methods, backpropagation neural networks, and radial basis function (RBF) neural networks to build models for 10-min-ahead wind power prediction [9]. These methods have been prove to facilitate the execution of wind power forecasting.
A number of studies have been found to be related to short-term forecasting models of wind power generation capacity [10]. The researchers, in [11] introduced short-term wind speed forecasting of wind farms based on the least squares support vector machine (SVM) model. Some methods employed by other authors for wind power forecasting include the artificial intelligence network [12] and double-stage hierarchical adaptive neuro-fuzzy inference system (ANFIS) approach [13]. Some have developed forecasting models and applications for the optimal operation of wind farms [14,15]. In [16], the authors provided a comprehensive review of combined approaches for short-term wind speed and wind power forecasting.
Hybrid forecasting methods have also been developed with a combination of weather and historical data in building forecasting models. Adding to these are combined optimization algorithms with current forecasting methods to improve accuracy. Such methods include the double-stage hierarchical hybrid genetic algorithm-ANN (GA-ANN) [17], hybrid intelligent systems [18], double-stage hierarchical hybrid particle swarm optimization-ANN (PSO-ANN) model [19], two-stage hybrid modeling approach based on supervisory, control, and data acquisition system (SCADA), and meteorological information [20,21,22]. Fuzzy methods have also been used by some to build a forecasting model [23,24,25]. In another approach, the Kalman filter was adopted to improve the model of wind speed prediction, thereby reducing errors in wind power generation forecasting [26]. Furthermore, a dual-step integrated machine learning model was introduced based on actual measurement data and environmental factors to improve the accuracy of the forecasting model [27]. Most of the articles above-mentioned have proposed advanced methods and built models of wind power generation forecasting that can be applied to actual production. However, forecasting errors can be further reduced through enhanced optimization methods and machine learning.
In this paper, two new methods of wind power forecasting are proposed: applying the optimization algorithm of PSO and applying GA to a PSO-ANN model. The idea behind these methods is to optimize the parameters of the PSO-ANN model, thus helping reduce the forecasting errors and enhancing prediction accuracy. Initially, a first PSO algorithm is used to adjust the parameters of a neural network in the wind power forecasting model. Then, in the PSO-PSO-ANN method, another particle swarm optimization is used to find the optimal parameters of the first PSO algorithm to improve forecasting accuracy. Similarly, in the GA-PSO-ANN method proposed, the genetic algorithm is used to adjust the parameters of the first PSO algorithm to improve the accuracy of the forecasting results.
The main objectives of this study are listed below:
  • Propose a double-optimization approach represented by two new advanced models for wind power forecasting using particle swarm optimization, genetic algorithms, and artificial neural network, the so-called PSO-PSO-ANN and GA-PSO-ANN;
  • Develop a wind power forecasting tool based on these models and use data from a real wind power plant to test the tool. Both models are tested with actual data collected from the Tuy Phong wind power plant, which is located in Binh Thuan Province, Vietnam; and
  • Increase prediction accuracy in comparison with other forecasting methods. The accuracy indicator of the proposed wind power forecasting models is then compared with that of several known approaches to verify efficiency and advancement.
The rest of this paper is organized as follows. In Section 2, fundamental concepts and structures of the ANN, PSO, GA, and PSO-ANN models are introduced. In Section 3, the two new algorithms GA-PSO-ANN and PSO-PSO-ANN are proposed in detail. These algorithms are used to develop a wind power forecasting tool based on Python, a programming language. As the proposed models are implemented to forecast wind power hourly, Section 4 provides insights into the experimental results and evaluates the accuracy, given some forecasting error benchmarks. Finally, Section 5 contains the discussion and ideas for extending research.

2. Forecasting Methods

2.1. Artificial Neural Network (ANN)

Artificial intelligence is a field that researches and develops ways to make machines capable of reasoning, making judgments, feeling, understanding languages, and solving problems like humans.
The artificial neural network has the same structure as the human brain. However, the difference is that the number of neurons in the ANN depends on the actual needs of the problem, whereas the human brain has approximately 15 billion neurons [28]. An ANN is capable of learning and applying what has been taught, and as a result, it has been strongly developed and employed, especially in the field of forecasting, classification, identification, control, and so on.
In this paper, a feedforward neural network was built to forecast wind power. The general structure of a feedforward multilayer neural network is described as follows [29,30]:
  • A multilayer feedforward network consists of an input layer, an output layer, and one or more hidden layers between them.
  • Inputs are vectors (x1, x2, ,…, xn) in n-dimensional space, and outputs are vectors (y1, y2, …, yk) in k-dimensional space.
  • Each neuron of the current layer is linked with all neurons in the previous layer.
  • The output of a previous layer is the input of the next layer.
  • The input layer receives data and redistributes them to neurons in the hidden layer(s). The input neurons do not perform any calculations. The information flow in the feedforward neuron network will go from left to right, and the input values (x1, x2, x3, …, xn) are transmitted to the hidden layer neurons through connection weights, and then taken to the output layer.
In this paper, the neural network structure includes one input layer, one hidden layer, and one output layer, which can be seen in Figure 3 [8]. The weight connected from the ith neuron in the input layer to the hth neuron in the hidden layer is denoted by w1ih, and the weight connected from the hth neuron in the hidden layer to the kth neuron in the output layer is denoted by w2h.
• With the hth neuron in the hidden layer [29,30]:
net h = i = 1 n w ih x i + b h
z h = f 1 ( net h )
where
  • xi is the ith input variable;
  • wih is the connection weights between ith input and hth neuron;
  • bh is the bias;
  • neth is the net input or argument of the activation function;
  • zh is the net output; and
  • f1(neth) is the activation function.
The input layer consists of three neurons that represent wind speed, wind direction, and temperature. The output layer has one neuron, which is wind power. The neural network also has ten neurons in the hidden layer. The number of neurons in the hidden layer has been carefully chosen. If this number is too small, it may cause the inability to fully identify the signals in a complex dataset. However, if there are too many, it will increase the time of network training and can lead to overfitting in the forecast. This number depends on factors such as the number of inputs, the output of the network, the number of cases in the sample set, the noise of the target data, the complexity of the error function, the network architecture, and the network training algorithm.
Many trials were made to determine the number of neurons in the hidden layer with different configurations, based on our research experience and the pilot test approach, and simulations were then conducted to perform neural network training and error validation (MAPE). Finally, the number of ten neurons in the hidden layer was chosen because it gave better MAPE values than the remaining trial cases without overfitting.
In this paper, we used tan-sigmoid as the activation function for neurons in the hidden layer and the purelin function for the output layer. Through our research on artificial intelligence and hands-on experience, the tan-sigmoid function is a nonlinear function that can simulate relatively close to the wind turbine’s power curve. Therefore, this function was used as the activation function for the hidden layer. Furthermore, based on the results from many publications, the most appropriate activation function for the output layer of a feedforward neuron network is a linear function. This is the reason why we used purelin, a linear function, to transfer data from the hidden layer to the output layer.

2.2. Particle Swarm Optimization (PSO)

The particle swarm optimization algorithm is one of the algorithms built on the concept of swarm intelligence to find solutions for optimization problems in a certain search space. The algorithm has important applications in many areas, whereby the solving of optimization problems is imperative [31].
The PSO algorithm is a form of the evolutionary algorithms that were previously known such as the genetic algorithm (GA) and ant colony algorithm [32]. However, PSO differs from GA in that it tends to use interactions among individuals in a population to explore the search space. The PSO algorithm is a result of modeling the flight of birds in search of food. It was first introduced in 1995 by James Kennedy and Russell C. Eberhart [31]. It is an optimization tool, in which each particle of the swarm flies in the search space for a potential solution to the problem. The velocity and position of each particle after each iteration can be updated using the current velocity and the distance from its best position (pbest) to swarm best position (gbest) by Equations (3) and (4), as demonstrated in Figure 4 [31,33,34,35]:
• Position of ith particle in the k + 1th iteration:
x k + 1 i =   x k i + v k + 1 i
• Velocity of ith particle in the k + 1th iteration:
v k + 1 i =   wv k i + c 1 r 1 ( p b e s t k i x k i ) + c 2 r 2 ( g b e s t k   x k i )
where
  • x k i is the position of the particle ith in the kth iteration;
  • x k + 1 i is the position of the particle ith in the (k + 1)th iteration;
  • v k i is the velocity of the ith particle in the kth iteration;
  • v k + 1 i is the velocity of the ith particle in the (k + 1)th iteration;
  • p b e s t k i is the best position of the ith particle until the kth iteration;
  • g b e s t k   is the best position of the swarm until the kth iteration;
  • w is the inertial weight;
  • c1, c2 are the acceleration coefficients; and
  • r1, r2 are the random numbers between 0 and 1.

2.3. Generic Algorithm

Genetic algorithm (GA) is a technique of computer science and a subdivision of evolutionary algorithms that seeks the right solution to optimization problems based on the genetic operators: selection, crossover, and mutation [36]. GA is based on two basic biological processes: the genetic theory of Gregor Johan Mendel (1865) and the evolutionary theory of Charles Darwin (1875). It can describe and solve many complex optimization problems in multiple areas such as scheduling problems, sales planning, and traveler’s problems [36,37,38,39]. The flowchart of GA can be seen in Figure 5 [39].

2.4. Particle Swarm Optimization-Artificial Neural Network (PSO-ANN) Hybrid Algorithm

The PSO algorithm is used in training the ANN to determine the set of parameters (w, b), so that the neural network can be best built and fit with the data [40]. The concept of the PSO-ANN algorithm is shown in Figure 6, with the PSO being used to train the ANN.
The number of parameters of ANN is determined by:
N = n × h + m × h + h + m = 3 × h + 1 × h + h + 1 = 5h + 1
where
  • N is the number of parameters of the neural network;
  • n is the number of neurons in the input layer;
  • h is the number of neurons in the hidden layer; and
  • m is the number of neurons in the output layer.
The size of the search space is defined based on the neural network structure:
D = N = 5 h + 1 = 5 × 10 + 1 = 51
Through experiments, several sets of PSO parameters were considered. Then, these sets were tested using the trial-and-error approach to select the set of parameters that produced the best result (smallest MAPE). The best set of PSO parameters with the relevant values are described in Table 1.
The procedure to implement the PSO-ANN hybrid algorithm is described below:
  • Step 1: Read and separate historical data into a training set (for training the neural network) and a test set (for testing the neural network).
  • Step 2: Specify PSO parameters.
  • Step 3: Generate an initial swarm with random position and velocity values for all particles. Each particle is a unique neural network. Hence, the number of neural networks is equal to the size of the swarm (or the number of particles in the swarm).
  • Step 4: Train the initial neural networks and calculate the fitness function value (mean absolute percent error, MAPE) for each particle. Then, calculate fibest, fgbest.
  • Step 5: Update the velocity and position of each particle.
  • Step 6: For each particle, train the current neural networks, and recalculate the fitness function value. If the current fitness function value is better than its best fitness function value in the previous iteration, then the fibest will be updated to the current fitness function value, and the particle best position (pbest) will be updated to the current position of the particle. After that, if the fibest value is better than fgbest, then the swarm best fitness function value fgbest will be updated by the current fibest value, and swarm best position (gbest) is updated to the best particle position.
  • Step 7: If the maximum iteration is reached, then proceed to step 8. Otherwise, go back to step 5.
  • Step 8: Check if the error is less than the pre-defined error epsilon (). If yes, print the optimized neural network parameters. Otherwise, we start the whole process again.
The whole process can be illustrated in Figure 7.

3. Proposing Algorithms for Short-Term Wind Power Forecasting

3.1. Proposing Particle Swarm Optimization – Particle Swarm Optimization – Artificial Neural Network (PSO-PSO-ANN) Hybrid Algorithm

In order to improve the accuracy of the wind power forecasting, this paper proposed a PSO-PSO-ANN algorithm, whose structure consists of three main rings: PSO1 loop, PSO2 loop, and neural network loop (Figure 8). In this structure, the outer loop PSO1 uses the PSO algorithm to determine the best values of parameters c1, c2, and w of the PSO2 loop. Similarly, the PSO2 loop uses the PSO algorithm to adjust the parameters of the neural network, as described in Section 2.4.
The procedure for implementing the PSO-PSO-ANN hybrid algorithm is now presented in Figure 9, where
  • x 1 i init is the initial position of the ith particle of the PSO1 algorithm;
  • x 2 i init is the initial position of the ith particle of the PSO2 algorithm;
  • v 1 i init is the initial velocity of the ith particle of the PSO1 algorithm;
  • v 2 i init is the initial velocity of the ith particle of the PSO2 algorithm;
  • p 1 i best is the best position of the ith particle of the PSO1 algorithm;
  • p 2 i best is the best position of the ith particle of the PSO2 algorithm;
  • f 1 i current is the fitness function value of the ith particle in the current iteration of the PSO1 algorithm;
  • f 2 i current is the fitness function value of the ith particle in the current iteration of the PSO2 algorithm;
  • f 1 i best is the best fitness function value of the ith particle of the PSO1 algorithm;
  • f 2 i best is the best fitness function value of the ith particle of the PSO2 algorithm;
  • g 1 best is the best position of the PSO1 algorithm;
  • g 2 best is the best position of the PSO2 algorithm;
  • f 1 best is the best fitness function value of the PSO1 algorithm;
  • f 2 best is the best fitness function value of the PSO2 algorithm;
  • iteration1, iteration2 are the current iterations of the PSO1 and PSO2 loop; and
  • iteration_max1, iteration_max2 are the maximum iterations of the PSO1 and PSO2 loop.

3.2. Proposing GA-PSO-ANN Hybrid Algorithm

Aside from PSO-PSO-ANN, the GA-PSO-ANN algorithm is also used to improve the accuracy of wind power forecasting. Its structure consists of three main rings: the GA loop, PSO loop, and the neural network loop (see Figure 10). In this structure, the outer loop GA uses a genetic algorithm to determine the best values of the parameters c1, c2, and w of the PSO loop. Similarly, the PSO loop uses the PSO algorithm to adjust the parameters of the neural network, as described in Section 2.4.
The procedure to implement the GA-PSO-ANN hybrid algorithm is demonstrated in Figure 11, where
  • x i init is the initial position of the ith particle of the PSO algorithm;
  • v i init is the initial velocity of the ith particle of the PSO algorithm;
  • p i best is the best position of the ith particle of the PSO algorithm;
  • f i current is the fitness function value of the ith particle in the current iteration of the PSO algorithm;
  • f i best is the best fitness function value of the ith particle of the PSO algorithm;
  • g best is the best position of the PSO algorithm;
  • f best is the best fitness function value of the PSO algorithm; and
  • Q is the population that consists of solutions (Q1, Q2, …, QN), Qi = (c1i, c2i, wi) with i = 1, 2, 3, …, N. N is the number of solutions of the population.

3.3. Data

The historical data including wind turbine output power, wind speed, wind direction, and temperature were used to train the models, as shown in Figure 12. These data were collected periodically with a 30-min cycle, taken from Tuy Phong wind farm, located in Binh Thuan Province, Vietnam. The entire dataset consists of 3866 records [8].
The 3866 data records were divided into two sets (i.e., training set and test set). The former had 3479 records, which were used to train the neural network, while the latter had 387 records used to check the accuracy of the model.

3.4. Programing Language

Based on the proposed GA-PSO-ANN and PSO-PSO-ANN algorithms, the wind power forecasting tool was built using Python, a high-level and object-oriented programming language. Python has a clear structure that is easy to understand and easy to use. Additionally, codes written in Python are often found to be shorter than other programming languages. In particular, Python supports a lot of math libraries, machine learning, data science, and optimization algorithm libraries [41].

4. Results

4.1. Evaluation Method

The mean absolute percentage error (MAPE) and mean square error (MSE) indices were used to evaluate the effectiveness of the proposed wind power forecasting models [42].
Mean absolute percentage error is calculated using the following equation [8,43,44]:
MAPE   = 1 N i   = 1 N | P i true P i predict | P i true 100 %
Mean square error [43,44] is determined by:
MSE   = 1 N i   = 1 N ( P i true P i predict ) 2
where
  • P i true is the ith actual power value;
  • P i predict is the ith forecasted power value; and
  • N is the total number of records of the data.

4.2. Experimental Results

For more accuracy evaluation, each proposed algorithm was used to train and test the neural network 24 times to calculate the average MSE and MAPE. The results compared with the PSO-ANN and Adam-ANN methods [45,46] are shown in Table 2.
Figure 13 and Figure 14 show the MAPE and MSE indices for 24 testing times of all four models (built on the four aforementioned methods). In the figures, the PSO-PSO-ANN and GA-PSO-ANN models had more stable accuracy than the PSO-ANN and Adam-ANN models.
The average results of the MSE and MAPE are now shown in Table 3 and Figure 15 and Figure 16.
The average result of MAPE across the 24 testing times for the GA-PSO-ANN algorithm was 4.52%, PSO-PSO-ANN was 4.54%, PSO-ANN was 4.90%, and Adam-ANN was 7.79%. Both PSO-PSO-ANN and GA-PSO-ANN algorithms provided better results than the PSO-ANN and Adam-ANN. Out of the four, the GA-PSO-ANN algorithm had the best result, which was slightly better than the PSO-PSO-ANN algorithm.
The average results of MSE in the 24 testing times for the GA-PSO-ANN, PSO-PSO-ANN, PSO-ANN, and Adam-ANN algorithms were 0.00114, 0.00112, 0.00121, and 0.00123, respectively. In the case of the MSE index, PSO-PSO-ANN had the best result among these four algorithms. Again, the two algorithms PSO-PSO-ANN and GA-PSO-ANN can be seen to provide better results than PSO-ANN and Adam-ANN.
In both cases, the proposed algorithms GA-PSO-ANN and PSO-PSO-ANN have outstanding results compared with PSO-ANN and Adam-ANN. Since the forecasting-versus-actual-result graphs for the two proposed algorithms resembled each other, graphs for the GA-PSO-ANN are shown as follows to represent both. As illustrated in Figure 17 and Figure 18, the wind power forecasting results for one day (Figure 17) and for one week (Figure 18) by the proposed GA-PSO-ANN models were quite similar to the actual wind power archived via the SCADA system.

5. Discussion

This paper demonstrated a tool that was built for the forecasting of wind power generation output with a high level of accuracy. By means of an open-source Python programming language, a wind power forecasting program was built with a hybrid application of an artificial neural network, particle swarm optimization algorithm, and genetic algorithm. Specifically, the particle swarm optimization algorithm was used to train the artificial neural networks (PSO-ANN model). In order to reduce errors and improve accuracy in forecasting, the authors used another particle swarm optimization algorithm and genetic algorithm (PSO-PSO-ANN and GA-PSO-ANN models) for the optimal adjustment of the first PSO parameters during neural network training. The two models were successfully applied for the forecasting power output of the Tuy Phong wind power plant in Binh Thuan Province, Vietnam. The results show that the forecasting models PSO-PSO-ANN and GA-PSO-ANN provided better results than the PSO-ANN or Adam-ANN models. Table 4 shows the comparison of MAPE between the different wind power forecasting models [8,27,47]. The proposed models PSO-PSO-ANN and GA-PSO-ANN showed better accuracy than the aforementioned models, which indicates that the proposed models in this model can be well used for forecasting in the actual production of wind farms while ensuring a higher level of accuracy.
Wind power generation forecasting plays an important role in optimizing the operation of the power system and electricity market. The models proposed can be expanded and further developed to improve the accuracy of the forecasting results. With the mismatch in forecasting wind power in several wind farms being minimized, the reservation capacity in the power system is very likely to reduce, thus increasing the efficiency of the operation in the electricity market. Some extensions to this piece of research can be considered, ranging from a study on an algorithm to filter and eliminate noise in the input data to an investigation into the algorithm to determine the optimal number of hidden layers in neural networks to give predictive results with the lowest error, to name just a few.

Author Contributions

Conceptualization, D.T.V. and Q.T.T.; Methodology, D.T.V. and V.V.P.; Software, V.V.P. and M.Q.D.; Validation, D.T.V., Q.T.T., and V.V.P.; Formal analysis, D.T.V.; Investigation, Q.T.T.; Resources, D.T.V.; Data curation, V.V.P. and M.Q.D.; Writing—original draft preparation, V.V.P., D.T.V., and M.Q.D.; Writing—review and editing, D.T.V., M.Q.D., and Q.T.T.; Visualization, V.V.P.; Supervision, D.T.V.; Project administration, D.T.V.; Funding acquisition, D.T.V. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Funds for Science and Technology Development of the University of Danang under project number B2019-DN01-27.

Acknowledgments

The University of Danang, The University of Danang-University of Science and Technology, and Danang Power Company Limited supported this work financially and technically.

Conflicts of Interest

The authors declare no conflicts of interest.

Nomenclature

GWECGlobal Wind Energy Council
CAGRCompound Annual Growth Rate
ANNArtificial Neural Network
PSOParticle Swarm Optimization
GAGenetic Algorithm
MAPEMean Absolute Percentage Error
MSEMean Square Error
SCADASupervisory Control and Data Acquisition

References

  1. Global Wind Report 2019; Global Wind Energy Council: Brussels, Belgium, 2020; Available online: https://gwec.net/global-wind-report-2019/ (accessed on 25 April 2020).
  2. Wind Energy. Available online: https://www.irena.org/wind (accessed on 25 April 2020).
  3. Global Wind and Solar Energy Growth Rate in 2019 Was “Slowest This Century”|Recharge. Available online: https://www.rechargenews.com/wind/global-wind-and-solar-energy-growth-rate-in-2019-was-slowest-this-century/2-1-769738 (accessed on 25 April 2020).
  4. Kabouris, J.; Kanellos, F.D. Impacts of Large Scale Wind Penetration on Energy Supply Industry. Energies 2009, 2, 1031–1041. [Google Scholar] [CrossRef]
  5. Mellit, A.; Massi Pavan, A.; Ogliari, E.; Leva, S.; Lughi, V. Advanced Methods for Photovoltaic Output Power Forecasting: A Review. Appl. Sci. 2020, 10, 487. [Google Scholar] [CrossRef] [Green Version]
  6. Lotfi, E.; Khosravi, A.; Akbarzadeh-T, M.-R.; Nahavandi, S. Wind power forecasting using emotional neural networks. In Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, CA, USA, 5–8 October 2014; Volume 2014. [Google Scholar]
  7. Blonbou, R. Very short-term wind power forecasting with neural networks and adaptive Bayesian learning. Renew. Energy 2011, 36, 1118–1124. [Google Scholar] [CrossRef]
  8. Viet, D.T.; Phuong, V.V.; Duong, M.Q.; Kies, A.; Schyska, B.U.; Wu, Y.K. A Short-Term Wind Power Forecasting Tool for Vietnamese Wind Farms and Electricity Market. In Proceedings of the 2018 4th International Conference on Green Technology and Sustainable Development (GTSD), Ho Chi Minh City, Vietnam, 23–24 November 2018; pp. 130–135. [Google Scholar]
  9. Chang, W.-Y. Short-Term Wind Power Forecasting Using the Enhanced Particle Swarm Optimization Based Hybrid Method. Energies 2013, 6, 4879–4896. [Google Scholar] [CrossRef] [Green Version]
  10. Maldonado-Correa, J.; Solano, J.; Rojas-Moncayo, M. Wind power forecasting: A systematic literature review. Wind Eng. 2019, 0309524X19891672. [Google Scholar] [CrossRef]
  11. Li, X.; Wang, X.; Zheng, Y.H.; Li, L.X.; Zhou, L.D.; Sheng, X.K. Short-Term Wind Power Forecasting Based on Least-Square Support Vector Machine (LSSVM). Available online: https://www.scientific.net/AMM.448-453.1825 (accessed on 25 April 2020).
  12. Eseye, A.; Zhang, J.; Zheng, D.; Shiferaw, D. Short-Term Wind Power Forecasting Using Artificial Neural Networks for Resource Scheduling in Microgrids. Int. J. Sci. Eng. Appl. 2016, 5, 144–151. [Google Scholar] [CrossRef]
  13. Zheng, D.; Eseye, A.; Zhang, J.; Li, H. Short-term wind power forecasting using a double-stage hierarchical ANFIS approach for energy management in microgrids. In Protection and Control of Modern Power Systems; Springer: Berlin/Heidelberg, Germany, 2017; Volume 2. [Google Scholar] [CrossRef] [Green Version]
  14. Würth, I.; Valldecabres, L.; Simon, E.; Möhrlen, C.; Uzunoğlu, B.; Gilbert, C.; Giebel, G.; Schlipf, D.; Kaifel, A. Minute-Scale Forecasting of Wind Power—Results from the Collaborative Workshop of IEA Wind Task 32 and 36. Energies 2019, 12, 712. [Google Scholar] [CrossRef] [Green Version]
  15. Ogimi, K.; Kamiyama, S.; Palmer, M.; Yona, A.; Senju, T.; Funabashi, T. Optimal Operation Planning of Wind Farm Installed BESS Using Wind Power Forecast Data of Wind Turbine Generators Considering Forecast Error. Int. J. Emerg. Electr. Power Syst. 2013, 14, 207–218. [Google Scholar] [CrossRef]
  16. Tascikaraoglu, A.; Uzunoglu, M. A review of combined approaches for prediction of short-term wind speed and power. Renew. Sustain. Energy Rev. 2014, 34, 243–254. [Google Scholar] [CrossRef]
  17. Eseye, A.; Zhang, J.; Zheng, D.; Ma, H.; Jingfu, G. Short-term wind power forecasting using a double-stage hierarchical hybrid GA-ANN approach. In Proceedings of the 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA), Beijing, China, 10–12 March 2017; pp. 552–556. [Google Scholar]
  18. Ranganayaki, V.; Deepa, S.N. An Intelligent Ensemble Neural Network Model for Wind Speed Prediction in Renewable Energy Systems. Available online: https://www.hindawi.com/journals/tswj/2016/9293529/ (accessed on 12 May 2020).
  19. Eseye, A.T.; Zhang, J.; Zheng, D.; Han, L.; Gan, J. A double-stage hierarchical hybrid PSO-ANN model for short-term wind power prediction. In Proceedings of the 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), Beijing, China, 10–12 March 2017; pp. 489–493. [Google Scholar]
  20. Zheng, D.; Shi, M.; Wang, Y.; Eseye, A.T.; Zhang, J. Day-Ahead Wind Power Forecasting Using a Two-Stage Hybrid Modeling Approach Based on SCADA and Meteorological Information, and Evaluating the Impact of Input-Data Dependency on Forecasting Accuracy. Energies 2017, 10, 1988. [Google Scholar] [CrossRef] [Green Version]
  21. Che, Y.; Peng, X.; Delle Monache, L.; Kawaguchi, T.; Xiao, F. A wind power forecasting system based on the weather research and forecasting model and Kalman filtering over a wind-farm in Japan. J. Renew. Sustain. Energy 2016, 8, 013302. [Google Scholar] [CrossRef]
  22. MacLeod, D.; Torralba, V.; Davis, M.; Doblas-Reyes, F. Transforming climate model output to forecasts of wind power production: How much resolution is enough? Meteorol. Appl. 2018, 25, 1–10. [Google Scholar] [CrossRef] [Green Version]
  23. Cunkas, M.; Çevik, H. Wind Power Forecasting Using Fuzzy Model. In Proceedings of the International Conference on Engineering Technologies (ICENTE’17), Konya, Turkey, 7–9 December 2017. [Google Scholar]
  24. Devi, M.R.; SriDevi, S. Probabilistic Wind Power Forecasting Using Fuzzy Logic. Int. J. Sci. Res. Manag. 2017, 5, 6497–6500. [Google Scholar] [CrossRef]
  25. Shahzad, M.; Naeem, U.; Sadiq, R.; Muhammad, E. Fuzzy Logic Based Algorithm for Wind Energy Prediction. In Proceedings of the 2019 International Symposium on Recent Advances in Electrical Engineering (RAEE), Islamabad, Pakistan, 28–29 August 2019; Volume 4, pp. 1–6. [Google Scholar]
  26. Song, D.; Yang, J.; Dong, M.; Joo, Y.H. Kalman filter-based wind speed estimation for wind turbine control. Int. J. Control Autom. Syst. 2017, 15, 1089–1096. [Google Scholar] [CrossRef]
  27. Ma, Y.-J.; Zhai, M.-Y. A Dual-Step Integrated Machine Learning Model for 24h-Ahead Wind Energy Generation Prediction Based on Actual Measurement Data and Environmental Factors. Appl. Sci. 2019, 9, 2125. [Google Scholar] [CrossRef] [Green Version]
  28. The Synaptic Organization of the Brain, 5th ed.; Oxford University Press, U.S.A.: Oxford, UK; New York, NY, USA, 2003; ISBN 978-0-19-515956-1.
  29. Neural Networks for Applied Sciences and Engineering: From Fundamentals to Complex Pattern Recognition, 1st ed.; Auerbach Publications: Boca Raton, FL, USA, 2006; ISBN 978-0-8493-3375-0.
  30. Demuth, H.; Beale, M. MATLAB: Neural Network Toolbox: User’s Guide: Version 2; Math Works, Inc.: Natick, MA, USA, 1997. [Google Scholar]
  31. Kennedy, J.; Eberhart, R. Particle swarm optimization. In Proceedings of the Proceedings of ICNN‘95—International Conference on Neural Networks, Perth, Australia, 27 November–1 December 1995; Volume 4, pp. 1942–1948. [Google Scholar]
  32. Duong, M.Q.; Pham, T.D.; Nguyen, T.T.; Doan, A.T.; Tran, H.V. Determination of Optimal Location and Sizing of Solar Photovoltaic Distribution Generation Units in Radial Distribution Systems. Energies 2019, 12, 174. [Google Scholar] [CrossRef] [Green Version]
  33. Viet, D.T.; Tuan, T.Q.; Van Phuong, V. Optimal Placement and Sizing of Wind Farm in Vietnamese Power System Based on Particle Swarm Optimization. In Proceedings of the 2019 International Conference on System Science and Engineering (ICSSE), Dong Hoi City, Vietnam, 19–21 July 2019; pp. 190–195. [Google Scholar]
  34. Kennedy, J.; Eberhart, R.C. A discrete binary version of the particle swarm algorithm. In Proceedings of the Computational Cybernetics and Simulation 1997 IEEE International Conference on Systems, Man, and Cybernetics, Orlando, FL, USA, 12–15 October 1997; Volume 5, pp. 4104–4108. [Google Scholar]
  35. Khalil, T.M.; Gorpinich, A.V. Gorpinich, Selective particle swarm optimization. Int. J. Multidiscip. Sci. Eng. 2012, 3, 2045–7057. [Google Scholar]
  36. Modern Heuristic Optimization Techniques: Theory and Applications to Power Systems|Wiley. Available online: https://0-www-wiley-com.brum.beds.ac.uk/en-us/Modern+Heuristic+Optimization+Techniques%3A+Theory+and+Applications+to+Power+Systems-p-9780471457114 (accessed on 25 April 2020).
  37. An Introduction to Genetic Algorithms; MIT Press: Cambridge, MA, USA, 1998; ISBN 978-0-262-63185-3.
  38. Nandasana, A.; Ray, A.; Gupta, S. Applications of the Non-Dominated Sorting Genetic Algorithm (NSGA) in Chemical Reaction Engineering. Int. J. Chem. React. Eng. 2003, 1. [Google Scholar] [CrossRef]
  39. Deb, K.; Pratap, A.; Agarwal, S.; Meyarivan, T. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 2002, 6, 182–197. [Google Scholar] [CrossRef] [Green Version]
  40. Le, L.; Nguyen, H.; Dou, J.; Zhou, J. A Comparative Study of PSO-ANN, GA-ANN, ICA-ANN, and ABC-ANN in Estimating the Heating Load of Buildings’ Energy Efficiency for Smart City Planning. Appl. Sci. 2019, 9, 2630. [Google Scholar] [CrossRef] [Green Version]
  41. Welcome to Python.org. Available online: https://www.python.org/about/ (accessed on 25 April 2020).
  42. Quan, D.M.; Ogliari, E.; Grimaccia, F.; Leva, S.; Mussetta, M. Hybrid model for hourly forecast of photovoltaic and wind power. In Proceedings of the 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Hyderabad, India, 7–10 July 2013; pp. 1–6. [Google Scholar]
  43. Barbosa de Alencar, D.; De Mattos Affonso, C.; Limão de Oliveira, R.C.; Moya Rodríguez, J.L.; Leite, J.C.; Reston Filho, J.C. Different Models for Forecasting Wind Power Generation: Case Study. Energies 2017, 10, 1976. [Google Scholar] [CrossRef] [Green Version]
  44. Zhao, X.; Wang, S.; Li, T. Review of Evaluation Criteria and Main Methods of Wind Power Forecasting. Energy Procedia 2011, 12, 761–769. [Google Scholar] [CrossRef] [Green Version]
  45. Jais, I.; Ismail, A.; Nisa, S. Adam Optimization Algorithm for Wide and Deep Neural Network. Knowl. Eng. Data Sci. 2019, 2, 41. [Google Scholar] [CrossRef]
  46. Huang, C.-J.; Kuo, P.-H. A Short-Term Wind Speed Forecasting Model by Using Artificial Neural Networks with Stochastic Optimization for Renewable Energy Systems. Energies 2018, 11, 2777. [Google Scholar] [CrossRef] [Green Version]
  47. Mandal, P.; Zareipour, H.; Rosehart, W. Forecasting aggregated wind power production of multiple wind farms using hybrid wavelet-PSO-NNs. Int. J. Energy Res. 2014, 38. [Google Scholar] [CrossRef]
Figure 1. Annual (a) and total (b) installed capacity of wind power [1].
Figure 1. Annual (a) and total (b) installed capacity of wind power [1].
Energies 13 02873 g001
Figure 2. Electricity generation of wind power [2].
Figure 2. Electricity generation of wind power [2].
Energies 13 02873 g002
Figure 3. Proposed feedforward neural network for wind power forecasting [8].
Figure 3. Proposed feedforward neural network for wind power forecasting [8].
Energies 13 02873 g003
Figure 4. Diagram of updating position and velocity parameters of the particle swarm optimization (PSO) algorithm [31].
Figure 4. Diagram of updating position and velocity parameters of the particle swarm optimization (PSO) algorithm [31].
Energies 13 02873 g004
Figure 5. Flowchart of the genetic algorithm [39].
Figure 5. Flowchart of the genetic algorithm [39].
Energies 13 02873 g005
Figure 6. Concept of the Particle Swarm Optimization-Artificial Neural Network (PSO-ANN) hybrid algorithm.
Figure 6. Concept of the Particle Swarm Optimization-Artificial Neural Network (PSO-ANN) hybrid algorithm.
Energies 13 02873 g006
Figure 7. Flowchart of the PSO-ANN hybrid algorithm.
Figure 7. Flowchart of the PSO-ANN hybrid algorithm.
Energies 13 02873 g007
Figure 8. Concept of the Particle Swarm Optimization – Particle Swarm Optimization – Artificial Neural Network (PSO-PSO-ANN) hybrid algorithm.
Figure 8. Concept of the Particle Swarm Optimization – Particle Swarm Optimization – Artificial Neural Network (PSO-PSO-ANN) hybrid algorithm.
Energies 13 02873 g008
Figure 9. Flowchart of the PSO-PSO-ANN hybrid algorithm.
Figure 9. Flowchart of the PSO-PSO-ANN hybrid algorithm.
Energies 13 02873 g009
Figure 10. Concept of the GA-PSO-ANN hybrid algorithm.
Figure 10. Concept of the GA-PSO-ANN hybrid algorithm.
Energies 13 02873 g010
Figure 11. Flowchart of the GA-PSO-ANN hybrid algorithm.
Figure 11. Flowchart of the GA-PSO-ANN hybrid algorithm.
Energies 13 02873 g011
Figure 12. Historical data of the turbine.
Figure 12. Historical data of the turbine.
Energies 13 02873 g012
Figure 13. Mean Absolute Percentage Error (MAPE) indices for 24-time testing.
Figure 13. Mean Absolute Percentage Error (MAPE) indices for 24-time testing.
Energies 13 02873 g013
Figure 14. Mean Square Error (MSE) indices for 24-times testing.
Figure 14. Mean Square Error (MSE) indices for 24-times testing.
Energies 13 02873 g014
Figure 15. Average results of the MAPE for 24-times testing.
Figure 15. Average results of the MAPE for 24-times testing.
Energies 13 02873 g015
Figure 16. The average result of the MSE for 24-times testing.
Figure 16. The average result of the MSE for 24-times testing.
Energies 13 02873 g016
Figure 17. Actual and forecasting wind power (GA-PSO-ANN model) in one day.
Figure 17. Actual and forecasting wind power (GA-PSO-ANN model) in one day.
Energies 13 02873 g017
Figure 18. Actual and forecasting wind power (GA-PSO-ANN model) in one week.
Figure 18. Actual and forecasting wind power (GA-PSO-ANN model) in one week.
Energies 13 02873 g018
Table 1. Values of the particle swarm optimization (PSO) parameters.
Table 1. Values of the particle swarm optimization (PSO) parameters.
ParameterDescriptionValue
winertial weight0.72
c1particle coefficient1
c2swarm coefficient1.5
iteration_maxmaximum iteration2000
r1, r2random numbers[0;1]
n_particlesnumber of particles100
Dsearch space dimension51
Table 2. Error results of the proposed methods compared with the Particle Swarm Optimization – Artificial Neural Network and Adam-Artificial Neural Network.
Table 2. Error results of the proposed methods compared with the Particle Swarm Optimization – Artificial Neural Network and Adam-Artificial Neural Network.
Testing TimeGA-PSO-ANNPSO-PSO-ANNPSO-ANNAdam-ANN
MSEMAPEMSEMAPEMSEMAPEMSEMAPE
10.00114.53%0.00114.58%0.00114.72%0.000576.20%
20.00114.50%0.00114.51%0.00114.65%0.000606.46%
30.00124.53%0.00114.56%0.00135.16%0.000548.30%
40.0014.43%0.00134.59%0.00125.05%0.000536.94%
50.00114.52%0.00114.54%0.00124.93%0.000585.80%
60.00134.54%0.00114.47%0.00114.65%0.000537.00%
70.00134.65%0.00114.58%0.00124.84%0.000546.07%
80.00114.55%0.00114.50%0.00114.56%0.000596.70%
90.00114.53%0.00114.55%0.00144.77%0.000606.85%
100.00124.52%0.00114.42%0.00125.03%0.000576.79%
110.00114.44%0.00114.59%0.00135.37%0.000515.92%
120.00114.48%0.00114.60%0.00114.76%0.000606.59%
130.00124.56%0.00114.54%0.00124.89%0.000556.93%
140.00114.44%0.00114.54%0.00114.58%0.000545.52%
150.00114.51%0.00114.49%0.00125.00%0.000556.51%
160.00114.46%0.00114.53%0.00135.17%0.000606.40%
170.00114.54%0.00114.52%0.00135.36%0.000576.14%
180.00114.53%0.00114.46%0.00124.82%0.000545.52%
190.00114.55%0.00114.62%0.00124.94%0.000567.20%
200.00134.55%0.00134.58%0.00124.89%0.000536.55%
210.00124.57%0.00114.54%0.00135.12%0.000546.27%
220.00124.62%0.00114.53%0.00124.93%0.000556.33%
230.00114.53%0.00114.60%0.00124.73%0.000546.40%
240.00114.48%0.00114.58%0.00124.79%0.000566.09%
Average0.00114.52%0.00114.54%0.00124.90%0.000566.48%
Table 3. Average results of the MSE and MAPE.
Table 3. Average results of the MSE and MAPE.
AlgorithmMAPEMSE
GA-PSO-ANN4.52%0.001139635
PSO-PSO-ANN4.54%0.001117418
PSO-ANN4.90%0.001212124
Adam-ANN7.79%0.001235203
Table 4. Comparison of Mean Absolute Percentage Error (MAPE) among different wind power forecasting models.
Table 4. Comparison of Mean Absolute Percentage Error (MAPE) among different wind power forecasting models.
AlgorithmMAPE
GA-PSO-ANN4.52%
PSO-PSO-ANN4.54%
PSO-ANN4.90%
Adam-ANN7.79%
Persistence11.94%
BP-FFANN7.35%
GA-FFANN6.79%
ANFIS14.92%
WT + ANFIS12.58%
WT + NNPSO8.19%
WT-ACO-FFANN5.35%
VWPF6.85%

Share and Cite

MDPI and ACS Style

Viet, D.T.; Phuong, V.V.; Duong, M.Q.; Tran, Q.T. Models for Short-Term Wind Power Forecasting Based on Improved Artificial Neural Network Using Particle Swarm Optimization and Genetic Algorithms. Energies 2020, 13, 2873. https://0-doi-org.brum.beds.ac.uk/10.3390/en13112873

AMA Style

Viet DT, Phuong VV, Duong MQ, Tran QT. Models for Short-Term Wind Power Forecasting Based on Improved Artificial Neural Network Using Particle Swarm Optimization and Genetic Algorithms. Energies. 2020; 13(11):2873. https://0-doi-org.brum.beds.ac.uk/10.3390/en13112873

Chicago/Turabian Style

Viet, Dinh Thanh, Vo Van Phuong, Minh Quan Duong, and Quoc Tuan Tran. 2020. "Models for Short-Term Wind Power Forecasting Based on Improved Artificial Neural Network Using Particle Swarm Optimization and Genetic Algorithms" Energies 13, no. 11: 2873. https://0-doi-org.brum.beds.ac.uk/10.3390/en13112873

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop