Next Article in Journal
Metal Contamination Distribution Detection in High-Voltage Transmission Line Insulators by Laser-induced Breakdown Spectroscopy (LIBS)
Previous Article in Journal
Design and Implementation of a Novel Polarimetric Active Radar Calibrator for Gaofen-3 SAR
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Future Trend Forecast by Empirical Wavelet Transform and Autoregressive Moving Average

1
School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China
2
Beijing Aerospace Automatic Control Institute, Beijing 100854, China
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Submission received: 7 July 2018 / Revised: 1 August 2018 / Accepted: 7 August 2018 / Published: 10 August 2018
(This article belongs to the Section Physical Sensors)

Abstract

:
In engineering and technical fields, a large number of sensors are applied to monitor a complex system. A special class of signals are often captured by those sensors. Although they often have indirect or indistinct relationships among them, they simultaneously reflect the operating states of the whole system. Using these signals, the field engineers can evaluate the operational states, even predict future behaviors of the monitored system. A novel method of future operational trend forecast of a complex system is proposed in this paper. It is based on empirical wavelet transform (EWT) and autoregressive moving average (ARMA) techniques. Firstly, empirical wavelet transform is used to extract the significant mode from each recorded signal, which reflects one aspect of the operating system. Secondly, the system states are represented by the indicator function which are obtained from those normalized and weighted significant modes. Finally, the future trend is forecast by the parametric model of ARMA. The effectiveness and practicality of the proposed method are verified by a set of numerical experiments.

1. Introduction

With the rapid development of sensor techniques and signal processing, a variety of sensors are arranged in a complicated system to monitor its operational states. Each sensor can obtain a set of measured values and each reflects one side of the running system, for example, temperature, humidity, pressure, etc. However, those parametric values often have close or relaxed relationships among each other. Moreover, they are affected by noise or interference and it is difficult to judge the operating states directly by those simultaneously measured signals. At the same time, the engineers and researchers are no longer satisfied with real-time monitoring of the running states of a complex system. They want to predict the future operational trend according to the current and previous states. Although each sensor records a real signal independently, for simplicity and practicality, it is better to synthesize a comprehensive one called indicator function taking all measured signals into account. Prior to synthesizing the indicator function, random factors and interference in the measured signals must be eliminated effectively. Based on the synthesized indicator function, the future states of the complex system can be forecast reliably.
To forecast the future operational behaviors or states, the autoregressive moving average (ARMA) model can be directly used [1]. ARMA is a high-precision short-term prediction method for time series analysis and offers a simple description for correlated linear, random processes [2,3]. For a linear time-invariant system, the observed data can be expressed by time-series containing historical observations and measurement noise [4]. When using ARMA to fit or predict a signal, an important issue is to estimate the order number of ARMA [5]. ARMA can be considered as the combination of an autoregressive (AR) and a moving averages (MA) model [3,6]. It is more popular than them because it has their advantages simultaneously, although it is more complex than them [7]. In time series prediction, ARMA provides an more effective linear model with the least parameters [8,9,10]. Hence, it is adopted in this paper for the future trend forecast, using the indicator function.
Prior to synthesizing the indicator function, the random noise in the recorded signals should be eliminated [11,12]. Many signal processing techniques have been used, including fast Fourier transform (FFT)-based methods, wavelet transform (WT), empirical mode decomposition (EMD), empirical wavelet transform (EWT) and some improved methods [13,14]. FFT is the most utilized method in extracting features from analyzing stationary signals [13]. However, it is not suitable for nonlinear and non-stationary signals [14]. To overcome the shortcomings of FFT, wavelet transform has been proposed. However, it requires careful selections of the mother wavelet and decomposition levels, in order to obtain a good time-frequency resolution [15,16]. In addition, synchrosqueezed wavelet transform (SWT) can also be used to denoise the acquired dynamic signals reliably [16]. Recently, a methodology based on the SWT, Hilbert transform and Kalman Filter is proposed for parameter identification [15]. Empirical mode decomposition (EMD) is an adaptive data processing method used to extract the mode information of nonlinear and non-stationary time series [17,18,19,20,21]. The major drawback is the lack of explicit mathematical theory and the existence of mode mixing effect [15,16,19]. In particular, EMD may produce too many modes that are difficult to be interpreted [22].
Empirical wavelet transform (EWT) is proposed recently. Compared with EMD, it has a more consistent decomposition and a rigorous theoretical foundations [22,23,24]. It combines the advantages of Fourier analysis and wavelet theory to extract the different modes in a complicated signal [23,25,26]. Yuan et al. applied EWT in modal identification, by combining with the second-order blind identification (SOBI), to improve the identification performance of modal frequencies [22]. Amezquita-Sanchez et al. proposed a new multiple signal classification-empirical wavelet transform (MUSIC-EWT) methodology [27]. It can obtain the individual mono-components according to the actual frequency information [27,28]. In addition, Amezquita-Sanchez et al. used this method to estimate the natural frequencies (NF) and damping ratios (DR) of large structures [28]. Dong et al. also proposed a modified EWT method based on local window maxima (LWM) [29]. It can obtain the meaningful modes by searching the local maxima of the Fourier spectrum in a proper window and determining the boundaries of spectrum segmentations automatically. In this paper, the modified EWT is used to extract the significant modes in the measured signals from a complex system, in order to synthesize the indicator function for future trend forecasts.
The following sections are organized as follows: the main idea and principle of the proposed method is presented and discussed in detail in Section 2. The numerical experiments are performed and their results are discussed briefly in Section 3. Finally, conclusions are drawn in Section 4.

2. The Trend Forecast Method

In engineering and technical fields, there is a special class of signals that are captured from the same complicated system and have close or relaxed relationships among them. With the system running, each signal only reflects one side of the operational states—for example, temperature, humidity, pressure, etc. If we extract the significant modes of all measured signals, we can synthesize an indicator function, which can be applied to forecast the future operational states of the whole system. Prior to getting the reliable significant mode of each measured signal, the random noise or interference must be carefully reduced, i.e., the extracted significant modes are reliable. In order to achieve the above tasks, we propose a novel method that is based on EWT (empirical wavelet transform) and ARMA (autoregressive and moving average model). The block diagram of the approach is shown in Figure 1.
Suppose f 1 , f 2 , , f K are K signals captured from a complex engineering system. Each of them is composed of a set of frequency components. The ith signal f i ( i = 1 , 2 , , K ) not only includes its significant mode, but also contains other frequency components, naturally including various noise. To extract the significant mode in f i , empirical wavelet transform (EWT) is adopted and performed on f i , due to its ability of anti-interference and computation effectiveness. Then, the extracted significant mode g i from f i ( i = 1 , 2 , , K ) is normalized into the interval [ 0 , 1 ] , to eliminate the impacts resulted from the numerical ranges of the measured signals. The normalized result of g i can be denoted as h i , for i = 1 , 2 , , K . After that, all significant modes h 1 , h 2 , , h K are weighted and summed as the indicator function l to reflect the comprehensive operational states of the monitored complex system. Finally, ARMA provides an effective linear model by the least number of coefficients and is performed on the slowly changing l, to reliably predict the future operational states of the complex system. The following subsections will discuss the main ideas above reflected in Figure 1 in detail.

2.1. Extraction of Significant Modes

In general, the captured signals from a complicated system are inevitably affected by random factors and various noise. If a measured signal has multiple disjoint narrow-band components and wide-band noise, the narrow-band component with maximum relative energy can be considered as the significant mode of the original signal. The significant modes can be effectively extracted from all original signals by empirical wavelet transform (EWT) under the conditions of random interference. EWT essentially designs a set of suitable wavelet filters to get several different bands of a signal (each band corresponds to one mode). In particular, the mode is selected as the significant one due to its outstanding energy. At the same time, the other ones are regarded as the interference components and discarded naturally. In EWT, spectrum segmentation is the most important step to obtain different modes [25,26]. It depends on the reliable detection of the local spectrum peaks of the original signal. In classical EWT, the intermediate frequency value between two consecutive spectrum peaks can be seen as their boundary [20,26]. Suppose the spectrum interval [ 0 , π ] of each digital signal is divided into N segments and their boundaries are denoted by ω n ( ω 0 = 0 and ω N = π ). Hence, the empirical wavelet can be constructed by empirical scale function and empirical wavelet function, which are expressed by
Φ ^ n ( ω ) = 1 , | ω | ( 1 γ ) ω n , cos [ π 2 β ( 1 2 γ ω n ( | ω | ( 1 γ ) ω n ) ) ] , ( 1 γ ) ω n | ω | ( 1 + γ ) ω n , 0 , otherwise ,
and
Ψ ^ n ( ω ) = 1 , ( 1 + γ ) ω n | ω | ( 1 γ ) ω n + 1 , cos [ π 2 β ( 1 2 γ ω n + 1 ( | ω | ( 1 γ ) ω n + 1 ) ) ] , ( 1 γ ) ω n + 1 | ω | ( 1 + γ ) ω n + 1 , sin [ π 2 β ( 1 2 γ ω n ( | ω | ( 1 γ ) ω n ) ) ] , ( 1 γ ) ω n | ω | ( 1 + γ ) ω n , 0 , otherwise ,
where γ and β ( x ) are defined by
γ < min n ω n + 1 ω n ω n + 1 + ω n
and
β ( x ) = x 4 ( 35 84 x + 70 x 2 20 x 3 ) , 0 < x < 1 , 0 , x 0 , 1 , x 1 .
Suppose the ith signal f i ( i = 1 , 2 , , K ) is processed by EWT, the approximate coefficients can be obtained by the inner product of the signal and empirical scale function:
W f i ε ( 0 , t ) = f i ( t ) , Φ 1 ( t ) = f i ( τ ) Φ 1 ( τ t ) ¯ d τ = ( f i ^ ( ω ) Φ ^ 1 ( ω ) ¯ ) ˇ , i = 1 , 2 , , K ,
where W f i ε ( 0 , t ) represents the approximate coefficient, Φ 1 ( t ) represents empirical scale function, and f i ( t ) represents the object signal. f i ( t ) , Φ 1 ( t ) represents the inner product of the object signal and the empirical scale function, and f i ^ ( ω ) and Φ ^ 1 ( ω ) represent the Fourier transform results, respectively. The symbol ˇ represents the inverse Fourier transform. Similarly, the detail coefficients of EWT are given by the inner products with the empirical wavelets:
W f i ε ( n , t ) = f i ( t ) , Ψ n ( t ) = f i ( τ ) Ψ n ( τ t ) ¯ d τ = ( f i ^ ( ω ) Ψ ^ n ( ω ) ¯ ) ˇ i = 1 , 2 , , K ,
where W f i ε ( n , t ) represents the n-th detail factor, and Ψ n ( t ) represents the n-th empirical wavelet function. f i ( t ) , Ψ n ( t ) represents the inner product of the object signal and the empirical wavelet function, f i ^ ( ω ) and Ψ ^ n ( ω ) represent the Fourier transform results, respectively.
The i-th signal f i ( t ) can be reconstructed by
f i ( t ) = W f i ε ( 0 , t ) × Φ 1 ( t ) + n = 1 N W f i ε ( n , t ) × Ψ n ( t ) = ( W f i ε ^ ( 0 , ω ) Φ ^ 1 ( ω ) + n = 1 N W f i ε ^ ( n , ω ) Ψ ^ n ( ω ) ) , ˇ
where i = 1 , 2 , , K . Therefore, the n-th empirical modes of each signal can be given by
f i 0 ( t ) = W f i ε ( 0 , t ) × Φ 1 ( t ) ,
f i n ( t ) = W f i ε ( n , t ) × Ψ n ( t ) ,
where i = 1 , 2 , , K denotes i-th measured signal and n = 1 , 2 , , N denotes n-th empirical mode.
In empirical wavelet transform, FFT is applied to calculate the spectrum of the object signal and then the spectrum peaks are employed to determine the boundaries of the different modes. For a noise-contaminated signal, it may result in incorrect boundaries because the spectrum peaks are sensitive to noise and interference. To improve reliability of spectrum segmentation, the modified EWT, which is based on local window maxima (LWM) [29], is adopted to extract the significant mode of the measured signals in this paper. It can reliably detect the local spectrum peaks at the cost of computation. The main idea of the method is to find all local maximum values of the spectrum and determine the global maximum value as the first peak. Then, all spectrum values around the global maximum value are set to zero. The other spectrum peaks can be found successively in that way until the number of spectrum peaks meets the predetermined requirement. The modified EWT (LWM-EWT) are not sensitive to noise and can void incorrect spectrum segmentation.
The anti-interference ability of the modified EWT (LWM-EWT) can be verified by the following example. The simulated signal is expressed as:
X s i g ( t ) = k = 1 5 A k cos ( 2 π H k ( f 0 + η cos ( 2 π f z t ) ) t ) ,
where A k is the k-th value in the amplitude vector A = [ 1.0 , 0.9 , 0.6 , 0.4 , 0.2 ] T . H k is the k-th value of the vector H = [ 1 , 3 , 5 , 9 , 13 ] T , to tune the k-th harmonic frequency. f 0 = 50 Hz, η = 0.04 , f z = 2.1 . The sampling frequency F s = 2000 Hz and sampling time T s = 1.5 s. The spectrum peaks obtained by the classical EWT and LWM-EWT [29] are shown in Figure 2.
From Figure 2, LWM-EWT can effectively detect the five significant components contained in the simulated signal and can avoid the excessive spectrum segmentation. Thus, LWM-EWT is adopted to extract the significant modes from the multiple-component signals captured in a complex system in this paper, in order to to obtain more reliable results.
Supposing that N modes are obtained by EWT performing onto the i-th signal f i ( i = 1 , 2 , , K ), they can be denoted as f i n , for n = 1 , 2 , N . The relative energy values of N modes are calculated by the following equation:
P n = f i n 2 ( t ) d t f i 2 ( t ) d t n = 1 , 2 , , N .
In general, the mode corresponding to the maximum value of relative energy can be considered as the significant one. For a real signal, if five modes are obtained by EWT, their relative energy values are denoted as a vector [ 0.3 , 0.5 , 0.1 , 0.07 , 0.03 ] , then the second mode is considered as the significant one, due to its maximum value.
Suppose K signals are measured from a complex system, for the i-th signal f i , the significant mode g i can be extracted by EWT from f i , according to the relative energy equation expressed in Equation (11), for i = 1 , 2 , , K . Therefore, K significant modes can be obtained and denoted as g i ( i = 1 , 2 , , K ) . The major process of significant mode extraction can be expressed by the following algorithm:
  • Load all K original signals ( f i , i = 1 , 2 , , K ) measured from a complex system.
  • For the i-th signal f i , perform empirical wavelet transform and determine its significant mode g i
    a.
    Set the maximum mode number N i and window length W i , according to prior knowledge.
    b.
    Calculate the magnitude spectrum of the i-th signal by fast Fourier transform (FFT).
    c.
    Use the LWM algorithm to find N i spectrum peaks, using mask window with length W i .
    d.
    Calculate N i 1 boundary values ω n for dividing the spectrum, according to N i peaks.
    e.
    Construct N i empirical wavelets with N i + 1 boundaries, including ω 0 = 0 and ω N = π .
    f.
    Perform the constructed wavelet on f i and obtain N i modes, denoted as f i n , n = 1 , 2 , , N i .
    g.
    For N i modes, calculate the relative energy values, denoted as p n ( n = 1 , 2 , , N i ) .
    h.
    Select the mode with largest relative energy as the significant one g i , corresponding to f i .
  • Execute the above operations until all K significant modes g 1 , g 2 , , g K have been output.

2.2. Synthesize Indicator Function

For a complicated system, suppose K signals f 1 , f 2 , , f K from different sensors (temperature, humidity, pressure, etc.) can be recorded simultaneously. Each measured signal only reflects one side of operational states. To reveal overall operating state, all measured signals must be considered. For simplicity, the significant modes are taken instead of the original signals. To minimize the impacts resulted from the numerical ranges, the values of the significant modes g 1 , g 2 , , g K must be normalized into [0,1]. The normalization process can be represented by
h i = g i min ( g i ) max ( g i ) min ( g i ) ,
where i = 1 , 2 , , K . The values of max ( g i ) and min ( g i ) denote the maximum and minimum of the significant mode g i , respectively. h i denotes the normalized result of g i .
Due to the complex correlating or coupling relationships among the measured signals f 1 , f 2 , , f K , or their significant modes g 1 , g 2 , , g K , we prefer to look for a comprehensive indicator to reveal the operational state of the complex system rather than consider multiple signals simultaneously. For simplicity, the normalized significant modes h 1 , h 2 , , h K are is weighted and summed to make up an indicator function.
l = w 1 h 1 + w 2 h 2 + + w K h K = i = 1 K w i h i ,
where w i represents the i-th weight coefficient corresponding to the normalized significant modes h i , for i = 1 , 2 , , K . In particular, they meet the condition of i = 1 K w i = 1 .
In general, there are two ways to obtain the weight coefficients w 1 , w 2 , , w K in Equation (13): one is to derive the weight coefficients according to the accuracy physical model of the complex system. The other is to use the data-driven method to setup the related empirical formula. However, it is very difficult to determine the weight coefficients by these two methods in practice, due to the fact that there are no explicit mathematical models or available empirical formulas to express complicated relationships among the measured signals. For a specific problem, the field engineers may adjust the weight coefficients based on their prior knowledge. Under some unknown conditions, the weight coefficients can be set to the same, i.e. w 1 = w 2 = = w K = 1 / K . It will lead to it being impossible to accurately describe the relationships among the measurement signals, and then lead to inaccuracies of the indication function and predicted results. If the importance of each signals are known, the weight coefficients must be adjusted correspondingly.

2.3. Forecast Future Trend

On the basis of the indicator function l obtained by (13), we can accurately forecast the trend which reflects the future operational states of the complex system. The autoregressive moving average (ARMA) model is applied to implement this task in this paper. In the theory of ARMA, a measured signal is considered to be a set of random variables that depend on time t. Although the individual value which makes up the signal is uncertain, the changes of the entire signal follow a certain rule that can be approximately described by a mathematic model [3,30]. The core idea of future trend forecasts is to use the extrapolation mechanism constructed by ARMA to obtain the better prediction result. The process of A R M A ( p , q ) can be represented by
l t = i = 1 p φ i l t i + a t + j = 1 q θ j a t j ,
where l t denotes the indicator function l depending on time t. φ i denotes the autoregressive (AR) coefficients at lags i. a t and a t j denote the residual or error terms. θ j denotes the the moving average (MA) coefficients at lags j. p and q denote the number of AR and MA coefficients, respectively.
From (14), the model of A R M A ( p , q ) is a memory system that includes the past states and various noise. That is, the sequential value at the certain moment can be represented by a linear combination of p historical observations and q moving average values of a white noise sequence [4,5]. The AR coefficient φ i ( i = 1 , 2 , , p ) determines the effect of the historical observations, while the MA coefficient θ j ( j = 1 , 2 , , q ) determines the effect of random factors [3,30]. One step ahead prediction can be represented as
l t ( 1 ) = i = 1 p φ i l t + 1 i j = 1 q θ j a t + 1 j .
Similarly, L ( > 1 ) steps ahead forecast is expressed as
l t ( L ) = i = 1 p φ i l t ( L i ) j = 1 q θ j a t + L j .
Before using the A R M A ( p , q ) model, we need to test the stationarity of the indicator function, using the Augmented Dickey–Fuller (ADF) criterion. If it is not stationary, the differential transformation is performed until the transformed result is stationary [1]. Then, we determine the orders of the ARMA model for the minimization of the selected criterion function. The criterion functions include the Final Prediction Error (FPE), Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC), etc.
Another important step is parameter estimation of the ARMA model. In general, the maximum likelihood estimation and the least square estimation can be used to estimate the coefficients of the ARMA model.
In this paper, we determine the parameter ranges of ( p , q ) using the autocorrelation function and the partial autocorrelation function, which are performed onto the indicator function. Then, we test the A R M A ( p , q ) model in the valid ranges of ( p , q ) , from low orders to high ones successively. The appropriate model can be determined finally according to AIC criterion proposed by Akaike [31]. In this way, the forecast values can be calculated by (15) and (16), using the indicator function l and the selected A R M A ( p , q ) model. The final results can be considered as the predicted results, which reflect the future operational states of the monitored complex system. In general, the predicted results are evaluated by the percentage of relative errors:
V e r r o r = l t l t r u e l t r u e × 100 % ,
where l t r u e is the true state value of the complex system.

3. Experimental Results and Analysis

3.1. Future Trend Forecast of Engine State

To verify the effectiveness and practicability of the proposed method in Section 2, we employ the experimental data from the Turbofan Engine Degradation Simulation Data Set that are recorded by several sensors to characterize engine state evolution under different operational conditions [32]. Figure 3 gives the simplified schematic of the 90 K engine. Several sensors are arranged at the High-Pressure Compressor (HPC) to monitor the engine states.
The selected experimental data (from four sensor channels) are shown in Figure 4.
The empirical wavelet transform (EWT) is performed on those data and the transformed results (IMFs—intrinsic mode functions) are shown in Figure 5.
Using the formula shown (11), the relative energy values of all IMFs, decomposed from each sensor, are calculated. According to the calculation result, we can find that the first component (IMF 1 ) has much more energy than other IMFs, for all sensor channels. For each sensor channel, IMF 1 is selected as the significant mode and the other IMFs are considered as random noise or interference. The significant mode IMF 1 and corresponding signal are illustrated in Figure 6.
According to Figure 6, all significant modes coincide with their original signals very well. That is, they contain the main information from the original signal. Prior to synthesizing the indicator function, the significant modes must be normalized to the interval [0,1], in order to minimize the impacts of the numerical ranges of the sensor signals. The normalized results are shown in Figure 7.
According to Figure 7, the indicator function, reflecting the comprehensive behavior of the turbofan engine system, is synthesized by (13) and shown in Figure 8. The weight coefficients are set as the same value for all significant modes because we have no explicit mathematical models or available empirical formulas for the engine system. For any complex systems in practice, it is very difficult to accurately determine those weight coefficients, but the field engineers can moderately adjust the weighted values, based on their prior knowledge and experience.
In Figure 8, the indicator function that characterizes the turbofan engine system states slightly fluctuates around 0.5. That is, the engine system is running smoothly or its operating status has no significant changes. In particular, the waveform of the indicator function depends not only on the rise or fall of the significant modes, but also on their increase or decrease slopes.
In addition, empirical mode decomposition (EMD) can also be applied to extract the significant modes of four signals shown in Figure 4. The EMD results of those signals are shown in Figure 9.
Similarly, we can also determine the first components (IMF 1 ) as the significant modes by using (11). The significant modes and original data are illustrated in Figure 10.
Compared with Figure 6, the significant modes extracted by EWT are a little better than those extracted by EMD. Similarly, we can normalize the significant modes obtained by EMD and synthesize the corresponding indicator function, shown in Figure 11.
According to Figure 11, the indicator functions, obtained by EWT and EMD, are very close to each other. If those indicator functions are applied to forecast the future states of the turbofan engine system, we can obtain similar results.
Based on the indicator function obtained by EWT, shown in Figure 8, the first 200 values are selected as the known data to predict the future values from 201 to 287, using the autoregressive moving average (ARMA) model expressed by (14). The forecast results of the turbofan engine system are shown in Figure 12.
According to Figure 12, the engine system operates normally in the near future (values from 201 to 287) and the forecast trend does not significantly deviate from the actual state curve. The predicted results of this experiment are consistent with the actual situations very well in the short term, although the biases increase over time.

3.2. Trend Forecast of Exchange Rates

The trend forecast approach proposed in Section 2 can be easily extended to a variety of fields, including science, technology, engineering, society, finance, etc. Here, we use the exchange rate data to verify the effectiveness of the proposed method. The adopted exchange rate data of USD/EUR, USD/GBP, USD/JPY and USD/CN are shown in Figure 13.
The empirical wavelet transform (EWT) results of those exchange rate data are shown in Figure 14. Similarly, the relative energy values of IMFs are calculated by (11) and all IMF 1 components are selected as the significant modes. The extracted significant modes and their corresponding exchange rate data are shown in Figure 15. Each significant mode (IMF 1 ) can represent the overall changes of the original exchange rate data. Then, normalized significant modes are shown in Figure 16.
The normalized significant modes, shown in Figure 16, are applied to synthesize the indicator function of the exchange rates, with the same weight coefficients. The synthesized result is shown in Figure 17. Although the normalized significant modes greatly change over time, the synthesized indicator function changes relatively little. This is consistent with the actual economic and financial developments.
According to the indicator function, the comprehensive trend of the exchange rates is forecasted by the ARMA model. The forecast results (from July 2013 to May 2014) are shown in Figure 18. The predicted results are well consistent with the actual exchange rates in the short term. This experiment also shows that the presented method is applied successfully in the finance field.

4. Conclusions

For any complex system in engineering and technical fields, operational state prediction is a very important technique to guarantee safe operation. On the basis of empirical wavelet transform and the autoregressive moving average model, an effective forecast method is proposed and discussed in this paper. For the multiple signals measured from a complex system, their significant modes are extracted reliably, through taking advantage of empirical wavelet transform and relative energy relationships. Those significant modes are very consistent with the original signal, but they have smoother waveforms or higher signal-to-noise-ratio (SNR). To suppress the negative impacts resulting from numerical ranges, those significant modes are normalized, weighted and summed as an indicator function, which reflects the comprehensive operational state over time. According to the simple indicator function, the future running trend of the complex system is reliably predicted by autoregressive moving average technique. The effectiveness and practicability of the presented method have been verified by a set of experiments whose multiple channel signals were recorded from actual complex systems. The experimental results show that the proposed method has been applied successfully in engineering and financial fields. The proposed approach can also be easily extended to science, technical, social and other fields.
To obtain better forecast results of complex systems, the future work related this paper may focus on: (1) improving the robustness of significant component extraction, and (2) enhancing the accuracy of predict methods.

Author Contributions

Conceptualization, Q.W., H.L. and J.L.; Methodology, H.L., Q.W. and C.Z.; Validation, Q.W., H.L. and J.L.; Formal Analysis, C.Z.; Investigation, H.L.; Data Curation, J.L.; Writing—Original Draft Preparation, H.L.; Writing—Review and Editing, Q.W.; Visualization, H.L.; Supervision, Q.W. and J.L.; Project Administration, C.Z.

Funding

This research received no external funding.

Acknowledgments

The authors would like to thank the reviewers and editors for their valuable comments and suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bissoondeeal, R.K.; Binner, J.M. Forecasting exchange rates with linear and nonlinear models. Glob. Bus. Econ. Rev. 2010, 10, 414–429. [Google Scholar] [CrossRef]
  2. Kuersteiner, G.M. Optimal instrumental variables estimation for ARMA models. J. Econom. 2001, 104, 359–405. [Google Scholar] [CrossRef] [Green Version]
  3. Box, G.E.; Jenkins, G.M.; Reinsel, G.C.; Ljung, G.M. Time Series Analysis: Forecasting and Control, 5th ed.; John Wiley and Sons Inc.: Hoboken, NJ, USA, 2015; pp. 199–201. [Google Scholar]
  4. Wu, Z.; Zhao, J.; Li, J.; Zhang, J. Software System for Dynamic Feature Extraction for Structural Health Monitoring. U.S. Patent 998,377,6B1, 29 May 2018. [Google Scholar]
  5. Musafere, F.; Sadhu, A.; Liu, K. Towards damage detection using blind source separation integrated with time-varying auto-regressive modeling. Smart Mater. Struct. 2016, 25, 015013. [Google Scholar] [CrossRef]
  6. Wang, K.; Wu, Y.; Gao, Y.; Li, Y. New methods to estimate the observed noise variance for an ARMA model. Measurement 2017, 99, 164–170. [Google Scholar] [CrossRef]
  7. Kizilkaya, A.; Kayran, A.H. ARMA model parameter estimation based on the equivalent MA approach. Digit. Signal Prog. 2006, 16, 670–681. [Google Scholar] [CrossRef]
  8. Zhang, S.; Liu, R. A rapid algorithm for on-line and real-time ARMA modeling. In Proceedings of the International Conference on Signal Processing, Beijing, China, 21–25 August 2000; pp. 230–233. [Google Scholar]
  9. Martinelli, G.; Orlandi, G.; Burrascano, P. ARMA estimation by the classical predictor. IEEE Trans. Circuits Syst. 1985, 32, 506–507. [Google Scholar] [CrossRef]
  10. Cadzow, J.A. High performance spectral estimation—A new ARMA method. IEEE Trans. Acoust. Speech Signal Process. 1980, 28, 524–529. [Google Scholar] [CrossRef]
  11. Ngo, L.; Lu, B.; Bui, H.; Apon, A.W.; Hamm, N.; Dowdy, L.W.; Hoffman, D.; Brewer, D. Application of Empirical Mode Decomposition to the Arrival Time Characterization of a Parallel Batch System Using System Logs. In Proceedings of the International Conference on Modeling, Simulation and Visualization Methods, Las Vegas, NV, USA, 13–16 July 2009; pp. 300–306. [Google Scholar]
  12. Xie, C.; Mao, Z.; Wang, G.J. Forecasting RMB Exchange Rate Based on a Nonlinear Combination Model of ARFIMA, SVM, and BPNN. Math. Probl. Eng. 2015, 2014, 1–10. [Google Scholar] [CrossRef]
  13. Amezquita-Sanchez, J.P.; Adeli, H. Signal Processing Techniques for Vibration-Based Health Monitoring of Smart Structures. Arch. Comput. Method Eng. 2014, 23, 1–15. [Google Scholar] [CrossRef]
  14. Amezquita-Sanchez, J.P.; Adeli, H. Synchrosqueezed wavelet transform-fractality model for locating, detecting, and quantifying damage in smart highrise building structures. Smart Mater. Struct. 2015, 24, 065034. [Google Scholar] [CrossRef]
  15. Perez-Ramirez, C.A.; Jaen-Cuellar, A.Y.; Valtierra-Rodriguez, M.; Dominguez-Gonzalez, A.; Osornio-Rios, R.A.; Romero-Troncoso, R.J.; Amezquita-Sanchez, J.P. A Two-Step Strategy for System Identification of Civil Structures for Structural Health Monitoring Using Wavelet Transform and Genetic Algorithms. Appl. Sci. 2017, 7, 111. [Google Scholar] [CrossRef]
  16. Perez-Ramirez, C.A.; Amezquita-Sanchez, J.P.; Adeli, H.; Valtierra-Rodriguez, M.; Camarena-Martinez, D.; Romero-Troncoso, R.J. New methodology for modal parameters identification of smart civil structures using ambient vibrations and synchrosqueezed wavelet transform. Eng. Appl. Artif. Intell. 2016, 48, 1–12. [Google Scholar] [CrossRef]
  17. Flandrin, P.; Rilling, G.; Goncalves, P. Empirical mode decomposition as a filter bank. IEEE Signal Process. Lett. 2004, 11, 112–114. [Google Scholar] [CrossRef] [Green Version]
  18. Hong, L. Decomposition and Forecast for Financial Time Series with High-frequency Based on Empirical Mode Decomposition. Energy Procedia 2011, 5, 1333–1340. [Google Scholar] [CrossRef]
  19. Hu, Y.; Li, F.; Li, H.; Liu, C. An enhanced empirical wavelet transform for noisy and non-stationary signal processing. Digit. Signal Prog. 2017, 60, 220–229. [Google Scholar] [CrossRef]
  20. Lahmiri, S. A Variational Mode Decompoisition Approach for Analysis and Forecasting of Economic and Financial Time Series. Expert Syst. Appl. 2016, 55, 268–273. [Google Scholar] [CrossRef]
  21. Jaeger, H.; Haas, H. Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science 2004, 304, 78–80. [Google Scholar] [CrossRef] [PubMed]
  22. Yuan, M.; Sadhu, A.; Liu, K. Condition assessment of structure with tuned mass damper using empirical wavelet transform. J. Vib. Control 2017. [Google Scholar] [CrossRef]
  23. Gilles, J. Empirical Wavelet Transform. IEEE Trans. Signal Process. 2013, 61, 3999–4010. [Google Scholar] [CrossRef]
  24. Zhang, X.; Li, X.; Feng, Y. Image fusion based on simultaneous empirical wavelet transform. Multimed. Tools Appl. 2017, 76, 8175–8193. [Google Scholar] [CrossRef]
  25. Kedadouche, M.; Thomas, M.; Tahan, A. A comparative study between Empirical Wavelet Transforms and Empirical Mode Decomposition Methods: Application to bearing defect diagnosis. Mech. Syst. Signal Proc. 2016, 81, 88–107. [Google Scholar] [CrossRef]
  26. Hu, J.; Wang, J. Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression. Energy 2015, 93, 1456–1466. [Google Scholar] [CrossRef]
  27. Amezquita-Sanchez, J.P.; Adeli, H. A new music-empirical wavelet transform methodology for time–frequency analysis of noisy nonlinear and non-stationary signals. Digit. Signal Prog. 2015, 45, 55–68. [Google Scholar] [CrossRef]
  28. Amezquita-Sanchez, J.P.; Park, H.S.; Adeli, H. A novel methodology for modal parameters identification of large smart structures using MUSIC, empirical wavelet transform, and Hilbert transform. Eng. Struct. 2017, 147, 148–159. [Google Scholar] [CrossRef]
  29. Dong, S.; Yuan, M.; Wang, Q.; Liang, Z. A Modified Empirical Wavelet Transform for Acoustic Emission Signal Decomposition in Structural Health Monitoring. Sensors 2018, 18, 1645. [Google Scholar] [CrossRef] [PubMed]
  30. Dilling, S.; Macvicar, B.J. Cleaning high-frequency velocity profile data with autoregressive moving average (ARMA) models. Flow Meas. Instrum. 2017, 54, 68–81. [Google Scholar] [CrossRef]
  31. Akaike, H. Canonical Correlation Analysis of Time Series and the Use of an Information Criterion. Math. Sci. Eng. 1976, 126, 27–96. [Google Scholar]
  32. Saxena, A.; Goebel, K. “Turbofan Engine Degradation Simulation Data Set”, NASA Ames Prognostics Data Repository. Available online: https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/ (accessed on 18 April 2018).
  33. Frederick, D.K.; Decastro, J.A.; Litt, J.S. User’s Guide for the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS); Technical Report; NASA: Cleveland, OH, USA, 2007.
Figure 1. The schematic diagram of the proposed trend forecast method.
Figure 1. The schematic diagram of the proposed trend forecast method.
Sensors 18 02621 g001
Figure 2. The spectrum peaks founded by the classical EWT and modified EWT (LWM-EWT).
Figure 2. The spectrum peaks founded by the classical EWT and modified EWT (LWM-EWT).
Sensors 18 02621 g002
Figure 3. The simplified schematic of the 90 K engine [33].
Figure 3. The simplified schematic of the 90 K engine [33].
Sensors 18 02621 g003
Figure 4. The selected experimental data from four sensors.
Figure 4. The selected experimental data from four sensors.
Sensors 18 02621 g004
Figure 5. The empirical wavelet transform (EWT) results of four-channel sensor signals.
Figure 5. The empirical wavelet transform (EWT) results of four-channel sensor signals.
Sensors 18 02621 g005
Figure 6. The original signals (black lines) and their significant modes obtained by EWT (blue lines).
Figure 6. The original signals (black lines) and their significant modes obtained by EWT (blue lines).
Sensors 18 02621 g006
Figure 7. The normalized significant modes of four-channel sensor signals.
Figure 7. The normalized significant modes of four-channel sensor signals.
Sensors 18 02621 g007
Figure 8. The indicator functions (solid line) and the normalized significant modes (dotted lines).
Figure 8. The indicator functions (solid line) and the normalized significant modes (dotted lines).
Sensors 18 02621 g008
Figure 9. The empirical mode decomposition (EMD) results of four-channel sensor signals.
Figure 9. The empirical mode decomposition (EMD) results of four-channel sensor signals.
Sensors 18 02621 g009
Figure 10. The original signals (black lines) and their significant modes obtained by EMD (blue lines).
Figure 10. The original signals (black lines) and their significant modes obtained by EMD (blue lines).
Sensors 18 02621 g010
Figure 11. The synthesized indicate functions obtained by EWT (solid line) and EMD (dotted line).
Figure 11. The synthesized indicate functions obtained by EWT (solid line) and EMD (dotted line).
Sensors 18 02621 g011
Figure 12. The forecast results by ARMA (solid line) and actual operational states (dotted line).
Figure 12. The forecast results by ARMA (solid line) and actual operational states (dotted line).
Sensors 18 02621 g012
Figure 13. The original data of four exchange rates (from May 2009 to May 2014).
Figure 13. The original data of four exchange rates (from May 2009 to May 2014).
Sensors 18 02621 g013
Figure 14. The empirical wavelet transform (EWT) results of the exchange rates.
Figure 14. The empirical wavelet transform (EWT) results of the exchange rates.
Sensors 18 02621 g014
Figure 15. The original exchange rate data (black lines) and their significant modes (blue lines).
Figure 15. The original exchange rate data (black lines) and their significant modes (blue lines).
Sensors 18 02621 g015
Figure 16. The normalized significant modes of the exchange rate data.
Figure 16. The normalized significant modes of the exchange rate data.
Sensors 18 02621 g016
Figure 17. The indicator functions (solid line) and the normalized significant modes (dotted lines).
Figure 17. The indicator functions (solid line) and the normalized significant modes (dotted lines).
Sensors 18 02621 g017
Figure 18. The forecast results by ARMA (solid line) and the actual exchange rates (dotted line).
Figure 18. The forecast results by ARMA (solid line) and the actual exchange rates (dotted line).
Sensors 18 02621 g018

Share and Cite

MDPI and ACS Style

Wang, Q.; Li, H.; Lin, J.; Zhang, C. Future Trend Forecast by Empirical Wavelet Transform and Autoregressive Moving Average. Sensors 2018, 18, 2621. https://0-doi-org.brum.beds.ac.uk/10.3390/s18082621

AMA Style

Wang Q, Li H, Lin J, Zhang C. Future Trend Forecast by Empirical Wavelet Transform and Autoregressive Moving Average. Sensors. 2018; 18(8):2621. https://0-doi-org.brum.beds.ac.uk/10.3390/s18082621

Chicago/Turabian Style

Wang, Qiusheng, Haipeng Li, Jinyong Lin, and Chunxia Zhang. 2018. "Future Trend Forecast by Empirical Wavelet Transform and Autoregressive Moving Average" Sensors 18, no. 8: 2621. https://0-doi-org.brum.beds.ac.uk/10.3390/s18082621

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop