Next Article in Journal
Information Acquisition for Product Design in a Green Supply Chain
Next Article in Special Issue
Metamorphoses of Earnings in the Transport Sector of the V4 Region
Previous Article in Journal
Four Boundary Value Problems for a Nonlocal Biharmonic Equation in the Unit Ball
Previous Article in Special Issue
Time-Varying Causalities in Prices and Volatilities between the Cross-Listed Stocks in Chinese Mainland and Hong Kong Stock Markets
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Coherence Coefficient for Official Statistics

by
Danutė Krapavickaitė
Department of Mathematical Statistics, Vilnius Gediminas Technical University, Saulėtekio al. 11, LT-10223 Vilnius, Lithuania
Submission received: 30 January 2022 / Revised: 28 March 2022 / Accepted: 31 March 2022 / Published: 3 April 2022
(This article belongs to the Special Issue Time Series Analysis and Econometrics with Applications)

Abstract

:
One of the quality requirements in official statistics is coherence of statistical information across domains, in time, in national accounts, and internally. However, no measure of its strength is used. The concept of coherence is also met in signal processing, wave physics, and time series. In the current article, the definition of the coherence coefficient for a weakly stationary time series is recalled and discussed. The coherence coefficient is a correlation coefficient between two indicators in time indexed by the same frequency components of their Fourier transforms and shows a degree of synchronicity between the time series for each frequency. The usage of this coefficient is illustrated through the coherence and Granger causality analysis of a collection of numerical economic and social statistical indicators. The coherence coefficient matrix-based non-metric multidimensional scaling for visualization of the time series in the frequency domain is a newly suggested method. The aim of this article is to propose the use of this coherence coefficient and its applications in official statistics.

1. Introduction

Signals are information carriers; a speech signal delivers semantic meanings, traffic signals give instructions or directions, brain signals reflect the intent of the subject, etc. Signals are often converted to other signals through a certain conversion system. When an input signal is applied, we cannot observe the response associated with that input; we are always faced with a certain amount of additional noise on the output. The relationship between two signals is measured by the coherence coefficient, which is defined as a cross-spectral density between these signals divided by the product of auto-spectral densities of each of them. It can be viewed as a squared correlation between Fourier transformation components of these signals at the same frequency [1,2]. The coherence coefficient gets a value of 1 in the case of a perfect linear relationship between the Fourier components, and a value of 0 for no linear relationship and all values in between [3]. If a small stone is dropped on a still water surface, we see waves of the same length and periodicity. It is said in wave physics that two waves are coherent if they have the same permanent wave length and frequency and their phase difference is constant [4]. For example, waves A and B in Figure 1 are coherent, but none of them is coherent with wave C, which has a different changeable frequency.
Coherent sources of light are sources of light that emit waves which have zero or constant phase difference and same the frequency. Incoherent sources are sources of light that emit waves which have random frequencies and phase differences. The coherence coefficient gives an answer when measuring the degree of coherence of light waves and signal input/output.
The concept of coherence is used in many fields of science, official statistics being one of them. As stated in Principle 14 of the European Statistics Code of Practice [5], official “statistics are internally coherent and consistent”. Consistency means validity of the arithmetic and accounting identities. At first sight, it looks like this meaning of coherence is completely different from the concept of coherence used in physics. In this paper, we will try to reveal similarities in these two understandings and propose to include a numerical measure of coherence to official statistics. Let us look at how different institutions understand coherence. According to the OECD Glossary [6], coherence of statistics is their suitability to be reliably combined for various aims and in different ways. Statistics may originate from a single source. In that case, their coherence means the possibility to combine elementary concepts correctly in more complex ways and for various aims. Statistics may originate from different sources and from statistical surveys of different frequencies. In that case, their coherence means the usage of common definitions, classifications and methodological principles. Consistency is understood simply as a separate aspect of coherence.
The Statistics Canada Quality Guidelines [7] state that coherence of statistical information means the degree to which it can be reliably aggregated and compared with other statistical information by methodological principles and over time. How should this degree be measured? The quality indicators for coherence are proposed in this document as adequacy to the “regional and international standards for statistical methods” and the reasons why some effects in statistical information cannot be fully explained by accuracy are listed. As we see, it is proposed to describe coherence only verbaly, and no numerical measure for the “degree to which statistical information can be reliably combined” is proposed.
The Australian Bureau of Statistics affirms that coherence refers to the internal consistency of data at a fixed time point and over time, and to its comparability with other sources of information [8].
Various aspects of coherence are presented and discussed in the Eurostat’s Handbook for Quality Reports [9] including coherence across domain, in sub-annual and annual statistics, in national accounts, as well as internal coherence. The Handbook mentions that preferably, a quantitative assessment of the possible effects in the statistical output results should be included in the statistical Quality Report. However, no coherence measures are proposed. From this we can see that, in official statistics, coherence is mainly about outputs.
It is felt that coherence in official statistics means similar trends in the indicator, and can therefore be compared with the waving situation in physics. At the same time, there is an observable difference between the concept of coherence in wave physics and in official statistics. Nevertheless, there is a clearly observable aspiration in official statistical documentation to measure the degree of coherence, even if it is not known how to do it yet. Indeed, there have been attempts, found in the official statistics literature, to measure coherence numerically.
The contents of the article are as follows. Section 2 includes an overview of the studies in the quantitative assessment of coherence in official statistics. The definition of the coherence coefficient is restated in Section 3. The fields of its application—time series causality and non-metric multidimensional scaling—are also presented in Section 3. The application of these methods for economic and social time series is given in Section 4. The article ends with conclusions and a list of references. The dataset used is presented in the Table A1.
The concept of the coherence coefficient was included by the author in the Final Report of the project Komuso [10] and Workshop paper [11].

2. Literature Overview of the Coherence Assessment in Official Statistics

The coherence of statistics across programmes has been investigated in several studies. Till-Tentschert [12] discusses the coherence assessment in the European Union Statistics on Income and Living Conditions (EU-SILC) at Statistics Austria. The distribution of annual gross employee income according to the EU-SILC 2005 and wage tax statistics 2004 are compared using their distributions by percentile. A conclusion is made about the high coherence (visually) for the number of income recipients. Comments are made about the difference of these distributions. One of the important conclusions is that coherence assessment stimulates critical quality assessment. As regards said paper, we would like to remark that the statistical hypothesis about the coincidence of two distributions can be tested by means of statistical test in order to get a more reliable conclusion on coherence (for example, by means of a two-sample Kolmogorov–Smirnov test).
Three examples are given for reconciling the Labour Force Survey (LFS) data with national accounts, with the results of industrial surveys of large establishments, and with administrative data on registered job seekers by the African Development Bank [13]. The essence of these examples is the decomposition of the coverage of the indicators into subsets with the aim to find the same subset covered by both indicators, the same definitions of the variables used, and to compare their values. The differences are expected to depend only on random fluctuations. It is shown in the document that the trends in employment and production follow the same pattern. If, according to LFS, employment increases, then an increase in production is expected in the national accounts. Correspondingly, if the LFS results show a decline in the level of employment, it should be followed by a decline in the level of production in the national accounts. This consideration reveals a comparison of the trends in the time series.
The population size in population statistics and the population size estimates based on the data from the European Union LFS (EU-LFS) usually differ due to the different coverage (EU-LFS covers only private households). Both statistics refer to certain dates: population statistics refer to January 1 or mid-year for the population level and characteristics, and the EU-LFS statistics generally refer to the average quarterly or annual situation. 15–64-year-old population size levels and their relative differences in two different datasets by country are presented by Eurostat [14].
The differences in employment statistics in the EU-LFS and business statistics are discussed in three aspects: different scope, different coverage, and different units. Levels, their differences and relative differences by country are presented by Eurostat [14].

3. Coherence of the Time Series

Wiener, 1930 [15], starts his article emphasising the close analogy between the problems of the harmonic analysis of light and the hidden periods found by the statistical analysis in the data sets such as of meteorology and astronomy. He pays attention to the “extremely valuable theory of the periodogram”. He subsequently points out the usefulness of the correlation matrices for statistical analysis and the need for statistical methods to study the time series. Finally, Wiener comes to a conclusion that the role of coherence matrices for the time series should be the same as the role of correlation matrices for frequency series. In his paper, he introduced the coherence coefficient of the time series, and we will follow this path, applying the methods proposed in Shumway and Stoffer [16], and Wei [17].

3.1. Stationary Time Series

Let us consider a real-valued time series x 1 , x 2 , , x n . It is called a weakly stationary time series if x t is a finite variance process such that its mean value function μ t = E x t is constant and does not depend on time t, and its covariance function, γ x ( s , t ) = E [ ( x t μ ) ( x s μ ) ] , s , t > 0 , depends on s and t only through their difference h = | s t | , and is denoted by γ x ( h ) = γ x ( t + h , t ) . A covariance of a weakly stationary time series does not depend on time. Henceforth, we will further use the term stationary to mean weak stationarity. It can be observed that V a r ( x t ) = γ x ( 0 ) .
A discrete Fourier transform for the time series x 1 , x 2 , , x n is defined as
d ( ω j ) = 1 n t = 1 n x t e 2 π i ω j t = 1 n t = 1 n x t ( cos ( 2 π ω j t ) i sin ( 2 π ω j t ) )
for j = 0 , 1 , 2 , , n 1 and i = 1 ([16] p. 69). Frequencies ω j = j / n are called Fourier frequencies, or fundamental frequencies. This transformation is one-to-one, and the inverse discrete Fourier transform allows to express the time series as
x t = 1 n j = 0 n 1 d ( ω j ) e 2 π i ω j t ,   t = 1 , 2 , , n .
The inverse Fourier transform expresses stationary time series as a sum of n periodic components which are not observable directly. Periodic components have unequal amplitudes, and the component with a higher amplitude | d ( ω j ) | plays a greater role in the Fourier transform.
The periodogram for time series x 1 , x 2 , , x n is defined as a squared modulus of the Fourier transform:
I ( ω j ) = | d ( ω j ) | 2 ,   j = 0 , 1 , 2 , , n 1 .
The periodogram allows us to compare the role of each component in the transform. We will use it in the next section. The scaled periodogram is
P ( j / n ) = 4 n I ( ω j ) = 1 n | 2 d ( ω j ) | 2 ,
(Ref. [16], p. 70, (2.46) formula), j = 0 , 1 , 2 , , n 1 . It is proven in Shumway [16], that if x t is stationary with the auto-covariance function γ ( h ) = E [ ( x t + h μ ) ( x t μ ) ] , then there exists a unique monotonically increasing function F ( ω ) , called a spectral distribution function, which is bounded, with F ( ) = F ( 1 / 2 ) = 0 , and F ( ) = F ( 1 / 2 ) = γ ( 0 ) such that
γ ( h ) = 1 / 2 1 / 2 e 2 π i ω h d F ( ω ) .
A more important situation we use repeatedly is the one covered by Theorem C.3 [16], where it is shown that, subject to absolute sumability of the auto-covariance, the spectral distribution function is absolutely continuous with d F ( ω ) = f ( ω ) d ω . The function f ( ω ) is called spectral density function.

3.2. Jointly Stationary Time Series

Two time series x t and y t are called jointly stationary if each of them is stationary and their cross-covariance function γ x y ( s , t ) = E [ ( x s μ x ) ( y t μ y ) ] depends only on the time difference | t s | , and γ x y ( t + h , t ) = γ x y ( h ) , t 0 . The cross-correlation function of jointly stationary time series x t and y t is defined as
ρ x y ( h ) = γ x y ( h ) γ x ( 0 ) γ y ( 0 ) , h > 0 .
It has properties: 1 ρ x y ( h ) 1 , ρ x y ( h ) = ρ x y ( h ) .
It is proven in Shumway [16] that, for jointly stationary time series, their cross-covariance function can be expressed as
γ x y ( h ) = 1 / 2 1 / 2 f x y ( ω ) e 2 π i ω h d ω , < t < ,
where the cross-spectrum f x y ( ω ) is defined as the Fourier transform
f x y ( ω ) = h = γ x y ( h ) e 2 π i ω h , 1 / 2 ω 1 / 2 ,
assuming that the cross-covariance function is absolutely sumable. The cross-spectrum f x y ( ω ) is generally a complex-valued function.

3.3. Coherence Coefficient

For the discrete finite time series x 1 , x 2 , , x n and y 1 , y 2 , , y n , we have ω = j / n , j = 0 , ± 1 , , ± [ n / 2 ] ,
γ x y ( h ) = 1 n j = [ n / 2 ] [ n / 2 ] f x y ( j / n ) e 2 π i j h / n , γ x y ( 0 ) = 1 n j = [ n / 2 ] [ n / 2 ] f x y ( j / n ) ,
f x y ( j / n ) = h = [ n / 2 ] [ n / 2 ] γ x y ( h ) e 2 π i j h / n .
We propose the application of the cross-spectrum as a measure of strength of the relationship of two time series in their Fourier transform components.
Definition. The sample coherence coefficient in frequency ω between two time series x t and y t is defined as
c o h x y 2 ( ω ) = | f x y ( ω ) | 2 f x x ( ω ) f y y ( ω )
where f x y ( ω ) is the cross-covariance (cross-spectral density) of two time series, and f x x ( ω ) , f y y ( ω ) are the auto-correlation (power spectral density functions) of x t and y t , respectively.
It is a square of the correlation coefficient between the ω frequency component of x t and the ω frequency component of yt (Wei, [17]). The properties of the coherence coefficient follow the correlation coefficient properties:
  • | coh x y 2 ( ω ) | 1
  • | coh x y 2 ( ω ) | = 1 means that the time series are perfectly correlated or linearly related at frequency ω;
  • | coh x y 2 ( ω ) | = 0 means that the time series are totally uncorrelated at frequency ω;
  • coh x y 2 ( ω ) = coh y x 2 ( ω ) means symmetry in x and y at frequency ω.
Coherence measures the degree of linear dependency of two time series indexed by the same frequency components. If two time series correspond to each other linearly perfectly at a given frequency, the magnitude of coherence is 1 at that frequency. If they are totally linearly unrelated, coherence will be 0 at that frequency. The coefficient (3) is sometimes called “ordinary coherence” [18]; it can be calculated for any arbitrary time series xt and yt. Its value indicates how much one time series is linearly related to the other time series at the fixed frequency, and this relationship does not mean any causal relationship.
Much research has been carried out to study the coherence coefficient. Papana [19] analyses connectivity measures in multivariate high dimensional systems and classifies them into two broad groups, namely symmetric and directional measures. Coherence and the Pearson correlation coefficient are assigned to the group of non-directional connectivity measures. An algorithm with the commonness between the cluster members measured by coherence is presented in [20]. It shows much better performance than the other methods compared. Coherence-based time series clustering is also used to study brain connectivity [21]. Foster and Guinzy in [22] wrote that, as an estimate of this parameter, most geophysicists have used the “sample coherence” (as given in (3)). They have found that the “Goodman distribution provides a means of constructing estimates of the true coherence, which are better than the widely used sample coherence”. Generalization of the coherence coefficient is extended to continuous time stationary weakly ergodic random processes [18]. Koopmans [23] has defined the coefficient of coherence for bivariate weakly stationary stochastic processes and “provided a justification for the already common use of the coefficient of coherence as a measure of linear-regression for pairs of correlated, weakly stationary time series”. This directs us to the other root of the coherence research connected with causality.

3.4. Coherence and Causality

Besides the common definition of coherence, we present its property which is included in many research works due to its possibility to measure causality in multivariate models. The basics of this connection is presented in the article by Granger [24]. Let us assume there are two jointly weakly stationary time series x t , yt, t = 1, 2, …, n, with zero means. The simple causal model is expressed:
y t = j = 1 m a j y t j + j = 1 m b j x t j + η t ,
x t = j = 1 m c j x t j + j = 1 m d j y t j + ε t ,
here ε t , η t are uncorrelated white noise time series with zero means, V a r ( ε t ) = σ ε 2 , V a r ( η t ) = σ η 2 , t = 1 , 2 , , n , a j , b j , c j , d j are constants, j = 1 , 2 , , m , m is a positive integer, usually less than n . If at least one coefficient b j 0 , j = 1 , 2 , , m , then it is said that the time series x t is a Granger cause for time series yt, and model (4) is called an unrestricted model. Otherwise, if b j = 0 for all j = 1 , 2 , , m , then the time series xt is not the Granger cause for the time series yt and model (4) is called a restricted model. The same applies to model (5) with the roles of the variables xt and yt exchanged. If at least one coefficient d j 0 , j = 1 , 2 , , m , then it is said that the time series yt is a Granger cause for time series xt, and it is not so if all dj = 0. We see, that the only lags are on the right hand side of Equations (4) and (5). It follows from (4) that if xt is the Granger cause for the time series yt, then y t can be predicted using the past values of xt. In order to test the existence of the Granger causality between the time series, the F test is used. Under the null hypothesis of no causality, it compares the unrestricted model where yt is explained by the lags of yt and lags of xt with the restricted model where y t is explained only by lags of y t . The fact that x t is a Granger cause of y t is denoted by x t y t . The reverse relationship in connection with (5) is also used: x t y t . If both these events occur, it is said that there is a feedback relation between the time series x t and y t .
Let us introduce notations:
a = a ( e i ω ) = j = 1 m a j e i ω j , b = b ( e i ω ) = j = 1 m b j e i ω j ,
c = c ( e i ω ) = j = 1 m c j e i ω j , d = d ( e i ω ) = j = 1 m d j e i ω j ,
Δ = | ( 1 a ) ( 1 d ) b c | 2 .
Granger showed [24] that in the case of causality, the cross-spectrum of the time series xt and yt can be written as a sum of two components:
f x y ( ω ) = f x y ( 1 ) ( ω ) + f x y ( 2 ) ( ω ) ,
f x y ( 1 ) ( ω ) = σ ε 2 2 Δ π ( 1 d ) c ¯ ,   f x y ( 2 ) ( ω ) = σ η 2 2 Δ π ( 1 a ¯ ) b .
If xt is not a Granger cause for yt, then the first of these components equals zero: f x y ( 1 ) ( ω ) = 0 ; and if yt is not a Granger cause for xt, then the second component equals zero: f x y ( 2 ) ( ω ) = 0 . If xt is the Granger cause for y t , then the coherence coefficient is defined as
c o h x y ( ω ) = | f x y ( 1 ) ( ω ) | 2 f x x ( ω ) f y y ( ω )   for   x t y t .
Its size shows the strength of the Granger causality x t y t against frequency ω and is called causality coherence. The coefficient c o h x y ( ω ) for x t y t is defined in the same way. From this it follows that: if x t is not the Granger cause for yt and yt is not the Granger cause for xt, then the coherence coefficient c o h x y ( ω ) should be zero. For an estimated coherence coefficient, it may not be exactly so. We will apply Granger causality to the economic and social time series in Section 4.3.
Granger causality has many applications in various fields of science. Statistical criteria have been developed to test causality in frequency domains, applied to cointegrated systems, the large sample properties of the test studied [25]. The coherence coefficient and Granger causality were considered in oceanography [26]; long-term coherence statistics reduced the misclassification of forests as urban; short-term coherence statistics reduced the misclassification of low vegetation in forests in [27].
To focus specifically on the temporal dimension of interactions between the brain regions, Granger causality and coherence were used in [28]. Brain functional connectivity was studied in [29].

3.5. Coherence and Multivariate Data Analysis

Correlation matrices are the starting point for many multivariate analysis methods. We observe that a similar situation arises with the ordinary coherence coefficient matrices. In the case of multivariate time series, the principal component analysis is used to reduce dimensionality, and a coherence coefficient matrix is used as a measure of proximity of the relationship between the variables in the frequency domain [30,31]. The canonical correlation analysis may be used to study the association between two signal groups in the frequency domain using coherence coefficients instead of correlation coefficients [32,33]. In this case it would be worth renaming the method as “canonical coherence analysis”. The set of coherence definitions is widened by introducing block coherence, multiple coherence, intra-block coherence, and partial block coherence—to measure the interdependence between multidimensional time series [34].
Along with other coherence matrix-based multivariate time series methods, such as principal component analysis [30,31] and canonical correlation analysis [32,33], a collection of multivariate analysis methods for time series is supplemented here by introducing a new version of a multidimensional scaling method in frequency domain based on the coherence matrix. Multidimensional scaling is a group of methods that project multidimensional data to a low (usually two) dimensional space and preserve the interpoint distances among data as much, as possible.
Let us have number K discrete finite weakly jointly stationary time series x 1 ( k ) , x 2 ( k ) , , x n ( k ) , k = 1 , 2 , , K (or K-dimensional time series) for which the Fourier transforms (2) are defined, the expressions for cross-covariance and cross-spectral density are as follows
γ k l ( h ) = 1 n j = [ n / 2 ] [ n / 2 ] f x ( k ) x ( l ) ( j / n ) e 2 π i j h / n , f k l ( j / n ) = h = [ n / 2 ] [ n / 2 ] γ k l ( h ) e 2 π i j h / n ,
j = 0 , ± 1 , , ± [ n / 2 ] , and coherence coefficients for k , l = 1 , 2 , , K , are denoted:
c o h k l 2 ( ω ) = | f k l ( ω ) | 2 f k k ( ω ) f l l ( ω ) .
Coherence matrices are recorded for all frequencies:
G ( ω ) = ( 1 c o h 12 2 ( ω ) c o h 1 K 2 ( ω ) c o h 21 2 ( ω ) 1 c o h 2 K 2 ( ω ) c o h K 1 2 ( ω ) c o h K 2 2 ( ω ) 1 ) .
The aim of multidimensional scaling is to produce a map of time series in the frequency domain, rather directly on the data. A distance matrix or a dissimilarity matrix is used instead. In the case of distance matrix multidimensional scaling is called metric; for this purpose, Euclidean or Manhatan distances may be used. In the case of dissimilarity matrix, multidimensional scaling is called non-metric. The values of the ranking variable matrix may play the role of the dissimilarity matrix. The coherence matrix is a similarity matrix, however, if we extract each of its terms from the unit, we obtain the following dissimilarity matrix:
G ˜ ( ω ) = ( 0 1 c o h 12 2 ( ω ) 1 c o h 1 K 2 ( ω ) 1 c o h 21 2 ( ω ) 0 1 c o h 2 K 2 ( ω ) 1 c o h K 1 2 ( ω ) 1 c o h K 2 2 ( ω ) 0 ) .
Any element of this matrix will be close to zero, if it belongs to the perfectly linearly correlated and synchronised time series components at frequency ω and vice versa: the high value of the matrix G ˜ ( ω ) element corresponds to unsynchronised time series components.
For the sake of simplicity let us denote the elements of the dissimilarity matrix G ˜ ( ω ) by δ k l , k , l = 1 , 2 , , K . They are symmetric in their indexes: δ k l = δ l k . Let us fix at the beginning one frequency ω and denote by X the m-dimensional space to which K -dimensional time series at frequency ω should be projected. Let d = d ( X ) = { d k l ( X ) , 0 < k < l K } be a set of coordinates in the space X to which dissimilarities δ k l are projected (dissimilarities with symmetric indices are not included). The coordinates d k l = d k l ( X ) should be chosen in such a way, that the distance (defined in a certain way) between d k l and δ k l is minimal. This is done not directly, but rather converting dissimilarities δ k l into disparities d ^ k l by ranking dissimilarities:
if   δ k l < δ r s   then   d ^ k l d ^ r s ,   k , l , r , s = 1 , 2 , , K ,   k < l ,   r < s
A normalized stress function, defined by the equation
S m ( X ) = k < l ( d ^ k l d k l ( X ) ) 2 k < l d k l 2 ( X )
from ref. [35], is used as a criteria to find the solution. The vector of coordinates d ^ = d ^ ( X ) = { d ^ k l ( X ) , 0 < k < l K } which minimises the stress function S m ( X ) provides a solution to the multidimensional scaling problem. A certain iterative process is used for the minimization of the stress function. If min d ( X ) S m ( X ) 0.05 , then the point of the minimum of the stress function is considered as appropriate. In the case of a two-dimensional space X ( m = 2 ) the dissimilarities in the matrix G ˜ ( ω ) are projected into the distances on the plane X. So, the multidimensional scaling is a method of visualisation of the time series: by presenting a sequence of multivariate projections of the multivariate time series for subsequent frequencies we are able to observe the change of multivariate time series following the frequency change. The plot of the time series components by points in the X space allows classifying these components for each frequency.
A variety of variants available for multidimensional scaling of variables [36] can be transformed in order to be used for the time series based on the coherence matrix.

4. Experimental Results

4.1. Data Used for the Study

Let us see how the coherence coefficient works for the indicators produced by official statistics.
A dataset of quarterly aggregated statistics from different statistical surveys conducted by Statistics Lithuania in 2008–2021 and certain administrative data sources [37] are used for this case study. The dataset is presented in Table A1. It consists of 53 quarterly observations, ending with the 1st quarter of 2021. The seven indicators studied are as follows:
  • Labour Force Survey variables: number of employed persons (LFSE); number of the unemployed (LFSU), in thousand;
  • Labour Remuneration Survey data: number of employees (Emp), in thousand; enterprise resources for remuneration (RRS), in EUR million;
  • Labour Exchange Office data: number of the registered unemployed (ExU), in thousand;
  • Administrative data of the State Social Insurance Fund Board: enterprise remuneration from which taxes are paid (RSI), in EUR million; Average wages and salaries of employees, excluding individual enterprises (average remuneration), in EUR (REM).
These time series are represented in Figure 2 using two vertical axes. The left-side vertical axis is for the indicators meaning the number of individuals (Emp, LFSU, ExU, LFSE) and average wages and salaries (REM). The right-side vertical axis is for the indicators expressed in EUR million (RSI, RRS).
The indicators have been chosen in order to ensure their diversity for further analysis. Figure 2 shows similar trends in the pairs of time series: the number of employed persons (LFSE) from the Labour Force Survey and the number of employees (Emp) from the Labour Remuneration Survey; the number of the unemployed (LFSU) from the Labour Force Survey and the number of the registered unemployed (ExU) from the Labour Exchange Office. These two pairs of indicators match each other well: as the number of employed persons increases, the number of the unemployed decreases, and vice versa. It would seem that they satisfy the definition of coherence provided in the OECD Glossary [6]. However, the coherence of the time series is not about their trends. Rather, it is about the linear dependency between the components of the Fourier transforms of the stationary time series corresponding to the same frequency.

4.2. Data Analysis for Ordinary Coherence

The data series used for this study are not stationary according to the augmented Dickey–Fuller test for the unit root [38]. In order to reach their stationarity, the third-order polynomial trend is excluded from the two time series of the unemployed, and the second-order polynomial trend is excluded from the remaining five time series using the least squares method. The standardised residuals are presented in Figure 3. Unfortunately, only three detrended time series have been recognized as stationary by the augmented Dickey–Fuller test: Emp (p = 0.08), RSI (p = 0.03), and RRS (p = 0.03). Some long-period waves can be observed in certain graphs of detrended and standardized time series in Figure 3, and they may determine the declination of the detrended time series from stationarity.
Signal processing researchers also face the problem of non-stationarity. One of the ways to wriggle out of this difficulty is to divide the signals into short time blocks, so as to capture the time dependency and, by restricting the signal to each of the individual blocks, enable it to be considered stationary (i.e., a pseudo-stationary approach). Then, one of the methods valid for stationary signals is applied to each block (Gonzales [39]). Our detrended time series are short: too short to be divided into the blocks. So, let us further assume that all of them are stationary.
Periodograms—squared coefficients of the periodic components in the time series Fourier representation against frequencies—for all of the time series are calculated, and their graphs are presented in Figure 4. The R program function spec.pgram (R stats package [40]) with the nonparametric smoothing of the sample periodogram is used [16]. A modified Daniell kernel is used for this purpose.
All of the periodograms show high spectrum values corresponding to low frequencies. They inform us about the importance of the corresponding periodic components in the Fourier representation. Since we have quarterly data, we can expect to find in our time series periods equal to several years or 4k quarters, k = 1,2, …. One-, two-, four- or eight-year cycles correspond to the frequencies ω = 1 / 4 k : 0.25, 0.125, 0.0625, 0.03275. Therefore, we see periodogram peaks for low frequencies and the eight-year cycle in some graphs of Figure 4. We also see a small peak in the periodogram at the obvious yearly cycle for the frequency ω = 0.25. It is a natural cycle in our quarterly data, and most of our further attention will be directed towards it.
Some visualisations of the coherence coefficients are presented in Figure 5. Squared coherence is presented for frequencies 0 ω 0.5 . It is drawn in a black solid line. The 0.95-level confidence interval for the coherence coefficient is drawn in dashed blue lines. The hypothesis about the equality of the coherence coefficient to 0 is tested by the approximate F test [16] and is rejected for the coherence coefficient greater than c = 0.226 with the significance level α = 0.01. The dashed black horizontal line on the graph means that the values of the coherence coefficient lower than c for any frequency are insignificant. Our interest lies mostly with the frequency ω = 0.25 , and a vertical line is drawn at this frequency in order to address the reader to the value of the squared coherence at this frequency.
Figure 5 shows quite high coefficients of coherence for the frequencies ω ≤ 0.25 between the two indicators of unemployment ExU and LFSU, and between the indicators of the registered unemployed (ExU) and enterprise remuneration from which taxes are paid (RSI). The number of the registered unemployed (ExU) from the Labour Exchange Office and the number of employed persons (LFSE) from the Labour Force Survey have a significant coefficient of coherence only for ω = 0.25. Meanwhile, the indicators of enterprise remuneration from which taxes are paid (RSI) from the State Social Insurance Fund Board and average wages and salaries of employees (REM) do not have a significant coherence coefficient for all frequencies.
All of the coherence coefficients of the indicators studied at frequency ω = 0.25 are presented in Table 1. Insignificant coefficients with the significance level α = 0.01 are taken into brackets. The indicator of average wages and salaries of employees (REM) does not have any significant coefficient of coherence with all of the indicators studied. A very high coefficient of coherence (0.985) is observed between RRS (enterprise resource for remuneration) and RSI (enterprise remuneration from which taxes are paid), that is, between survey data and administrative source data.

4.3. Data Analysis for Granger Causality

In order to satisfy an assumption on weakly stationary time series for the causality study, the initial variables were standardised and the second-order differences from the standardised variables were extracted. According to the augmented Dickey Fuller test with the significance level α = 0.05 all of the resulting variables become weakly stationary (Figure 6).
The lag size m included in (4), (5) is estimated applying Schwarz information criteria [41]. For almost all variables this statistic reaches its minimum value at m = 4 . Therefore, the Granger causality is tested with this lag value m = 4. The hypothesis H0: xt is not the Granger cause for yt against the alternative H 1 : x t y t is tested by an approximate F test using F(m,n-(2m + 1)) statistics. The results are presented in Table 2. Its lower left triangle includes coherence coefficients. The upper right triangle includes the results of the Granger causality test. It includes in each cell the value of the empirical test statistics F, p-value and arrow. This arrow from left to right means that the indicator on the line is a cause for the indicator in the column. The arrow from the right to the left means that the column indicator is a cause for the line indicator.
Ordinary coherence coefficients for ω = 0.25 are presented in Table 2. Logical Granger causality cases are observed: the number of employed persons estimated based on the Labour Force Survey data is a Granger cause for the number of the unemployed estimated in the same survey; average wages and salaries is a cause for the resources for remuneration. It is seen that there is feedback relation between two indicators: RSI and RR, and their coherence coefficient is high for both methods. Let us compare the following results:
  • LFSE ⟹ LFSU, c o h 2 ( LFSU , LFSE | ω = 0.25 ) = 0.577 ;
  • Emp ⟹ ExU, c o h 2 ( Emp , ExU | ω = 0.25 ) = 0.354 .
In these cases the hypothesis about no Granger causality is rejected, and coherence coefficients between the variables are also significant. Other cases:
3.
Emp ⟹ RSI, c o h 2 ( Emp , RSI | ω = 0.25 ) = 0.0765 ;
4.
Emp ⟹ RSE, c o h 2 ( Emp , RSE | ω = 0.25 ) = 0.0720 .
In the last cases, coherence coefficients are not significant despite the fact that the hypothesis about no Granger causality is rejected. Now let us compare coherence coefficients with the corresponding ones in Table 1:
5.
c o h 2 ( LFSU , LFSE | ω = 0.25 ) = 0.347 ;   c o h 2 ( Emp , ExU | ω = 0.25 ) = 0.466 ;
6.
c o h 2 ( Emp , RSI | ω = 0.25 ) = 0.497 ;   c o h 2 ( Emp , RSE | ω = 0.25 ) = 0.5 .
The estimated coefficients in Case 5 can be compared with the corresponding coefficients in cases 1 and 2. However, Case 6 differs from cases 3 and 4.
Two methodological approaches have been proposed to estimate ordinary coherence coefficient. The results of the coherence coefficient estimation have similarities, but there are also differences. Lack of the stationarity in the first case may be one of the reasons. Despite the fact that the time series in both cases have the same origin, they are different, which may be another reason for certain differences in the values of coherence coefficients. We see that an unambiguous conclusion about coherence coefficient estimation in both cases cannot be drawn. The validity of the Granger causality does not necessarily mean that the coherence coefficient is significant.

4.4. Visualization of the Time Series

We will visualise seven time series described in Section 3.5 by applying multidimensional scaling. The four frequencies chosen are presented in Table 3.
Multidimensional scaling is implemented for the time series under study to visualize them on a plane (the dimension of the coordinate space X is m = 2 ) and the four frequencies chosen. The value of the normalised stress function reached in the iterative procedure equals 0.009, which means satisfactory accuracy of the coordinates obtained. The projections of the time series to the two-dimensional space for selected frequencies are shown in Figure 7.
Each of the univariate time series is represented by a blue dot in a two-dimensional space. Rays connect these points with the origin point (0, 0). The proximity of the dot positions means the level of synchronicity of the time series at that frequency. Case 1 shows high synchronicity in two time series of the number of employed persons; two time series on resources for remuneration are also close. Two time series on the number of the unemployed are less synchronised than the previous pairs. Definitions of unemployed person in LFSU and ExU differ, and this difference is reflected in most of the cases of the Figure 7. Case 2 shows less synchronicity in the time series for employment, but perfect synchronicity in the resources for remuneration. Case 3, which corresponds to one-year period, demonstrates complete synchronicity between employment and remuneration, as well as between the time series on unemployment. The time series on average wages and salaries is separated from others in all cases. Case 4 corresponds to the period of 7.5 months, which is impossible in these time series, and the corresponding picture shows a mixture: no synchronicity between the time series on employed persons.

4.5. Software

All of the calculations are carried out with the R v. 4.1.2 software [39].
The coefficients of the second and third order polynomial trends in time series are estimated by the least squares method using the function polyfit, and the trend itself is calculated by the function polyval, both from the package pracma.
The evaluation of the presence of the unit roots in the time series and checking for their stationarity is tested by the augmented Dickey Fuller test using the function adf.test in the package tseries.
The function spec.pgram from the package stats is used to calculate the periodograms of the weakly stationary time series by the fast Fourier transform. The same function is used to smoothen the coherence with a modified Daniel smoother (using nine terms for the moving average method half interval and giving half of the weight to the smoothing interval end values), and to test the hypothesis about the significance of coherence using Fisher statistics.
The number of lags for the causality model is tested by the Schwarz’s SC statistic implemented in the function VARselect of the package vars. The Wald test for the frequency domain-based Granger causality of the time series is realized in the function grangertest of the package lmtest.
The function isoMDS of the R package MASS is used to implement multidimensional scaling.

5. Discussion

The problem of coherence has arisen to the author due to its unmeasurable usage in official statistics. The coherence of statistical output in official statistics is a very wide concept. Any of its aspects may have different measures to assess coherence strength: cross-domain, sub-annual, and annual statistics; in national accounts, internal, geographical, and over time. In the present article, a measure for coherence strength of social and economic indicators in time—a coherence coefficient known and used in other fields of science–is recalled.
The coherence coefficient is a correlation coefficient between the Fourier transforms of two statistical indicators indexed by the same frequency. It gives an undiluted measure of linear dependency of a swing in two weakly-stationary time series due to the specified frequency. This coefficient shows the level of synchrony between the Fourier transforms of the time series of the same frequency. The article reminds the definition of the ordinary coherence coefficient. The coherence matrix may show numerically meaningful relationships between the economic time series in specific frequencies, such as frequencies, corresponding to a one-year period. Besides, some examples of methods are given. One of them is a widely explored feature of the coherence to measure the strength of the causal effect between jointly weekly stationary time series, Granger causality [26,27,28,29], and it is demonstrated in the simulation study. This property can be applied in the construction of econometric models.
Coherence matrix is often used as a starting point for multivariate analysis of time series in a similar way as correlation matrix is used for multivariate analysis of random variables. Several publications illustrating this are noticed further. Principal component analysis is applied to the coherence matrix [30,31] for dimensionality reduction. Principal components analysis is applied to the cross-spectral density matrix, and coherence coefficients are calculated for the obtained principal components in [42]. A new electroencephalography coherence approach named magnitude squared coherence based on weighted canonical correlation analysis is proposed in [32]. It improves the accuracy in coherence estimation. A coherent change detection scheme using canonical correlation analysis to determine the linear dependence between the canonical coordinates of the input channels is explored in [43]. Coherence matrix-based metric is defined in [44] and used for hierarchical clustering of the random processes and to multivariate analysis of high frequency stock market values [45] since it is able to detect any possible linear relation between two times series, even at different time instants.
One of the aims of this article is to extend a range of multivariate analysis methods used together with the coherence matrix. Multidimensional scaling is a multivariate data visualisation method in a low dimensional space. This method for large genomic data set is applied in [46]. A standard Euclidean distance is used to measure the dissimilarity of the gene groups, and the main difficulty in the solution of this problem is high dimensionality of the data set. The authors in [47] study a musical opus from the point of view of three mathematical tools; multidimensional scaling is one of them. The method is applied based on two alternative metrics: the average mutual information and the fractal dimension. The results reveal significant differences in the musical styles, demonstrating the feasibility of the proposed strategy.
We propose a multidimensional scaling method of multivariate time series in frequency domain. The coherence coefficient matrix is used as a similarity matrix between the time series in the frequency domain for non-metric multidimensional scaling. This method allows following the visual changes in the time series due to the frequency change. The method may be applied to the time series classification. It can be further developed in order to improve the accuracy of the visual representation of the time series, especially for the high dimensional case. Time series visualization is studied also in [48]. Frobenius norm, generalized correlation coefficient between two matrices, principal component analysis similarity factor is used to construct the similarity measure between the time series themselves. The Fourier transform to the time series is not applied. Our proposal is new.
A matrix of ordinary coherence coefficients may serve as a basic matrix of association among the time series in frequency for other methods of multivariate analysis.
The ordinary coherence coefficient with possible applications is proposed for the usage in official statistics for quality assessment and deeper analysis of the statistical results.

Funding

This research received no external funding.

Data Availability Statement

Data for the case study have been compiled from the indicators presented on the Official Statistics Portal, managed by Statistics Lithuania (https://osp.stat.gov.lt/, accessed on 20 January 2022), and are included in Appendix A.

Acknowledgments

The author thanks the editors and anonymous referees for their comments and suggestions, which helped to significantly improve the article.

Conflicts of Interest

The author declares no conflict of interest.

Appendix A

Table A1. Data set for the case study [37].
Table A1. Data set for the case study [37].
YearQuarterExULFSULFSEEmpRSIRRSREM
2008176,24774.21416.31,225,579623.12,308,808,3592,363,109,444
2008268,37768.51432.11,225,139647.82,406,414,1742,461,320,556
2008369,05690.21445.81,217,387671.92,461,575,8442,519,700,890
2008479,839120.21414.21,182,155671.72,344,094,3702,448,874,661
20091150,867183.41329.91,153,522635.22,133,829,1742,184,921,227
20092193,005210.91321.61,105,870629.22,022,994,1192,066,057,345
20093216,797211.81329.81,069,554620.41,920,387,3081,973,800,770
20094251,803236.51288.31,035,599613.51,820,404,8311,869,016,244
20101298,039272.21221.91,029,803588.31,727,789,4931,774,727,272
20102324,468273.71231.01,031,499595.41,772,0245581,819,986,665
20103319,943270.51261.51,038,689602.91,818,575,2811,860,114,000
20104306,016265.31276.21,037,375614.41,861,967,6611,905,767,899
20111303,692255.11232.91,059,600600.01,840,842,4911,871,739,022
20112246,707232.91262.21,080,333610.41,938,042,3831,975,212,406
20113221,274221.31260.71,094,869612.81,982,452,8662,024,025,178
20114217,134202.81258.71,090,185629.92,025,371,5212,072,390,439
20121242,059212.71251.41,101,293619.21,985,074,5882,025,141,063
20122216,475196.51284.11,113,460623.72,046,589,5742,091,059,274
20123205,422185.51298.01,117,600628.82,078,963,3462,128,180,667
20124203,537192.51269.41,110,714646.42,124,877,6172,173,804,073
20131229,502191.21267.21,126,036646.72,122,599,7942,165,028,897
20132197,661171.81297.11,138,652652.52,196,084,2392,252,422,898
20133185,739159.61308.21,147,276667.72,265,256,5372,321,432,196
20134192,387167.21298.61,140,335677.82,278,247,3152,327,255,164
20141206,079183.41295.31,161,133670.72,264,769,3932,309,649,474
20142167,988165.51309.21,175,198682.32,353,632,6632,402,902,573
20143157,944135.41349.21,177,126696.72,401,668,9202,446,552,234
20144160,011147.81322.41,169,402714.52,448,904,4782,493,322,593
20151171,767145.81317.51,194,723699.82,424,880,4322,473,235,328
20152154,516138.01336.31,204,611713.92,524,677,5562,586,979,303
20153151,583122.51347.41,204,198735.12,606,122,1132,669,476,792
20154154,745129.51338.51,194,923756.92,655,432,5712,716,650,174
20161165,882122.51350.81,210,243748.02,635,907,8962,687,204,050
20162139,980119.11367.71,219,175771.92,766,639,3272,821,945,721
20163134,454111.01368.71,217,086793.32,857,993,2122,911,196,395
20164139,141112.01358.41,210,342822.82,937,353,9902,994,475,146
20171153,495117.71345.31,222,378817.62,900,763,2042,957,958,651
20172133,083102.21362.81,230,629838.73,045,375,3233,129,433,254
20173132,57495.51358.81,226,833850.83,092,979,2113,164,580,713
20174139,30897.11352.31,222,817884.83,190,590,1643,269,956,131
20181162,200103.91347.11,230,548895.23,212,311,0313,273,567,722
20182143,08286.01370.91,235,994926.73,408,966,2393,481,541,119
20183144,22282.91404.91,237,430935.73,460,961,5893,537,412,644
20184154,43087.41376.01,234,872970.33,561,459,0733,647,635,020
20191155,92195.11374.01,250,7231262.73,601,427,8713,671,909,464
20192138,46990.21382.21,260,3401289.03,757,034,2133,858,893,280
20193137,01388.91378.11,260,5751317.63,847,743,6443,940,044,105
20194150,46993.71379.41,256,3621358.63,941,919,6914,036,791,146
20201169,436106.31386.41,271,0021381.03,995,577,2324,074,616,070
20202208,074125.91351.51,245,6381398.53,867,650,3303,964,444,596
20203243,271137.21342.31,244,4551454.84,172,921,1274,268,937,946
20204277,119134.51352.41,248,6811524.24,357,386,1704,436,727,466
20211259,800108.81351.81,263,4411517.44,363,643,3774,448,379,003

References

  1. Li, F.F.; Cox, T.J. Digital Signal Processing in Audio and Acoustical Engineering; CRC Press: Boca Raton, FL, USA, 2019. [Google Scholar]
  2. Cohen, D.; Tsuchiya, N. The Effect of Common Signals on Power, Coherence and Granger Causality: Theoretical Review, Simulations, and Empirical Analysis of Fruit Fly LFPs Data. Front. Syst. Neurosci. 2018, 12, 30. [Google Scholar] [CrossRef] [PubMed]
  3. Sun, F.T.; Miller, L.M.; D’Esposito, M. Measuring interregional functional connectivity using coherence and partial coherence analyses of fMRI data. NeuroImage 2004, 21, 647–658. [Google Scholar] [CrossRef] [PubMed]
  4. Kock, W.E. Wave Coherence. In Engineering Applications of Lasers and Holography; Springer: Boston, MA, USA, 1975. [Google Scholar]
  5. Eurostat. European Statistics Code of Practice, 2nd ed.; Eurostat: Luxembourg, 2017; Available online: https://ec.europa.eu/eurostat/web/products-catalogues/-/KS-02-18-142 (accessed on 8 January 2022).
  6. OECD. Glossary of Statistical Terms. Available online: https://stats.oecd.org/glossary/ (accessed on 8 January 2022).
  7. Statistics Canada. Statistics Canada Quality Guidelines, 6th ed.; Statistics Canada: Ottawa, ON, Canada, 2019; pp. 14–15. Available online: https://www150.statcan.gc.ca/n1/pub/12-539-x/12-539-x2019001-eng.htm (accessed on 8 January 2022).
  8. Australian Bureau of Statistics. Available online: https://www.abs.gov.au/ (accessed on 8 January 2022).
  9. Eurostat. ESS Handbook for Quality Reports; Eurostat: Luxembourg, 2014; Available online: http://ec.europa.eu/eurostat/web/ess/-/the-ess-handbook-for-quality-reports-2014-edition (accessed on 8 January 2022).
  10. European Commission. ESSnet on Quality of Multisource Statistics—Komuso; Eurostat: Luxembourg, 2019; Available online: https://ec.europa.eu/eurostat/cros/content/essnet-quality-multisource-statistics-komuso_en/ (accessed on 8 January 2022).
  11. Pankūnas, V.; Janeiko, J.; Krapavickaitė, D. Coherence studies in time series. In Proceedings of the Workshop of Baltic-Nordic-Ukrainian Network on Survey Statistics, Jelgava, Latvia, 21–25 August 2018; pp. 66–69. Available online: http://www.statistikuasociacija.lv/workshop2018/files/papers/BNU2018-Pank%C5%ABnas-and-Janeiko.pdf (accessed on 3 March 2022).
  12. Till-Tentschert, U. Coherence Assessment of EU-SILC in Austria, 2006. In Proceedings of the Conference and Methodological Workshop “Comparative EU Statistics on Income and Living Conditions: Issues and Challenges”, Finland, Helsinki, 6–8 November 2006; Available online: https://www.stat.fi/eusilc/ws_5-2_till.pdf (accessed on 8 January 2022).
  13. African Development Bank. Labour Force Data Analysis: Guidelines with African Specificities; African Development Bank: Tunis, Tunisia, 2012; pp. 92–97. Available online: https://www.afdb.org/fileadmin/uploads/afdb/Documents/Publications/Labour%20Force%20Data%20Analysis_WEB.pdf (accessed on 8 January 2022).
  14. Eurostat. Quality Report of the European Union Labour Force Survey 2015; Eurostat: Luxembourg, 2017; pp. 28–32. Available online: http://ec.europa.eu/eurostat/documents/7870049/7887033/KS-FT-17-003-EN-N.pdf/22ed8f4e-9eb3-455c-924a-8df102620f89 (accessed on 8 January 2022).
  15. Wiener, N. Generalized harmonic analysis. Acta Math. 1930, 55, 117–258. [Google Scholar] [CrossRef]
  16. Shumway, R.H.; Stoffer, D.S. Time Series Analysis and Its Applications: With R Examples; Springer: Berlin/Heidelberg, Germany, 2006. [Google Scholar]
  17. Wei, W.W.S. Time Series Analysis: Univariate and Multivariate Methods; Pearson Education: London, UK, 2006. [Google Scholar]
  18. Bendat, J.S.; Piersol, A.G. Random Data. Analysis and Measurement Procedures; Wiley-Interscience: Hoboken, NJ, USA, 2010. [Google Scholar]
  19. Papana, A. Connectivity Analysis for Multivariate Time Series: Correlation vs. Causality. Entropy 2021, 23, 1570. [Google Scholar] [CrossRef] [PubMed]
  20. Yue, J.; Takaahara, G.; Franczak, B.; Burr, W.S. Time Series Clustering using Coherence. In Proceedings of the 2nd International Conference on Statistics: Theory and Applications (ICSTA’20), Prague, Czech Republic, 19–21 August 2020. [Google Scholar] [CrossRef]
  21. Euán, C.; Sun, Y.; Ombao, H. Coherence-based time series clustering for statistical inference and visualization of brain connectivity. Ann. Appl. Stat. 2019, 13, 990–1015. [Google Scholar] [CrossRef] [Green Version]
  22. Foster, M.R.; Guinzy, N.J. The Coefficient of Coherence: Its estimation and Use in Geophysical Data Processing. Geophysics 1967, 32, 602–616. [Google Scholar] [CrossRef]
  23. Koopmans, L.H. On the Coefficient of Coherence for Weakly Stationary Stochastic Processes. Ann. Math. Stat. 1964, 35, 532–549. [Google Scholar] [CrossRef]
  24. Granger, C.W. Investigating causal relations by econometric models and cross-spectral methods. Econometrica 1969, 37, 424–438. [Google Scholar] [CrossRef]
  25. Breitung, J.; Candelon, B. Testing for short- and long-run causality: A frequency-domain approach. J. Econom. 2006, 132, 363–378. [Google Scholar] [CrossRef]
  26. Contreras-Reyes, J.E.; Hernández-Santoro, C. Assessing Granger-causality in the southern Humboldt current ecosystem using cross-spectral methods. Entropy 2021, 22, 1071. [Google Scholar] [CrossRef]
  27. Borlaf-Mena, I.; Badea, O.; Tanase, M.A. Assessing the Utility of Sentinel-1 Coherence Time Series for Temperate and Tropical Forest Mapping. Remote Sens. 2021, 13, 4814. [Google Scholar] [CrossRef]
  28. Kayer, A.S.; Sun, T.C.; D’Esposito, M. A Comparison of Granger causality and Coherency in fMRI-Based Analysis of the Motor System. Hum. Brain Mapp. 2009, 30, 3475–3494. [Google Scholar]
  29. Faes, L.; Erla, S.; Porta, A.; Nollo, G. A framework for assessing frequency domain causality in physiological time series with instantaneous effects. Philos. Trans. R. Soc. A 2013, 371, 20110618. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Liu, Z.; Song, C.; Cai, H.; Yao, X.; Hu, G. Enhanced coherence using principal component analysis. Interpretation 2017, 5, T351–T359. [Google Scholar] [CrossRef]
  31. Le, N.; Song, S.; Zhang, Q.; Wang, R. Robust principal component analysis in optical micro-angiography. Quant. Imaging Med. Surg. 2017, 7, 654–667. Available online: https://qims.amegroups.com/article/view/17862 (accessed on 8 January 2022). [CrossRef] [PubMed] [Green Version]
  32. Cui, D.; Qi, S.; Gu, G.; Li, X.; Li, Z.; Wang, L.; Yin, S. Magnitude Squared Coherence Method based on Weighted Canonical Correlation Analysis for EEG Synchronization Analysis in Amnesic Mild Cognitive Impairment of Diabetes Mellitus. IEEE Trans. Neural Syst. Rehabil. Eng. 2018, 26, 1908–1917. [Google Scholar] [CrossRef]
  33. Zhao, Y.; Wachowski, N.; Azimi-Sadjadi, M.R. Target Coherence Analysis Using Canonical Correlation Decomposition for SAS Data. In Proceedings of the OCEANS 2009, Biloxi, MS, USA, 26–29 October 2009. [Google Scholar] [CrossRef]
  34. Nedungadi, A.G.; Ding, M.; Rangarajan, G. Block coherence: A method for measuring the interdependence between two blocks of neurobiological time series. Biol. Cybern. 2011, 104, 197–207. [Google Scholar] [CrossRef]
  35. Borg, I.; Groenen, P.J.F. Modern Multidimensional Scaling; Springer: Berlin/Heidelberg, Germany, 2005. [Google Scholar]
  36. Dzemyda, G.; Kurasova, O.; Žilinskas, J. Multidimensional Data Visualization, Methods and Applications; Springer: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  37. Statistics Lithuania: Official Statistics Portal. Available online: https://osp.stat.gov.lt/ (accessed on 20 January 2022).
  38. Dickey, D.A.; Fuller, W.A. Distribution of the estimates for autoregressive time series with a unit root. J. Am. Stat. Assoc. 1979, 74, 427–431. [Google Scholar]
  39. Gomez Gonzalez, A.; Rodrıguez, J.; Sagartzazu, X.; Schuhmacher, A.; Isasa, I. Multiple coherence method in time domain for the analysis of the transmission paths of noise and vibrations with non-stationary signals. In Proceedings of the ISMA2010 International Conference on Noise and Vibration Engineering including USD2010; Sas, P., Bergen, B., Eds.; Katholieke Universiteit Leuven: Leuven, Belgium, 2010; pp. 3927–3942. [Google Scholar]
  40. The Comprehensive R Archive Network. Available online: https://cran.r-project.org/ (accessed on 8 January 2022).
  41. Schwarz, G. Estimating the dimension of a model. Ann. Stat. 1978, 6, 461–464. [Google Scholar] [CrossRef]
  42. Huang, Y.; Fergusson, N. Principal component analysis of the cross-axis apparent mass nonlinearity during whole-body vibration. Mech. Syst. Signal Process. 2021, 146, 107008. [Google Scholar] [CrossRef]
  43. Tesfaye, G.-M.; Tucker, J.D. Canonical correlation analysis for coherent change detection in synthetic aperture Sonar Imagery. Inst. Acoust. Proc. 2010, 32, 117–122. [Google Scholar]
  44. Innocenti, G.; Materassi, D. Econometrics as Sorcery. Statistical Finance (q-fin.ST). arXiv 2008, arXiv:0801.3047. [Google Scholar] [CrossRef]
  45. Materassi, D.; Innocenti, G. Coherence-based multivariate analysis of high frequency stock market values. arXiv 2008, arXiv:0805.2713. [Google Scholar] [CrossRef]
  46. Tzeng, J.; Lu, H.H.S.; Li, W.H. Multidimensional scaling for large genomic data sets. BMC Bioinform. 2008, 9, 179. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Lima, M.F.M.; Machado, J.A.T.; Costa, A.C. A Multidimensional Scaling Analysis of Musical Sounds Based on Pseudo Phase Plane. Abstr. Appl. Anal. 2012, 2012, 436108. [Google Scholar] [CrossRef] [Green Version]
  48. Bernatavičienė, J.; Dzemyda, G.; Bazilevičius, G.; Medvedev, V.; Marcinkevičius, V.; Treigys, P. Method for visual detection of similarities in medical streaming data. Int. J. Comput. Commun. Control 2015, 10, 8–21. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Coherent and incoherent waves.
Figure 1. Coherent and incoherent waves.
Mathematics 10 01159 g001
Figure 2. Time series studied.
Figure 2. Time series studied.
Mathematics 10 01159 g002
Figure 3. Time series after the exclusion of polynomial trends and standardization.
Figure 3. Time series after the exclusion of polynomial trends and standardization.
Mathematics 10 01159 g003
Figure 4. Periodograms.
Figure 4. Periodograms.
Mathematics 10 01159 g004
Figure 5. Visualisations of coherence coefficients (in black) and their 0.95-level confidence interval (in blue).
Figure 5. Visualisations of coherence coefficients (in black) and their 0.95-level confidence interval (in blue).
Mathematics 10 01159 g005
Figure 6. Stationary time series.
Figure 6. Stationary time series.
Mathematics 10 01159 g006
Figure 7. Projections of time series to two-dimensional space for frequencies given in Table 3.
Figure 7. Projections of time series to two-dimensional space for frequencies given in Table 3.
Mathematics 10 01159 g007
Table 1. Coherence matrix at frequency ω = 0.25 .
Table 1. Coherence matrix at frequency ω = 0.25 .
ExULFSULFSEEmpRSIRRSREM
ExU1.000
LFSU0.5811.000
LFSE0.4820.3471.000
Emp0.466(0.159)0.5901.000
RSI0.5130.3120.5730.4971.000
RRS0.5170.3170.5900.5050.9851.000
REM(0.186)(0.054)(0.034)(0.045)(0.154)(0.145)1.000
Table 2. Coherence and causality at frequency ω = 0.25.
Table 2. Coherence and causality at frequency ω = 0.25.
ExULFSULFSEEmpRSIRRSREM
ExU1 F = 4.0304
p = 0.0080
F = 2.2583
p = 0.0808
LFSU0.57771F = 2.9724
p = 0.0313
F = 3.598
p = 0.0139
LFSE0.54580.55091
Emp0.3540(0.2115)0.27651F = 2.4902
p = 0.0593
F = 2.7536
p = 0.0418
RSI(0.1235)(0.1462)0.2609(0.0765)1F = 2.9798
p = 0.0310

F2.1892
p = 0.0886
F = 2.4902
p = 0.0593
RRS(0.2144)(0.2125)0.3209(0.0720)0.95541F = 2.7536
p = 0.0418
REM(0.0190)(0.0049)(0.0533)(0.0082)(0.0209)(0.0125)1
Table 3. Frequency choice for visualisation of the time series.
Table 3. Frequency choice for visualisation of the time series.
CaseFrequency ωPeriod T = 1 / ω
( Quarters   of   the   Year )
Meaning
10.07413.53 years
20.1297.752 years
30.2414.151 year
40.42.57.5 months
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Krapavickaitė, D. Coherence Coefficient for Official Statistics. Mathematics 2022, 10, 1159. https://0-doi-org.brum.beds.ac.uk/10.3390/math10071159

AMA Style

Krapavickaitė D. Coherence Coefficient for Official Statistics. Mathematics. 2022; 10(7):1159. https://0-doi-org.brum.beds.ac.uk/10.3390/math10071159

Chicago/Turabian Style

Krapavickaitė, Danutė. 2022. "Coherence Coefficient for Official Statistics" Mathematics 10, no. 7: 1159. https://0-doi-org.brum.beds.ac.uk/10.3390/math10071159

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop