Next Article in Journal
Application of Biological Domain Knowledge Based Feature Selection on Gene Expression Data
Previous Article in Journal
Analysis on the Development of Digital Economy in Guangdong Province Based on Improved Entropy Method and Multivariate Statistical Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Measuring the Coupling Direction between Neural Oscillations with Weighted Symbolic Transfer Entropy

1
School of Information Science and Engineering (School of Software), Yanshan University, Qinhuangdao 066004, China
2
Hebei Key Laboratory of Information Transmission and Signal Processing, Yanshan University, Qinhuangdao 066004, China
3
Beijing Institute of Functional Neurosurgery, Capital Medical University, Beijing 100053, China
4
State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
*
Author to whom correspondence should be addressed.
Submission received: 9 November 2020 / Revised: 13 December 2020 / Accepted: 16 December 2020 / Published: 21 December 2020

Abstract

:
Neural oscillations reflect rhythmic fluctuations in the synchronization of neuronal populations and play a significant role in neural processing. To further understand the dynamic interactions between different regions in the brain, it is necessary to estimate the coupling direction between neural oscillations. Here, we developed a novel method, termed weighted symbolic transfer entropy (WSTE), that combines symbolic transfer entropy (STE) and weighted probability distribution to measure the directionality between two neuronal populations. The traditional STE ignores the degree of difference between the amplitude values of a time series. In our proposed WSTE method, this information is picked up by utilizing a weighted probability distribution. The simulation analysis shows that the WSTE method can effectively estimate the coupling direction between two neural oscillations. In comparison with STE, the new method is more sensitive to the coupling strength and is more robust against noise. When applied to epileptic electrocorticography data, a significant coupling direction from the anterior nucleus of thalamus (ANT) to the seizure onset zone (SOZ) was detected during seizures. Considering the superiorities of the WSTE method, it is greatly advantageous to measure the coupling direction between neural oscillations and consequently characterize the information flow between different brain regions.

1. Introduction

Neural oscillations are rhythmic patterns of electrical activity produced by the interaction of neurons in the nervous system [1], which are the fundamental mechanism to achieve coordinated activities in the brain [2,3,4]. The oscillations are ubiquitously observed in mammalian brains and involved in a variety of brain operations, including visual attention [5,6], memory formation [7,8], and stimulation processing [9,10]. Although it is relatively easy to observe the modulation of neural oscillations, what role they play in neural information processing is still unclear [11,12,13]. A noteworthy feature of neural oscillations is the specific coupling between different frequency rhythms [14,15]. The coupling between neural oscillations is of crucial importance in the communication across areas of the brain and the integration of information [16,17]. It may take a variety of forms, appear in different areas, and support distinct functions [18,19]. The integrated functions of the brain, such as vision and hearing, require the cooperation of several spatially separated brain regions [20,21]. Therefore, a reliable estimate of this cooperation is essential to reveal the functional connectivity between brain regions. Many methods have been introduced to analyze electrophysiological recordings and quantify the coupling strength between neural oscillations in different brain regions [22], such as likelihood synchronization [23], coupling analysis [24], and nonlinear interdependence measures [25]. However, most of them focus on the strength of pairwise interactions (i.e., the degree of similarity or dissimilarity between two neural oscillations).
In fact, the coupling direction is also of great significance to characterizing the interaction between neuronal oscillations [26]. One of the frequently used methods is the Granger causality, which evaluates the directionality by measuring the effect of historical information of one time series on the prediction error of future moments in another time series [27,28,29,30]. According to previous studies, the Granger causality method is statistically significant and can be successfully applied to linear models, but it only gives qualitative analysis results and cannot be applied to nonlinear models directly [31]. Other prevailing methods used to estimate the coupling direction are mostly based on information theory, such as conditional mutual information [32] and transfer entropy [33,34]. These methods measure the information provided by the sourcing process on the state transitions in the target process, characterizing the non-linear causality between time series [35]. However, they generally require a large amount of data and are prone to be affected by the noise. Therefore, a technique of symbolization based on phase space reconstruction and permutations has been applied to improve the performance of these information-based methods. Typical examples are permutation conditional mutual information [36,37] and symbolic transfer entropy [38,39]. Considering that the construction of a symbolized sequence ignores the amplitude information in the original data and reduces the impact of larger fluctuations in the time series on the results [40,41,42,43], we used weighted probability to calculate the joint distribution of the permutation motifs and consequently obtain the symbolic transfer entropy based on the weighted probability distribution. The proposed method to measure the coupling direction is termed weighted symbolic transfer entropy (WSTE) in this study. We compared WSTE and STE by using a neural mass model, and the results of the new method showed that WSTE was significantly better than STE at detecting the directionality index, even in noisy data. Moreover, to test the validity, we used the proposed method to analyze the epileptic electrocorticography (ECoG) recorded from a patient with epilepsy. The results indicated a significant coupling direction from the thalamus to the cortex during seizures.
The remainder of this paper is organized as follows. Section 2 introduces the definitions of STE and WSTE. Section 3 compares the performance of STE and WSTE based on the neural oscillations model and uses WSTE to estimate the coupling direction between the thalamus and the seizure onset zone. Finally, we conclude our paper in Section 4.

2. Materials and Methods

2.1. Symbolic Transfer Entropy (STE)

Symbolic transfer entropy adopts a technique of symbolization, which has also been introduced with the definition of permutation entropy [38,44]. Suppose a time series X   =   { x t } t = 1 T   is recorded from a certain area of the brain for an arbitrary i. X can be reconstructed into the time delay embedding representation X i m , τ , as shown in Equation (1):
X i m , τ   =     { x i , x i + τ , , x i + ( m 1 ) τ } ,     i = 1   ,   2   ,     ,   T (   m 1   )   τ ,
where m and τ denote the embedding dimension and time delay, respectively. To get the sequence of symbols, each vector is arranged in ascending order of the elements:
x i + ( l 1 1 ) τ x i + ( l 2 1 ) τ x i + ( l m 1 ) τ ,
The original index of elements forms a sequence { l 1 , l 2 , , l m } , representing one of m! possible permutations, which can be mapped onto a corresponding symbol π k , k = 1 , 2 , , m ! . For example, if m = 3, the following six ordinal patterns and their corresponding symbols are { 1 , 2 , 3 } π 1   ,   { 1 , 3 , 2 } π 2 ,   { 2 , 1 , 3 } π 3 ,   { 2 , 3 , 1 } π 4 ,   { 3 , 1 , 2 } π 5 ,   { 3 , 2 , 1 } π 6 ,   and if X i 3 , 1 = { 1 . 26 , 0.45 , 0 . 81 } , the symbol of X i 3 , 1 will be π 4 . Let S ( ) denote the map from the ordinal pattern space to the symbol space. Each   X i m , τ   is uniquely mapped onto one of the m! possible symbols such that S ( X i m , τ ) = π k . Therefore, the symbol sequences are given by
x ^ = { S ( X 1 m , τ ) , S ( X 2 m , τ ) , , S ( X T ( m 1 ) τ m , τ ) } ,
y ^ = { S ( Y 1 m , τ ) , S ( Y 2 m , τ ) , , S ( Y T ( m 1 ) τ m , τ ) } ,
Another symbol sequence,   x ^ δ   is delayed by δ steps form x ^ :
x ^ δ = { S ( X 1 + δ m , τ ) , S ( X 2 + δ m , τ ) , } ,
The symbolic transfer entropy (STE) from Y to X can be defined as [38]
T Y X δ = x ^ , y ^ p ( x ^ δ , x ^ , y ^ ) log p ( x ^ δ | x ^ , y ^ ) p ( x ^ δ | x ^ ) ,
The information entropy that is transferred from y ^ to x ^ at some later points in time can be defined as [45]
T Y X   =   T Y X δ   ,     δ =   arg   max ( T Y X δ ) ,
In this equation, T X Y is defined in a complete analogy. Finally, the directionality index between X and Y is given by [46]
D S = T X Y T Y X
The directionality index D S quantifies the direction of information flow between two neural oscillations. It is positive if the direction of information flow is from X to Y; if it is the contrary, then it is negative.
Obviously, the definition of STE involves probability calculations, which is the focus of this section. It is generally considered that the probability for the occurrence of a symbol   p ( π k )   is equivalent to the proportion of the symbol in the finite sequence. Thus, it can be calculated as follows:
p ( π k ) = i = 1 T ( m 1 ) τ I { S ( X i m , τ ) , π k } T ( m 1 ) τ ,
where k = 1 , 2 , , m ! , I { S ( X i m , τ ) , π k } = 1 if X i m , τ can map onto symbol π k ; otherwise I { S ( X i m , τ ) , π k } = 0 .
The main disadvantage of the above definition for the symbols is that it only focuses on the sequential structure and ignores the degree of difference between the amplitude values of the time series. Therefore, the influence of large fluctuations in the time series on the final results of the transfer entropy is also not considered. On the other hand, the small fluctuations which may be induced by noise should not be supposed to exert the same influence on the final STE value as the large fluctuations. Figure 1 demonstrates that different m-dimensional vectors are treated as the same ordinal pattern. Obviously, although (a) and (b) have a great difference in amplitude, they are regarded as the same order pattern. Another example is (c) and (d). Thus, it is necessary to emphasize the degree of difference between the amplitudes.

2.2. Weighted Symbolic Transfer Entropy

In this section, the weighted probability is introduced into the STE, which has been applied in weighted permutation entropy and can improve the robustness of the algorithm against noise [40]. For a symbol π k , the weighted probability p w ( π k ) can be calculated:
p w ( π k ) = i = 1 T     ( m 1 ) τ I { S ( X i m , τ ) , π k } w i W ,
where   w i   is the standard deviation of X i m , τ , indicating the weight value of the ith symbol in x ^ :
w i = 1 m j = 1 m ( x i + ( j 1 ) τ X ¯ i m , τ ) 2 ,
where W will be the new denominator instead of T ( m 1 ) τ :
W = i = 1 T ( m 1 ) τ w i   .
The degree of difference between motifs with different amplitudes can be highlighted by the weight w i . For the given signals X and Y and their reconstructed matrices X m , τ and Y m , τ , we get the symbol combinations ( π k x , π k y ) such that X and Y are mapped at the same time, and there are ( m ! ) 2 symbol combinations for X and Y. The weighted joint probability can be calculated as
p w ( π k x , π k y ) = i = 1 T ( m 1 ) τ I { S ( X i m , τ , Y i m , τ ) , ( π k x , π k y ) } w i x w i y W x W y ,
where the definitions of w i x , w i y and W x , W y are the same as above.
Therefore, WSTE can be defined as
W T Y X δ   =   x ^ , y ^ p w ( x ^ δ , x ^ , y ^ ) log p w ( x ^ δ | x ^ , y ^ ) p w ( x ^ δ | x ^ ) ,
Similar to Equations (7) and (8), the directionality index of WSTE between X and Y is given by
D W   = W T X Y       W T Y X .

2.2.1. Parameters of WSTE

There are three parameters in the calculation of WSTE, including the embedding dimension m, time delay τ, and δ. The embedding dimension m is the number of points in each permutation pattern. Generally, the recommended values are m = 3…7 [44]. If m = 1 or 2, very few permutation patterns are included, which makes the method meaningless. It is acceptable to choose a larger m for the analysis of long stationary time series. However, for two neural signals, each with a sampling length L, m has to satisfy the condition   L > ( m ! ) 3 so as to ensure the occurrence of every possible joint permutation pattern. Taking m = 4 as an example, the sample length of the data L should be greater than   ( 4 ! ) 3 =   13824 . In short, to obtain the temporal characteristics of neural signals, a large value of m is not appropriate. Thus, m = 3 was selected for the calculation of WSTE in the following analyses.
The lag τ is referred to as the number of sample points spanned by each permutation pattern, which is associated with the sampling frequency of a time series. The higher the sampling frequency, the longer the lag τ. In practice, we could employ an autocorrelation function (ACF) of a signal to determine the lag τ. Figure 2a plots two time series generated by a coupled neural mass model (see Section 2.3). Figure 2b shows the ACFs of time series X and Y that are normalized to unify at zero lag. An optimal lag could be determined at the point where the ACF had decayed to   e 1   of its peak value [47]. It can be seen that the ACF was less than e 1 when the lag τ = 5 and τ = 6 for time series X and Y, respectively. As such, in this case, the lag τ = 6 could be selected for calculating the WSTE.
The δ is related to the delay between time series X and Y, and δ cannot be less than the embedding dimension m in the WSTE calculation [32]. Here, we made the δ range from 3 to 20. Given m = 3 and τ = 6, the transfer entropy at different δ is plotted in Figure 2c. It is shown that there was a clear maximum of W T X Y at δ = 8, which indicates the delay of information transferred from X to Y. On the contrary, the W T Y X was relatively small, and there was no obvious difference for the values of δ, meaning that no coupling was available in the direction from Y to X.

2.2.2. Significance of WSTE

In this study, we used a surrogate method [48] to test the significance of the directionality index. The control group was a set of surrogate data obtained by randomly shuffling the original time series [33]. The surrogate data retained the same distribution, but the random shuffling destroyed the ordinal patterns of the original time series. Thus, the surrogate data could be regarded as independent, and the motifs constructed from the original series changed correspondingly. If there was a significant difference in the direction index between the original data and the surrogate data, the null hypothesis (two series are independent) should have been rejected.
For each original series, 100 surrogate data were generated to test the statistically significant difference of the directionality index between the original and surrogate series. The range of the mean ± 2 * SD (standard deviations) of the surrogate directionality index without any coupling direction could be used to illustrate its fluctuation. If the directionality of the original data was located within this range, it would be considered insignificant and set to zero. The processed directionality index was called the filtered directionality index.

2.3. Coupled Neural Mass Model

To evaluate the performance of the WSTE algorithm, it was necessary to use an appropriate model of reference for practical applications in complex systems. A neural mass model (NMM) [49,50] was employed to generate the coupled neural oscillations to test the performance of our proposed WSTE method. Based on the average field modeling idea, the model reflects the average behavior of the whole neuronal population in the neural networks with lumped state variables. The model constructs the neural oscillations from the perspective of the tissue structure in the nervous system, which is simple and physiological. The coupled NMM can reflect the interrelationship between neuron groups and simulate large-scale interactive neural networks at a macro level [51]. The NMM is represented by Equation (16).
The parameters in the model were physiologically realistic, and their details are listed in Table 1. In the model, the internal behavior of the neuronal population was mainly affected by the excitatory neuron parameter A and the inhibitory neuron parameter B. In Section 3.1, we set A 1 = A 2 = 3.25 and B 1 = B 2 = 35 for two oscillators. The static nonlinear function S is represented by the sigmoid function S ( v ) = 2 e 0 / ( 1 + e r ( v 0 v ) ) . The extrinsic input P ( t ) represents Gaussian white noise, with an assigned mean value and variance. This describes the overall density of action potentials coming from other regions and is similar to subcortical–cortical excitatory drive. Another important parameter is the connection strength K, which defines the degree and direction of coupling between neuronal populations [52,53]. In this study, initial conditions were set to zero in all simulations, and an integration step size of 5 ms (sampling frequency of 200 Hz) was used. Two coupled neuronal populations were generated, and the effect of the parameters on the directionality index were examined.
{ y ˙ 0 n ( t ) = y 3 n ( t ) , y ˙ 3 n ( t ) = A a S [ y 1 n ( t ) y 2 n ( t ) ] 2 a y 3 n ( t ) a 2 y 0 n ( t ) , y ˙ 1 n ( t ) = y 4 n ( t ) , y ˙ 4 n ( t ) = A a { p n ( t ) + C 2 S [ C 1 y 0 n ( t ) ] + i = 1 , , N , i n K i y 6 i ( t ) } 2 a y 4 n ( t ) a 2 y 1 n ( t ) , y ˙ 2 n ( t ) = y 5 n ( t ) , y ˙ 5 n ( t ) = B b { C 4 S [ C 3 y 0 n ( t ) ] } 2 b y 5 n ( t ) b 2 y 2 n ( t ) , y ˙ 6 n ( t ) = y 7 n ( t ) , y ˙ 7 n ( t ) = A a d S [ ( y 1 n ( t ) y 2 n ( t ) ) ] 2 a d y 7 n ( t ) a d 2 y 6 n ( t ) , n = 1 , 2

2.4. Epileptic ECoG Data

Investigating the spread of epilepsy discharges can reveal whether there is an interaction between the seizure onset zone and the remote area [54]. For instance, if a seizure starts in one area of the brain, then it may cause another region to follow it by a coupling [55,56,57]. Detecting the coupling direction between different brain regions can help to make a deep understanding of the propagating mechanism for seizures and the structure of epileptic networks [58].
To characterize the interaction between the different brain regions of a patient (male, 18 years old) with refractory focal seizures, the WSTE was used to estimate the coupling direction of the recorded electrocorticography (ECoG). The depth electrodes were semi-rigid platinum/iridium with 16 contacts. One of the clinical depth electrodes exploring the frontal cortex, or the peri-insular cortex, was extended into the anterior nucleus of thalamus (ANT) after a subtle angle adjustment. The patient had signed informed consent that this clinical data might be used for research purposes, and the study protocol had previously been approved by the local ethics committee. The raw signals were recorded by a Micromed electroencephalogram (EEG) data acquisition system with a sampling frequency of 1024 Hz, referencing a common contact placed subcutaneously. All surgical and electrophysiological records were performed at the participating hospital (Xuanwu Hospital Capital Medical University). More details can be found in [59]. Before calculating the directionality index, the recorded signals were filtered at 0.5–100 Hz with a Butterworth band-pass filter, and an adaptive notch filter was used to remove the 50 Hz power signal. Prior to analysis, the processed data had been down-sampled to 512 Hz. A segment of 120 s which involved a seizure was extracted from the whole recording. The down-sampled signals of six channels are demonstrated in Figure 3, which were located in the anterior nucleus of thalamus (ANT), supplementary motor area (SMA), and anterior cingulate cortex (ACC). The seizure started at approximately 30 s in the recording and lasted about 60 s.

3. Results

3.1. Application to the Neural Mass Model

In simulation analysis, the bionic nonlinear model was adopted because of its consistency with the main idea of this study. First, the basic principle and parameters of the neural mass model (NMM) are presented. Secondly, we measured the sensitivity of WSTE’s variation with the coupling strength of the model. Finally, by comparing this with the traditional STE method in the aspects of data length and noise immunity, the superiority of WSTE is illustrated.

3.1.1. Variation of the Directionality Index with Coupling Strength

Given the coupling strength K 1 , 2 = 0 and its increasing from 0 to 50 in steps of 1, two oscillations with a length of 20 s were generated. We used m = 3 and τ = 6 to calculate the directionality index between the oscillations with WSTE and STE, respectively. As shown in Figure 4, the results are given in the form of mean ± SD of 100 realizations for each method. Figure 4a plots the dependence of transfer entropy on the coupling strength K 2 , 1 . As K 2 , 1 increased from 0 to 30, both T Y X and W T Y X did not change significantly. However, in the opposite direction, the values of T X Y and W T X Y were continuously growing, which was consistent with the direction of information flow from X to Y. Figure 4b demonstrates the relationship between the directionality index and the coupling coefficient. As the coupling coefficient K 2 , 1 changed from 0 to 30, both the directional indexes kept increasing. In addition, it is worth noting that the values of W T X Y were always larger than W T Y X , and the values of D W were significantly higher than D S (ANOVA, p < 0.001) while the coupling strength was more than 4. This suggests that the WSTE method was more effective and appropriate for detecting the coupling strength between two oscillations.

3.1.2. Robustness of the Directionality Index Against Noise

Adding measurement noise into the signals can assess the robustness of the directionality index without disturbing the inherent dynamics of the system. Given K 1 , 2 = 0 , we set K 2 , 1 to 10, 20, and 30, respectively, and two neuronal population outputs of 20 s were generated. The signal-to-noise ratio (SNR) ranged from −10 dB to 30 dB with a step of 1 dB. The effect of white Gaussian noise on the directionality index at three different coupling strengths is illustrated in Figure 5. Error bars indicated the average and standard deviations from 100 trials of calculations. As can be seen from the results, both D S and D W were deteriorated severely by the noise when the SNR was less than about 10 dB. However, it was also found that D W was significantly higher than D S when the SNR was greater than −2 dB (ANOVA, p < 0.001). Thus, it is reasonable to conclude WSTE was superior to STE at identifying the coupling direction between two neural oscillations.

3.1.3. Variation of the Directionality Index with Sample Length

Transfer entropy depends on the statistical calculation of the conditional mutual information; therefore, the influence of the sample length on the directionality index should be investigated. Given K 1 , 2   = 0 , K 2 , 1 increased from 10 to 30 in steps of 10, the NMM output oscillations with lengths from 1 s to 20 s in steps of 1 s. The directionality index of the simulated oscillations for each coupling strength was calculated. Error bars indicated the mean and standard deviations from 100 trials. It can be seen from Figure 6 that the average directionality index increased with the sample length, while the standard deviation decreased at the same time. The blue curve is stable when the sampling length exceeds 7 s, while the red one is still growing slightly. STE and WSTE could both reliably distinguish the coupling direction between two neural oscillations when the sample length was greater than 2 s (400 sampling points). Moreover, the D W was larger than the D S while the sample length was over 8 s, indicating that WSTE performed better than STE with enough data points.

3.2. Application to Epileptic Seizures

A window of 3 s with an overlap of 2 s was utilized to calculate the significance of the directionality index. Figure 7a,b illustrate the variation of the filtered coupling directionality index between ANT and right SMA (epilepsy focus) over time. It can be seen that the directionality index between the ANT and right SMA was mostly positive and significant during the seizure (30–90 s), indicating the information transferred from the ANT to the right SMA. In other words, the ANT exerted some driving effects on the epilepsy focus, which may have played an important role in promoting or maintaining the abnormal activity of the epileptic network. Actually, deep brain stimulation (DBS) has emerged as an effective form of therapy for drug-resistant epilepsy [60]. Among a number of brain targets, the ANT is generally considered as a potential target because of its central connectivity and possible role in the propagation of seizure activity [59]. Thus, it is proven that our results are consistent with previous studies. Similarly, Figure 7c,d demonstrates the variation of the directionality index between the ANT and the left SMA over time. It was shown that there were no clear unidirectional couplings between the two regions in the earlier period of the seizure (30–50 s), whereas the directionality index between the ANT and the left SMA were mostly positive during the later period of the seizure (50–90 s). This means that the driving relationship from the ANT to the left SMA was also significant, but delayed by approximately 20 s, which will be further analyzed in our future works. On the other hand, when the ANT and the ACC entered the computation of WSTE, there was no similar phenomenon observed between these two regions. As shown in Figure 7e,f, even during the onset interval, the relatively weak coupling appeared in both directions. This suggests that there is no obvious causal relationship available from the ANT to the ACC and, consequently, the seizure does not occur in the ACC.

3.3. Comparison between WSTE and STE with Noisy Experimental Data

The electrocorticography in Section 2.4 and Section 3.2 can be considered noise-free. Figure 8a,b plots the directionality indices of the two algorithms when analyzing the noise-free data, and both could estimate significant directionality indices during the seizure (30–90 s). However, WSTE outperformed STE in noisy time series. To evaluate the robustness against noise, we added white Gaussian noise to the time series of ANT1 and SMA-R before calculating the directionality index. Clearly, as shown in Figure 8c–f, WSTE could still give significant directionality indices during the seizure, while STE could hardly detect the coupling direction, especially when the SNR was lower than 10 dB.

4. Conclusions

The brain is a complex non-linear physiological system. The coupling direction between neural oscillations is of great importance to studying brain functions. The transfer entropy algorithm is an effective tool to estimate the coupling direction based on information theory, which establishes a causal relationship between neural oscillations. In this study, we proposed a novel WSTE method to analyze the coupling direction between two neural oscillations. By estimating the weighted probability distribution, WSTE emphasizes the degree of difference between the amplitudes of a time series while defining symbols. In contrast, this information is ignored in the calculation of STE. The results of simulated data show that WSTE is superior to the traditional STE method, particularly in the sensitivity of coupling strength, the requirement of data length, and the performance against noise. The proposed WSTE method is also used to analyze the experimental recordings of an epilepsy patient. It was found that there was a significant coupling direction from the ANT to the seizure onset zone (SOZ) during the epileptic seizure, which is consistent with some conclusions about deep brain stimulation. In the application of human data, both WSTE and STE could describe the spatial connection and causal relationship between different brain areas. Although they could give consistent results in the noiseless case, WSTE was more robust than STE when the noise was available. To conclude, our main work is to optimize the STE method and improve its performance, and we suggest that the novel measure is a powerful and effective tool for estimating the coupling direction between neural oscillations. In addition, it should be noted that the present form of the WSTE method cannot directly be applied to more than two neural oscillations, which will be further studied in our future works.

Author Contributions

Conceptualization, Z.L.; methodology, Z.L.; software, S.L.; validation, S.L.; formal analysis, X.L.; data curation, T.Y.; writing—review and editing, Z.L.; writing—original draft preparation, S.L.; supervision, X.L.; funding acquisition, Z.L. All authors read and agreed to the published version of the manuscript.

Funding

This research was funded in part by the National Natural Science Foundation of China (61971374, 61603327).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Buzsaki, G.; Draguhn, A. Neuronal oscillations in cortical networks. Science 2004, 304, 1926–1929. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Ahn, S.; Rubchinsky, L.L. Short desynchronization episodes prevail in synchronous dynamics of human brain rhythms. Chaos 2013, 23, 013138. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Fries, P. Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu. Rev. Neurosci. 2009, 32, 209–224. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Colgin, L.L.; Denninger, T.; Fyhn, M.; Hafting, T.; Bonnevie, T.; Jensen, O.; Moser, M.B.; Moser, E.I. Frequency of gamma oscillations routes flow of information in the hippocampus. Nature 2009, 462, 353–357. [Google Scholar] [CrossRef] [PubMed]
  5. Lakatos, P.; Karmos, G.; Mehta, A.D.; Ulbert, I.; Schroeder, C.E. Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 2008, 320, 110–113. [Google Scholar] [CrossRef] [Green Version]
  6. Magazzini, L.; Singh, K.D. Spatial attention modulates visual gamma oscillations across the human ventral stream. Neuroimage 2018, 166, 219–229. [Google Scholar] [CrossRef]
  7. Fries, P.; Fernández, G.; Jensen, O. When neurons form memories. Trends Neurosci. 2003, 26, 123–124. [Google Scholar] [CrossRef]
  8. Minarik, T.; Berger, B.; Sauseng, P. The involvement of alpha oscillations in voluntary attention directed towards encoding episodic memories. Neuroimage 2018, 166, 307–316. [Google Scholar] [CrossRef]
  9. Womelsdorf, T.; Schoffelen, J.M.; Oostenveld, R.; Singer, W.; Desimone, R.; Engel, A.K.; Fries, P. Modulation of neuronal interactions through neuronal synchronization. Science 2007, 316, 1609–1612. [Google Scholar] [CrossRef] [Green Version]
  10. Fries, P. A mechanism for cognitive dynamics: Neuronal communication through neuronal coherence. Trends Cogn. Sci. 2005, 9, 474–480. [Google Scholar] [CrossRef]
  11. Wang, X.J. Neurophysiological and computational principles of cortical rhythms in cognition. Physiol. Rev. 2010, 90, 1195–1268. [Google Scholar] [CrossRef] [PubMed]
  12. Ray, S.; Maunsell, J.H. Do gamma oscillations play a role in cerebral cortex? Trends Cogn. Sci. 2015, 19, 78–85. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Kramer, M.A.; Eden, U.T. Assessment of cross-frequency coupling with confidence using generalized linear models. J. Neurosci. Methods 2013, 220, 64–74. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Young, C.K.; Eggermont, J.J. Coupling of mesoscopic brain oscillations: Recent advances in analytical and theoretical perspectives. Prog. Neurobiol. 2009, 89, 61–78. [Google Scholar] [CrossRef] [PubMed]
  15. Jensen, O.; Colgin, L.L. Cross-frequency coupling between neuronal oscillations. Trends Cogn. Sci. 2007, 11, 267–269. [Google Scholar] [CrossRef] [PubMed]
  16. John, L.E.; Jensen, O. The Theta-Gamma Neural Code. Neuron 2013, 77, 1002–1016. [Google Scholar] [CrossRef] [Green Version]
  17. Zhou, S.; Xie, P.; Chen, X.; Wang, Y.; Zhang, Y.; Du, Y. Optimization of relative parameters in transfer entropy estimation and application to corticomuscular coupling in humans. J. Neurosci. Methods 2018, 308, 276–285. [Google Scholar] [CrossRef]
  18. Hyafil, A.; Giraud, A.L.; Fontolan, L.; Gutkin, B. Neural Cross-Frequency Coupling: Connecting Architectures, Mechanisms, and Functions. Trends Neurosci. 2015, 38, 725–740. [Google Scholar] [CrossRef]
  19. Dietz, V.; Macauda, G.; Schrafl-Altermatt, M.; Wirz, M.; Kloter, E.; Michels, L. Neural coupling of cooperative hand movements: A reflex and fMRI study. Cereb. Cortex 2015, 25, 948–958. [Google Scholar] [CrossRef]
  20. Rizzolatti, G.; Fabbri-Destro, M.; Caruana, F.; Avanzini, P. System neuroscience: Past, present, and future. CNS Neurosci. Ther. 2018, 24, 685–693. [Google Scholar] [CrossRef]
  21. Smith, S.M.; Vidaurre, D.; Beckmann, C.F.; Glasser, M.F.; Jenkinson, M.; Miller, K.L.; Nichols, T.E.; Robinson, E.C.; Salimi-Khorshidi, G.; Woolrich, M.W.; et al. Functional connectomics from resting-state fMRI. Trends Cogn. Sci. 2013, 17, 666–682. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Brea, J.; Russell, D.F.; Neiman, A.B. Measuring direction in the coupling of biological oscillators: A case study for electroreceptors of paddlefish. Chaos 2006, 16, 026111. [Google Scholar] [CrossRef] [PubMed]
  23. Babiloni, C.; Ferri, R.; Binetti, G.; Cassarino, A.; Dal Forno, G.; Ercolani, M.; Ferreri, F.; Frisoni, G.B.; Lanuzza, B.; Miniussi, C.; et al. Fronto-parietal coupling of brain rhythms in mild cognitive impairment: A multicentric EEG study. Brain Res. Bull. 2006, 69, 63–73. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Rosenblum, M.G.; Pikovsky, A.S. Detecting direction of coupling in interacting oscillators. Phys. Rev. E 2001, 64, 045202. [Google Scholar] [CrossRef] [Green Version]
  25. Chicharro, D.; Andrzejak, R.G. Reliable detection of directional couplings using rank statistics. Phys. Rev. E 2009, 80, 026217. [Google Scholar] [CrossRef] [Green Version]
  26. Sun, Y.; Li, J.; Liu, J.; Chow, C.; Sun, B.; Wang, R. Using causal discovery for feature selection in multivariate numerical time series. Mach.Learn. 2014, 101, 377–395. [Google Scholar] [CrossRef]
  27. Shojaie, A.; Michailidis, G. Discovering graphical Granger causality using the truncating lasso penalty. Bioinformatics 2010, 26, i517–i523. [Google Scholar] [CrossRef]
  28. Bolstad, A.; Van Veen, B.D.; Nowak, R. Causal Network Inference Via Group Sparse Regularization. IEEE Trans. Signal Process 2011, 59, 2628–2641. [Google Scholar] [CrossRef] [Green Version]
  29. Yang, G.; Wang, L.; Wang, X. Reconstruction of Complex Directional Networks with Group Lasso Nonlinear Conditional Granger Causality. Sci. Rep. 2017, 7, 2991. [Google Scholar] [CrossRef] [Green Version]
  30. Barnett, L.; Seth, A.K. The MVGC multivariate Granger causality toolbox: A new approach to Granger-causal inference. J. Neurosci. Methods 2014, 223, 50–68. [Google Scholar] [CrossRef] [Green Version]
  31. Palus, M.; Vejmelka, M. Directionality of coupling from bivariate time series: How to avoid false causalities and missed connections. Phys. Rev. E 2007, 75, 056211. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Bahraminasab, A.; Ghasemi, F.; Stefanovska, A.; McClintock, P.V.; Kantz, H. Direction of coupling from phases of interacting oscillators: A permutation information approach. Phys. Rev. Lett. 2008, 100, 084101. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Schreiber, T. Measuring Information Transfer. Phys. Rev. Lett. 2000, 85, 461–464. [Google Scholar] [CrossRef] [Green Version]
  34. Faes, L.; Nollo, G.; Porta, A. Compensated Transfer Entropy as a Tool for Reliably Estimating Information Transfer in Physiological Time Series. Entropy 2013, 15, 198–219. [Google Scholar] [CrossRef] [Green Version]
  35. Bossomaier, T.; Barnett, L.; Harré, M.; Lizier, J.T. An Introduction to Transfer Entropy-Information Flow in Complex; Springer International Publishing: Cham, Switzerland, 2016. [Google Scholar] [CrossRef]
  36. Li, X.; Ouyang, G. Estimating coupling direction between neuronal populations with permutation conditional mutual information. Neuroimage 2010, 52, 497–507. [Google Scholar] [CrossRef] [PubMed]
  37. Wen, D.; Jia, P.; Hsu, S.H.; Zhou, Y.; Lan, X.; Cui, D.; Li, G.; Yin, S.; Wang, L. Estimating coupling strength between multivariate neural series with multivariate permutation conditional mutual information. Neural. Netw. 2019, 110, 159–169. [Google Scholar] [CrossRef] [PubMed]
  38. Staniek, M.; Lehnertz, K. Symbolic transfer entropy. Phys. Rev. Lett. 2008, 100, 158101. [Google Scholar] [CrossRef]
  39. Staniek, M.; Lehnertz, K. Symbolic transfer entropy: Inferring directionality in biosignals. Biomed. Tech. (Berl) 2009, 54, 323–328. [Google Scholar] [CrossRef]
  40. Fadlallah, B.; Chen, B.; Keil, A.; Principe, J. Weighted-permutation entropy: A complexity measure for time series incorporating amplitude information. Phys. Rev. E 2013, 87, 022911. [Google Scholar] [CrossRef] [Green Version]
  41. Xiao-Feng, L.; Yue, W. Fine-grained permutation entropy as a measure of natural complexity for time series. Chin. Phys. B 2009, 18, 2690–2695. [Google Scholar] [CrossRef]
  42. Yin, Y.; Shang, P. Weighted permutation entropy based on different symbolic approaches for financial time series. Physica A Stat. Mechan. Appl. 2016, 443, 137–148. [Google Scholar] [CrossRef]
  43. Liu, X.; Jiang, A.; Xu, N.; Xue, J. Increment Entropy as a Measure of Complexity for Time Series. Entropy 2016, 18, 22. [Google Scholar] [CrossRef] [Green Version]
  44. Bandt, C.; Pompe, B. Permutation entropy: A natural complexity measure for time series. Phys. Rev. Lett. 2002, 88, 174102. [Google Scholar] [CrossRef] [PubMed]
  45. Wibral, M.; Pampu, N.; Priesemann, V.; Siebenhuhner, F.; Seiwert, H.; Lindner, M.; Lizier, J.T.; Vicente, R. Measuring information-transfer delays. PLoS ONE 2013, 8, e55809. [Google Scholar] [CrossRef]
  46. Martini, M.; Kranz, T.A.; Wagner, T.; Lehnertz, K. Inferring directional interactions from transient signals with symbolic transfer entropy. Phys. Rev. E 2011, 83. [Google Scholar] [CrossRef]
  47. Shelhamer, M. Nonlinear Dynamics in Physiology: A State-Space Approach; World Scientific Publishing Company: Singapore, 2006. [Google Scholar]
  48. Theiler, J.; Eubank, S.; Longtin, A.; Galdrikian, B.; Farmer, J.D. Testing for nonlinearity in time series: The method of surrogate data. Physica D 1992, 58, 77–94. [Google Scholar] [CrossRef] [Green Version]
  49. Wendling, F.; Bellanger, J.J.; Bartolomei, F.; Chauvel, P. Relevance of nonlinear lumped-parameter models in the analysis of depth-EEG epileptic signals. Biol. Cybern. 2000, 83, 367–378. [Google Scholar] [CrossRef]
  50. Jansen, B.H.; Rit, V.G. Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns. Biol. Cybern. 1995, 73, 357–366. [Google Scholar] [CrossRef]
  51. David, O.; Cosmelli, D.; Friston, K.J. Evaluation of different measures of functional connectivity using a neural mass model. Neuroimage 2004, 21, 659–673. [Google Scholar] [CrossRef]
  52. Li, X.; Yao, X.; Fox, J.; Jefferys, J.G. Interaction dynamics of neuronal oscillations analysed using wavelet transforms. J. Neurosci. Methods 2007, 160, 178–185. [Google Scholar] [CrossRef] [Green Version]
  53. Li, Y.; Li, X.; Ouyang, G.; Guan, X. Information flow among neural networks with Bayesian estimation. Chin. Sci. Bull. 2007, 52, 2006–2011. [Google Scholar] [CrossRef]
  54. Frauscher, B.; Gotman, J. Sleep, oscillations, interictal discharges, and seizures in human focal epilepsy. Neurobiol. Dis. 2019, 127, 545–553. [Google Scholar] [CrossRef] [PubMed]
  55. Proix, T.; Bartolomei, F.; Chauvel, P.; Bernard, C.; Jirsa, V.K. Permittivity coupling across brain regions determines seizure recruitment in partial epilepsy. J. Neurosci. 2014, 34, 15009–15021. [Google Scholar] [CrossRef] [PubMed]
  56. Martinet, L.E.; Fiddyment, G.; Madsen, J.R.; Eskandar, E.N.; Truccolo, W.; Eden, U.T.; Cash, S.S.; Kramer, M.A. Human seizures couple across spatial scales through travelling wave dynamics. Nat. Commun. 2017, 8, 14896. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  57. Salami, P.; Peled, N.; Nadalin, J.K.; Martinet, L.E.; Kramer, M.A.; Lee, J.W.; Cash, S.S. Seizure onset location shapes dynamics of initiation. Clin. Neurophysiol. 2020, 131, 1782–1797. [Google Scholar] [CrossRef]
  58. Bezruchko, B.P.; Smirnov, D.A. Identification of Directional Couplings. In Extracting Knowledge from Time Series: An Introduction to Nonlinear Empirical Modeling; Springer: Berlin/Heidelberg, Germany, 2010; pp. 319–348. [Google Scholar] [CrossRef]
  59. Yu, T.; Wang, X.; Li, Y.; Zhang, G.; Worrell, G.; Chauvel, P.; Ni, D.; Qiao, L.; Liu, C.; Li, L.; et al. High-frequency stimulation of anterior nucleus of thalamus desynchronizes epileptic network in humans. Brain 2018, 141, 2631–2643. [Google Scholar] [CrossRef]
  60. Fisher, R.S.; Velasco, A.L. Electrical brain stimulation for epilepsy. Nat. Rev. Neurol. 2014, 10, 261–270. [Google Scholar] [CrossRef]
Figure 1. Two examples of different vectors (m = 3, τ = 1) in a time series mapped onto the same motif. Six motifs are available in total. (ad) Examples for Motif #2 and Motif #5.
Figure 1. Two examples of different vectors (m = 3, τ = 1) in a time series mapped onto the same motif. Six motifs are available in total. (ad) Examples for Motif #2 and Motif #5.
Entropy 22 01442 g001
Figure 2. The determination of the lag base on the autocorrelation function. (a) Two simulated time series with X driving Y. (b) The normalized autocorrelation functions (ACFs) of time series X and Y. (c) The weighted symbolic transfer entropy (WSTE) between X and Y with different δ.
Figure 2. The determination of the lag base on the autocorrelation function. (a) Two simulated time series with X driving Y. (b) The normalized autocorrelation functions (ACFs) of time series X and Y. (c) The weighted symbolic transfer entropy (WSTE) between X and Y with different δ.
Entropy 22 01442 g002
Figure 3. Electrocorticography (ECoG) of six channels recorded from a patient with a refractory focal seizure. (a,b) are the recordings in the anterior nucleus of thalamus (ANT). (c) The recordings in the left supplementary motor area (SMA). (d) The recordings in the right SMA (epilepsy focus). The vertical lines in these panels indicate the beginning and termination of the seizure. (e) The recordings in the anterior cingulate cortex (ACC) (the normal cortex without seizures).
Figure 3. Electrocorticography (ECoG) of six channels recorded from a patient with a refractory focal seizure. (a,b) are the recordings in the anterior nucleus of thalamus (ANT). (c) The recordings in the left supplementary motor area (SMA). (d) The recordings in the right SMA (epilepsy focus). The vertical lines in these panels indicate the beginning and termination of the seizure. (e) The recordings in the anterior cingulate cortex (ACC) (the normal cortex without seizures).
Entropy 22 01442 g003aEntropy 22 01442 g003b
Figure 4. Effect of coupling strength on STE and WSTE. (a) Transfer entropy in two directions. (b) Directionality index from X to Y.
Figure 4. Effect of coupling strength on STE and WSTE. (a) Transfer entropy in two directions. (b) Directionality index from X to Y.
Entropy 22 01442 g004
Figure 5. The influence of noise on the directionality indexes of STE and WSTE. (a) The coupling strength K 2 , 1 is set to 10. (b) The coupling strength K 2 , 1 is set to 20. (c) The coupling strength K 2 , 1 is set to 30.
Figure 5. The influence of noise on the directionality indexes of STE and WSTE. (a) The coupling strength K 2 , 1 is set to 10. (b) The coupling strength K 2 , 1 is set to 20. (c) The coupling strength K 2 , 1 is set to 30.
Entropy 22 01442 g005
Figure 6. The influence of sample length on the directionality index of STE and WSTE. (a) The coupling strength K 2 , 1 is 10. (b) The coupling strength K 2 , 1 is 20. (c) The coupling strength K 2 , 1 is 30.
Figure 6. The influence of sample length on the directionality index of STE and WSTE. (a) The coupling strength K 2 , 1 is 10. (b) The coupling strength K 2 , 1 is 20. (c) The coupling strength K 2 , 1 is 30.
Entropy 22 01442 g006
Figure 7. The variation of the directionality index between different regions. (a,b) are the directionality index between the ANT and the right SMA. (c,d) are the directionality index between the ANT and the left SMA. (e,f) are the directionality index between the ANT and the ACC.
Figure 7. The variation of the directionality index between different regions. (a,b) are the directionality index between the ANT and the right SMA. (c,d) are the directionality index between the ANT and the left SMA. (e,f) are the directionality index between the ANT and the ACC.
Entropy 22 01442 g007
Figure 8. The variation of the directionality index between the ANT and the right SMA. (a,b) show WSTE and STE without noise. (c,d) show WSTE and STE for a 15 dB signal-to-noise ratio (SNR). (e,f) show WSTE and STE for a 10 dB SNR.
Figure 8. The variation of the directionality index between the ANT and the right SMA. (a,b) show WSTE and STE without noise. (c,d) show WSTE and STE for a 15 dB signal-to-noise ratio (SNR). (e,f) show WSTE and STE for a 10 dB SNR.
Entropy 22 01442 g008aEntropy 22 01442 g008b
Table 1. Physiological interpretation of the model parameters.
Table 1. Physiological interpretation of the model parameters.
ParameterInterpretation
AAverage excitatory synaptic gain
BAverage inhibitory synaptic gain
C 1 , C 2 Average number of synaptic contacts in the excitatory feedback loop
C 3 , C 4 Average number of synaptic contacts in the inhibitory feedback loop
v 0 , e 0 , r Parameters of the nonlinear sigmoid function (transforming the average membrane potential to an average density of action potentials)
a d Average time delay on efferent connection from a population
K i Connectivity constant associated with the connection between populations
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, Z.; Li, S.; Yu, T.; Li, X. Measuring the Coupling Direction between Neural Oscillations with Weighted Symbolic Transfer Entropy. Entropy 2020, 22, 1442. https://0-doi-org.brum.beds.ac.uk/10.3390/e22121442

AMA Style

Li Z, Li S, Yu T, Li X. Measuring the Coupling Direction between Neural Oscillations with Weighted Symbolic Transfer Entropy. Entropy. 2020; 22(12):1442. https://0-doi-org.brum.beds.ac.uk/10.3390/e22121442

Chicago/Turabian Style

Li, Zhaohui, Shuaifei Li, Tao Yu, and Xiaoli Li. 2020. "Measuring the Coupling Direction between Neural Oscillations with Weighted Symbolic Transfer Entropy" Entropy 22, no. 12: 1442. https://0-doi-org.brum.beds.ac.uk/10.3390/e22121442

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop