Inference of Gene Regulatory Network Based on Local Bayesian Networks

Fei Liu; Shao-Wu Zhang; Wei-Feng Guo; Ze-Gang Wei; Luonan Chen

doi:10.1371/journal.pcbi.1005024

Abstract

The inference of gene regulatory networks (GRNs) from expression data can mine the direct regulations among genes and gain deep insights into biological processes at a network level. During past decades, numerous computational approaches have been introduced for inferring the GRNs. However, many of them still suffer from various problems, e.g., Bayesian network (BN) methods cannot handle large-scale networks due to their high computational complexity, while information theory-based methods cannot identify the directions of regulatory interactions and also suffer from false positive/negative problems. To overcome the limitations, in this work we present a novel algorithm, namely local Bayesian network (LBN), to infer GRNs from gene expression data by using the network decomposition strategy and false-positive edge elimination scheme. Specifically, LBN algorithm first uses conditional mutual information (CMI) to construct an initial network or GRN, which is decomposed into a number of local networks or GRNs. Then, BN method is employed to generate a series of local BNs by selecting the k-nearest neighbors of each gene as its candidate regulatory genes, which significantly reduces the exponential search space from all possible GRN structures. Integrating these local BNs forms a tentative network or GRN by performing CMI, which reduces redundant regulations in the GRN and thus alleviates the false positive problem. The final network or GRN can be obtained by iteratively performing CMI and local BN on the tentative network. In the iterative process, the false or redundant regulations are gradually removed. When tested on the benchmark GRN datasets from DREAM challenge as well as the SOS DNA repair network in E.coli, our results suggest that LBN outperforms other state-of-the-art methods (ARACNE, GENIE3 and NARROMI) significantly, with more accurate and robust performance. In particular, the decomposition strategy with local Bayesian networks not only effectively reduce the computational cost of BN due to much smaller sizes of local GRNs, but also identify the directions of the regulations.

Author Summary

Gene regulatory network (GRN) represents how some genes encode regulatory molecules such as transcription factors or microRNAs for regulating the expression of other genes. Accurate inference of GRN is an important task to understand the biological activity from signal emulsion to metabolic dynamics, prioritize potential drug targets of various diseases, devise effective therapeutics, and discover the novel pathways. In this paper, we propose a novel local Bayesian network (LBN) algorithm to improve the accuracy of GRN inference from gene expression data by exploring advantages of Bayesian network (BN) and conditional mutual information (CMI) methods. BNs with kNN network decomposition and CMI are respectively introduced to reduce the high computational complexity of BN and remove the false or redundant regulation interactions. The superior performance of the proposed LBN approach is demonstrated on GRN datasets from DREAM challenge as well as the SOS DNA repair network in E. coli.

Citation: Liu F, Zhang S-W, Guo W-F, Wei Z-G, Chen L (2016) Inference of Gene Regulatory Network Based on Local Bayesian Networks. PLoS Comput Biol 12(8): e1005024. https://doi.org/10.1371/journal.pcbi.1005024

Editor: Edwin Wang, University of Calgary Cumming School of Medicine, CANADA

Received: October 27, 2015; Accepted: June 20, 2016; Published: August 1, 2016

Copyright: © 2016 Liu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the paper and its Supporting Information files.

Funding: This work was supported by the Strategic Priority Research Program of the Chinese Academy of Sciences (No. XDB13040700) awarded to LC; National Natural Science Foundation of China (Nos. 91430111, 61473232, 61170134, 91439103, 61134013, 91529303 and 81471047) awarded to SWZ and LC; and was also partially supported by JSPS KAKENHI Grant Number 15H05707, awarded to LC. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Gene regulatory networks (GRNs) that explicitly characterize regulatory processes in cells are typically modeled by graphs, in which the nodes represent the genes and the edges reflect the regulatory or interaction relationship between genes [1]. Accurately inferring GRN is of great importance and also an essential task to understand the biological activity from signal emulsion to metabolic dynamics, prioritize potential drug targets of various diseases, devise effective therapeutics, and discover the novel pathways [2–4]. Identifying the GRNs with experimental methods is usually time-consuming, tedious and expensive, and sometimes lack of reproducibility. In addition, recent high-throughput sequencing technologies have yielded a mass of gene expression data [5], which provides opportunity for understanding the underlying regulatory mechanism based on the data. Therefore, numerous computational approaches have been developed to infer the GRNs [3, 6–45]. Such computational methods can be roughly categorized into the co-expression based approaches [6], supervised learning-based approaches [7–13], model-based approaches [3, 14–30], and information theory-based approaches [31–40]. The co-expression based methods have low computational complexity, but they cannot infer direct associations or model system dynamics. The supervised learning-based methods make use of the known regulations to infer GRNs on a genome-wide data, such as SEREND [8], GENIES [9] and SIRENE [11], but require additional information of the regulatory interactions to train a model. By guiding the inference engine from the prior information of the known regulations, it can achieve higher precision and outperform many other methods [46]. However, the insufficient information of the labeled or known gene datasets limits the application of this kind of approaches [47, 48].

On the other hand, model-based methods can be further classified into ordinary differential equation [14, 15], multiple linear regression [18, 19], linear programming [20, 21], Boolean networks [17, 22], and probabilistic graphical models including Bayesian network (BN) [3, 16, 23, 49] and graphical Gaussian model [24, 25]. Overall, these model-based methods can provide us a deeper understanding of the system’s behaviors at a network level and can also infer the directions of regulations in the network. However, these methods are parameters-dependent and time-consuming, which makes them difficult to deal with large-scale networks. For example, inferring GRNs based on the probabilistic graphical models requires to search the optimal graph from all possible graphs with respect to all genes in the network. Due to this NP-hard nature [50] of learning static Bayesian network structure, two common alternative techniques, i.e., a heuristic-based search [26] and the maximum-number-of-parents (maxP) [27, 28] were developed approximately to search the sub-optimal graphs. Yet, the heuristic search approaches still have high computational complexity and do not guarantee global optimal. Although the maxP technique by limiting the maximum number of parents for each gene to q can partly reduce the computational complexity, it needs to traverse search all genes for inferring the parents of one gene. Thus, maxP techniques have polynomial complexity of O(n^q) for an n-node GRN [28], which are still unsuitable for large-scale GRNs. To reconstruct dynamic Bayesian networks (DBNs), two structure learning algorithms such as BNFinder [29] and globalMIT [30] have been proposed to infer GRNs, but these algorithms are currently suitable only for small networks since they also require to search all combinations of regulators for a gene.

Recently, information theory-based methods are widely used for reconstructing GNRs, such as mutual information (MI) [33, 34–36, 42–44] and conditional mutual information (CMI) [31, 38, 45]. These approaches are assumption-free methods, measuring unknown, non-linear and complex associations rather than linear-correlations between genes [38, 40], and addressing the problem of intense computation for parameters. Thus, they can be used to infer large-scale GRNs. However, MI-based methods overestimate the regulation relationships to some extent and fail to distinguish indirect regulators from direct ones, thereby leading to possible false positives [38, 51, 52]. Although CMI-based methods are able to separate the direct regulations from the indirect ones, they cannot derive the directions of regulations in the network and also tend to underestimate the regulation strength in some cases [32, 37, 45].

To overcome these limitations of BN, MI and CMI, in this paper, we propose a novel local Bayesian network (LBN) algorithm to reconstruct GRNs from gene expression data by making use of their advantages, i.e., infer the directed network with less false-positive edges and with high computational efficiency. LBN algorithm mainly consists of five distinct elements shown in Fig 1: i) CMI is first employed to construct an initial network, i.e., G_MI, which then is decomposed into a series of smaller sub-networks, i.e., local networks or GRNs, according to the nearest relationship among genes in the network with k-nearest neighbor (kNN) method. ii) For these local networks or GRNs, BN method is used to identify their regulatory relationships with directions, generating a series of local BNs which are integrated into a candidate GRN G_B. iii) CMI is applied to remove the false positive edges in G_B, forming a tentative GRN G_C. iv) According to the relationships of kNN among genes in the network, the tentative GRN (G_C) is further decomposed into a series of smaller sub-networks or local networks, in which BN method is implemented to delete the false regulatory relationships. v) The final network or GRN G_F is inferred by iteratively performing BN and CMI with kNN decomposition until the topological structure of the tentative network G_C does not change. On the benchmark GRN datasets from DREAM challenge [53, 54] and widely used SOS DNA repair network in Escherichia coli [55, 56], the simulation results confirmed the effectiveness of our LBN algorithm, which is superior to other three state-of-the-art approaches, i.e., ARACNE [36], GENIE3 [13] and NARROMI [20].

Download:

Fig 1. Schematic diagram of LBN method.

(1) process the data, (2) construct the initial network (a large-scale network) by CMI or MI, (3) decompose the network into local networks (a number of small-scale networks) by kNN with k = 1, (4) perform BN to obtain local BNs (a number of small-scale networks), (5) integrate local BNs into a candidate network (a large-scale network), (6) perform CMI to obtain the tentative network (a large-scale network). Iteratively performing BN and CMI with kNN (k = 2) until G_C topological structure tends to stable, the final network or GRN can be inferred. The solid lines denote the true regulations and the dashed lines denote redundant correlations between two genes.

https://doi.org/10.1371/journal.pcbi.1005024.g001

Results and Discussion

Datasets and evaluation metrics

The benchmark network datasets play an important role in assessing the effectiveness of algorithms in reconstructing GRNs. Many researchers used the simulated datasets derived from DREAM challenge [53] to evaluate their algorithms. DREAM challenge gives a series of gene expression datasets with noise and gold benchmark networks, which were selected from source networks of real species. In this work, we utilized three simulation datasets as well as two real gene expression datasets to validate our method. The three synthetic datasets in sizes 10, 50 and 100 (marked as dataset10, dataset50 and dataset100, respectively) obtained from DREAM3 challenge contain 10, 50 and 100 genes with 10, 77 and 125 edges, respectively, which come from 10, 50 and 100 samples respectively. The real gene expression dataset is the well-known SOS DNA repair network with experiment dataset in E. coli [55, 56], which includes 9 genes with 24 edges. Another large-scale gene expression dataset from E. coli data bank [57] is an experimentally verified network [58], which includes 1418 genes with 2675 edges.

In order to validate our algorithm, the true positive rate (TPR), false positive rate (FPR), false discovery rate (FDR), positive predictive value (PPV), overall accuracy (ACC), F-score measure and Matthews correlation coefficient (MCC) are used to evaluate the performance of our LBN and other algorithms. These metrics are defined as follows: (1) where TP is the number of edges that are correctly identified, TN is the number of non-link edges correctly identified, FP is the number of edges that are incorrectly identified, FN is the number of non-link edges incorrectly identified. By setting different CMI threshold values varying from large to small with a fixed scale, we obtained a series of TP, FP, TN and FN to calculate their corresponding TPR and FPR values, which are used to plot the receiver operating characteristic (ROC) curves. The area under ROC curves (AUC) is calculated as another metric for comparing different algorithms.

Evaluating simulation datasets

Three synthetic datasets (dataset10, dataset50 and dataset100) from DREAM3 challenge were used to assess LBN algorithm, and three state-of-the-art methods of GENIE3 [13], ARACNE [36], and NARROMI [20] were chosen to evaluate the performance of LBN and those methods. GENIE3 [13] decomposes the problem of inferring a regulatory network of p genes into p different feature selection problems by using Random Forest and Extra-Trees algorithms. ARACNE [36] utilizes the data processing inequality to eliminate the majority of indirect interactions inferred by co-expression methods, which cannot recover all transcriptional interactions in a GRN but rather to recover some transcriptional interactions with a high confidence. NARROMI [20] combines the information theory-based CMI and the path-consistent algorithm (PCA) to improve the accuracy of GRN inference. In NARROMI, MI is firstly used to remove the noisy regulations with low pairwise correlations, and then CMI is utilized to exclude the redundant regulations from indirect regulators iteratively by PCA from a lower order to a higher order. For all the methods in comparison, the parameters were set to default values.

We use the Z-statistic test [59, 60, 38] at the significance level of P-value = 0.05 to select the suitable thresholds for parameters α and β, which are approximately α = 0.03, 0.1 and 0.1 as the threshold values of CMI to construct the gene correlation network G_MI for dataset10, dataset50 and dataset100 respectively. In the same way, we also selected β = 0.03, 0.1 and 0.1 as the threshold value of CMI to remove the false positive edges for dataset10, dataset50 and dataset100 respectively. The results in Table 1 show that our LBN method has the highest PPV, ACC, MCC, F and AUC scores among all, except that the AUC of ARACNE on the dataset 100 is a little higher than that of our LBN method. The results on the three datasets with different network sizes selected from real and experimental verified networks in Yeast genomes also demonstrate the effectiveness of our LBN in terms of higher and more robust performances in inferring GRNs.

Download:

Table 1. Comparison of different methods on dataset10, dataset50 and dataset100.

https://doi.org/10.1371/journal.pcbi.1005024.t001

In addition, there are a number of methods for inferring GRNs based on Markov Blanket, such as Grow-shring [61], IAMB [62] and Fast-IAMB [63]. Both of Grow-shring and IAMB methods first identify the Markov Blankets for each variable (or node) by iteratively executing a series of conditional independence and dependence tests, then connect nodes in a consistent way to infer Bayesian network. However, in the process of discovering the Markov Blanket of a target variable T, Grow-shring and IAMB methods require to search almost all other variables, which increases algorithm’s time complexity. Although the computational complexity (O(n²)) of these two methods is in the same scale as our method and is lower than that of BN method (O(2ⁿ)), numerical computations show that our method performs superior to them for simulation dataset and real datasets or large-scale GRNs. Specifically, in order to assess effectiveness of our LBN method, we compared LBN with Grow-shring and IAMB methods on dataset10. The comparative results of three methods are shown on Table 2, from which we can see that the computational time of our LBN method is considerably lower than that of either Grow-shring method or IAMB method. In addition, as shown in Table 2, the accuracy of our GRN inference is also high.

Download:

Table 2. Comparison of Grow-shring, IAMB and LBN methods on dataset10.

https://doi.org/10.1371/journal.pcbi.1005024.t002

Inferring SOS network and gene regulatory interactions in E. coli

In order to further evaluate the performance of our LBN algorithm, we also implemented our LBN method and other five methods, i.e., GENIE3, ARACNE,NARROMI, Grow-shring and IAMB on the well-known SOS DNA repair network, which is an experimentally verified network in E. coli, with real gene expression data [55, 56]. SOS network (Fig 2A) includes two mediators of the SOS response (lexA and recA), four other regulatory genes (ssb, recF, dinI and umuDC) involved in the SOS response, and three sigma factor genes (rpoD, rpoH and rpoS) whose regulations play important roles in the SOS response. Choosing threshold α = β = 0.01, the comparison results of LBN with GENIE3, ARACNE, NARROMI, Grow-shring and IAMB are shown on Table 3, in which we can see that the performance of our LBN method is also superior to GENIE3, ARACNE, NARROMI, Grow-shring and IAMB. For example, the ACC of LBN is 73.6%, which is 4.2%, 25%, 15.3%, 9.7% and 2.8% higher than that of GENIE3, ARACNE, NARROMI, Grow-shring and IAMB, respectively, and AUC of LBN achieves at 0.816, which is 0.132, 0.077, 0.025, 0.058 and 0.007 higher than that of GENIE3, ARACNE, NARROMI, Grow-shring and IAMB, respectively. Fig 2B gives the SOS network inferred with LBN, which shows that LBN method infers 15 true regulatory relationships and 10 false regulatory links. These results also indicate that our LBN method can infer most of the true regulatory relationships between genes, and verify the effectiveness and efficiency of LBN method on the real gene expression data.

Download:

Fig 2. SOS DNA repair network.

(a) True network. (b) Inferred network with LBN (α = β = 0.01). The solid lines are correctly inferred regulatory relationships, and the dotted lines are false regulatory links.

https://doi.org/10.1371/journal.pcbi.1005024.g002

Download:

Table 3. Comparison of different methods on SOS DNA repair network.

https://doi.org/10.1371/journal.pcbi.1005024.t003

LBN was also applied to construct a large-scale GRN from real gene expression data. We used the experimentally verified reference network in E. coli [58] to evaluate the performance of LBN, and downloaded the gene expression data from the well-known E. coli data bank [57]. The experimentally verified network includes 2675 edges between 160 regulators and 1258 targets that can be found in the gene expression dataset [20]. The comparison results of LBN with GENIE3, ARACNE, NARROMI, Grow-shring and IAMB on the large-scale gene regulatory network in E. coli are listed on Table 4, from which we can see that the proposed LBN method performs better than other methods with the highest average AUC scores, number and proportion for regulators and target genes. These results indicate that our LBN method is also suitable to infer large-scale GRNs.

Download:

Table 4. Comparison of different methods on the large-scale gene regulatory network.

https://doi.org/10.1371/journal.pcbi.1005024.t004

Effects of the strategies of network decomposition and false-positive edge deletion

In order to evaluate the effectiveness of the strategies of the network decomposition and false-positive edge deletion introduced in our LBN algorithm, we tested the performance of different combination ways (i.e. MI+BN, MI+BN+CMI, MI+BN+CMI+kNN+BN) on the dataset10, which includes 10 genes and 10 regulatory edges. MI+BN denotes that MI method was firstly used to construct the initial GRN, then the network decomposition strategy and BN method were adopted to generate GRN; MI+BN+CMI denotes that MI, the network decomposition strategy and BN method were used to infer GRN, then CMI was chosen to remove the false positive edges; MI+BN+CMI+kNN+BN denotes that MI, the network decomposition strategy, CMI and BN methods were used to generate GRN, then kNN and BN methods were respectively taken to decompose GRN, reconstruct GRN and further delete the false positive edges. On the same PC (i5-2400 CPU, 4GB RAM), the results of different combination ways were listed on Table 5. Fig 3 shows the true gene regulatory network (a) that was selected from an experimental verified network in Yeast genome, the inferred networks (b), (c), (d) and (e) generated by BN, MI+BN, MI+BN+CMI and MI+BN+CMI+kNN+BN, respectively. From Table 5 and Fig 3, we can see that the running time of MI+BN was 0.7852s lower than that of BN, while it wrongly predicted 7 regulatory edges, which means that the strategy of MI+BN effectively reduces the computational time, meanwhile it results in more false positive edges; CMI can really remove the false positive edges, and kNN indeed helps the Bayesian network accurately learning and reducing the false positive edges. These results indicate that our strategy of the network decomposition can significantly reduce the high computation cost of the BN method for large-scale GRNs, whereas the strategy of deleting the false-positive edges with CMI and kNN can remarkably enhance the accuracy of the network inference.

Download:

Fig 3. Gene regulatory networks composed of 10 genes.

(a) The true network with 10 genes and 10 edges. (b) The network inferred by BN method. (c) The network inferred by MI+BN. (d) The network inferred by MI+BN+CMI. (e) The network inferred by MI+BN+CMI+kNN+BN. The solid lines are correctly inferred regulatory relationships, and the dotted lines are false regulatory links.

https://doi.org/10.1371/journal.pcbi.1005024.g003

Download:

Table 5. Results of different combination ways on the dataset10.

https://doi.org/10.1371/journal.pcbi.1005024.t005

Effects of the threshold parameters

There are two parameters α and β in our LBN algorithm, which determine whether or not there is a link or an edge between two genes in the reconstructed GRN. In order to evaluate the impact of α and β parameters in LBN algorithm, we performed simulations on dataset10 by calculating ACC with different α and β values by fixing another parameter, and the simulated results are shown in Fig 4. From Fig 4A, we found that the ACC value increases gradually in the range 0 ≤ α < 0.025, and reaches the highest value (ACC = 0.944) in the range 0.025 ≤ α ≤ 0.03, and decreases gradually in the range 0.03 < α < 0.045, while the ACC basically remains unchanged (ACC ≈ 0.9). From Fig 4B, we found that the ACC value increases gradually in the range 0 ≤ β < 0.024, and reaches the highest value (ACC = 0.944) in the range of 0.024 ≤ β ≤ 0.03, and decreases gradually in the range 0.03 < β < 0.09. Although the parameters α and β have some influence on the results of the inferred GRNs, the effect is minor in those threshold ranges. Thus, we can select α and β lied in these range (e.g., 0.025 ≤ α ≤ 0.03 and 0.024 ≤ β ≤ 0.03) to obtain the best GRN for dataset10. We also performed simulations by calculating ACC with different α and β values on dataset50, dataset100 and SOS DNA dataset, respectively. The experimental results show that we should select the suitable parameters (α and β) for different datasets to obtain the best GRNs.

Download:

Fig 4. Effect of parameters α and β for LBN on dataset10.

https://doi.org/10.1371/journal.pcbi.1005024.g004

Analysis of LBN computational complexity

The computational complexity of LBN method involves five phases or parts. In the phase of inferring an initial network, LBN needs to compute MI or CMI value of each gene pair at zero order, thus the maximum complexity is in the order of O(n²), where n is the total number of genes. For the phase of constructing the directed network, LBN needs to select regulatory genes for each target gene, and thus the maximum complexity is in the order of O(n×2^m), where m is the number of regulatory genes, and m << n. In the phase of filtering false positive edges by CMI, the time complexity is O(n²). For the phase of further removing the redundant edges with kNN, LBN needs to find n sub-networks, and hence the time complexity is O(n). In last phase of iteratively performing CMI and BN with kNN methods until the topological structure of the tentative or candidate network does not change. If iteratively performing l times, then the total complexity of LBN is O(2l×n²+l×n+l×n×2^m). When n is very large and m << n, the computational complexity of LBN is O(n²), which is lower than that of BN method (O(2ⁿ)).

Conclusions

In this work, we presented a novel method, namely LBN, to improve the accuracy of GRN inference from gene expression data by adopting two strategies, i.e., the network decomposition and the false-positive edge deletion, which can accurately infer a directed network with high computational efficiency. Specifically, the network decomposition can effectively reduce the high computational cost of BN method for inferring large-scale GRNs, whereas CMI with kNN can delete the redundant regulations and thus reduce the false positives. By iteratively performing CMI and BN with kNN methods, LBN algorithm can infer the optimal GRN structure with regulation directions. The results on the benchmark gene regulatory networks from the DREAM3 challenge and a real SOS DNA repair network in E. coli show that our LBN method outperforms significantly other three state-of-the-art methods of ARACNE, GENIE3 and NARROMI. Clearly, our LBN makes Bayesian network accurately to learn the network structure and reduce the false positives by searching k-nearest neighbors of every gene, and thus, LBN is effective and robust for inferring the directed GRNs. On the other hand, based on probabilistic graphical model, a network inference method called the module network method [64] was also developed. Compared with Segal’s Module network method [64] which infers the network among modules, our LBN algorithm adopts the iterative algorithm between CMI and probabilistic graphical model (i.e., BN) to infer the network among genes.

Despite the above advantages of LBN, it can be improved from the following two aspects. Firstly, it is still a challenging task to select the parent genes of X gene in the set of variables, which will affect the computational cost and accuracy of inferring GRNs. Secondly, the inferred network is a static network, and thus it is a future direction to extend LBN to consider the dynamical features in the network, e.g., Dynamic Bayesian Networks (DBNs) or Dynamical Network Markers (DNMs) [65] by using time-course or stage-course data, which can be found in wider applications [66–68] in biomedical fields.

Methods

MI and CMI

Recently, both of mutual information (MI) and conditional mutual information (CMI) have been widely applied to inferring GRNs [20, 31, 38, 40, 55, 56, 69], due to their capability of characterizing nonlinear dependency, which provides a natural generalization of association between genes. MI can be used to measure the degree of independence between two genes X_i and X_j, but it tends to overestimate the regulation strengths between genes (i.e., false positive problem). On the other hand, CMI measures the conditional dependency between two genes X_i and X_j given other gene X_k, which can quantify the undirected regulation.

For discrete variables X and Y, MI is defined as [31, 38, 70, 71]: (2) where p(x, y) is the joint probability distribution of X and Y, and p(x) and p(y) are the marginal probability distributions of X and Y, respectively; H(X) and H(Y) are the entropies of X and Y, respectively; and H(X,Y) is the joint entropy of X and Y.

CMI between two variables X and Y given variable Z is defined as [31, 38, 70]: (3) where p(x,y|z), p(x|z) and p(y|z) are conditional probability distributions, and H(X, Z), H(Y, Z), and H(X, Y, Z) are the joint entropies.

With the widely adopted hypothesis of Gaussian distribution for gene expression data, the entropy can be estimated by the following Gaussian kernel probability density function [38, 42], (4)

where C is the covariance matrix of variable X, |C| is the determinant of the matrix, N is the number of samples and n is the number of variables (genes) in C. Generally, if the sample number is almost equal to the gene number, the empirical covariance matrix is often used to estimate the covariance matrix of the distribution of gene expression profile, which can be considered as a good approximation of the true covariance matrix. However, when the number of samples is smaller than that of genes, the regularized covariance matrix [72, 73] is used to estimate the covariance matrix of the distribution of gene expression profile. The number of replicate samples will affect the performance of the method, and increasing replicate samples can enhance the GRN inference algorithm’s power.

Thus, the entropy of variable X can be denoted as: (5)

According to Eqs 2 and 5, MI between two variables (genes) X and Y can be easily calculated by using the following equivalent formula [31, 38, 70].

(6)

High MI value indicates that there may be a close relationship between the variables (genes) X and Y, while low MI value implies their independence. If variables (genes) X and Y are independent of each other, clearly MI(X, Y) = 0.

Similarly, under the assumption of Gaussian distributions for gene expression data, CMI of two variables (genes) X and Y given variable (gene) Z can be easily calculated by using the following equivalent formula [31, 38].

(7)

Obviously, when X and Y are conditionally independent given Z, CMI(X, Y|Z) = 0. In addition, this equivalent expression is an efficient method to calculate CMI between two variables X and Y given one or more variables Z, e.g., if the conditional variable Z = (Z₁, Z₂) is composed of two variables Z₁ and Z₂, we can obtain the second-order CMI.

Bayesian networks

A Bayesian network (BN) is a graphical model of the probabilistic relationships among a set of random variable X = {X₁,X₂,…,X_i,….X_n}, which is a directed acyclic graph G. In a Bayesian network, the vertices (nodes) are the random variables (genes), and the edges represent the probabilistic dependencies among the corresponding random variables (genes). Under the Markov assumption that given its parents, each variable is independent of its non-descendants, the relationships between the variables (genes) are described by a joint probability distribution P(X₁,X₂,…,X_n), which can be decomposed into a product of conditional probabilities based on the graphical structure: (8) where Pa(X_i) is the set of parents of node X_i in graph G.

In the process of BN structure learning, the most likely graph G for a given dataset D can be inferred by searching for the optimal graph based on a Bayesian scoring metric. That is, by trying out all possible graphs G (i.e., all possible combinations of interaction among genes), the graph G with the maximum Bayesian score (joint probability) is chosen as the most likely gene regulatory network. In general, the number of possible graph G grows exponentially with the number of nodes (or genes), and the problem of identifying the optimal graph is NP-hard [50]. For a larger dataset D which contains more variables, it is not computationally possible to calculate the Bayesian score for all possible graphs G. Therefore, the heuristic search methods, such as greedy-hill climbing approach, the Markov Chain Monte Carlo method and simulated annealing, are often used to infer the Bayesian network structure [28, 74].

Here, the optimal graph G can be decomposed into a series of optimal sub-graphs, each of which is centered on one node or gene. However, the parent set of every node X_i may be consisted of other nodes in G, the computational complexity of identifying the optimal sub-graphs is considerably high, i.e., it is still not computationally possible to calculate the maximum Bayesian score of all possible sub-graphs of every node for a large-scale network. Generally, the neighbor genes of gene X_i most likely regulate it. Thus, we limit the size of parents of each node X_i to approximately calculate the maximum Bayesian score of every node.

In this paper, as shown in Fig 1, we first construct the undirected network with CMI method, and decompose the network into a series of sub-networks in which the central node just is linked with its k nearest neighbors (or nodes). Due to every sub-network just contains a few nodes, we can identify the set of parents of every central node by calculating the Bayesian scores of all possible sub-network structures of the central node to choose the optimal Bayesian sub-network with maximum joint probability distribution score. Then, by integrating all of the sub-networks, we have the candidate global Bayesian network (or GRN). Note that BN can be extended to dynamic Bayesian network by using time-course expression data.

k-nearest neighbor

In a graph G(V,E), V represents a set of nodes and E represents edges between nodes. The k closest neighbors of each node are selected according their shortest path distance in the graph structure. That is, the k-nearest neighbor (kNN) of node V_i consists of a set of nodes whose shortest path to the node V_i is k. In this paper, we used the k-nearest neighbors of each node to decompose a large-scale network to form a series of local Bayesian networks. For each local Bayesian network, the Bayesian network inference method is used to remove the false positive edges. For a large-scale network, we show that it can actually achieve a high accuracy even with the first- and second-nearest neighbors of each node. Actually, the k-nearest neighbors of a gene or node with k = 2 contains the Markov blanket of the node, which includes all the k-nearest neighbors with k = 1 and the partial the k-nearest neighbors with k = 2 for that node. The Markov blanket of a node in a Bayesian network is composed of all the variables that shield the node from the rest of the network, which implies that the Markov blanket of a node is the only knowledge needed to predict the behavior of that node. Thus, we choose k = 2 in this paper.

LBN algorithm

Given an expression dataset with n genes and N samples, a novel algorithm (called LBN) was developed to infer its underlying GRN. As shown in Fig 1, LBN is composed of four main parts: i) Construct an initial network (or GRN) with MI or CMI method, ii) Decompose the large-scale (initial) network into series of sub-networks by kNN method, i.e., local networks or GRNs, iii) Identify the regulatory relationship among genes by BN method for each sub-network, and iv) Integrate all local BNs as a candidate network, and then remove the false regulatory relationships by CMI, i.e., construct the tentative network. Then we have the final network or GRN by iteratively performing CMI and BN with kNN methods. Numerical computations show that our LBN method can infer the final GRN after iterating 10–20 times. Fig 1 is the schematic diagram of our LBN method, which is described in detail as follows:

Step 1: Construct the initial network by CMI.

In general, the gene-gene pairs with high MI or CMI values are co-expressed genes, in which one is the target gene, and another is the regulatory gene (regulator). For an expression dataset with n genes, we first compute the MI or CMI values between all gene pairs with Eq 6, deleting these edges whose MI values are smaller than a pre-defined threshold α, and then construct an initial GRN which is an undirected network G_MI.

Step 2: Decompose G_MI into n sub-networks or local networks by kNN.

For a larger network G_MI which contains a large number of genes, it is a NP-hard problem to try out all its possible structures to search for the most likely gene regulatory network with BN method. Therefore, we proposed a strategy to bypass this problem by decomposing network G_MI into series of sub-networks which contains a few genes. Suppose every gene g_i in the network G_MI is a potential target gene, and its nearest neighbor genes in G_MI are its potential regulatory genes (regulators), that is, gene g_i and its nearest neighbor genes form a local network G_MI. Based on this assumption, the network G_MI can be decomposed into n sub-networks or local networks, where n is the total number of genes in the network. Every sub-network is composed of the gene g_i and its nearest neighbor genes.

Step 3: Construct local BNs by estimating the gene regulations and integrate local BNs into a candidate network.

For every sub-network, we calculate the joint probability distribution value of all its possible structure, selecting the network with the maximum joint probability distribution value as the optimal Bayesian sub-network from which we can identify the candidate regulatory genes (regulators) of the target g_i. Then, the n optimal Bayesian sub-networks or local BNs are integrated into a directed network G_B as a candidate network or GRN from which we can find the regulatory relationship between genes. In the process of constructing the Bayesian sub-network, it can not only identify the edge direction between the interacting genes, but also eliminate the redundant regulation edges.

Step 4: Construct tentative network by eliminating the redundant regulations by CMI.

MI method commonly tends to overestimate the regulation strengths between genes, which does not consider the joint regulations of a target gene by other two or more genes, and thus results in more false positive edges. In this step, we use CMI to remove false positive edges by computing the first-order CMI(i, j|k), second-order CMI(i, j|k, l) with Eq 7. If CMI(i, j|k) (or CMI(i, j|k, l)) is smaller than a pre-defined threshold β, the edge linked genes i and j is deleted from network G_B. Thus, we can generate a tentative network or GRN G_C.

Step 5: Decompose G_C into N smaller networks or local networks.

In Steps 2 and 3, the sub-networks decomposed from G_MI are the smallest local networks whose shortest path is 1 (i.e., k = 1). Using these sub-networks to construct local GRN with BN method may introduce some false regulatory edges. For further filtering the false genes regulatory edges, we should enlarge the parent set of each gene. However, if selecting more neighbors for one gene as its candidate regulators, it will increase the computational complexity. In this work, we select k = 2 to enlarge the parent set of each gene. Thus, we applied the second-nearest neighbor of each node to decompose G_C, forming n sub-networks whose shortest path is 2 (i.e., k = 2), then using the BN method to reconstruct local GRNs for every sub-networks. The candidate GRN G_C is calculated by iteratively performing Steps 3–5 until its topological structure does not change. In the end, we can obtain the final network or GRN G_F.

Author Contributions

Conceived and designed the experiments: FL, SWZ, LC. Performed the experiments: FL, WFG, ZGW. Analyzed the data: FL, SWZ, LC. Contributed reagents/materials/analysis tools: FL, WFG, ZGW. Wrote the paper: FL, SWZ, LC.

References

1. Levine M, Davidson EH. Gene regulatory networks for development. Proc Natl Acad Sci USA. Proceedings of the National Academy of Sciences. 2005;102(14):4936–42. pmid:15788537
- View Article
- PubMed/NCBI
- Google Scholar
2. Csermely P, Ágoston V, Pongor S. The efficiency of multi-target drugs: the network approach might help drug design. Trends in Pharmacological Sciences. 2005;26(4):178–82. pmid:15808341
- View Article
- PubMed/NCBI
- Google Scholar
3. Friedman N, Linial M, Nachman I, Pe'Er D. Using Bayesian networks to analyze expression data. Journal of Computational Biology A Journal of Computational Molecular Cell Biology. 2000;7(3–4):601–20. pmid:11108481
- View Article
- PubMed/NCBI
- Google Scholar
4. Savoie CJ, Aburatani S, Watanabe S, Eguchi Y, Muta S, Imoto S, et al. Use of gene networks from full genome microarray libraries to identify functionally relevant drug-affected genes and gene regulation cascades. Dna Research. 2003;10(1):19–25. pmid:12693551
- View Article
- PubMed/NCBI
- Google Scholar
5. Hughes TR, Marton MJ, Jones AR, Roberts CJ, Stoughton R, Armour CD, et al. Functional Discovery via a Compendium of Expression Profiles. Cell. 2013;volume 102(1):109–26(18).
- View Article
- Google Scholar
6. Eisen MB, Spellman PT, Brown PO, Botstein D. Botstein D: Cluster analysis and display of genome-wide expression patterns. Proceedings of the National Academy of Sciences of the United States of America. 1998;95(25):14863–8. pmid:9843981
- View Article
- PubMed/NCBI
- Google Scholar
7. Yalamanchili HK, Yan B, Li MJ, Qin J, Zhao Z, Chin FY, et al. DDGni: dynamic delay gene-network inference from high-temporal data using gapped local alignment. Bioinformatics. 2014;30(3):377–83. pmid:24285602
- View Article
- PubMed/NCBI
- Google Scholar
8. Ernst J, Beg QK, Kay KA, Balázsi G, Oltvai ZN, Bar-Joseph Z. A Semi-Supervised Method for Predicting Transcription Factor-Gene Interactions in. Plos Computational Biology. 2008;4(3):e1000044–e. pmid:18369434
- View Article
- PubMed/NCBI
- Google Scholar
9. Kotera M, Yamanishi Y, Moriya Y, Kanehisa M, Goto S. GENIES: gene network inference engine based on supervised analysis. Nucleic Acids Research. 2012;40(Web Server issue):162–7.
- View Article
- Google Scholar
10. Marbach D, Costello JC, Küffner R, Vega NM, Prill RJ, Camacho DM, et al. Wisdom of crowds for robust gene network inference. Nature Methods. 2012;9(8):796–804. pmid:22796662
- View Article
- PubMed/NCBI
- Google Scholar
11. Mordelet F, Vert JP. SIRENE: supervised inference of regulatory networks. Bioinformatics. 2008;24(16):i76–82. pmid:18689844
- View Article
- PubMed/NCBI
- Google Scholar
12. Zare H, Sangurdekar D, Srivastava P, Kaveh M, Khodursky A. Reconstruction of Escherichia coli transcriptional regulatory networks via regulon-based associations. Bmc Systems Biology. 2009;3(6):579–88.
- View Article
- Google Scholar
13. Irrthum A, Wehenkel L, Geurts P. Inferring Regulatory Networks from Expression Data using Tree-based Methods. Plos One. 2010;5(9):4439–51.
- View Article
- Google Scholar
14. Sakamoto E, Iba H. Inferring a system of differential equations for a gene regulatory network by using genetic programming2001. 720–6 vol. 1 p.
15. Tian T, Burrage K. Stochastic models for regulatory networks of the genetic toggle switch. Proceedings of the National Academy of Sciences of the United States of America. 2006;103(22):8372–7. pmid:16714385
- View Article
- PubMed/NCBI
- Google Scholar
16. Zou M, Conzen S. A new dynamic Bayesian network (DBN) approach for identifying gene regulatory networks from time course microarray data. Bioinformatics. 2005;21(1):71–9. pmid:15308537
- View Article
- PubMed/NCBI
- Google Scholar
17. Shmulevich I, Dougherty ER, Kim S, Zhang W. Probabilistic Boolean Networks: a rule-based uncertainty model for gene regulatory networks. Bioinformatics. 2002;18(2):261–74. pmid:11847074
- View Article
- PubMed/NCBI
- Google Scholar
18. Cantone I, Marucci L, Iorio F, Ricci MA, Belcastro V, Bansal M, et al. A Yeast Synthetic Network for In Vivo Assessment of Reverse-Engineering and Modeling Approaches. Cell. 2009;137(1):172–81. pmid:19327819
- View Article
- PubMed/NCBI
- Google Scholar
19. Honkela A, Girardot C, Gustafson EH, Liu YH, Furlong EE, Lawrence ND, et al. Model-based method for transcription factor target identification with limited data. Proceedings of the National Academy of Sciences of the United States of America. 2010;107(17):7793–8. pmid:20385836
- View Article
- PubMed/NCBI
- Google Scholar
20. Zhang X, Liu K, Liu ZP, Duval B, Richer JM, Zhao XM, et al. NARROMI: a noise and redundancy reduction technique improves accuracy of gene regulatory network inference. Bioinformatics. 2013;29(1):106–13. pmid:23080116
- View Article
- PubMed/NCBI
- Google Scholar
21. Zhu H, Rao RS, Zeng T, Chen L. Reconstructing dynamic gene regulatory networks from sample-based transcriptional data. Nucleic Acids Research. 2012;40(21):10657–67. pmid:23002138
- View Article
- PubMed/NCBI
- Google Scholar
22. Akutsu T, Miyano S, Kuhara S. IDENTIFICATION OF GENETIC NETWORKS FROM A SMALL NUMBER OF GENE EXPRESSION PATTERNS UNDER THE BOOLEAN NETWORK MODEL. Pacific Symposium on Biocomputing Pacific Symposium on Biocomputing. 1999:17–28. pmid:10380182
- View Article
- PubMed/NCBI
- Google Scholar
23. Zhu D, Li H. Improved Bayesian Network inference using relaxed gene ordering. International Journal of Data Mining & Bioinformatics. 2010;4(1):44–59.
- View Article
- Google Scholar
24. Krämer N, Schäfer J, Boulesteix AL. Regularized estimation of large-scale gene association networks using graphical Gaussian models. Bmc Bioinformatics. 2009;10(1):1–24.
- View Article
- Google Scholar
25. Menéndez P, Kourmpetis YAI, Braak CJFT, Eeuwijk FAV. Gene Regulatory Networks from Multifactorial Perturbations Using Graphical Lasso: Application to the DREAM4 Challenge. Plos One. 2010;5(12):2010.
- View Article
- Google Scholar
26. Aghdam R, Ganjali M, Zhang X, Eslahchi C. CN: a consensus algorithm for inferring gene regulatory networks using the SORDER algorithm and conditional mutual information test. Molecular bioSystems. 2015;11(3):942–9. pmid:25607659
- View Article
- PubMed/NCBI
- Google Scholar
27. Husmeier D. Sensitivity and specificity of inferring genetic regulatory interactions from microarray experiments with dynamic Bayesian networks. Bioinformatics. 2003;19(17):2271–82. pmid:14630656
- View Article
- PubMed/NCBI
- Google Scholar
28. Nair A, Chetty M, Wangikar PP. Improving gene regulatory network inference using network topology information. Molecular bioSystems. 2015;11(9):2449–63. pmid:26126758
- View Article
- PubMed/NCBI
- Google Scholar
29. Wilczynski B, Dojer N. BNFinder: exact and efficient method for learning Bayesian networks. Bioinformatics. 2008;25(2):286–7. pmid:18826957
- View Article
- PubMed/NCBI
- Google Scholar
30. Vinh NX, Chetty M, Coppel R, Wangikar PP. GlobalMIT: learning globally optimal dynamic bayesian network with the mutual information test criterion. Bioinformatics. 2011;27(19):2765–6. pmid:21813478
- View Article
- PubMed/NCBI
- Google Scholar
31. Zhang X, Zhao J, Hao JK, Zhao XM, Chen L. Conditional mutual inclusive information enables accurate quantification of associations in gene regulatory networks. Nucleic Acids Research. 2015;43(5):e31–e. pmid:25539927
- View Article
- PubMed/NCBI
- Google Scholar
32. Chaitankar V, Ghosh P, Perkins EJ, Gong P, Zhang C. Time lagged information theoretic approaches to the reverse engineering of gene regulatory networks. Bmc Bioinformatics. 2010;11(Suppl6):1–14.
- View Article
- Google Scholar
33. Faith JJ, Hayete B, Thaden JT, Mogno I, Wierzbowski J, Cottarel G, et al. Large-Scale Mapping and Validation of Escherichia coli Transcriptional Regulation from a Compendium of Expression Profiles. Plos Biology. 2007;5(1):e8–e. pmid:17214507
- View Article
- PubMed/NCBI
- Google Scholar
34. Liang S, Fuhrman S, Somogyi R. Reveal, a general reverse engineering algorithm for inference of genetic network architectures. Pacific Symposium on Biocomputing Pacific Symposium on Biocomputing. 1998;1998(4):18–29.
- View Article
- Google Scholar
35. Luo W, Hankenson KD, Woolf PJ. Learning transcriptional regulatory networks from high throughput gene expression data using continuous three-way mutual information. Bmc Bioinformatics. 2008;9(1):1–15.
- View Article
- Google Scholar
36. Margolin AA, Nemenman I, Basso K, Wiggins C, Stolovitzky G, Favera RD, et al. ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context. Bmc Bioinformatics. 2006;7(2):: S7.
- View Article
- Google Scholar
37. Kai W, Saito M, Bisikirska BC, Alvarez MJ, Wei KL, Rajbhandari P, et al. Genome-wide identification of post-translational modulators of transcription factor activity in human B cells. Nature Biotechnology. 2009;27(9):829–39. pmid:19741643
- View Article
- PubMed/NCBI
- Google Scholar
38. Zhang X, Zhao XM, He K, Lu L, Cao Y, Liu J, et al. Inferring gene regulatory networks from gene expression data by path consistency algorithm based on conditional mutual information. Bioinformatics. 2012;28(1):98–104. pmid:22088843
- View Article
- PubMed/NCBI
- Google Scholar
39. Zhou C, Zhang SW, Liu F. An ensemble method for reconstructing gene regulatory network with jackknife resampling and arithmetic mean fusion. International Journal of Data Mining & Bioinformatics. 2015;12(3).
- View Article
- Google Scholar
40. Villaverde AF, Ross J, Banga JR. Reverse engineering cellular networks with information theoretic methods. Cells. 2013;2(2):306–29. pmid:24709703
- View Article
- PubMed/NCBI
- Google Scholar
41. López-Kleine L, Leal L, López C. Biostatistical approaches for the reconstruction of gene co-expression networks based on transcriptomic data. Briefings in Functional Genomics. 2013;12(5):457–67. pmid:23407269
- View Article
- PubMed/NCBI
- Google Scholar
42. Basso K, Margolin AA, Stolovitzky G, Klein U, Dallafavera R, Califano A. Reverse engineering of regulatory networks in human B cells. Nature Genetics. 2005;37(4):382–90. pmid:15778709
- View Article
- PubMed/NCBI
- Google Scholar
43. Modi SR, Camacho DM, Kohanski MA, Walker GC, Collins JJ. Functional characterization of bacterial sRNAs using a network biology approach. Proceedings of the National Academy of Sciences of the United States of America. 2011;108(37):15522–7. pmid:21876160
- View Article
- PubMed/NCBI
- Google Scholar
44. Wang J, Chen B, Wang Y, Wang N, Garbey M, Tran-Son-Tay R, et al. Reconstructing regulatory networks from the dynamic plasticity of gene expression by mutual information. Nucleic Acids Research. 2013;41(8):395–408.
- View Article
- Google Scholar
45. Sumazin P, Yang X, Chiu HS, Chung WJ, Iyer A, Llobet-Navas D, et al. An Extensive MicroRNA-Mediated Network of RNA-RNA Interactions Regulates Established Oncogenic Pathways in Glioblastoma. Cancer Research. 2012;72(8 Supplement):4186–.
- View Article
- Google Scholar
46. Madhamshettiwar PB, Maetschke SR, Davis MJ, Reverter A, Ragan MA. Gene regulatory network inference: evaluation and application to ovarian cancer allows the prioritization of drug targets. Genome Medicine. 2012;4(5):41.1–.15.
- View Article
- Google Scholar
47. Cerulo L, Elkan C, Ceccarelli M. Learning gene regulatory networks from only positive and unlabeled data. Bmc Bioinformatics. 2010;11(1):: 228.
- View Article
- Google Scholar
48. De SR, Marchal K. Advantages and limitations of current network inference methods. Nature Reviews Microbiology. 2010;8(10):717–29. pmid:20805835
- View Article
- PubMed/NCBI
- Google Scholar
49. Pei B, Rowe DW, Shin DG. Learning Bayesian networks with integration of indirect prior knowledge. International Journal of Data Mining & Bioinformatics. 2010;4(5):505–19.
- View Article
- Google Scholar
50. Chickering DM, Heckerman D, Meek C, editors. Large-Sample Learning of Bayesian Networks is NP-Hard. Nineteenth Conference on Uncertainty in Artificial Intelligence; 2002.
51. Barzel B. Network link prediction by global silencing of indirect correlations. Nature Biotechnology. 2013;31(8):720–5. pmid:23851447
- View Article
- PubMed/NCBI
- Google Scholar
52. Feizi S, Marbach D, Médard M, Kellis M. Network deconvolution as a general method to distinguish direct dependencies in networks. Nature Biotechnology. 2013;31(8):726–33. pmid:23851448
- View Article
- PubMed/NCBI
- Google Scholar
53. Schaffter T, Marbach D, Floreano D. GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods. Bioinformatics. 2011;27(16):2263–70. pmid:21697125
- View Article
- PubMed/NCBI
- Google Scholar
54. Marbach D, Prill RJ, Schaffter T, Mattiussi C, Floreano D, Stolovitzky G. Revealing strengths and weaknesses of methods for gene network inference. Proceedings of the National Academy of Sciences of the United States of America. 2010;107(14):6286–91. pmid:20308593
- View Article
- PubMed/NCBI
- Google Scholar
55. Ronen M, Rosenberg R, Shraiman BI, Alon U. Assigning numbers to the arrows: parameterizing a gene regulation network by using accurate expression kinetics. Proceedings of the National Academy of Sciences of the United States of America. 2002;99(16):10555–60. pmid:12145321
- View Article
- PubMed/NCBI
- Google Scholar
56. Shen-Orr SS, Milo R, Mangan S, Alon U. Network motifs in the transcriptional regulation network of Escherichia coli. Nature Genetics. 2002;31(1):64–8. pmid:11967538
- View Article
- PubMed/NCBI
- Google Scholar
57. Faith JJ, Driscoll ME, Fusaro VA, Cosgrove EJ, Hayete B, Juhn FS, et al. Many Microbe Microarrays Database: uniformly normalized Affymetrix compendia with structured experimental metadata. Nucleic Acids Research. 2008;36(36):866–70.
- View Article
- Google Scholar
58. Gama-Castro S, Salgado H, Peralta-Gil M, Santos-Zavaleta A, Muñiz-Rascado L, Solano-Lira H, et al. RegulonDB version 7.0: transcriptional regulation of. Nucleic Acids Research. 2011;39(Database issue):98–105.
- View Article
- Google Scholar
59. Saito S, Hirokawa T, Horimoto K. Discovery of chemical compound groups with common structures by a network analysis approach (affinity prediction method). Journal of Chemical Information & Modeling. 2011;51(1):61–8.
- View Article
- Google Scholar
60. Kalisch M, Bühlmann P. Estimating high-dimensional directed acyclic graphs with the PC-algorithm. Journal of Machine Learning Research. 2005;8(2):613–36.
- View Article
- Google Scholar
61. Margaritis D, Thrun S. Bayesian Network Induction via Local Neighborhoods. Advances in Neural Information Processing Systems. 1999;12:505–11.
- View Article
- Google Scholar
62. Tsamardinos I, Aliferis CF, Statnikov AR, editors. Algorithms for Large Scale Markov Blanket Discovery. International Flairs Conference; 2003;376–380.
63. Yaramakala S, Margaritis D, editors. Speculative Markov Blanket Discovery for Optimal Feature Selection. IEEE International Conference on Data Mining; 2005;809–812.
64. Segal E, Shapira M, Regev A, Pe'Er D, Botstein D, Koller D, et al. Module networks: identifying regulatory modules and their condition-specific regulators from gene expression data. Nature Genetics. 2003;34(2):166–76. pmid:12740579
- View Article
- PubMed/NCBI
- Google Scholar
65. Rui L, Pei C, Kazuyuki A, Chen L. Identifying early-warning signals of critical transitions with strong noise by dynamical network markers. Scientific Reports. 2015;5.
- View Article
- Google Scholar
66. Chen L, Liu R, Liu ZP, Li M, Aihara K. Detecting early-warning signals for sudden deterioration of complex diseases by dynamical network biomarkers. Scientific Reports. 2012;2(7391):342–.
- View Article
- Google Scholar
67. Liu R, Wang X, † KA , ‡ LC . Early Diagnosis of Complex Diseases by Molecular Biomarkers, Network Biomarkers, and Dynamical Network Biomarkers. Medicinal Research Reviews. 2014;34(3):455–78. pmid:23775602
- View Article
- PubMed/NCBI
- Google Scholar
68. Rui L, Yu X, Liu X, Dong X, Aihara K, Chen L. Identifying critical transitions of complex diseases based on a single sample. Bioinformatics. 2014;30(11):1579–86. pmid:24519381
- View Article
- PubMed/NCBI
- Google Scholar
69. Zhao J, Zhou Y, Zhang X, Chen L. Part mutual information for quantifying direct associations in networks. Proceedings of the National Academy of Sciences. 2016; 113(18): 5130–5135.
- View Article
- Google Scholar
70. Aghdam R, Ganjali M, Eslahchi C. IPCA-CMI: an algorithm for inferring gene regulatory networks based on a combination of PCA-CMI and MIT score. Plos One. 2014;9(4):e92600. pmid:24728051
- View Article
- PubMed/NCBI
- Google Scholar
71. Altay G, kmen , Emmert-Streib F. Revealing differences in gene network inference algorithms on the network level by ensemble methods. Bioinformatics. 2010;26(14):1738–44. pmid:20501553
- View Article
- PubMed/NCBI
- Google Scholar
72. Schäfer J, Strimmer K. A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Statistical Applications in Genetics & Molecular Biology. 2005;4(1):1–32.
- View Article
- Google Scholar
73. Coluccia A. Regularized Covariance Matrix Estimation via Empirical Bayes. IEEE Signal Processing Letters. 2015;22(11):2127–31.
- View Article
- Google Scholar
74. Wu J, Zhao X, Lin Z, Shao Z. Large scale gene regulatory network inference with a multi-level strategy. Molecular bioSystems. 2015;12(2):588–97.
- View Article
- Google Scholar

[ref1] 1. Levine M, Davidson EH. Gene regulatory networks for development. Proc Natl Acad Sci USA. Proceedings of the National Academy of Sciences. 2005;102(14):4936–42. pmid:15788537
View Article
PubMed/NCBI
Google Scholar

[2] View Article

[3] PubMed/NCBI

[4] Google Scholar

[ref2] 2. Csermely P, Ágoston V, Pongor S. The efficiency of multi-target drugs: the network approach might help drug design. Trends in Pharmacological Sciences. 2005;26(4):178–82. pmid:15808341
View Article
PubMed/NCBI
Google Scholar

[6] View Article

[7] PubMed/NCBI

[8] Google Scholar

[ref3] 3. Friedman N, Linial M, Nachman I, Pe'Er D. Using Bayesian networks to analyze expression data. Journal of Computational Biology A Journal of Computational Molecular Cell Biology. 2000;7(3–4):601–20. pmid:11108481
View Article
PubMed/NCBI
Google Scholar

[10] View Article

[11] PubMed/NCBI

[12] Google Scholar

[ref4] 4. Savoie CJ, Aburatani S, Watanabe S, Eguchi Y, Muta S, Imoto S, et al. Use of gene networks from full genome microarray libraries to identify functionally relevant drug-affected genes and gene regulation cascades. Dna Research. 2003;10(1):19–25. pmid:12693551
View Article
PubMed/NCBI
Google Scholar

[14] View Article

[15] PubMed/NCBI

[16] Google Scholar

[ref5] 5. Hughes TR, Marton MJ, Jones AR, Roberts CJ, Stoughton R, Armour CD, et al. Functional Discovery via a Compendium of Expression Profiles. Cell. 2013;volume 102(1):109–26(18).
View Article
Google Scholar

[18] View Article

[19] Google Scholar

[ref6] 6. Eisen MB, Spellman PT, Brown PO, Botstein D. Botstein D: Cluster analysis and display of genome-wide expression patterns. Proceedings of the National Academy of Sciences of the United States of America. 1998;95(25):14863–8. pmid:9843981
View Article
PubMed/NCBI
Google Scholar

[21] View Article

[22] PubMed/NCBI

[23] Google Scholar

[ref7] 7. Yalamanchili HK, Yan B, Li MJ, Qin J, Zhao Z, Chin FY, et al. DDGni: dynamic delay gene-network inference from high-temporal data using gapped local alignment. Bioinformatics. 2014;30(3):377–83. pmid:24285602
View Article
PubMed/NCBI
Google Scholar

[25] View Article

[26] PubMed/NCBI

[27] Google Scholar

[ref8] 8. Ernst J, Beg QK, Kay KA, Balázsi G, Oltvai ZN, Bar-Joseph Z. A Semi-Supervised Method for Predicting Transcription Factor-Gene Interactions in. Plos Computational Biology. 2008;4(3):e1000044–e. pmid:18369434
View Article
PubMed/NCBI
Google Scholar

[29] View Article

[30] PubMed/NCBI

[31] Google Scholar

[ref9] 9. Kotera M, Yamanishi Y, Moriya Y, Kanehisa M, Goto S. GENIES: gene network inference engine based on supervised analysis. Nucleic Acids Research. 2012;40(Web Server issue):162–7.
View Article
Google Scholar

[33] View Article

[34] Google Scholar

[ref10] 10. Marbach D, Costello JC, Küffner R, Vega NM, Prill RJ, Camacho DM, et al. Wisdom of crowds for robust gene network inference. Nature Methods. 2012;9(8):796–804. pmid:22796662
View Article
PubMed/NCBI
Google Scholar

[36] View Article

[37] PubMed/NCBI

[38] Google Scholar

[ref11] 11. Mordelet F, Vert JP. SIRENE: supervised inference of regulatory networks. Bioinformatics. 2008;24(16):i76–82. pmid:18689844
View Article
PubMed/NCBI
Google Scholar

[40] View Article

[41] PubMed/NCBI

[42] Google Scholar

[ref12] 12. Zare H, Sangurdekar D, Srivastava P, Kaveh M, Khodursky A. Reconstruction of Escherichia coli transcriptional regulatory networks via regulon-based associations. Bmc Systems Biology. 2009;3(6):579–88.
View Article
Google Scholar

[44] View Article

[45] Google Scholar

[ref13] 13. Irrthum A, Wehenkel L, Geurts P. Inferring Regulatory Networks from Expression Data using Tree-based Methods. Plos One. 2010;5(9):4439–51.
View Article
Google Scholar

[47] View Article

[48] Google Scholar

[ref14] 14. Sakamoto E, Iba H. Inferring a system of differential equations for a gene regulatory network by using genetic programming2001. 720–6 vol. 1 p.

[ref15] 15. Tian T, Burrage K. Stochastic models for regulatory networks of the genetic toggle switch. Proceedings of the National Academy of Sciences of the United States of America. 2006;103(22):8372–7. pmid:16714385
View Article
PubMed/NCBI
Google Scholar

[51] View Article

[52] PubMed/NCBI

[53] Google Scholar

[ref16] 16. Zou M, Conzen S. A new dynamic Bayesian network (DBN) approach for identifying gene regulatory networks from time course microarray data. Bioinformatics. 2005;21(1):71–9. pmid:15308537
View Article
PubMed/NCBI
Google Scholar

[55] View Article

[56] PubMed/NCBI

[57] Google Scholar

[ref17] 17. Shmulevich I, Dougherty ER, Kim S, Zhang W. Probabilistic Boolean Networks: a rule-based uncertainty model for gene regulatory networks. Bioinformatics. 2002;18(2):261–74. pmid:11847074
View Article
PubMed/NCBI
Google Scholar

[59] View Article

[60] PubMed/NCBI

[61] Google Scholar

[ref18] 18. Cantone I, Marucci L, Iorio F, Ricci MA, Belcastro V, Bansal M, et al. A Yeast Synthetic Network for In Vivo Assessment of Reverse-Engineering and Modeling Approaches. Cell. 2009;137(1):172–81. pmid:19327819
View Article
PubMed/NCBI
Google Scholar

[63] View Article

[64] PubMed/NCBI

[65] Google Scholar

[ref19] 19. Honkela A, Girardot C, Gustafson EH, Liu YH, Furlong EE, Lawrence ND, et al. Model-based method for transcription factor target identification with limited data. Proceedings of the National Academy of Sciences of the United States of America. 2010;107(17):7793–8. pmid:20385836
View Article
PubMed/NCBI
Google Scholar

[67] View Article

[68] PubMed/NCBI

[69] Google Scholar

[ref20] 20. Zhang X, Liu K, Liu ZP, Duval B, Richer JM, Zhao XM, et al. NARROMI: a noise and redundancy reduction technique improves accuracy of gene regulatory network inference. Bioinformatics. 2013;29(1):106–13. pmid:23080116
View Article
PubMed/NCBI
Google Scholar

[71] View Article

[72] PubMed/NCBI

[73] Google Scholar

[ref21] 21. Zhu H, Rao RS, Zeng T, Chen L. Reconstructing dynamic gene regulatory networks from sample-based transcriptional data. Nucleic Acids Research. 2012;40(21):10657–67. pmid:23002138
View Article
PubMed/NCBI
Google Scholar

[75] View Article

[76] PubMed/NCBI

[77] Google Scholar

[ref22] 22. Akutsu T, Miyano S, Kuhara S. IDENTIFICATION OF GENETIC NETWORKS FROM A SMALL NUMBER OF GENE EXPRESSION PATTERNS UNDER THE BOOLEAN NETWORK MODEL. Pacific Symposium on Biocomputing Pacific Symposium on Biocomputing. 1999:17–28. pmid:10380182
View Article
PubMed/NCBI
Google Scholar

[79] View Article

[80] PubMed/NCBI

[81] Google Scholar

[ref23] 23. Zhu D, Li H. Improved Bayesian Network inference using relaxed gene ordering. International Journal of Data Mining & Bioinformatics. 2010;4(1):44–59.
View Article
Google Scholar

[83] View Article

[84] Google Scholar

[ref24] 24. Krämer N, Schäfer J, Boulesteix AL. Regularized estimation of large-scale gene association networks using graphical Gaussian models. Bmc Bioinformatics. 2009;10(1):1–24.
View Article
Google Scholar

[86] View Article

[87] Google Scholar

[ref25] 25. Menéndez P, Kourmpetis YAI, Braak CJFT, Eeuwijk FAV. Gene Regulatory Networks from Multifactorial Perturbations Using Graphical Lasso: Application to the DREAM4 Challenge. Plos One. 2010;5(12):2010.
View Article
Google Scholar

[89] View Article

[90] Google Scholar

[ref26] 26. Aghdam R, Ganjali M, Zhang X, Eslahchi C. CN: a consensus algorithm for inferring gene regulatory networks using the SORDER algorithm and conditional mutual information test. Molecular bioSystems. 2015;11(3):942–9. pmid:25607659
View Article
PubMed/NCBI
Google Scholar

[92] View Article

[93] PubMed/NCBI

[94] Google Scholar

[ref27] 27. Husmeier D. Sensitivity and specificity of inferring genetic regulatory interactions from microarray experiments with dynamic Bayesian networks. Bioinformatics. 2003;19(17):2271–82. pmid:14630656
View Article
PubMed/NCBI
Google Scholar

[96] View Article

[97] PubMed/NCBI

[98] Google Scholar

[ref28] 28. Nair A, Chetty M, Wangikar PP. Improving gene regulatory network inference using network topology information. Molecular bioSystems. 2015;11(9):2449–63. pmid:26126758
View Article
PubMed/NCBI
Google Scholar

[100] View Article

[101] PubMed/NCBI

[102] Google Scholar

[ref29] 29. Wilczynski B, Dojer N. BNFinder: exact and efficient method for learning Bayesian networks. Bioinformatics. 2008;25(2):286–7. pmid:18826957
View Article
PubMed/NCBI
Google Scholar

[104] View Article

[105] PubMed/NCBI

[106] Google Scholar

[ref30] 30. Vinh NX, Chetty M, Coppel R, Wangikar PP. GlobalMIT: learning globally optimal dynamic bayesian network with the mutual information test criterion. Bioinformatics. 2011;27(19):2765–6. pmid:21813478
View Article
PubMed/NCBI
Google Scholar

[108] View Article

[109] PubMed/NCBI

[110] Google Scholar

[ref31] 31. Zhang X, Zhao J, Hao JK, Zhao XM, Chen L. Conditional mutual inclusive information enables accurate quantification of associations in gene regulatory networks. Nucleic Acids Research. 2015;43(5):e31–e. pmid:25539927
View Article
PubMed/NCBI
Google Scholar

[112] View Article

[113] PubMed/NCBI

[114] Google Scholar

[ref32] 32. Chaitankar V, Ghosh P, Perkins EJ, Gong P, Zhang C. Time lagged information theoretic approaches to the reverse engineering of gene regulatory networks. Bmc Bioinformatics. 2010;11(Suppl6):1–14.
View Article
Google Scholar

[116] View Article

[117] Google Scholar

[ref33] 33. Faith JJ, Hayete B, Thaden JT, Mogno I, Wierzbowski J, Cottarel G, et al. Large-Scale Mapping and Validation of Escherichia coli Transcriptional Regulation from a Compendium of Expression Profiles. Plos Biology. 2007;5(1):e8–e. pmid:17214507
View Article
PubMed/NCBI
Google Scholar

[119] View Article

[120] PubMed/NCBI

[121] Google Scholar

[ref34] 34. Liang S, Fuhrman S, Somogyi R. Reveal, a general reverse engineering algorithm for inference of genetic network architectures. Pacific Symposium on Biocomputing Pacific Symposium on Biocomputing. 1998;1998(4):18–29.
View Article
Google Scholar

[123] View Article

[124] Google Scholar

[ref35] 35. Luo W, Hankenson KD, Woolf PJ. Learning transcriptional regulatory networks from high throughput gene expression data using continuous three-way mutual information. Bmc Bioinformatics. 2008;9(1):1–15.
View Article
Google Scholar

[126] View Article

[127] Google Scholar

[ref36] 36. Margolin AA, Nemenman I, Basso K, Wiggins C, Stolovitzky G, Favera RD, et al. ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context. Bmc Bioinformatics. 2006;7(2):: S7.
View Article
Google Scholar

[129] View Article

[130] Google Scholar

[ref37] 37. Kai W, Saito M, Bisikirska BC, Alvarez MJ, Wei KL, Rajbhandari P, et al. Genome-wide identification of post-translational modulators of transcription factor activity in human B cells. Nature Biotechnology. 2009;27(9):829–39. pmid:19741643
View Article
PubMed/NCBI
Google Scholar

[132] View Article

[133] PubMed/NCBI

[134] Google Scholar

[ref38] 38. Zhang X, Zhao XM, He K, Lu L, Cao Y, Liu J, et al. Inferring gene regulatory networks from gene expression data by path consistency algorithm based on conditional mutual information. Bioinformatics. 2012;28(1):98–104. pmid:22088843
View Article
PubMed/NCBI
Google Scholar

[136] View Article

[137] PubMed/NCBI

[138] Google Scholar

[ref39] 39. Zhou C, Zhang SW, Liu F. An ensemble method for reconstructing gene regulatory network with jackknife resampling and arithmetic mean fusion. International Journal of Data Mining & Bioinformatics. 2015;12(3).
View Article
Google Scholar

[140] View Article

[141] Google Scholar

[ref40] 40. Villaverde AF, Ross J, Banga JR. Reverse engineering cellular networks with information theoretic methods. Cells. 2013;2(2):306–29. pmid:24709703
View Article
PubMed/NCBI
Google Scholar

[143] View Article

[144] PubMed/NCBI

[145] Google Scholar

[ref41] 41. López-Kleine L, Leal L, López C. Biostatistical approaches for the reconstruction of gene co-expression networks based on transcriptomic data. Briefings in Functional Genomics. 2013;12(5):457–67. pmid:23407269
View Article
PubMed/NCBI
Google Scholar

[147] View Article

[148] PubMed/NCBI

[149] Google Scholar

[ref42] 42. Basso K, Margolin AA, Stolovitzky G, Klein U, Dallafavera R, Califano A. Reverse engineering of regulatory networks in human B cells. Nature Genetics. 2005;37(4):382–90. pmid:15778709
View Article
PubMed/NCBI
Google Scholar

[151] View Article

[152] PubMed/NCBI

[153] Google Scholar

[ref43] 43. Modi SR, Camacho DM, Kohanski MA, Walker GC, Collins JJ. Functional characterization of bacterial sRNAs using a network biology approach. Proceedings of the National Academy of Sciences of the United States of America. 2011;108(37):15522–7. pmid:21876160
View Article
PubMed/NCBI
Google Scholar

[155] View Article

[156] PubMed/NCBI

[157] Google Scholar

[ref44] 44. Wang J, Chen B, Wang Y, Wang N, Garbey M, Tran-Son-Tay R, et al. Reconstructing regulatory networks from the dynamic plasticity of gene expression by mutual information. Nucleic Acids Research. 2013;41(8):395–408.
View Article
Google Scholar

[159] View Article

[160] Google Scholar

[ref45] 45. Sumazin P, Yang X, Chiu HS, Chung WJ, Iyer A, Llobet-Navas D, et al. An Extensive MicroRNA-Mediated Network of RNA-RNA Interactions Regulates Established Oncogenic Pathways in Glioblastoma. Cancer Research. 2012;72(8 Supplement):4186–.
View Article
Google Scholar

[162] View Article

[163] Google Scholar

[ref46] 46. Madhamshettiwar PB, Maetschke SR, Davis MJ, Reverter A, Ragan MA. Gene regulatory network inference: evaluation and application to ovarian cancer allows the prioritization of drug targets. Genome Medicine. 2012;4(5):41.1–.15.
View Article
Google Scholar

[165] View Article

[166] Google Scholar

[ref47] 47. Cerulo L, Elkan C, Ceccarelli M. Learning gene regulatory networks from only positive and unlabeled data. Bmc Bioinformatics. 2010;11(1):: 228.
View Article
Google Scholar

[168] View Article

[169] Google Scholar

[ref48] 48. De SR, Marchal K. Advantages and limitations of current network inference methods. Nature Reviews Microbiology. 2010;8(10):717–29. pmid:20805835
View Article
PubMed/NCBI
Google Scholar

[171] View Article

[172] PubMed/NCBI

[173] Google Scholar

[ref49] 49. Pei B, Rowe DW, Shin DG. Learning Bayesian networks with integration of indirect prior knowledge. International Journal of Data Mining & Bioinformatics. 2010;4(5):505–19.
View Article
Google Scholar

[175] View Article

[176] Google Scholar

[ref50] 50. Chickering DM, Heckerman D, Meek C, editors. Large-Sample Learning of Bayesian Networks is NP-Hard. Nineteenth Conference on Uncertainty in Artificial Intelligence; 2002.

[ref51] 51. Barzel B. Network link prediction by global silencing of indirect correlations. Nature Biotechnology. 2013;31(8):720–5. pmid:23851447
View Article
PubMed/NCBI
Google Scholar

[179] View Article

[180] PubMed/NCBI

[181] Google Scholar

[ref52] 52. Feizi S, Marbach D, Médard M, Kellis M. Network deconvolution as a general method to distinguish direct dependencies in networks. Nature Biotechnology. 2013;31(8):726–33. pmid:23851448
View Article
PubMed/NCBI
Google Scholar

[183] View Article

[184] PubMed/NCBI

[185] Google Scholar

[ref53] 53. Schaffter T, Marbach D, Floreano D. GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods. Bioinformatics. 2011;27(16):2263–70. pmid:21697125
View Article
PubMed/NCBI
Google Scholar

[187] View Article

[188] PubMed/NCBI

[189] Google Scholar

[ref54] 54. Marbach D, Prill RJ, Schaffter T, Mattiussi C, Floreano D, Stolovitzky G. Revealing strengths and weaknesses of methods for gene network inference. Proceedings of the National Academy of Sciences of the United States of America. 2010;107(14):6286–91. pmid:20308593
View Article
PubMed/NCBI
Google Scholar

[191] View Article

[192] PubMed/NCBI

[193] Google Scholar

[ref55] 55. Ronen M, Rosenberg R, Shraiman BI, Alon U. Assigning numbers to the arrows: parameterizing a gene regulation network by using accurate expression kinetics. Proceedings of the National Academy of Sciences of the United States of America. 2002;99(16):10555–60. pmid:12145321
View Article
PubMed/NCBI
Google Scholar

[195] View Article

[196] PubMed/NCBI

[197] Google Scholar

[ref56] 56. Shen-Orr SS, Milo R, Mangan S, Alon U. Network motifs in the transcriptional regulation network of Escherichia coli. Nature Genetics. 2002;31(1):64–8. pmid:11967538
View Article
PubMed/NCBI
Google Scholar

[199] View Article

[200] PubMed/NCBI

[201] Google Scholar

[ref57] 57. Faith JJ, Driscoll ME, Fusaro VA, Cosgrove EJ, Hayete B, Juhn FS, et al. Many Microbe Microarrays Database: uniformly normalized Affymetrix compendia with structured experimental metadata. Nucleic Acids Research. 2008;36(36):866–70.
View Article
Google Scholar

[203] View Article

[204] Google Scholar

[ref58] 58. Gama-Castro S, Salgado H, Peralta-Gil M, Santos-Zavaleta A, Muñiz-Rascado L, Solano-Lira H, et al. RegulonDB version 7.0: transcriptional regulation of. Nucleic Acids Research. 2011;39(Database issue):98–105.
View Article
Google Scholar

[206] View Article

[207] Google Scholar

[ref59] 59. Saito S, Hirokawa T, Horimoto K. Discovery of chemical compound groups with common structures by a network analysis approach (affinity prediction method). Journal of Chemical Information & Modeling. 2011;51(1):61–8.
View Article
Google Scholar

[209] View Article

[210] Google Scholar

[ref60] 60. Kalisch M, Bühlmann P. Estimating high-dimensional directed acyclic graphs with the PC-algorithm. Journal of Machine Learning Research. 2005;8(2):613–36.
View Article
Google Scholar

[212] View Article

[213] Google Scholar

[ref61] 61. Margaritis D, Thrun S. Bayesian Network Induction via Local Neighborhoods. Advances in Neural Information Processing Systems. 1999;12:505–11.
View Article
Google Scholar

[215] View Article

[216] Google Scholar

[ref62] 62. Tsamardinos I, Aliferis CF, Statnikov AR, editors. Algorithms for Large Scale Markov Blanket Discovery. International Flairs Conference; 2003;376–380.

[ref63] 63. Yaramakala S, Margaritis D, editors. Speculative Markov Blanket Discovery for Optimal Feature Selection. IEEE International Conference on Data Mining; 2005;809–812.

[ref64] 64. Segal E, Shapira M, Regev A, Pe'Er D, Botstein D, Koller D, et al. Module networks: identifying regulatory modules and their condition-specific regulators from gene expression data. Nature Genetics. 2003;34(2):166–76. pmid:12740579
View Article
PubMed/NCBI
Google Scholar

[220] View Article

[221] PubMed/NCBI

[222] Google Scholar

[ref65] 65. Rui L, Pei C, Kazuyuki A, Chen L. Identifying early-warning signals of critical transitions with strong noise by dynamical network markers. Scientific Reports. 2015;5.
View Article
Google Scholar

[224] View Article

[225] Google Scholar

[ref66] 66. Chen L, Liu R, Liu ZP, Li M, Aihara K. Detecting early-warning signals for sudden deterioration of complex diseases by dynamical network biomarkers. Scientific Reports. 2012;2(7391):342–.
View Article
Google Scholar

[227] View Article

[228] Google Scholar

[ref67] 67. Liu R, Wang X, † KA , ‡ LC . Early Diagnosis of Complex Diseases by Molecular Biomarkers, Network Biomarkers, and Dynamical Network Biomarkers. Medicinal Research Reviews. 2014;34(3):455–78. pmid:23775602
View Article
PubMed/NCBI
Google Scholar

[230] View Article

[231] PubMed/NCBI

[232] Google Scholar

[ref68] 68. Rui L, Yu X, Liu X, Dong X, Aihara K, Chen L. Identifying critical transitions of complex diseases based on a single sample. Bioinformatics. 2014;30(11):1579–86. pmid:24519381
View Article
PubMed/NCBI
Google Scholar

[234] View Article

[235] PubMed/NCBI

[236] Google Scholar

[ref69] 69. Zhao J, Zhou Y, Zhang X, Chen L. Part mutual information for quantifying direct associations in networks. Proceedings of the National Academy of Sciences. 2016; 113(18): 5130–5135.
View Article
Google Scholar

[238] View Article

[239] Google Scholar

[ref70] 70. Aghdam R, Ganjali M, Eslahchi C. IPCA-CMI: an algorithm for inferring gene regulatory networks based on a combination of PCA-CMI and MIT score. Plos One. 2014;9(4):e92600. pmid:24728051
View Article
PubMed/NCBI
Google Scholar

[241] View Article

[242] PubMed/NCBI

[243] Google Scholar

[ref71] 71. Altay G, kmen , Emmert-Streib F. Revealing differences in gene network inference algorithms on the network level by ensemble methods. Bioinformatics. 2010;26(14):1738–44. pmid:20501553
View Article
PubMed/NCBI
Google Scholar

[245] View Article

[246] PubMed/NCBI

[247] Google Scholar

[ref72] 72. Schäfer J, Strimmer K. A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Statistical Applications in Genetics & Molecular Biology. 2005;4(1):1–32.
View Article
Google Scholar

[249] View Article

[250] Google Scholar

[ref73] 73. Coluccia A. Regularized Covariance Matrix Estimation via Empirical Bayes. IEEE Signal Processing Letters. 2015;22(11):2127–31.
View Article
Google Scholar

[252] View Article

[253] Google Scholar

[ref74] 74. Wu J, Zhao X, Lin Z, Shao Z. Large scale gene regulatory network inference with a multi-level strategy. Molecular bioSystems. 2015;12(2):588–97.
View Article
Google Scholar

[255] View Article

[256] Google Scholar

Figures

Abstract

Author Summary

Introduction

Results and Discussion

Datasets and evaluation metrics

Evaluating simulation datasets

Inferring SOS network and gene regulatory interactions in E. coli

Effects of the strategies of network decomposition and false-positive edge deletion

Effects of the threshold parameters

Analysis of LBN computational complexity

Conclusions

Methods

MI and CMI

Bayesian networks

k-nearest neighbor

LBN algorithm

Step 1: Construct the initial network by CMI.

Step 2: Decompose GMI into n sub-networks or local networks by kNN.

Step 3: Construct local BNs by estimating the gene regulations and integrate local BNs into a candidate network.

Step 4: Construct tentative network by eliminating the redundant regulations by CMI.

Step 5: Decompose GC into N smaller networks or local networks.

Author Contributions

References

Step 2: Decompose G_MI into n sub-networks or local networks by kNN.

Step 5: Decompose G_C into N smaller networks or local networks.