Skip to main content
Advertisement
  • Loading metrics

LRSSLMDA: Laplacian Regularized Sparse Subspace Learning for MiRNA-Disease Association prediction

  • Xing Chen ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

    xingchen@amss.ac.cn

    ‡ These authors share first authorship on this work.

    Affiliation School of Information and Control Engineering, China University of Mining and Technology, Xuzhou, China

  • Li Huang

    Roles Conceptualization, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    ‡ These authors share first authorship on this work.

    Affiliation Business Analytics Centre, National University of Singapore, Singapore

Abstract

Predicting novel microRNA (miRNA)-disease associations is clinically significant due to miRNAs’ potential roles of diagnostic biomarkers and therapeutic targets for various human diseases. Previous studies have demonstrated the viability of utilizing different types of biological data to computationally infer new disease-related miRNAs. Yet researchers face the challenge of how to effectively integrate diverse datasets and make reliable predictions. In this study, we presented a computational model named Laplacian Regularized Sparse Subspace Learning for MiRNA-Disease Association prediction (LRSSLMDA), which projected miRNAs/diseases’ statistical feature profile and graph theoretical feature profile to a common subspace. It used Laplacian regularization to preserve the local structures of the training data and a L1-norm constraint to select important miRNA/disease features for prediction. The strength of dimensionality reduction enabled the model to be easily extended to much higher dimensional datasets than those exploited in this study. Experimental results showed that LRSSLMDA outperformed ten previous models: the AUC of 0.9178 in global leave-one-out cross validation (LOOCV) and the AUC of 0.8418 in local LOOCV indicated the model’s superior prediction accuracy; and the average AUC of 0.9181+/-0.0004 in 5-fold cross validation justified its accuracy and stability. In addition, three types of case studies further demonstrated its predictive power. Potential miRNAs related to Colon Neoplasms, Lymphoma, Kidney Neoplasms, Esophageal Neoplasms and Breast Neoplasms were predicted by LRSSLMDA. Respectively, 98%, 88%, 96%, 98% and 98% out of the top 50 predictions were validated by experimental evidences. Therefore, we conclude that LRSSLMDA would be a valuable computational tool for miRNA-disease association prediction.

Author summary

Discovering miRNA-disease associations promotes the understanding towards the molecular mechanisms of various human diseases at the miRNA level, and contributes to the development of diagnostic biomarkers and treatment tools for diseases. Computational models can make the discovery more efficient and experiments more productive. LRSSLMDA was proposed to computationally infer potential miRNA-disease associations via adopting sparse subspace learning with Laplacian regularization on the known miRNA-disease association network and the informative feature profiles extracted from the integrated miRNA/disease similarity networks. Experimental results in global and local leave-one-out cross validation and 5-fold cross validation showed a superior prediction performance of LRSSLMDA over previous models. Moreover, three types of case studies on five important human diseases were carried out to further demonstrate the model’s predictive power: respectively, 98%, 88%, 96%, 98% and 98% out of the top 50 predicted miRNAs were confirmed by experimental literatures. So, we believe that LRSSLMDA could make reliable predictions and might guide future experimental studies on miRNA-disease associations.

This is a PLOS Computational Biology Methods paper.

Introduction

MicroRNAs (miRNAs) are small (about 22 nucleotides) non-coding RNAs that regulate gene expression [1]. They normally cleave or translationally repress their target messenger RNAs (mRNAs) via base-pairing to the 3’ untranslated region (UTR) sites of the mRNAs [25], thereby influencing various biological processes including cell proliferation, development, differentiation, death, apoptosis, metabolism, aging, signal transduction and viral infection [3,611]. In addition, increasing studies have indicated a correlation between miRNAs and human diseases [1219]. For example, the expression level of miR-195 is lowered in Alzheimer’s disease (AD) patients and the AD amyloid-β production could be downregulated by over-expressing this miRNA [20]. Another miRNA mir-26a contributes to the migration of Lung Neoplasms (LN) cells through modulating the expression of metastasis-related genes and suppressing phosphatase and tensin homolog (PTEN) to activate the Protein Kinase B (AKT) pathway [21]. In contrast, miR-145 is under-expressed in LN patients and its restoration inhibits the LN cell proliferation by targeting the EGFR and NUDT1 genes [22]. A further example of miRNA-disease association is miR-501 in Hepatitis B viruses (HBV). Knockdown of this miRNA in the HBV-producing cell line HepG2.2.15 could significantly reduce HBV replication [23]. These miRNAs and many other disease-associated ones may serve as biomarkers for disease diagnosis, progression, prognosis and treatment response [2427]. Thus, identifying miRNA-disease associations promotes the understanding of complex human diseases and benefits disease treatment. Experimental methods such as microarray profiling and qRTPCR have been used to discover miRNA-disease associations [28]. But they suffer from false-positive microarray results [25,2830] and are time-consuming and expensive, especially due to the high probe design cost [28]. Fortunately, the large amount of biological data enables researches to develop computational models for predicting disease-related miRNAs. The potential miRNAs are prioritized in terms of prediction scores and the most promising ones are selected for biological verification. This approach complements experimental methods, improving the accuracy of association identification and reducing time and cost.

Remarkable progresses have been achieved in developing prediction models for potential disease-miRNA associations in the past. Most models were based on the assumption that miRNAs with similar functions tend to be associated with phenotypically similar diseases [3133]. Many previous models were based on network analysis algorithms. An early model for predicting disease-related miRNAs was devised by Jiang et al. [34] and it integrated the miRNA functional similarity network, the disease phenotype similarity network and the known disease-miRNA association network. The potential miRNA-disease associations were scored according to a discrete hypergeometric probability distribution. However, the model only considered each miRNA’s neighbor information rather than global similarity measures. Then, Chen et al. [35] proposed RWRMDA where novel miRNA-disease associations were predicted by implementing random walking with restart on the miRNA functional similarity network. Although the model achieved an improved prediction accuracy compared with previous models, it was unable to prioritize miRNAs for diseases without any known related miRNAs. Later, Xuan et al. [28] developed HDMP, a model that integrated the known miRNA-disease associations and the miRNA functional similarity calculated by incorporating the information content of disease terms and phenotype similarity between diseases. When scoring miRNA-disease pairs, the model included the information of each miRNA’s k most similar neighbors and assigned higher weights to miRNAs within the same cluster or family. However, HDMP faced the same problem of failing to predict potential miRNAs related to new diseases without any known associated miRNAs. Subsequently, Shi et al. [36] devised another random walk model with a focus on the functional link between miRNA targets and disease genes in a protein-protein interaction (PPI) network. In addition, miRNA-disease co-regulated modules were identified via a hierarchical clustering analysis of a bipartite miRNA-disease network. Nonetheless, involving known disease-gene associations and miRNA-target interactions in the computation impaired the model’s prediction accuracy, since 60% of human diseases have unknown molecular bases [37] and the miRNA-target interactions contain a high rate of false-positive and high false-negative results [35]. Mork et al. [38] used a protein-driven approach named miRPD to infer miRNA-protein-disease associations. The model provided not only the potential associations between miRNAs and diseases but also the protein links between them. To make the inference, known and predicted protein-miRNA interactions were coupled with protein-disease associations text-mined from experimental literatures. Then the inferred miRNA-protein-disease associations were ranked by confidence under two scoring schemes; and the ranking results were divided into a high-confidence subset holding the most probable associations and a medium-confidence subset including the less likely associations. Xuan et al. [39] further introduced a random walk model named MIDP that exploited the prior information of nodes and various ranges of topologies in a miRNA-disease bilayer network derived from the miRNA functional similarity network, the disease semantic similarity network, and the edges between the two networks. With an extended walk on the network, the model overcame the limitations of previous models and could make association predictions for diseases that has no known related miRNAs. Furthermore, the negative effect of noisy data was mitigated via adjusting the restart rate of the random walk. To improve the prediction accuracy, Chen et al. [40] released WBSMDA that calculated and combined the within and between scores from the views of miRNAs and diseases in a composite network, built from the known miRNA-disease associations, the miRNA functional similarity, the disease semantic similarity and the Gaussian interaction profile kernel similarity networks for diseases and miRNAs. Gu et al. [41] developed a non-parametric universal network-based model named NCPMDA. In this model, a miRNA similarity network was constructed by combining the miRNA functional similarity, the Jaccard miRNA similarity of the known miRNA-disease associations and the miRNA family information; and a disease similarity network was built by integrating the disease semantic similarity and the Jaccard disease similarity of the known associations. Then, network consistency projection was carried out on the miRNA similarity network to the adjacency matrix of miRNA-disease associations, and on the disease similarity network to the adjacency matrix, respectively. Lastly, the miRNA space projection scores and the disease space projection scores were combined and normalized to give the final prediction scores. Chen et al. [42] further presented HGIMDA in which a heterogeneous graph network was constructed using the same model inputs as WBSMDA. Then, an iterative process was carried out in the network until a stable association probability matrix was obtained. Following HGIMDA, MCMDA was published by Li et al. [43] utilizing a matrix completion algorithm on the low-rank miRNA-disease association matrix. The candidate miRNA-disease pairs in the matrix were iteratively updated with predictive association scores, yielding highly reliable outcomes. Yu et al. [44] proposed a combinatorial prioritization algorithm named MaxFlow. The model’s input included the miRNA functional similarity network, the disease semantic and phenotypic similarity network, and the heterogeneous miRNA-disease association network that integrated miRNA-disease associations, the miRNA family information and the miRNA cluster information. Subsequently, these three networks were further combined to form a directed miRNAome-phenome network graph, where the weight of each link was regarded as the flow capacity. For an investigated disease, a source node and a sink node were introduced to this graph; and the maximum information flow from the source over all links to the sink were calculated using the push-relabel maximum flow algorithm. The flow quantity leaving a miRNA node was used as the association score between the miRNA and the investigated disease. More recently, You et al. [45] devised path-based model named PBMDA, where a heterogeneous graph were built from the same input datasets as those in WBSMDA. In the graph, all paths between a miRNA-disease pair were traversed via the adoption of the depth-first search algorithm; and each path’s score was computed by multiplying all the edges’ weights along the path. For a longer path, the score would be penalized by a distance-decay function. The sum of scores for all the paths were used as the association score for the miRNA-disease pair.

In addition, other previous models were based on machine learning algorithms. Xu et al. [46] used a support vector machine classifier to separate positive and negative miRNA-disease associations in a heterogeneous miRNA-target dysregulated network (MTDN). Negative samples were required to train the model. However, finding negative miRNA-disease associations is a difficult or even impossible task [42], meaning that the prediction accuracy might be reduced because the model is learned from inappropriate training samples. To address this problem, Chen et al. [47] applied semi-supervised learning (RLSMDA) to the inference of miRNA-disease associations and only using positive samples would suffice the model-training. The ensuing model was RBMMMDA authored by Chen et al. [48]. Restricted Boltzmann machine was implemented to predict four different types of miRNA-disease associations from a two-layered (with visible and hidden units) undirected miRNA-disease graph. RBMMMDA was the first model not only prioritizing potential associations but also providing the corresponding association types. A more recent model developed by Chen et al. [49] was ranking-based k-nearest neighbors for miRNA-disease association prediction (RKNNMDA). It was a three-staged approach: initially running the k-nearest neighbors algorithm for miRNAs and diseases, then carrying out SVM Ranking to rank the neighbors and lastly weighted-voting for both miRNAs and diseases to reduce the prediction bias. Later, Pasquier et al. [50] introduced a vector space model named MiRAI that formed a large network via concatenating five association networks, namely, the miRNA-disease association network, the miRNA-neighbor association network with edges weighted by the genomic distance between two miRNA nodes, the miRNA-target association network, the miRNA-word association network with edges weighted by the term frequency–inverse document frequency (TF-IDF) information retrieval scheme on investigated miRNAs’ associated documents, and the miRNA-family association network. Then, the large combined network was decomposed by Singular Value Decomposition (SVD) into the form of UΣVT, where the columns of U were the left-singular vectors, Σ was the matrix of nonnegative real numbers on the diagonal, and the columns of V were the right-singular vectors. The association score for a miRNA-disease pair was calculated by the cosine similarity between the vector of the miRNA in the miRNA space (U) and the vector of the disease in the disease space (a part of V).

The above mentioned models had their own strengths and uniqueness, while several of them suffered from obvious weaknesses. More importantly, although most models exhibited a sound prediction accuracy, there still exist areas for a continued improvement. When informative feature profiles were extracted from the training data, the challenge would be how to achieve a single classifier that reasonably combine multiple profile spaces. Hence in this study we presented a model of Laplacian Regularized Sparse Subspace Learning for MiRNA-Disease Association prediction (LRSSLMDA) to meet the challenge. The Gaussian interaction profile kernel similarity for miRNA and diseases was computed and integrated with the miRNA functional similarity and the disease semantic similarity. Although the Gaussian interaction profile kernel similarity had been successfully used by Chen et al. [51] in the LRLSLDA model for lncRNA-disease association prediction, their data preparation process was different from that in our study. For LRLSLDA, data preparation involved the lncRNA expression similarity and the lncRNA-disease associations; and the disease semantic similarity was not used. The Gaussian interaction profile kernel similarity for diseases and lncRNAs were computed from the lncRNA-disease associations. Then, the disease similarity was calculated by performing logistic function transformation on the Gaussian interaction profile kernel similarity for diseases; and the integrated similarity for lncRNAs was built by combining the Gaussian interaction profile kernel similarity for lncRNAs and the lncRNA expression similarity. Moreover, a weight coefficient was used in the integrated similarity for lncRNAs. From this, it is apparent that our model and LRLSLDA had different data preparation processes. In addition, constructing the integrated similarity for diseases and miRNAs was only the first step of our model’s data preparation. As the ensuing and important step, feature extraction was performed on the integrated similarity to form the statistical profile and the graph theoretical profile, and these two informative feature profiles were a key to the success of LRSSLMDA. Subsequently, the model used sparse subspace learning to map high dimensional miRNA/disease spaces into a lower dimensional subspace; and it used Laplacian regularization to smooth the subspace and maintain the local structures of the high dimensional spaces. The combination of these two techniques has been successfully applied to web image categorization by Shi et al.’s [52] and drug-target interaction prediction by Liang et al. [53]. But different from Liang et al.’s model, our model made effective predictions with fewer input datasets, exploited informative disease-related feature profiles, and could be applied to diseases without known associations. LRSSLMDA achieved effective dimensionality reduction and could simultaneously analyze a large amount of unlabeled data and a small amount of labeled data. The model was evaluated in three cross validation schemes and three types of case studies on five diseases. In local leave-one-out cross validation (LOOCV), global LOOCV and 5-fold cross validation, LRSSLMDA outperformed ten previous models; and for each disease in case studies, our model predicted the top 50 potentially associated miRNAs and most of the predictions were confirmed by experimental literatures.

Materials and methods

Human miRNA-disease associations

HMDD v2.0 is a human miRNA-disease association database that records 5430 experimentally supported associations between 495 miRNAs and 383 diseases (See S2 Table). We used nm to denote the number of miRNAs, nd for the number of diseases and MDA for the nm × nd adjacency matrix made up of the nm miRNAs and the nd diseases. If miRNA m(i) had a known association to disease d(j), the entity MDA(m(i), d(j)) would equal to 1, and otherwise 0.

MiRNA functional similarity

MiRNA functional similarity scores used in our study were retrieved from http://www.cuilab.cn/files/images/cuilab/misim.zip and computed based on the hypothesis that miRNAs with a functional similarity are more likely to correlate with diseases with a phenotypical similarity [54]. A nm × nm miRNA functional similarity network FS was constructed with weighted edges. An entity FS(m(i), m(j)) denoted the functional similarity score between miRNA m(i) and m(j).

Disease semantic similarity

As illustrated in the literature [28], the semantic information of disease d(i) was explained by a Directed Acyclic Graph (DAG) where d(i) and its ancestor diseases were used as nodes. The DAGs were retrieved from the U.S. National Library of Medicine (MeSH) at https://www.nlm.nih.gov/mesh/. The relationship between a parent node and a child node was represented by a directed edge pointing from the former to the latter. For disease t in DAG(d(i)), its contribution to the semantic value of d(i) was computed by (1)

The rationale behind (1) was that a greater contribution should be made by a more specific disease t to the semantic value of d(i). Summing up all the contributions from d(i)’s ancestor diseases and itself gave its semantic value (2) where D(d(i)) denoted the node set in DAG(d(i)). Subsequently, the semantic similarity between disease d(i) and d(j) was defined by: (3)

This equation implied that two diseases with a greater overlap of their DAGs would exhibit a higher semantic similarity score between them.

Gaussian interaction profile kernel similarity for miRNAs

According to [55], the Gaussian kernel similarity between miRNA m(i) and miRNA m(j) was calculated as follows. Respectively, binary interaction profile vectors IP(m(i)) and IP(m(j)) were used to represent the ith column and the jth column of MDA and were then fed into the Gaussian interaction profile kernel similarity matrix for miRNAs, KM (4) where γm was the bandwidth parameter for the function. It was defined by another parameter γm and the average number of associated diseases for all miRNAs (5)

Same to previous literatures [51,55], both the values of γm and γm were set to 1 for the simplicity of calculations.

Gaussian interaction profile kernel similarity for diseases

Similar to miRNAs, the diseases’ Gaussian interaction profile kernel similarity matrix KD was calculated by (6) where binary interaction profile vectors IP(d(i)) and IP(d(j)) denoted the ith row and the jth row of MDA; and γd was the bandwidth parameter defined by another parameter γd and the average number of associated miRNAs for all diseases (7)

Again, as with the literatures [51,55], in our study we set the values of γd and γd to 1 to make the calculations simple.

Integrated miRNA similarity and diseases

The miRNA functional similarity matrix FS and the Gaussian interaction profile kernel similarity matrix KM were integrated to form a more comprehensive similarity measure, which was the integrated similarity matrix for miRNAs SM (8)

This means that if miRNA m(i) and m(j) had a functional similarity, we chose their corresponding score in FS to be their integrated similarity score; otherwise, we chose instead their Gaussian kernel similarity score obtained from (4).

Similarly, the disease integrated similarity matrix SD was obtained from the disease semantic similarity matrix SS and the Gaussian interaction profile kernel similarity matrix KD (9)

LRSSLMDA

In this study, we developed LRSSLMDA to uncover potential miRNA-disease associations. The model inputs included the miRNA-disease association matrix MDA, the miRNA functional similarity matrix FS and the disease semantic similarity matrix SS. The procedure of implementing LRSSLMDA involved data preparation, model formulation and optimization, as depicted in Fig 1. In data preparation, the integrated similarity matrices SM/SD were constructed according to (8) and (9), respectively, before being used to form two types of feature profiles for miRNAs/diseases. The idea of performing feature extraction on similarity networks to obtain feature profiles originated from the literature [56]. In our study, the first type of profile summarized SM/SD from a statistical perspective, so it was known as the statistical profile. For miRNA m(i)/disease d(j), we calculated

thumbnail
Fig 1. Flowchart of potential miRNA-disease association prediction based on the computational model of LRSSLMDA.

1) data preparation, where statistical and graph theoretical features for miRNAs/diseases were extracted and graph Laplacian matrices were formed; 2) model formation, where a common subspace for the miRNA/disease profiles, a L1-norm constraint and Laplacian regularization terms were joint to construct the LRSSLMDA model; 3) optimization, where the projection matrices were iteratively updated, the controlling parameter was renewed and they were combined to yield the prediction outcomes from the miRNA/disease perspective. The final predictions were made according to whether the investigated miRNA/disease had known associated diseases/miRNAs or not.

https://doi.org/10.1371/journal.pcbi.1005912.g001

  • n.obs, the number of observed associations in the corresponding ith row/jth column of MDA, namely, the sum of the ith row/jth column of MDA for miRNA m(i)/disease d(j). The rationale for using this metric was as follows. When making predictions for a specific miRNA m(i)/disease d(j), our method would analyze not only m(i)/d(j)’s known associated diseases/miRNAs but also these diseases/miRNAs’ similar diseases/miRNAs. The more known associated diseases/miRNAs m(i)/d(j) had, the more data would be analyzed to support the predictions for m(i)/d(j). Therefore, a higher value of n.obs for a miRNA/disease indicated that more reliable predictions would likely be made for the miRNA/disease.
  • ave.sim, the average of similarity scores for miRNA m(i)/disease d(j), namely, the average of the ith/jth row of SM/SD
  • s.d.sim, the standard deviation of similarity scores for miRNA m(i)/disease d(j)
  • min.sim, the minimum of similarity scores for miRNA m(i)/disease d(j)
  • first.q.sim, the first quantile value of similarity scores for miRNA m(i) /disease d(j)
  • median.sim, the median of similarity scores for miRNA m(i) /disease d(j)
  • third.q.sim, the third quantile value of similarity scores for miRNA m(i) /disease d(j)
  • max.sim, the maximum of similarity scores for miRNA m(i) /disease d(j)
  • hist.sim, the histogram feature; the range of similarity scores [0, 1] was segmented into n bins (n equaled 10 in this study) and we counted the proportion of similarity scores for m(i)/d(j) that fell into each bin

The second type of profile described SM/SD using graph theories, hence was named graph theoretical profiles. We converted SM/SD into an unweighted graph version: miRNA m(i)/disease d(j) now became a node in the graph; and an edge would form between two nodes if their similarity score surpassed the mean value of all entities. For each node in the unweighted graph version of SM/SD, we calculated

  • num.nb, the number of neighbors of the node
  • k.sim, the similarity values of the k-nearest neighbors of the node (k equaled 10 in this study, so this was a vector of 10 elements)
  • k.ave.feat, the average of statistical features (defined in the statistical profile) for the k-nearest neighbors of the node
  • k.w.ave.feat, the average of statistical features for the k-nearest neighbors of the node weighted by the neighbors’ similarity scores
  • bt,cl,ev, the betweenness, closeness, eigenvector centralities of the node
  • pr, the Page-Rank score of the node

Inspired by Liang et al.’s LRSSL model for drug-disease association prediction [53], we used the feature profiles for miRNAs and diseases separately to form and optimize two respective LRSSLMDA objective functions. Our model was an innovation to Liang et al.’s model in the following aspects. First, LRSSLMDA could make effective predictions with fewer input datasets than Liang et al.’s model. As aforementioned, the input to our model contained only three datasets, namely, the miRNA functional similarity, the disease semantic similarity and the known miRNA-disease associations. On the other hand, their model predicted associations between drugs and diseases by integrating five datasets: the drugs’ chemical substructure profile, the drugs’ target protein domain profile, the drugs’ gene ontology term profile, the disease semantic similarity and the known drug-diseases associations. Second, Liang et al.’s model was developed mainly based on the ready-made drug-related profiles and so was only able to work from the drug perspective. Liang et al.’s literature stated that a limitation of the method was not being able to exploit disease-related profiles. Without the involvement of disease-related profiles, the model could not achieve the best possible performance. To deal with this limitation, we made the most of the available disease information by constructing the integrated disease similarity, extracting the statistical profile and the graph theoretical profile for diseases from the integrated similarity, and building the objective function from the disease perspective. In this manner, our model could accurately infer miRNA-disease associations. Third, by intensively involving disease feature profiles, our model could be applied to diseases without known associated miRNAs, whereas Liang et al.’s model was not effective in uncovering drugs associated with a disease that had no known associated drugs.

Because the two objective functions from the miRNA and disease perspectives were constructed and optimized in a similar manner, the rest of this section elaborates the remaining data preparation step, the model formation step and the optimization step from the view of miRNAs, while briefly presenting these steps from the view of diseases.

For miRNAs, the two feature profiles were represented by Xp where p equaled 1, 2 to denote the first and second profiles; the dimension of Xp was dp × nm where dp was the number of features for the pth profile. For each profile, we further built a network graph Sp, whose elements were defined by (10) where Xp(i) and Xp(j) were respectively the ith and jth vectors of the pth feature profile. Their closeness was measured by the cosine similarity between them. Furthermore, for miRNAs with known related diseases, we constructed another network graph SMDA, whose elements were computed by (11) where MDA(m(i)) and MDA(m(j)) were respectively the ith and jth row of MDA. Their closeness equaled the maximum integrated similarity score between m(i) and m(j)’s associated disease groups. The last part of the data preparation step was to construct graph Laplacian matrices Lp and LA (12) where Dp was the diagonal matrix of Sp in the form of (13)

Similarly, (14) where DMDA was the diagonal matrix of SMDA and defined by (15)

Lp and LMDA were used to form a Laplacian regularization term in our model and to smooth a subspace to which the miRNA profiles were projected. Lp reflected the trend that miRNAs with similar features should be related to similar diseases, while LMDA helped to maintain the similarity between different miRNAs’ related disease groups.

The subsequent step was model formation, where a common subspace for the miRNA profiles, a L1-norm constraint and Laplacian regularization terms were joint to construct the LRSSLMDA model. This formation was consistent with that presented in the literature [53] and conveyed as the objective function below. This function effectively projected the miRNA profiles to a common subspace and maintained both the local and global structure of the input data.

(16)

In (16), F was the predicted miRNA-disease association matrix. The first term was to keep F aligned with MDA, and ||·||F was the Frobenius norm.

Tr(FTLF) was the Laplacian regularization term, where . Here, α controlled the contribution of different graph Laplacian matrices to the predictions and γ > 1 guaranteed that all graph Laplacian matrices made a contribution. m was the number of miRNA feature profiles and equaled 2 in this study.

was the subspace regression term, where was a common subspace in the form of a linear transformation of Xp, and Gp was the projection matrix of the pth miRNA feature profile. The subspace was learnt by minimizing the regression errors and μ was the balancing parameter for the subspace learning.

was the L1-norm constraint, used to impose sparsity on Gp and assign weights to miRNA features. Here, λ was the regularization parameter and Gp(:, j) was the jth column of Gp.

Finally, (16) was optimized in an iterative process where α1, α2 and αMDA were initialized to 1/3 and G1 and G2 began with random non-negative values from uniform distribution on the [0, 1] interval. According to [53], γ was set to 2; and since the algorithm was not that sensitive to the values of μ and λ, we have set both of them to 1 for the simplicity in calculation. All parameters could be optimized by further cross validation. Gp was interactively updated based on the auxiliary function approach [57] (17) where (18) (19) (20) and was a 1×dp vector with all elements equal to 1. By fixing F and Gp, αp was renewed by the equation introduced in [52].

(21)

The derivation and convergence proof of the optimization algorithm were presented in [53]. The final Gp was multiplied by Xp and then was normalized by row sums, before further timed by the final αp. In this way, the predicted association scores for all miRNA-disease pairs from the view of miRNAs were obtained (22)

Similarly, for diseases in Data Preparation, the two feature profiles were denoted by Xp where p equaled 1, 2 to denote the first and second profiles; the dimension of Xp was nm × dp where dp was the number of features for the pth profile. The resulting network graphs for disease profiles were obtained in the same way as (10). For diseases with known related miRNAs, the network graph SMDA was given by (23)

Then graph Laplacian matrices Lp and LA were calculated according to (12) and (14). Again, we constructed the objective function based on (16) in Model Formation, and the Optimization step gave the predicted association scores for all miRNA-disease pairs from the view of diseases (24)

The final prediction scores for all miRNA-disease pairs were computed according to three scenarios. First, when predicting potential diseases associated with a miRNA that had no associated diseases, the final prediction scores were calculated according to (22) only, which was MDA* from the miRNA perspective. Second, when predicting potential miRNAs associated with a disease that had no associated miRNAs, the final prediction scores were calculated based on (24) only, which was MDA* from the disease perspective. Third, when making predictions for a miRNA/disease with some associated diseases/miRNAs, the final prediction scores were obtained by taking the average of (22) and (24). These three scenarios were depicted as in (25) (25)

Results

Performance evaluation

In this study, we implemented both global and local LOOCV validation methods based on 5430 known miRNA-disease associations between 383 diseases and 495 miRNAs from HMDD v2.0 to evaluate the prediction accuracy of LRSSLMDA. Global LOOCV focused on all potential miRNA-disease associations. Each known miRNA-disease association was left out in turn as the test sample (hence 5430 validation rounds in total), while all the other known associations were considered as the training samples. The remaining miRNA-disease pairs were regarded as candidates. A candidate means a miRNA-disease pair whose association was unconfirmed according to HMDD v2.0 and needed to be predicted by LRSSLMDA. In contrast, local LOOCV only considered miRNAs for a specific disease. Each known miRNA related to disease d(i) was left out in turn as the test sample. This time, we defined all other known disease-related miRNAs (including those related to diseases other than disease d(i)) to be the seeds, and the miRNAs under the unconfirmed association status with disease d(i) to be the candidates. For both global and local LOOCV, the test sample was ranked by LRSSLMDA against the candidates; a rank exceeding a predefined threshold would indicate a successful prediction made by the model and vice versa. Then we plotted a Receiver Operating Characteristics curve with the true positive rate (TPR, sensitivity) versus the false positive rate (FPR, 1-specificity) at various thresholds. Sensitivity meant the percentage of test samples ranked above the threshold and specificity represented the percentage of candidates ranked below the threshold. ROC was subsequently used to generate Area under the ROC curve (AUC), a statistic widely used for describing the prediction accuracy of computational model. An AUC of 1 indicates a perfect performance whereas an AUC of 0.5 implies a random performance.

As shown in Fig 2, in global LOOCV, LRSSLMDA achieved an AUC of 0.9178 and was superior to PBMDA (0.9169), MCMDA (0.8749), MaxFlow (0.8624), NCPMDA (0.9073), HGIMDA (0.8781), WBSMDA (0.8030), HDMP (0.8366) and RLSMDA (0.8426). RWRMDA was not compared in global LOOCV because the model was based on a local ranking approach and thus unable to simultaneously uncover potential miRNAs for all diseases. MiRAI was not implemented in global LOOCV, either. By analyzing association scores calculated by this model, we found that the scores were highly positively correlated with the seed count (i.e., the number of known associated miRNAs) of the investigated disease. We calculated the correlation coefficient between the mean/median score for a disease and the seed count of the disease:

thumbnail
Fig 2. Performance comparison between LRSSLMDA and ten previous disease-miRNA association prediction models (PBMDA, MaxFlow, MCMDA, NCPMDA, HGIMDA, MiRAI, WBSMDA, HDMP, RLSMDA and RWRMDA) in terms of ROC curves and AUCs based on global and local LOOCV.

As a result, LRSSLMDA outperformed other models by achieving an AUC of 0.9178 in global LOOCV and an AUC of 0.8418 in local LOOCV.

https://doi.org/10.1371/journal.pcbi.1005912.g002

From this, we can see that the more associated miRNAs a disease had, the higher the association scores for its candidate miRNAs would be; and vice versa. Thus, the association scores calculated by MiRAI for different diseases were not globally comparable and the model was a local method, not applicable to global LOOCV.

In local LOOCV, our model yielded an AUC of 0.8418 and outperformed PBMDA (0.8341), MaxFlow (0.7774), MCMDA (0.7718), HGIMDA (0.8077), MiRAI (0.6299), WBSMDA (0.8031), HDMP (0.7702), RLSMDA (0.6953) and RWRMDA (0.7891). Although our model underperformed NCPMDA (0.8584), the former was superior to the latter both in global LOOCV as mentioned above and in 5-fold cross validation to be subsequently discussed after local LOOCV. Furthermore, NCPMDA seemed sensitive to the percentage of known associations in the training data. In Gu et al.’s study [41], the model was evaluated by local LOOCV using the 1395 known associations between 271 miRNAs and 137 diseases in the HMDD v1.0 database; and the resulting AUC was 0.9173, much higher than the value of 0.8584 obtained in our study. This was due to a reduction of the ratio of known associations to all miRNA-disease pairs in the training data: in HMDD v1.0 there were 1395/(271×137) = 3.76% of miRNA-disease pairs known to be associated, whereas in HMDD v2.0 there were 5430/(495×383) = 2.86% of miRNA-disease pairs known to be associated. This reduction made NCPMDA not as performative as presented in Gu et al.’s study. In addition, it is worth noting that MiRAI had a low AUC of only 0.6299, worse than the AUC of 0.867 presented in Pasquier et al.’ literature [50], because the model was based on collaborative filtering that is known to have the data sparsity problem. The training dataset in our study was sparse, where the average number of miRNAs associated with a disease was 14, while the dataset in Pasquier et al.’ study included 83 diseases with at least 20 known associated miRNAs. Evaluated using a sparser dataset, MiRAI became less performative. We believe that using our dataset to assess models would be a more realistic evaluation than using Pasquier et al.’s dataset, because the relatedness between miRNAs and diseases remains mostly unknown—currently the biological datasets available to research have a just small amount of labeled data and a large amount of unlabeled data. Our method overcame the data sparsity problem and could be applied to this kind of datasets to make effective predictions.

To evaluate LRSSLMDA’s performance variance, we further carried out 5-fold cross validation on the same dataset as that in global and local LOOCV. Since 5-fold cross validation was a global evaluation, MiRAI and RWRMDA were not included in this comparison. The 5430 known miRNA-disease associations were randomly divided into five subsets with an equal size. Each subset was regarded as the test samples in turn and the rest four were used as the training samples. Again, the miRNA-disease pairs without known association evidences were considered as candidates and we recorded the rank of each test sample against them. Finally, an ROC was produced to calculate the AUC. We repeated this procedure for 100 times to achieve a sound estimate of the average prediction accuracy of LRSSLMDA and obtained an AUC of 0.9181+/-0.0004, surpassing that for PBMDA (0.9172+/-0.0007), MCMDA (0.8767+/-0.0011), MaxFlow (0.8579+/-0.0010), NCPMDA (0.8763+/-0.0008), WBSMDA (0.8185+/-0.0009), RLSMDA (0.8569+/-0.0020) and HDMP (0.8342+/-0.0010). Moreover, the AUC’s standard deviation of 0.0004 was one-fifth of that for RLSMDA (0.0020) and about one-third of that for MCMDA (0.0011), and was also noticeably less than that for the remaining five models. This means that, in addition to its superior prediction power, LRSSLMDA was also a stable model with a lower performance variance than others. Another observation was that the average AUC of 0.8763 for NCPMDA was noticeably lower than its AUC of 0.9073 in global LOOCV. In contrast, for all other models, the two values were very similar to each other. This observation again proved the sensitivity of NCPMDA to the percentage of known associations in the training dataset. In global LOOCV 5429/(495×383) = 2.86% of all miRNA-disease pairs in the training dataset were associated, while in 5-fold cross validation 4344/(495×383) = 2.29% of all miRNA-disease pairs in the training dataset were associated. Again, this reduction in percentage impaired NCPMDA’s prediction accuracy.

According to the above comparison, and to our knowledge, LRSSLMDA was by far the most performative machine learning-based model for miRNA-disease association prediction, whereas PBMDA and NCPMDA were the most state-of-the-art network analysis-based models, though there existed a high risk that NCPMDA was sensitive to the percentage of known miRNA-disease associations and would not perform as well with different datasets. Furthermore, it is worth mentioning that the dimensionality reduction technique used in LRSSLMDA facilitated its extendibility to high dimensional datasets. Therefore, the model’s superiority over other models would likely become even more significant in the future with the availability of more feature profiles for miRNAs/diseases as a result of continuous research.

Finally, to assess the predictability of the statistical feature profile and the graph theoretical profile in our study, we used each profile separately for prediction in the above-mentioned three cross validation schemes. Table 1 records the corresponding AUCs and the AUCs for LRSSLMDA with both profiles used. In global LOOCV, the graph theoretical profile achieved a slightly higher predictive accuracy (an AUC of 0.9174) than the statistical profile (with an AUC of 0.9171). This indicated that the former profile was more advantageous in simultaneously uncovering novel miRNA-disease associations for all diseases than the latter. But in local LOOCV, the statistical profile (with an AUC of 0.8405) became superior to the graph theoretical profile (with an AUC of 0.8375), implying that the former would outperform the latter when making predictions for a specific disease. In 5-fold cross validation, like global LOOCV, the graph theoretical profile (with an average AUC of 0.9177) performed better than the statistical profile (with an average AUC of 0.9174), although both of them had an equally low standard deviation of 0.0004. Overall, using either of the two profiles alone for prediction would yield a satisfactory performance; however, only by involving both profiles could our model achieve the best possible predictive performance, that is, an AUC of 0.9178 in global LOOCV, an AUC of 0.8418 in local LOOCV and an average AUC of 0.9181+/-0.0004 in 5-fold cross validation.

thumbnail
Table 1. To evaluate the predictability of different feature profiles in our study, the statistical profile and the graph theoretical profile were used separately for prediction in global LOOCV, local LOOCV and 5-fold cross validation.

The corresponding AUCs are shown in the second and third columns, and compared with the AUCs for LRSSLMDA with both profiles in the fourth column.

https://doi.org/10.1371/journal.pcbi.1005912.t001

Case studies

Three types of case studies on five important human diseases were carried out to demonstrate the predictive power of LRSSLMDA. The first type concerned with Colon Neoplasms, Lymphoma and Kidney Neoplasms. The known miRNA-disease associations in HMDD v2.0 were used as the training dataset for the model. For each investigated disease, candidate miRNAs were ranked in terms of their predicted association scores. Then, the top 50 candidates were validated by 1) two other prominent miRNA-disease association databases, namely, dbDEMC [58] and miR2Disease [59], and 2) more recent experimental literatures. As a result of inner joining the three databases, 232 of the 5430 known miRNA-disease associations in HMDD v2.0 also existed in miR2Disease, and 546 associations also existed in dbDEMC. Despite this, there was no overlap between the training samples and the prediction lists. This was because in case studies only candidate miRNAs for an investigated disease were ranked and confirmed by experimental evidences. As has been defined, a candidate miRNA was a miRNA unassociated with the investigated disease according to HMDD v2.0. Therefore, none of the top 50 predictions existed in HMDD v2.0 and validation of the predictions was completely independent of this training database. To facilitate further experimental validations, we used LRSSLMDA to produce a complete prediction list for all the 383 diseases in HMDD v2.0 (See S1 Table). In the second type of case study, we sought to demonstrate the model’s applicability to diseases with no known associated miRNAs and used Esophageal Neoplasms as an example. All the known miRNAs related to this cancer were removed from the training samples so that prioritizing candidate miRNAs would only depend on the information of other diseases’ known associated miRNAs and the similarity information of diseases and miRNAs. In this case study only, we built our model solely from the disease perspective, since the investigated disease was made to have no known associated miRNAs. In the third type of case study, the model was trained by 1395 known miRNA-disease associations between 271 miRNAs and 137 diseases from the old version of HMDD, that is, HMDD v1.0. Breast Neoplasms was the investigated disease and its predicted miRNAs were validated against databases including HMDD v2.0, dbDEMC and miR2Disease as well as more recent studies. We implemented this case study to illustrate the applicability of LRSSLMDA to different datasets other than that in HMDD v2.0. The results for the five cancers in the three types of case studies are listed as follows.

Colon Neoplasms (CN) is a cancer arising from the colon or rectum of humans and is more commonly found in developed countries than developing ones [60]. According to the most recent statistics [61], 135,430 newly diagnosed CN cases and 50,260 deaths caused by this disease are expected in the United States in 2017. Both the CN incidence and mortality rates experienced a continuous decline over the past several decades, partly because of the introduction and wide adoption of screening tests [62]. Nowadays, the screening technology could be improved by the utilization of miRNAs as new biomarkers [63,64]. Studies have shown that miR-126 and miR-145 suppress the CN cell growth via targeting the phosphatidylinositol 3-kinase signaling and the insulin receptor substrate-1, respectively [65,66]. We used LRSSLMDA to uncover more CN-related miRNAs and confirmed 43 out of the top 50 potential miRNAs based on dbDEMC and miR2Disease. Among the remaining seven predictions, six were validated by more recent studies: miR-92a was determined to directly target the anti-apoptosis molecule BCL-2-interacting mediator of cell death (BIM) in CN tissues and an anti-miR-92a antagomir led to the apoptosis of CN cell lines [67]; overexpressed miR-199a-3p (the 3p arm of the pre-miRNA for miR-199a) contributed to the late TNM stage in CN and transfecting miR-199a-3p inhibitor into CN SW480 cells could significantly limit the cell proliferation [68]; miR-142-3p (the 3p arm of the pre-miRNA for miR-142) functioned as a CN suppressor through targeting CD133, leucine-rich-repeat-containing G-protein-coupled receptor 5 (Lgr5) and ATP binding cassette (ABCG2) [69]; miR-146b enhanced the proliferation of CN by targeting the calcium-sensing receptor (CaSR) and impairing the anti-proliferative and pro-differentiating actions of calcium [70]; miR-150 was found to be a tumor suppressor in CN by targeting c-Myb [71]; overexpressed miR-122 and its concomitantly suppressed target gene, cationic amino acid transporter 1 (CAT1), would contribute to the development of CN liver metastasis [72]. Overall, combining the above experimental evidences gave a confirmation of 49 out of the top 50 potential miRNAs (See Table 2).

thumbnail
Table 2. Prediction of the top 50 potential Colon Neoplasms-related miRNAs based on known associations in HMDD v2.0 database.

The first column records top 1–25 related miRNAs. The third column records the top 26–50 related miRNAs. The evidences for the associations were either dbDEMC and miR2Disease or more recent experimental literatures with the corresponding PMIDs.

https://doi.org/10.1371/journal.pcbi.1005912.t002

Lymphoma is the most common cancer in adolescents, accounting for 21% of all the cancer cases [61]. Across all age groups, 80,500 new lymphoma incidences and 20,140 mortalities due to the cancer are expected in the United States in 2017 [61]. There are many types of lymphomas but broadly they fall into Hodgkin Lymphoma (HL) or non-Hodgkin Lymphoma (NHL). Experiments have shown that miR-494, miR-1973 and miR-21 could not only be used as diagnostic biomarkers but also circulating cell-free treatment response biomarkers in HL [73]. An example of NHL-miRNA association is that the subtype of NHL, canine B-cell lymphoma, has been found to experience an upregulated expression of miR-19a in the normal lymph nodes [74]. We implemented LRSSLMDA to predict more lymphoma-related miRNAs. Out of the top 50 potential miRNAs, 41 were verified by dbDEMC and miR2Disease; and, among the rest nine predictions, three were confirmed by more recent literatures. MiR-125b-5p (the 5p arm of the pre-miRNA for miR-125b) could upregulate the growth of cutaneous T-cell lymphomas (CTCL) cells, shorten the median survival rate of CTCL patients and promote cellular resistance to proteasome inhibitors by modulating MAD4 proteins [75]. Overexpressed miR-142-5p (the 5p arm of the pre-miRNA for miR-142) was observed in gastric MALT lymphoma, playing a pivotal role in pathogenesis of this cancer [76]. Lastly, the overexpression of miR-146b-5p (the 5p arm of the pre-miRNA for miR-146b) impeded the diffuse large B-cell lymphoma (DLBCL) cell proliferation and this miRNA’s low expression level could predict ineffective treatment response of DLBCL to cyclophosphamide, doxorubicin, vincristine, and prednisone (CHOP) [77]. Consequently, 44 out of the top 50 potential lymphoma-associated miRNAs were proved by experiments (See Table 3).

thumbnail
Table 3. Prediction of the top 50 potential Lymphoma-related miRNAs based on known associations in HMDD v2.0 database.

The first column records top 1–25 related miRNAs. The third column records the top 26–50 related miRNAs. The evidences for the associations were either dbDEMC and miR2Disease or more recent experimental literatures with the corresponding PMIDs.

https://doi.org/10.1371/journal.pcbi.1005912.t003

Kidney Neoplasms (KN) constitutes about 3.8% of all new cancer cases [78] and so is a less common cancer compared with CN and lymphoma. It has been estimated that in 2017 the United States will witness 63,990 new KN cases and 14,400 deaths due to KN [61]. Renal cell carcinoma (RCC) accounts for nearly 80–85% of KN tumors [79] and its diagnosis was made easier by the application of imaging methods such as ultrasound and abdominal CT with or without pelvic CT [80,81]. MiRNAs hold the potential of being novel biological diagnostic targets for KN. For example, a systematic review [82] has reported the down-expression of miR-141 and miR-200 and the up-expression of miR-23b, miR-29b and miR-438-3p in RCCs. We used LRSSLMDA to discover more KN-related miRNAs. Out of the top 50 candidates, 41 were confirmed by dbDEMC and miR2Disease, while seven other candidates were verified by more recent studies as follows: a lately study [83] revealed that down-regulated miR-125b could inhibit the RCC cell migration and invasion, and result in cell apoptosis, though it had no observed impact on the RCC cell proliferation; miR-221 could promote clear cell RCC (ccRCC) proliferation, migration and invasion via directly inhibiting the tumor suppressor TIMP2 [84]; an inverse correlation between the Von Hippel-Lindau (VHL) gene expression and miR-92a was found in ccRCC patients in the study [85], suggesting this miRNA’s oncogenic role in the tumorigenesis of ccRCC; let-7b was considerably under-expressed in ccRCC tissues and its dysregulation was associated with the pathological grade of ccRCC [86]; a low expression of both miR-133a and miR-1 could up-regulate the oncogenic luciferase assay revealed transgelin-2 (TAGLN2), contributing to the development of RCC [87]; oncogene miR-142-3p (the 3p arm of the pre-miRNA for miR-142) was significantly more overexpressed in RCC tissues than adjacent normal tissues and down-regulated miRNA could induce the apoptosis in RCC 786-O and ACHN cells [88]; miR-30a-5p (the 5p arm of the pre-miRNA for miR-30a) experienced considerably downregulation in RCC tissues and cells [89]. As a result, 48 out of the top 50 potential KN-related miRNAs were confirmed by biological evidences (See Table 4).

thumbnail
Table 4. Prediction of the top 50 potential Kidney Neoplasms-related miRNAs based on known associations in HMDD v2.0 database.

The first column records top 1–25 related miRNAs. The third column records the top 26–50 related miRNAs. The evidences for the associations were either dbDEMC and miR2Disease or more recent experimental literatures with the corresponding PMIDs.

https://doi.org/10.1371/journal.pcbi.1005912.t004

Esophageal Neoplasms (EN) is a cancer developed from the esophagus and ranks sixth among all cancers in terms of mortality [90]. I the United States, for both sexes the total estimated new EN cases will be 16,940 in 2017, while the total projected death caused by EN will be 15,690 [61]. Population-based screening for EN was not viable due to the relatively low incidence, the absence of early symptoms and the rarity of a hereditary form of the cancer [90,91]. Fortunately, monitoring miRNA expression may be useful for detecting EN. Experiments have indicated that expression profiles of mir-203, mir-205 and mir-21 can determine esophageal tumor histology and discriminate normal tissues from tumorous ones [92]. We trained LRSSLMDA to uncover more EN-related miRNAs and illustrate our model’s applicability to diseases without known associated miRNAs. Out of the top 50 predictions, 49 were confirmed by dbDEMC and miR2Disease (See Table 5). The remaining candidate, mir-122, was found to assist Tanshinone IIA in inhibiting EN cell growth [93]. In addition, miRNA response elements (MREs) of miR-122 and mir-144 employed in EN patients would induce EN cell apoptosis while preserving normal cells [94]. However, whether a direct link exists between miR-122 and EN deserves further investigation.

thumbnail
Table 5. Prediction of the top 50 potential Esophageal Neoplasms-related miRNAs based on known associations in HMDD v2.0 database.

All the known miRNAs related to this cancer were removed from the training samples, and LRSSLMDA was built solely from the disease perspective. The first column records top 1–25 related miRNAs. The third column records the top 26–50 related miRNAs. The evidences for the associations were dbDEMC, miR2Disease and HMDD v2.0.

https://doi.org/10.1371/journal.pcbi.1005912.t005

Breast Neoplasms (BN) is a common cancer in developed countries. In the United States, for instance, one in eight of its population has acquired BN [95] and in 2017 there will be approximately 63,410 newly diagnosed cases [61]. The detection methods for BN mainly include clinical breast examination for earlier-stage cancers and mammography is recommended for women aged over 40 [96]. Curing BN is highly possible given an early stage diagnosis, which could be achieved by involving easily accessible and sensitive miRNAs [97]. MiRNA dysregulations exist in BN patients through polymorphisms in the sequence of the miRNA, its binding sites in target genes, or through epigenetic mechanisms [98]. An example is the elevated expression level of miR-195 which occurred exclusively in BN patients and could be used to differentiate BN from other Malignancies [99]. We trained LRSSLMDA by known miRNA-disease association data from HMDD v1.0. The HMDD v2.0, dbDEMC and miR2Disease databases confirmed 47 out of the top 50 potential BN-related miRNAs, while more recent experimental literatures verified two of the rest three ones. MiR-494 could suppress the progression of BN in vitro by targeting CXCR4 through the Wnt/β-catenin signaling pathway [100]; and the expression level of miR-30e was lowered in both plasma and breast cancer tissues of BN patients and plasma miR-30e expression was statistically related to the patients age and clinical stage of BN [101]. To conclude, experimental evidences from databases and other publications validated 49 out of the top 50 potential BN-associated miRNAs (See Table 6).

thumbnail
Table 6. Prediction of the top 50 potential Breast Neoplasms-related miRNAs based on known associations in the old version of HMDD, that is, HMDD v1.0.

The first column records top 1–25 related miRNAs. The third column records the top 26–50 related miRNAs. The evidences for the associations were either HMDD v2.0, dbDEMC and miR2Disease or more recent experimental literatures with the corresponding PMIDs.

https://doi.org/10.1371/journal.pcbi.1005912.t006

Discussion

The clinical significance of uncovering disease-associated miRNAs lies in their potential roles of therapeutic targets and diagnostic biomarkers for diseases. We introduced a novel computational model for predicting disease-miRNA associations by Laplacian regularized sparse subspace learning (LRSSLMDA). It would effectively complement to existing experimental methods in a way that the candidate miRNAs would be initially prioritized based on available biological data, followed by experimental validations on the most promising candidates. LRSSLMDA was developed as follows. The first step was Data Preparation. The Gaussian interaction profile kernel similarity scores for miRNAs and diseases were calculated from known miRNA-disease associations. Then we constructed the integrated similarity for miRNAs and diseases. In addition, statistical features and graph theoretic features for miRNAs and diseases were extracted from the integrated similarity. The second step was Model Formation. From the respective miRNA/disease perspective, we built an objective function from the common miRNA/disease subspace for the miRNA/disease feature spaces, an L1-norm constraint and Laplacian regularization terms. This step resulted in two objective functions: one from the view of miRNAs and the other from the view of diseases. The third step was Optimization where we optimized the objective functions and lastly combined the optimization results to attain the final prediction outcomes. Albeit inspired by Liang et al.’s method, our model had a substantial innovation: less input data was needed for prediction without sacrificing the predictive performance; disease-related feature profiles were efficiently exploited; and the model could effectively prioritize candidate miRNAs for diseases without known associated miRNAs. Cross validations were carried out to assess the prediction performance of LRSSLMDA. Impressively, it outperformed ten previous models (MCMDA, HGIMDA, WBSMDA, HDMP, RLSMDA and RWRMDA) under the global and local LOOCV frameworks and its prediction stability was reflected by a low standard deviation in results of the 5-fold cross validation. To our knowledge, LRSSLMDA is one of the very few models that achieved an AUC greater than 0.9 in global LOOCV. In addition, three types of case studies on five diseases demonstrated LRSSLMDA’s prediction accuracy. For each disease, a majority of the top 50 potential related miRNAs were confirmed by experimental literatures.

The reliable performance of LRSSMDA stemmed from four factors. First, comprehensive statistical features and graph theoretic features were constructed from the integrated similarity matrices for miRNAs and diseases. The statistical profile included the mean, the sum, the quantiles and the histogram distributions of the similarity scores, while the graph theoretic profile recorded the neighbor count, the centrality measures and Page-Rank scores of the network graphs built from the integrated similarity matrices for miRNAs and diseases. Moreover, because these two feature profiles made full use of the miRNA similarity and the disease similarity, and because functionally similar miRNAs tend to be related to phenotypically similar diseases [3133], our model could effectively uncover miRNAs associated with diseases that had no known associated miRNAs. This was demonstrated in the fourth case study on Esophageal Neoplasms, where 49 out of the top 50 predictions were confirmed by experimental literatures. Second, dimensionality reduction was implemented via projecting the profiles to a common subspace, which removed the multi-collinearity in them. LRSSLMDA sought to determine the most useful features for differently profiles simultaneously. Third, Laplacian regularization was used to keep the local structure of the feature spaces; it also captured the similarities between known miRNA-related diseases and between known disease-related miRNAs. This resonated with the assumption that functionally similar miRNAs tend to be related to semantically similar diseases. Fourth, the sparse feature selection facilitated by L1-norm assigned higher weights to the most useful features, further improving the performance of LRSSLMDA.

However, there is noticeable room for improvement in LRSSLMDA. The miRNA and disease similarity calculations presented in this study might not be the perfect methods and we expect more biological information to be incorporated into the calculations in the future to fine-tune the similarity measures. In addition, by far the known miRNA-disease associations have a large degree of sparsity (with only 2.86% of 189,585 miRNA-disease pairs being labeled). Accumulating experimental evidences will confirm more associations that would diminish the prediction bias of LRSSLMDA. As a final point, the increasing understanding towards miRNAs and diseases would eventually facilitate a miRNA-disease association prediction that not solely depends on miRNAs’ functional similarity and diseases’ semantic similarity, but also other possible miRNA and disease profiles. Adding new profiles into LRSSLMDA would lead to a more comprehensive analysis and hopefully an improved accuracy of miRNA-disease association prediction. Therefore, we believe that our model would perform even better in future research.

Supporting information

S1 Table. We applied LRSSMDA to prioritize all the candidate miRNA-disease pairs based on all the known miRNA-disease associations in HMDD ver2.0 database as training samples.

This prediction result is released for further experimental validation and research.

https://doi.org/10.1371/journal.pcbi.1005912.s001

(XLSX)

S2 Table. The human miRNA-disease associations dataset used to train LRSSLMDA was retrieved from the latest version of the HMDD database, covering 5430 experimentally confirmed associations between 495 miRNAs and 383 diseases.

https://doi.org/10.1371/journal.pcbi.1005912.s002

(XLSX)

References

  1. 1. Ambros V (2001) microRNAs: tiny regulators with great potential. Cell 107: 823–826. pmid:11779458
  2. 2. Ambros V (2004) The functions of animal microRNAs. Nature 431: 350–355. pmid:15372042
  3. 3. Bartel DP (2009) MicroRNAs: target recognition and regulatory functions. Cell 136: 215–233. pmid:19167326
  4. 4. Bartel DP (2004) MicroRNAs: genomics, biogenesis, mechanism, and function. Cell 116: 281–297. pmid:14744438
  5. 5. Meister G, Tuschl T (2004) Mechanisms of gene silencing by double-stranded RNA. Nature 431: 343–349. pmid:15372041
  6. 6. Cheng AM, Byrom MW, Shelton J, Ford LP (2005) Antisense inhibition of human miRNAs and indications for an involvement of miRNA in cell growth and apoptosis. Nucleic Acids Res 33: 1290–1297. pmid:15741182
  7. 7. Karp X, Ambros V (2005) Developmental biology. Encountering microRNAs in cell fate signaling. Science 310: 1288–1289. pmid:16311325
  8. 8. Miska EA (2005) How microRNAs control cell division, differentiation and death. Curr Opin Genet Dev 15: 563–568. pmid:16099643
  9. 9. Xu P, Guo M, Hay BA (2004) MicroRNAs and the regulation of cell death. Trends Genet 20: 617–624. pmid:15522457
  10. 10. Alshalalfa M, Alhajj R (2013) Using context-specific effect of miRNAs to identify functional associations between miRNAs and gene signatures. BMC Bioinformatics 14 Suppl 12: S1.
  11. 11. Cui Q, Yu Z, Purisima EO, Wang E (2006) Principles of microRNA regulation of a human cellular signaling network. Mol Syst Biol 2: 46. pmid:16969338
  12. 12. Care A, Catalucci D, Felicetti F, Bonci D, Addario A, et al. (2007) MicroRNA-133 controls cardiac hypertrophy. Nat Med 13: 613–618. pmid:17468766
  13. 13. Esquela-Kerscher A, Slack FJ (2006) Oncomirs—microRNAs with a role in cancer. Nat Rev Cancer 6: 259–269. pmid:16557279
  14. 14. Wiemer EA (2007) The role of microRNAs in cancer: no small matter. Eur J Cancer 43: 1529–1544. pmid:17531469
  15. 15. Latronico MV, Catalucci D, Condorelli G (2007) Emerging role of microRNAs in cardiovascular biology. Circ Res 101: 1225–1236. pmid:18063818
  16. 16. Krutzfeldt J, Stoffel M (2006) MicroRNAs: a new class of regulatory genes affecting metabolism. Cell Metab 4: 9–12. pmid:16814728
  17. 17. Liu Z, Sall A, Yang D (2008) MicroRNA: An emerging therapeutic target and intervention tool. Int J Mol Sci 9: 978–999. pmid:19325841
  18. 18. Lu M, Zhang Q, Deng M, Miao J, Guo Y, et al. (2008) An analysis of human microRNA and disease associations. PLoS One 3: e3420. pmid:18923704
  19. 19. Nelson PT, Keller JN (2007) RNA in brain disease: no longer just "the messenger in the middle". J Neuropathol Exp Neurol 66: 461–468. pmid:17549006
  20. 20. Zhu HC, Wang LM, Wang M, Song B, Tan S, et al. (2012) MicroRNA-195 downregulates Alzheimer’s disease amyloid-beta production by targeting BACE1. Brain Res Bull 88: 596–601. pmid:22721728
  21. 21. Liu B, Wu X, Liu B, Wang C, Liu Y, et al. (2012) MiR-26a enhances metastasis potential of lung cancer cells via AKT pathway by targeting PTEN. Biochim Biophys Acta 1822: 1692–1704. pmid:22885155
  22. 22. Cho WC, Chow AS, Au JS (2011) MiR-145 inhibits cell proliferation of human lung adenocarcinoma by targeting EGFR and NUDT1. RNA Biol 8: 125–131. pmid:21289483
  23. 23. Jin J, Tang S, Xia L, Du R, Xie H, et al. (2013) MicroRNA-501 promotes HBV replication by targeting HBXIP. Biochem Biophys Res Commun 430: 1228–1233. pmid:23266610
  24. 24. Calin GA, Croce CM (2006) MicroRNA signatures in human cancers. Nat Rev Cancer 6: 857–866. pmid:17060945
  25. 25. Lu J, Getz G, Miska EA, Alvarez-Saavedra E, Lamb J, et al. (2005) MicroRNA expression profiles classify human cancers. Nature 435: 834–838. pmid:15944708
  26. 26. Slack FJ, Weidhaas JB (2008) MicroRNA in cancer prognosis. N Engl J Med 359: 2720–2722. pmid:19092157
  27. 27. Weinberg MS, Wood MJ (2009) Short non-coding RNA biology and neurodegenerative disorders: novel disease targets and therapeutics. Hum Mol Genet 18: R27–39. pmid:19297399
  28. 28. Xuan P, Han K, Guo M, Guo Y, Li J, et al. (2013) Prediction of microRNAs associated with human diseases based on weighted k most similar neighbors. PLoS One 8: e70204. pmid:23950912
  29. 29. Gaur A, Jewell DA, Liang Y, Ridzon D, Moore JH, et al. (2007) Characterization of microRNA expression levels and their biological correlates in human cancer cell lines. Cancer Res 67: 2456–2468. pmid:17363563
  30. 30. Bandyopadhyay S, Mitra R, Maulik U, Zhang MQ (2010) Development of the human cancer microRNA network. Silence 1: 6. pmid:20226080
  31. 31. Perez-Iratxeta C, Bork P, Andrade MA (2002) Association of genes to genetically inherited diseases using data mining. Nat Genet 31: 316–319. pmid:12006977
  32. 32. Perez-Iratxeta C, Wjst M, Bork P, Andrade MA (2005) G2D: a tool for mining genes associated with disease. BMC Genet 6: 45. pmid:16115313
  33. 33. Aerts S, Lambrechts D, Maity S, Van Loo P, Coessens B, et al. (2006) Gene prioritization through genomic data fusion. Nat Biotechnol 24: 537–544. pmid:16680138
  34. 34. Jiang Q, Hao Y, Wang G, Juan L, Zhang T, et al. (2010) Prioritization of disease microRNAs through a human phenome-microRNAome network. BMC Syst Biol 4 Suppl 1: S2.
  35. 35. Chen X, Liu MX, Yan GY (2012) RWRMDA: predicting novel human microRNA-disease associations. Mol Biosyst 8: 2792–2798. pmid:22875290
  36. 36. Shi H, Xu J, Zhang G, Xu L, Li C, et al. (2013) Walking the interactome to identify human miRNA-disease associations through the functional link between miRNA targets and disease genes. BMC Syst Biol 7: 101. pmid:24103777
  37. 37. Hamosh A, Scott AF, Amberger JS, Bocchini CA, McKusick VA (2005) Online Mendelian Inheritance in Man (OMIM), a knowledgebase of human genes and genetic disorders. Nucleic Acids Res 33: D514–517. pmid:15608251
  38. 38. Mork S, Pletscher-Frankild S, Palleja Caro A, Gorodkin J, Jensen LJ (2014) Protein-driven inference of miRNA-disease associations. Bioinformatics 30: 392–397. pmid:24273243
  39. 39. Xuan P, Han K, Guo Y, Li J, Li X, et al. (2015) Prediction of potential disease-associated microRNAs based on random walk. Bioinformatics 31: 1805–1815. pmid:25618864
  40. 40. Chen X, Yan CC, Zhang X, You ZH, Deng L, et al. (2016) WBSMDA: Within and Between Score for MiRNA-Disease Association prediction. Sci Rep 6: 21106. pmid:26880032
  41. 41. Gu C, Liao B, Li X, Li K (2016) Network Consistency Projection for Human miRNA-Disease Associations Inference. Sci Rep 6: 36054. pmid:27779232
  42. 42. Chen X, Yan CC, Zhang X, You ZH, Huang YA, et al. (2016) HGIMDA: Heterogeneous graph inference for miRNA-disease association prediction. Oncotarget 7: 65257–65269. pmid:27533456
  43. 43. Li JQ, Rong ZH, Chen X, Yan GY, You ZH (2017) MCMDA: Matrix Completion for MiRNA-Disease Association prediction. Oncotarget 8: 21187–21199. pmid:28177900
  44. 44. Yu H, Chen X, Lu L (2017) Large-scale prediction of microRNA-disease associations by combinatorial prioritization algorithm. Sci Rep 7: 43792. pmid:28317855
  45. 45. You ZH, Huang ZA, Zhu Z, Yan GY, Li ZW, et al. (2017) PBMDA: A novel and effective path-based computational model for miRNA-disease association prediction. PLoS Comput Biol 13: e1005455. pmid:28339468
  46. 46. Xu J, Li CX, Lv JY, Li YS, Xiao Y, et al. (2011) Prioritizing candidate disease miRNAs by topological features in the miRNA target-dysregulated network: case study of prostate cancer. Mol Cancer Ther 10: 1857–1866. pmid:21768329
  47. 47. Chen X, Yan GY (2014) Semi-supervised learning for potential human microRNA-disease associations inference. Sci Rep 4: 5501. pmid:24975600
  48. 48. Chen X, Yan CC, Zhang X, Li Z, Deng L, et al. (2015) RBMMMDA: predicting multiple types of disease-microRNA associations. Sci Rep 5: 13877. pmid:26347258
  49. 49. Chen X, Wu QF, Yan GY (2017) RKNNMDA: Ranking-based KNN for MiRNA-Disease Association prediction. RNA Biol : 1–11. pmid:28421868
  50. 50. Pasquier C, Gardes J (2016) Prediction of miRNA-disease associations with a vector space model. Sci Rep 6: 27036. pmid:27246786
  51. 51. Chen X, Yan GY (2013) Novel human lncRNA-disease association inference based on lncRNA expression profiles. Bioinformatics 29: 2617–2624. pmid:24002109
  52. 52. Shi C, Ruan Q, An G, Ge C (2015) Semi-supervised sparse feature selection based on multi-view Laplacian regularization. Image & Vision Computing 41: 1–10.
  53. 53. Liang X, Zhang P, Yan L, Fu Y, Peng F, et al. (2017) LRSSL: predict and interpret drug-disease associations based on data integration using sparse subspace learning. Bioinformatics 33: 1187–1196. pmid:28096083
  54. 54. Wang D, Wang J, Lu M, Song F, Cui Q (2010) Inferring the human microRNA functional similarity and functional network based on microRNA-associated diseases. Bioinformatics 26: 1644–1650. pmid:20439255
  55. 55. van Laarhoven T, Nabuurs SB, Marchiori E (2011) Gaussian interaction profile kernels for predicting drug-target interaction. Bioinformatics 27: 3036–3043. pmid:21893517
  56. 56. He T, Heidemeyer M, Ban F, Cherkasov A, Ester M (2017) SimBoost: a read-across approach for predicting drug–target binding affinities using gradient boosting machines. Journal of Cheminformatics 9: 24. pmid:29086119
  57. 57. Ding C, Li T, Jordan MI (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32: 45–55. pmid:19926898
  58. 58. Yang Z, Ren F, Liu C, He S, Sun G, et al. (2010) dbDEMC: a database of differentially expressed miRNAs in human cancers. BMC Genomics 11 Suppl 4: S5.
  59. 59. Jiang Q, Wang Y, Hao Y, Juan L, Teng M, et al. (2009) miR2Disease: a manually curated database for microRNA deregulation in human disease. Nucleic Acids Res 37: D98–104. pmid:18927107
  60. 60. Torre LA, Bray F, Siegel RL, Ferlay J, Lortet-Tieulent J, et al. (2015) Global cancer statistics, 2012. CA Cancer J Clin 65: 87–108. pmid:25651787
  61. 61. Siegel RL, Miller KD, Jemal A (2017) Cancer Statistics, 2017. CA Cancer J Clin 67: 7–30. pmid:28055103
  62. 62. Siegel RL, Miller KD, Fedewa SA, Ahnen DJ, Meester RGS, et al. (2017) Colorectal cancer statistics, 2017. CA Cancer J Clin 67: 177–193. pmid:28248415
  63. 63. Ma Y, Zhang P, Yang J, Liu Z, Yang Z, et al. (2012) Candidate microRNA biomarkers in human colorectal cancer: systematic review profiling studies and experimental validation. Int J Cancer 130: 2077–2087. pmid:21671476
  64. 64. Ogata-Kawata H, Izumiya M, Kurioka D, Honma Y, Yamada Y, et al. (2014) Circulating exosomal microRNAs as biomarkers of colon cancer. PLoS One 9: e92921. pmid:24705249
  65. 65. Guo C, Sah JF, Beard L, Willson JK, Markowitz SD, et al. (2008) The noncoding RNA, miR-126, suppresses the growth of neoplastic cells by targeting phosphatidylinositol 3-kinase signaling and is frequently lost in colon cancers. Genes Chromosomes Cancer 47: 939–946. pmid:18663744
  66. 66. Shi B, Sepp-Lorenzino L, Prisco M, Linsley P, deAngelis T, et al. (2007) Micro RNA 145 targets the insulin receptor substrate-1 and inhibits the growth of colon cancer cells. J Biol Chem 282: 32582–32590. pmid:17827156
  67. 67. Tsuchida A, Ohno S, Wu W, Borjigin N, Fujita K, et al. (2011) miR-92 is a key oncogenic component of the miR-17-92 cluster in colon cancer. Cancer Sci 102: 2264–2271. pmid:21883694
  68. 68. Wan D, He S, Xie B, Xu G, Gu W, et al. (2013) Aberrant expression of miR-199a-3p and its clinical significance in colorectal cancers. Med Oncol 30: 378. pmid:23292866
  69. 69. Shen WW, Zeng Z, Zhu WX, Fu GH (2013) MiR-142-3p functions as a tumor suppressor by targeting CD133, ABCG2, and Lgr5 in colon cancer cells. J Mol Med (Berl) 91: 989–1000.
  70. 70. Fetahu IS, Tennakoon S, Lines KE, Groschel C, Aggarwal A, et al. (2016) miR-135b- and miR-146b-dependent silencing of calcium-sensing receptor expression in colorectal tumors. Int J Cancer 138: 137–145. pmid:26178670
  71. 71. Feng J, Yang Y, Zhang P, Wang F, Ma Y, et al. (2014) miR-150 functions as a tumour suppressor in human colorectal cancer by targeting c-Myb. J Cell Mol Med 18: 2125–2134. pmid:25230975
  72. 72. Iino I, Kikuchi H, Miyazaki S, Hiramatsu Y, Ohta M, et al. (2013) Effect of miR-122 and its target gene cationic amino acid transporter 1 on colorectal liver metastasis. Cancer Sci 104: 624–630. pmid:23373973
  73. 73. Jones K, Nourse JP, Keane C, Bhatnagar A, Gandhi MK (2014) Plasma microRNA are disease response biomarkers in classical Hodgkin lymphoma. Clin Cancer Res 20: 253–264. pmid:24222179
  74. 74. Uhl E, Krimer P, Schliekelman P, Tompkins SM, Suter S (2011) Identification of altered MicroRNA expression in canine lymphoid cell lines and cases of B- and T-Cell lymphomas. Genes Chromosomes Cancer 50: 950–967. pmid:21910161
  75. 75. Manfe V, Biskup E, Willumsgaard A, Skov AG, Palmieri D, et al. (2013) cMyc/miR-125b-5p signalling determines sensitivity to bortezomib in preclinical model of cutaneous T-cell lymphomas. PLoS One 8: e59390. pmid:23527180
  76. 76. Saito Y, Suzuki H, Tsugawa H, Imaeda H, Matsuzaki J, et al. (2012) Overexpression of miR-142-5p and miR-155 in gastric mucosa-associated lymphoid tissue (MALT) lymphoma resistant to Helicobacter pylori eradication. PLoS One 7: e47396. pmid:23209550
  77. 77. Wu PY, Zhang XD, Zhu J, Guo XY, Wang JF (2014) Low expression of microRNA-146b-5p and microRNA-320d predicts poor outcome of large B-cell lymphoma treated with cyclophosphamide, doxorubicin, vincristine, and prednisone. Hum Pathol 45: 1664–1673. pmid:24931464
  78. 78. Motzer RJ, Jonasch E, Agarwal N, Bhayani S, Bro WP, et al. (2017) Kidney Cancer, Version 2.2017, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Canc Netw 15: 804–834. pmid:28596261
  79. 79. Karumanchi SA, Merchan J, Sukhatme VP (2002) Renal cancer: molecular mechanisms and newer therapeutic options. Curr Opin Nephrol Hypertens 11: 37–42. pmid:11753085
  80. 80. Jayson M, Sanders H (1998) Increased incidence of serendipitously discovered renal cell carcinoma. Urology 51: 203–205. pmid:9495698
  81. 81. Luciani LG, Cestari R, Tallarigo C (2000) Incidental renal cell carcinoma-age and stage characterization and clinical implications: study of 1092 patients (1982–1997). Urology 56: 58–62. pmid:10869624
  82. 82. Catto JW, Alcaraz A, Bjartell AS, De Vere White R, Evans CP, et al. (2011) MicroRNA in prostate, bladder, and kidney cancer: a systematic review. Eur Urol 59: 671–681. pmid:21296484
  83. 83. Jin L, Zhang Z, Li Y, He T, Hu J, et al. (2017) miR-125b is associated with renal cell carcinoma cell migration, invasion and apoptosis. Oncol Lett 13: 4512–4520. pmid:28599452
  84. 84. Lu GJ, Dong YQ, Zhang QM, Di WY, Jiao LY, et al. (2015) miRNA-221 promotes proliferation, migration and invasion by targeting TIMP2 in renal cell carcinoma. Int J Clin Exp Pathol 8: 5224–5229. pmid:26191221
  85. 85. Valera VA, Walter BA, Linehan WM, Merino MJ (2011) Regulatory Effects of microRNA-92 (miR-92) on VHL Gene Expression and the Hypoxic Activation of miR-210 in Clear Cell Renal Cell Carcinoma. J Cancer 2: 515–526. pmid:22043236
  86. 86. Peng J, Mo R, Ma J, Fan J (2015) let-7b and let-7c are determinants of intrinsic chemoresistance in renal cell carcinoma. World J Surg Oncol 13: 175. pmid:25951903
  87. 87. Kawakami K, Enokida H, Chiyomaru T, Tatarano S, Yoshino H, et al. (2012) The functional significance of miR-1 and miR-133a in renal cell carcinoma. Eur J Cancer 48: 827–836. pmid:21745735
  88. 88. Li Y, Chen D, Jin LU, Liu J, Li Y, et al. (2016) Oncogenic microRNA-142-3p is associated with cellular migration, proliferation and apoptosis in renal cell carcinoma. Oncol Lett 11: 1235–1241. pmid:26893725
  89. 89. Li Y, Li Y, Chen D, Jin L, Su Z, et al. (2016) miR30a5p in the tumorigenesis of renal cell carcinoma: A tumor suppressive microRNA. Mol Med Rep 13: 4085–4094. pmid:27035333
  90. 90. Zhang Y (2013) Epidemiology of esophageal cancer. World J Gastroenterol 19: 5598–5606. pmid:24039351
  91. 91. Enzinger PC, Mayer RJ (2003) Esophageal cancer. N Engl J Med 349: 2241–2252. pmid:14657432
  92. 92. Feber A, Xi L, Luketich JD, Pennathur A, Landreneau RJ, et al. (2008) MicroRNA expression profiles of esophageal cancer. J Thorac Cardiovasc Surg 135: 255–260; discussion 260. pmid:18242245
  93. 93. Zhang HS, Zhang FJ, Li H, Liu Y, Du GY, et al. (2016) Tanshinone A inhibits human esophageal cancer cell growth through miR-122-mediated PKM2 down-regulation. Arch Biochem Biophys 598: 50–56. pmid:27040384
  94. 94. Zhou K, Yan Y, Zhao S (2014) Esophageal cancer-selective expression of TRAIL mediated by MREs of miR-143 and miR-122. Tumour Biol 35: 5787–5795. pmid:24659424
  95. 95. Dunning AM, Healey CS, Pharoah PD, Teare MD, Ponder BA, et al. (1999) A systematic review of genetic polymorphisms and breast cancer risk. Cancer Epidemiol Biomarkers Prev 8: 843–854. pmid:10548311
  96. 96. Saslow D, Hannan J, Osuch J, Alciati MH, Baines C, et al. (2004) Clinical breast examination: practical recommendations for optimizing performance and reporting. CA Cancer J Clin 54: 327–344. pmid:15537576
  97. 97. Fu SW, Chen L, Man YG (2011) miRNA Biomarkers in Breast Cancer Detection and Management. J Cancer 2: 116–122. pmid:21479130
  98. 98. Mulrane L, McGee SF, Gallagher WM, O’Connor DP (2013) miRNA dysregulation in breast cancer. Cancer Res 73: 6554–6562. pmid:24204025
  99. 99. Heneghan HM, Miller N, Kelly R, Newell J, Kerin MJ (2010) Systemic miRNA-195 differentiates breast cancer from other malignancies and is a potential biomarker for detecting noninvasive and early stage disease. Oncologist 15: 673–682. pmid:20576643
  100. 100. Song L, Liu D, Wang B, He J, Zhang S, et al. (2015) miR-494 suppresses the progression of breast cancer in vitro by targeting CXCR4 through the Wnt/beta-catenin signaling pathway. Oncol Rep 34: 525–531. pmid:25955111
  101. 101. Lin Z, Li JW, Wang Y, Chen T, Ren N, et al. (2016) Abnormal miRNA-30e Expression is Associated with Breast Cancer Progression. Clin Lab 62: 121–128. pmid:27012041