Next Article in Journal
N6-methyladenosine Modification of Noncoding RNAs: Mechanisms and Clinical Applications in Cancer
Next Article in Special Issue
Contextual Features and Information Bottleneck-Based Multi-Input Network for Breast Cancer Classification from Contrast-Enhanced Spectral Mammography
Previous Article in Journal
Cardiovascular Comorbidities in Relation to the Functional Status and Vitamin D Levels in Elderly Patients with Dementia
Previous Article in Special Issue
Embedded AMIS-Deep Learning with Dialog-Based Object Query System for Multi-Class Tuberculosis Drug Response Classification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting IDH Mutation Status in Low-Grade Gliomas Based on Optimal Radiomic Features Combined with Multi-Sequence Magnetic Resonance Imaging

1
Big Data Center, Affiliated Hospital of Jiangnan University, Wuxi 214122, China
2
Department of Radiology, Affiliated Hospital of Jiangnan University, Wuxi 214122, China
3
Department of Neurosurgery, Affiliated Hospital of Jiangnan University, Wuxi 214122, China
4
Department of Pathology, Affiliated Hospital of Jiangnan University, Wuxi 214122, China
5
Laboratory of Genomic and Precision Medicine, Wuxi School of Medicine, Jiangnan University, Wuxi 214122, China
*
Authors to whom correspondence should be addressed.
Submission received: 15 October 2022 / Revised: 24 November 2022 / Accepted: 25 November 2022 / Published: 30 November 2022
(This article belongs to the Special Issue Artificial Intelligence in Clinical Medical Imaging Analysis)

Abstract

:
The IDH somatic mutation status is an important basis for the diagnosis and classification of gliomas. We proposed a “6-Step” general radiomics model to noninvasively predict the IDH mutation status by simultaneously tuning combined multi-sequence MRI and optimizing the full radiomics processing pipeline. Radiomic features (n = 3776) were extracted from multi-sequence MRI (T1, T2, FLAIR, and T1Gd) in low-grade gliomas (LGGs), and a total of 45,360 radiomics pipeline were investigated according to different settings. The predictive ability of the general radiomics model was evaluated with regards to accuracy, stability, and efficiency. Based on numerous experiments, we finally reached an optimal pipeline for classifying IDH mutation status, namely the T2+FLAIR combined multi-sequence with the wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and SVM classifier. The mean and standard deviation of AUC, accuracy, sensitivity, and specificity were 0.873 ± 0.05, 0.876 ± 0.09, 0.875 ± 0.11, and 0.877 ± 0.15, respectively. Furthermore, 14 radiomic features that best distinguished the IDH mutation status of the T2+FLAIR multi-sequence were analyzed, and the gray level co-occurrence matrix (GLCM) features were shown to be of high importance. Apart from the promising prediction of the molecular subtypes, this study also provided a general tool for radiomics investigation.

1. Introduction

Isocitrate dehydrogenase (IDH) is an important molecular diagnosis bias in low-grade gliomas (LGGs) [1,2]. For LGGs, the IDH phenotype affects not only the degree of tumorigenesis, but also the patients’ clinical outcome. Usually, patients with IDH mutations have a better prognosis than IDH wild-type patients [3,4,5]. The 2016 World Health Organization Classification of Tumors of the Central Nervous System (2016 CNS WHO) clarified the importance of IDH mutation status in the diagnosis of gliomas [6]. Furthermore, the new version, the 2021 CNS WHO [7], emphasized the value of molecular diagnosis and pathological features in tumor classification, which could provide an evaluation basis for early diagnosis and individualized treatment of gliomas.
Machine learning-based radiomics is an extensive research topic in predicting tumor subtypes [8,9,10,11,12], which is widely applied to disease assessment because quantitative features can be extracted from conventional imaging (CT, MRI, PET, etc.). Emerging studies have demonstrated promising values for radiomics in predicting IDH mutation status [13,14,15,16,17,18,19,20,21], which enables a noninvasive, real-time, and reproducible acquisition mechanism for glioma subtype research. In 2020, the linear classification model was used by Kim et al. [14] to predict IDH mutation status with multi-sequence MRIs including diffusion weighted imaging (DWI), contrast-enhanced T1-weighted imaging (CE-T1WI), fluid-attenuated inversion recovery (FLAIR), and apparent diffusion coefficient (ADC). It proved that multiparametric MRIs performed better in IDH mutation status prediction, and ADC features were significant. Santinha J et al. [18] combined T1-weighted (T1), T2-weighted (T2), and FLAIR multi-sequence MRIs with the traditional radiomics model to predict IDH mutation status with different features acquisition environment. They verified that the feature screening algorithm has better performance and robustness in the prediction model. Li et al. [19] reported the different settings in their radiomics pipeline based on T1, T2, FLAIR, and post-contrast T1-weighted (T1Gd) multi-sequence MRIs. Their findings provided a better understanding of radiomics model development and interpretability. Choi, Y.S. et al. [21] used an automatic segmentation method for multi-parametric MRI images (T1, T2, FLAIR) to predict IDH mutation status, and the TCGA database was used for external validation. They found that the hybrid model of automatic segmentation performed well in IDH prediction. However, the diagnostic performances achieved through tuning different combinations of multi-sequence MRIs and investigating different settings in the radiomics pipeline simultaneously remain unexplored.
To solve these problems, we focus on two aspects in this paper. First, based on the traditional machine learning-based radiomics technology [8,9,10,11,12], we proposed a “6-Step” general radiomics model, which can investigate both the optimal combined multi-sequence MRI and the most appropriate settings in the radiomics pipeline simultaneously, to noninvasively distinguish the IDH mutation status. The “6-Step” general radiomics model can be applied to different images. The steps in the pipeline are as follows: (1) medical imaging, (2) image segmentation, (3) multi-sequence MRI selection, (4) feature extraction, (5) model exploration, and (6) model evaluation. Secondly, we evaluated the predictive ability of the radiomics model with accuracy [22,23], stability [19], and efficiency.
In general, we utilized a machine learning-based radiomics method to classify the IDH mutation status of LGG patients, in order to obtain a more accurate, stable, and efficient imaging processing method for classifying tumor subtypes. In this task we followed the “6-Step” general radiomics model to simultaneously tune the combination of four traditional glioma MRI sequences (including T1, T2, FLAIR, and T1Gd) and optimize the settings in the radiomics pipeline. We investigated in detail the predictive ability of different settings on different radiomics pipelines, including multi-sequence MRI selection, image filters, radiomics feature extractors, the data normalization strategy, the dimension reduction approach, the feature selection method, and classifier settings, etc. Based on numerous experiments, we ultimately achieved an optimal pipeline that best distinguished the IDH mutation status.

2. Materials and Methods

2.1. Data Cohort

The public retrospective dataset The Cancer Genome Atlas Low-Grade Glioma (TCGA-LGG, https://www.cancer.gov/, accessed on 1 June 2022) was used in this paper, and a total of 108 patients were taken from this public dataset. For each patient, we could easily obtain their molecular status (tumor grade, IDH mutation status, etc.), clinical information (age, sex, etc.), and their MRI sequences. Patients were excluded from the cohort if they met the following criteria: (1) missing T1, T2, FLAIR, or T1Gd sequences (n = 0); (2) unavailable for IDH mutation status information (n = 9); (3) unavailable for histological type or 1p/19q codeletion status information (n = 0); and (4) unreadable for any imaging (n = 0). Ultimately, 99 cases (training data, 80 cases; test data, 19 cases) were enrolled in the study (mean age: 46 years; range: 20–76 years) (Figure 1). We can see that most of the patients were IDH-mutant (n = 72), while a few patients were IDH-wild (n = 27). The histological type has now been reclassified by two pathologists according to 2021 WHO classification [7].

2.2. Imaging Data Acquisition

For each of the 108 patients we downloaded 4 3D-MRI sequences from the TCGA-LGG dataset, including T1-weighted (T1), T2-weighted (T2), T1-weighted gadolinium post-contrast (T1Gd), and fluid-attenuated inversion recovery (FLAIR) sequences. These were first gathered from various institutions, and then they were pre-processed under the same anatomical template before being published on The Cancer Imaging Archive (TCIA) platform [24].
In the dataset, we could also get the segmentation mask for each patient. There were two types of segmentation masks available here: the “_GlistrBoost.nii.gz” suffix, referring to the segmentation masks produced by GLISTRboost with the assistance of computers [25], and the “GlistrBoost ManuallyCorrected.nii.gz” suffix. The latter denotes the segmentation masks that were manually corrected after being adjusted using GLISTRboost’s automated segmentation masks [26]. In the current paper, we utilized the manually corrected segmentation masks first, and we used the other type for features extraction.

2.3. Radiomics Feature Extraction

Before extracting the radiomic features, BinCount = 25 was used for the discretization, and the MRI sequences were transformed with original, wavelet, and no image filters strategies. Then we extracted radiomic features using the FeAture Explorer (FAE, Version 0.5.2) software for the reproducibility of our results, which is an open-source software package and publicly available tool for radiomics models [27]. The radiomics features we extracted included shape features, texture features and first-order statistical features. A total of 3776 radiomic features were obtained from all 4 of the MRI sequences.
After this, the “label” column was added to the feature matrix file to form a supervised learning matrix and then perform feature preprocessing. The current paper adopts a random classification method, dividing the dataset into a training set and a test set according to a ratio of 8:2 (80 training data and 19 testing data) and removing the invalid features via data cleaning.

2.4. “6-Step” General Radiomics Model Exploration

In this section, we propose a “6-Step” general radiomics model, which can investigate both the optimal combined multi-sequence MRI and the most appropriate settings in the radiomics pipeline simultaneously, to best distinguish the IDH mutation status. The “6-Step” model (Figure 2) covers the entire workflow of the radiomics model, including (1), medical imaging, (2) image segmentation, (3) multi-sequence MRI selection, (4) feature extraction, (5) model exploration, and (6) model evaluation. As different medical images are put into the model, different combined multi-sequence MRIs are performed by the “Multi-sequence MRI selection” box. Next, different settings in the radiomics pipeline are investigated in the “feature extraction” and “model exploration” steps. Finally, three important results are shown according to our model evaluation criteria: (1) the best pipeline, (2) the vital features, and (3) the optimal model.
We used four conventional MRI sequences (including T1, T2, FLAIR, and T1Gd) to verify the “6-Step” general radiomics model for predicting the IDH mutation status. We put all 4 sequences into the model, and 15 combined multi-sequence MRIs were generated by the “Multi-sequence MRI Selection” box: T1, T2, FLAIR, T1Gd, T1+T2, T1+FLAIR, T1+T1Gd, T2+FLAIR, T2+T1Gd, T1Gd+FLAIR, T1+T2+FLAIR, T1+T1Gd+FLAIR, T1+T2+T1Gd, T2+FLAIR+T1Gd, and T1+T2+T1Gd+FLAIR. Then we used the radiomics pipeline below for the classification task (Table 1). Firstly, the MRI sequences were transformed with original, wavelet transformation, and none image filters strategies. Secondly, the training set data balance was processed by the random upsampling, downsampling, and none balance methods. Thirdly, the MinMax, Z-Score, mean, and none options were for data normalization. We performed normalization using the training set, then we used the same parameter strategy to normalize the test set. Forthly, principal component analysis (PCA), Pearson correlation coefficients (PCC), and none options were utilized for feature dimension reduction. Fifthly, four feature selection methods were used for comparison, including analysis of variance (ANOVA), Kruskal-Wallis (KW), recursive feature elimination (RFE), and relief. Lastly, seven conventional machine learning classification algorithms were available, including support vector machine (SVM), auto ecoder (AE), random forest (RF), linear discriminant analysis (LDA), logistic regression (LR), logistic regression via lasso (LR-Lasso), and decision tree (DT). A total of 45,360 radiomics pipelines were established, and each optimal model was evaluated by 10 repeated runs. Based on numerous experiments, we reached an optimal pipeline in the “6-Step” general radiomics model for classifying the IDH mutation status.

2.5. Model Evaluation

We evaluated the predictive ability of the “6-Step” general radiomics model with regard to the area under the curve (AUC), accuracy, sensitivity, and specificity [22,23]. Meanwhile, stability was evaluated based on the mean and variance of the results of 10 repeated runs [19]. Considering the economic cost and service efficiency, the number of the combined multi-sequence MRIs involved in the model was evaluated for efficiency. In addition, 1–15 features for the radiomics signature were analyzed. All the analyses were evaluated by 5-fold cross-validation on the training data, which was the default setting embedded in the software.

2.6. Statistical Analysis

The clinical characteristics of patients and tumor characteristics between the training and testing sets were compared using Student’s t-tests. A p value of <0.05 indicated statistical significance. Precision-recall (PR) plots and Matthew’s correlation coefficients were used to evaluate the performance of the models. The positive predictive value (PPV) and negative predictive value (NPV) were calculated at the Youden index. The above analyses were performed using R software (R4.2.0) and FAE (Version 0.5.2).

3. Results

3.1. Clinical Characteristics

A summary of the baseline demographics and clinical features of the research participants is given in Table 2. The train cohort contained 80 patients (58 with mutated IDH and 22 with wild-type IDH), while the test cohort included 19 patients (14 with mutated IDH and 5 with wild-type IDH). There was no significant difference in age (p = 0.62), sex (p = 0.13), IDH mutation (p = 0.92), histological type (p = 0.962), or 1p/19q codeletion status (p = 0.089), between the train and test cohorts.

3.2. Comparison of the Performance of Different Combined Multi-Sequence MRIs Generated by the “6-Step” General Radiomics Model

In Section 2.3 and Section 2.4, we tuned different settings in the “6-Step” general radiomics model, and in this section, we will compare the predictive ability of those different combinations. A total of 45,360 radiomics pipelines were investigated in our model, and the best performance of each combined multi-sequence MRI is shown in Table 3.
As shown in Table 3 and Figure 3, the optimal radiomics pipeline for predicting IDH mutation status was the T2+FLAIR combined multi-sequence MRI with specific settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and SVM classifier. The AUC, accuracy, sensitivity, and specificity were 0.873 ± 0.05 (95% confidence interval [CI], 0.926–1.000), 0.876 ± 0.09, 0.875 ± 0.11 and 0.877 ± 0.15, respectively. The highest AUC was 0.957 (95% CI, 0.875–1.000). The best diagnostic performance of a single radiomic sequence was T2 with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and LDA classifier, where the AUC, accuracy, sensitivity, and specificity were 0.842 ± 0.05, 0.779 ± 0.08, 0.780 ± 0.13 and 0.780 ± 0.19, respectively (Figure 4). The best diagnostic performance of three combined multi-sequence MRIs was T1+T2+T1Gd with the following settings: wavelet image filter, Z-score data normalization, PCA dimension reduction, RFE feature selection, and RF classifier, with the AUC, accuracy, sensitivity, and specificity being 0.816 ± 0.11, 0.747 ± 0.08, 0.743 ± 0.10 and 0.760 ± 0.20, respectively (Figure 5). The best performance of all four combined multi-sequence MRIs was generated with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, ANOVA feature selection, and RF classifier. The AUC, accuracy, sensitivity, and specificity were 0.811 ± 0.07, 0.763 ± 0.09, 0.771 ± 0.10 and 0.740 ± 0.16, respectively (Figure 6).

3.3. Statistical Result and Feature Analysis

The clinical statistics of the best radiomics pipeline is shown in Table 4. To better understand the “6-Step” general radiomics model, we also analyzed the characteristics of the radiomic features retrieved by the optimal radiomics pipeline. For instance, the T2+FLAIR combined multi-sequence had the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and SVM classifier. The radiomic features that had the highest average feature importance are analyzed in Table 5. In addition, we analyzed the performance of the optimal pipeline with a varying number of features ranging from 1 to 15, as shown in Figure 7. In terms of AUC, there was a higher performance of 0.957 when the number of features was 7, 8, and 14. The result with 14 features performed best when AUC, accuracy, specificity, and sensitivity were taken into account.
As shown in Table 5, we gave an explanation to each vital radiomic features, and we found that the top 14 selected features were wavelet transformed features, but not other types. There were 7 gray level co-occurrence matrix (GLCM) features, 4 gray level zone matrix (GLZM) features, and 3 first-order features selected from the most important radiomic features. In light of the statistical results, the gray level co-occurrence matrix (GLCM) feature was the most important radiomic feature.

3.4. The Accuracy, Stability and Efficiency of the “6-Step” General Radiomics Model

To eliminate bias induced by a random choice, we averaged the feature significance computed by the experiments using 10 repeated runs for each optimum pipeline of all the combinations, as shown in Table 3. We found the T2+FLAIR combined multi-sequence with wavelet transformation image filter, mean normalization, PCC dimension reduction, RFE feature selection strategy, and SVM classifier was the most accurate, stable, and efficient. This is because the mean and standard deviation of the AUC, accuracy, sensitivity, and specificity of this pipeline were all lower than that of the others. In addition, it only took two MRI sequences for modeling, which can reduce the time needed for the doctor to scan the MRI sequence and make a diagnosis.

4. Discussion

In this paper, we investigated the use of “6-Step” general radiomics model—a noninvasive method—in predicting the IDH mutation status. Four traditional glioma MRI sequences (including T1, T2, FLAIR, and T1Gd) and the conventional settings in radiomics pipelines were optimized simultaneously, to obtain a more economical, convenient, accurate, and reliable imaging processing method. Based on 45,360 radiomics pipelines, we arrived at an optimal pipeline for classifying the IDH mutation status, which was the T2+FLAIR combined multi-sequence with wavelet transformation image filter processing, mean normalization, PCC dimension reduction, the RFE feature selection strategy, and the SVM classifier with 14 radiomic features. Our model also determined the most important features calculated by the optimal pipeline for better interpretation of a radiomics model. The grayscale covariance matrix texture (GLCM) features from the T2 and FLARI sequences were of high importance.
In this study, the T1+T2+T1Gd+FLAIR combined multi-sequence was not the best-performing sequence for predicting the IDH mutation status in LGG. This was not surprising, as Kim et al. [14] reported that a multi-parametric MRI radiomics model did not improve the diagnostic performance in IDH mutation status prediction. This might be explained by the fact that a combined multi-sequence can aggregate multi-source information, allowing the radiomics model to learn more information within a given range. Nevertheless, beyond this range, too many features will reduce the performance of the model, as mentioned in [28]. From the perspective of efficiency, this finding will benefit clinical treatment greatly. It can help both in reducing the MRI scanning time for patients and the diagnosis time for doctors. Therefore, using as few MRI sequences as possible to correctly predict the glioma subtypes has great research value.
Previous research has revealed that radiomic features are a reliable means of predicting IDH mutant status [13,14,15,16,17,18,19,20,21,29]. In addition to the conventional MRI sequences, a number of researchers have explored the predictive ability of the T2-FLAIR mismatch for IDH mutation status [30,31,32]. They both confirmed that T2-FLAIR mismatch represented a highly specific imaging biomarker for IDH mutation status. However, the diagnostic performance of different combinations of multi-sequence MRIs and the different settings in the radiomics pipeline were not reported. In our paper, we proposed a “6-Step” general radiomics model, which can simultaneously investigate both the optimal combined multi-sequence MRI and the most appropriate settings in the radiomics pipeline to best distinguish the IDH mutation status. To verify the “6-Step” general radiomics model for predicting the IDH Mutation status, four traditional glioma MRI sequences (including T1, T2, FLAIR, and T1Gd) were used. The predictive ability of the radiomics model was evaluated with regards to accuracy, stability and efficiency. We investigated the predictive ability of different settings in the “6-Step” general radiomics model, including multi-sequence MRI selection, image filters, radiomics features extractors, data normalization strategies, dimension reduction approaches, feature selection methods, and classifier settings, etc. Finally, we achieved an optimal pipeline that best distinguished the IDH mutation status based on numerous experiments. The top 14 radiomic features with the highest average feature importance calculated by the general model were analyzed, revealing that the gray level co-occurrence matrix (GLCM) features with wavelet transformation image filters from the T2+FLAIR multi-sequence combination, are the most important features. Therefore, we recommend that the T2 and FLAIR MRI sequences should be analyzed first during clinical diagnosis of LGG.
Recent studies have demonstrated that segmentation repeatability is essential in terms of feature stability, for it is heavily influenced by different MRI protocols and machines [21,33,34,35,36]. In this paper, we downloaded the segmented data outlined on the TCIA website by using automatic image segmentation and manual supervision, and we performed the experiment using the FAE software, which is a publicly available tool for radiomics models and is applied to many fields [37,38,39,40,41]. Thus, all the experiment results are robust and replicable.
There are several limitations to this study, however. Firstly, because it was retrospective and just a few patients were included, a prospective study with a large cohort of patients is required to validate the stability and repeatability of our findings. We will also use more sufficient data for model validation in the future. Secondly, the diagnostic performance was assessed and verified using information from only a single database, due to the limited number of patient cases in our hospital. Thereforem decisive external validation us required for its clinical application, which should be performed in further studies.

5. Conclusions

In this paper, we proposed a “6-Step” general radiomics model to investigate both the optimal combined multi-sequence MRI and the most appropriate settings in radiomics pipelines, which can best distinguish the IDH mutation status. The predictive ability of the general radiomics model was then calculated with regard to accuracy, stability, and efficiency. Several investigations were conducted on the “6-Step” general model, such as multi-sequence MRI selection, image filters, radiomics features extractors, the data normalization strategy, the dimension reduction approach, the feature selection method, and classifier settings, etc. After tuning these settings, a final radiomics pipeline for the prediction of the IDH mutation status was proposed. This paper not only provides a radiomics pipeline which works well for predicting molecular subtypes, but it also contributes to the evaluation of the development of the general model. However, since a small cohort was enrolled in this study, more sufficient data will be used for the proposed model validation in our future study.

Author Contributions

Conceptualization, A.H., J.C. and L.L.; Data curation, P.W.; Formal analysis, A.H. and L.L.; Funding acquisition, L.L.; Investigation, A.H., P.W. and Y.L.; Methodology, A.H. and L.L.; Project administration, J.C. and L.L.; Resources, A.Z.; Software, A.H., P.W. and L.L.; Supervision, P.W. and L.L.; Validation, P.W. and Y.L.; Visualization, A.Z.; Writing—original draft, A.H.; and Writing—review and editing, P.W., A.Z., Y.L., J.C. and L.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Research Projects of Jiangsu Provincial Hospital Association, grant number JSYGY-3-2021-PJ127 and Wuxi Health Commission, grant number MS201903.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data supporting reported results can be found at the publicly archived datasets TCGA-LGG (https://www.Cancer.gov/ accessed on 30 December 2021).

Acknowledgments

The authors acknowledge Professor Ding, Y.R. for model calibration.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yang, K.; Wu, Z.; Zhang, H.; Zhang, N.; Wu, W.; Wang, Z.; Dai, Z.; Zhang, X.; Zhang, L.; Peng, Y.; et al. Glioma targeted therapy: Insight into future of molecular approaches. Mol. Cancer. 2022, 21, 39. [Google Scholar] [CrossRef] [PubMed]
  2. Choi, Y.S.; Ahn, S.S.; Chang, J.H.; Kang, S.-G.; Kim, E.H.; Kim, S.H.; Jain, R.; Lee, S.-K. Machine learning and radiomic phenotyping of lower grade gliomas: Improving survival prediction. Eur. Radiol. 2020, 307, 3834–3842. [Google Scholar] [CrossRef] [PubMed]
  3. Galbraith, K.; Snuderl, M. Molecular Pathology of Gliomas. Surg. Pathol. Clin. 2021, 14, 379–386. [Google Scholar] [CrossRef] [PubMed]
  4. Weller, M.; van den Bent, M.; Tonn, J.C. European Association for Neuro-Oncology (EANO) guideline on the diagnosis and treatment of adult astrocytic and oligodendroglial gliomas. Lancet Oncol. 2017, 18, e315–e329. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Wang, L.-B.; Karpova, A.; Gritsenko, M.A.; Kyle, J.E.; Cao, S.; Li, Y.; Rykunov, D.; Colaprico, A.; Rothstein, J.H.; Hong, R.; et al. Clinical Proteomic Tumor Analysis Consortium. Proteogenomic and metabolomic characterization of human glioblastoma. Cancer Cell. 2021, 39, 509–528. [Google Scholar] [CrossRef]
  6. Louis, D.N.; Perry, A.; Reifenberger, G.; Von Deimling, A.; Figarella-Branger, D.; Cavenee, W.K.; Ohgaki, H.; Wiestler, O.D.; Kleihues, P.; Ellison, D.W. The 2016 World Health Organization Classification of Tumors of the Central Nervous System: A summary. Acta Neuropathol. 2016, 131, 803–820. [Google Scholar] [CrossRef] [Green Version]
  7. Louis, D.N.; Perry, A.; Wesseling, P.; Brat, D.J.; Cree, I.A.; Figarella-Branger, D.; Hawkins, C.; Ng, H.K.; Pfister, S.M.; Reifenberger, G.; et al. The 2021 WHO Classification of Tumors of the Central Nervous System: A summary. Neuro Oncol. 2021, 23, 1231–1251. [Google Scholar] [CrossRef]
  8. Lambin, P.; Leijenaar, R.T.H.; Deist, T.M.; Peerlings, J.; de Jong, E.E.C.; van Timmeren, J.; Sanduleanu, S.; Larue, R.T.H.M.; Even, A.J.G.; Jochems, A.; et al. Radiomics: The bridge between medical imaging and personalized medicine. Nat. Rev. Clin. Oncol. 2017, 14, 749–762. [Google Scholar] [CrossRef] [Green Version]
  9. Lambin, P.; Velazquez, E.; Leijenaar, R.; Carvalho, S.; van Stiphout, R.G.P.M.; Granton, P.; Zegers, C.M.L.; Gillies, R.; Boellard, R.; Dekker, A.; et al. Radiomics: Extracting more information from medical images using advanced feature analysis. Eur. J. Cancer 2012, 48, 441–446. [Google Scholar] [CrossRef] [Green Version]
  10. Aerts, H.J.W.L.; Velazquez, E.R.; Leijenaar, R.T.H.; Parmar, C.; Grossmann, P.; Carvalho, S.; Bussink, J.; Monshouwer, R.; Haibe-Kains, B.; Rietveld, D.; et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat. Commun. 2014, 5, 4644. [Google Scholar] [CrossRef]
  11. Luo, H.; Zhuang, Q.; Wang, Y.; Abudumijiti, A.; Shi, K.; Rominger, A.; Chen, H.; Yang, Z.; Tran, V.; Wu, G.; et al. A novel image signature-based radiomics method to achieve precise diagnosis and prognostic stratification of gliomas. Lab. Investig. 2021, 101, 450–462. [Google Scholar] [CrossRef] [PubMed]
  12. Pyka, T.; Krzyzanowska, I.; Rominger, A.; Delbridge, C.; Meyer, B.; Boeckh-Behrens, T.; Zimmer, C.; Gempt, J. Multiparametric Characterization of Intracranial Gliomas Using Dynamic [18F]FET-PET and Magnetic Resonance Spectroscopy. Diagnostics 2022, 12, 2331. [Google Scholar] [CrossRef] [PubMed]
  13. Zhang, X.; Tian, Q.; Wang, L.; Liu, Y.; Li, B.; Liang, Z.; Gao, P.; Zheng, K.; Zhao, B.; Lu, H. Radiomics strategy for molecular subtype stratification of lower-grade glioma: Detecting IDH and TP53 mutations based on multimodal MRI. J. Magn. Reson. Imaging 2018, 48, 916–926. [Google Scholar] [CrossRef] [PubMed]
  14. Kim, M.; Jung, S.Y.; Park, J.E.; Jo, Y.; Park, S.Y.; Nam, S.J.; Kim, J.H.; Kim, H.S. Diffusion-and perfusion-weighted MRI radiomics model may predict isocitrate dehydrogenase (IDH) mutation and tumor aggressiveness in diffuse lower grade glioma. Eur. Radiol. 2020, 30, 2142–2151. [Google Scholar] [CrossRef]
  15. Liu, X.; Li, Y.; Li, S.; Fan, X.; Sun, Z.; Yang, Z.; Wang, K.; Zhang, Z.; Jiang, T.; Liu, Y.; et al. IDH mutation-specific radiomic signature in lower-grade gliomas. Aging 2019, 11, 673. [Google Scholar] [CrossRef]
  16. Wu, S.; Meng, J.; Yu, Q.; Li, P.; Fu, S. Radiomics-based machine learning methods for isocitrate dehydrogenase genotype prediction of diffuse gliomas. J. Cancer Res. Clin. Oncol. 2019, 145, 543–550. [Google Scholar] [CrossRef] [Green Version]
  17. Tan, Y.; Zhang, S.T.; Wei, J.W.; Dong, D.; Wang, X.C.; Yang, G.Q.; Tian, J.; Zhang, H. A radiomics nomogram may improve the prediction of IDH genotype for astrocytoma before surgery. Eur. Radiol. 2019, 29, 3325–3337. [Google Scholar] [CrossRef]
  18. Santinha, J.; Matos, C.; Figueiredo, M.; Papanikolaou, N. Improving performance and generalizability in radiogenomics: A pilot study for prediction of IDH1/2 mutation status in gliomas with multicentric data. J. Med. Imaging 2021, 8, 031905. [Google Scholar] [CrossRef]
  19. Li, Y.; Ammari, S.; Lawrance, L.; Quillent, A.; Assi, T.; Lassau, N.; Chouzenoux, E. Radiomics-Based Method for Predicting the Glioma Subtype as Defined by Tumor Grade, IDH Mutation, and 1p/19q Codeletion. Cancers 2022, 14, 1778. [Google Scholar] [CrossRef]
  20. Li, Y.; Qin, Q.; Zhang, Y.; Cao, Y. Noninvasive Determination of the IDH Status of Gliomas Using MRI and MRI-Based Radiomics: Impact on Diagnosis and Prognosis. Curr. Oncol. 2022, 29, 6893–6907. [Google Scholar] [CrossRef]
  21. Choi, Y.S.; Bae, S.; Chang, J.H.; Kang, S.G.; Kim, S.H.; Kim, J.; Rim, T.H.; Choi, S.H.; Jain, R.; Lee, S.K. Fully automated hybrid approach to predict the IDH mutation status of gliomas via deep learning and radiomics. Neuro Oncol. 2021, 23, 304–313. [Google Scholar] [CrossRef] [PubMed]
  22. Bi, W.L.; Hosny, A.; Schabath, M.B.; Giger, M.L.; Birkbak, N.; Mehrtash, A.; Allison, T.; Arnaout, O.; Abbosh, C.; Dunn, I.F.; et al. Artificial Intelligence in Cancer Imaging: Clinical Challenges and Applications. CA Cancer J. Clin. 2019, 69, 127–157. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Song, X.L.; Ren, J.L.; Yao, T.Y.; Zhao, D.; Niu, J. Radiomics based on multi-sequence magnetic resonance imaging for the preoperative prediction of peritoneal metastasis in ovarian cancer. Eur. Radiol. 2021, 31, 8438–8446. [Google Scholar] [CrossRef] [PubMed]
  24. Rohlfing, T.; Zahr, N.M.; Sullivan, E.V.; Pfefferbaum, A. The SRI24 multichannel atlas of normal adult human brain structure. Hum. Brain Mapp. 2010, 31, 798–819. [Google Scholar] [CrossRef] [Green Version]
  25. Bakas, S.; Zeng, K.; Sotiras, A.; Rathore, S.; Akbari, H.; Gaonkar, B.; Rozycki, M.; Pati, S.; Davatzikos, C. GLISTRboost: Combining multimodal MRI segmentation, registration, and biophysical tumor growth modeling with gradient boosting machines for glioma segmentation. Brainlesion 2015, 9556, 144–155. [Google Scholar] [CrossRef] [Green Version]
  26. Bakas, S.; Akbari, H.; Sotiras, A.; Bilello, M.; Rozycki, M.; Kirby, J.S.; Freymann, J.B.; Farahani, K.; Davatzikos, C. Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Sci. Data 2017, 4, 170117. [Google Scholar] [CrossRef] [Green Version]
  27. Song, Y.; Zhang, J.; Zhang, Y.-D.; Hou, Y.; Yan, X.; Wang, Y.; Zhou, M.; Yao, Y.-F.; Yang, G. FeAture Explorer (FAE): A tool for developing and comparing radiomics models. PLoS ONE 2020, 15, e0237587. [Google Scholar] [CrossRef]
  28. Yogananda, C.G.B.; Shah, B.R.; Vejdani-Jahromi, M.; Nalawade, S.; Murugesan, G.K.; Yu, F.F.; Pinho, M.C.; Wagner, B.C.; Mickey, B.; Patel, T.R.; et al. A novel fully automated MRI-based deep-learning method for classification of IDH mutation status in brain gliomas. Neuro Oncol. 2020, 22, 402–411. [Google Scholar] [CrossRef]
  29. Chang, K.; Bai, H.X.; Zhou, H.; Su, C.; Bi, W.L.; Agbodza, E.; Kavouridis, V.K.; Senders, J.T.; Boaro, A.; Beers, A.; et al. Residual Convolutional Neural Network for the Determination of IDH Status in Low- and High-Grade Gliomas from MR Imaging. Clin. Cancer Res. 2018, 24, 1073–1081. [Google Scholar] [CrossRef] [Green Version]
  30. Broen, M.P.G.; Smits, M.; Wijnenga, M.M.J.; Dubbink, H.J.; Anten, M.H.M.E.; Schijns, O.E.M.G.; Beckervordersandforth, J.; Postma, A.A.; Bent, M.V.D. The T2-FLAIR mismatch sign as an imaging marker for nonenhancing IDH-mutant, 1p/19q-intact low-grade glioma: A validation study. Neuro Oncol. 2018, 20, 1393–1399. [Google Scholar] [CrossRef]
  31. Patel, S.H.; Poisson, L.M.; Brat, D.J.; Zhou, Y.; Cooper, L.; Snuderl, M.; Thomas, C.; Franceschi, A.M.; Griffith, B.; Flanders, A.E.; et al. T2-FLAIR Mismatch, an Imaging Biomarker for IDH and 1p/19q Status in Low-grade Gliomas: A TCGA/TCIA Project. Clin. Cancer Res. 2017, 23, 6078–6085. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Park, S.I.; Suh, C.H.; Guenette, J.P.; Huang, R.Y.; Kim, H.S. The T2-FLAIR mismatch sign as a predictor of IDH-mutant,1p/19q-noncodeleted lower-grade gliomas: A systematic review and diagnostic meta-analysis. Eur. Radiol. 2021, 31, 5289–5299. [Google Scholar] [CrossRef] [PubMed]
  33. Shofty, B.; Artzi, M.; Ben Bashat, D.; Liberman, G.; Haim, O.; Kashanian, A.; Bokstein, F.; Blumenthal, D.T.; Ram, Z.; Shahar, T. MRI radiomic analysis of molecular alterations in low-grade gliomas. Int. J. Comput. Assist. Radiol. Surg. 2018, 13, 563–571. [Google Scholar] [CrossRef]
  34. D’Alessio, A.; Proietti, G.; Sica, G.; Scicchitano, B.M. Pathological and Molecular Features of Glioblastoma and Its Peritumoral Tissue. Cancers 2019, 11, 469. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Zhou, M.; Scott, J.; Chaudhury, B.; Hall, L.; Goldgof, D.; Yeom, K.; Iv, M.; Ou, Y.; Kalpathy-Cramer, J.; Napel, S.; et al. Radiomics in Brain Tumor: Image Assessment, Quantitative Feature Descriptors, and Machine-Learning Approaches. Am. J. Neuroradiol. 2018, 39, 208–216. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Jakola, A.S.; Zhang, Y.-H.; Skjulsvik, A.J.; Solheim, O.; Bø, H.K.; Berntsen, E.M.; Reinertsen, I.; Gulati, S.; Förander, P.; Brismar, T.B. Quantitative texture analysis in the prediction of IDH status in low-grade gliomas. Clin. Neurol. Neurosurg. 2018, 164, 114–120. [Google Scholar] [CrossRef]
  37. Ma, M.; Gan, L.; Liu, Y.; Jiang, Y.; Xin, L.; Liu, Y.; Qin, N.; Cheng, Y.; Liu, Q.; Xu, L.; et al. radiomic features based on automatic segmented MRI images: Prognostic biomarkers for triple-negative breast cancer treated with neoadjuvant chemotherapy. Eur. J. Radiol. 2022, 146, 110095. [Google Scholar] [CrossRef]
  38. Ma, M.; Gan, L.; Jiang, Y.; Qin, N.; Li, C.; Zhang, Y.; Wang, X. Radiomics Analysis Based on Automatic Image Segmentation of DCE-MRI for Predicting Triple-Negative and Nontriple-Negative Breast Cancer. Comput. Math. Methods Med. 2021, 2021, 1–7. [Google Scholar] [CrossRef]
  39. Chen, C.; Qin, Y.; Cheng, J.; Gao, F.; Zhou, X. Texture Analysis of Fat-Suppressed T2-Weighted Magnetic Resonance Imaging and Use of Machine Learning to Discriminate Nasal and Paranasal Sinus Small Round Malignant Cell Tumors. Front. Oncol. 2021, 11, 701289. [Google Scholar] [CrossRef]
  40. Chen, C.; Qin, Y.; Chen, H.; Cheng, J.; He, B.; Wan, Y.; Zhu, D.; Gao, F.; Zhou, X. Machine learning to differentiate small round cell malignant tumors and non-small round cell malignant tumors of the nasal and paranasal sinuses using apparent diffusion coefficient values. Eur. Radiol. 2022, 2, 3819–3829. [Google Scholar] [CrossRef]
  41. Jin, Z.; Chen, L.; Zhong, B.; Zhou, H.; Zhu, H.; Zhou, H.; Song, J.; Guo, J.; Zhu, X.; Ji, J.; et al. Machine-learning analysis of contrast-enhanced computed tomography radiomic predicts patients with hepatocellular carcinoma who are unsuitable for initial transarterial chemoembolization monotherapy: A multicenter study. Transl. Oncol. 2021, 14, 101034. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Patient screening flowchart. Abbreviations: TCGA, The Cancer Genome Atlas; T1, T1-weighted; T2, T2-weighted; FLAIR, fluid-attenuated inversion recovery; and T1Gd, post-contrast T1-weighted.
Figure 1. Patient screening flowchart. Abbreviations: TCGA, The Cancer Genome Atlas; T1, T1-weighted; T2, T2-weighted; FLAIR, fluid-attenuated inversion recovery; and T1Gd, post-contrast T1-weighted.
Diagnostics 12 02995 g001
Figure 2. Flow chart of the “6-Step” general radiomics model. The data frames in blue indicate that we chose one of the displayed methods, and the data frames in green mean that we chose all of the displayed methods. A, B, C, and D indicate different medical images. The “+” symbol indicates that different MRI sequences were combined to form a new input object. Abbreviations: GLCM, Gray-level co-occurrence matrix; GLSZM, Gray-level size zone matrix; GLRLM, Gray-level run length matrix; GLDM, Gray-level dependence matrix; and NGTDM, neighboring gray tone difference matrix.
Figure 2. Flow chart of the “6-Step” general radiomics model. The data frames in blue indicate that we chose one of the displayed methods, and the data frames in green mean that we chose all of the displayed methods. A, B, C, and D indicate different medical images. The “+” symbol indicates that different MRI sequences were combined to form a new input object. Abbreviations: GLCM, Gray-level co-occurrence matrix; GLSZM, Gray-level size zone matrix; GLRLM, Gray-level run length matrix; GLDM, Gray-level dependence matrix; and NGTDM, neighboring gray tone difference matrix.
Diagnostics 12 02995 g002
Figure 3. The best performance generated by the “6-Step” general radiomics model was the T2+FLAIR combined multi-sequence with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and SVM classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing, and validation sets; (b) the FAE software’s suggestion of a candidate 14-feature model according to the “one-standard error” rule; (c) the 14 radiomic features with the highest average feature importance calculated by the best settings with the T2+FLAIR combined multi-sequence.
Figure 3. The best performance generated by the “6-Step” general radiomics model was the T2+FLAIR combined multi-sequence with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and SVM classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing, and validation sets; (b) the FAE software’s suggestion of a candidate 14-feature model according to the “one-standard error” rule; (c) the 14 radiomic features with the highest average feature importance calculated by the best settings with the T2+FLAIR combined multi-sequence.
Diagnostics 12 02995 g003
Figure 4. The best diagnostic performance of a single radiomic sequence was T2 with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and LDA classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing, and validation sets; (b) FAE software’s suggestion of a candidate 10-feature model according to the “one-standard error” rule; (c) the 10 radiomic features with the highest average feature importance calculated by the best settings with the T2 sequence.
Figure 4. The best diagnostic performance of a single radiomic sequence was T2 with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and LDA classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing, and validation sets; (b) FAE software’s suggestion of a candidate 10-feature model according to the “one-standard error” rule; (c) the 10 radiomic features with the highest average feature importance calculated by the best settings with the T2 sequence.
Diagnostics 12 02995 g004
Figure 5. The best diagnostic performance of the three combined multi-sequence was the T1+T2+T1Gd combined multi-sequence with the following settings: wavelet image filter, Z-score data normalization, PCA dimension reduction, RFE feature selection, and RF classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing, and validation sets; (b) FAE software’s suggestion of a candidate 11-feature model according to the “one-standard error” rule; (c) the 11 radiomic features with the highest average feature importance calculated by the best settings with the T1+T2+T1Gd combined multi-sequence.
Figure 5. The best diagnostic performance of the three combined multi-sequence was the T1+T2+T1Gd combined multi-sequence with the following settings: wavelet image filter, Z-score data normalization, PCA dimension reduction, RFE feature selection, and RF classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing, and validation sets; (b) FAE software’s suggestion of a candidate 11-feature model according to the “one-standard error” rule; (c) the 11 radiomic features with the highest average feature importance calculated by the best settings with the T1+T2+T1Gd combined multi-sequence.
Diagnostics 12 02995 g005
Figure 6. The best performance generated by the T1+T2+FLAIR+T1Gd combined multi-sequence with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, ANOVA feature selection, and RF classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing and validation sets; (b) FAE software’s suggestion of a candidate 5-feature model according to the “one-standard error” rule; (c) the 5 radiomic features with the highest average feature importance calculated by the best settings with the T1+T2+FLAIR+T1Gd combined multi-sequence.
Figure 6. The best performance generated by the T1+T2+FLAIR+T1Gd combined multi-sequence with the following settings: wavelet image filter, mean data normalization, PCC dimension reduction, ANOVA feature selection, and RF classifier. (a) Receiver operating characteristic (ROC) curves of the training, testing and validation sets; (b) FAE software’s suggestion of a candidate 5-feature model according to the “one-standard error” rule; (c) the 5 radiomic features with the highest average feature importance calculated by the best settings with the T1+T2+FLAIR+T1Gd combined multi-sequence.
Diagnostics 12 02995 g006
Figure 7. The performance with a different number of features, ranging from 1 to 15. This result was generated by the following radiomic pipeline settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and the SVM classifier with a number of features ranging from 1 to 15. Abbreviations: AUC, area under the curve; Acc, accuracy; Sen, sensitivity; and Spe, specificity.
Figure 7. The performance with a different number of features, ranging from 1 to 15. This result was generated by the following radiomic pipeline settings: wavelet image filter, mean data normalization, PCC dimension reduction, RFE feature selection, and the SVM classifier with a number of features ranging from 1 to 15. Abbreviations: AUC, area under the curve; Acc, accuracy; Sen, sensitivity; and Spe, specificity.
Diagnostics 12 02995 g007
Table 1. Different options in the main radiomics pipeline of the “6-Step” general model (taking T1, T2, FLAIR, and T1Gd four MRI sequences, for example).
Table 1. Different options in the main radiomics pipeline of the “6-Step” general model (taking T1, T2, FLAIR, and T1Gd four MRI sequences, for example).
The Main Radiomics PipelineOptions
Medical imagesT1, T2, FLAIR, T1Gd
Combined Multi-sequence MRIT1, T2, FLAIR, T1Gd, T1+T2, T1+FLAIR, T1+T1Gd, T2+FLAIR, T2+T1Gd, T1Gd+FLAIR, T1+T2+FLAIR, T1+T1Gd+FLAIR, T1+T2+T1Gd, T2+FLAIR+T1Gd, T1+T2+T1Gd+FLAIR.
Images filtersOriginal/wavelet Transformation/None
Data BalanceUpsampling/Downsampling/None
NormalizationZ- Score/Mean/MinMax/None
Dimension ReductionPCA/PCC/None
Feature SelectionANOVA/KW/RFE/Relief
ClassifierSVM/AE/LD/RF/LR/LR-Lasso/DT
45,360 combinations = 15 combined multi-sequence MRI × 3 image filters × 3 data balance methods × 4 data normalization strategies × 3 dimension reduction methods × 4 feature selectors × 7 classifiers. Abbreviations: PCA, principal component analysis; PCC, Pearson correlation coefficients; ANOVA, analysis of variance; KW, Kruskal–Wallis; RFE, recursive feature elimination; SVM, support vector machine; AE, Auto Encoder; LDA, linear discriminant analysis; RF, random forest; LR, logistic regression; LR-Lasso: logistic regression via lasso; and DT, decision tree.
Table 2. Clinical characteristics of the train and test cohorts.
Table 2. Clinical characteristics of the train and test cohorts.
CharacteristicTotalTrain CohortTest Cohortp-Value
Number (%)99 (100)80 (80.8)19 (19.2)
Age45.41 ± 13.6944.88 ± 13.8847.68 ± 12.980.62
Gender
Female
Male

53
46

39
41

14
5
0.13
IDH status
Wildtype
Mutation

27
72

22
58

5
14
0.92
Histological type
Astrocytomas
Oligodendrogliomas
NEC

57
14
28

46
11
23

11
3
5
0.962
1p/19q codeletion status
No
Yes

84
15

68
12

16
3
0.089
p < 0.05. Abbreviations: AUC, area under the curve; NPV, negative predictive value; PPV, positive predictive value; and NEC, Not Elsewhere Classified.
Table 3. The best performance of each combined multi-sequence MRI generated by the “6-Step” general radiomics model.
Table 3. The best performance of each combined multi-sequence MRI generated by the “6-Step” general radiomics model.
Combined Multi-Sequence MRITestAccSenSpeOptimal Pipeline
T10.778 ± 0.090.699 ± 0.150.729 ± 0.150.720 ± 0.19Wavelet_MinMax_PCC_RFE_15_RF
T20.842 ± 0.050.779 ± 0.080.780 ± 0.130.780 ± 0.19Wavelet_Mean_PCC_RFE_10_LDA
FLAIR0.800 ± 0.080.742 ± 0.090.736 ± 0.110.730 ± 0.25Wavelet_MinMax_Pcc_RFE_15_RF
T1Gd0.764 ± 0.040.679 ± 0.090.686 ± 0.160.66 ± 0.16Wavelet_Mean_PCA_RFE_15_LRLasso
T1+T20.696 ± 0.120.663 ± 0.090.714 ± 0.160.520 ± 0.22Wavelet_Mean_PCC_RFE_14_LDA
T1Gd+FLAIR0.647 ± 0.120.658 ± 0.090.722 ± 0.110.480 ± 0.20Wavelet_Mean_PCC_RFE_10_LR
T1+FLAIR0.858 ± 0.080.737 ± 0.080.686 ± 0.120.88 ± 0.16Wavelet_Mean_PCC_KW_13_AE
T1+T1Gd0.713 ± 0.090.637 ± 0.080.636 ± 0.070.640 ± 0.17Wavelet_MinMax_PCC_Relief_15_LDA
T1Gd+T20.825 ± 0.090.737 ± 0.070.786 ± 0.120.600 ± 0.24Wavelet_Zscore_PCC_RFE_14_SVM
T2+FLAIR0.873 ± 0.050.876 ± 0.090.875 ± 0.110.877 ± 0.15Wavelet_Mean_PCC_RFE_14_SVM
T1+FLAIR+T1Gd0.807 ± 0.070.763 ± 0.080.786 ± 0.120.700 ± 0.18Wavelet_Mean_PCA_RFE_12_AE
T1+T2+FLAIR0.738 ± 0.140.711 ± 0.110.714 ± 0.120.700 ± 0.18Wavelet_MinMax_PCC_Relief_3_RF
T2+FLAIR+T1Gd0.624 ± 0.160.663 ± 0.130.729 ± 0.170.480 ± 0.27Wavelet_Mean_PCC_RFE_10_LR
T1+T2+T1Gd0.816 ± 0.110.747 ± 0.080.743 ± 0.100.760 ± 0.20Wavelet_Zscore_PCA_RFE_10_SVM
T1+T2+T1Gd+FLAIR0.811 ± 0.070.763 ± 0.090.771 ± 0.100.740 ± 0.16Wavelet_Mean_PCC_ANOVA_10_RF
Abbreviations: AUC, area under the curve; Acc, accuracy; Sen, sensitivity; and Spe, specificity.
Table 4. Clinical statistics in the diagnosis of the best radiomics pipeline (T2+FLAIR combination).
Table 4. Clinical statistics in the diagnosis of the best radiomics pipeline (T2+FLAIR combination).
StatisticsValue
Accuracy0.9357
AUC0.957
AUC 95% CIs[0.926–1.000]
NPV0.8148
PPV1.0000
Sensitivity0.9138
Specificity1.0000
Abbreviations: AUC, area under the curve; NPV, negative predictive value; and PPV, positive predictive value.
Table 5. The 14 radiomic features with the highest average feature importance generated by the optimal pipeline (T2+FLAIR multi-sequence combination).
Table 5. The 14 radiomic features with the highest average feature importance generated by the optimal pipeline (T2+FLAIR multi-sequence combination).
FeaturesRankDescription
FLAIR_wavelet-HLL_glrlm_GrayLevelNonUniformity1Flair wavelet texture gray region size matrix characteristic gray nonuniformity
T2_wavelet-LLH_firstorder_Skewness2T2 wavelet first order characteristic skewness
T2_wavelet-HLL_glcm_Correlation3T2 wavelet characteristic correlation of texture gray level co-occurrence matrix
T2_wavelet-LHL_firstorder_Range4T2 wavelet texture first-order feature deviation
T2_wavelet-LHL_firstorder_Minimum5T2 wavelet texture first-order feature minimum
T2_wavelet-LHL_glcm_Correlation6Feature correlation of T2 wavelet texture gray level co-occurrence matrix
T2_wavelet-HLH_glcm_Correlation7Feature correlation of T2 wavelet texture gray level co-occurrence matrix
T2_wavelet-LHH_firstorder _Mean8T2 wavelet texture first-order feature mean
FLAIR_wavelet-HLL_glcm_JointEnergy9Joint energy of flair wavelet texture gray level co-occurrence matrix features
T2_wavelet-HLH_glszm_SizeZoneNonUniformityNormalized10T2 wavelet texture gray region size matrix feature normalized region size nonuniformity
FLAIR_wavelet-LLH_gldm_SmallDependence-LowGrayLevelEmphasis11Flair wavelet texture gray correlation matrix small dependence low gray emphasis
T2_wavelet-LLH_glcm_ InverseVariance12T2 wavelet texture gray level co-occurrence matrix characteristic deficit square
FLAIR_wavelet-HLH_glcm_InverseVariance13Characteristic deficit square of gray level co-occurrence matrix of flair wavelet texture
T2_wavelet-HLH_glszm_SmallAreaEmphasis14T2 wavelet texture gray area size matrix feature small area emphasis
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

He, A.; Wang, P.; Zhu, A.; Liu, Y.; Chen, J.; Liu, L. Predicting IDH Mutation Status in Low-Grade Gliomas Based on Optimal Radiomic Features Combined with Multi-Sequence Magnetic Resonance Imaging. Diagnostics 2022, 12, 2995. https://0-doi-org.brum.beds.ac.uk/10.3390/diagnostics12122995

AMA Style

He A, Wang P, Zhu A, Liu Y, Chen J, Liu L. Predicting IDH Mutation Status in Low-Grade Gliomas Based on Optimal Radiomic Features Combined with Multi-Sequence Magnetic Resonance Imaging. Diagnostics. 2022; 12(12):2995. https://0-doi-org.brum.beds.ac.uk/10.3390/diagnostics12122995

Chicago/Turabian Style

He, Ailing, Peng Wang, Aihua Zhu, Yankui Liu, Jianhuan Chen, and Li Liu. 2022. "Predicting IDH Mutation Status in Low-Grade Gliomas Based on Optimal Radiomic Features Combined with Multi-Sequence Magnetic Resonance Imaging" Diagnostics 12, no. 12: 2995. https://0-doi-org.brum.beds.ac.uk/10.3390/diagnostics12122995

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop