Next Article in Journal
Diagnostic Accuracy of Fine-Needle Aspiration Cytology and Core-Needle Biopsy in the Assessment of the Axillary Lymph Nodes in Breast Cancer—A Meta-Analysis
Previous Article in Journal
Evaluation of FDG-PET/CT Use in Children with Suspected Infection or Inflammation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Antigen-Specific Cytokine and Chemokine Gene Expression for Diagnosing Latent and Active Tuberculosis

1
Molecular Diagnostic Laboratory, Department of Biomedical Laboratory Sciences, Yonsei University, Wonju 26493, Korea
2
Institute of Biotechnology, Addis Ababa University, Addis Ababa, P.O. Box 1176, Ethiopia
3
Armauer Hansen Research Institute, Addis Ababa, P.O Box 1005, Ethiopia
4
St. Paul’s Hospital Millennium Medical College, Department of pathology, Addis Ababa, P.O. Box 1271, Ethiopia
*
Authors to whom correspondence should be addressed.
Submission received: 18 August 2020 / Revised: 15 September 2020 / Accepted: 16 September 2020 / Published: 18 September 2020
(This article belongs to the Section Diagnostic Microbiology and Infectious Disease)

Abstract

:
Tuberculosis infection exhibits different forms, namely, pulmonary, extrapulmonary, and latent. Here, diagnostic markers based on the gene expression of cytokines and chemokines for differentiating between tuberculosis infection state(s) were identified. Gene expression of seven cytokines (Interferon gamma (IFN-γ), Interferon gamma-induced protein 10 (IP-10), Interleukin-2 receptor (IL-2R), C-X-C Motif Chemokine Ligand 9 (CXCL-9), Interleukin 10 (IL-10), Interleukin 4 (IL-4), and Tumor Necrosis Factor alpha (TNF-α)) in response to tuberculosis antigen was analyzed using real-time polymerase reaction. The sensitivity and specificity of relative quantification (2^-ΔΔCt) of mRNA expression were analyzed by constructing receiver operating characteristic curves and measuring the area under the curve (AUC) values. Combinations of cytokines were analyzed using the R statistical software package. IFN-γ, IP-10, IL2R, and CXCL-9 showed high expression in latent and active tuberculosis patients (p = 0.001), with a decrease in IL10 expression, and no statistical difference in IL-4 levels among all the groups (p = 0.999). IL-10 differentiated pulmonary tuberculosis patients from latent cases with an AUC of 0.731. IL10 combined with CXCL-9 distinguished pulmonary tuberculosis patients from extrapulmonary cases with a sensitivity, specificity, and accuracy of 85.7%, 73.9%, and 81.0%, respectively. IL-10 together with IP-10 and IL-4 differentiated pulmonary tuberculosis from latent cases with a sensitivity and specificity of 77.1% and 88.1%, respectively. Decision tree analysis demonstrated that IFN-γ IL-2R, and IL-4 can diagnose tuberculosis infection with a sensitivity, specificity, and accuracy of 89.7%, 96.1%, and 92.7%, respectively. A combination of gene expression of cytokines and chemokines might serve as an effective marker to differentiate tuberculosis infection state(s).

1. Introduction

Tuberculosis is one of the leading causes of morbidity and mortality worldwide that accounted for the death of 1.2 million individuals and demonstrated an incidence of 10 million cases in the year 2018. Ethiopia is one of the thirty high burden countries worldwide with a total incidence rate of 151 and mortality rate of 24 per 100,000 population [1].
It is estimated that one-third of the global (2 billion) population has been infected with Mycobacterium tuberculosis (MTB), but only a small proportion (5–10%) will develop an active infection during the following months after the initial infection extending up to the lifetime, whereas the majority of the population demonstrate a latent infection [2]. Consequently, latent tuberculosis infection (LTBI) is believed to be the source of active infection. The state of latency is established due to the host immune response that controls the growth of MTB. Owing to this, the patient remains asymptomatic [3,4].
Improvement in the diagnostic tools is essential for accelerating the progress toward the elimination of tuberculosis as a public health problem by 2050. Mycobacterial culture, the gold standard method of diagnosis of active tuberculosis infection, is a time-consuming process (3 to 6 weeks). Hence, the diagnosis of MTB is primarily performed by sputum smear microscopy; however, it has a low sensitivity ranging from 20 to 60% [5]. The implementation of a rapid molecular test, such as GeneXpert®, has improved the detection of active tuberculosis infection with increased sensitivity. However, the diagnosis of extrapulmonary tuberculosis (EPTB) remains challenging due to the nature of the disease, which primarily relies on clinical symptoms and invasive procedures [6].
Interferon gamma (IFN-γ), the primary cytokine produced by host immune cells in response to MTB, is widely utilized to detect tuberculosis infection. [7]. In vitro measurements of the level of IFN-γ in blood against MTB antigens are utilized as a marker in tuberculosis infection. QuantiFERON Gold in tube (QFT-GIT) test, which is an enzyme-linked immunosorbent assay (ELISA) performed with whole blood samples, and enzyme-linked immunospot assay (T-SPOT) test, which is based on peripheral blood mononuclear cells (PBMCs), are the two gamma release assays (IGRAs) commercially available. Both methods utilize the expression of IFN-γ initiated by cluster of differentiation 4 (CD4) lymphocytes in response to ex-vivo stimulation with Region of Difference 1 (RD1)-encoded MTB-specific antigens, namely, culture filtrate protein (CFP-10) and early secretory antigenic target (ESAT-6) [8,9]. Although IGRAs have overcome the drawback of false positivity of the tuberculin sensitivity test (TST) owing to cross-reactivity with the BCG vaccine, it exhibits an inherent failure in discriminating between LTBI and active tuberculosis infection [10]. Therefore, the expression of various cytokines was studied and suggested as potential diagnostic markers that could differentiate various tuberculosis infection statuses. IFN-γ combined with IFN-γ-inducible protein 10 (IP-10) demonstrated an increased sensitivity for the detection of MTB infection [11]. In other studies, mitogen-induced IP-10 response showed higher sensitivity and specificity in distinguishing active tuberculosis and LTBI [12], and IP-10 combined with monocyte chemotactic protein-2 (MCP-2) was also demonstrated to be an effective marker for the diagnosis of tuberculosis infection [11]. QuantiFERON-TB Gold In-Tube (QFT-GIT) test also has a limitation in diagnosing EPTB. Although studies have proposed various diagnostic markers, accurate detection of EPTB remains elusive [13,14]. A previous study has shown that the implementation of combined markers might be useful for distinguishing various infection statuses [15].
MTB interacts initially with alveolar macrophages via cell surface receptors. Subsequently, cascades of signals lead to immune responses. The expression of cytokines is the primary immune response mediated by T-lymphocytes. T cells with CD4 surface molecules are known as T helper cells (Th1 and Th2) [16]. We hypothesized that the gene expression of Th1, Th2, and IFN- γ-induced chemokines might be utilized for the diagnosis of tuberculosis infection. Therefore, Th1 (pro-inflammatory) cytokines, such as IFN-γ, IL-2, and TNF-α; Th2 (anti-inflammatory) cytokines, including IL-4 and IL-10; and IFN-γ-induced chemokines, such as CXCL-9 and CXCL-10, were selected to investigate the gene expression in blood cells stimulated with MTB antigens and compare it with that of unstimulated control blood cells obtained from individuals categorized under four different groups of participants (healthy, latently infected, and smear-positive pulmonary tuberculosis (PTB) and EPTB).

2. Materials and Methods

2.1. Ethical Statement

The study protocol was reviewed and approved by the National Research Ethics Review Committee (NRERC), No. 3.10/13/2018, Ministry of Innovation and Technology, Ethiopia, and Yonsei University, Wonju Institutional Review Board (IRB) No. 1041849-201709-BR-104-02, South Korea. All participants were informed about the study and provided consent.

2.2. Study Participants and Case Definitions

A total of 151 participants (51 healthy controls, 42 latently infected individuals (LTBI), 35 Pulmonary tuberculosis (PTB), and 23 tuberculosis lymphadenitis (TBLN) were recruited during the study period (January 2018 to January 2019) from three hospitals and four health centers in Addis Ababa, Ethiopia. The case definition of participants was based on the WHO classification [17]. PTB patients were clinically diagnosed as new cases and confirmed by sputum smear examinations for acid-fast bacilli (AFB) and/or GeneXpert® and culture. Clinical suspects of lymphadenitis diagnosed with histological examination and culture-confirmed fine needle aspirates (FNA) were categorized under Extra pulmonary tuberculosis (EPTB). None of the latent infected and healthy control individuals had a history of tuberculosis or recent infections, and they were classified based on the clinical evidence and QFT-ELISA assays (Table 1). Household contacts who were QFT-positive were classified as having LTBI, whereas those with negative QFT results were considered healthy controls. Individuals with HIV infection, diabetes, allergic diseases, respiratory infections, and other immunocompromised conditions were excluded from this study.

2.3. Interferon Gamma Release Assay (IGRA)

IGRA was performed using the QuantiFERON®-TB Gold In-Tube test aided with ELISA. A total of 5 mL of whole blood was collected in heparin-coated tubes (BD Vacutainer®, Franklin Lakes, NJ, USA). Then, 1 mL of blood was added to three tubes: nil (control), MTB antigen-coated with (Early Secretary Antigen-6 (ESAT-6), Culture Filtrate Protein-10 (CFP-10), and TB7.7), and mitogen (to be used as a positive control), followed by incubation for 20 h at 37 °C. After incubation, plasma was collected via centrifugation and the levels of IFN-γ were measured by ELISA using the QFT system as per the manufacturer’s protocol [9]. The cells separated from the plasma were treated with 500 mL of Red Blood Cells (RBC) bone marrow stabilization buffer (Roche diagnostic, Manheim, Germany) and stored at −80 °C for subsequent RNA extraction.

2.4. RNA Extraction and Complementary DNA (cDNA) Synthesis

Whole blood cells mixed with stabilization buffer and stored under −80 °C were thawed. Total RNA was extracted using the High Pure RNA Isolation Kit (Roche diagnostic, Basel, Switzerland) following the manufacturer’s instructions (https://lifescience.roche.com/global_en/products/high-pure-rna-isolation-kit.html). The quality and concentration of RNA were measured using the Infinite® 200 PRO NanoQuant instrument. Prior to quantitative polymerase reaction, complementary DNA (cDNA) was prepared using the Moloney Murine Leukemia Virus (MMLV)-based reverse transcriptase enzyme, which is a two-step reaction involving the incubation of RNA templates with a master mix at 65 °C and subsequent amplification. Initially, 10 µL of the RNA template was added to a mixture containing 1 µL of 0.25 µg/µL random primer (Invitrogen®, Carlsbad, CA, USA) and 4 µL of 2.5 mM deoxynucleotide triphosphates (dNTPs) (iNtRON Biotechnology®, Gyeonggi-do, South Korea) and heated at 65 °C to denature the secondary structure of RNA. The reaction was immediately cooled on ice to let the primer anneal to the RNA. Then, 1 µL of the enzyme, MMLV-reverse transcriptase, 2 µL of 0.1 M dithiothreitol (DTT) (Invitrogen®), and 4 µL of 5x first strand buffer were added to the heated reaction mixture. Finally, amplification (cDNA synthesis) was performed using Veriti 96 well Thermal Cycler (Applied biosystem®, Foster City, CA, USA) with a reaction cycle set as 25 °C for 10 min, 37 °C for 50 min for RT extension, 70 °C for 15 min to inactivate the enzyme, and finally cooling at 4 °C. The synthesized cDNA was stored at −20 °C for real-time polymerase chain reaction (RT-PCR).

2.5. Primer, Probe Designing and Optimization

Primers and probes targeting the seven selected genes (IFN-γ, TNF-α, IL-10, IL-4, IL-2R, IP-10, and CXCL-9) were designed using a web application developed by Integrated DNA Technologies, Inc. (https://sg.idtdna.com/Primerquest/Home/Index). The sequences of each gene were entered into the website to generate the primers in line with their exon-exon junctions. The primers and probes were selected based on the parameters described [18] and evaluated in a previous study [19] (Supplementary Material Table S1).

2.6. Real-Time Polymerase Chain Reaction Analysis

RT-PCR was performed using the CFX96 Touch Real-Time PCR Detection System (Bio-Rad Laboratories, Inc, Hercules, CA, USA) and the TaqMan® probe that utilizes fluorescent emissions. Sense and antisense primers of IFN-γ, TNF-α, IL-10, IL4, IL2R, IP-10, and CXCL-9 were used to amplify the cDNA, and glyceraldehyde-3 phosphate (GAPDH) was used as a “housekeeping” gene [20]. The RT-PCR master mix containing 10 µL of THUNDERBIRD Probe qPCR Mix (TOOBO, Osaka, Japan), 5 µL of ultra-distilled water, 3 µL mixture of forward and reverse primer, and probe (1 µL of 10 pmol from each), was dispensed in to the PCR tubes. Then, 2 µL of cDNA was added to bring the final reaction volume up to 20 µL. The reaction cycle for RT-PCR was set as follows: 20 s at 95 °C followed by 40 cycles of 3 s at 95 °C and 30 s at 60 °C.

2.7. Normality of Sample Distribution

The gene expression results were entered in an excel data sheet following the protocol described in a previous study [21]. The changes in the expression of the gene encoding the MTB antigen between stimulated and non-simulated controls were normalized using the reference gene (GAPDH) expression results. The relative gene expression was calculated using the 2−ΔΔCT method (Supplementary Material Table S2) [21]. The sample distribution was assessed with the normality test using the SPSS software package. The data showed that the distribution was not normal with a significance value of 0.000. Thus, we used the Kruskal-Wallis test and Student’s t-test (Supplementary Material Table S3).

2.8. Data Analysis

The expression of mRNA extracted from MTB antigen-stimulated (ESAT-6, CFP-10, and TB7.7) and unstimulated whole blood cells were analyzed by CFX Manager software Version: 3.1. (Bio-Rad Laboratories, Inc.). The threshold (Ct) for each was set to analyze the absolute expression, which is the result of differences between stimulated and non-stimulated expression after normalizing with the expression of the endogenous gene (Supplementary Material Table S4). Then, the relative quantification of the expression of the seven selected target genes was then analyzed using the 2−ΔΔCT method as described in a previous study [21].
The differences in gene expression between two groups were compared using the Mann-Whitney test, whereas the variances among four groups (healthy controls (HC), Latent tuberculosis (LTB), Pulmonary tuberculosis (PTB), and Extra pulmonary tuberculosis (EPTB)) were compared using the nonparametric ANOVA (Kruskal–Wallis) test, and multiple comparisons were corrected with the Dunn’s post-test. The diagnostic performance of cytokines was estimated using the receiver operating characteristic (ROC) curve analysis and calculating the area under the curve (AUC) values. The p-value < 0.05 was considered statistically significant. In addition, the diagnostic value of a combination of genes was evaluated by R 3.6.3 foundation statistical computing by processing four types of classifier models (decision tree, logistic regression, neural network, and support vector machines).

3. Results

3.1. Participants Characteristics

A total of 151 subjects were enrolled, consisting of 51 healthy controls, 42 latently infected patients, 35 PTB patients, and 23 EPTB (TBLN) patients. The number of male participants was higher than that of females, with a male to female ratio of 1.7 (95 males and 56 females). The mean age of participants was 30.62 ± 9.6 years, ranging from 18 to 70 years (Table 1 and Figure 1).

3.2. Determination of Cut off Values and Diagnostic Performance of Cytokines and Chemokines

The cutoff values were determined by considering both EPTB and PTB cases as positive, whereas the healthy groups were considered controls, based on the ROC curve analysis. The cut off values for IFN-γ, TNF-α, IL-10, IL2R, IP-10, and CXCL-9 were >1.07, >1.52, <0.55, >2.02, >1.22, and >1.22, respectively. The diagnostic potential of the markers was evaluated by determining the positivity using the relative expression results of each marker. For differentiating PTB, IFN-γ and CXCL-9 exhibited the highest positivity (85.72%) followed by IP-10 and IL-10 with 80%, IL-2R with 74.3%, and TNF-α, which showed the lowest positivity at 62.9% (Supplementary Material Table S4).

3.3. Individual Biomarkers Identification and Validation

Multiple comparisons were performed using the Mann–Whitney test and ANOVA to assess the difference in the median values, and ROC curve analysis was also applied to evaluate the discriminatory ability of individual cytokines between different groups (Table 2). Accordingly, four cytokine genes, IFN-γ, IP-10, IL2R, CXCL-9, and TNF-α showed significant difference (p = 0.0001) between patients with LTBI and healthy individuals with AUC values of 0.86, 0.85, 0.82, 0.79, and 0.694, respectively. However, the mean value of IL10 and IL4 did not show a significant difference between the two groups with p = 0.99 (Table 2). In a similar analysis, five cytokines genes, IFN-γ, IP-10, IL2R, CXCL-9, and IL-10 showed a significant difference (p = 0.0001 for all but IL-2R 0.0002) between PTB patients and healthy participants with AUC of 0.89, 0.84, 0.73, 0.84, 0.82, respectively (Figure 2 and Table 2). In the case of EPTB, we observed that the gene expression of five cytokines, namely, IFN-γ, IP-10, IL2R, CXCL-9, and TNF-α, significantly differentiated from healthy controls with p-values of 0.0001, 0.0001, 0.0008, 0.009, and 0.007 and AUC values of 0.81, 0.79, 0.74, 0.69, and 0.70, respectively (Figure 3 and Table 2).
Moreover, the total tuberculosis patients included the combination of both PTB and EPTB patients. The Mann–Whitney test and multiple comparison ANOVA (Kruskal–Wallis test) demonstrated that six markers, namely, IFN-γ, TNF-α, IP-10, IL-10, IL-2R, and CXCL-9, showed significant differences as compared to healthy controls (Table 2). The p-value of four cytokines (IFN-γ, IP-10, IL-2R, and CXCL-9) was 0.0001, whereas the p-value of IL-10 and TNF-α was 0.0002 and 0.003, respectively. To analyze the diagnostic potential of these markers in tuberculosis infection, ROC curves were also evaluated. IFN-γ demonstrated the highest AUC value of 0.86, with a 95% confidence interval (CI) ranging from 0.79 to 0.93, followed by IP-10 with AUC = 0.82 and CI ranging from 0.74–0.90, CXCL-9 with AUC = 0.78 and CI ranging from 0.70–0.87, and IL2R with AUC = 0.74 and CI ranging from 0.64–0.832 (Figure 4A–F).
The comparative analysis between PTB and latently infected patients was performed using a non-parametric t-test, the results of which demonstrated that out of the seven genes, IL-10 was the only gene that was able to differentiate LTB from PTB with a p-value of 0.0004. In addition, ROC curve analysis was performed to assess the diagnostic potential of IL-10, which showed the AUC value of 0.731 (Figure 5A,B). The Mann–Whitney t-test analysis between PTB and EPTB also demonstrated that both IL-10 and CXCL-9 demonstrated significant differences with p-values of 0.004 (Table 2B). Moreover, the evaluation of the diagnostic potential of the two markers (IL10 and CXCX-9) for distinguishing between PTB and EPTB resulted in AUC values of 0.731 and 0.72, sensitivity of 66.2% and 73.9%, and specificity of 62.9% and 65.7%, respectively, in addition to a p-value of 0.004 (Figure 5C,D and Figure 6A,B).
In general, the analysis of variations in the relative gene expression among four groups of participants (HC, LTB, PTB, and EPTB) using Kruskal-Wallis and Mann-Whitney tests demonstrated that the expression of five genes, namely, IFN-γ, IP-10, IL2R, CXCL-9, and TNFα was increased significantly in the LTBI, PTB, and EPTB cases compared to healthy controls with varied p-values, whereas no significant differences were observed in IL4 expression (p = 0.6023). The level of IL10 was lower in PTB than in other groups (Figure 7). In addition, four genes, namely, IFN-γ, IP-10, IL2R, and CXCL-9, were strongly expressed and demonstrated a high diagnostic potential for tuberculosis (Table 2).

3.4. Combination of Cytokine Markers in Discriminating Tuberculosis Infection

The diagnostic efficiency of the combinations of genes was assessed with the R software. The qPCR data stored in excel were entered into a program designed to run automatically with four models using R script: decision tree, logistic regression, neural network, and support vector machine. The training, validation, and test sets were assigned with a ratio of 8:2:2, respectively. The R program was run with 4000 iterations. The convergence result showed that a combination of cytokines could differentiate between different tuberculosis state(s) with better sensitivity, specificity, and accuracy. Accordingly, the data obtained from four groups of participants were analyzed in six different comparison setups (Table 3 and Supplementary Material Table S5).
The decision tree analysis showed that IL 10, IL 4, and IP 10 were able to differentiate between LTBI and active tuberculosis with 77.1% sensitivity, 83.1% specificity, and 88.1% accuracy (Table 3 and Figure 8). Moreover, a combination of IFN-γ, IL-10, and IL-2R was able to differentiate PTB from healthy controls with a test result of 97.1% sensitivity 88.2% specificity, and 91.9% accuracy. In addition, IFN-γ, IL-2R, and IL4 were identified as effective markers to differentiate both EPTB and PTB from healthy controls with a sensitivity of 89.7%, specificity of 96.1%, and accuracy of 96.1%. IL-10 combined with CXCL-9 could also differentiate EPTB from PTB with 85.7% sensitivity, 73.9% specificity, and 81.0% accuracy (Table 3). In a similar analysis, latently infected plus healthy control groups were compared with actively infected participants (both pulmonary and extra pulmonary tuberculosis), pulmonary tuberculosis and extrapulmonary tuberculosis, respectively (Supplementary Material Table S5).

4. Discussion

A QuantiFERON®-TB Gold In-Tube assay that measures the level of IFN-γ released in response to MTB antigens was utilized to detect tuberculosis infection. However, it cannot differentiate LTBI from active tuberculosis infection cases [10]. Consequently, the development of a rapid and noninvasive bioassay is essential for the diagnosis of tuberculosis infection status. Different studies have proposed that both individual and/or combined cytokines can act as potential biomarkers in differentiating PTB from LTBI [12,15,19,22,23] as well as for the detection of EPTB [13,14,24]. In this study, we employed RT-qPCR to analyze the relative gene expression of cytokines that were stimulated as a part of the bioassay for discriminating tuberculosis infection status, which offers a better advantage with increased sensitivity and specificity. Thus, the genetic expression of selected cytokines was used in differentiating the tuberculosis infection state of participants categorized in four groups: PTB, EPTB (TBLN), latently infected (QFT-positive), and healthy controls (QFT-negative) (Table 2 and Table 3).
We observed that, of the seven cytokine genes analyzed by non-parametric t-tests, the expression of five genes, namely, IP-10, CXCL-9, IFN-γ, IL-2R and IL-10, was significantly different in PTB compared to the healthy controls with AUC values of 0.842, 0.844, 0.889, 0.732, and 0.818, respectively (Figure 2). In accordance with our results, the expression of cytokines, namely, IFN-γ, IL-2R, and IP-10 was reported to be significantly higher in tuberculosis patients than in healthy individuals in a previous study [19]. In another study, IFN-γ, IL-4, IP-10, and TNF levels in plasma were able to discriminate tuberculosis patients from household contacts with high sensitivity. In contrast, none of them were competent to differentiate between QFT-positive and QFT-negative household contacts [25].
The response of the hosts to mycobacterial infection involves a wide range of cytokines and chemokines at different levels of the immune system. Various studies have proposed a multiplex model of cytokines and chemokines as biomarkers to distinguish tuberculosis infection status owing to the advantages of increased sensitivity and specificity over the use of single cytokines and/or chemokines [19,26]. Hence, combined detection of IFN-γ, IP-10, and Monokine-induced-by-IFN-γ (MIG) exhibits better diagnostic performance for tuberculosis than the individual cytokine/chemokine assays [26]. Cytokines, such as IFN-γ, IL-1RA, IL-8, and MCP-1, were also differentially expressed at higher levels in tuberculosis patients compared to latently infected participants. IL10 and IL-5 levels were lower in latently infected individuals than tuberculosis patients [22]. In contrast, our study showed that the levels of IL10 were lower in PTB patients than in any other form of tuberculosis (Figure 7). In this study, we utilized both combined and individual cytokine analysis to discriminate PTB from latently infected participants and healthy controls. Accordingly, IL-10 was a single cytokine that differentiated PTB from latently infected participants with a p-value of 0.0005 and AUC 0.731 (Figure 5A,B), which is in contrast to the previous study wherein IL10 levels were higher in in PTB patients than in latently infected individuals [22]. In parallel, the diagnostic capacity of combined cytokines using decision tree analysis demonstrated that the combination of IL10, IL4, and IP10 could distinguish PTB patients from latently infected individuals with a sensitivity, specificity, and accuracy of 77.1%, 88.1%, and 83.1%, respectively (Table 3). Similarly, a previous study also reported that IL10 and IL2 accurately identified active tuberculosis from LTBI cases [23]. Moreover, the expression of combinations of Th1 type factors (TNF-α and IL-2R) and IFN-γ-induced chemokines (CXCL9 and CXCL10) potentially differentiated PTB from latently infected participants and healthy controls and identified the combinations of IFN-γ, TNFα, and IL-2R and TNF-α, IL-2R, CXCL-9, and IP-10 as the best diagnostic markers for active and LTBI, respectively [19].
Accurate diagnosis of EPTB remains obscure. Goyal et al., suggested that the serum level of circulating IFN-γ and the ratio of IFN-γ and IL-2 remarkably identified EPTB patients from healthy controls [13]. Our study showed that, of the seven markers analyzed IFN-γ, IP10, IL2R, TNF-α and CXCL9 distinguished pulmonary tuberculosis cases from health controls with AUC value of 0.813, 0.79, 0.74, 0.7 and 0.69 respectively(Figure 3).In another study, the plasma level of VEGF was demonstrated to be a biomarker for differentiating EPTB from non-extrapulmonary forms [24]. In this study, individual cytokine analysis using a non-parametric t-test and ROC curve revealed that IL10 and CXCL-9 were able to differentiate EPTB from PTB cases (Figure 5C,D and Figure 6). Similarly, analysis using machine learning also showed that a combination of IL10 and CXCL9 had a diagnostic capacity to identify EPTB from PTB with a sensitivity, specificity, and accuracy of 85.7%, 73.9%, and 81% (Table 3).
In addition, the analysis of PTB and EPTB as one group (PETB) to identify common markers using both machine learning and non-parametric t-test methods was performed. Accordingly, of the seven genes, the following five cytokines: IFN-γ, IP10, IL10, IL2R, and CXCL9 were identified as markers that individually differentiated PETB cases from healthy controls (Figure 4). In contrast, the decision tree analysis showed that combined gene expression of IFN-γ, IL-2R, and IL4 differentiated tuberculosis patients (both PTB and EPTB) from healthy participants with sensitivity, specificity, and accuracy of 89.7%, 96.1%, and 92.7%, respectively. Hence, IFN-γ and IL-2R are common markers identified and associated with tuberculosis (Table 3).

5. Conclusions

The development of rapid and accurate diagnostic markers is important for controlling and treating tuberculosis. Differentiating active tuberculosis cases from latent cases still lacks accurate methods. In this study, we observed that IL10 combined with IL 4 and IP 10 could act as a marker to differentiate PTB from LTBI. In addition, the combination of IL10 with CXCL-9 was demonstrated to be an effective marker for differentiating active pulmonary cases from EPTB (TBLN). Based on the machine learning analysis results, IFN-γ and IL2R were found to be the common markers associated with tuberculosis. Thus, combined cytokine and chemokine markers exhibit better potential for diagnosis and differentiation of tuberculosis infection state(s).

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/2075-4418/10/9/716/s1, Table S1: Primer and probe sequences used for quantification, Table S2: Determination of the relative expression of cytokines using 2−ΔΔCt method, Table S3: Normality test of relative gene expression of cytokines, Table S4: Threshold values, sensitivity, specificity, and cut off values for cytokines and chemokines, Table S5: Decision tree (DT) analysis of combined cytokines gene expression using R program that run with 4000 iterations.

Author Contributions

Conceptualization, methodology, formal analysis, data curation, investigation, original draft preparation, and review and editing, W.K.; supervision, conceptualization, review and editing, methodology, project administration, and funding acquisition; H.L., A.M. and T.S.T.; methodology, and investigation, A.T. (Azeb Tarekegn), M.T., M.O.H., A.T. (Adem Tuha), S.K., Y.C., D.H. and M.A. All authors have read and agreed to the published version of the manuscript.

Funding

This study is part of the research funded by the National Research Foundation, Joint research program, Republic of Korea (Grant Number = NFR-2017K2A9A1A01092944).

Acknowledgments

We are grateful to Taye Balcha (Armaure Hansen Research Institute) for his genuine support and for creating the platform for collaboration. We also acknowledge individuals and professionals who assisted in sample collection and transportation: Tigist Damitew and Tirsit Ayalew (Zewuditu Memorial Hospital); Abebayew Minalu and Nesira Kedir (Tekilehaymahot Health Station); Fantanesh Melese, Yayehyirad Tassachew, Emawayish Andargie, Henok Andualem, Dawit Beyene, Dawit Tayachew, and Daniel Demissu (Armaure Hansen Research Institute); Ahmed Musa (Girar Health Station); Kelemua Zewude and Tesfu Melaku (St. Paul’s Hospital Millennium Medical College, Department of Pathology).

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Annabel, B.; Anna, D.; Hannah, M. Global Tuberculosis Report 2019; World Health Organization: Geneva, Switzerland, 2019. [Google Scholar]
  2. Harding, E. WHO global progress report on tuberculosis elimination. Lancet Respir. Med. 2020, 8, 19. [Google Scholar] [CrossRef]
  3. Lin, P.L.; Flynn, J.L. Understanding latent tuberculosis: A moving target. J. Immunol. 2010, 185, 15–22. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. O’Garra, A.; Redford, P.S.; McNab, F.W.; Bloom, C.I.; Wilkinson, R.J.; Berry, M.P.R. The Immune Response in Tuberculosis. Annu. Rev. Immunol. 2013, 31, 475–527. [Google Scholar] [CrossRef] [PubMed]
  5. Steingart, K.R.; Ng, V.; Henry, M.; Hopewell, P.C.; Ramsay, A.; Cunningham, J.; Urbanczik, R.; Perkins, M.D.; Aziz, M.A.; Pai, M. Sputum processing methods to improve the sensitivity of smear microscopy for tuberculosis: A systematic review. Lancet Infect. Dis. 2006, 6, 664–674. [Google Scholar] [CrossRef]
  6. Lawn, S.D.; Mwaba, P.; Bates, M.; Piatek, A.; Alexander, H.; Marais, B.J.; Cuevas, L.E.; McHugh, T.D.; Zijenah, L.; Kapata, N.; et al. Advances in tuberculosis diagnostics: The Xpert MTB/RIF assay and future prospects for a point-of-care test. Lancet Infect. Dis. 2013, 13, 349–361. [Google Scholar] [CrossRef] [Green Version]
  7. Domingo-Gonzalez, R.; Prince, O.; Cooper, A.; Khader, S.A. Cytokines and Chemokines in Mycobacterium tuberculosis Infection. Microbiol. Spectr. 2016, 4. [Google Scholar] [CrossRef] [Green Version]
  8. Andersen, P.; Munk, M.E.; Pollock, J.M.; Doherty, T.M. Specific immune-based diagnosis of tuberculosis. Lancet 2000, 356, 1099–1104. [Google Scholar] [CrossRef]
  9. Harada, N. Characteristics of a diagnostic method for tuberculosis infection based on whole blood interferon-gamma assay. Kekkaku 2006, 81, 681–686. [Google Scholar]
  10. Herrera, V.; Perry, S.; Parsonnet, J.; Banaei, N. Clinical Application and Limitations of Interferon-γ Release Assays for the Diagnosis of Latent Tuberculosis Infection. Clin. Infect. Dis. 2011, 52, 1031–1037. [Google Scholar] [CrossRef] [Green Version]
  11. Ruhwald, M.; Bodmer, T.; Maier, C.; Jepsen, M.; Haaland, M.B.; Eugen-Olsen, J.; Ravn, P. Evaluating the potential of IP-10 and MCP-2 as biomarkers for the diagnosis of tuberculosis. Eur. Respir. J. 2008, 32, 1607–1615. [Google Scholar] [CrossRef] [Green Version]
  12. Jeong, Y.H.; Hur, Y.-G.; Lee, H.; Kim, S.; Cho, J.-E.; Chang, J.; Shin, S.J.; Lee, H.; Kang, Y.A.; Cho, S.-N.; et al. Discrimination between active and latent tuberculosis based on ratio of antigen-specific to mitogen-induced IP-10 production. J. Clin. Microbiol. 2015, 53, 504–510. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Goyal, N.; Kashyap, B.; Kaur, I.R. Significance of IFN-ɤ/IL-2 Ratio as a Circulating Diagnostic Biomarker in Extrapulmonary Tuberculosis. Scand. J. Immunol. 2016, 83, 338–344. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Santos, A.P.; Corrêa, R.D.S.; Ribeiro-Alves, M.; Soares da Silva, A.C.O.; Mafort, T.T.; Leung, J.; Pereira, G.M.B.; Rodrigues, L.S.; Rufino, R. Application of Venn’s diagram in the diagnosis of pleural tuberculosis using IFN-γ, IP-10 and adenosine deaminase. PLoS ONE 2018, 13, e0202481. [Google Scholar] [CrossRef] [PubMed]
  15. Wang, S.; Li, Y.; Shen, Y.; Wu, J.; Gao, Y.; Zhang, S.; Shao, L.; Jin, J.; Zhang, Y.; Zhang, W. Screening and identification of a six-cytokine biosignature for detecting TB infection and discriminating active from latent TB. J. Transl. Med. 2018, 16, 206. [Google Scholar] [CrossRef] [Green Version]
  16. Bozzano, F.; Marras, F.; de Maria, A. Immunology of Tuberculosis. Mediterr. J. Hematol. Infect. Dis. 2014, 6, e2014027. [Google Scholar] [CrossRef]
  17. World Health Organization. Treatment of Tuberculosis: Guidelines; World Health Organization: Geneva, Switzerland, 2010. [Google Scholar]
  18. Rodríguez, A.; Rodríguez, M.; Córdoba, J.J.; Andrade, M.J. Design of primers and probes for quantitative real-time PCR methods. Methods Mol. Biol. 2015, 1275, 31–56. [Google Scholar] [PubMed]
  19. Kim, S.; Lee, H.; Kim, H.; Kim, Y.; Cho, J.-E.; Jin, H.; Kim, D.Y.; Ha, S.-J.; Kang, Y.A.; Cho, S.-N.; et al. Diagnostic performance of a cytokine and IFN-γ-induced chemokine mRNA assay after Mycobacterium tuberculosis-specific antigen stimulation in whole blood from infected individuals. J. Mol. Diagn. 2015, 17, 90–99. [Google Scholar] [CrossRef]
  20. Barber, R.D.; Harmer, D.W.; Coleman, R.A.; Clark, B.J. GAPDH as a housekeeping gene: Analysis of GAPDH mRNA expression in a panel of 72 human tissues. Physiol. Genom. 2005, 21, 389–395. [Google Scholar] [CrossRef] [Green Version]
  21. Livak, K.J.; Schmittgen, T.D. Analysis of relative gene expression data using real-time quantitative PCR and the 2(-Delta Delta C(T)) Method. Methods 2001, 25, 402–408. [Google Scholar] [CrossRef]
  22. Suzukawa, M.; Akashi, S.; Nagai, H.; Nagase, H.; Nakamura, H.; Matsui, H.; Hebisawa, A.; Ohta, K. Combined Analysis of IFN-γ, IL-2, IL-5, IL-10, IL-1RA and MCP-1 in QFT Supernatant Is Useful for Distinguishing Active Tuberculosis from Latent Infection. PLoS ONE 2016, 11, e0152483. [Google Scholar] [CrossRef] [Green Version]
  23. Wu, J.; Wang, S.; Lu, C.; Shao, L.; Gao, Y.; Zhou, Z.; Huang, H.; Zhang, Y.; Zhang, W. Multiple cytokine responses in discriminating between active tuberculosis and latent tuberculosis infection. Tuberculosis 2017, 102, 68–75. [Google Scholar] [CrossRef] [PubMed]
  24. Ranaivomanana, P.; Raberahona, M.; Rabarioelina, S.; Borella, Y.; Machado, A.; Randria, M.J.D.D.; Rakotoarivelo, R.A.; Rasolofo, V.; Rakotosamimanana, N. Cytokine Biomarkers Associated with Human Extra-Pulmonary Tuberculosis Clinical Strains and Symptoms. Front. Microbiol. 2018, 9, 275. [Google Scholar] [CrossRef] [PubMed]
  25. Mihret, A.; Bekele, Y.; Bobosha, K.; Kidd, M.; Aseffa, A.; Howe, R.; Walzl, G. Plasma cytokines and chemokines differentiate between active disease and non-active tuberculosis infection. J. Infect. 2013, 66, 357–365. [Google Scholar] [CrossRef] [PubMed]
  26. Wang, X.; Jiang, J.; Cao, Z.; Yang, B.; Zhang, J.; Cheng, X. Diagnostic performance of multiplex cytokine and chemokine assay for tuberculosis. Tuberculosis 2012, 92, 513–520. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Age distribution of study participants and frequency classified with a gap of 10 years. The mean age was 36.62 ± 9.65 years.
Figure 1. Age distribution of study participants and frequency classified with a gap of 10 years. The mean age was 36.62 ± 9.65 years.
Diagnostics 10 00716 g001
Figure 2. (AE) ROC curve analysis of cytokines and chemokines in pulmonary tuberculosis patients (PTB) compared to healthy controls (HC). The genetic expression of Interferon gamma, Interferon gamma-induced protein 10 (IP-10), Interleukin-2 receptor (IL-2R), and C-X-C Motif Chemokine Ligand 9, Interleukin 10 (IL-10) Pulmonary tuberculosis infected patients (n = 35), compared with healthy controls (n = 51) from A to E respectively.
Figure 2. (AE) ROC curve analysis of cytokines and chemokines in pulmonary tuberculosis patients (PTB) compared to healthy controls (HC). The genetic expression of Interferon gamma, Interferon gamma-induced protein 10 (IP-10), Interleukin-2 receptor (IL-2R), and C-X-C Motif Chemokine Ligand 9, Interleukin 10 (IL-10) Pulmonary tuberculosis infected patients (n = 35), compared with healthy controls (n = 51) from A to E respectively.
Diagnostics 10 00716 g002
Figure 3. (AE) The Receiver Operating Characteristic (ROC) curve analysis of cytokines and chemokines gene expressions of extrapulmonary tuberculosis patients (EPTB), n = 23 compared to healthy controls n = 51, where the Area Under the Curve (AUC) values of CXCL_9, TNF-α, IP-10, IL-2R, and IFN-γ from A to E respectively.
Figure 3. (AE) The Receiver Operating Characteristic (ROC) curve analysis of cytokines and chemokines gene expressions of extrapulmonary tuberculosis patients (EPTB), n = 23 compared to healthy controls n = 51, where the Area Under the Curve (AUC) values of CXCL_9, TNF-α, IP-10, IL-2R, and IFN-γ from A to E respectively.
Diagnostics 10 00716 g003
Figure 4. The Receiver Operating Characteristic (ROC) curve analysis of cytokines and chemokines (IFN-γ: (A), IP-10: (B), TNF-α: (C), IL-10: (D), IL-2R: (E), and CXCL-9: (F)) gene expressions of active tuberculosis patients (n = 58) compared with healthy controls (n = 51). Active tuberculosis infected patient category is the sum of pulmonary and Extrapulmonary infected participants which is represented as PETB. The p values (p < 0.05) considered as statistically significant.
Figure 4. The Receiver Operating Characteristic (ROC) curve analysis of cytokines and chemokines (IFN-γ: (A), IP-10: (B), TNF-α: (C), IL-10: (D), IL-2R: (E), and CXCL-9: (F)) gene expressions of active tuberculosis patients (n = 58) compared with healthy controls (n = 51). Active tuberculosis infected patient category is the sum of pulmonary and Extrapulmonary infected participants which is represented as PETB. The p values (p < 0.05) considered as statistically significant.
Diagnostics 10 00716 g004
Figure 5. (A) Mann-Whitney test result of IL-10 levels between LTBI and PTB patients (**** p < 0.0004). (B) ROC curve analysis result of IL-10 levels between LTBI and PTB patients. (C) Mann-Whitney test result of IL-10 levels between PTB and EPTB patients where the red line shows the median of each groups. (D) ROC curve analysis result of IL-10 levels between PTB and EPTB patients.
Figure 5. (A) Mann-Whitney test result of IL-10 levels between LTBI and PTB patients (**** p < 0.0004). (B) ROC curve analysis result of IL-10 levels between LTBI and PTB patients. (C) Mann-Whitney test result of IL-10 levels between PTB and EPTB patients where the red line shows the median of each groups. (D) ROC curve analysis result of IL-10 levels between PTB and EPTB patients.
Diagnostics 10 00716 g005
Figure 6. (A) Mann-Whitney test (** p < 0.004, the red line shows the median of each groups) and (B) ROC curve analysis results of CXCL-9 levels between PTB and EPTB patients.
Figure 6. (A) Mann-Whitney test (** p < 0.004, the red line shows the median of each groups) and (B) ROC curve analysis results of CXCL-9 levels between PTB and EPTB patients.
Diagnostics 10 00716 g006
Figure 7. Kruskal–Wallis test of the relative expression of genes among four groups of participants (healthy controls, PTB, LTB and EPTB). The expression value of each groups was different, and the results were presented by comparing each tuberculosis infected groups versus with health controls. Of the seven cytokines, five such as (A) IFN-γ, (B) IP-10, (C) IL-2R (D) CXCL-9, and (E) TNF-α were shown significant difference between tuberculosis infected (LTB, PTB and EPTB) and healthy controls with the p values written on each figure whereas IL-4 (G) showed no statistically significant differences. IL10 (F) showed significance differences between PTB and LTB or PTB and HC but no differences between LTB and HC.
Figure 7. Kruskal–Wallis test of the relative expression of genes among four groups of participants (healthy controls, PTB, LTB and EPTB). The expression value of each groups was different, and the results were presented by comparing each tuberculosis infected groups versus with health controls. Of the seven cytokines, five such as (A) IFN-γ, (B) IP-10, (C) IL-2R (D) CXCL-9, and (E) TNF-α were shown significant difference between tuberculosis infected (LTB, PTB and EPTB) and healthy controls with the p values written on each figure whereas IL-4 (G) showed no statistically significant differences. IL10 (F) showed significance differences between PTB and LTB or PTB and HC but no differences between LTB and HC.
Diagnostics 10 00716 g007
Figure 8. Machine learning-based decision tree comparing PTB and LTBI cases. The combination of IL-10, IL-4, and IP-10 distinguishes PTB from LTBI with a sensitivity, specificity, and accuracy of 77.1%, 88.1%, and 83.1%, respectively.
Figure 8. Machine learning-based decision tree comparing PTB and LTBI cases. The combination of IL-10, IL-4, and IP-10 distinguishes PTB from LTBI with a sensitivity, specificity, and accuracy of 77.1%, 88.1%, and 83.1%, respectively.
Diagnostics 10 00716 g008
Table 1. Categorization of participants by sex, percentile proportion, and QuantiFERON enzyme-linked immunosorbent assay (QFT-ELISA) test results after 20 h of incubation at 37 °C.
Table 1. Categorization of participants by sex, percentile proportion, and QuantiFERON enzyme-linked immunosorbent assay (QFT-ELISA) test results after 20 h of incubation at 37 °C.
Healthy ControlLatent TuberculosisPTBEPTB
SexMale27292613
Female2413910
Total 51423523
%33.827.823.215.2
QFT (+/−)0/5142/034/123/0
Table 2. The cytokines and chemokines gene expression results compared among different groups. A/ Multiple comparison result among the groups using Kruskal-Wallis Test (One-way Analysis of Variances (ANOVA)) B comparison between two groups using Mann–Whitney U test. The p value for the statistical analysis were set as 0.05 and 95% CI.
Table 2. The cytokines and chemokines gene expression results compared among different groups. A/ Multiple comparison result among the groups using Kruskal-Wallis Test (One-way Analysis of Variances (ANOVA)) B comparison between two groups using Mann–Whitney U test. The p value for the statistical analysis were set as 0.05 and 95% CI.
A Multiple Comparison ANOVA (Kruskal-Wallis Test)
MarkerHC vs. LTBHC vs. PTBHC vs. EPTBHC vs. PTB, EPTBLTB vs. PTBPTB vs. EPTB
INF-γ0.00010.00010.00150.00010.9990.999
TNF-α0.02330.25820.12560.0390.9990.999
IP-100.00010.00010.00350.00010.9990.999
IL-100.9990.00010.9990.00220.00650.0472
IL-2R0.9990.00810.0060.00040.9990.999
IL-40.00010.9990.9990.9990.9990.999
CXCL-90.00010.00010.58030.00010.9990.1066
B Mann-Whitney Test (Two-Sided)
MarkerHC vs. LTBHC vs. PTBHC vs. EPTBHC vs. PTB, EPTBLTB vs. PTBPTB vs. EPTB
IFN-γ0.00010.00010.00010.00010.78750.1436
TNF-α0.00120.02160.00680.00270.50330.8514
IP-100.00010.00010.00010.00010.71040.2912
IL-100.252<0.00010.61980.00020.00040.0045
IL-2R0.00010.00020.0008<0.00010.12220.5781
IL-40.40080.60430.61180.92650.19410.4414
CXC-L-90.0001<0.00010.0094<0.00010.38390.004
Table 3. Decision tree analysis results obtained using R. The analysis of cytokine gene expression performed to distinguish different categories was programmed using R-statistical software package with a ratio of 6:2:2 corresponding to validation, training, and test sets, respectively. A total of 151 participants, with 51 healthy controls, 42 latently infected participants, 35 smear-positive PTB patients, and 23 clinically and cytologically confirmed EPTB patients were analyzed.
Table 3. Decision tree analysis results obtained using R. The analysis of cytokine gene expression performed to distinguish different categories was programmed using R-statistical software package with a ratio of 6:2:2 corresponding to validation, training, and test sets, respectively. A total of 151 participants, with 51 healthy controls, 42 latently infected participants, 35 smear-positive PTB patients, and 23 clinically and cytologically confirmed EPTB patients were analyzed.
Decision Tree Analysis Result
Category ControlPatientTotalNormalityAccuracySensitivitySpecificityGenes
HC vs. LTBTrain40337354.8%86.3%75.8%95.0%IFN-γ, IL2R
Validate1192055.0%100.0%100.0%100.0%
Test51429354.8%89.2%81.0%96.1%
ControlPatientTotalNormalityAccuracySensitivitySpecificity
HC vs. PTBTrain40276759.7%89.6%96.3%85.0%IFN-γ, IL10, IL2R
Validate1181957.9%100.0%100.0%100.0%
Test51358659.3%91.9%97.1%88.2%
ControlPatientTotalNormalityAccuracySensitivitySpecificity
LTB vs. PTBTraining33276055.0%83.3%77.8%87.9%IL10, IL4, IP10
Validation981752.9%82.4%75.0%88.9%
Test42357754.5%83.1%77.1%88.1%
ControlPatientTotalNormalityAccuracySensitivitySpecificity
EPTB vs. PTBTraining18274540.0%75.6%81.5%66.7%IL10, CXCL-9
Validation581338.5%100.0%100.0%100.0%
Test23355839.7%81.0%85.7%73.9%
HC vs. PETB ControlPatientTotalNormalityAccuracySensitivitySpecificity
Training40468646.5%90.7%87.0%95.0%IFN-γ, IL-2R, IL4
Validation11122347.8%100.0%100.0%100.0%
Test515810946.8%92.7%89.7%96.1%

Share and Cite

MDPI and ACS Style

Korma, W.; Mihret, A.; Chang, Y.; Tarekegn, A.; Tegegn, M.; Tuha, A.; Hwang, D.; Asefa, M.; Hasen, M.O.; Kim, S.; et al. Antigen-Specific Cytokine and Chemokine Gene Expression for Diagnosing Latent and Active Tuberculosis. Diagnostics 2020, 10, 716. https://0-doi-org.brum.beds.ac.uk/10.3390/diagnostics10090716

AMA Style

Korma W, Mihret A, Chang Y, Tarekegn A, Tegegn M, Tuha A, Hwang D, Asefa M, Hasen MO, Kim S, et al. Antigen-Specific Cytokine and Chemokine Gene Expression for Diagnosing Latent and Active Tuberculosis. Diagnostics. 2020; 10(9):716. https://0-doi-org.brum.beds.ac.uk/10.3390/diagnostics10090716

Chicago/Turabian Style

Korma, Workneh, Adane Mihret, Yunhee Chang, Azeb Tarekegn, Metasebiya Tegegn, Adem Tuha, Dasom Hwang, Mesfin Asefa, Mahlet O. Hasen, Seoyoung Kim, and et al. 2020. "Antigen-Specific Cytokine and Chemokine Gene Expression for Diagnosing Latent and Active Tuberculosis" Diagnostics 10, no. 9: 716. https://0-doi-org.brum.beds.ac.uk/10.3390/diagnostics10090716

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop