Figures
Abstract
The Xpert MTB/RIF assay was introduced for timely and accurate detection of tuberculosis (TB). The aim of this study was to determine the diagnostic accuracy and turnaround time (TAT) of Xpert MTB/RIF assay in clinical practice in South Korea. We retrospectively reviewed the medical records of patients in whom Xpert MTB/RIF assay using sputum were requested. The sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for the diagnosis of pulmonary tuberculosis (PTB) and detection of rifampicin resistance were calculated. In addition, TAT of Xpert MTB/RIF assay was compared with those of other tests. Total 681 patients in whom Xpert MTB/RIF assay was requested were included in the analysis. The sensitivity, specificity, PPV and NPV of Xpert MTB/RIF assay for diagnosis of PTB were 79.5% (124/156), 100.0% (505/505), 100.0% (124/124) and 94.0% (505/537), respectively. Those for the detection of rifampicin resistance were 57.1% (8/14), 100.0% (113/113), 100.0% (8/8) and 94.9% (113/119), respectively. The median TAT of Xpert MTB/RIF assay to the report of results and results confirmed by physicians in outpatient settings were 0 (0–1) and 6 (3–7) days, respectively. Median time to treatment after initial evaluation was 7 (4–9) days in patients with Xpert MTB/RIF assay, but was 21 (7–33.5) days in patients without Xpert MTB/RIF assay. Xpert MTB/RIF assay showed acceptable sensitivity and excellent specificity for the diagnosis of PTB and detection of rifampicin resistance in areas with intermediate TB burden. Additionally, the assay decreased time to the initiation of anti-TB drugs through shorter TAT.
Citation: Kwak N, Choi SM, Lee J, Park YS, Lee C-H, Lee S-M, et al. (2013) Diagnostic Accuracy and Turnaround Time of the Xpert MTB/RIF Assay in Routine Clinical Practice. PLoS ONE 8(10): e77456. https://doi.org/10.1371/journal.pone.0077456
Editor: Robert J. Wilkinson, Institute of Infectious Diseases and Molecular Medicine, South Africa
Received: August 5, 2013; Accepted: September 10, 2013; Published: October 29, 2013
Copyright: © 2013 Kwak et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by a grant of the Korean Health Technology R&D Project, Ministry of Health & Welfare, Republic of Korea (HI13C0844). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Early and accurate detection of tuberculosis (TB) is important for the timely initiation of treatment and prevention of TB transmission. In addition, early detection of drug resistance is crucial for early treatment of multi-drug resistant (MDR) TB. Conventional methods for the diagnosis of TB have limitations in terms of early and accurate detection. Acid-fast bacilli (AFB) smears show short turnaround times (TAT) and high specificity [1], but lower and variable sensitivity [2], [3]. In South Korea, confirmation of mycobacterial culture and confirmation of conventional drug susceptibility tests (DST) takes approximately 43 days (19–77), and 91.5 days (51–170), respectively. [4].
The Xpert MTB/RIF assay, using RT-PCR for the TB specific rpoB gene, was validated for simple and rapid diagnosis of TB [5]. Detection of the rpoB gene is known to be specific for TB diagnosis, and mutation of the rpoB gene is associated with resistance to rifampicin (RIF). Using probes complementary to the rpoB gene, the Xpert MTB/RIF assay can identify M. TB and RIF resistance simultaneously in 2 h. In South Korea, the Xpert MTB/RIF assay was adopted for the diagnosis of TB since 2011.
Previous studies showed the high sensitivity and speed of the Xpert MTB/RIF assay for detection of TB and RIF resistance. When performed more than 3 times, the sensitivity of the Xpert MTB/RIF assay for detection of TB and RIF resistance was greater than 98% and 97%, respectively [5]. Time to detection of TB and RIF resistance could also be shortened, which led to earlier treatment [6]. However, these studies were performed in areas with a high burden of TB and in research settings. The aim of this study was to determine the diagnostic accuracy and TAT of the Xpert MTB/RIF assay in routine clinical practice in South Korea, a country with an intermediate TB burden, where the incidence of TB is 100 per 100,000 persons and 516 cases of MDR-TB were confirmed in 2011 [7].
Methods
Study Design
The design of this study was approved by the Institutional Review Board of Seoul National University Hospital. We retrospectively reviewed the medical records of patients in whom the Xpert MTB/RIF assay using sputum were requested due to suspicion of pulmonary TB between January 1 2011 and May 31 2013 at Seoul National University Hospital. Using data from these patients, we evaluated the accuracy of the Xpert MTB/RIF assay and compared the TAT of the assay with those of other TB tests. Obtaining consents from individual patients was waived by the Institutional Review Board.
Accuracy of the Xpert MTB/RIF Assay for the Diagnosis of Pulmonary TB
We calculated the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the Xpert MTB/RIF assay using sputum for the diagnosis of pulmonary TB. Diagnosis of pulmonary TB was confirmed by culturing M. TB from sputum for primary analysis. In this analysis, patients in whom M.TB was detected using the Xpert MTB/RIF assay, but M.TB isolation by mycobacterial culture failed, were excluded although all were treated with anti-TB drugs. We also calculated the sensitivity, specificity, PPV, and NPV of the Xpert MTB/RIF assay regarding the patients with positive Xpert MTB/RIF assay as having pulmonary TB.
Accuracy of the Xpert MTB/RIF Assay for Detection of Rifampicin Resistance
We calculated the sensitivity, specificity, PPV, and NPV of the Xpert MTB/RIF assay using sputum to detect RIF resistance. Drug susceptibility tests (DST) using the absolute concentration method was used as a gold standard for detection of RIF resistance. Resistance to RIF was defined as ≥1% bacterial growth in Löwenstein–Jensen medium at a concentration of 40.0 µg/ml.
Turnaround Time of the Xpert MTB/RIF Assay
The TAT of the Xpert MTB/RIF assay was compared with those of acid-fast bacilli (AFB) smears, cultures on liquid media or solid media, and conventional DST against anti-TB drugs. In addition, we compared the intervals from the request of diagnostic tests for TB to the initiation of anti-TB drugs between patient diagnosed as pulmonary TB using the Xpert MTB/RIF assay and pulmonary TB patients diagnosed without using the Xpert MTB/RIF assay. To perform this comparison, we matched twice as many TB patients diagnosed without using the Xpert MTB/RIF assay to patients diagnosed with Xpert MTB/RIF assay.
Acid-fast Bacilli (AFB) Smear, Mycobacterial Culture, and the Xpert MTB/RIF Assay
Patients were asked to submit one spot and one or two subsequent morning sputa for AFB smear. One additional sputum was submitted for Xpert MTB/RIF assay. All sputum specimens were pretreated with equal volumes of 4% sodium hydroxide and centrifuged at 3000×g for 20 min. AFB smears were performed using Auramine-Rhodamine fluorescent staining and confirmed by Ziehl–Neelsen staining. Sediment was cultivated on Ogawa medium for 9 weeks in 5–10% CO2 incubators, as well as in BACTEC™ MGIT™ for 6 weeks. Once cultured, the isolation of M.TB was confirmed using the Gen-Probe® method (Gen-Probe, San Diego, CA, USA) [8].
The Xpert MTB/RIF assay was performed and interpreted according to the manufacturer’s instructions. Sputum specimens were lodged in the Xpert MTB/RIF assay cartridges, and tests were performed within 24 h after sputum submission.
Statistical Analysis
The sensitivity, specificity, PPV and NPV of the Xpert MTB/RIF assay were calculated and 95% confidence intervals were estimated. Clinical data of included patients were described with the medians and ranges. Chi-square tests and Fisher’s exact tests were used for comparison of categorical variables, and independent t-tests, Mann-Whitney tests and Kruskal-Wallis tests were used to compare continuous variables. All analyses were performed using the SPSS software, version 19.0 (SPSS Inc., Chicago, IL, USA).
Results
Patients’ Characteristics
Between Jan 1 2011 and May 31 2013, the Xpert MTB/RIF assay using sputum was requested in 681 patients with suspicion of pulmonary TB. The median age of these patients was 61 years and 426 (62.5%) were male. Median number of submitted samples for each patients was 2 for AFB smear and mycobacterial culture. A total of 84 patients (12.3%) had diabetes. Among 681 pulmonary TB suspects, culture-proven pulmonary TB was diagnosed in 156 patients (22.9%). In addition, 59 patients were diagnosed with pulmonary TB based on their symptoms and radiographic findings, although M. TB was not cultured from their sputum (Table 1).
Diagnostic Accuracy of the Xpert MTB/RIF Assay for Pulmonary TB
The sensitivity of the Xpert MTB/RIF assay for diagnosis of pulmonary TB was 79.5% (124/156) and specificity was 100.0% (505/505), while PPV was 100.0% (124/124) and NPV was 94.0% (505/537). Among patients with positive sputum AFB smears, sensitivity, specificity, PPV and NPV of the Xpert MTB/RIF assay was 88.9% (56/63), 100.0% (16/16), 100.0% (56/56), and 69.6% (16/23), respectively. Meanwhile, the sensitivity, specificity, PPV and NPV of the Xpert MTB/RIF assay were 73.1% (68/93), 100.0% (489/489), 100.0% (68/68), and 95.1% (489/514) among patients with negative sputum AFB smears. In the positive sputum AFB smear group, the sensitivity (p = 0.017) and PPV (p<0.001) were higher than in the negative sputum AFB smear group. (Table 2).
The sensitivity of the Xpert MTB/RIF assay was 81.8% (144/176) for diagnosis of pulmonary TB if we classified not only patients with culture-proven TB but also patients with positive Xpert MTB/RIF assay as having pulmonary TB. (Table 3).
Among 79 patients with positive sputum AFB smears, the results of the Xpert MTB/RIF assay were negative in 23 patients. In 7 of these 23 patients, pulmonary TB was confirmed by culturing M.TB from their sputum. Nontuberculous mycobacteria (NTM) instead of M.TB were cultured from the sputum of the other 16 patients and these patients were excluded from the analysis (Table 2).
Accuracy of the Xpert MTB/RIF Assay for Detecting Rifampicin Resistance
Conventional DST failed in 29 of 156 patients with culture-confirmed pulmonary TB. These 29 patients were excluded from the accuracy analysis using the Xpert MTB/RIF assay for the detection of RIF resistance. Using conventional DST, RIF resistance was identified in 14 of 127 patients with available DST results. The Xpert MTB/RIF assay correctly detected RIF resistance in 8 of 14 patients. Subsequently, the sensitivity of the Xpert MTB/RIF assay was 57.1%. False-positive RIF resistance using the Xpert MTB/RIF was not detected. Consequently, the specificity (113/113) and PPV(8/8) of the assay were 100%.
In five of six patients in whom the Xpert MTB/RIF assay failed to detect RIF resistance, the assay also failed to detect the presence of M.TB. If these five patients were excluded from the analysis, the sensitivity was 88.9% (8/9) and the specificity to 100% (90/90). In addition, PPV was 100% (8/8) and NPV was 98.9% (90/91) (Table 4).
Turnaround Times (TAT) of the Xpert MTB/RIF Assay, AFB Smear, Mycobacterial Culture and Drug Susceptibility Tests
The median TAT from requested Xpert MTB/RIF assays to reported laboratory results was 0 days (0–1 days). This was significantly shorter than those of AFB smears (median 1 day, 0–1 days), culture on liquid (median 14 days, 10.25–17.75 days) or solid (median 24 days, 17–30 days) media, and drug susceptibility tests based on solid media (median 78 days, 65–96 days) (Table 5). Median TAT from requested Xpert MTB/RIF assays to confirmation of results by physicians was 6 days (3–7 days) in outpatient settings. This was also significantly shorter than other tests (Table 5).
Among pulmonary TB patients diagnosed using the Xpert MTB/RIF assay, anti-TB treatment was initiated median 7 days (4–9 days) after the evaluation for TB. However, among pulmonary TB patients in whom the Xpert MTB/RIF assay was not performed, the median time to initiation of anti-TB treatment was 21 days (7–33.5 days) (Table 6).
Discussion
As an initial diagnostic method of M.TB, the accuracy and speed of the Xpert MTB/RIF assay have been demonstrated in previous studies. However, many of these were performed in low-income countries with limited medical resources [5], [6]. Our study was performed in tertiary referral hospitals in South Korea, where the annual incidence of TB was 100/100,000 on 2011 [7], and medical resources such as solid and liquid mycobacterial culture systems, as well as bronchoscopy or computed tomography, are readily available.
In our study, the sensitivity, specificity, PPV and NPV of the Xpert MTB/RIF assay for diagnosis of pulmonary TB were 79.5%, 100.0%, 100.0% and 94.0% respectively. The sensitivity in our study was lower than 90.4%, which was also reported in a recent meta-analysis [9]. Sensitivity of RIF resistance detection was 57.1%, but specificity and PPV were both 100.0%. The TAT of the Xpert MTB/RIF assay was shorter than AFB smears, mycobacterial culture and DST in terms of time to report of results, as well as time to confirmation of results by the physician. Consequently, the Xpert MTB/RIF assay shortened the time to initiation of anti-TB drugs by median 14 days.
The threshold of M.TB detection using the Xpert MTB/RIF assay is affected by the number of colonies in the sample [10]. Because smear-negative pulmonary TB reflects the lower burden of M.TB [11] and smear sensitivity correlates with quantitative growth [12], the sensitivity of the Xpert MTB/RIF assay could be lowered in smear-negative group. In previous studies of the Xpert MTB/RIF assay in high-TB burden countries [5], [6], [13], the proportion of smear-negative pulmonary TB was lower than that of smear- positive pulmonary TB. However, in South Korea, the proportion of sputum-negative pulmonary TB (61%) exceeded smear-positive TB (39%) [7]. In our study, 59.6% of culture confirmed pulmonary TB was sputum smear-negative. This could explain the relatively lower sensitivity (79.5%) of the Xpert MTB/RIF assay. However, we should take into account the fact that two or three sets of sputa samples were submitted for M.TB culture but the Xpert MTB/RIF assays were performed using only one sputum sample.
In our study, of 681 TB suspects, 156 patients were diagnosed with pulmonary TB with confirmation by mycobacterial culture. However, mycobacterial culture failed to identify M.TB in 59 patients who were concluded to have pulmonary TB based on the symptoms and radiographic findings. The fact that approximately one third of pulmonary TB cases could not be identified by mycobacterial culture suggests that more sensitive diagnostic methods are required. In fact, the Xpert MTB/RIF assay yielded positive results in 20 of these 59 TB suspects without bacteriological confirmation. This observation suggested that the Xpert MTB/RIF assay could be a complimentary test for the diagnosis of TB, including in the regions in which mycobacterial cultures are readily available.
In our study, the specificity and PPV of the Xpert MTB/RIF assay were each 100%. The high specificity and PPV of the assay are useful in countries such as South Korea, where the incidence of NTM is increasing rapidly [14]. Because of the considerable overlap in clinical characteristics between pulmonary TB and NTM lung diseases [15], exclusion of NTM lung diseases among patients with positive sputum AFB smears is crucial. Because the Xpert MTB/RIF assay showed high PPV of the Xpert MTB/RIF assay, physicians could exclude NTM lung disease and initiate anti-TB medication promptly among patients with both smear-positive and the Xpert MTB/RIF assay positive results.
The detection of MDR-TB is important because a prolonged treatment duration is required, but treatment success rates are low. Because RIF resistance serves as a surrogate of multidrug resistance [16], detection of RIF resistance using the Xpert MTB/RIF assay could be used to screen patients with MDR-TB. In our study, 14 patients were diagnosed with MDR-TB based on conventional DST, and 8 were shown to have RIF-resistance using the Xpert MTB/RIF assay. The low sensitivity of RIF-resistance detection was affected by the lower burden of M.TB, as discussed above. Meanwhile, in five MDR-TB patients, the Xpert MTB/RIF assay could not detect the presence of M.TB as well as RIF resistance. Thus, we must keep in mind that MDR-TB cannot be excluded based on the result of Xpert MTB/RIF assay when the assay shows negative results for M.TB.
Mathematically, the PPV of the Xpert MTB/RIF assay for RIF resistance varies according to the prevalence of MDR-TB. PPV for RIF-resistance is expected to be less than 70% based on the prevalence of MDR-TB in South Korea [17], [18]. Since the Xpert MTB/RIF assay can provide false positive results, selection of appropriate anti-TB drugs is difficult for patients with RIF-resistant TB based on the results of the Xpert MTB/RIF assay alone [19]. However, in our study, the specificity and PPV of the Xpert MTB/RIF assay were each 100% for RIF resistance. Although our observation suggests that false positive RIF-resistance detected by the Xpert MTB/RIF assay might be lower than expected, we should wait for the study including more patients with RIF-resistant TB before reaching a conclusion.
As expected, the TAT of the Xpert MTB/RIF assay in an outpatient setting was shorter than those of AFB smears, liquid culture, solid culture and DST in terms of interval to the report of results from the laboratory, as well as interval to the confirmation of results by physicians, in our study. In particular, the Xpert MTB/RIF assay shortened the time to initiation of anti-TB drugs by 14 days. However, the 5.5-day delay from the report of the Xpert MTB/RIF assays to confirmation by physicians suggested that the follow-up system requires improvement when the Xpert MTB/RIF assay is used in routine practice.
In conclusion, the Xpert MTB/RIF assay has acceptable sensitivity and excellent specificity for the diagnosis of pulmonary TB, as well as for the detection of RIF resistance in intermediate TB burden countries. In addition, the assay significantly shortened the time to anti-TB treatment.
Author Contributions
Analyzed the data: SMC JL YSP CHL. Wrote the paper: NK JJY. Study design: NK JJY. Data collection: NK JJY. Data interpretation: SML CGY YWK SKH.
References
- 1. Foulds J, OBrien R (1998) New tools for the diagnosis of tuberculosis: the perspective of developing countries. The International Journal of Tuberculosis and Lung Disease 2: 778–783.
- 2. Perkins MD, Cunningham J (2007) Facing the crisis: improving the diagnosis of tuberculosis in the HIV era. Journal of Infectious Diseases 196: S15–S27.
- 3. Steingart KR, Ramsay A, Pai M (2007) Optimizing sputum smear microscopy for the diagnosis of pulmonary tuberculosis. Expert review of anti-infective therapy 5: 327–331.
- 4. Joh J-S, Lee CH, Lee JE, Park Y-K, Bai G-H, et al. (2007) The interval between initiation of anti-tuberculosis treatment in patients with culture-positive pulmonary tuberculosis and receipt of drug-susceptibility test results. Journal of Korean medical science 22: 26–29.
- 5. Boehme CC, Nabeta P, Hillemann D, Nicol MP, Shenai S, et al. (2010) Rapid molecular detection of tuberculosis and rifampin resistance. New England Journal of Medicine 363: 1005–1015.
- 6. Boehme CC, Nicol MP, Nabeta P, Michael JS, Gotuzzo E, et al. (2011) Feasibility, diagnostic accuracy, and effectiveness of decentralised use of the Xpert MTB/RIF test for diagnosis of tuberculosis and multidrug resistance: a multicentre implementation study. The lancet 377: 1495–1505.
- 7.
World Health Organization (2012) Global tuberculosis report.
- 8. Bergmann JS, Yuoh G, Fish G, Woods GL (1999) Clinical evaluation of the enhanced Gen-Probe Amplified Mycobacterium Tuberculosis Direct Test for rapid diagnosis of tuberculosis in prison inmates. Journal of clinical microbiology 37: 1419–1425.
- 9. Chang K, Lu W, Wang J, Zhang K, Jia S, et al. (2012) Rapid and effective diagnosis of tuberculosis and rifampicin resistance with Xpert MTB/RIF assay: a meta-analysis. Journal of Infection 64: 580–588.
- 10. Helb D, Jones M, Story E, Boehme C, Wallace E, et al. (2010) Rapid detection of Mycobacterium tuberculosis and rifampin resistance by use of on-demand, near-patient technology. Journal of clinical microbiology 48: 229–237.
- 11. Colebunders R, Bastian I (2000) A review of the diagnosis and treatment of smear-negative pulmonary tuberculosis. The International Journal of Tuberculosis and Lung Disease 4: 97–107.
- 12. Lipsky BA, Gates J, Tenover FC, Plorde JJ (1984) Factors affecting the clinical value of microscopy for acid-fast bacilli. Review of Infectious Diseases 6: 214–222.
- 13. Scott LE, McCarthy K, Gous N, Nduna M, Van Rie A, et al. (2011) Comparison of Xpert MTB/RIF with other nucleic acid technologies for diagnosing pulmonary tuberculosis in a high HIV prevalence setting: a prospective study. PLoS medicine 8: e1001061.
- 14. Park Y, Lee C, Lee S, Yang S, Yoo C, et al. (2010) Rapid increase of non-tuberculous mycobacterial lung diseases at a tertiary referral hospital in South Korea [Short communication]. The International Journal of Tuberculosis and Lung Disease 14: 1069–1071.
- 15. Koh W, Yu C, Suh G, Chung M, Kim H, et al. (2006) Pulmonary TB and NTM lung disease: comparison of characteristics in patients with AFB smear-positive sputum. The International Journal of Tuberculosis and Lung Disease 10: 1001–1007.
- 16. Watterson SA, Wilson SM, Yates MD, Drobniewski FA (1998) Comparison of three molecular assays for rapid detection of rifampin resistance in Mycobacterium tuberculosis. Journal of clinical microbiology 36: 1969–1973.
- 17. Organization WH (2011) Rapid implementation of the Xpert MTB/RIF diagnostic test: technical and operational ‘How-to’; practical considerations. Geneva: World Health Organization 978: 4.
- 18. Park Y-S, Hong S-J, Boo Y-K, Hwang E-S, Kim HJ, et al. (2012) The national status of tuberculosis using nationwide medical records survey of patients with tuberculosis in Korea. Tuberculosis and respiratory diseases 73: 48–55.
- 19. Van Rie A, Mellet K, John M, Scott L, Page-Shipp L, et al. (2012) False-positive rifampicin resistance on Xpert® MTB/RIF: case report and clinical implications. The international journal of tuberculosis and lung disease: the official journal of the International Union against Tuberculosis and Lung Disease 16: 206.