Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Prioritising between direct observation of therapy and case-finding interventions for tuberculosis: use of population impact measures

BMC Medicine volume 4, Article number: 35 (2006) Cite this article

Abstract

Background

Population impact measures (PIMs) have been developed as tools to help policy-makers with locally relevant decisions over health risks and benefits. This involves estimating and prioritising potential benefits of interventions in specific populations. Using tuberculosis (TB) in India as an example, we examined the population impact of two interventions: direct observation of therapy and increasing case-finding.

Methods

PIMs were calculated using published literature and national data for India, and applied to a notional population of 100 000 people. Data included the incidence or prevalence of smear-positive TB and the relative risk reduction from increasing case finding and the use of direct observation of therapy (applied to the baseline risks over the next year), and the incremental proportion of the population eligible for the proposed interventions.

Results

In a population of 100 000 people in India, the directly observed component of the Directly Observed Treatment, Short-course (DOTS) programme may prevent 0.188 deaths from TB in the next year compared with 1.79 deaths by increasing TB case finding. The costs of direct observation are (in international dollars) I$5960 and of case finding are I$4839 or I$31702 and I$2703 per life saved respectively.

Conclusion

Increasing case-finding for TB will save nearly 10 times more lives than will the use of the directly observed component of DOTS in India, at a smaller cost per life saved. The demonstration of the population impact, using simple and explicit numbers, may be of value to policy-makers as they prioritise interventions for their populations.

Peer Review reports

Background

Tuberculosis (TB) is a major global public health problem. Reducing the burden of morbidity and mortality due to TB relies on identifying the treatments and preventive measures of greatest impact, and communicating this information to decision-makers so that the most appropriate policies are implemented.

We have previously described a series of population impact measures (PIMs) to describe the population impacts of risks and benefits [1–3]. These are measures of absolute risk and are based on previous methods for describing clinical and population impacts. They provide local meaning to an otherwise confusing mixture of generic evidence and local statistics, helping policy-makers to identify and prioritise the potential benefits of interventions in their own population. PIMs are simple to compute, and contain the elements to which policy-makers need to pay attention in the commissioning or improvement of services. They are designed as useful additions to the generic measures of illness burden, from which they differ in having event-specific outcomes rather than generic outcomes such as the quality-adjusted life year (QALY) or the disability-adjusted life year (DALY).

The World Health Organization (WHO) has promoted the Directly Observed Treatment, Short-course (DOTS) strategy, which comprises five elements, (political commitment, case detection using sputum microscopy, standardised short-course chemotherapy, regular drug supply, and a standardised recording and reporting system). These elements incorporate direct observation of treatment but exclude active case finding [4]. DOTS programmes may differ in the emphasis placed on the five elements, and may incorporate additional features[5]. In India, the Revised National Tuberculosis Control Programme gives considerable emphasis to directly observed treatment, so that it is now one of the five main elements [6]. Some authors have suggested that case finding is underemphasised as a global TB control strategy [7–11], and that directly observed therapy may be overemphasised[5, 12]. Case-finding may be "active" or "enhanced"[11]; we did not specify which of these we include under our general category of increased case-finding, as this will vary according to local conditions. In this study, the utility of using PIMs to describe the population impact of the directly observed component of DOTS was compared with that of increased case-finding, using India, where TB provides a major health burden, as an example[13].

Methods

To describe the impact of preventive and treatment interventions, the number of events prevented in a population (NEPP) is defined as "the number of events prevented by the intervention in your population over a defined time period" [2]. NEPP extends the number needed to treat (NNT) beyond the individual patient to a specific population. The components of the calculations (see Appendix for the formulae) are: (i) population denominator (size of the population); (ii) proportion of the population with the disease; (iii) the incremental proportion of the diseased population eligible for the proposed intervention (the latter requires the actual or estimated proportion who are currently receiving, and are compliant with, the interventions, subtracted from best practice goal from guidelines or targets); (iv) baseline risk (the probability of the outcome of interest in this or similar populations); and the(v) relative risk reduction (RRR) associated with the intervention. Confidence intervals (CIs) for the measures were obtained using simulation methods http://www.phsim.man.ac.uk/. The calculations were made using published data (each source is referenced in the Results section).

Data from the paper by Baltussen et al[14] were used to calculate the costs, which are reported in international dollars (I$). Direct observation of therapy requires 40 clinic visits for supervision (24 in the intensive and 16 in the continuation phase) rather than 4 (1 initial and 3 for progress monitoring) for unobserved treatment. Each clinic visit costs I$3.85. Each TB smear test for those identified by case finding costs I$1.14, and we multiplied this by the prevalence of symptoms in the population (to reflect that increased case-finding would occur among those who are symptomatic). We do not have an estimate of the costs of detecting those who are symptomatic in order for them to have a sputum smear for diagnosis, as the way in which cases are detected will differ depending on the setting and on whether the case finding is "active" or "enhanced"[11]. However, we doubled the cost of the smears to allow for the costs of the case finding to detect symptomatic people who will subsequently have a smear, and also added the treatment costs for the cases of smear-positive TB identified by the case-finding process (drug costs at I$7.84 plus four clinic visits per patient).

Results

The published data show that 45% of identified TB patients in India are covered by the DOTS programme[15] However, only an estimated 50% of smear-positive TB cases in India are identified by the current passive case-finding approach[13]. The benefit of increasing this by a further 20% (or 40% of the currently unidentified cases) was estimated, as this is consistent with the national and global target of detecting 70% of smear-positive cases[6, 13], and is a conservative estimate of the proportion of undetected cases that might be found through case finding[11, 16]. The added benefit of the directly observed component of DOTS on cure and completion rates has been estimated in a systematic review as 6%, which is the figure used in our study, although this was not statistically significantly different from no benefit[12]. We assumed that this benefit would translate to a similar reduction in case fatality. Six-month case fatality for treated TB was estimated in the original MRC trial of the treatment of TB as 7.3% and for untreated TB 27%, with a reduction of 73% from treatment,[17] and are consistent with a reported global case fatality rate of 23% [9, 18]. We also assumed that only 71% of patients with TB would complete treatment in the absence of the DOTS programme, taken from the "cure plus treatment completion" figures of the control groups in the Cochrane review[12]. This is consistent with the 76% quoted elsewhere [19] Table 1 demonstrates that the current direct observation of the DOTS programme would, on average, produce a reduction of 0.188 deaths from TB for each 100 000 people in the population in a year. If the identification rate of TB was increased by 20%, using increased case-finding, and 71% of these people completed treatment, there would be a reduction of 1.79 deaths from TB for each 100 000 people in the population in a year, nearly 10 times the numbers of deaths saved by direct observation of therapy.

Table 1 Number of deaths prevented among 100,000 people in India with direct observation of therapy and increased use of case finding
Full size table

Costs

The cost of direct observation for 36 extra clinic visits is I$138.6 per patient. Table 1 shows that there are 43 smear-positive cases per 100 000 population in a year, thus the cost of direct observation for these 43 cases is I$5960, resulting in a cost of I$31702 per life saved.

For case finding, we estimated that 2% of the population may be symptomatic (from previous figures of 1.2–6.7% symptomatic people in possibly similar populations[11, 16]), hence requiring 2000 smears. This may be a conservative estimate, as Baltussen estimates that only 30 smears need to be taken to find one case, whereas we estimated it would take 2000 smears to find 12 cases (40% of the 32 undiagnosed in our population of 100 000), or 167 smears to find one case. The drug costs and 4 clinic visits total I$23.24 for each of the 12 identified cases. The cost of case finding is thus estimated to be I$4839, or I$2703 per life saved (table 2).

Table 2 Costs of direct observation of therapy and increased use of case finding among 100 000 people in India
Full size table

Discussion

This study shows that, given the parameters used, increasing case finding by 20% would lead to nearly 10 times the numbers of deaths saved by the current direct observation of therapy in India. This is due to a greater RRR, applied to a higher baseline case-fatality, hence producing a larger absolute benefit. The analysis clearly shows that, based on the assumptions made, improving case-finding for TB will save far more lives than maximizing the use of the directly observed component of DOTS among currently identified cases in India. This has obvious implications for health decision-makers. Although the DOTS program does encourage better case detection, it does not include active or enhanced case-finding [5, 6, 20]. Our findings concur with those who feel that case finding should receive more attention [7, 21, 22], and that a careful approach to examining the benefits of different aspects of DOTS programmes should be encouraged[5].

There are several different strategies for increasing case-finding, and the choice should depend on local factors such as disease prevalence, adequacy of training of healthcare workers and willingness of the infected population to seek care for symptoms[11]. The benefits of active, passive or enhanced case-finding among general, high-risk, and symptomatic populations have been reviewed in depth by Golub et al[11].

The calculations made in this study depend on the accuracy of the data used. Each estimate is subject to potential error, and ideally, each population should obtain its own data in order to produce accurate estimates of population impact of risks and interventions. The literature-based estimates of RRR are also open to question. Our use of the baseline risk of death from treated and untreated TB uses old trial data, although the treated risk is consistent with recently published data of death rates of 4.4% among DOTS-registered cases in countries with high TB burden[13]. We applied the cure rate of the systematic review of DOTS therapy to the case fatality, and this may be open to question. An updated Cochrane Review was published in 2006[23], which came to the same conclusion about a non-significant 6% difference in the outcome cured or completed treatment. There were insufficient numbers to allow analysis of case fatality, although four of the included trials did include mortality as an outcome measure. The results of the calculations depend on the various assumptions made. For example, changing the estimate of TB treatment completion would have changed the number of deaths prevented, but is unlikely to have changed the ranking of benefit between increasing case-finding and direct observation of treatment. Thus it is important to obtain relevant local data, apply the approach to different populations and population subgroups, and to test the robustness of the estimates to varying the assumptions. For example, in a population where case finding is already extensive, costs per case detected are likely to be higher, and thus maximizing the use of directly observed therapy could have the greater impact.

The confidence intervals were made taking into account the potential variability of the estimates used; however, changing the estimates used for each of the components of the PIMs themselves has additional potential to influence the results. This can be explored by recalculating the measures using different estimates as appropriate to particular local settings. To assist potential users, we have developed a public access website that automatically calculates both the PIMs and their confidence intervals http://www.phsim.man.ac.uk/.

We did not include the impact of transmission dynamics on the rest of the population in our calculations, as this would add considerably to the complexity of the approach. In terms of the comparison between direct observation and improved case-finding, the lack of attention to transmission dynamics will underestimate the relative benefit of improved case-finding, as the resulting early intervention is likely to be more effective than the later attempt to improve therapy adherence. The decision to restrict the analysis to smear-positive cases was based on the better accuracy of this measure of disease burden, although it will underestimate the benefit of treatment on extrapulmonary TB. We do not wish to claim false accuracy for the results presented; however, they do use the best available data, are easy to compute and produce results that are easy to understand. The level of accuracy should be adequate for most policy decisions, and is preferable to making decisions in the absence of estimates of population benefit.

If PIMs prove useful where relevant data exist, then this could stimulate better collection and use of health data in situations where there are currently too few data to enable reasonable calculations. Similarly, the use of PIMs with confidence intervals enables policy-makers to be explicit about the uncertainties they face.

The measures can be used to compare between populations, in which case standardization for age, sex, ethnicity and socioeconomic status may be required. The measures can also be used to compare between segments of a population, in which case the potential for an intervention to reduce health inequalities and increase equity within a population can be explored[3].

For ease of presentation, the population denominator we used was 100 000 adults; however, one of the main benefits of these measures is the ability to relate to local context, hence policy-makers can make the calculations for their own population denominator.

The addition of information on costs to the population impact measures will also be important for policy makers, and our estimated costs for the programme will allow costs and their consequences to be calculated[24]. PIMs differ from measures used in cost-effectiveness analyses by not including life expectancy or the utility or valuation of the health outcome. They thus produce outcomes expressed as events rather than generic outcomes such as QALY or DALY gained[25]. We have previously suggested that the valuation of the events prevented should be performed by the policy-maker in relation to the costs of the intervention, once the measures have been produced [26]. Although our cost estimates are prone to error, they were derived using previously published costs applied to this simple model of health gain. They show that the programme costs for the direct observation of therapy and the detection of new cases are similar, although the health gain is much greater for the detection of new cases. In fact, our estimate of the health gain from direct observation may be an overestimate, as the relative risk quoted was not significantly different from no effect.

The data shown on TB control demonstrates the potential benefit to policy-makers from the use of PIMs. There is some evidence that the way in which health benefits are framed impacts on the policy decisions reached[27], although there is debate about the consistency of such an effect[28]. We previously showed that although clinicians were more influenced by benefit expressed as RRR than as PIMs[29], public health professionals were more likely to prioritise interventions based on the use of PIMs than on the basis of more complex demonstrations of health gain [26]. The evidence base on what are the most effective methods of presenting health gains from interventions in order to assist in policy-making is, however, weak. Health policy requires more than merely demonstration of health gain [30–32], as the complexity of policy-making includes social and political drivers of decision-making, as well as the need to take into account issues such equity, total budget impact, total morbidity and disease severity.

Our method is considerably simpler than other modelling exercises that have also examined the potential benefits of case finding[7, 8], and may compensate for this simplicity by the increased ease of when making the calculations and understanding the results. Both modelling and the calculation of PIMs have similar reliance on data availability and accuracy. Our method is not intended to replace more complex analyses of TB control[14], nor is it intended to reflect adversely on the DOTS programme, which has many components, of which direct observation is only one. It is intended to show how to use local data to provide simple demonstrations of health benefit, which can then be used in policy-making. We believe that it is worth testing the hypothesis that simple demonstration of the population health-gain consequences of interventions will lead to the introduction of health policies that can provide appropriate priorities to improve health in developing countries. This could be of marked benefit in TB, a major threat to global health.

Conclusion

Increasing case-finding for TB will save nearly 10 times more lives than will the use of the directly observed component of DOTS in India, at a smaller cost per life saved. The demonstration of the population impact, using simple and explicit numbers, may be of value to policy-makers as they prioritise interventions for their populations.

Appendix

Formula for calculating population impact measure

Number of events prevented in your population (NEPP) [2]

NEPP = n* P d * P e * r u * RRR

where n = population size, P d = prevalence of the disease in the population, P e = proportion eligible for treatment, r u = risk of the event of interest in the untreated group or baseline risk, and RRR = relative risk reduction associated with the treatment

In order to reflect the incremental effect of changing from current to "best" practice and to adjust for levels of compliance the proportion eligible for treatment P e is

((P b - P t ) * P c

where P t is the proportion currently treated, P b is the proportion that would be treated if best practice was adopted and P c is the proportion of the population that is compliant with the medication.

Funding

The authors received no funding for this study.

References

  1. Heller RF, Dobson AJ: Disease impact number and population impact number: a population perspective to measures of risk and benefit. BMJ. 2000, 321: 950-952. 10.1136/bmj.321.7266.950.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Heller RF, Edwards R, McElduff P: Implementing guidelines in primary care: can population impact measures help?. BMC Public Health. 2003, 3: 7-10.1186/1471-2458-3-7.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Heller RF, Buchan I, Edwards R, Lyratzopoulos G, McElduff P, St Leger S: Communicating risks at the population level: application of population impact numbers. BMJ. 2003, 327: 1162-1165. 10.1136/bmj.327.7424.1162.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Coker R, Atun R, McKee M: Untangling Gordian knots: improving tuberculosis control through the development of 'programme theories'. Int J Health Plann Manage. 2004, 19: 217-226. 10.1002/hpm.759.

    Article  CAS  PubMed  Google Scholar 

  5. Volmink J, Matchaba P, Garner P: Directly observed therapy and treatment adherence. Lancet. 2000, 355: 1345-1350. 10.1016/S0140-6736(00)02124-3.

    Article  CAS  PubMed  Google Scholar 

  6. Directorate General of Health Services. Tuberculosis Control India: 2005, [http://www.tbcindia.org]

  7. Murray CJ, Salomon JA: Modeling the impact of global tuberculosis control strategies. Proc Natl Acad Sci USA. 1998, 95: 13881-13886. 10.1073/pnas.95.23.13881.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Dye C, Garnett GP, Sleeman K, Williams BG: Prospects for worldwide tuberculosis control under the WHO DOTS strategy. Directly observed short-course therapy. Lancet. 1998, 352: 1886-1891. 10.1016/S0140-6736(98)03199-7.

    Article  CAS  PubMed  Google Scholar 

  9. Bleed D, Dye C, Raviglione MC: Dynamics and control of the global tuberculosis epidemic. Curr Opin Pulm Med. 2000, 6: 174-179. 10.1097/00063198-200005000-00002.

    Article  CAS  PubMed  Google Scholar 

  10. Murray CJ, Salomon JA: Expanding the WHO tuberculosis control strategy: rethinking the role of active case-finding. Int J Tuberc Lung Dis. 1998, 2: S9-15.

    CAS  PubMed  Google Scholar 

  11. Golub JE, Mohan CI, Comstock GW, Chaisson RE: Active case finding of tuberculosis: historical perspective and future prospects. Int J Tuberc Lung Dis. 2005, 9: 1183-1203.

    CAS  PubMed  PubMed Central  Google Scholar 

  12. Volmink J, Garner P: Directly observed therapy for treating tuberculosis. The Cochrane Library. 2003, 1.

    Google Scholar 

  13. World Health Organisation: Global Tuberculosis Control: Surveillance, Planning, Financing. 2006, Geneva, Switzerland WHO

    Google Scholar 

  14. Baltussen R, Floyd K, Dye C: Cost effectiveness analysis of strategies for tuberculosis control in developing countries. BMJ. 2005, 331: 1364-10.1136/bmj.38645.660093.68.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Zaidi AKM, Awasthi S, deSilva HJ: Burden of infectious diseases in South Asia. BMJ. 2004, 328: 811-815. 10.1136/bmj.328.7443.811.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Jagota P, Mahadev B, Srikantaramu N, Balasangameshwara V, Sreenivas T: Case-finding in diostrict tuberculosis programme: potential and perfromance. Ind J Tub. 1998, 45: 39-46.

    Google Scholar 

  17. Fox W, Ellard GA, Mitchison DA: Studies on the treatment of tuberculosis undertaken by the British Medical Research Council Tuberculosis Units, 1946-with relevant subsequent publications. International Journal of Tuberculosis and Lung Disease. 1999, 3: S231-S279.

    CAS  PubMed  Google Scholar 

  18. Dye C, Scheele S, Dolin P, Pathania V, Raviglione MC: Consensus statement. Global burden of tuberculosis: estimated incidence, prevalence, and mortality by country. WHO Global Surveillance and Monitoring Project. JAMA. 1999, 282: 677-686. 10.1001/jama.282.7.677.

    Article  CAS  PubMed  Google Scholar 

  19. Barton S: Clinical Evidence: The International Source of the Best Available Evidence for Effective Health Care. 2004, London: BMJ Publishing Group, 7

    Google Scholar 

  20. World Health Organisation: Treatment Of Tuberculosis: Guidelines For Natinal Programmes. WHO/TB/97.220. 1997, Geneva, World Health Organisation

    Google Scholar 

  21. Dye C, Watt CJ, Bleed DM, Williams BG: What is the limit to case detection under the DOTS strategy for tuberculosis control?. Tuberculosis (Edinb). 2003, 83: 35-43. 10.1016/S1472-9792(02)00056-2.

    Article  Google Scholar 

  22. Demissie M, Lindtjorn B, Berhane Y: Patient and health service delay in the diagnosis of pulmonary tuberculosis in Ethiopia. BMC Public Health. 2002, 2: 23-10.1186/1471-2458-2-23.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Volmink J, Garner P: Directly observed therapy for treating tuberculosis. Cochrane Database Syst Rev. 2006, CD003343.

    Google Scholar 

  24. Coast J: Is economic evaluation in touch with society's health values?. BMJ. 2004, 329: 1233-1236. 10.1136/bmj.329.7476.1233.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Stone PW, Schackman BR, Neukermans CP, Olchanski N, Greenberg D, Rosen AB, et al: A synthesis of cost-utility analysis literature in infectious disease. Lancet Infect Dis. 2005, 5: 383-391. 10.1016/S1473-3099(05)70142-0.

    Article  PubMed  Google Scholar 

  26. Heller RF, Gemmell I, Wilson EC, Fordham R, Smith RD: Using economic analyses for local priority setting : the population cost-impact approach. Appl Health Econ Health Policy. 2006, 5: 45-54. 10.2165/00148365-200605010-00006.

    Article  PubMed  Google Scholar 

  27. Fahey T, Griffiths S, Peters TJ: Evidence based purchasing: understanding results of clinical trials and systematic reviews. British Medical Journal. 1995, 311: 1056-1059.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. McGettigan P, Sly K, O'Connell D, Hill S, Henry D: The Effects of Information Framing on the Practices of Physicians. Journal of General Internal Medicine. 1999, 14: 633-642. 10.1046/j.1525-1497.1999.09038.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Heller RF, Sandars JE, Patterson L, McElduff P: GPs' and physicians' interpretation of risks, benefits and diagnostic test results. Fam Pract. 2004, 21: 155-159. 10.1093/fampra/cmh209.

    Article  PubMed  Google Scholar 

  30. Dobrow MJ, Goel V, Upshur RE: Evidence-based health policy: context and utilisation. Soc Sci Med. 2004, 58: 207-217. 10.1016/S0277-9536(03)00166-7.

    Article  PubMed  Google Scholar 

  31. Singer PA, Martin DK, Giacomini M, Purdy L: Priority setting for new technologies in medicine: qualitative case study. BMJ. 2000, 321: 1316-1318. 10.1136/bmj.321.7272.1316.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Elliott H, Popay J: How are policy makers using evidence? Models of research utilisation and local NHS policy making. J Epidemiol Community Health. 2000, 54: 461-468. 10.1136/jech.54.6.461.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Author information

Authors and Affiliations

  1. Evidence for Population Health Unit, University of Manchester, Oxford Road, Manchester, M13 9PT, UK

    Richard F Heller, Islay Gemmell & Iain Buchan

  2. University of Otago, New Zealand

    Richard Edwards

  3. King George's Medical College, Lucknow, India

    Shally Awasthi

  4. Faculty of Health Sciences, University of Stellenbosch, South Africa

    James A Volmink

Authors
  1. Richard F Heller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Islay Gemmell
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richard Edwards
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Iain Buchan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shally Awasthi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. James A Volmink
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Richard F Heller.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

RFH, RE and IB were involved in the design and conception of the study, IG and IB in statistical analysis, RFH and SA in data acquisition, RFH, IG, IB and JAV in analysis and interpretation, RFH and IG in initial drafting and all authors in critical revision of the manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Heller, R.F., Gemmell, I., Edwards, R. et al. Prioritising between direct observation of therapy and case-finding interventions for tuberculosis: use of population impact measures. BMC Med 4, 35 (2006). https://0-doi-org.brum.beds.ac.uk/10.1186/1741-7015-4-35

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1741-7015-4-35

Keywords

BMC Medicine

ISSN: 1741-7015

Contact us