Skip to main content

Economic evaluations and their use in infection prevention and control: a narrative review

Abstract

Background

The objective of this review is to provide a comprehensive overview of the different types of economic evaluations that can be utilized by Infection Prevention and Control practitioners with a particular focus on the use of the quality adjusted life year, and its associated challenges. We also highlight existing economic evaluations published within Infection Prevention and Control, research gaps and future directions.

Design

Narrative Review.

Conclusions

To date the majority of economic evaluations within Infection Prevention and Control are considered partial economic evaluations. Acknowledging the challenges, which include variable utilities within infection prevention and control, a lack of randomized controlled trials, and difficulty in modelling infectious diseases in general, future economic evaluation studies should strive to be consistent with published guidelines for economic evaluations. This includes the use of quality adjusted life years. Further research is required to estimate utility scores of relevance within Infection Prevention and Control.

Background

Health-care associated infections (HAI) are common. In Canada approximately 200,000 patients will develop a HAI each year with 8000 associated deaths [1]. In the United States (US), there are over two million HAI annually [2]. HAIs are also extremely costly, with the overall annual direct costs to hospitals in the US ranging from $35.7 to $45 billion [3, 4]. There are numerous Infection Prevention and Control (IPC) interventions that can be utilized in hospitals to prevent HAI and their spread [5]. IPC activities include programs such as surveillance, hospital investigations when there are outbreaks, measures to prevent spread of contagious organisms, education for healthcare employees, patients and family members, and reporting of HAI to national organizations [6].

While many IPC programs and activities can be justified given that HAIs result in patient morbidity and lengthy hospital admissions [7], not every activity or program within IPC should be funded. When determining which programs should be implemented, the efficiency and effectiveness of such programs must be considered. Economic evaluations can determine which IPC strategies are cost-effective and provide reasonable value for money [7]. We sought to conduct a narrative review of the various types of economic evaluations, recommendations by national institutions, and factors to consider for economic evaluations, particularly the use of quality adjusted life years (QALYs) within IPC and their associated challenges.

Economic evaluations

All economic evaluations assess value for money by comparing the impact of competing interventions on both costs and consequences simultaneously [8]. There are a variety of types of economic evaluations described briefly below.

Cost-minimization analysis

A basic form of analysis is cost-minimization analysis which is used when the clinical effectiveness of two interventions are the same - so the choice between them relates to their relative costs [8]. For example, if two programs to promote hand hygiene were identical in terms of efficiency than only the comparisons of costs would be relevant.

Cost-effectiveness analysis

A cost-effectiveness analysis (CEA) compares consequences using natural clinical units such as life years gained, or infections avoided. The advantage to CEAs is that they are easier to conduct and the consequences are simple to understand clinically, however it can be difficult to compare the results of different evaluations if the same measure of clinical outcome is not used (for instance, how to compare a study reporting a cost per pneumonia avoided with a study reporting a cost per heart attack prevented) [8]. An example of a CEA is a recent study which compared universal and targeted decolonization for methicillin resistant Staphylococcus aureus (MRSA) in patients in the intensive care unit, to screening and then isolating patients who were colonized with MRSA [9]. It was more cost-effective (e.g. lower cost and prevented more MRSA infections) to complete universal and targeted decolonization compared to screening and isolation [9].

Cost-utility analysis

A cost-utility analysis (CUA) is an extension of a CEA, where the measure of health benefit is a measure that considers both length and quality of life. This is often represented by the QALY, calculated by multiplying the utility (a measure of preference for a person’s overall quality of life) of a given health state by the time spent in that health state [8]. The QALY allows for direct comparison between economic evaluations comparing different types of interventions and health conditions, rendering cost per QALY estimates more comparable. For example, a study compared the cost per QALY of rectal culture-guided antibiotic prophylaxis with standard ciprofloxacin prophylaxis [10]. The culture guided group saved 0.0002 QALYs and $24 per patient, by preventing more infections [10].

Cost benefit analysis

Cost-benefit analysis (CBA) is another form of economic evaluation where all consequences, including clinical outcomes, are expressed in monetary terms. CBAs can be a challenge in health care evaluations because many of the health benefits can be difficult to quantify in monetary terms, though they can be helpful when there are non-health benefits of interventions that require inclusion (for instance, the benefits of receiving health care locally vs travelling or when there are other process benefits that wouldn’t be quantified through the usual QALY rubric) [8]. In a recent cost-benefit analysis of a supplementary measles immunization program in a highly immunized population [11], the authors noted that the management of 187 cases of measles cost $864,000 (hospitalization costs, case management and earnings lost). In order for supplemental vaccination to be considered cost-effective, they estimated that the vaccination would need to cost less than $66 to $1877 per patient (depending on different scenarios) [11]. As the authors concluded that such a program would be unlikely to exceed these costs, supplementary measles immunization was considered cost-effective [11].

Guidelines for conducting economic evaluations

The most recent guidelines for the conduct of economic evaluations from the Canadian Agency for Drug and Technologies in Health were published in 2017 [12]. These guidelines are meant to improve the quality of economic evaluations for health technologies, and to ensure comparability across different analyses. They recommend that a CUA be utilized with the outcomes expressed as QALYs. Any other type of economic evaluation must be justified.

The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) also has guidelines on the reporting of economic evaluations which suggest the use of QALYs whenever possible, and are used widely in Canada, the United States and internationally [13].

Estimating and using the quality adjusted life year

As described above, a CUA is frequently the recommended type of economic evaluation and the outcome that is suggested for use by all contemporary guidelines is the QALY. A QALY is calculated by multiplying the utility (a measure of preference for a person’s overall quality of life – usually varying on a scale from 0 to 1, where 1 represents perfect health and 0 is equivalent to death) for a given health state by the time spent in that health state [14]. Utility scores can be determined in a variety of ways. They can be measured directly – through use of the visual analogue scale, the time trade-off and the standard gamble [14], or they can be measured indirectly, through questionnaires like the Euroqol EQ-5D, or the Health Utilities Index.

In the visual analogue scale participants with a certain health condition are presented with a scale ranging from worst to best imaginable health state and on that scale they place where they feel their current health state is [15]. This provides subjective weights and an ordinal ranking of health outcomes, but it does not invoke the notion of trade-off [15]. In the time trade-off method individuals have a choice between living the rest of their life (t) in a particular health state (i) or living for a shorter time period (x) but in perfect health. The time is varied until the participant feels ambivalent about the two options and then the preference score for i is x/t [15]. In the standard gamble individuals have to choose between the certainty of remaining in a given health state i and an alternative with two outcomes of perfect health with the probability p and death with the probability 1-p. The p is varied until the participant is indifferent between the two choices and then the score for state i for time t is p [15]. If a participant places a higher value on state i then a higher probability of perfect health will be needed for the individual to be indifferent between i and the gamble of having perfect health [15]. In both cases a score between 0 and 1 results, with higher scores reflecting better overall quality of life.

As the above direct methods can be time consuming and challenging for patients, several instruments have been developed that can generate utilities from scores on a variety of domains, for instance the EQ-5D, the SF-6D and the health utilities index [14]. These generic measures are used for valuing health related quality of life based on health status within certain areas [14]. The responses to these questionnaires are then converted into a single utility value.

We illustrate the use of QALYs with an example from the IPC literature which compared different IPC programs designed to prevent surgical site infections [16]. The authors used hypothetical data to estimate how surgical site infections would impact morbidity and mortality and the influence of these infections could be measured in QALYs. Two different scenarios were represented, in the first scenario patients either did or did not develop an infection and those who did develop an infection died shortly after surgery. The patients who did not develop an infection had 7.575 more QALYs than those who did acquire an infection. In another scenario, a patient develops an infection but recovers and after several months improves to the same health state as a patient who never develops an infection. This patient has 7.475 QALYs after surgery [16].

Economic evaluations within infection prevention and control

Positive and negative economic evaluations

Health care systems universally work within the confines of cost containment and it can be difficult to reconcile programs such as IPC interventions that improve patient quality of care with their associated costs. Economic evaluations can enhance the evidence base demonstrating how certain IPC programs, despite their expense, improve care for patients in a cost-effective manner and in some cases can result in cost savings. For example, a Canadian study demonstrated that after an IPC program became regionalized with standardized policies and procedures, with a budget of $6.7 million over the four years, the program resulted in cost savings of $9.1 million with a reduction of 4739 HAI cases [17]. It is evidence such as this that justifies the existence and continued funding for health care quality improvement programs such as IPC. Alternatively, economic evaluations will also demonstrate when IPC programs are not cost-effective. A study from the United States looked at the effectiveness of universal screening for MRSA to prevent hospital acquired MRSA infections [18]. The authors determined that while the rate of detection of MRSA was higher in universal screening, it was also more costly and did not significantly reduce the rate of hospital acquired MRSA infections compared to targeted screening. Therefore, no implementation of a universal screening program was advised [18].

Is a full economic evaluation required?

A systematic review from 2005 examining 70 different studies which performed economic analyses of HAI [2], a systematic audit of economic evidence linking HAI and IPC interventions from 1990 to 2000 [19], and a recent systematic review from 2016 [20], all found that frequently only partial economic evaluations were completed. Simple cost analyses of infection were commonly utilized, guidelines for economic evaluations were not followed, and the quality of reporting according to ISPOR was low [2, 19, 20]. This likely reflects that health economics in IPC is still a relatively new area.

If a strategy that improves outcomes also saves money in the short-term, then there is potentially no need for a complete economic evaluation assuming proper methodology was utilized. However, if there is additional cost associated with the intervention then other factors do need to be considered, such as infections prevented, or the impact on QALYs, allowing for comparison between different interventions [8].

Use of quality adjusted life years in economic evaluations within infection prevention and control

With respect to the important question of whether to invest in IPC programs, a question to be asked is: what are the benefits in terms of improvements to patient’s quality of life and survival, as well as the impact on overall costs? The purpose of IPC interventions is to prevent infections thus improving patient outcomes and resulting in additional QALYs [7]. Without randomized controlled trials (RCTs), this can be difficult to assess as the economic evaluation needs to be able to estimate what care for patients would have cost if they had not developed any infection [21].

The study used previously to describe the calculation of QALYs examined a model with six different IPC programs designed to prevent surgical site infections using infection related costs and QALYs [16]. The authors considered the outcomes of the cost of the IPC program, the cost of infection to the hospital, the cost to the community services and the patient-borne costs of the infection. The different IPC programs had varied upfront costs but some had more cost-savings, due to more infections prevented – resulting in different incremental QALY estimates. This reinforces that just assessing the change in costs related to preventing infection does not fully answer the question posed by their study. Changes in health benefits must be considered [16]. The authors then determined which IPC strategy had the lowest cost per QALY, and their conclusions contrast with the decisions that might be made when only considering the evaluation from the viewpoint of costs spent and saved [16].

In another recent study, the authors created a HAI cost-effectiveness policy model simulating elderly patients admitted to the intensive care unit (ICU). The objective was to determine the cost-effectiveness of hospitals’ continuing investments in HAI prevention in ICUs. Subsequently, multiple health states following the ICU admission were considered including bloodstream infection related to an access line, ventilator associated pneumonia, the conditional probability of inpatient deaths due to each specific HAI type, as well as incremental hospital costs associated with each infection [22]. A five year time horizon was used, which included QALYs and healthcare costs (dependent on whether or not a HAI developed) [22]. Published literature was used to determine the costs and rates of HAI and Medicare data was used to estimate the monthly conditional probabilities of health states for those who had or had not developed a HAI [22]. The authors determined that by continuing to use an IPC program to prevent HAI in ICUs, it would cost $14,250 per life year gained and $23,277 per QALY gained (US dollars) compared to not using an IPC program [22]. While not cost-saving, the IPC program to prevent HAI was still considered cost-effective [22].

Challenges with quality adjusted life years and economic evaluations in infection prevention and control

A systematic review of CUA related to Infectious Diseases including IPC was published in 2005 [23], noting only 122 CUA publications over a 21 year time period. There are many reasons for this, including a focus by payers on costs, a lack of RCTs in IPC, the complexity of modelling in infectious diseases, and few estimates for utility measures in IPC. In general, hospitals implementing IPC programs care about the costs spent and saved, and considering costs on their own is a simple accounting exercise.

There are few RCTs in IPC, and utilities as well as costs and benefits are frequently determined alongside these trials. This has likely impacted the number of informative CUAs in IPC. The lack of RCTs may in part be due to the difficulty in comparing the multitude of different IPC interventions, rendering it extremely difficult to complete one succinct RCT [16]. Therefore, in order to model the costs and benefits of IPC programs, multiple sources of information may need to be funneled into one model, creating a more difficult modelling scenario [16].

In addition to the issues just described, modelling for infectious diseases in general can be quite complex and requires specific expertise [23]. For example, the lack of an IPC program may lead to a patient developing an infection with antimicrobial resistant bacteria via transmission from another patient causing adverse consequences and increased costs. However, it can be difficult to model this continued transmission.

The estimation of utilities in infectious diseases appears to be challenging for several reasons. Indeed, studies that have estimated utilities in infectious diseases have noted a very wide interquartile range compared to 13 other disease categories [23]. The broad range of utilities available may at first glance render a CEA, which examines costs per life year gained or per infection avoided, more appealing to conduct.

Another limitation of using a QALY in HAI, which are typically transient [24], is that it can be difficult to determine a trade-off between quality and quantity of life [25]. Transient health states are those that last for a specific brief time, often less than one year, followed by a return to full health [26]. While traditional methods for measuring quality of life may not be appropriate for these transient health states, there are techniques adapted from the conventional methods which can be utilized [26]. While it could be argued that with such a short health state any influence on QALYs would be minimal, there may be longer lasting effects from even a short-term impact on health such as infection. In studies looking at health valuation specifically in transient health states such as dentistry and infection following hip arthroplasty, valuation of the health state can still be accomplished which subsequently can be turned into QALYs allowing for comparison between programs [27, 28].

Conclusions

The majority of economic evaluations in IPC are partial evaluations only considering costs. Given finite resources and fixed budgets, conducting rigorous economic evaluations of IPC programs will help policy makers understand where and how to spend scarce healthcare dollars. Utilizing a CUA and QALYs will allow comparison to other programs where healthcare dollars might be spent and ensure that resources are being used in sustainable and cost-effective programs.

The utilization of the QALY is not without its difficulties. This necessitates the use of more complex models and many of the necessary pieces of information, including utilities and time spent in particular health states lack reliable information within the realm of IPC.

Despite these challenges, given that IPC interventions were designed to improve patient safety and quality of care it is appropriate to not only consider costs saved from the hospital standpoint during admission but also the benefit to health through the use of QALYs.

Future economic evaluations in the area of IPC interventions should aim to follow rigorous guidelines for economic evaluations and justify when they are not used. CEAs that demonstrate cost savings and improved outcomes can inform funding decisions, but in most situations, use of the QALY when comparing different IPC interventions should be carefully considered.

Finally, the difficulty with estimating utilities in infectious diseases, in the context of this review, and in particular IPC should be addressed through additional studies that collect utilities for different health states related to HAI [23].

As more health economists work alongside infectious diseases and IPC specialists, it is likely that the outcomes relevant to health economics will be included, making economic evaluations more common. Collaborating with health economists can help in addressing the difficulties in uncertainty and amalgamating data when there are multiple sources of information and a lack of RCTs. Additionally, they can aid in creating valid economic models that take into account the transient nature of HAI and encourage the use of proper techniques to obtain utilities and subsequent QALYs.

Abbreviations

CEA:

Cost Effectiveness Analysis

CUA:

Cost Utility Analysis

HAI:

Healthcare Associated Infections

ICU:

Intensive Care Unit

IPC:

Infection Prevention and Control

ISPOR:

International Society for Pharmacoeconomics and Outcomes Research

MRSA:

Methicillin Resistant Staphylococcus aureus

QALY:

Quality Adjusted Life Year

US:

United States

References

  1. Zoutman DE, Ford B, Bryce E, Gourdeau M, Hebert G, Henderson E, et al. The state of infection surveillance and control in Canadian acute care hospitals. Am J Infect Control. 2003;31(5):266–73.

    Article  PubMed  Google Scholar 

  2. Stone PW, Braccia D, Larson E. Systematic review of economic analyses of health care-associated infections. Am J Infect Control. 2005;33(9):501–9.

    Article  PubMed  Google Scholar 

  3. Al-Tawfiq JA, Tambyah PA. Healthcare associated infections (HAI) perspectives. J Infect Public Health. 2014;7(4):339–44.

    Article  PubMed  Google Scholar 

  4. Storr J, Twyman A, Zingg W, Damani N, Kilpatrick C, Reilly J, et al. Core components for effective infection prevention and control programmes: new WHO evidence-based recommendations. Antimicrob Resist Infect Control. 2017;6(5):6.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Scheckler WE, Brimhall D, Buck AS, Farr B, Friedman C, Garibaldi R, et al. Requirements for infrastructure and essential activities of infection control and epidemiology in hospitals: a consensus panel report. Society for Healthcare Epidemiology of America. Infect Control Hosp Epidemiol. 1998;19(2):114–24.

    Article  CAS  PubMed  Google Scholar 

  6. Bryant KA, Harris AD, Gould CV, Humphreys E, Lundstrom T, Murphy D, et al. Necessary infrastructure of infection prevention and healthcare epidemiology programs: a review. Infect Control Hosp Epidemiol. 2016;37(4):371–80.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Graves N, Harbarth S, Beyersmann J, Barnett A, Halton K, Cooper B. Estimating the cost of health care-associated infections: mind your p's and q's. Clin Infect Dis. 2010;50(7):1017–21.

    Article  PubMed  Google Scholar 

  8. Drummond MF, Davies LM. Evaluation of the costs and benefits of reducing hospital infection. J Hosp Infect. 1991;18(Supplement A):85–93.

    Article  PubMed  Google Scholar 

  9. Whittington MD, Atherly AJ, Curtis DJ, Lindrooth RC, Bradley CJ, Campbell JD. Recommendations for methicillin-resistant Staphylococcus aureus prevention in adult ICUs: a cost-effectiveness analysis. Crit Care Med. 2017;45(8):1304–10.

    Article  PubMed  Google Scholar 

  10. Li CK, Tong BCY, You JHS. Cost-effectiveness of culture-guided antimicrobial prophylaxis for the prevention of infections after prostate biopsy. Int J Infect Dis. 2016;43:7–12.

    Article  CAS  PubMed  Google Scholar 

  11. Hayman DTS, Marshall JC, French NP, Carpenter TE, Roberts MG, Kiedrzynski T. Cost benefit analyses of supplementary measles immunisation in the highly immunized population of New Zealand. Vaccine. 2017;35(37):4913–22.

    Article  CAS  PubMed  Google Scholar 

  12. Canadian Agency for Drugs and Technologies in Health. Guidelines for the Economic Evaluation of Health Technologies. Canada; 2017. https://www.cadth.ca/guidelines-economic-evaluation-health-technologies-canada-4th-edition. Accessed 15 Jan 2018

  13. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS)--explanation and elaboration: a report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Health. 2013;16(2):231–50.

    Article  PubMed  Google Scholar 

  14. Bravo Vergel Y, Sculpher M. Quality-adjusted life years. Pract Neurol. 2008;8(3):175–82.

    Article  PubMed  Google Scholar 

  15. Drummond MF, Sculpher M, Claxton K, Stoddart G, Torrance G. Methods for the economic evaluation of health care programmes. Fourth ed. New York: Oxford University Press; 2015.

    Google Scholar 

  16. Graves N, Halton LD. Economics and preventing hospital-acquired infection: broadening the perspective. Infect Control Hosp Epidemiol. 2007;28(2):178–84.

    Article  PubMed  Google Scholar 

  17. Raschka S, Dempster L, Bryce E. Health economic evaluation of an infection prevention and control program: are quality and patient safety programs worth the investment? Am J Infect Control. 2013;41(9):773–7.

    Article  PubMed  Google Scholar 

  18. Leonhardt KK, Yakusheva O, Phelan D, Reeths A, Hosterman T, Bonin D, et al. Clinical effectiveness and cost benefit of universal versus targeted methicillin-resistant Staphylococcus aureus screening upon admission in hospitals. Infect Control Hosp Epidemiol. 2011;32(8):797–803.

    Article  PubMed  Google Scholar 

  19. Stone PW, Larson E, Kawar LN. A systematic audit of economic evidence linking nosocomial infections and infection control interventions: 1990-2000. Am J Infect Control. 2002;30(3):145–52.

    Article  PubMed  Google Scholar 

  20. Arefian H, Vogel M, Kwetkat A, Hartmann M. Economic evaluation of interventions for prevention of hospital acquired infections: a systematic review. PLoS One. 2016;11(1):e0146381.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Roberts RR, Ek M, Weinstein RA. A guide to interpreting economic studies in infectious diseases. Clin Microbiol Infect. 2010;16(12):1713–20.

    Article  CAS  PubMed  Google Scholar 

  22. Dick A, Perencevich EN, Pogorzelska-Maziarz M, Zwanziger J, Larson EL, Stone PW. A decade of investment in infection prevention: a cost effectiveness analysis. Am J Infect Control. 2015;43(1):4–9.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Stone PW, Schackman BR, Neukermans CP, Olchanski N, Greenberg D, Rosen A, et al. A synthesis of cost-utility analysis literature in infectious disease. Lancet Infect Dis. 2005;5(6):383–91.

    Article  PubMed  Google Scholar 

  24. Pettitt DA, Raza S, Naughton B, Roscoe A, Ramakrishnan A, Ali A, et al. The limitations of QALY: a literature review. J Stem Cell Res Ther. 2016;6:334–6.

    Google Scholar 

  25. Knapp M, Mangalore R. The trouble with QALYs.... Epidemiol Psychiatr Soc. 2007;16(4):289–93.

    Article  Google Scholar 

  26. Ogwulu CB, Jackson LJ, Kinghorn P, Roberts TE. A systematic review of the techniques used to value temporary health states. Value Health. 2017;20(8):1180–97.

    Article  PubMed  Google Scholar 

  27. Cunningham SJ. Economic evaluation of healthcare-is it important to us? Br Dent J. 2000;188(5):250–4.

    Article  CAS  PubMed  Google Scholar 

  28. Gu N, Wolf C, Leopold S, Manner PA, Doctor JN. A comparison of physician and patient time trade-offs for postoperative hip outcomes. Value Health. 2009;12(4):618–20.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Not applicable.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the literature review and helped in creating the outline for the paper. Author ER wrote the initial draft of the paper and all other authors provided feedback and edited the initial draft. All authors read, edited, and approved the final manuscript.

Corresponding author

Correspondence to Elissa Rennert-May.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Has been obtained by all authors.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rennert-May, E., Conly, J., Leal, J. et al. Economic evaluations and their use in infection prevention and control: a narrative review. Antimicrob Resist Infect Control 7, 31 (2018). https://0-doi-org.brum.beds.ac.uk/10.1186/s13756-018-0327-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13756-018-0327-z

Keywords