Skip to main content
Advertisement
  • Loading metrics

Antibiotic prescription practices in primary care in low- and middle-income countries: A systematic review and meta-analysis

  • Giorgia Sulis,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Quebec, Canada, McGill International TB Centre, McGill University, Montreal, Quebec, Canada

  • Pierrick Adam,

    Roles Data curation, Methodology, Writing – review & editing

    Affiliations Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Quebec, Canada, McGill International TB Centre, McGill University, Montreal, Quebec, Canada

  • Vaidehi Nafade,

    Roles Data curation, Methodology, Writing – review & editing

    Affiliations Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Quebec, Canada, McGill International TB Centre, McGill University, Montreal, Quebec, Canada

  • Genevieve Gore,

    Roles Data curation, Methodology, Writing – review & editing

    Affiliation Schulich Library of Physical Sciences, Life Sciences and Engineering, McGill University, Montreal, Quebec, Canada

  • Benjamin Daniels,

    Roles Methodology, Software, Writing – review & editing

    Affiliation McCourt School of Public Policy, Georgetown University, Washington, District of Columbia, United States of America

  • Amrita Daftary,

    Roles Methodology, Writing – review & editing

    Affiliations McGill International TB Centre, McGill University, Montreal, Quebec, Canada, School of Health Policy and Management, Faculty of Health, York University, Toronto, Ontario, Canada

  • Jishnu Das,

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation McCourt School of Public Policy, Georgetown University, Washington, District of Columbia, United States of America

  • Sumanth Gandra ,

    Roles Conceptualization, Data curation, Formal analysis, Supervision, Writing – original draft, Writing – review & editing

    ‡ These authors are joint senior authors on this work.

    Affiliation Division of Infectious Diseases, Department of Medicine, Washington University School of Medicine, St. Louis, Missouri, United States of America

  • Madhukar Pai

    Roles Conceptualization, Methodology, Resources, Supervision, Writing – review & editing

    madhukar.pai@mcgill.ca

    ‡ These authors are joint senior authors on this work.

    Affiliations Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Quebec, Canada, McGill International TB Centre, McGill University, Montreal, Quebec, Canada, Manipal McGill Program for Infectious Diseases, Manipal Centre for Infectious Diseases, Manipal Academy of Higher Education, Manipal, Karnataka, India

Abstract

Background

The widespread use of antibiotics plays a major role in the development and spread of antimicrobial resistance. However, important knowledge gaps still exist regarding the extent of their use in low- and middle-income countries (LMICs), particularly at the primary care level. We performed a systematic review and meta-analysis of studies conducted in primary care in LMICs to estimate the prevalence of antibiotic prescriptions as well as the proportion of such prescriptions that are inappropriate.

Methods and findings

We searched PubMed, Embase, Global Health, and CENTRAL for articles published between 1 January 2010 and 4 April 2019 without language restrictions. We subsequently updated our search on PubMed only to capture publications up to 11 March 2020. Studies conducted in LMICs (defined as per the World Bank criteria) reporting data on medicine use in primary care were included. Three reviewers independently screened citations by title and abstract, whereas the full-text evaluation of all selected records was performed by 2 reviewers, who also conducted data extraction and quality assessment. A modified version of a tool developed by Hoy and colleagues was utilized to evaluate the risk of bias of each included study. Meta-analyses using random-effects models were performed to identify the proportion of patients receiving antibiotics. The WHO Access, Watch, and Reserve (AWaRe) framework was used to classify prescribed antibiotics. We identified 48 studies from 27 LMICs, mostly conducted in the public sector and in urban areas, and predominantly based on medical records abstraction and/or drug prescription audits. The pooled prevalence proportion of antibiotic prescribing was 52% (95% CI: 51%–53%), with a prediction interval of 44%–60%. Individual studies’ estimates were consistent across settings. Only 9 studies assessed rationality, and the proportion of inappropriate prescription among patients with various conditions ranged from 8% to 100%. Among 16 studies in 15 countries that reported details on prescribed antibiotics, Access-group antibiotics accounted for more than 60% of the total in 12 countries. The interpretation of pooled estimates is limited by the considerable between-study heterogeneity. Also, most of the available studies suffer from methodological issues and report insufficient details to assess appropriateness of prescription.

Conclusions

Antibiotics are highly prescribed in primary care across LMICs. Although a subset of studies reported a high proportion of inappropriate use, the true extent could not be assessed due to methodological limitations. Yet, our findings highlight the need for urgent action to improve prescription practices, starting from the integration of WHO treatment recommendations and the AWaRe classification into national guidelines.

Trial registration

PROSPERO registration number: CRD42019123269.

Author summary

Why was this study done?

  • Inappropriate use of antibiotics, both in terms of incorrect regimens and prescription without clinical indication, is a major driver of antibiotic resistance.
  • Global drug sales data indicate a substantial increase in antibiotic use in low- and middle-income countries (LMICs) over the past 2 decades.
  • An accurate quantification of antibiotic prescribing in primary care across LMICs is not available.

What did the researchers do and find?

  • We conducted a systematic review and meta-analysis to estimate the proportion of antibiotic prescribing across primary care settings in LMICs.
  • Our study showed that, on average, approximately half of patients attending primary care facilities in LMICs received at least 1 antibiotic.
  • Very few included studies made an attempt to assess the extent of inappropriate prescriptions and indicate potential misuse.
  • Among studies that provided information on the types of antibiotics used, we found that, in 12/16 studies, 60% of prescriptions were for antibiotics with low potential for resistance selection as defined by the World Health Organization (WHO).

What do these findings mean?

  • Our study highlights that antibiotics are highly prescribed in outpatient primary care settings.
  • Better quality data are necessary to dig deeper into the patterns of inappropriate use according to local epidemiologic scenarios.
  • Adapting WHO treatment recommendations and incorporating the WHO Access, Watch, and Reserve (AWaRe) classification of antibiotics into national guidelines will be a first key step to improve prescription practices.

Introduction

Antimicrobial resistance (AMR) is a major health threat globally [1]. Growing morbidity and mortality rates due to resistant infections in humans are expected worldwide, along with a substantial economic impact in terms of productivity losses and healthcare expenditures [2,3].

Several factors are known to play a role in the development and spread of AMR, with inappropriate use of antibiotics being one of its most important drivers [4]. Gathering data about resistance as well as antibiotic use is 1 of the top 5 priorities of the Global Action Plan on Antimicrobial Resistance by the World Health Organization (WHO) [5].

A multinational survey conducted across 76 countries to determine the magnitude of antibiotic consumption and its trend over time revealed a dramatic increase between 2000 and 2015 (+65% globally), mostly driven by a sharp rise in low- and middle-income countries (LMICs) (+114%), where the levels of antibiotic consumption are high and rapidly approaching those observed in high-income countries (HICs) [6]. However, this analysis was based on drug sales data, thus providing limited information regarding providers’ prescription habits.

The high level of antibiotic consumption in LMICs is because of multiple factors, including the high burden of infectious diseases, lack of regulations (or weak enforcement) to prevent over-the-counter sale of antibiotics, inadequate training of healthcare professionals, and the limited availability of essential diagnostics, which favors empirical use of antibiotics [1,7,8]. Besides misuse (i.e., prescription without clinical indication), another huge concern is the inappropriate use of antibiotics in terms of choice of a suitable molecule, dosage, and duration of treatment according to the site of infection and patient’s characteristics.

Most studies investigating the magnitude and determinants of antibiotic use have focused on HICs, and those from LMICs have been carried out predominantly in hospital settings [912], leaving a number of unanswered questions about current practices at the primary healthcare level, where the bulk of antibiotic use takes place.

Of note, there is a paucity of information regarding the degree and pattern of antibiotic use in outpatient primary healthcare facilities, i.e., any service (other than pharmacies) providing care for people making an initial contact with a health professional. Having this information will be helpful to design and implement effective stewardship interventions and policies in LMICs.

We conducted a systematic review of the literature to assess the extent and patterns of antibiotic prescription and their determinants at the primary healthcare level in LMICs, as well as the proportion of such prescriptions deemed to be inappropriate.

Methods

The protocol for this systematic review was registered in the International Prospective Register of Systematic Reviews (PROSPERO) (identifier: CRD42019123269) and followed the PRISMA guidelines [13]. The PRISMA checklist and PROSPERO protocol are provided as S1 PRISMA Checklist and S1 PROSPERO Protocol.

Search strategy and selection criteria

We performed a systematic review of cross-sectional studies that were conducted in primary care in LMICs and reported the proportion of individuals receiving any antibiotic or the proportion of drug prescriptions that included an antibiotic. We also examined randomized and non-randomized trials as well as other observational studies to determine whether potentially relevant information (e.g., results from preliminary field assessments including cross-sectional drug prescription data) was provided. Conference proceedings and abstracts, commentaries, editorials, reviews, mathematical modeling studies, economic analyses, qualitative studies, and studies published in predatory journals as defined by Beall [14] were excluded. Studies conducted solely in an inpatient setting, those that focused on veterinary use of antibiotics, and those that only enrolled patients belonging to special cohorts (e.g., patients with cystic fibrosis or neutropenia or other underlying conditions that may justify an increased empirical use of antibiotics, or patients receiving antibiotics as part of prophylactic regimens) were also ineligible. No restrictions were applied with regards to the population characteristics in terms of age, sex, pregnancy status, or HIV status.

For the purpose of the study, we considered as “primary care” any care provided by any health professional (other than pharmacists) with whom patients have their initial contact, in the public or private sector, including primary care delivered in hospital settings wherever appropriate. In cases of uncertainty, we contacted the study authors for clarification. Antibiotics were defined as any agents included in the J01 group of the ATC (Anatomical Therapeutic Chemical) classification system [15]. Inappropriate prescriptions were recorded when such assessment was performed in the original studies. Countries were classified as low, lower-middle, upper-middle, or high income following the World Bank categorization based on gross national income per capita (GNI) of the study start year [16]. GNI thresholds for the definition of such categories, which have changed slightly over time, are provided in S1 Table. Given that there is no international standard definition of “urban” and “rural” areas, we classified the study settings in accordance with the authors’ statements. If not explicitly stated by the investigators, we categorized as “urban” any site with a minimum population of 2,000 inhabitants, i.e., the most frequently used cutoff [17].

The search strategy was built in collaboration with a medical librarian (GG), using key terms for “antibiotic,” “primary healthcare,” “prescribing,” and “LMICs” (both as a group and as individual countries, adopting a filter that was developed according to the World Bank categories). Medline (PubMed), Embase (Ovid), Global Health (Ovid), and CENTRAL (Cochrane Library) were systematically searched from 1 January 2010 until 4 April 2019. We also reran our search on 11 March 2020 using PubMed only; for feasibility reasons, the update could not be conducted through all data sources used in the initial search. Studies conducted before 1 January 2010 were excluded. The start date of our search was established after the conduction of an exploratory review of the literature showing that only a small number of studies were performed before 2010 in relevant settings, in the face of the exponentially higher number of total records identified through our search strategy, which would have posed substantial feasibility issues with very little benefit. Additionally, as patterns of antibiotic prescribing have changed substantially over time, including older studies would have been of limited value for understanding the current situation. No language restrictions were applied. The full search strategies for each database are presented in S1 Text.

Study screening and data extraction

Search results were imported into a citation manager (EndNote X9, Clarivate Analytics), and duplicates were removed. Three authors (GS, PA, and VN) independently screened citations by title and abstract against predefined eligibility criteria. The full-text review of all selected records was performed by 2 authors (GS and PA). An electronic data extraction form was piloted on 5 randomly selected papers and then used by 2 reviewers (GS and PA) to extract information from all eligible publications. At each stage of the screening and data extraction process, disagreements were resolved through discussion, and, if necessary, a third author (SG) was consulted to reach consensus. Study authors were contacted to request clarifications or additional data if needed. A detailed description of the screening and data extraction process is provided in S2 Text along with interrater agreement statistics.

Assessment of study quality and publication bias

A modified version of a tool developed by Hoy and colleagues was utilized to evaluate the risk of bias of each included study (S2 Table) [18]. Our checklist included 8 methodological items (rated as low or high risk of bias), plus a summary item on the overall risk of study bias (rated as low, moderate, or high); no numeric scores were applied. All findings from this assessment were recorded in the data extraction form by the same independent reviewers. As a sensitivity analysis, we excluded studies with a high overall risk of bias.

No formal assessment of publication bias could be performed since traditional approaches such as funnel plots and tests for asymmetry are considered unsuitable for prevalence studies [19].

Statistical analysis

Depending on the type of data available from individual studies, we calculated either the proportion of patients evaluated in a given health facility or by a certain provider who received antibiotics or the proportion of all drug prescriptions containing any antibiotics, along with their Clopper–Pearson (or exact) 95% confidence intervals (CIs) [20]. The 2019 WHO Access, Watch, and Reserve (AWaRe) framework was used to classify antibiotics according to their potential for selecting resistance [21]. Access-group antibiotics are first-line and narrow-spectrum agents such as penicillin, amoxicillin, and trimethoprim-sulfamethoxazole. Watch-group antibiotics are broad-spectrum agents with higher resistance selection such as second- and third-generation cephalosporins, and fluoroquinolones. Reserve-group antibiotics include last-resort antibiotics such as colistin. Fixed-dose combinations of antibiotics (e.g., ciprofloxacin/ornidazole) were classified as “discouraged” antibiotics, in line with WHO recommendations.

Random-effects meta-analyses were performed to estimate pooled proportions after Freeman–Tukey transformation to normalize the outcome [22]. To assess the between-study heterogeneity, we used the I2 statistic and calculated prediction intervals (i.e., a type of confidence interval that provides the 95% range of true values to be expected in similar studies) [23,24]. Random-effects meta-regression with Knapp–Hartung adjustment (aimed to accommodate high degrees of heterogeneity) was employed to investigate the sources of heterogeneity. Categorical predictors for facility location (urban/rural), healthcare sector (public/private), age group (adults/children/all), type of patients (i.e., patients seeking care for any reason or individuals with a specific condition, e.g., diarrhea), and source of prescription information were considered for building the model. If collinearity issues were observed, variables with the lowest number of missing values were prioritized and included in the model.

Subgroup analyses were conducted to investigate potential differences across levels of country income and types of patients involved (with a focus on studies where all patients attending 1 or more facilities were considered without placing restrictions based on their clinical presentation).

Sensitivity analyses were done by repeating analyses without studies that (i) were conducted in Iran as they were all based on administrative data from national registers; (ii) did not report details on the population and/or health facility location; (iii) were conducted in low-income countries; (iv) were based on the standardized patient methodology, in which antibiotics were deemed inappropriate by indication; (v) were deemed to be low quality (i.e., overall risk of study bias scored as “high”).

All analyses were conducted in Stata (version 14; StataCorp) [25,26].

Results

Our initial search yielded 9,604 unique citations, and an additional 590 were retrieved through our search update. A total of 48 studies (all cross-sectional) were finally included in the analyses (Fig 1) [2774]. All included publications were in English language, except for 1 that was in Spanish. A summary of the main study characteristics is presented in Table 1, and the full dataset used for analyses is provided as S1 Data. Most studies were conducted in lower-middle- or upper-middle-income countries (22 and 19, respectively), while only 6 were in a low-income country. Additionally, 1 study was carried out in 3 countries (1 low income and 2 lower-middle income) [70]. Both public and private healthcare services were involved in 10 of the 48 (20.8%) included studies, whereas 26 (54.2%) studies were focused on the public sector, 4 (8.3%) were focused on the private sector, and 8 (16.7%) did not provide this information; none of the studies mentioned any involvement of informal practitioners. Facilities located in urban areas were more represented than those located in rural areas (17/48 studies [35.4%; 95% CI: 22.2%–50.5%] versus 10/48 studies [20.8%; 95% CI: 10.5%–35.0%]), with 13 (27.1%) studies involving both settings and 8 (16.7%) not reporting sufficient details. While 9 (18.8%) studies only included individuals presenting with 1 prespecified condition (i.e., acute respiratory illness, diarrhea, or fever), the other studies did not apply restrictions on the reason for seeking care and/or the final diagnosis (if any) and likely included patients with various conditions. None of the studies focused solely on dental care; although it is possible that patients seeking dental care were included in some studies, this group likely represented a negligible proportion of the total sample. Of note, no clinical information was reported in most studies.

thumbnail
Table 1. Characteristics of studies identified through systematic review.

https://doi.org/10.1371/journal.pmed.1003139.t001

Importantly, almost all the studies identified through our systematic review only assessed drug prescription and did not account for direct dispensing of unlabeled medicines, which is likely a common practice [75]. This may underestimate the true antibiotic prescribing proportion.

Study quality

Fig 2 displays the summary of the risk of bias assessment, while the individual studies’ quality assessment results are presented in S3 Table. The overall risk of study bias was scored as high for 21/48 studies (43.8%), moderate for 11 (22.9%), and low for 16 (33.3%). The proportion of studies assigned to the high risk group was higher among those conducted in low- and lower-middle-income countries (14/28; 50%) and lower among those performed in upper-middle-income countries (7/19; 36.8%). No major changes were observed in terms of overall study quality over time, although this could be due to the limited number of studies. In general, the biggest issues were observed with regards to external validity: Some form of random sampling or a census was seldom performed, and the study population was rarely representative of the target, mostly due to the fact that prescriptions were often selected from one or a few facilities in circumscribed areas. The case definition was considered inadequate for studies that did not record clinical details about patients receiving prescriptions. The risk of bias concerning the data collection method was deemed to be low for studies that used medical records or similar sources to retrieve prescription information. This choice was made based on the fact that medical records and drug prescription audits constitute good sources to estimate the proportion of antibiotic prescribing, although they are generally poorly suited for an accurate evaluation of appropriateness of prescription. On the other hand, studies using patient or provider questionnaires were considered at high risk of bias given the potential for recall bias and Hawthorne effect [76,77].

Prevalence of antibiotic prescription

Among the 21 studies that reported the total number of patients attending a certain facility at the time of data collection [27,28,30,32,36,38,39,41,42,48,5356,59,62,65,68,70,72,73], the average proportion of individuals receiving an antibiotic prescription ranged widely, from 19.6% (95% CI: 14.0%–26.4%) to 90.8% (95% CI: 89.3%–92.0%) [27,54]. Among the 27 studies in which the denominator was the total number of drug prescriptions [29,31,3335,37,40,4347,4952,57,58, 60,61,63,64,66,67,69,71,74], the proportion of prescriptions containing antibiotics varied between 17.8% (95% CI: 14.2%–21.9%) and 79.2% (95% CI: 74.4%–82.7%) [46,57]. We could not identify any specific pattern in the distribution of antibiotic prescription rates across levels of country income, partly due to small sample sizes. As very few studies were conducted solely in the private health sector, no comparisons could be made against public facilities. Similar considerations apply to the health service location (i.e., urban versus rural areas). Furthermore, we did not observe any specific variation over time in the proportion of patients receiving antibiotics, either overall or after stratifying by country income level.

Since almost all patient–provider encounters included in studies using patients as the denominator resulted in a treatment prescription, prevalence estimates can be considered comparable to those derived from the 27 studies using drug prescriptions as the denominator. The pooled proportion of patients who received antibiotics resulting from a meta-analysis of all studies was 52% (95% CI: 51%–53%), and both stratum-specific pooled proportions for studies using one or the other type of denominator were reasonably close to the overall estimate (Fig 3). As expected, very high levels of between-study heterogeneity were observed (I2 values were above 98% overall, in subgroup analyses, and in sensitivity analyses), thus limiting the reliability of our pooled estimates. However, the 95% prediction interval calculated in the primary analysis was quite narrow, ranging from 44% to 60%, indicating that a new potential observation in a similar setting would likely yield a proportion of patients receiving antibiotics close to 50%. The prediction interval is wider than the conventional confidence interval owing to the fact that it accounts for uncertainty about both the population mean and the distribution of values.

thumbnail
Fig 3. Forest plot of antibiotic prescription prevalence across all studies stratified by type of denominator used (i.e., either total number of patients or total number of drug prescriptions).

CI, confidence interval; ES, effect size; PNG, Papua New Guinea.

https://doi.org/10.1371/journal.pmed.1003139.g003

Subgroup analyses (e.g., after stratification by country income level, type of denominator, or type of patients examined) and sensitivity analyses yielded similar point estimates, but confidence and prediction intervals became much wider (S1S4 Figs). Unsurprisingly, given the results of subgroup meta-analyses, none of the coefficients of our meta-regression models was statistically significant, and the overall model could only explain a negligible proportion of the observed heterogeneity (S4 Table).

Inappropriate antibiotic prescription

As previously mentioned, we recorded the proportion of inappropriate prescriptions when available in individual studies. In most cases, the authors made their judgment based on national and/or international guidelines for treatment of key conditions. Among the 9 studies that assessed the rationality of antibiotic prescriptions [36,39,46,53,55,62,64,65,67], the proportion judged inappropriate ranged widely, reflecting the significant differences in study designs as well as in the sets of criteria that were adopted to determine the outcome (Table 2). The lowest level of inappropriate prescription (7.9%; 95% CI: 4.6%–12.5%) was reported in a study conducted in Zambia that included 537 children aged <5 years presenting with an acute respiratory syndrome, of whom 37.6% (95% CI: 33.5%–41.9%) were given antibiotics [39]. All antibiotic prescriptions were classified as inappropriate in 3 studies: 2 of them employed standardized patients portraying conditions that did not require antibiotics such as common cold, watery diarrhea, presumptive tuberculosis, and chest pain indicative of angina, with an overall antibiotic prescription prevalence of about 41%–42% [53,65]; the other study was performed in China and included 9,340 drug prescriptions issued for children with acute respiratory tract infection of likely viral etiology, 36.6% (95% CI: 35.7%–37.6%) of whom received an antibiotic [67]. The proportion of inappropriate antibiotic prescriptions exceeded 50% in the remaining 5 studies.

thumbnail
Table 2. Main findings of studies that assessed inappropriate antibiotic prescription.

https://doi.org/10.1371/journal.pmed.1003139.t002

Information regarding individual antibiotics was available from 16 studies in 15 countries. Of note, 11 of these studies included patients seeking care for any reason, while the remaining 5 studies focused on a specific condition (i.e., respiratory tract infection [4 studies] or diarrhea [1 study]) (Table 3). Access-group antibiotics accounted for the majority of prescriptions (more than 60%) in 13 studies from 12 countries, whereas Watch-group antibiotics accounted for high proportions of prescriptions among studies from Mexico (90.3%; 95% CI: 88.8%–91.7%), China (78.4%; 95% CI: 75.7%–81.0%), and Pakistan (47.8%; 95% CI: 46.5%–49.1%) (Table 3) [46,54,63].

thumbnail
Table 3. AWaRe classification of antibiotic prescriptions in a subset of studies included in analysis.

https://doi.org/10.1371/journal.pmed.1003139.t003

Discussion

To our knowledge, this is the first comprehensive analysis of antibiotic prescriptions in primary care in LMICs. We found that the proportion of patients seeking care for any reason who were prescribed antibiotics in this context often exceeded 50%. Although the interpretation of our pooled estimates is limited by the considerable between-study heterogeneity, values were quite consistent across settings. Available studies from LMICs often suffer from several methodological issues and report scanty details concerning patients’ clinical features that would help accurately judge the appropriateness of prescription. The number of health facilities involved in individual studies is often very small, particularly in low-income countries (a total of 13 facilities across 4 studies that reported this information), indicating major discrepancies in the quality of information among geographic areas. Although all included studies examined prescription data in primary care facilities, we recognize that primary care entails a wide range of facility types, each with its own peculiarities and challenges. This variegated scenario prevented us from conducting specific subgroup analyses that could inform targeted antibiotic stewardship strategies. Two studies, both conducted in an Iranian province, had a very large sample size because prescription details were captured through an electronic data collection system that is available nationwide. However, clinical information on patients receiving each prescription is much more challenging to obtain from this system, thus hindering a thorough assessment of inappropriate drug use.

WHO recommends that the proportion of patients receiving antibiotics in an outpatient setting should be less than 30% [78]. However, this threshold was established somewhat arbitrarily more than 2 decades ago, due to a lack of evidence on prescription practices and actual needs according to patients’ clinical features. If accurate and nationally representative prescribing data were available for individual countries, these could be used as a benchmark to define condition-specific ideal prescribing proportions that account for context-related variables.

High infectious disease burden in LMICs could potentially explain the high prevalence of antibiotic use; however, our results raise concerns about potential misuse of antibiotics based on a subset of studies that assessed the rationality of antibiotic prescriptions. For example, high levels of antibiotic prescriptions (41%–42%) were reported in 2 standardized patient studies in Malaysia and China, where nobody should have received antibiotics, by design [53,65]. In a study conducted in Mexico, 69% of patients had had watery diarrhea for less than 48 hours, but almost everybody received antibiotics instead of rehydration alone [54]. Similarly, in a nationwide health facility survey in Zambia, 72.2% of patients met the criteria for suspected malaria, for which antibiotics are not appropriate treatment, but nonetheless more than half were given antibiotics [42]. Studies focused on individuals with upper respiratory symptoms such as common cold or pharyngitis reported unacceptably high antibiotic prescribing proportions, ranging from 36.7% to 55.3% [39,62,63,67].

To promote the optimal use of antibiotics and assist antibiotic stewardship efforts, WHO introduced the AWaRe classification in 2017 [21]. The classification underlines that, where appropriate, narrow-spectrum antibiotics included in the Access group should be preferred over broad-spectrum antibiotics from Watch and Reserve groups in order to limit the selection and spread of antibiotic resistance. Accordingly, WHO recommends that Access-group antibiotics should constitute at least 60% of overall antibiotic use [21]. Only 16 of the 48 studies identified through our systematic review reported detailed information on individual antibiotic drugs, and all but 3 had at least 60% of antibiotics being from the Access group [21]. Three studies with a high proportion of Watch-group antibiotics were from Mexico, China, and Pakistan; however, we cannot generalize these estimates to overall antibiotic consumption in these countries based on only 1 study in each country. Interestingly, a recent study that analyzed pediatric antibiotic sales data using AWaRe categories in 70 countries showed a high proportion of Watch-group antibiotics in China, Pakistan, and Mexico [79].

A recently published umbrella review on antibiotic use for adults in primary care (though focused on dental care) identified several factors that appear to affect prescribing behaviors in HICs, such as socio-cultural context, financial incentives, personal beliefs, patients’ attitudes, and AMR awareness [80]. Similar considerations likely apply to prescription practices in LMICs, although a deeper understanding of underlying determinants remains challenging. Among the biggest issues is the poor documentation of clinical reasons leading to antibiotic prescription, as observed in other settings [81]. Reaching a definitive diagnosis is often a huge challenge in resource-constrained areas, where point-of-care diagnostic tests for the most common conditions observed in primary care are frequently lacking [82].

Along with potential antibiotic misuse, therapeutic schemes may be inappropriate because of inadequate choice of antibiotic or incorrect dose or duration. However, a thorough assessment of prescription practices that includes such considerations is made particularly difficult by the variability in national treatment guidelines regarding antibiotic regimens [83]. In an attempt to foster the harmonization of such guidelines and minimize differences across countries, WHO recently released antibiotic treatment guidelines for 26 common infectious syndromes encountered in primary care and inpatient settings [84]. These guidelines currently indicate when and what antibiotics should be prescribed, and further work on harmonizing dose, duration, and formulation is ongoing [21].

In summary, the pooled estimate of antibiotic prescription in primary care settings across LMICs was 52%, but there was significant between-study heterogeneity. Further, the true extent of misuse was hard to discern, given the lack of data on appropriateness and the low quality of studies included. Future studies should use methodologies such as standardized patients, where the diagnosis is fixed by design, or include thorough laboratory testing to match diagnoses with antibiotic use. Accurate prescription audit tools are difficult to implement in most LMICs owing to the limited availability of electronic records. Also, the paucity of clinical details that can be captured through medical records (paper-based or not) makes it even harder to determine the appropriateness of prescription [85].

There is a need for better quality data to accurately measure the magnitude of antibiotic prescribing and dispensing by healthcare professionals at the primary care level accounting for local epidemiologic patterns. Global burden of disease data [86] combined with nationally representative AMR surveillance data [87] could be utilized to estimate the amount and type of antibiotics needed in a country, which could then be compared with existing national antibiotic consumption databases [6]. Meanwhile, LMICs should adapt the WHO infection treatment guidelines and incorporate the AWaRe categorization into their national antibiotic treatment guidelines to improve antibiotic prescribing. This will help countries to prioritize surveillance and stewardship efforts aimed at curbing the spread of AMR and preserving the efficacy of currently available antibiotics.

Supporting information

S1 Fig. Forest plot of proportion of patients receiving antibiotics, restricted to studies including patients seeking care for any reason.

https://doi.org/10.1371/journal.pmed.1003139.s002

(TIF)

S2 Fig. Forest plot of proportion of patients receiving antibiotics stratified by country income level (LIC = low-income country; LMIC = lower-middle-income country; UMIC = upper-middle-income country).

https://doi.org/10.1371/journal.pmed.1003139.s003

(TIF)

S3 Fig. Forest plot of proportion of patients receiving antibiotics, including all studies except those conducted in Iran.

https://doi.org/10.1371/journal.pmed.1003139.s004

(TIF)

S4 Fig. Forest plot of proportion of patients receiving antibiotics, excluding studies whose overall risk of bias was scored as “high.”

https://doi.org/10.1371/journal.pmed.1003139.s005

(TIF)

S1 Table. World Bank criteria for the definition of countries’ income level 2010–2018.

https://doi.org/10.1371/journal.pmed.1003139.s008

(DOCX)

S2 Table. Risk of bias assessment tool (adapted from Hoy et al. [18]).

https://doi.org/10.1371/journal.pmed.1003139.s009

(DOCX)

S3 Table. Risk of bias assessment of all studies included in final synthesis.

https://doi.org/10.1371/journal.pmed.1003139.s010

(DOCX)

S4 Table. Results of meta-regression analysis.

https://doi.org/10.1371/journal.pmed.1003139.s011

(DOCX)

S2 Text. Selection process and data extraction.

https://doi.org/10.1371/journal.pmed.1003139.s013

(DOCX)

References

  1. 1. World Health Organization. Antimicrobial resistance and primary health care. Geneva: World Health Organization; 2018 [cited 2020 May 13]. Available from: https://apps.who.int/iris/bitstream/handle/10665/326454/WHO-HIS-SDS-2018.56-eng.pdf.
  2. 2. Review on Antimicrobial Resistance. Tackling drug-resistant infections globally: final report and recommendations. London: Review on Antimicrobial Resistance; 2016 [cited 2020 May 13]. Available from: https://amr-review.org/sites/default/files/160518_Final%20paper_with%20cover.pdf.
  3. 3. de Kraker ME, Stewardson AJ, Harbarth S. Will 10 million people die a year due to antimicrobial resistance by 2050? PLoS Med. 2016;13(11):e1002184. pmid:27898664
  4. 4. Chatterjee A, Modarai M, Naylor NR, Boyd SE, Atun R, Barlow J, et al. Quantifying drivers of antibiotic resistance in humans: a systematic review. Lancet Infect Dis. 2018;18(12):e368–78. pmid:30172580
  5. 5. World Health Organization. Global action plan on antimicrobial resistance. Geneva: World Health Organization; 2015 [cited 2020 May 13]. Available from: https://apps.who.int/iris/bitstream/handle/10665/193736/9789241509763_eng.pdf?sequence=1.
  6. 6. Klein EY, Van Boeckel TP, Martinez EM, Pant S, Gandra S, Levin SA, et al. Global increase and geographic convergence in antibiotic consumption between 2000 and 2015. Proc Natl Acad Sci U S A. 2018;115(15):E3463–70. pmid:29581252
  7. 7. Center for Disease Dynamics, Economics and Policy, Global Antibiotic Resistance Partnership. The state of the world’s antibiotics 2015. Washington (DC): Center for Disease Dynamics, Economics and Policy; 2015 [cited 2020 May 13]. Available from: https://www.cddep.org/wp-content/uploads/2017/06/swa_executive_summary_edits_2016.pdf.
  8. 8. Auta A, Hadi MA, Oga E, Adewuyi EO, Abdu-Aguye SN, Adeloye D, et al. Global access to antibiotics without prescription in community pharmacies: a systematic review and meta-analysis. J Infect. 2019;78(1):8–18. pmid:29981773
  9. 9. Machowska A, Stalsby Lundborg C. Drivers of irrational use of antibiotics in Europe. Int J Environ Res Public Health. 2018;16(1):27. pmid:30583571
  10. 10. Chua KP, Fischer MA, Linder JA. Appropriateness of outpatient antibiotic prescribing among privately insured US patients: ICD-10-CM based cross sectional study. BMJ. 2019;364:k5092. pmid:30651273
  11. 11. Versporten A, Zarb P, Caniaux I, Gros MF, Drapier N, Miller M, et al. Antimicrobial consumption and resistance in adult hospital inpatients in 53 countries: results of an internet-based global point prevalence survey. Lancet Glob Health. 2018;6(6):e619–29. pmid:29681513
  12. 12. Kardas P, Devine S, Golembesky A, Roberts C. A systematic review and meta-analysis of misuse of antibiotic therapies in the community. Int J Antimicrob Agents. 2005;26(2):106–13. pmid:16009535
  13. 13. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1. pmid:25554246
  14. 14. Beall’s list of potential predatory journals and publishers: Potential predatory scholarly open-access journals. beallslist.net; 2019 [cited 2020 May 13] Available from: https://beallslist.net/standalone-journals/.
  15. 15. WHO Collaborating Centre for Drug Statistics Methodology. Anatomical Therapeutic Chemical (ATC) classification system 2019. Oslo: WHO Collaborating Centre for Drug Statistics Methodology; 2019.
  16. 16. World Bank. World Bank country and lending groups. Washington (DC): World Bank; 2020 [cited 2020 May 13]. Available from: https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.
  17. 17. Uchida H, Nelson A. Agglomeration index: towards a new measure of urban concentration. Working Paper No. 2010/29. Helsinki: World Institute for Development Economics Research; 2010 [cited 2020 May 13]. Available from: https://www.wider.unu.edu/sites/default/files/wp2010-29.pdf.
  18. 18. Hoy D, Brooks P, Woolf A, Blyth F, March L, Bain C, et al. Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement. J Clin Epidemiol. 2012;65(9):934–9. pmid:22742910
  19. 19. Hunter JP, Saratzis A, Sutton AJ, Boucher RH, Sayers RD, Bown MJ. In meta-analyses of proportion studies, funnel plots were found to be an inaccurate method of assessing publication bias. J Clin Epidemiol. 2014;67(8):897–903. pmid:24794697
  20. 20. Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26(4):404–13.
  21. 21. Sharland M, Gandra S, Huttner B, Moja L, Pulcini C, Zeng M, et al. Encouraging AWaRe-ness and discouraging inappropriate antibiotic use-the new 2019 Essential Medicines List becomes a global antibiotic stewardship tool. Lancet Infect Dis. 2019;19(12):1278–80. pmid:31782385
  22. 22. Barendregt JJ, Doi SA, Lee YY, Norman RE, Vos T. Meta-analysis of prevalence. J Epidemiol Community Health. 2013;67(11):974–8. pmid:23963506
  23. 23. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. pmid:12958120
  24. 24. IntHout J, Ioannidis JP, Rovers MM, Goeman JJ. Plea for routinely presenting prediction intervals in meta-analysis. BMJ Open. 2016;6(7):e010247. pmid:27406637
  25. 25. Nyaga VN, Arbyn M, Aerts M. Metaprop: a Stata command to perform meta-analysis of binomial data. Arch Public Health. 2014;72(1):39. pmid:25810908
  26. 26. Harbord RM, Higgins JPT. Meta-regression in Stata. Stata J. 2008;8(4):493–519.
  27. 27. Mukonzo JK, Namuwenge PM, Okure G, Mwesige B, Namusisi OK, Mukanga D. Over-the-counter suboptimal dispensing of antibiotics in Uganda. J Multidiscip Healthc. 2013;6:303–10. pmid:23990728
  28. 28. Savadogo LGB, Ilboudo B, Kinda M, Boubacar N, Hennart P, Dramaix M, et al. Antibiotics prescribed to febrile under-five children outpatients in urban public health services in Burkina Faso. Health. 2014;6(2):165–70.
  29. 29. Worku F, Tewahido D. Retrospective assessment of antibiotics prescribing at public primary healthcare facilities in Addis Ababa, Ethiopia. Interdiscip Perspect Infect Dis. 2018;2018:4323769. pmid:29681933
  30. 30. Yebyo H, Medhanyie AA, Spigt M, Hopstaken R. C-reactive protein point-of-care testing and antibiotic prescribing for acute respiratory tract infections in rural primary health centres of North Ethiopia: a cross-sectional study. NPJ Prim Care Respir Med. 2016;26:15076. pmid:26769226
  31. 31. Abdulah R, Insani WN, Putri NE, Purba HP, Destiani DP, Barliana MI. Pattern of medication use in geriatric patients at primary health care facilities in Karawang, Indonesia. Drug Healthc Patient Saf. 2019;11:1–5. pmid:30799958
  32. 32. Adisa R, Fakeye TO, Aindero VO. Evaluation of prescription pattern and patients’ opinion on healthcare practices in selected primary healthcare facilities in Ibadan, South-Western Nigeria. Afr Health Sci. 2015;15(4):1318–29. pmid:26958037
  33. 33. Ahiabu MA, Tersbol BP, Biritwum R, Bygbjerg IC, Magnussen P. A retrospective audit of antibiotic prescriptions in primary health-care facilities in Eastern Region, Ghana. Health Policy Plan. 2016;31(2):250–8. pmid:26045328
  34. 34. Akl OA, El Mahalli AA, Elkahky AA, Salem AM. WHO/INRUD drug use indicators at primary healthcare centers in Alexandria, Egypt. J Taibah Univ Med Sci. 2014;9(1):54–64.
  35. 35. Atif M, Sarwar MR, Azeem M, Naz M, Amir S, Nazir K. Assessment of core drug use indicators using WHO/INRUD methodology at primary healthcare centers in Bahawalpur, Pakistan. BMC Health Serv Res. 2016;16(1):684. pmid:27931213
  36. 36. Beri SG, Pandit VA, Khade KS, Sarda KD. The pattern of drug use in acute fever by general practitioners (GPs) in Pune City, India. J Clin Diagn Res. 2013;7(3):467–72. pmid:23634398
  37. 37. Chem ED, Anong DN, Akoachere JKT. Prescribing patterns and associated factors of antibiotic prescription in primary health care facilities of Kumbo East and Kumbo West Health Districts, North West Cameroon. PLoS ONE. 2018;13(3):e0193353. pmid:29505584
  38. 38. El Mahalli AA, Akl OA. Effect of adopting integrated management of childhood illness guidelines on drug use at a primary health care center: a case study from Egypt. J Family Community Med. 2011;18(3):118–23. pmid:22175038
  39. 39. Graham K, Sinyangwe C, Nicholas S, King R, Mukupa S, Kallander K, et al. Rational use of antibiotics by community health workers and caregivers for children with suspected pneumonia in Zambia: a cross-sectional mixed methods study. BMC Public Health. 2016;16:897. pmid:27567604
  40. 40. Jose J, Devassykutty D. Paediatric prescription analysis in a primary health care institution. J Clin Diagn Res. 2016;10(11):FC05–8. pmid:28050392
  41. 41. Kasabi GS, Thilakavathi S, Allam RR, Grace CA, Shivanna R, Murhekar MV. Prescription practices & use of essential medicines in the primary health care system, Shimoga district, Karnataka, India. Indian J Med Res. 2015;142(2):216–9. pmid:26354220
  42. 42. Ndhlovu M, Nkhama E, Miller JM, Hamer DH. Antibiotic prescribing practices for patients with fever in the transition from presumptive treatment of malaria to ‘confirm and treat’ in Zambia: a cross-sectional study. Trop Med Int Health. 2015;20(12):1696–706. pmid:26311240
  43. 43. Omole VN, Joshua IA, Muhammad-Idris ZK, Usman NO, Ahmad IA. Use of injections and antibiotics and profile of health workers in rural primary health care facilities in north-western Nigeria. Int J Med Health Dev. 2018;23(1):183–8.
  44. 44. Oyeyemi AS, Ogunleye OA. Rational use of medicines: assessing progress using primary health centres in Shomolu local government area of Lagos, Nigeria. West Afr J Med. 2013;32(2):121–5. pmid:23913500
  45. 45. Raza UA, Khursheed T, Irfan M, Abbas M, Irfan UM. Prescription patterns of general practitioners in Peshawar, Pakistan. Pak J Med Sci. 2014;30(3):462–5. pmid:24948959
  46. 46. Sarwar MR, Saqib A, Iftikhar S, Sadiq T. Antimicrobial use by WHO methodology at primary health care centers: a cross sectional study in Punjab, Pakistan. BMC Infect Dis. 2018;18(1):492. pmid:30268106
  47. 47. Saurabh MK, Biswas NK, Yadav AK, Singhai A, Saurabh A. Study of prescribing habits and assessment of rational use of drugs among doctors of primary health care facilities. Asian J Pharm Clin Res. 2011;4(4):102–5.
  48. 48. Saweri OPM, Hetzel MW, Mueller I, Siba PM, Pulford J. The treatment of non-malarial febrile illness in Papua New Guinea: findings from cross sectional and longitudinal studies of health worker practice. BMC Health Serv Res. 2017;17(1):10. pmid:28056949
  49. 49. Sudarsan M, Sitikantha B, Aparajita D. Audit and quality assessment of prescriptions in an urban health centre of Kolkata. Int J Med Public Health. 2016;6(3):136–9.
  50. 50. Yousif BM, Supakankunti S. General practitioners’ prescribing patterns at primary healthcare centers in national health insurance, Gezira, Sudan. Drugs Real World Outcomes. 2016;3(3):327–32. pmid:27747832
  51. 51. Yuniar CT, Anggadiredja K, Islamiyah AN. Evaluation of rational drug use for acute pharyngitis associated with the incidence and prevalence of the disease at two community health centers in Indonesia. Sci Pharm. 2017;85(2):22. pmid:28452967
  52. 52. Ahmadi F, Zarei E. Prescribing patterns of rural family physicians: a study in Kermanshah Province, Iran. BMC Public Health. 2017;17(1):908. pmid:29183293
  53. 53. Alabid AH, Ibrahim MI, Hassali MA. Antibiotics dispensing for urtis by community pharmacists (CPs) and general medical practitioners in Penang, Malaysia: a comparative study using simulated patients (SPs). J Clin Diagn Res. 2014;8(1):119–23. pmid:24596741
  54. 54. Bielsa-Fernandez MV, Frati-Munari AC, Ariza-Andraca R. Treatment to patients with acute diarrhea: survey to a group of general practitioners from Mexico. Atencion Familiar. 2016;23(4):119–24.
  55. 55. Gasson J, Blockman M, Willems B. Antibiotic prescribing practice and adherence to guidelines in primary care in the Cape Town Metro District, South Africa. S Afr Med J. 2018;108(4):304–10. pmid:29629681
  56. 56. Greer RC, Intralawan D, Mukaka M, Wannapinij P, Day NPJ, Nedsuwan S, et al. Retrospective review of the management of acute infections and the indications for antibiotic prescription in primary care in northern Thailand. BMJ Open. 2018;8(7):e022250. pmid:30061442
  57. 57. Lima MG, Dutra KR, Martins UCM. Prescribing indicators in primary health care in Belo Horizonte, Brazil: associated factors. Int J Clin Pharm. 2017;39(4):913–8. pmid:28626850
  58. 58. Mashalla Y, Setlhare V, Massele A, Sepako E, Tiroyakgosi C, Kgatlwane J, et al. Assessment of prescribing practices at the primary healthcare facilities in Botswana with an emphasis on antibiotics: findings and implications. Int J Clin Pract. 2017;71(12). pmid:29178350
  59. 59. Ab Rahman N, Teng CL, Sivasampu S. Antibiotic prescribing in public and private practice: a cross-sectional study in primary care clinics in Malaysia. BMC Infect Dis. 2016;16:208. pmid:27188538
  60. 60. Sadeghian GH, Safaeian L, Mahdanian AR, Salami S, Kebriaee-Zadeh J. Prescribing quality in medical specialists in Isfahan, Iran. Iran J Pharm Res. 2013;12(1):235–41. pmid:24250595
  61. 61. Safaeian L, Mahdanian AR, Salami S, Pakmehr F, Mansourian M. Seasonality and physician-related factors associated with antibiotic prescribing: a cross-sectional study in Isfahan, Iran. Int J Prev Med. 2015;6:1. pmid:25789136
  62. 62. Sánchez Choez X, Armijos Acurio ML, Jimbo Sotomayor RE. Appropriateness and adequacy of antibiotic prescription for upper respiratory tract infections in ambulatory health care centers in Ecuador. BMC Pharmacol Toxicol. 2018;19(1):46. pmid:30049281
  63. 63. Sun Q, Dyar OJ, Zhao L, Tomson G, Nilsson LE, Grape M, et al. Overuse of antibiotics for the common cold—attitudes and behaviors among doctors in rural areas of Shandong Province, China. BMC Pharmacol Toxicol. 2015;16:6. pmid:25884702
  64. 64. Wang J, Wang P, Wang X, Zheng Y, Xiao Y. Use and prescription of antibiotics in primary health care settings in China. JAMA Intern Med. 2014;174(12):1914–20. pmid:25285394
  65. 65. Xue H, Shi Y, Huang L, Yi H, Zhou H, Zhou C, et al. Diagnostic ability and inappropriate antibiotic prescriptions: a quasi-experimental study of primary care providers in rural China. J Antimicrob Chemother. 2019;74(1):256–63. pmid:30285113
  66. 66. Yin X, Gong Y, Yang C, Tu X, Liu W, Cao S, et al. A comparison of quality of community health services between public and private community health centers in urban China. Med Care. 2015;53(10):888–93. pmid:26366520
  67. 67. Zhang Z, Hu Y, Zou G, Lin M, Zeng J, Deng S, et al. Antibiotic prescribing for upper respiratory infections among children in rural China: a cross-sectional study of outpatient prescriptions. Glob Health Action. 2017;10(1):1287334. pmid:28462635
  68. 68. Baltzell K, Kortz TB, Scarr E, Blair A, Mguntha A, Bandawe G, et al. ‘Not all fevers are malaria’: a mixed methods study of non-malarial fever management in rural southern Malawi. Rural Remote Health. 2019;19(2):4818. pmid:31200600
  69. 69. Zhan Q, Wang YL, Chen X. Evaluation of antibacterial use in outpatients of township and community primary medical institutions in a district of Sichuan Province, China. J Glob Antimicrob Resist. 2019;19:201–6. pmid:31077858
  70. 70. Kjærgaard J, Anastasaki M, Stubbe Østergaard M, Isaeva E, Akylbekov A, Nguyen NQ, et al. Diagnosis and treatment of acute respiratory illness in children under five in primary care in low-, middle-, and high-income countries: a descriptive FRESH AIR study. PLoS ONE. 2019;14(11):e0221389. pmid:31693667
  71. 71. Liu C, Wang D, Zhang X. Intrinsic and external determinants of antibiotic prescribing: a multi-level path analysis of primary care prescriptions in Hubei, China. Antimicrob Resist Infect Control. 2019;8:132. pmid:31406571
  72. 72. Mekuria LA, de Wit TF, Spieker N, Koech R, Nyarango R, Ndwiga S, et al. Analyzing data from the digital healthcare exchange platform for surveillance of antibiotic prescriptions in primary care in urban Kenya: a mixed-methods study. PLoS ONE. 2019;14(9):e0222651. pmid:31557170
  73. 73. Nepal A, Hendrie D, Robinson S, Selvey LA. Analysis of patterns of antibiotic prescribing in public health facilities in Nepal. J Infect Dev Ctries. 2020;14(1):18–27. pmid:32088680
  74. 74. Yin J, Dyar OJ, Yang P, Yang D, Marrone G, Sun M, et al. Pattern of antibiotic prescribing and factors associated with it in eight village clinics in rural Shandong Province, China: a descriptive study. Trans R Soc Trop Med Hyg. 2019;113(11):714–21. pmid:31294806
  75. 75. Kwan A, Daniels B, Saria V, Satyanarayana S, Subbaraman R, McDowell A, et al. Variations in the quality of tuberculosis care in urban India: a cross-sectional, standardized patient study in two cities. PLoS Med. 2018;15(9):e1002653. pmid:30252849
  76. 76. Leonard K, Masatu MC. Outpatient process quality evaluation and the Hawthorne effect. Soc Sci Med. 2006;63(9):2330–40. pmid:16887245
  77. 77. Leonard KL, Masatu MC. The use of direct clinician observation and vignettes for health services quality evaluation in developing countries. Soc Sci Med. 2005;61(9):1944–51. pmid:15936863
  78. 78. Using indicators to measure country pharmaceutical situations. Fact book on WHO Level I and Level II monitoring indicators. Geneva: World Health Organization; 2006 [cited 2020 May 13]. Available from: https://www.who.int/medicines/publications/WHOTCM2006.2A.pdf.
  79. 79. Hsia Y, Sharland M, Jackson C, Wong ICK, Magrini N, Bielicki JA. Consumption of oral antibiotic formulations for young children according to the WHO Access, Watch, Reserve (AWaRe) antibiotic groups: an analysis of sales data from 70 middle-income and high-income countries. Lancet Infect Dis. 2019;19(1):67–75. pmid:30522834
  80. 80. Thompson W, Tonkin-Crine S, Pavitt SH, McEachan RRC, Douglas GVA, Aggarwal VR, et al. Factors associated with antibiotic prescribing for adults with acute conditions: an umbrella review across primary care and a systematic review focusing on primary dental care. J Antimicrob Chemother. 2019;74(8):2139–52. pmid:31002336
  81. 81. Dolk FCK, Pouwels KB, Smith DRM, Robotham JV, Smieszek T. Antibiotics in primary care in England: which antibiotics are prescribed and for which conditions? J Antimicrob Chemother. 2018;73(Suppl. 2):ii2–10. pmid:29490062
  82. 82. Kohli M, Sen P, Pai M. Improving access to essential tests for infectious diseases. Microbes Infect. 2019;21(1):1–3. pmid:30217736
  83. 83. Pulcini C ESGAP AMOXDOSE working group. Amoxicillin dosing recommendations are very different in European countries: a cross-sectional survey. Clin Microbiol Infect. 2017;23(6):414–5. pmid:27890458
  84. 84. World Health Organization. Executive summary: the selection and use of essential medicines 2019. Report of the 22nd WHO Expert Committee on the Selection and Use of Essential Medicines. Geneva: World Health Organization; 2019 [cited 2020 May 13]. Available from: https://apps.who.int/iris/bitstream/handle/10665/325773/WHO-MVP-EMP-IAU-2019.05-eng.pdf?sequence=1&isAllowed=y.
  85. 85. Spivak ES, Cosgrove SE, Srinivasan A. Measuring appropriate antimicrobial use: attempts at opening the black box. Clin Infect Dis. 2016;63(12):1639–44. pmid:27682070
  86. 86. GBD 2017 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392(10159):1789–858. pmid:30496104
  87. 87. World Health Organization. Global Antimicrobial Resistance Surveillance System (GLASS) report: early implementation 2016–2017. Geneva: World Health Organization; 2017 [cited 2020 May 13]. Available from: https://apps.who.int/iris/bitstream/handle/10665/259744/9789241513449-eng.pdf?sequence=1.