Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Factors contributing to racial disparities in influenza vaccinations

  • Suma Vupputuri ,

    Contributed equally to this work with: Suma Vupputuri, Kevin B. Rubenstein, Alphonse J. Derus

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    suma.vupputuri@kp.org

    Affiliation Mid-Atlantic Permanente Research Institute, Mid-Atlantic Permanente Medical Group, Kaiser Permanente Mid-Atlantic States, Rockville, Maryland, United States of America

  • Kevin B. Rubenstein ,

    Contributed equally to this work with: Suma Vupputuri, Kevin B. Rubenstein, Alphonse J. Derus

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – review & editing

    Affiliation Mid-Atlantic Permanente Research Institute, Mid-Atlantic Permanente Medical Group, Kaiser Permanente Mid-Atlantic States, Rockville, Maryland, United States of America

  • Alphonse J. Derus ,

    Contributed equally to this work with: Suma Vupputuri, Kevin B. Rubenstein, Alphonse J. Derus

    Roles Data curation, Formal analysis, Methodology, Writing – review & editing

    Affiliation Mid-Atlantic Permanente Research Institute, Mid-Atlantic Permanente Medical Group, Kaiser Permanente Mid-Atlantic States, Rockville, Maryland, United States of America

  • Bernadette C. Loftus ,

    Roles Conceptualization, Methodology, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Mid-Atlantic Permanente Medical Group, Kaiser Permanente Mid-Atlantic States, Rockville, Maryland, United States of America

  • Michael A. Horberg

    Roles Conceptualization, Methodology, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Mid-Atlantic Permanente Research Institute, Mid-Atlantic Permanente Medical Group, Kaiser Permanente Mid-Atlantic States, Rockville, Maryland, United States of America

Abstract

Background

Racial/ethnic disparities in rates of influenza vaccinations in the US remain an issue even among those with access, no out-of-pocket costs, and after adjusting for confounders. We used an approach called the Oaxaca-Blinder (OB) decomposition method to ascertain the contribution of covariates individually and in aggregate to the racial disparity in influenza vaccination.

Methods

We included members > = 18 years of age as of 05/01/2014 with continuous enrollment through 04/30/2015. Influenza vaccination was defined by diagnosis, procedure, or medication codes, or documentation in the immunization table. Characteristics were reported by race. Logistic regression models estimated the odds of vaccination associated with: (1) race; and (2) covariates stratified by race. The Oaxaca-Blinder (OB) method calculated the contribution of covariates to the difference or disparity in vaccination between Blacks and Whites.

Results

We found that among adults, 44% were vaccinated; 55% were Black; and 45% were White. Black members have 42% lower odds of vaccination than White members. The contribution of the differences in the average value of the study covariates between Black and White members (the OB covariate effect) accounted for 29% of the racial disparity. The contributions to the total White-Black disparity in vaccination included: age (16%), neighborhood median income (11%), and registration on the online patient portal (13%). The contribution of the differences in how the covariates impact vaccination (OB coefficient effect) accounted for 71% of the disparity in vaccination between Blacks and Whites.

Conclusion

In conclusion, equalizing average covariate values in Blacks and Whites could reduce the racial disparity in influenza vaccination by 29%. For health system vaccine campaigns, improving registration on the patient portal may be a target component of an effective system-level strategy to reduce racial disparities in vaccination. Additional information on patient-centered factors could further improve the value of the OB approach.

Introduction

Influenza spreads in a yearly outbreak, resulting in three to five million cases of severe illness and about 250,000 to 500,000 deaths globally [1], and an annual average of 41,400 deaths in the U.S. [2] Influenza occurs with an annual attack rate of 5%–10% in adults [1, 3] and can result in hospitalization and death mainly among high-risk groups such as older persons, young children, persons with certain health conditions, and pregnant women [4]. Safe and effective influenza vaccines are widely available and have been used for more than 60 years.[5] [6]

Influenza vaccination coverage in the U.S. was 47.1% in 2014 and was lower among Blacks (43.8%) than Whites (48.5%).[7] Racial/ethnic disparities in rates of influenza vaccinations in the US remain an issue even among those with no out-of-pocket costs for the vaccination and after adjusting for confounders such as sociodemographic characteristics, health status, insurance, access, and geographic region.[813] Until recently, racial disparities in health outcomes or preventive services such as vaccinations have been assessed in relatively simple terms: (1) examining the rate of influenza vaccination in Blacks compared to Whites; or (2) assessing, in an etiologic model, the statistical significance and magnitude of the race term. When we do find a gap between Whites and Blacks in influenza vaccination, the question follows: how much of that gap can be explained by observable characteristics? An approach called the Oaxaca-Blinder decomposition method was developed to address this question. [14, 15]

Kaiser Permanente Mid-Atlantic States (KPMAS) is a group-model health maintenance organization that provides comprehensive, pre-paid health care to approximately 750,000 members in Maryland, Virginia, and the District of Columbia. KPMAS is composed of the Kaiser Foundation Health Plan and the Permanente Medical Group, a multi-specialty group practice that provides health care for members of the health plan. KPMAS has made annual influenza vaccination a priority initiative to prevent illness with a vaccination program consisting of no-referral flu vaccination clinics in all medical centers from September through late December; no copays; and a widespread education campaign. Despite these efforts, racial disparities in vaccination at KPMAS persist. In the era of “Learning Health Systems” (i.e. systems where internal data and scientific evidence are systematically integrated within system culture in order to use that knowledge for improving practice), the Oaxaca-Blinder methodology will specifically identify factors that demonstrate a strong contribution to racial disparities in influenza vaccinations in order to target these factors operationally. We aim to provide evidence and guidance to health systems on where to put resources and efforts to potentially reduce the disparity in influenza vaccination.

The purpose of this study was to examine whether the difference in the proportion of patients vaccinated at Kaiser Permanente Mid-Atlantic States (KPMAS) between Whites and Blacks (ie. the racial disparity) can be explained by the distribution and the impact of a comprehensive list of pre-specified covariates. In order to do this, we will assess: the distribution of covariates by race; the odds of vaccination associated with the covariates stratified by race; and finally, the meaningful contribution of the covariates; and the effects of those covariates on the racial disparity in influenza vaccination.

Methods

Data source

The study was conducted at Kaiser Permanente Mid-Atlantic States (KPMAS), an integrated health care delivery system that maintains comprehensive electronic medical records (EMRs). We used data from May 1, 2014 to April 30, 2015.

Study population

We included members who identified as White or Black (either African-American or African immigrant), were 18 years of age or older on May 1, 2014, and who had continuous enrollment (allowing for 60-day gaps) between May 1, 2014 –April 30, 2015. A total of 236,511 KPMAS members met the inclusion and exclusion criteria. There were missing data for certain covariates including smoking status (17.3% missing) and provider race (5.3% missing). Neither smoking status nor provider race demonstrated differential missingness by patient race. However, most of the other covariates were missing at rates less than 1%. Overall, we included 184,745 patients in the regression analyses.

Study variables

Race was defined by self-reported identification to a category of race. Our outcome was influenza vaccination, a dichotomous variable (yes/no) indicating influenza vaccination during the study period. The proportion vaccinated was calculated as the number of patients who received the vaccine divided by the total population at risk during the study period. Patients who self-reported flu vaccination outside of KPMAS were also included as vaccinated.

Data obtained from the EMR included demographics (age at the beginning of the study period, gender, race, service area); comorbidities (Charlson Comorbidity Index [CCI] [16]); health system information (distance to their KPMAS Medical Center); and behavioral factors (current cigarette smoker and being registered on “KP.org”—an online portal available to all KPMAS members where, if registered, they can access their medical record, appointments, and health education, including detailed information on influenza vaccinations). Demographic data at the neighborhood level were obtained by using patients’ geocoded addresses which were matched to census data at the block group level (neighborhood median household income). We used neighborhood-level median household income as a proxy for individual-level income. Charlson Comorbidity Index (CCI) was calculated to assess burden of comorbidities.[16] Finally, provider data was used to determine the race of patients’ primary care providers to examine discordant patient/provider race as a covariate.

Statistical analysis

Summary statistics of the characteristics of the study population, including influenza vaccination status, were reported by race. P-values for the association between categorical variables with race and continuous variables with race were calculated using Pearson's Chi-squared [17, 18] and Welch's T-Tests [1921], respectively. Logistic regression models assessed the odds of influenza vaccination associated with White and Black race, adjusting for a priori-specified covariates. This model determined the evidence for a racial disparity in influenza vaccination.

We then used an extension of the Oaxaca-Blinder (OB) decomposition method [14, 15, 22] for logistic models to calculate the contribution of the covariates described above to the disparity in vaccination by race. The OB method allows the assessment of the difference or disparity between two groups to be partitioned into both differences in observable characteristics/covariates, and the difference in the effects of those characteristics across groups. We want to establish not only that a disparity exists, but also quantify the extent that certain pre-specified covariates contribute to the disparity. The OB method was developed to study the gender wage gap. It enabled the authors to estimate the proportion of the wage gap attributable to differences in education, work experience, or other relevant characteristics, as well as the proportion that cannot be accounted for by these variables. This remaining proportion may be attributed to gender discrimination or unobserved predictors of wages.

To conduct the OB analysis of the disparity in vaccination rates, we used coefficients from logistic regression models stratified by race as well as average covariate values within each race to decompose the racial disparity into a covariate effect (the effect of differences in the average value of all covariates between the Black and White groups on vaccination), and the coefficient effect (the effect of differing impact of the covariates on vaccination between the Black group and the White group). We then estimated the relative contribution of each of the covariates to: (1) the covariate effect; (2) the coefficient effect; and (3) the total racial disparity. In other words, we are determining how differences in observable characteristics between the White and Black groups contribute to the overall racial difference in vaccination rates, and we are also determining how differences in the effects of those characteristics on vaccination between White and Black groups contribute to the overall racial difference in vaccination rates. It is important to note that these contributors to the racial difference/disparity may contribute via exacerbating the racial disparity or, alternately, reducing the racial disparity. (A description of a hypothetical counterfactual population and an informative example is given in S1 Text).

Data extraction and quality control were performed using SAS software (version 9.4; SAS Institute, Cary, NC). Descriptive statistics and logistic regression models were computed using R software (R version 3.1.1, Core Team 2013, Vienna, Austria). The Oaxaca-Blinder decomposition for logistic models was computed using the oaxaca command with the logit option in Stata (Release 14, StataCorp LP 2015, College Station, TX) [23].

This study was approved by the Institutional Review Board (IRB) at Kaiser Permanente Mid-Atlantic States. We received a waiver for consent from the IRB because this was a retrospective data-only study and the data were analyzed anonymously.

Results

Patient characteristics

There were 236,511 KPMAS members between May 1, 2014 and April 30, 2015 who were included in our analysis. Fig 1 shows the geographic distribution of influenza vaccinations in the four main areas served by KPMAS by race. In every service area and virtually every county, Blacks had a lower rate of vaccination than Whites. Service areas at KPMAS are administratively and geographically defined, thus, in order to provide context for results and estimates related to service area we have included a Supplemental table describing the characteristics of the 3 service areas.

thumbnail
Fig 1. Geographic distribution of the influenza vaccination at KPMAS by race, 2014–2015.

https://doi.org/10.1371/journal.pone.0213972.g001

Overall, our study included 129,517 (55%) Black and 106,994 (45%) White patients. The differences in characteristics/covariates between Whites and Blacks are reported in Table 1. Of Blacks, 36% were vaccinated, and of Whites, 53% were vaccinated. All of the White-Black differences were significant. These racial differences in characteristics are the key estimates to inform the covariate effects for the OB analysis presented later.

thumbnail
Table 1. Characteristics of KPMAS members between 5/1/14 and 4/30/15, by race.

https://doi.org/10.1371/journal.pone.0213972.t001

Odds of influenza vaccination

The race-adjusted logistic regression model estimating the odds of influenza vaccination associated with select characteristics are given in Table 2. Black members had 43% lower odds of receiving the influenza vaccination compared to White members. All of the covariates listed in Table 2, with the exception of living in DC service area, were statistically significant in terms of their association with influenza vaccination after accounting for race. Fully adjusted race-stratified logistic regression models for the odds of influenza vaccination are given in Table 3 to describe the differences in effects of characteristics between Blacks and Whites. For example, the higher odds of vaccination associated with older age and being registered on KP.org was stronger among Whites versus Blacks. The differences in the effect of characteristics on influenza vaccination between Whites and Blacks are the key estimates to inform the coefficient effects for the OB analysis presented later in Table 4.

thumbnail
Table 2. Race-Adjusted Odds (95% confidence interval [CI]) of Influenza Vaccination.

https://doi.org/10.1371/journal.pone.0213972.t002

thumbnail
Table 3. Odds Ratios (95% confidence interval [CI]) for Influenza Vaccination stratified by Black and White KPMAS patients.

https://doi.org/10.1371/journal.pone.0213972.t003

thumbnail
Table 4. Oaxaca-Blinder decomposition analysis for the racial disparity in influenza vaccination between Black and White* KPMAS patients.

https://doi.org/10.1371/journal.pone.0213972.t004

Oaxaca-Blinder decomposition method

Table 4 shows the results of the Oaxaca-Blinder decomposition analysis for the disparity in the probability of influenza vaccination between Blacks and Whites. In Panel A of Table 4, the overall decomposition of the disparity is shown, where the aggregated effect of the average values of the study covariates (the covariate effect) accounted for 29% of the total disparity; and the coefficient effect accounted for 71% of the total overall disparity in vaccination between Blacks and Whites. These results indicate that the racial disparity in vaccination could be reduced by 29% if the Black population becomes similar to the White population with respect to all of the average covariate values in the model. The remainder of the disparity (71%) is due to: the difference in the impact of the covariates on influenza vaccination (the coefficient effect), and/or covariates not included in the model, and/or non-linear terms not included in the model.

Covariate effects

In Panel B of Table 4, the estimated covariate effects of each individual covariate on the probability of vaccination are reported, as well as their estimated contributions to the overall disparity in vaccination rates between Black and White members. Earlier in Table 1, we showed the White-Black difference in the proportion of members who were registered on KP.org (Black = 64% and White = 82%). With the OB analysis we are able to say that 12.5% of the total White-Black disparity in vaccinations can be attributed to the difference in registration on KP.org between Blacks and Whites (Table 4).

Conversely, the White-Black difference in the proportion of members living in Suburban Maryland (Black = 55% and White = 24% in Table 1) contributed to reducing the total White-Black disparity in vaccination by 6.0% (Table 4). Living in Suburban Maryland, though, is not a modifiable variable, therefore interpreting the meaning of the specific estimate in the context of this current OB analysis may not be practical.

Among all the covariates in Table 4, age had the largest contribution to the total White-Black disparity in vaccination, accounting for 16% of the disparity. However, age is also a non-modifiable variable. Other covariates with sizable contributions to the total White-Black disparity in vaccination were registration on kp.org, the patient website portal, (with a 13% share) and neighborhood median income (with an 11% share).

Coefficient effects

In Panel C of Table 4, the coefficient effects on the vaccination probabilities are reported. These are the detailed decomposition of the disparity contributed by the differences in each of the estimated coefficients (i.e. odds ratios) in the logistic regression models summarized in Table 3. The estimated odds ratios of receiving vaccination associated with registering on KP.org vs. not registering on KP.org were OR = 1.79 in Whites and OR = 1.46 in Blacks (Table 3). The effect of being registered on KP.org contributed to a 17% share of the total White-Black disparity in vaccination (Table 4). In other words, the effect of being registered on KP.org on influenza vaccination is different for Blacks compared to Whites.

Among all the coefficient effects in Table 4, age, registration on KP.org, living in Suburban Maryland, and neighborhood median household income had the most sizable contributions to exacerbating the total White-Black differences/disparity in vaccination, accounting for 29%, 17%, 16%, and 12%. The constant (or intercept) contributed a 31% share of the total White-Black disparity in vaccination. The share of the constant term demonstrates that 31% of the racial disparity in vaccination was not explained by the observed covariates included in the stratified regression model.

We also conducted a sensitivity analysis where we added health care utilization variables to our models (including in-patient, out-patient, emergency department, and PCP visits). The resulting estimates with the utilization variables demonstrated that the overall covariate effects explain 35% of the total disparity rather than 29% when excluding the utilization variables. The covariate and coefficient effects of the individual variables were largely consistent. The greatest difference is that the proportion of the total disparity attributed to the coefficient effect of the intercept increased from 31% to 50%. This is largely due to the 24% decrease in the total disparity attributed to the coefficient effect of PCP visit that was included. All other differences in individual covariate or coefficient effects changed by less than 5% of the total disparity.

Discussion

In our study of 236,511 adult, KPMAS members, 44% received the influenza vaccine between May 1, 2014 and April 30, 2015. Black members had 42% lower odds of receiving an influenza vaccination than White members. Covariates (including smoking, being registered on KP.org, and discordance of patient-provider race) had a differential effect on vaccination based on race. However, the aggregated effect of the differences in the average values of the study covariates accounted for only 29% of the total White-Black disparity. The remaining 71% of the White-Black disparity was due to the differential impact of the covariates on vaccination as well as the effect of unmeasured covariates. In other words, the disparity in influenza vaccination between Black and White KPMAS members could, at most, be reduced by 29% if all of the average covariate values in Blacks became equivalent to those of White members. We identified certain modifiable variables that could be acted upon to reduce the White-Black disparity in vaccination at KPMAS such as registration on KP.org as a possibly effective system target to reduce the racial disparity in vaccination at KPMAS. However, also understanding how covariates with differential impacts on influenza vaccination by race (the coefficient effect) contribute to racial disparities in vaccination is important to provide information to better understand the mechanisms through which the racial disparities operate (even though these effects cannot be acted on directly).

Yoo et al., were the first to apply the Oaxaca-Blinder decomposition method to assess racial/ethnic disparities in influenza vaccination rates. In their formative paper, they used the Medicare Current Beneficiary Survey (MCBS) to assess the relative contribution of a selection of covariates. They applied the Oaxaca-Blinder decomposition method to assess the relative contribution of various covariates available in the MCBS data. In our study, we followed the same methodology to assess the contribution of covariates that were available in the KPMAS electronic medical records. Our population included patients aged 18–105 (mean age = 50 years) and our data included several additional covariates that were not included in Yoo et al.’s study, including distance to medical center, Charlson comorbidity index, registration on a patient portal website, smoking, and patient-provider race discordance. Of these, only being registered on the patient portal website contributed a sizable proportion of the total racial disparity in influenza vaccinations. Yoo et al. found that 42% of the disparity in influenza vaccination between Black and White persons could be eliminated by equalizing the average values of the covariates in their regression model, while we found 29%. This difference in estimates is likely attributed to the difference in populations (eg. Medicare beneficiaries versus patients of wide ranging ages) and the type of data that was used (survey data versus real-world EMR data). Similar to Yoo et al., we found that much of the White-Black disparity in vaccination could be attributed to social demographic factors like income. We additionally found factors such as age and being registered on KP.org made significant contributions to the disparity.

As pointed out by Yoo and others [913], many previous studies identified racial disparities in influenza vaccinations. However, knowing which specific modifiable factors are sizable contributors to the racial disparity is especially meaningful for health care management and quality programs that aim to implement strategies to reduce disparities (especially at the health system level). Prioritizing factors that may have the biggest impact on the disparities will allow health systems to target resources efficiently and effectively. Our study indicates that one strategy to address racial disparities in vaccination at KPMAS would be to encourage Black members to utilize KP’s patient portal website. Further, our study showed that the effect of KP.org on vaccination was different for Blacks and Whites suggesting that perhaps the way the information is presented is not resonating with Blacks as it is with Whites.

The coefficient effects, because they estimate the differential impact of covariates on influenza vaccination rates by race, are considered to contribute to the unexplained gap between Blacks and Whites. However, they provide clues as to what might be contributing to the unexplained gap and allow us to make conjectures about these factors. For example, our finding of a large coefficient effect of age suggested that the impact of age on flu vaccination is different by race. It is possible that we could reduce the racial disparity in vaccinations by targeting older Black patients.

Finally, by quantifying the contributions to the racial disparity that cannot be explained by the variables in the regression model, we are able to identify gaps in our knowledge about the relationship between race and influenza vaccinations. It is clear from the results of our study that there are other factors (such as behavioral, psychosocial, lifestyle, and environmental factors) that we did not measure that could be contributing to the White-Black disparity in vaccination. Future research needs to focus on clarifying which additional contributors may be involved.

The main limitation of this study is not having behavioral or psychosocial factors that may contribute to the disparity. These may include such variables as exercise, diet, patient knowledge and attitudes towards vaccination, patient activation, etc. In addition, when we modeled our covariates, we did not include non-linear or interaction effects which may or may not have contributed to OB covariate effects. Finally, because our data represented mostly insured, employed, patients from one geographic region in the U.S., and because we restricted our analysis to only African-American and White patients, the generalizability of our results is limited to that specific population.

In conclusion, we explained the contribution of specific variables to the White-Black disparity in influenza vaccination. In terms of addressing the disparities in a health system such as KPMAS, we identified potential areas to target resources, including encouraging Black members to use the KP patient portal. However, further research should be done to identify additional factors that may contribute to racial disparities in influenza vaccinations.

Supporting information

S1 Text. Description of a hypothetical counterfactual population and an informative example.

https://doi.org/10.1371/journal.pone.0213972.s001

(DOC)

S1 Table. Characteristics of geographic service areas of the health system population.

https://doi.org/10.1371/journal.pone.0213972.s002

(DOC)

References

  1. 1. World Health Organization. Influenza (Seasonal) Fact sheet N°211. Available from: http://www.who.int/mediacentre/factsheets/fs211/en/.
  2. 2. Dushoff J, Plotkin JB, Viboud C, Earn DJ, Simonsen L. Mortality due to influenza in the United States—an annualized regression approach using multiple-cause mortality data. American journal of epidemiology. 2006;163(2):181–7. Epub 2005/12/02. pmid:16319291.
  3. 3. Gasparini R, Amicizia D, Lai PL, Panatto D. Influenza vaccination: from epidemiological aspects and advances in research to dissent and vaccination policies. Journal of preventive medicine and hygiene. 2016;57(1):E1–4. pmid:27346933; PubMed Central PMCID: PMC4910436.
  4. 4. Grohskopf LA, Sokolow LZ, Broder KR, Olsen SJ, Karron RA, Jernigan DB, et al. Prevention and Control of Seasonal Influenza with Vaccines. MMWR Recomm Rep. 2016;65(5):1–54. Epub 2016/08/26. pmid:27560619.
  5. 5. Osterholm MT, Kelley NS, Sommer A, Belongia EA. Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. The Lancet Infectious diseases. 2012;12(1):36–44. pmid:22032844.
  6. 6. Thompson WW, Comanor L, Shay DK. Epidemiology of seasonal influenza: use of surveillance data and statistical models to estimate the burden of disease. The Journal of infectious diseases. 2006;194 Suppl 2:S82–91. pmid:17163394.
  7. 7. Santibanez TA, Kahn KE ZY, O'Halloran A, Davis N, Bridges CB, Lu P-J, et al. Flu Vaccination Coverage In: Centers for Disease C, editor. Atlanta, GA2015.
  8. 8. Fiscella K. Commentary—anatomy of racial disparity in influenza vaccination. Health services research. 2005;40(2):539–49. pmid:15762906; PubMed Central PMCID: PMC1361155.
  9. 9. Marin MG, Johanson WG Jr., Salas-Lopez D. Influenza vaccination among minority populations in the United States. Preventive medicine. 2002;34(2):235–41. pmid:11817920.
  10. 10. Yoo BK, Hasebe T, Szilagyi PG. Decomposing racial/ethnic disparities in influenza vaccination among the elderly. Vaccine. 2015. Epub 2015/04/23. pmid:25900133.
  11. 11. Wang J, Munshi KD, Hong SH. Racial and ethnic disparities in influenza vaccinations among community pharmacy patients and non-community pharmacy respondents. Research in social & administrative pharmacy: RSAP. 2014;10(1):126–40. pmid:23706653; PubMed Central PMCID: PMC3858597.
  12. 12. Lu PJ, O'Halloran A, Williams WW, Lindley MC, Farrall S, Bridges CB. Racial and ethnic disparities in vaccination coverage among adult populations in the U.S. Vaccine. 2015;33 Suppl 4:D83–91. pmid:26615174.
  13. 13. Link MW, Ahluwalia IB, Euler GL, Bridges CB, Chu SY, Wortley PM. Racial and ethnic disparities in influenza vaccination coverage among adults during the 2004–2005 season. American journal of epidemiology. 2006;163(6):571–8. pmid:16443801.
  14. 14. Blinder AS. Wage discrimination: reduced form and structural estimates. Journal of Human Resources. 1973;8:436–55.
  15. 15. Oaxaca R. Male-female wage differentials in urban labor markets International Economic Review. 1973;14:693–709.
  16. 16. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. Journal of chronic diseases. 1987;40(5):373–83. pmid:3558716.
  17. 17. Chernoff H, Lehmann E.L. The Use of Maximum Likelihood Estimates in χ2 Tests for Goodness of Fit. Ann Math Statist. 1954;25(3):579–86.
  18. 18. Plackett RL. Karl Pearson and the Chi-Squared Test. International Statistical Review. 1983;51(1):59–72.
  19. 19. Derrick B, Toher D., White P. Why Welch’s test is Type I error robust. The Quantitative Methods for Psychology. 2016;12(1):30–8.
  20. 20. Ruxton GD. The unequal variance t-test is an underused alternative to Student's t-test and the Mann–Whitney U test. Behavioral Ecology. 2006;17(4):688–90.
  21. 21. Welch BL. The generalisation of student's problems when several different population variances are involved. Biometrika. 1947;34(1–2):28–35. Epub 1947/01/01. pmid:20287819.
  22. 22. Yun MS. Decomposing differences in the first moment. Economics Letters 2004;82:275–80.
  23. 23. Jann B. The Blinder-Oaxaca decomposition for linear regression models. The Stata Journal. 2008;8(4):453–79.