Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

On the relationship between conspiracy theory beliefs, misinformation, and vaccine hesitancy

  • Adam M. Enders ,

    Contributed equally to this work with: Adam M. Enders, Joseph Uscinski

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Software, Writing – original draft, Writing – review & editing

    Affiliation Department of Political Science, University of Louisville, Louisville, Kentucky, United States of America

  • Joseph Uscinski ,

    Contributed equally to this work with: Adam M. Enders, Joseph Uscinski

    Roles Conceptualization, Funding acquisition, Investigation, Project administration, Writing – original draft, Writing – review & editing

    uscinski@miami.edu

    Affiliation Department of Political Science, University of Miami, Coral Gables, Florida, United States of America

  • Casey Klofstad ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Writing – review & editing

    ‡ These authors also contributed equally to this work

    Affiliation Department of Political Science, University of Miami, Coral Gables, Florida, United States of America

  • Justin Stoler

    Roles Conceptualization, Funding acquisition, Investigation, Writing – review & editing

    ‡ These authors also contributed equally to this work

    Affiliation Department of Geography and Sustainable Development, University of Miami, Coral Gables, Florida, United States of America

Abstract

At the time of writing, nearly one hundred published studies demonstrate that beliefs in COVID-19 conspiracy theories and misinformation are negatively associated with COVID-19 preventive behaviors. These correlational findings are often interpreted as evidence that beliefs in conspiracy theories and misinformation are exogenous factors that shape human behavior, such as forgoing vaccination. This interpretation has motivated researchers to develop methods for “prebunking,” “debunking,” or otherwise limiting the spread of conspiracy theories and misinformation online. However, the robust literatures on conspiracy theory beliefs, health behaviors, and media effects lead us to question whether beliefs in conspiracy theories and misinformation should be treated as exogenous to vaccine hesitancy and refusal. Employing U.S. survey data (n = 2,065) from July 2021, we show that beliefs in COVID-19 conspiracy theories and misinformation are not only related to COVID-19 vaccine hesitancy and refusal, but also strongly associated with the same psychological, social, and political motivations theorized to drive COVID-19 vaccine hesitancy and refusal. These findings suggest that beliefs in conspiracy theories and misinformation might not always be an exogenous cause, but rather a manifestation of the same factors that lead to vaccine hesitancy and refusal. We conclude by encouraging researchers to carefully consider modeling choices and imploring practitioners to refocus on the worldviews, personality traits, and political orientations that underlie both health-related behaviors and beliefs in conspiracy theories and misinformation.

Introduction

Since the beginning of the COVID-19 pandemic, conspiracy theories and misinformation (CTM) have been a prime concern of researchers across disciplines [13], and for good reason: a wealth of research consistently demonstrates a strong negative relationship between beliefs in pandemic-related CTM and disease-preventive behaviors, including vaccine refusal [for review, see 4]. Thus, many scholars have come to believe that the spread of CTM represents a “crisis situation” [5] or “infodemic” as dangerous as the pandemic itself [6]. One characteristic of this research is the assumption of a specific causal link: that beliefs in CTM cause vaccine hesitancy and refusal.

This assumption has become influential in discussions of COVID-19 CTM. It has motivated the development of methods for pre-bunking [7] and debunking [8] beliefs in CTM, and has led researchers to call for the “downgrading, blocking, and counteracting” of online CTM [9]. Likewise, journalists often blame CTM for deleterious beliefs and behaviors [10] and U.S. lawmakers have proposed legislation to limit CTM online [11]. U.S. President Joe Biden, for example, claimed that online CTM was responsible for “killing people” [12].

While beliefs in CTM are undisputedly correlated with vaccine hesitancy and refusal, we question the frequent interpretation of such correlations as evidence of the causal, exogenous impact of CTM. As Scheufele et al. [13] recently argued, for example, the prevailing assumption that CTM “significantly distorts attitudes and behaviors of a citizenry that would otherwise hold issue and policy stances that are consistent with the best available scientific evidence” has “limited foundations in the social scientific literature.” Instead, we argue, and demonstrate empirically, that it may also be the case that, for many Americans, CTM are endogenous to vaccine hesitancy and refusal––i.e., they are less so unique causal explanations for vaccine hesitancy than they are beliefs reinforced by vaccine hesitancy or caused by underlying factors shared with vaccine hesitancy. This is primarily because the psychological, social, and political motivations––as well as situational environmental factors––that promote vaccine-related attitudes and behaviors have also been found to promote beliefs in CTM. For example, a lack of trust in the scientific community may cause individuals to eschew the COVID-19 vaccine and concurrently to adopt beliefs in CTM.

Our argument is built on the foundational literatures addressing media effects, beliefs in CTM, and health-related beliefs and behaviors, which suggest that 1) beliefs in CTM are likely to be endogenous to vaccine attitudes and behaviors, and that 2) exposure to CTM in the information environment does not necessarily promote beliefs in CTM. To illustrate the plausibility of our argument empirically, we employ nationally-representative U.S. survey data from July 2021 (n = 2,065) measuring beliefs in COVID-19 CTM and vaccine hesitancy and status. A factor analysis shows that beliefs in COVID-19 CTM and vaccine hesitancy can be conceived of as sharing a single dimension of opinion and that these phenomena are sufficiently correlated that distinguishing between them is difficult. Next, we explore the role of COVID-19 CTM in the theoretical and empirical models typically used to explain vaccine hesitancy and refusal. We demonstrate that the characteristics that predict belief in COVID-19 CTM also predict vaccine status and hesitancy, thereby establishing the plausibility of the argument that beliefs in CTM are, at least partially, endogenous to vaccine hesitancy.

Our argument attempts to reconcile two growing bodies of literature: one expressing alarm about the role of CTM in driving deleterious attitudes and behaviors [5,9,14,15] and another expressing doubt about the influence of CTM, which suggests that its influence on attitudes and behaviors is limited and conditional [13,1619]. Simply put, we argue that the characteristics that foster exposure and acceptance of CTM need to be properly accounted for. When failing to account for these factors, scholars may inappropriately make causal claims that potentially misattribute the foundations of vaccine hesitancy and, consequently, misdirect efforts at increasing vaccination rates.

The connection between COVID-19 CTM and vaccine hesitancy and refusal

Since the onset of the COVID-19 pandemic, scholars have focused on the circulation of CTM about the virus’s origins, effects, and treatments, as well as the potential impact of CTM on pandemic-related behaviors [20]. The vast majority of these studies––across different disciplines and focusing on various countries––demonstrate that beliefs in COVID-19 CTM have a strong negative association with pro-social and disease-preventative health behaviors [see review in 4].

The most protective COVID-19 public health measure individuals can partake in is vaccination, yet vaccination rates in many parts of the world have stagnated. Numerous studies demonstrate a negative association between beliefs in COVID-19 CTM and vaccine intentions and status [e.g., 2123], providing a potential clue about why.

Despite the correlational nature of these studies, negative relationships between beliefs in COVID-19 CTM and COVID-19 vaccine attitudes and behaviors are typically interpreted through a particular causal lens: that vaccine hesitancy is, at least partially, caused by (online) exposure to and belief in CTM [15,24,25]. For example, based on cross-sectional, correlational evidence, Allington et al. [15] argue (emphasis added) that “conspiracy beliefs act to inhibit health-protective behaviours and that social media act as a vector for such beliefs.” Dow et al. argue that “social media radicalizes beliefs, increasing contagion (rapid spread) and stickiness (resistance to change) of conspiracy theories. As conspiracy theories are reinforced in online communities, social norms develop, translating conspiracy beliefs into real-world action.” Dow et al. further argue that “COVID-19 conspiracy beliefs translate directly to various health-protective behaviors,” and that “conspiracy beliefs reduce healthy behaviors” [14]. Goreis and Kothgassner contend that the “endorsement of such theories reduces compliance with mandated measures” [24]. The scholarly literature also implies such a relationship when certain causal processes are assumed. For example, Romer and Jamieson conclude that “it will be critical to confront both conspiracy theories and vaccination misinformation to prevent further spread of the virus in the US” [20].

The conceptual model in Panel A of Fig 1 details the relationship between beliefs in COVID-19 CTM and vaccine hesitancy and refusal assumed by many scholars, journalists, and policymakers [e.g., 26]: exposure to COVID-19 CTM vis-à-vis media use––especially social media use––leads to beliefs in COVID-19 CTM, which subsequently result in vaccine hesitancy, and finally vaccine refusal. Under this and similar models, the obvious prescription for boosting vaccination rates involves limiting CTM in the information environment [9], or perhaps inoculating people against such ideas in advance of exposure [7]. Thus, researchers have recommended “aggressive” actions [9] because “unregulated social media may present a health risk” [15]. However, two robust bodies of literature provide reasons for skepticism of the presumed causal pathway depicted in Panel A of Fig 1.

thumbnail
Fig 1. Two conceptual models of relationship between beliefs in COVID-19 conspiracy theories and misinformation and vaccine hesitancy and refusal.

https://doi.org/10.1371/journal.pone.0276082.g001

First, a wealth of research on the causal antecedents of beliefs in CTM conceives of such beliefs as the product of deep-seated psychological, social, and political motivations [27], with exposure sometimes playing a more limited and conditional role [28]. Thus, beliefs in CTM could be treated as the downstream products of more foundational characteristics, rather than as explanatory factors in and of themselves. This theoretical perspective follows widely-accepted and well-evidenced models of both health and political belief formation: people’s worldviews, ideologies, values, group attachments, personalities, and even occasionally biological and genetic factors––the relatively stable features of our identities and belief systems––are the primary ingredients of beliefs regarding politics, health and medicine, and various forms of CTM [2931]. In other words, beliefs in COVID-19 CTM and pandemic-related behaviors share many underlying (presumably causal) ingredients [32].

For example, conspiracy mentality [33,34], scientific literacy and trust in science [35,36], political ideology and partisan attachments [20,37], social media use [9], personality traits [38,39], and emotional conditions, such as stress and anxiety [40,41], have been found to predict both beliefs in COVID-19 CTM and pandemic-related behavioral intentions. Moreover, whereas Panel A of Fig 1 suggests a recent cause for beliefs in COVID-19 CTM and vaccine refusal (i.e., exposure to COVID-19 CTM), vaccine CTM and vaccine hesitancy, more generally, are hardly new problems. Previous vaccines have faced longstanding opposition [42], and the factors associated with opposition to vaccines, in general, are also associated with opposition to COVID-19 vaccines, specifically [4345]. Thus, refusing to vaccinate for COVID-19 may be related to motivational factors that preexist not only exposure to COVID-19 CTM but also the COVID-19 pandemic itself.

These points come into focus when considering the implied influence of information exposure detailed in Panel A of Fig 1. The causal influence of exposure to COVID-19 CTM by traditional and social media, or from elsewhere, suggests a “hypodermic needle” effect [46], whereby (incidental) exposure directly promotes belief. However, a century-long literature demonstrates that media effects are more limited, conditional on individual and environmental factors, and, most importantly, partially endogenous to beliefs themselves [4753].

Second, selective exposure and avoidance––the tendency for individuals to seek out information that comports with previously held beliefs or ignore that which is incongruent with said beliefs [54,55]––are better-evidenced models of media effects than the hypodermic model. Selective exposure also guides the search for/avoidance of and acceptance/rejection of CTM, specifically: those drawn to conspiracy theories tend to seek them out, and individuals not attracted to conspiratorial explanations avoid them [56]. The same can be said of vaccine skeptical content: very few people not exhibiting vaccine hesitant attitudes choose to consume vaccine skeptical content [57]. Even for individuals who are incidentally exposed to CTM, previously held dispositions and beliefs will temper persuasion effects through processes such as motivated reasoning [58]. Thus, we possess additional reasons to expect that exposure to CTM––regardless of medium––might serve more as an expression of, reinforcement for, or rationalization for previously held beliefs, values, and predispositions, rather than an impetus for individual change.

Considering these bodies of past work, we propose an alternative theoretical model of vaccine hesitancy and refusal in Panel B of Fig 1 in which pre-existing social, political, and psychological motivations are key to understanding vaccine hesitancy and refusal. This model, while containing many of the same elements as Panel A, better incorporates past theories and empirical findings regarding the causes of beliefs about CTM and vaccines [59]. In this model, both beliefs in COVID-19 CTM and vaccine hesitancy are promoted by social, political, and psychological motivations; those motivations in Panel B largely replace the assumed foundational role of exposure to COVID-19 CTM vis-à-vis exposure in Panel A. For example, those who distrust doctors and scientists are more likely to concurrently hold vaccine hesitant attitudes and believe in COVID-19 CTM. This not only better incorporates the literature on the foundations of beliefs in CTM and vaccine hesitant attitudes, but more accurately accounts for well-evidenced theories of media effects.

The model in Panel B also allows for a reinforcing relationship between beliefs in COVID-19 CTM and vaccine hesitancy. Because of the tendency for individuals to reinforce their beliefs and identities, vaccine hesitancy might encourage or further strengthen beliefs in CTM, just as beliefs in CTM may encourage or further strengthen vaccine hesitancy. This reciprocal relationship allows for the possibility of beliefs in COVID-19 CTM to be adopted after an individual is vaccine hesitant, a scenario in which CTM serve as a rationalization for, rather than a motivating force behind, attitudes and behaviors. This process comports with scholarship showing that people will often adopt beliefs in CTM to justify pre-existing views in the face of disconfirming evidence or use CTM to rationalize personal or political losses [60]. Further, Panel B is consistent with individuals who base their vaccine hesitancy on a stylized interpretation of authoritative facts (e.g., the COVID-19 vaccine is ‘not yet fully approved’) [61] and with pro-vaccine individuals who share beliefs in various CTM [62]. Exposure to, and beliefs in, COVID-19 CTM in Panel B are, therefore, neither necessary nor sufficient for the adoption of vaccine hesitant attitudes or vaccine refusal.

Before exploring the plausibility that a different process (Panel B) underlies vaccine hesitancy/refusal than is commonly assumed (Panel A), we wish to make several points clear. Most importantly, we are not arguing that the typical model (Panel A) is flatly incorrect and that the proposed alternative (Panel B) is correct. Indeed, it strikes us as highly likely that beliefs in CTM are neither strictly exogenous nor completely endogenous to vaccine hesitancy––the world is complicated and filled with reciprocal effects promoted by changes in situational factors and other contextual considerations. Rather, we argue only that the alternative model (Panel B) is plausible, given the observational nature of the vast majority of analyses (including our own) and past findings regarding media effects and the predictors of beliefs in CTM and vaccine hesitancy pre-pandemic. Our intention is to contribute a different perspective to the conversation on the relationship between CTM and vaccine hesitancy and refusal, not to dismiss past work that reliably finds correlational associations between these constructs.

Expectations

If the alternative model we propose is plausible, we expect to observe several patterns in our analyses. First, an analysis of the dimensionality of beliefs in CTM and vaccine hesitancy (e.g., using factor analysis) will reveal a unidimensional structure. This would suggest that beliefs in CTM and vaccine hesitancy are more similar than different, perhaps because of the social, political, and psychological antecedents that they share (though this is not the only possibility, which we discuss below). Second, an analysis of the predictors of beliefs in CTM, on the one hand, and vaccine hesitancy and refusal, on the other, should reveal that both sets of dependent variables share many of the same correlates. This, too, would provide evidence for the plausibility that beliefs in CTM are not strictly exogenous to vaccine hesitancy and refusal, as has often been taken for granted in the literature.

Materials and methods

Our central argument is that beliefs in COVID-19 CTM should not, based on current evidence, be thought of as strictly exogenous to vaccine hesitancy and behavior. It is just as plausible that beliefs in CTM are endogenous to vaccine hesitancy. Therefore, our empirical examination is designed to demonstrate the plausibility of Panel B of Fig 1. We utilize a unique national survey containing questions about COVID-related CTM, as well as questions designed to measure a wealth of psychological, social, and political traits and orientations previously found to promote beliefs in CTM [27]. These include science literacy, trust in scientists and health professionals, Machiavellianism, narcissism, psychopathy, perceived victimhood, stress, conflictual behavior, conspiracy thinking, partisanship, ideology, support for Donald Trump, and social media usage, in addition to age, educational attainment, religiosity, perceived socioeconomic status, race and ethnicity, and gender. While this dataset was initially collected in the context of a project on deciphering the various correlates of vaccine hesitancy, it is also capable of aiding in the exploration of the plausibility of the alternative model we pose because it contains many of the focal predictors of both beliefs in CTM and vaccine hesitancy. Details regarding question wording, summary statistics, and scale reliability appear in the Supplementary Information (SI); all variables are captured using previously developed and validated measures.

We partnered with Qualtrics to interview 2,065 U.S. adults between July 17–August 5, 2021. The sample was designed to match the 2019 U.S. Census American Community Survey records on sex, age, race, and education; details about the sociodemographic composition of the sample appear in the SI. This research was approved by the University of Miami Human Subject Research Office on July 14, 2021 (Protocol #20210618). In order to ensure quality, respondents were required to pass four attention checks; these included a mixture of standalone questions and questions embedded in grids, per best practices [63]. Participants who failed to pass all four attention checks were excluded from the data set. Qualtrics also took steps to eliminate “speeders”––respondents who quickly completed the survey without reading the questions. A soft-launch of the survey (n = 127) yielded a median time to complete of 11.6 minutes. Participants completing the questionnaire in less than half the median time were excluded from the final n = 2,056 dataset delivered to us by Qualtrics.

The specific beliefs that comprise our CTM measure appear in Table 1, along with the percentage of respondents who either “agree” or “strongly agree” with each. We observe significant variability in the popularity of these ideas. Both sets of questions were averaged into additive scales of beliefs in conspiracy theories (α = 0.90, Range = 1–5, M = 2.20, SD = 1.04) and beliefs in misinformation (α = 0.93, Range = 1–5, M = 2.16, SD = 1.06).

thumbnail
Table 1. Proportion of Americans who believe in COVID-19 conspiracy theories and misinformation.

https://doi.org/10.1371/journal.pone.0276082.t001

We utilize two dependent variables. The first is self-reported vaccination status. We asked respondents: “Have you personally received at least one dose of a COVID-19 vaccine?” Sixty-eight percent reported having received the vaccine, 32 percent reported not having received it. We also asked those who reported not having received the vaccine: “Which of the following best describes how you feel about the COVID-19 vaccine?” Response options included: “I plan to get the vaccine as soon as possible” (12%), “I am open to it, but will keep waiting and see what happens” (25%), “I will only get the vaccine if required by my job or places I need to go” (12%), and “I definitely will not get the vaccine” (51%). For this dependent variable, we coded as 1 those who received the vaccine and those who reported a plan to get the vaccine as soon as possible (72%); those who had not received the vaccine and were either unwilling or had no immediate intention of being vaccinated (28%) are coded 0. We also estimated the models below using only the initial question about vaccination status where only those who have not been vaccinated and are completely unwilling to be vaccinated are coded as 0; results, which are available in the SI, are substantively identical to those provided below.

Our second dependent variable is an additive scale of attitudes about vaccines [64], coded such that greater values reflect stronger vaccine hesitancy (α = 0.91, Range = 1–5, M = 2.34, SD = 0.83). For example, respondents were asked to what extent they agreed with the following: “Getting vaccines is a good way to protect me from disease” and “I do not need vaccines for diseases that are not common anymore.” The correlation between this measure of vaccine hesitancy and vaccination status is -0.62 (p<0.001).

A note on causality

The data we employ is cross-sectional and, therefore, unsuited for demonstrating causality. We reiterate that our objective is to illustrate the plausibility of our argument that beliefs in CTM are (at least partially) endogenous to vaccine hesitancy and refusal, rather than strictly exogenous. While, at first glance, mere plausibility may seem underwhelming, this is precisely the same standard that most published studies on CTM and vaccine hesitancy are capable of meeting, even though a particular causal interpretation is frequently––and, perhaps, inappropriately––employed or assumed. In other words, our study is not unique in utilizing cross-sectional data––it is unique only by way of our explicit attention to the fact that our data are incapable of establishing unidirectional causal relationships.

This is not to say that other, “better” designs are impossible (e.g., experiments, panel data). We merely highlight that most studies, like our own, are only capable of revealing the plausibility of an argument. Our intent is to demonstrate the plausibility of an argument that has been, to the detriment of the relevant literatures and practical efforts to combat vaccine hesitancy, largely overlooked.

Results

Assessing the dimensionality of beliefs

We begin our analysis by examining the results of an exploratory factor analysis of the items composing the conspiracy theory, misinformation, and vaccine hesitancy scales described above. If beliefs in CTM and vaccine hesitancy are the related to shared social, psychological, and political antecedents, it stands to reason that they may occupy a shared dimension of opinion, rather than three distinct dimensions each representing conspiracy theories, misinformation, and vaccine hesitancy. Before estimating the factor model, we conducted Horn’s parallel analysis for guidance on the appropriate number of factors to retain; this analysis suggested that two factors are appropriate. We also examined a scree plot (see SI), which prompted the same conclusion (the “elbow” appearing at the third factor suggests a two-factor solution).

We estimated the two-factor solution using iterated principal axis factoring; (unrotated) factor loadings and other details appear in Table 2. We bolded the greatest loading in absolute value associated with each item; note that the exact wording for each item appears in 1. In each case, the greatest loading is associated with the first factor, usually by a considerable discrepancy. The eigenvalue associated with the first factor is also approximately six times greater than that associated with the second factor. These results suggest that vaccine hesitancy can be conceived as occupying the same dimension of opinion as beliefs in COVID-19 CTM.

Of course, this result does not indicate that COVID-19 CTM beliefs and vaccine hesitancy are synonymous, nor does it mean that we should ignore beliefs in COVID-19 CTM when investigating vaccine hesitancy. It does, however, suggest that these beliefs, as measured, are so highly correlated that they are difficult to disentangle. Unidimensional structure is frequently a primary criterion to meet in the process of successfully creating and validating a psychometric scale––applying the same standard here, we could justifiably create an “anti-vax” scale composed of beliefs regarding COVID-19 CTM and vaccines that captures a single (category of) attitude. In a sense, then, modeling COVID-19 vaccine hesitancy based on beliefs in COVID-19 CTM may not be particularly illuminating, as such an activity amounts to an empirical tautology.

That said, we would be remiss if we failed to note that the factor analysis result could also be reflective of the model in Panel A of Fig 1. It could be the case that beliefs in COVID-19 CTM and vaccine hesitancy are so highly correlated by summer of 2021 when our data was collected because social media exposure to CTM lead to beliefs in CTM, which subsequently resulted in vaccine hesitancy and refusal. This said, we have some (empirical) reason to doubt this. The correlation between beliefs in COVID conspiracy theories and vaccine refusal is -0.38 (p<0.001). Moreover, the correlation between social media use and vaccine refusal is non-significant at 0.017 (p = 0.439). It seems to us that both the direct and indirect (through beliefs in CTM) role of media exposure are far from determinative of vaccination status, where they are correlated at all. Still, causality is difficult to assess under the best of conditions and observational data have clear limitations. This is precisely one of our central arguments: our data, as with other studies, are only capable of establishing plausibility. Unfortunately, plausibility is oftentimes not enough to adjudicate between competing theories, as in this case.

In order to further explore the plausibility of the alternative model we pose, we next turn toward comparing regression models of beliefs in CTM, vaccine hesitancy, and vaccine refusal in order to decipher which predictors are shared and which differ across constructs.

Model comparison

Next, we examine different strategies for modeling vaccine hesitancy and behaviors. We first demonstrate how beliefs in CTM are typically modeled in the social scientific literatures that empirically examine COVID-19 behavioral intentions. The first two columns of Table 3 contain the (abbreviated) results of two such models. We include all psychological, social, and political factors described above. This group of explanatory factors is more comprehensive than any studies of which we are aware.

thumbnail
Table 3. Models of beliefs in COVID-19 CTM, vaccine hesitancy, and non-vaccination status, presented as regression coefficients with significance levels.

https://doi.org/10.1371/journal.pone.0276082.t003

We observe significant positive relationships between our two dependent variables and conspiracy thinking, ideology, Trump approval, psychopathy, perceived victimhood, and conflictual behavior. We observe significant negative relationships with science literacy, trust in scientists, and stress. Interestingly, we do not observe a relationship between beliefs in CTM and time spent on social media, contrary to the predictions of the model in Panel A of Fig 1. Hardly an empirical irregularity, this finding comports with recent work arguing that beliefs in COVID-19 CTM are more than the product of exposure alone [57]. That said, we observe significant bivariate correlations (p<0.001 in every case) between each variable included in Table 3 and beliefs in CTM; see the SI.

Altogether, a litany of traits, orientations, and motivations are presumably exogenous to, and theoretically formative of, beliefs in COVID-19 CTM. Indeed, most of these relationships were discovered prior to the COVID-19 pandemic and will presumably prove relevant after the COVID-19 pandemic has passed. This leads us back to our argument about modeling vaccination hesitancy and refusal: the foundational factors behind beliefs in CTM should be the focus of researchers seeking to understand vaccine hesitancy and refusal, not beliefs in specific CTM that are tethered to a particular event and are, themselves, the theoretical product of many of the same foundational factors.

Columns 3 and 5 of Table 3 present typical models of vaccine hesitancy and refusal that seek to understand the role of beliefs in COVID-19 CTM. Beliefs in CTM are treated as presumably exogenous independent variables, along with controls for sociodemographic factors (included in the models but omitted from Table 3). In both cases, as with previous work, we observe statistically significant estimates for beliefs in CTM.

While these models show evidence for hypothesized relationships, we have provided theoretical and empirical arguments about why they may not be particularly illuminative of causal relationships for researchers seeking to understand the psychological antecedents of vaccine hesitancy or working to develop strategies to encourage vaccination. We present alternative models––derived from the literature outlined above and more congruent with the model in Panel B of Fig 1—of vaccine-relevant attitudes and behaviors in columns 4 and 6. Here we have replaced beliefs in COVID-19 CTM with the predictors of those beliefs. In doing so, we observe statistically significant relationships with conspiracy thinking, science literacy, trust in scientists, ideology, and Trump approval—many of the same characteristics that foster beliefs in CTM.

More specifically, we find that conspiracy thinking, trust in scientists, and Trump approval are significant across all four models. Science literacy is a significant predictor of beliefs in CTM and vaccination status, but not vaccine hesitancy. We also find that ideology is a significant predictor of COVID-19 conspiracy beliefs and vaccine hesitancy, but not beliefs in misinformation or vaccination status. We also reiterate that social media use is unrelated to beliefs in COVID-19 CTM and vaccine hesitancy, though positively and statistically significantly related to vaccination status (i.e., the more social media use, the more likely one is to be vaccinated, all else equal). These results are contradictory of the model in Panel A of Fig 1 and other such models of vaccine hesitancy and refusal that situate social media use/exposure as a primary causal mechanism.

Even though beliefs in CTM and vaccine hesitancy/refusal do not share all predictors, they share many. Moreover, each substantive (i.e., non-sociodemographic) predictor in Table 3 is statistically significantly correlated with vaccine hesitancy, as well as beliefs in CTM; hence, fluctuations in statistical significance could be due to variability in the precision of measurement, multicollinearity, model specification, or true differences. We have no way of knowing, though we emphasize that this is precisely the problem with observational research that we wish to highlight: it is not capable of assessing causality, and in some case (like ours) it is not even capable of adjudicating between two plausible models. If this is the case, how can we declare a winner?

Exploratory analysis of open-ended responses

Finally, a perusal of open-ended responses to the question, “Are there any other reasons why you have not received the COVID-19 vaccine?” offered to the unvaccinated in our survey further illustrates our argument. Some respondents—even those who point to specific CTM—mention longstanding views about the government, (“I am a person who is awake to the government’s agenda to depopulate the world by poisoning people with vaccines through the years. There has never been a reason to have a vaccine”), religion (“I Trust God not science and believe this is part of the Mark of the Beast”), and medicine (“Don’t believe in vaccines in general,” “I am against all vaccines they are toxic poisonous used to control population use aborted fetal cells and no vaccines protect you,” “I don’t even receive the flu shot”) that likely predate COVID-19. Such reasoning suggests that recent exposure to COVID-19 CTM is not the only cause of vaccine refusal. Furthermore, some respondents point to factual information as the reason for not getting vaccinated (“I see vaccinated people getting covid anyway”). Thus, beliefs in COVID-19 CTM are neither necessary for, nor strictly exogenous to, vaccine refusal.

Discussion

The academic response to COVID-19 is unsurpassed in the speed in which it produced important findings under trying conditions. Our intention is not to diminish the great interdisciplinary strides made in explaining why individuals took part in, or eschewed, COVID-19 preventive behaviors. However, the speed of scientific discovery meant that researchers were working concurrently, rather than sequentially––this may have inadvertently slowed self-critique and challenges to the core assumptions of this rapidly expanding literature. Our investigation confronts the possibility that this literature, by not introspectively considering its modeling decisions, is (at least partially) misattributing blame for vaccine hesitancy and refusal and for other undesirable pandemic-related behaviors, as well.

Understanding the precise nature of the relationship between COVID-19 CTM and vaccine hesitancy and refusal is important not only for the sake of appropriate statistical modeling. Indeed, it speaks directly to the measures that are needed to address vaccine hesitancy. If COVID-19 CTM are merely a symptom of another problem, perhaps one that similarly impacts vaccine attitudes, then efforts to censor or correct CTM beliefs will do little to impact vaccination rates. This would also be the case if beliefs in CTM were adopted to justify preexisting preferences and behavioral intentions [65]. It may be the case, consistent with demand-driven models of media content [e.g., 66], that content producers—even those producing CTM-related content—tailor their content (i.e., supply) to match the audience’s pre-existing views (i.e., demand). Further, studies suggest that efforts aimed at removing CTM through government censorship, for example, may actually arouse suspicions, thereby encouraging conspiracy theory beliefs [67]. Regardless of the impact, schemes at removing or labeling content may inadvertently inhibit the free exchange of ideas that are central to democratic societies and remove from public debate ideas that are potentially true or valuable.

There was no shortage of easily accessible, high-quality information about the COVID-19 virus and vaccines during the pandemic, yet vaccine hesitancy persists. This is likely because anti-vaccine attitudes are deeply rooted, having posed a persistent threat to public health long before social media and COVID-19. We, therefore, encourage researchers to treat vaccine hesitant attitudes like other beliefs they study. Beliefs––in CTM or the dangers of vaccines––are a product of people’s motivations: the foundational ingredients of public opinion that guide which information one accepts and integrates into their belief system, and which they reject, ignore, or explain away. This fundamental argument is consistent across the literatures explaining political opinions [29], health-related beliefs [30], and beliefs in CTM [27]. In other words, simply giving people the “right” set of facts does not guarantee that they will adopt desirable beliefs or engage in advisable behaviors [68]. If we are interested in understanding the exogenous factors that promote vaccine hesitancy, we must recognize the role of people’s motivations and probe deeper than specific beliefs about a given vaccine or virus.

Many of the concerns expressed about CTM at the beginning of the pandemic are beginning to be investigated further and placed into appropriate context. As compared to some of the claims proffered by concerned researchers in early 2020, more recent work has found that online CTM is less prevalent [19,69], people engage with less online CTM [70], people share less CTM [17], CTM appears less influential [28], and echo chambers are less prominent [71,72]. Moreover, researchers are finding that online CTM and other forms of toxic rhetoric are confined to small numbers of people who exhibit unrepresentative personality traits [73,74]. While CTM, both online and offline, have been and continue to be an important social and political problem in need of attention [7578], emerging studies suggest that it has limited scope, reach, and influence [79] and that the initial claims about an “infodemic” in 2020 may have been overstated [16,80], albeit well-intentioned.

There are, of course, limitations to our analyses. Given their cross-sectional nature, our findings only demonstrate the plausibility of our argument; this is the case for most research on COVID-19 vaccine hesitancy, a challenge that continues to obscure inferences related to the pandemic. More data, utilizing different research designs (e.g., experiments, panel data), would be invaluable for more robustly testing the plausibility of various hypotheses about causal pathways. Nevertheless, this study’s empirical evidence demonstrating the plausibility that COVID-19 CTM are not exogenous to vaccine hesitancy and refusal should prompt researchers to reevaluate their modeling assumptions, explore additional predictors of vaccine hesitancy, and consult the literatures on media effects, selective exposure, conspiracy theory beliefs, and vaccine attitudes for guidance on the COVID-19 case.

Conclusion

The argument that “correlation is not causation” is neither unique nor profound, yet it is often ignored, even by the most well-intended scholars. Our findings comport with a small but growing chorus of scholars pointing out that the co-occurrence of “persistent vaccine hesitancy” and “widespread misinformation” does not indicate causation [13]. As dangerous as vaccine hesitancy is, and as bizarre as vaccine refusal may seem to members of the scientific community, socio-behavioral theories guiding human beliefs and behavior still apply. Even though beliefs in COVID-19 CTM––by virtue of their relationship with many normatively undesirable outcomes––make an attractive culprit for resistance to disease-preventive behaviors, they may not be primary, causal antecedents of those outcomes. Given increasing concern over the potential social and medical harms of CTM, we encourage alternative perspectives to studying their causes and consequences.

Supporting information

S1 File. Supporting information.

This file contains supplementary information.

https://doi.org/10.1371/journal.pone.0276082.s001

(PDF)

References

  1. 1. Douglas K. COVID-19 conspiracy theories. Group Processes & Intergroup Relations. 2021;24(2):270–5.
  2. 2. Uscinski J, Enders AM, Stefan W, Klofstad C, Seelig M, Funchion J, et al. Why do people believe COVID-19 conspiracy theories? The Harvard Kennedy School (HKS) Misinformation Review. 2020;1:1–12.
  3. 3. Cassese EC, Farhart CE, Miller JM. Gender Differences in COVID-19 Conspiracy Theory Beliefs. Politics & Gender. 2020;16(4):1009–18.
  4. 4. Bierwiaczonek K, Kunst JR, Gundersen AB. The Role of Conspiracy Beliefs for COVID-19 Prevention: A Meta-analysis. Current Opinion in Psychology. 2022. Epub September 9, 2021.
  5. 5. Bak-Coleman JB, Alfano M, Barfuss W, Bergstrom CT, Centeno MA, Couzin ID, et al. Stewardship of global collective behavior. Proceedings of the National Academy of Sciences. 2021;118(27):e2025764118. pmid:34155097
  6. 6. Zarocostas J. How to fight an infodemic. The Lancet. 2020;395(10225):676. pmid:32113495
  7. 7. Basol M, Roozenbeek J, Berriche M, Uenal F, McClanahan WP, Linden Svd. Towards psychological herd immunity: Cross-cultural evidence for two prebunking interventions against COVID-19 misinformation. Big Data & Society. 2021;8(1):20539517211013868.
  8. 8. Vraga EK, Bode L. Addressing COVID-19 Misinformation on Social Media Preemptively and Responsively. Emerging infectious diseases. 2021;27(2):396–403. Epub 2021/01/04. pmid:33395379.
  9. 9. Romer D, Jamieson KH. Patterns of Media Use, Strength of Belief in COVID-19 Conspiracy Theories, and the Prevention of COVID-19 From March to July 2020 in the United States: Survey Study. J Med Internet Res. 2021;23(4):e25215. Epub 27.4.2021. pmid:33857008.
  10. 10. Collins B. How QAnon rode the pandemic to new heights—and fueled the viral anti-mask phenomenon. NBC News [Internet]. 2020 8/15/2020. https://www.nbcnews.com/tech/tech-news/how-qanon-rode-pandemic-new-heights-fueled-viral-anti-mask-n1236695.
  11. 11. Greenhut S. Government Regulation of Social Media Won’t Protect Free Speech. Reason [Internet]. 2021 11/12/2021. https://reason.com/2021/11/12/government-regulation-of-social-media-wont-protect-free-speech/.
  12. 12. Rose N, Culliford E. Biden says Facebook, others ’killing people’ by carrying COVID misinformation. Reuters [Internet]. 2021 11/13/2021. https://www.reuters.com/business/healthcare-pharmaceuticals/white-house-says-facebooks-steps-stop-vaccine-misinformation-are-inadequate-2021-07-16/.
  13. 13. Scheufele DA, Krause NM, Freiling I. Misinformed About The “Infodemic?” Science’s Ongoing Struggle With Misinformation. Journal of Applied Research in Memory and Cognition. 2021;10(4):522–6.
  14. 14. Dow BJ, Johnson AL, Wang CS, Whitson J, Menon T. The COVID-19 pandemic and the search for structure: Social media and conspiracy theories. Social and Personality Psychology Compass. 2021. pmid:34512798
  15. 15. Allington D, Duffy B, Wessely S, Dhavan N, Rubin J. Health-protective behaviour, social media usage and conspiracy belief during the COVID-19 public health emergency. Psychological Medicine. 2021;51(10):1763–9. Epub 2020/06/09. pmid:32513320
  16. 16. Simon FM, Camargo CQ. Autopsy of a metaphor: The origins, use and blind spots of the ‘infodemic’. New Media & Society. 2021.
  17. 17. Altay S, Hacquin A-S, Mercier H. Why do so few people share fake news? It hurts their reputation. New Media & Society. 2021;0(0):1461444820969893.
  18. 18. Guess A, Lockett D, Lyons B, Montgomery JM, Nyhan B, Reifler J. “Fake news” may have limited effects beyond increasing beliefs in false claims. Harvard Kennedy School Misinformation Review. 2020.
  19. 19. Acerbi A, Altay S, Mercier H. Fighting misinformation or fighting for information? Harvard Kennedy School (HKS) Misinformation Review. 2022.
  20. 20. Romer D, Jamieson KH. Conspiracy theories as barriers to controlling the spread of COVID-19 in the US. Social Science & Medicine. 2020;263(113356):1–8. pmid:32967786
  21. 21. Yang Z, Luo X, Jia H. Is It All a Conspiracy? Conspiracy Theories and People’s Attitude to COVID-19 Vaccination. Vaccines. 2021;9(10):1051. pmid:34696159
  22. 22. van Prooijen J-W, Etienne TW, Kutiyski Y, Krouwel AP. Just a Flu? Self-perceived infection mediates the link between conspiracy beliefs and Covid-19 health beliefs and behaviors. Journal of Health Psychology. 2021;0(0):13591053211051816. pmid:34670439.
  23. 23. Piltch-Loeb R, Savoia E, Goldberg B, Hughes B, Verhey T, Kayyem J, et al. Examining the effect of information channel on COVID-19 vaccine acceptance. PLOS ONE. 2021;16(5):e0251095. pmid:33979370
  24. 24. Goreis A, Kothgassner OD. Social media as vehicle for conspiracy beliefs on COVID-19. Digital Psychology. 2020;1(2):36–9.
  25. 25. Arshad MS, Hussain I, Mahmood T, Hayat K, Majeed A, Imran I, et al. A National Survey to Assess the COVID-19 Vaccine-Related Conspiracy Beliefs, Acceptability, Preference, and Willingness to Pay among the General Population of Pakistan. Vaccines. 2021;9(7):720. pmid:34358136
  26. 26. Pummerer L, Böhm R, Lilleholt L, Winter K, Zettler I, Sassenberg K. Conspiracy Theories and Their Societal Effects During the COVID-19 Pandemic. Social Psychological and Personality Science. 2021:19485506211000217.
  27. 27. Douglas K, Uscinski J, Sutton R, Cichocka A, Nefes T, Ang CS, et al. Understanding Conspiracy Theories. Advances in Political Psychology. 2019;40(1):3–35.
  28. 28. Enders A, Uscinski JE, Seelig MI, Klofstad CA, Wuchty S, Funchion JR, et al. The Relationship Between Social Media Use and Beliefs in Conspiracy Theories and Misinformation. Political Behavior. 2021. pmid:34248238
  29. 29. Leeper TJ, Slothuus R. Political Parties, Motivated Reasoning, and Public Opinion Formation. Political Psychology. 2014;35:129–56.
  30. 30. Mercadante AR, Law AV. Will they, or Won’t they? Examining patients’ vaccine intention for flu and COVID-19 using the Health Belief Model. Research in Social and Administrative Pharmacy. 2021;17(9):1596–605. pmid:33431259
  31. 31. Young DG, Bleakley A. Ideological Health Spirals: An Integrated Political and Health Communication Approach to COVID Interventions 2020.
  32. 32. Stoler J, Klofstad CA, Enders AM, Uscinski JE. Sociopolitical and psychological correlates of COVID-19 vaccine hesitancy in the United States during summer 2021. Social Science & Medicine. 2022;306:115112. pmid:35700550
  33. 33. Marinthe G, Brown G, Delouvée S, Jolley D. Looking out for myself: Exploring the relationship between conspiracy mentality, perceived personal risk, and COVID-19 prevention measures. British Journal of Health Psychology. 2020;25(4):957–80. pmid:32583540
  34. 34. Bertin P, Nera K, Delouvée S. Conspiracy Beliefs, Rejection of Vaccination, and Support for hydroxychloroquine: A Conceptual Replication-Extension in the COVID-19 Pandemic Context. Frontiers in Psychology. 2020;11(2471). pmid:33071892
  35. 35. Čavojová V, Šrol J, Ballová Mikušková E. How scientific reasoning correlates with health-related beliefs and behaviors during the COVID-19 pandemic? Journal of Health Psychology. 2020;0(0):1359105320962266. pmid:33016131.
  36. 36. Austin EW, Austin BW, Willoughby JF, Amram O, Domgaard S. How Media Literacy and Science Media Literacy Predicted the Adoption of Protective Behaviors Amidst the COVID-19 Pandemic. Journal of Health Communication. 2021;26(4):239–52. pmid:33928871
  37. 37. Stecula D, Pickup M. How populism and conservative media fuel conspiracy beliefs about COVID-19 and what it means for COVID-19 behaviors. Research & Politics. 2021;8(1):2053168021993979.
  38. 38. Sternisko A, Cichocka A, Cislak A, Van Bavel JJ. Collective narcissism predicts the belief and dissemination of conspiracy theories during the COVID-19 pandemic. Personality and Social Psychology Bulletin. 2021.
  39. 39. Hughes S, Machan L. It’s a conspiracy: Covid-19 conspiracies link to psychopathy, Machiavellianism and collective narcissism. Personality and Individual Differences. 2021;171:110559. pmid:33867616
  40. 40. Simione L, Vagni M, Gnagnarella C, Bersani G, Pajardi D. Mistrust and Beliefs in Conspiracy Theories Differently Mediate the Effects of Psychological Factors on Propensity for COVID-19 Vaccine. Frontiers in psychology. 2021;12:683684-. pmid:34305736.
  41. 41. Leibovitz T, Shamblaw AL, Rumas R, Best MW. COVID-19 conspiracy beliefs: Relations with anxiety, quality of life, and schemas. Personality and Individual Differences. 2021;175:110704. pmid:33531727
  42. 42. Dubé E, Laberge C, Guay M, Bramadat P, Roy R, Bettinger JA. Vaccine hesitancy. Human Vaccines & Immunotherapeutics. 2013;9(8):1763–73. pmid:23584253
  43. 43. Stecula D, Kuru O, Jamieson KH. How trust in experts and media use affect acceptance of common anti-vaccination claims. Harvard Kennedy School Misinformation Review. 2020;1(1).
  44. 44. Mesch GS, Schwirian KP. Social and political determinants of vaccine hesitancy: Lessons learned from the H1N1 pandemic of 2009–2010. American Journal of Infection Control. 2015;43(11):1161–5. pmid:26521933
  45. 45. Cislak A, Marchlewska M, Wojcik AD, Śliwiński K, Molenda Z, Szczepańska D, et al. National narcissism and support for voluntary vaccination policy: The mediating role of vaccination conspiracy beliefs. Group Processes & Intergroup Relations. 2021;24(5):701–19.
  46. 46. Bineham JL. A historical account of the hypodermic model in mass communication. Communication Monographs. 1988;55(3):230–46.
  47. 47. Lazarsfeld P, Berelson B, Gaudet H. The People’s Choice: How the Voter Makes Up His Mind in a Presidential Campaign. New York: Columbia University Press; 1948.
  48. 48. Katz E. Communications Research Since Lazarfeld. The Public Opinion Quarterly. 1987;51(2):S25–S45.
  49. 49. Finkel SE. Reexamining the "Minimal Effects" Model in Recent Presidential Campaigns. The Journal of Politics. 1993;55(1):1–21.
  50. 50. Bennett WL, Iyengar S. A New Era of Minimal Effects? the Changing Foundations of Political Communication. Journal of Communication. 2008;58(4):707–31.
  51. 51. Althaus SL, Coe K. Priming Patriots: Social Identity Processes and the Dynamics of Public Support for War. Public Opinion Quarterly. 2011;75(1):65–88.
  52. 52. Arceneaux K, Johnson M. Changing minds or changing channels?: Partisan news in an age of choice: University of Chicago Press; 2013.
  53. 53. Davis NT, Dunaway JL. Party Polarization, Media Choice, and Mass Partisan-Ideological Sorting. Public Opinion Quarterly. 2016;80(S1):272–97.
  54. 54. Stroud NJ. Media Use and Political Predispositions: Revisiting the Concept of Selective Exposure. Political Behavior. 2008;30(3):341–66.
  55. 55. Garrett RK. Politically Motivated Reinforcement Seeking: Reframing the Selective Exposure Debate. Journal of Communication. 2009;59(4):676–99.
  56. 56. Guess A, Nyhan B, Reifler J. Selective exposure to misinformation: Evidence from the consumption of fake news during the 2016 US presidential campaign. European Research Council. 2018;9(3):4.
  57. 57. Guess A, Nyhan B, O’Keeffe Z, Reifler J. The sources and correlates of exposure to vaccine-related (mis)information online. Vaccine. 2020;38(49):7799–805. pmid:33164802
  58. 58. Miller JM, Saunders KL, Farhart CE. Conspiracy endorsement as motivated reasoning: The moderating roles of political knowledge and trust. American Journal of Political Science. 2016;60(4):824–44.
  59. 59. Uscinski J, Enders AM, Klofstad C, Stoler J. Cause and Effect: On the Antecedents and Consequences of Conspiracy Theory Beliefs. Current Opinion in Psychology. 2022:101364. pmid:35728357
  60. 60. Uscinski J, Parent JM. American Conspiracy Theories. New York, NY, USA: Oxford University Press; 2014.
  61. 61. Edelman G. Let’s Keep the Vaccine Misinformation Problem in Perspective. Wiredcom [Internet]. 2021 11/13/2021. https://www.wired.com/story/lets-keep-vaccine-misinformation-problem-in-perspective/.
  62. 62. Jamison AM, Broniatowski DA, Dredze M, Sangraula A, Smith MC, Quinn SC. Not just conspiracy theories: Vaccine opponents and proponents add to the COVID-19 ‘infodemic’on Twitter. Harvard Kennedy School Misinformation Review. 2020;1(3).
  63. 63. Berinsky A, Margolis MF, Sances MW, Warshaw C. Using screeners to measure respondent attention on self-administered surveys: Which items and how many? Political Science Research and Methods. 2021;9(2):430–7. Epub 2019/11/12.
  64. 64. Shapiro GK, Tatar O, Dube E, Amsel R, Knauper B, Naz A, et al. The vaccine hesitancy scale: Psychometric properties and validation. Vaccine. 2018;36(5):660–7. pmid:29289384
  65. 65. Prooijen J-Wv. Psychological benefits of believing conspiracy theories. Current Opinion in Psychology. 2022;47:101352. pmid:35644093
  66. 66. Searles K, Smith G. Who’s the boss? Setting the agenda in a fragmented media environment. International Journal of Communication. 2016;10:22.
  67. 67. Vitriol JA, Marsh JK. A Pandemic of Misbelief: How Beliefs Promote or Undermine COVID-19 Mitigation. Frontiers in Political Science. 2021;3(54).
  68. 68. Bisgaard M. How Getting the Facts Right Can Fuel Partisan-Motivated Reasoning. American Journal of Political Science. 2019;63(4):824–39.
  69. 69. Guess A, Nyhan B, Reifler J. Exposure to untrustworthy websites in the 2016 US election. Nature Human Behaviour. 2020;4(5):472–80. pmid:32123342
  70. 70. Berriche M, Altay S. Internet users engage more with phatic posts than with health misinformation on Facebook. Palgrave Communications. 2020;6(1):71.
  71. 71. Guess A. (Almost) Everything in Moderation: New Evidence on Americans’ Online Media Diets. American Journal of Political Science. 2021;65(4):1007–22.
  72. 72. Arguedas AR, Robertson CT, Fletcher R, Nielsen RK. Echo chambers, filter bubbles, and polarisation: a literature review. https://reutersinstitute.politics.ox.ac.uk/echo-chambers-filter-bubbles-and-polarisation-literature-review?s=09: Reuters Institute, University of Oxford, 2022 January 19, 2022. Report No.
  73. 73. Kim JW, Guess A, Nyhan B, Reifler J. The Distorting Prism of Social Media: How Self-Selection and Exposure to Incivility Fuel Online Comment Toxicity. Journal of Communication. 2021.
  74. 74. Lawson MA, Kakkar H. Of pandemics, politics, and personality: The role of conscientiousness and political ideology in the sharing of fake news. Journal of Experimental Psychology: General. 2021. pmid:34694858
  75. 75. Jerit J, Zhao Y. Political Misinformation. Annual Review of Political Science. 2020;23(1):77–94.
  76. 76. Hochschild J, Einstein KL. ‘It Isn’t What We Don’t Know that Gives Us Trouble, It’s What We Know that Ain’t So’: Misinformation and Democratic Politics. British Journal of Political Science. 2014;45(3):467–75. Epub 12/22.
  77. 77. Kuklinski JH, Quirk PJ, Jerit J, Schwieder D, Rich RF. Misinformation and the Currency of Democratic Citizenship. Journal of Politics. 2000;62(3):790–816.
  78. 78. Bode L, Vraga E. The Swiss cheese model for mitigating online misinformation. Bulletin of the Atomic Scientists. 2021;77(3):129–33.
  79. 79. Guess A, Nagler J, Tucker J. Less than you think: Prevalence and predictors of fake news dissemination on Facebook. Science Advances. 2019;5(1). pmid:30662946
  80. 80. Broniatowski DA, Kerchner D, Farooq F, Huang X, Jamison AM, Dredze M, et al. Twitter and Facebook posts about COVID-19 are less likely to spread misinformation compared to other health topics. PLOS ONE. 2022;17(1):e0261768. pmid:35020727