Next Article in Journal
COVID-19 Vaccine Hesitancy and Its Associated Factors in Japan
Next Article in Special Issue
COVID-19 Vaccine and Social Media in the U.S.: Exploring Emotions and Discussions on Twitter
Previous Article in Journal
Development of a Macrophage-Based ADCC Assay
Previous Article in Special Issue
Knowledge and Acceptance of COVID-19 Vaccination among Undergraduate Students from Central and Southern Italy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Global Trends and Correlates of COVID-19 Vaccination Hesitancy: Findings from the iCARE Study

by
Jovana Stojanovic
1,2,
Vincent G. Boucher
2,3,
Myriam Gagne
4,
Samir Gupta
4,5,
Keven Joyal-Desmarais
1,2,
Stefania Paduano
6,
Ala’ S. Aburub
7,
Sherri N. Sheinfeld Gorin
8,
Angelos P. Kassianos
9,10,
Paula A. B. Ribeiro
2,
Simon L. Bacon
1,2 and
Kim L. Lavoie
2,3,*,†
1
Department of Health, Kinesiology & Applied Physiology, Concordia University, Montréal, QC H4B 1R6, Canada
2
Montreal Behavioural Medicine Centre, Research Centre, Centre Intégré Universitaire de Santé et de Services Sociaux du Nord de l’Ile de Montréal (CIUSSS-NIM), Montréal, QC H4J 1C5, Canada
3
Department of Psychology, University of Québec at Montreal (UQAM), Montréal, QC C3H 3P8, Canada
4
Unity Health Toronto, Department of Medicine, Division of Respirology, St. Michael’s Hospital, Toronto, ON M5B 1W8, Canada
5
Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael’s Hospital, University of Toronto, Toronto, ON M52 3M2, Canada
6
Section of Public Health, Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
7
Physical Therapy Department, Faculty of Allied Medical Sciences, Isra University, Queen Alia International Airport South of the Capital Amman, Amman 11622, Jordan
8
Department of Family Medicine, University of Michigan School of Medicine, Ann Arbor, MI 48109, USA
9
Department of Psychology, University of Cyprus, Nicosia 2109, Cyprus
10
Department of Applied Health Research, University College London, London WC1E 7HB, UK
*
Author to whom correspondence should be addressed.
On behalf of the iCARE Study Team.
Submission received: 5 May 2021 / Revised: 28 May 2021 / Accepted: 11 June 2021 / Published: 17 June 2021
(This article belongs to the Special Issue COVID-19 Vaccines: A Public Health Perspective)

Abstract

:
The success of large-scale COVID-19 vaccination campaigns is contingent upon people being willing to receive the vaccine. Our study explored COVID-19 vaccine hesitancy and its correlates in eight different countries around the globe. We analyzed convenience sample data collected between March 2020 and January 2021 as part of the iCARE cross-sectional study. Univariate and multivariate statistical analyses were conducted to explore the correlates of vaccine hesitancy. We included 32,028 participants from eight countries, and observed that 27% of the participants exhibited vaccine hesitancy, with increases over time. France reported the highest level of hesitancy (47.3%) and Brazil reported the lowest (9.6%). Women, younger individuals (≤29 years), people living in rural areas, and those with a lower perceived income were more likely to be hesitant. People who previously received an influenza vaccine were 70% less likely to report COVID-19 vaccine hesitancy. We observed that people reporting greater COVID-19 health concerns were less likely to be hesitant, whereas people with higher personal financial concerns were more likely to be hesitant. Our findings indicate that there is substantial vaccine hesitancy in several countries, with cross-national differences in the magnitude and direction of the trend. Vaccination communication initiatives should target hesitant individuals (women, younger adults, people with lower incomes and those living in rural areas), and should highlight the immediate health, social and economic benefits of vaccination across these settings. Country-level analyses are warranted to understand the complex psychological, socio-environmental, and cultural factors associated with vaccine hesitancy.

1. Introduction

In 2019, low vaccine intentions or vaccine hesitancy, defined as a ‘delay in acceptance or refusal of vaccination despite availability of vaccination services’ was reported as one of the top ten threats to global health by the World Health Organization [1,2]. Hesitancy is a complex and dynamic problem, driven by individual and group factors, context-specific issues, and vaccine-specific influences [3,4]. The impact of these factors can be hard to predict within unstable environments such as pandemics and epidemics.
Since the beginning of the SARS-CoV-2 pandemic, major public health prevention efforts, such as social isolation, contact tracing, masks, and lockdowns, have been implemented throughout affected countries to lessen the unprecedented health and social impacts [5]. Importantly, significant investments were made by several countries to rapidly develop and test SARS-CoV-2 vaccines. By the beginning of 2021, seven vaccines were approved in various countries, and around half a million doses were administered globally. Since then, the rollout has substantially increased—as of April 2021, over 12 million people had received at least one dose worldwide [6,7,8].
Beyond the complex logistical issues around mass manufacturing, global access and distribution [9], COVID-19 vaccine hesitancy among the public might threaten governments’ hopes of achieving herd immunity [10]. Despite initial data showing promising vaccine uptake among those who are willing [6], substantial work needs to be done moving forward in order to incentivize those who are ambivalent and hesitant to receive the vaccine. This has proved to be difficult in situations with an evolving epidemiological situation [11], the emergence of novel viral variants [12,13], and a continuous inflow of new vaccine-related information (including complications) [14]. Public health institutions are struggling to combat emergent factors influencing the surge in vaccine hesitancy, many of which are unique to the current pandemic-related circumstances, such as concerns about the expedited process of vaccine development, testing, and approval, the vaccine and COVID-19 infodemic (including a great deal of false information), and the politicization of vaccines [15].
To date, an increasing number of studies have shown that COVID-19 vaccine hesitancy can range from less than 10% to an overwhelming 40–50%, with great variability across different countries and sub-populations [16,17,18]. However, there is limited availability of single-study data that enable direct cross-country comparisons of COVID-19 vaccine hesitancy, using a consistent formulation of the hesitancy question over time [16,18].
Understanding and continuously assessing COVID-19-specific predictors of vaccine hesitancy could help prioritize communication targets, and help tailor the message format and content, with the goal of better addressing the underlying reasons for vaccine hesitancy and instilling trust in the public. With this aim in mind, we provide a map of this issue, assess changes over time, and evaluate the diverse correlates of vaccine hesitancy across eight countries. This is the first study to describe COVID-19 vaccine hesitancy using the consistent measure of hesitancy throughout seven waves of survey data collection, across three different continents.

2. Materials and Methods

2.1. Study Design

The iCARE Study (www.icarestudy.com (accessed on 14 June 2021)) is an ongoing international cross-sectional survey series that uses different survey recruitment approaches to capture public awareness and attitudes towards COVID-19 and related public health measures. The iCARE study is led by researchers at the Montreal Behavioural Medicine Centre (MBMC: https://mbmc-cmcm.ca/covid19/ (accessed on 14 June 2021)). The details and methodological background of the iCARE study have been published elsewhere [19].

2.2. Study Participants and Recruitment

We report data from the iCARE global convenience sample from 27 March 2020 to 31 January 2021. The iCARE survey (distributed using LimeSurvey© from Montreal, Canada) was administered in 40 countries around the world using an online snowball sampling strategy, through the direct engagement of the study collaborators. The survey distribution occurred through professional associations and societies, university networks, community organizations and groups, social media, and personal contacts.
To ensure sufficient global representation with consistency over time, we divided the study timeline into three different periods, based on the global COVID-19 epidemiological situation: period 1: 27 March–31 May 2020; period 2: 1 June–15 September 2020; and period 3: 16 September 2020–31 January 2021 (Supplementary Table S1). Eight countries (Brazil, Canada, Colombia, France, Italy, Turkey, the United Kingdom (UK), the United States of America (USA)), with a total of 32,028 participants were included in the analysis.
The study was approved by the Research Ethics Committee at the Centre intégré universitaire de santé et de services sociaux du Nord-de-l’Île-de-Montréal (CIUSSS-NIM) (REB#: 2020-2099/03-25-2020). The present paper is presented in line with the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement (Supplementary Table S2) [20].

2.3. iCARE Survey Questionnaire

The survey was designed to measure constructs related to the COM-B Model [21], which predicts that behaviour change depends on the awareness of prevention measures (capability), individuals’ beliefs that measures are personally relevant and important (motivation) and social and environmental structures that enable the required behaviours (opportunity); and the Health Beliefs Model [22], which predicts that behaviour change depends on individuals’ belief in the personal threat(s) of the disease, as well as their beliefs around how important and effective the recommended behaviour is. Survey questions included the following: sociodemographic variables; physical/mental health; prior COVID-19 infection; general health behaviours; awareness of local government and municipal policies; perceptions and attitudes about these policies; concerns about the virus and its impacts; behavioural responses; and vaccine intentions (available online: https://osf.io/nswcm/ (accessed on 14 June 2021)). A detailed map of the survey questions to the theoretical behaviour change frameworks is provided elsewhere [19]. COVID-19 vaccine intentions were assessed using the question “If a vaccine for COVID-19 were available today, what is the likelihood that you would get vaccinated?” (possible responses: Extremely likely, Somewhat likely, Unlikely, Very unlikely, and I don’t know/prefer not to answer). All the questionnaire items that included an ‘I don’t know/I prefer not to answer’ response were considered missing values. In our analyses, we dichotomized this variable into “Extremely likely” (not vaccine hesitant) vs. all others (vaccine hesitant).
COVID-related concerns were measured with different survey items, with the following possible answers: To a Great Extent, Somewhat, Very Little, and Not at All.

2.4. Data Analysis

Descriptive statistics were calculated to provide an overview of the study sample in terms of their sociodemographic characteristics and selected lifestyle habits, according to the vaccine intentions response. Additional graphical presentations are provided to present changes in vaccine intentions between different countries and across time points. All questionnaire items that included an ‘I don’t know/I prefer not to answer’ response were considered missing values, and statistical analyses were based on complete case records.
We applied univariate and multivariate logistic regressions in order to evaluate the association between vaccine hesitancy (dependent variable) and a series of demographic and health factors (independent variables), which were pre-selected based on the previous literature (age, sex, perceived income, education, continent, residential area (i.e., urban, suburban and rural), the presence of chronic health conditions, and influenza vaccination history) [4]. The Cochran–Armitage test for trends was used to assess whether a trend in vaccine hesitancy was present across ordered periods of time, both in the overall sample and across individual countries.
To cluster the COVID-19-related concerns, we performed a principal component analysis (PCA) with varimax rotation on a polychoric correlation matrix of 11 items that were assessed in every survey of the iCARE study. We identified four components based on the Kaiser criterion (eigenvalue > 1.0), scree plot, and components’ interpretability [23]. Items with component loadings higher than 0.4 were used to interpret each component of the COVID-19 concerns. The four components were: ‘Health concerns (self)’, including concerns about being infected and the impact of infection on one’s health, ‘Health concerns (others)’, including concerns about infecting close individuals and people in the community; ‘Personal financial concerns’, including concerns about losing income and inability to pay food or housing; ‘Social/economic concerns’, including concerns around the country entering an economic recession and how long it will take to return to normal (see Supplementary Table S3 for a list of items and component loadings). A separate multivariate logistic model was applied to test the associations between vaccine hesitancy (dependent variable) and these four COVID-19-related concern variables, with adjustments for age, sex, education, residential area, continent, and survey period. All statistical tests were two-sided, and a p-value < 0.05 was considered statistically significant. The statistical analysis was performed using SAS, version 9.4.

3. Results

3.1. Sample Description

Our sample included 32,028 responses from eight countries across three different continents (North America, South America, and Europe). The majority of individuals were female (72.2%), between 30 and 64 years of age (60.6%), with a graduate or postgraduate degree (77.3%) and in the middle third of perceived income (54.1%) (Table 1, Supplementary Table S4). Around two-thirds of respondents lived in urban areas. The sociodemographic characteristics of our samples, broken down by time and individual country, can be found in Supplementary Tables S4 and S5.

3.2. Estimates of Vaccine Hesitancy and Changes over Time

Overall, almost 27% of our sample reported vaccine hesitancy (Supplementary Figure S1). We observed significant increases in hesitancy levels across our entire sample over time (period one: 25.6%; period two: 27.5%; period three: 29.9%, p < 0.0001 for trend, see Figure 1). When looking at individual countries, French residents reported the highest rate of vaccine hesitancy (39.9%, 51.2%, and 50.9% across period one, two, and three, respectively) and Brazilian residents reported the lowest (8.4%, 9.5%, and 11.1% in period one, two, and three, respectively). Italy reported low proportions when the country was hardest hit during the initial period of the pandemic (9.3%), but hesitancy then increased to around 19% in period 3 (p < 0.0001 for trend). Significant trends in increased vaccine hesitancy were also observed in Canada, Colombia, France, Turkey and the USA (data not shown). Conversely, there was a non-significant trend towards a decrease in hesitancy from 26.7% in period 1 and 27.6% in period 2, to 20.3% in period 3 among UK residents (p = 0.35 for trend).

3.3. Predictors of Vaccine Hesitancy

Table 2 presents the findings from the univariate and multivariate analyses examining the association between vaccine hesitancy and the sociodemographic and health characteristics of individuals. In the following section, we provide a summary of the multivariate analysis. Males, older adults and urban-dwelling individuals were less likely to report COVID-19 vaccine hesitancy (OR = 0.84, 95% CI = 0.78–0.91 for males compared to females; OR = 0.75, 95% CI = 0.64–0.88 for individuals over 65 compared to under 29 years old; and OR = 0.83, 95% CI = 0.74–0.92 for individuals living in urban compared to rural areas). Furthermore, compared to people with the lowest perceived income, those reported as being in the middle or top tertile for income expressed a lower likelihood of vaccine hesitancy (OR = 0.81, 95% CI = 0.73–0.90 and OR = 0.53, 95% CI = 0.47–0.59 for middle and top income tertiles compared to the lowest tertile, respectively). Those reporting a history of influenza vaccination were 70% less likely to report any level of COVID-19 vaccine hesitancy (OR = 0.26, 95% CI = 0.24–0.29). Having a chronic health condition was significantly associated with lower hesitancy in the univariate analysis, but these effects were attenuated in the multivariate models. In our multivariate modelling analysis, we clustered the countries into continents and observed that, compared to individuals from North America, individuals from Europe were 37% more likely and those from South America were 35% less likely to report vaccine hesitancy.

3.4. Association between COVID-19-Related Concerns and Vaccine Hesitancy

In line with the constructs of the Health Beliefs and COM-B models, we evaluated the association between COVID-19-related concerns and vaccine hesitancy in a multivariate analysis adjusted for age, sex, education, living area, continent, and survey period. Our analysis showed that people with higher personal health concerns and higher health concerns for other individuals were significantly more likely not to report hesitancy (β = −0.374, p < 0.001; and β = −0.309, p < 0.001, respectively) (Table 3). In contrast, people with higher levels of personal financial concerns were more likely to be hesitant (β = 0.369, p < 0.001). Lastly, having higher social/economic concerns was significantly associated with not being hesitant (β = −0.199, p < 0.001).

4. Discussion

We used a multi-round cross sectional survey to understand the trends in COVID-19 vaccine hesitancy in over 32,000 individuals from eight countries. We further sought to identify factors associated with vaccine hesitancy as a function of sociodemographic characteristics and reported COVID-19-related concerns.
Our data show that COVID-19 vaccine hesitancy has increased over time across seven countries in our sample, which may signal a troubling trend globally. Although most countries are in the early to mid-phases of their vaccine campaign, and demand exceeds supply in most settings, given the estimated required population vaccination threshold of 70–80% for herd immunity, our findings suggest that a focus on vaccine hesitant individuals will be required for the global vaccination effort to ultimately succeed. This can be particularly troubling for countries such as France and Turkey, which reported the highest hesitancy estimates across all three time points, in line with the previously published literature [4,24]. On the contrary, the Brazilian population was the most vaccine receptive in our dataset, with hesitancy levels ranging from only 8 to 11%. These estimates are somewhat comparable to representative sample data reported by Lazarus et al. in June 2020, showing high acceptance across Latin American countries (including 85% vaccine acceptance in Brazil) [25]. Moreover, the UK was the only country in our sample that reported promising decreases in hesitancy over time. This positive turnaround was also observed in a longitudinal analysis from England and Wales, showing that almost four in five adults who were hesitant in December 2020 planned to receive or had already obtained the vaccine in February 2021. This shift can be attributed to the early vaccine availability, aggressive vaccination campaign and public health communication efforts [26]. Our analyses demonstrated a high degree of variability in vaccine hesitance across countries when measured at the same time and with the same measures. This likely reflects the complex interplay between social, cultural, demographic, and public health-related determinants of vaccine hesitancy, and requires further study.
We identified several sociodemographic correlates of poor COVID-19 vaccine intentions. Certain demographic characteristics were associated with higher hesitancy (being female, of a younger age, living in a rural area, and having a lower perceived income). This is largely in line with the published COVID-19 literature and with evidence from previous pandemics [16,18,25,27,28,29]. We observed that women, compared to men, experienced greater hesitancy levels, similar to the growing body of COVID-19 literature [30,31]. Our finding is somewhat surprising, especially considering that women continuously reported better adherence to COVID-19 preventive behaviours, most likely due to increased risk perceptions [32,33] and greater concerns about the negative health and social impacts of the virus [34,35]. However, sex differences in vaccination outcomes have been documented previously, with women reporting higher antibody responses [36] and more adverse events following vaccination for influenza, hepatitis B, and yellow fever vaccines [36,37]. Relative to the COVID-19 vaccines, rare and serious side effects were more prevalent among females in two widely used vaccines, which may have led to increased levels of worries and safety concerns among this population [35,36,38,39,40].
Our data showed that respondents over 65 years of age had 25% lower odds of hesitancy, compared to individuals under 30. Higher levels of risk perception and actual risk of getting sick or developing serious complications from COVID in older individuals most likely explain these differences [41]. Almost 30% of younger and middle-aged adults reported some levels of hesitancy, which might significantly undermine vaccine rollout efforts in community-dwelling adults. Moreover, our analyses demonstrated that there are socioeconomic disparities in vaccine acceptance. Individuals with a lower perceived income reported poor vaccine intentions; however, they are at increased risk of acquiring the infection, as well as suffering from negative direct or indirect consequences of COVID-19 [5,42]. This suggests that there is an urgent need for governments and health authorities to study the determinants of hesitancy in these groups more closely, and to develop correspondingly targeted interventions for these populations. This will require investments in areas such as increasing vaccine and overall health literacy, as well as acknowledging previously identified sources of vaccine hesitancy in these populations, such as distrust of healthcare systems and authority [3]. In many settings, these individuals are also more likely to be from racialized and new immigrant communities, suggesting the need for culturally and linguistically sensitive vaccination messages. Lastly, our data demonstrated a strong influence from past behaviours, with individuals reporting a previous influenza inoculation having 70% lower odds of hesitancy, compared to individuals that did not. These findings might reflect the fact that individuals’ previous positive experiences with influenza vaccines may have resulted in them having more reassuring attitudes towards COVID vaccination. To support this, findings from previous [28,29] and current pandemics [43,44,45,46,47,48] showed that regular influenza vaccine takers reported increased risk perception regarding H1N1 influenza, as well as positive attitudes in regard to vaccine safety and the value of vaccination in general.
Population-specific concerns and motivations may be leveraged to create targets for vaccine hesitancy communication strategies. A large body of literature suggests that vaccination decisions may depend on perceptions about individual and community risk [49]. This is consistent with both the Health Beliefs and COM-B models, which assume that greater concerns about the health consequences of the virus (on an individual, friends, family, and the community) can influence both the intention and adoption of disease prevention measures, such as vaccination. In reference to this, we evaluated the relationship between different types of COVID-19-related concerns and vaccine hesitancy. Our results demonstrated that individuals with higher levels of personal health concerns were less likely to report vaccine hesitancy, consistent with prior studies carried throughout the countries [27,43,44,50,51]. Moreover, elevated concerns about the health of other individuals, including family and friends, were significantly associated with lower vaccine hesitancy in our study. These findings demonstrate that communications should stress the social benefits of vaccination, including the protection of close individuals and society as a whole [52]. Finally, our multivariate modelling revealed that people with higher personal financial concerns were more likely to demonstrate vaccine hesitancy, which parallels previous iCARE data showing that adherence to other COVID-19 preventive behaviours correlates with individuals’ financial situation and concerns [35]. Importantly, considering the negative impacts of the current pandemic on the broader economies of societies and individuals, our results suggest that communication strategies for increasing vaccine uptake should address the economic benefits of vaccination, including positive economic impacts on individual families (i.e., a reduced need for further societal lockdowns, affecting businesses, and the personal ability to avoid reduced productivity at work and a loss of pay due to illness and recovery) [53]. Reflecting upon the COM-B model, which stresses the importance of having suitable social and environmental resources for behaviour change, it is likely that the financial concerns evaluated in our study represent an important aspect of the ‘reflective motivation’ for enabling the adoption of the vaccine behaviour.
Our study has several limitations. We employed a multi-round cross-sectional survey, which enabled us to provide snapshots across different periods of time, but direct causality between the variables of interest and vaccine hesitancy cannot be inferred. Data were collected using a convenience sample methodology, with an overrepresentation of women and highly educated individuals. The outputs may not be representative of the general population in the individual countries. However, our data might be underestimating the extent of hesitancy in the general population in these countries. Unpublished data from the iCARE representative sample reported higher figures of hesitancy in the Canadian population, ranging from 35% in April to 49% in November, 2020 [54]. Furthermore, our data were collected up to January 2021, a time point in which many of the countries began their vaccination campaigns, which might have affected overall hesitancy rates in the population. Nevertheless, the predictors of hesitancy are unlikely to change dramatically and our analysis still provides a way forward with regard to which groups to target and how. Moreover, we acknowledge the absence of validated vaccine hesitancy measures and the fact that the iCARE questionnaire measured participants’ intention to receive a vaccination, which overestimates actual vaccination behaviour, though it is noted that intentions are among the best predictors of actual behaviour [55]. Lastly, we did not analyze the influence of certain other predictors, such as trust in different information sources and the government, as these questions were not assessed in each version of the survey.

5. Conclusions

In summary, global vaccine hesitancy increased between the beginning of the pandemic, in March 2020, and the period immediately before the wide release of vaccines, in January 2021. Hesitancy varied across the eight countries in our sample, and temporal trends showed increases in vaccine hesitancy for the majority of the studied countries. Future analyses should explore how the complex social, environmental, psychological, and cultural differences between countries may influence vaccine hesitancy. We also noted that those of the female sex, those of a younger age, those who live in rural areas, and those with a lower perceived income were more likely to be vaccine hesitant, as were those with lower perceptions of their own and others’ COVID-19-related health risks and those who reported higher degrees of personal financial concern. These participants should be key target audiences for global vaccination campaigns, and the findings indicate the need to address population-specific concerns around health and finances in vaccine communications.

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/vaccines9060661/s1, Figure S1. Vaccine intentions in the overall sample (with percentages of individuals that are Extremely likely, Somewhat likely, Unlikely, and Very unlikely to receive the vaccine); Table S1. Recruitment numbers across individual countries (n = 32,028), and survey periods mapped to the epidemiology of COVID-19; Table S2. STROBE Checklist; Table S3. Principal component analysis of 11 concern-related items in iCARE (overview of item correlations, component mean values, loadings and graphical presentation of Eigen values (scree plot)); Table S4. Sociodemographic characteristics of participants (in the overall sample, and across the three periods of time); Table S5. Sociodemographic characteristics of participants (across individual countries).

Author Contributions

Conceptualization, J.S., V.G.B., M.G., S.G., K.J.-D., S.P., A.S.A., S.N.S.G., P.A.B.R., S.L.B. and K.L.L.; methodology, J.S., V.G.B., M.G., S.G., K.J.-D., S.P., A.S.A., S.N.S.G., P.A.B.R., S.L.B. and K.L.L.; formal analysis, J.S.; analysis interpretation, J.S., V.G.B., M.G., S.G., K.J.-D., S.P., A.S.A., S.N.S.G., A.P.K., P.A.B.R., S.L.B. and K.L.L.; writing—original draft preparation, J.S.; writing—review and editing, V.G.B., M.G., S.G., K.J.-D., S.P., A.S.A., S.N.S.G., A.P.K., P.A.B.R., S.L.B. and K.L.L.; funding acquisition, K.L.L., S.L.B., J.S., K.J.-D., V.G.B. All authors have read and agreed to the published version of the manuscript.

Funding

iCARE is supported by the Canadian Institutes of Health Research (CIHR: MM1-174903; MS3-173099; SMC-151518), the Canada Research Chairs Program (950-232522, chair holder: Dr. Kim L. Lavoie), the Fonds de recherche du Québec-santé (FRQ-S: 251618 and 34757), the Fonds de recherche du Québec-Société et culture (FRQSC: 2019-SE1-252541), and the Ministère de l’Économie et de l’Innovation du Québec (2020-2022-COVID-19-PSOv2a-51754). The study sponsors had no role in the design of the database or the data collection.

Institutional Review Board Statement

The study was approved by the Research Ethics Committee at the Centre intégré universitaire de santé et de services sociaux du Nord-de-l’Île-de-Montréal (CIUSSS-NIM) (REB#: 2020-2099/03-25-2020).

Informed Consent Statement

Subjects’ consent was waived due to non-identifiable nature of the data that were collected.

Data Availability Statement

The iCARE study data are available on request via the process identified here: https://mbmc-cmcm.ca/covid19/apl/ (accessed on 14 June 2021).

Acknowledgments

We acknowledge the support from our MBMC iCARE Team, the particularly administrative support of Guillaume Lacoste and Katherine Seguin, and the analytic support of Ruth Bruno.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. MacDonald, N.E.; Eskola, J.; Liang, X.; Chaudhuri, M.; Dube, E.; Gellin, B.; Goldstein, S.; Larson, H.; Manzo, M.L.; Reingold, A.; et al. Vaccine hesitancy: Definition, scope and determinants. Vaccine 2015, 33, 4161–4164. [Google Scholar] [CrossRef]
  2. Ten Threats to Global Health in 2019. Available online: https://www.who.int/news-room/spotlight/ten-threats-to-global-health-in-2019 (accessed on 20 April 2021).
  3. de Figueiredo, A.; Simas, C.; Karafillakis, E.; Paterson, P.; Larson, H.J. Mapping global trends in vaccine confidence and investigating barriers to vaccine uptake: A large-scale retrospective temporal modelling study. Lancet 2020, 396, 898–908. [Google Scholar] [CrossRef]
  4. Larson, H.J.; Jarrett, C.; Eckersberger, E.; Smith, D.M.D.; Paterson, P. Understanding vaccine hesitancy around vaccines and vaccination from a global perspective: A systematic review of published literature, 2007–2012. Vaccine 2014, 32, 2150–2159. [Google Scholar] [CrossRef]
  5. Nicola, M.; Alsafi, Z.; Sohrabi, C.; Kerwan, A.; Al-Jabir, A.; Iosifidis, C.; Agha, M.; Agha, R. The socio-economic implications of the coronavirus pandemic (COVID-19): A review. Int. J. Surg. 2020, 78, 185–193. [Google Scholar] [CrossRef]
  6. Covid World Vaccination Tracker—The New York Times. Available online: https://www.nytimes.com/interactive/2021/world/covid-vaccinations-tracker.html (accessed on 20 April 2021).
  7. Covid-19 Vaccine Tracker. Available online: https://vac-lshtm.shinyapps.io/ncov_vaccine_landscape/ (accessed on 20 April 2021).
  8. Shrotri, M.; Swinnen, T.; Kampmann, B.; Parker, E.P.K. An interactive website tracking COVID-19 vaccine development. Lancet Glob. Heal. 2021, 9, e590–e592. [Google Scholar] [CrossRef]
  9. Wouters, O.J.; Shadlen, K.C.; Salcher-Konrad, M.; Pollard, A.J.; Larson, H.J.; Teerawattananon, Y.; Jit, M. Challenges in ensuring global access to COVID-19 vaccines: Production, affordability, allocation, and deployment. Lancet 2021, 397, 1023–1034. [Google Scholar] [CrossRef]
  10. Wang, W.; Wu, Q.; Yang, J.; Dong, K.; Chen, X.; Bai, X.; Chen, X.; Chen, Z.; Viboud, C.; Ajelli, M.; et al. Global, regional, and national estimates of target population sizes for COVID-19 vaccination. medRxiv 2020. [Google Scholar] [CrossRef]
  11. Global.Health. A Data Science Initiative. Available online: https://global.health/ (accessed on 20 April 2021).
  12. Abu-Raddad, L.J.; Chemaitelly, H.; Butt, A.A. Effectiveness of the BNT162b2 Covid-19 Vaccine against the B.1.1.7 and B.1.351 Variants. N. Engl. J. Med. 2021. [Google Scholar] [CrossRef] [PubMed]
  13. Adam, D. What scientists know about new, fast-spreading coronavirus variants. Nature 2021. [Google Scholar] [CrossRef] [PubMed]
  14. Puri, N.; Coomes, E.A.; Haghbayan, H.; Gunaratne, K. Social media and vaccine hesitancy: New updates for the era of COVID-19 and globalized infectious diseases. Hum. Vaccines Immunother. 2020, 16, 1–8. [Google Scholar] [CrossRef]
  15. Limaye, R.J.; Sauer, M.; Truelove, S.A. Politicizing public health: The powder keg of rushing COVID-19 vaccines. Hum. Vaccines Immunother. 2020. [Google Scholar] [CrossRef]
  16. Sallam, M. Covid-19 vaccine hesitancy worldwide: A concise systematic review of vaccine acceptance rates. Vaccines 2021, 9, 160. [Google Scholar] [CrossRef]
  17. Lazarus, J.V.; Wyka, K.; Rauh, L.; Rabin, K.; Ratzan, S.; Gostin, L.O.; Larson, H.J.; El-Mohandes, A. Hesitant or Not? The Association of Age, Gender, and Education with Potential Acceptance of a COVID-19 Vaccine: A Country-level Analysis. J. Health Commun. 2020, 25, 799–807. [Google Scholar] [CrossRef]
  18. Lin, C.; Tu, P.; Beitsch, L.M. Confidence and receptivity for covid-19 vaccines: A rapid systematic review. Vaccines 2021, 9, 16. [Google Scholar] [CrossRef] [PubMed]
  19. Bacon, S.L.; Lavoie, K.L.; Boyle, J.; Stojanovic, J.; Joyal-Desmarais, K. International assessment of the link between COVID-19 related attitudes, concerns and behaviours in relation to public health policies: Optimising policy strategies to improve health, economic and quality of life outcomes (the iCARE Study). BMJ Open 2021, 11, 46127. [Google Scholar] [CrossRef] [PubMed]
  20. von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. J. Clin. Epidemiol. 2008, 61, 344–349. [Google Scholar] [CrossRef] [Green Version]
  21. Michie, S.; van Stralen, M.M.; West, R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement. Sci. 2011, 6. [Google Scholar] [CrossRef] [Green Version]
  22. Rosenstock, I.M. The Health Belief Model and Preventive Health Behavior. Health Educ. Monogr. 1974, 2, 354–386. [Google Scholar] [CrossRef]
  23. Kaiser, H.F. The Application of Electronic Computers to Factor Analysis. Educ. Psychol. Meas. 1960, 20, 141–151. [Google Scholar] [CrossRef]
  24. Salali, G.D.; Uysal, M.S. COVID-19 vaccine hesitancy is associated with beliefs on the origin of the novel coronavirus in the UK and Turkey. Psychol. Med. 2020, 1, 1–3. [Google Scholar] [CrossRef]
  25. Lazarus, J.V.; Ratzan, S.C.; Palayew, A.; Gostin, L.O.; Larson, H.J.; Rabin, K.; Kimball, S.; El-Mohandes, A. A global survey of potential acceptance of a COVID-19 vaccine. Nat. Med. 2021, 27, 225–228. [Google Scholar] [CrossRef] [PubMed]
  26. Byrne, T.; Patel, P.; Shrotri, M.; Beale, S.; Michie, S.; Butt, J.; Hawkins, N.; Hardelid, P.; Rodger, A.; Aryee, A.; et al. Trends, patterns and psychological influences on COVID-19 vaccination intention: Findings from a large prospective community cohort study in England and Wales (Virus Watch). medRxiv 2021. [Google Scholar] [CrossRef]
  27. Neumann-Böhme, S.; Varghese, N.E.; Sabat, I.; Barros, P.P.; Brouwer, W.; van Exel, J.; Schreyögg, J.; Stargardt, T. Once we have it, will we use it? A European survey on willingness to be vaccinated against COVID-19. Eur. J. Heal. Econ. 2020, 21, 977–982. [Google Scholar] [CrossRef]
  28. Bish, A.; Yardley, L.; Nicoll, A.; Michie, S. Factors associated with uptake of vaccination against pandemic influenza: A systematic review. Vaccine 2011, 29, 6472–6484. [Google Scholar] [CrossRef]
  29. Brien, S.; Kwong, J.C.; Buckeridge, D.L. The determinants of 2009 pandemic A/H1N1 influenza vaccination: A systematic review. Vaccine 2012, 30, 1255–1264. [Google Scholar] [CrossRef]
  30. Latkin, C.A.; Dayton, L.; Yi, G.; Colon, B.; Kong, X. Mask usage, social distancing, racial, and gender correlates of COVID-19 vaccine intentions among adults in the US. PLoS ONE 2021, 16, e0246970. [Google Scholar] [CrossRef]
  31. Green, M.S.; Abdullah, R.; Vered, S.; Nitzan, D. A study of ethnic, gender and educational differences in attitudes toward COVID-19 vaccines in Israel—Implications for vaccination implementation policies. Isr. J. Health Policy Res. 2021, 10, 26. [Google Scholar] [CrossRef]
  32. Gustafson, P.E. Gender differences in risk perception: Theoretical and methodological perspectives. Risk Anal. 1998, 18, 805–811. [Google Scholar] [CrossRef] [PubMed]
  33. Dryhurst, S.; Schneider, C.R.; Kerr, J.; Freeman, A.L.J.; Recchia, G.; van der Bles, A.M.; Spiegelhalter, D.; van der Linden, S. Risk perceptions of COVID-19 around the world. J. Risk Res. 2020, 23, 994–1006. [Google Scholar] [CrossRef]
  34. COVID-19 and Its Economic Toll on Women: The Story behind the Numbers; UN Women: New York, NY, USA, 2020; Available online: https://www.unwomen.org/en/news/stories/2020/9/feature-covid-19-economic-impacts-on-women (accessed on 20 April 2021).
  35. Lavoie, K.L.; Gosselin-Boucher, V.; Stojanovic, J.; Voisard, B.; Szczepanik, G.; Boyle, J.A.; Belanger-Gravel, A.; Bacon, S.L. Determinants of adherence to COVID-19 preventive behaviours in Canada: Results from the iCARE Study. medRxiv 2021. [Google Scholar] [CrossRef]
  36. Flanagan, K.L.; Fink, A.L.; Plebanski, M.; Klein, S.L. Sex and gender differences in the outcomes of vaccination over the life course. Annu. Rev. Cell Dev. Biol. 2017, 33, 577–599. [Google Scholar] [CrossRef] [PubMed]
  37. Kleina, S.L.; Marriott, I.; Fish, E.N. Sex-based differences in immune function and responses to vaccination. Trans. R. Soc. Trop. Med. Hyg. 2014, 109, 9–15. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Galasso, V.; Pons, V.; Profeta, P.; Becher, M.; Brouard, S.; Foucault, M. Gender differences in COVID-19 attitudes and behavior: Panel evidence from eight countries. Proc. Natl. Acad. Sci. USA 2020, 117, 27285–27291. [Google Scholar] [CrossRef] [PubMed]
  39. COVID-19 Vaccine Janssen: EMA Finds Possible Link to Very Rare Cases of Unusual Blood Clots with Low Blood Platelets; European Medicines Agency: Amsterdam, The Netherlands, 2021. Available online: https://www.ema.europa.eu/en/news/covid-19-vaccine-janssen-ema-finds-possible-link-very-rare-cases-unusual-blood-clots-low-blood (accessed on 3 May 2021).
  40. AstraZeneca’s COVID-19 Vaccine: EMA Finds Possible Link to Very Rare Cases of Unusual Blood Clots with Low Blood Platelets; European Medicines Agency: Amsterdam, The Netherlands, 2021. Available online: https://www.ema.europa.eu/en/news/astrazenecas-covid-19-vaccine-ema-finds-possible-link-very-rare-cases-unusual-blood-clots-low-blood (accessed on 3 May 2021).
  41. Booth, A.; Reed, A.B.; Ponzo, S.; Yassaee, A.; Aral, M.; Plans, D.; Labrique, A.; Mohan, D. Population risk factors for severe disease and mortality in COVID-19: A global systematic review and meta-analysis. PLoS ONE 2021, 16, e0247461. [Google Scholar] [CrossRef]
  42. Whitehead, M.; Taylor-Robinson, D.; Barr, B. Poverty, health, and covid-19. BMJ 2021, 372, n376. [Google Scholar] [CrossRef]
  43. Caserotti, M.; Girardi, P.; Rubaltelli, E.; Tasso, A.; Lotto, L.; Gavaruzzi, T. Associations of COVID-19 risk perception with vaccine hesitancy over time for Italian residents. Soc. Sci. Med. 2021, 272, 113688. [Google Scholar] [CrossRef]
  44. Paul, E.; Steptoe, A.; Fancourt, D. Attitudes towards vaccines and intention to vaccinate against COVID-19: Implications for public health communications. Lancet Reg. Heal. Eur. 2021, 1, 100012. [Google Scholar] [CrossRef]
  45. Schwarzinger, M.; Watson, V.; Arwidson, P.; Alla, F.; Luchini, S. COVID-19 vaccine hesitancy in a representative working-age population in France: A survey experiment based on vaccine characteristics. Lancet Public Heal. 2021, 6, e210–e221. [Google Scholar] [CrossRef]
  46. Fridman, A.; Gershon, R.; Gneezy, A. COVID-19 and vaccine hesitancy: A longitudinal study. PLoS ONE 2021, 16, e0250123. [Google Scholar] [CrossRef]
  47. Szmyd, B.; Karuga, F.F.; Bartoszek, A.; Staniecka, K.; Siwecka, N.; Bartoszek, A.; Błaszczyk, M.; Radek, M. Attitude and behaviors towards sars-cov-2 vaccination among healthcareworkers: A cross-sectional study from Poland. Vaccines 2021, 9, 218. [Google Scholar] [CrossRef]
  48. Szmyd, B.; Bartoszek, A.; Karuga, F.F.; Staniecka, K.; Błaszczyk, M.; Radek, M. Medical students and sars-cov-2 vaccination: Attitude and behaviors. Vaccines 2021, 9, 128. [Google Scholar] [CrossRef]
  49. Brewer, N.T.; Chapman, G.B.; Gibbons, F.X.; Gerrard, M.; McCaul, K.D.; Weinstein, N.D. Meta-analysis of the relationship between risk perception and health behavior: The example of vaccination. Heal. Psychol. 2007, 26, 136–145. [Google Scholar] [CrossRef] [Green Version]
  50. Faasse, K.; Newby, J. Public Perceptions of COVID-19 in Australia: Perceived Risk, Knowledge, Health-Protective Behaviors, and Vaccine Intentions. Front. Psychol. 2020, 11, 551004. [Google Scholar] [CrossRef] [PubMed]
  51. Loomba, S.; de Figueiredo, A.; Piatek, S.J.; de Graaf, K.; Larson, H.J. Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA. Nat. Hum. Behav. 2021, 5, 337–348. [Google Scholar] [CrossRef] [PubMed]
  52. Betsch, C.; Böhm, R.; Korn, L. Inviting free-riders or appealing to prosocial behavior? Game-theoretical reflections on communicating herd immunity in vaccine advocacy. Health Psychol. 2013, 32, 978–985. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Rodrigues, C.M.C.; Plotkin, S.A. Impact of Vaccines; Health, Economic and Social Perspectives. Front. Microbiol. 2020, 11, 1526. [Google Scholar] [CrossRef] [PubMed]
  54. iCARE Study. Infographics—MBMC. Available online: https://mbmc-cmcm.ca/covid19/research/infog/ (accessed on 4 May 2021).
  55. McEachan, R.; Taylor, N.; Harrison, R.; Lawton, R.; Gardner, P.; Conner, M. Meta-Analysis of the Reasoned Action Approach (RAA) to Understanding Health Behaviors. Ann. Behav. Med. 2016, 50, 592–612. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Positive vaccine intentions over time and across countries (defined as individuals that are Extremely likely to receive the vaccine). * indicates a significant test for a trend using the two-sided Cochran–Armitage trend test.
Figure 1. Positive vaccine intentions over time and across countries (defined as individuals that are Extremely likely to receive the vaccine). * indicates a significant test for a trend using the two-sided Cochran–Armitage trend test.
Vaccines 09 00661 g001
Table 1. Sociodemographic and health characteristics of the sample as a function of vaccine hesitancy.
Table 1. Sociodemographic and health characteristics of the sample as a function of vaccine hesitancy.
Sociodemographic and Health VariablesVaccine Hesitancy
Somewhat Likely, Unlikely, Very UnlikelyExtremely Likelyp-Value a
N%N%
Overall707426.6119,50873.39
Missing values5446
Period b
3106429.92249270.08<0.0001
2167827.47443172.53
1433225.6112,58574.39
Continent
North America402225.6611,65374.34<0.0001
Europe224932.19473867.81
South America80320.48311779.52
Sex
Women527227.6613,78872.34<0.0001
Men172423.6558176.4
Age
Less than or equal to 29189828.32480371.68<0.0001
30–64 years451028.1811,49571.82
65 years or more63316.74314883.26
Education level
High school or lower147725.83424274.170.3451
Graduate or postgraduate degree517726.4514,39573.55
Current employment status
Unemployed109521.26405678.74<0.0001
Employed 413527.7210,78472.28
Student55032.05116667.95
Residential area
Rural or country area98729.79232670.21<0.0001
Suburban or regional192227.88497272.12
Urban or city375324.7911,38575.21
Perceived average annual household income
Bottom third102733.56203366.44<0.0001
Middle third343327.82890772.18
Top third149719.97600180.03
Health condition at risk
No465027.9411,99172.06<0.0001
Yes207123.23684476.77
History of seasonal influenza vaccination
Never or once or twice in the last 5 years536534.8910,01065.11<0.0001
Every year and 3 times in the last 5 years118812.41838787.59
ap-value from χ2 test for bivariate comparisons; b Period 1 (March–May 2020); 2 (June–15 September 2020); Period 3 (15 September 2020–January 2021).
Table 2. Univariate and multivariate associations between sociodemographic and health characteristics of participants and vaccine hesitancy.
Table 2. Univariate and multivariate associations between sociodemographic and health characteristics of participants and vaccine hesitancy.
Sociodemographic and Health VariablesUnivariate Analysis aMultivariate Analysis b
OR c95% Confidence Intervalp-ValueOR c95% Confidence Intervalp-Value
LowerUpper LowerUpper
Period d
31 1
20.890.810.970.00990.770.690.86<0.0001
10.810.740.87<0.00010.630.570.7<0.0001
Continent
North America1 1
Europe1.381.291.46<0.00011.371.271.49<0.0001
South America0.750.690.81<0.00010.660.580.74<0.0001
Sex
Women1 1
Men0.810.760.86<0.00010.840.780.91<0.0001
Age
Less than or equal to 291 1
30–64 years0.990.931.060.82431.040.931.150.5273
65 years or more0.510.460.56<0.00010.750.640.880.0004
Education level
High school or lower1 1
Graduate or postgraduate degree1.030.971.110.34721.070.981.180.1306
Current employment status
Unemployed1 1
Employed1.421.321.53<0.00011.030.931.150.5495
Student1.751.551.97<0.00011.080.921.270.3643
Residential area
Rural or country area1 1
Suburban or regional0.910.830.990.0450.980.871.090.6787
Urban or city0.780.720.84<0.00010.830.740.920.0003
Perceived average annual household income
Bottom third1 1
Middle third0.760.700.83<0.00010.810.730.90<0.0001
Top third0.490.450.54<0.00010.530.470.59<0.0001
Health condition at risk e
No1 1
Yes0.780.740.83<0.00010.970.901.050.4244
History of seasonal influenza vaccination
Never or once or twice in the last 5 years1 1
Every year and 3 times in the last 5 years0.260.250.28<0.00010.260.240.29<0.0001
a A series of univariate logistic regressions was conducted to assess the relationship between vaccine hesitancy and individuals’ sociodemographic and health factors (probability modeled is ‘Somewhat likely, Unlikely, Very unlikely’); b multivariate logistic regression was conducted to assess the relationship between vaccine hesitancy and sociodemographic and health factors (probability modeled is ‘Somewhat likely, Unlikely, Very unlikely’); analysis was done on 19,546 individuals due to missing values in either response or explanatory variables; Goodness-of-Fit Test and Hosmer and Lemeshow Goodness of Fit Test (p = 0.7783); McFadden’s index = 0.09; c OR—odds ratio; d Period 1 (March–May, 2020); Period 2 (June–15 September 2020); Period 3 (15 September 2020–January 2021); e Health condition at risk includes: any heart disease or history of heart attack or stroke, any chronic lung disease; active/current cancer; hypertension; diabetes; severe obesity; any autoimmune disease.
Table 3. Multivariate logistic regression model estimating the association between vaccine hesitancy and COVID-19 related concerns.
Table 3. Multivariate logistic regression model estimating the association between vaccine hesitancy and COVID-19 related concerns.
OR d95% CI e
VariableEstimate aSE bp-Value c Lower Upper
Intercept1.1010.108<0.0001
Health concerns (others) (continuous)−0.3090.025<0.00010.730.700.77
Health concerns (self) (continuous)−0.3740.022<0.00010.690.660.72
Personal financial concerns (continuous)0.3690.020<0.00011.451.391.50
Social/economic concerns (continuous)−0.1990.022<0.00010.820.790.86
Goodness-of-Fit Test f (p = 0.06)
a The model was adjusted for sex, age, education, area of living, continent, and period of survey. Probability modeled: ‘Somewhat likely, Unlikely, Very unlikely’. Analysis was conducted on 24,699 individuals due to missing values in either response or explanatory variables; b SE—standard error; c p-values for the chi-square test, testing the null hypothesis that the individual predictor’s regression coefficient equals zero, given that the other predictor variables are in the model; d OR—odds ratio; e 95% confidence interval for the regression parameters; f Hosmer and Lemeshow Goodness of Fit Test.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Stojanovic, J.; Boucher, V.G.; Gagne, M.; Gupta, S.; Joyal-Desmarais, K.; Paduano, S.; Aburub, A.S.; Sheinfeld Gorin, S.N.; Kassianos, A.P.; Ribeiro, P.A.B.; et al. Global Trends and Correlates of COVID-19 Vaccination Hesitancy: Findings from the iCARE Study. Vaccines 2021, 9, 661. https://0-doi-org.brum.beds.ac.uk/10.3390/vaccines9060661

AMA Style

Stojanovic J, Boucher VG, Gagne M, Gupta S, Joyal-Desmarais K, Paduano S, Aburub AS, Sheinfeld Gorin SN, Kassianos AP, Ribeiro PAB, et al. Global Trends and Correlates of COVID-19 Vaccination Hesitancy: Findings from the iCARE Study. Vaccines. 2021; 9(6):661. https://0-doi-org.brum.beds.ac.uk/10.3390/vaccines9060661

Chicago/Turabian Style

Stojanovic, Jovana, Vincent G. Boucher, Myriam Gagne, Samir Gupta, Keven Joyal-Desmarais, Stefania Paduano, Ala’ S. Aburub, Sherri N. Sheinfeld Gorin, Angelos P. Kassianos, Paula A. B. Ribeiro, and et al. 2021. "Global Trends and Correlates of COVID-19 Vaccination Hesitancy: Findings from the iCARE Study" Vaccines 9, no. 6: 661. https://0-doi-org.brum.beds.ac.uk/10.3390/vaccines9060661

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop