ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article

Negative sentiment towards COVID-19 vaccines: A comparative study of USA and UK social media posts before vaccination rollout

[version 1; peer review: 2 approved with reservations]
PUBLISHED 15 Jun 2021
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Sociology of Health gateway.

This article is included in the Emerging Diseases and Outbreaks gateway.

This article is included in the Coronavirus (COVID-19) collection.

This article is included in the Sociology of Vaccines collection.

Abstract

Abstract 
Introduction: The global spread of the COVID-19 pandemic was rapid and devastating to humanity. The public health response to the pandemic was rapid too. Completion of COVID-19 vaccine development was achieved in under a year. The USA and the UK were the first countries to rollout COVID-19 vaccines to contain the pandemic. Successful rollout of the vaccines hinges on many factors, among which is public trust.  
Aim: To investigate the sentiments towards COVID-19 vaccines in the USA and UK prior to vaccination rollout. 
Methods: Neuro-linguistic programming with human validation was used to analyse a sample of 243,883 COVID-19 vaccine related social media posts from the USA and the UK in the period 28 July to 28 August 2020. The sentiment analysis measured polarity (positive, neutral, negative), and the themes present in negative comments.  
Results: In the sample of 243,883 social media posts, both the USA and the UK had a net sentiment profile of approximately 28% positive, 8% negative and 63% neutral sentiment. On further analysis, there were distinct differences between the two country’s social media sentiment towards COVID-19 vaccines. The differences were seen in the themes behind the negative sentiment. In the USA, the negative sentiments were mainly due to health and safety concerns, the fear of making a vaccine mandatory, and the role that pharmaceutical companies would play with the release of vaccines. In the UK the main driver of negative sentiment was the fear of making the vaccine mandatory (almost double the size of the sentiment in the USA). 
Conclusions: Negative sentiments towards COVID-19 vaccines were prevalent in the third quarter of 2020 in the USA and the UK. Reasons behind the negative sentiments can be used by authorities in the two countries to design evidence-based interventions to address the refusal of vaccination against COVID-19.

Keywords

COVID-19 pandemic; new vaccines; social media; sentiment analysis; USA and UK.

Introduction

On a global scale, Coronavirus disease 2019 (COVID-19) resulted in an unprecedented public health challenge, including disruption of social-economic and cultural systems1. The disease was declared a pandemic by the World Health Organisation (WHO) in March 20202. Public health interventions to contain the pandemic are guided by existing and emerging evidence on the epidemiology of the disease. To mitigate the impacts of the COVID-19 pandemic, tremendous and record-breaking efforts culminated in the development and subsequent rollout of novel vaccines3,4. In the first quarter of 2021, several vaccines were approved for emergency use by health regulatory authorities across the world. Against this background, a global survey on public acceptance of COVID-19 vaccines showed a wide-ranging acceptance rates of below 55% to a high of about 90%5.

Successful rollout of COVID-19 vaccines to the communities will hinge on many key factors, among which is public trust and benefits of the vaccines6. Negative public sentiments and uncertainty towards COVID-19 vaccines can hinder high uptake during the rollout, resulting in less vaccination impact than expected. Therefore, characterising sentiments towards COVID-19 vaccines is an ongoing public health priority. Social media provides inexpensive access to large and global data that can be used for characterising vaccine sentiments, with the potential to identify priority areas for interventions to improve high uptake of vaccines.

Social media platforms are increasingly becoming frequent sources of vaccination misinformation7. Sentiment analysis of social media posts is an approach used for collecting and analysing posted information to gain detailed insights of people’s decision making process with regards to vaccination8,9. Research in the field of measuring vaccine sentiments from social media is advancing rapidly. Its applications are wide - from a gaining deeper understanding of sentiments towards specific vaccines, such as HPV, to understanding sentiments towards vaccination of vulnerable populations, such as pregnant women10,11. At a global scale, COVID-19 pandemic and the development of vaccines against the disease have generated unprecedented misinformation on social media12,13. We therefore conducted a social media sentiment analysis towards COVID-19 vaccines in the USA and the UK prior to the full-scale vaccination rollout. Both the USA and UK were among the first countries to rollout COVID-19 vaccines at scale and have the most pandemic-related deaths proportionally to their COVID-19 cases or population4. Leading pharma from both countries are front runners in the development and testing of new COVID-19 vaccines14.

In the planning phase of rolling out COVID-19 vaccines, Operation Warp Speed of the USA government committed significant resources to make available hundreds of millions of COVID-19 vaccine doses to the members of the public15. The USA has been a front runner in rolling out COVID-19 vaccines. However, experiences from the past, including recent pandemics, show that availability of vaccines does not necessarily translate to high vaccine uptake16,17. To address the potential low uptake, a Working Group on Readying Populations for COVID-19 Vaccine was formed18. The purpose of the group was “to develop and disseminate recommendations emanating from design thinking process and evidence from social, behavioural, and communication sciences, that would support realistic planning for a US COVID-19 vaccination campaign”18.

In December 2020, the UK Government authorised emergency use of a new COVID-19 vaccine19. The UK has past experience wherein misinformation on the safety of measles, mumps and rubella vaccination (The MMR vaccine) which resulted in a dramatic fall in uptake and subsequent outbreaks of measles20. Knowledge on the extent and nature of public trust on COVID-19 vaccines is useful for UK authorities. This understanding can be used to develop and implement strategies that will ensure high COVID-19 vaccine uptake.

Against this background, we were interested in mining and analysing social media sentiments towards COVID-19 vaccines in the USA and the UK prior vaccination rollout. Social network analysis has been successfully used to understand COVID-19 pandemic sentiments in the USA21. In 2020, the USA and UK ranked first and fifth respectively with respect to leading countries based on number of Twitter users22. Although there are prior studies that have been conducted to characterise sentiment towards COVID-19 vaccines21, our study methodology has some unique aspects, including the broad scope of analysing unsolicited social media sentiment as opposed to survey methodologies that often involve subjective sampling.

Methods

From 28 July – 28 August 2020 (one month) of social media data were examined and allowed for unsolicited and noncoercive responses that captured the lived experiences of consumers commenting on the concept of a COVID-19 vaccine. The analysis was completed before a confirmed announcement of a vaccine was made by Pfizer in November 202023. Conversations about the COVID-19 vaccines were accessed via an application programming interface (API) called gnip: that enabled social media data to be gathered from Twitter. GNIP (an API aggregation company) was used to collect the social media data for the period and normalise the data24.

These posts were analysed for themes and sentiment with a computerised natural language processing (NLP) program provided by research company BrandsEye. This type of NLP is like that available on platforms like Amazon Lex, IBM Watson Assistant and DialogFlow. With the use of BrandsEye’s custom interface, a sub-sample of posts were sent for human topic analysis and sentiment validation25,26. This methodology of sub-sample validation improves the accuracy of net-sentiment measurement and topic analysis as NLP is still not accurate enough for precise interpretation of slang, sarcasm and emoji’s25. Mentions were analysed by the human raters (a large, distributed workforce who BrandsEye curate and pay to verify and mark-up raw social media data) and a set of themes were generated. Posts were then tagged according to these classified themes.

Results

In total, 243,883 COVID-19 vaccine related posts were collected from both the USA and the UK for the sample period. A sub-sample of 8,392 posts were sent for human topic analysis and sentiment validation. Figure 1a and 1b provide examples of the kind of posts that were collected for analysis.

764856bb-7b8a-47b3-8c51-c8a5f4d86f8d_figure1.gif

Figure 1. A sub-sample of 8 392 posts were sent for human topic analysis and sentiment validation.

An example of raw data (tweets) by users from USA and UK are shown. Figure 1a: Sample of Tweets from the USA (Mentions anonymised to protect author privacy). Figure 1b: Sample of Tweets from the UK (Mentions anonymised to protect author privacy).

Sentiment analysis

The sentiment margin of error was calculated by comparing how many percentage points this calculation’s result will differ from the real population value. For example, a 95% confidence interval with a 4% margin of error means that the statistic will be within 4 percentage points of the real population value 95% of the time. In the case of the data that verified for sentiment, the margin of error ranged from ±1.6% (overall sample) to ±2.3% (UK sample). The combined process of the machine learning algorithm and manual validation has created a confidence level of 95% and an overall 1.6% margin of error, showing a strong reliability of the data (Table 1).

Table 1. Total sample of micro-blogs collected and analysed (28 July – 28 August 2020).

Shows the total volume of twitter mentions BrandsEye identified about a COVID-19 vaccine from 28 July – 28 August 2020. BrandsEye’s Crowd of human contributors evaluated the sentiment contained in 8,392 mentions. Mentions were assigned sentiment scores of positive, negative or neutral. 1505 mentions were categorised into nine hesitancy themes. The resultant margin of error for COVID-19 vaccine sentiment is below 2.5% for both USA and UK, calculated at a 95% confidence interval.

OverallUSAUK
Total COVID-19 vaccine
conversation
243 883219 67124 212
Sentiment verification
and theme analysis
8 3924 8873 505
Mentions tagged with
classification
1 505839666
Sentiment margin of
error
±1.6%±2.1%±2.3%

Overall conversation sentiment

In total, over 64% of the sampled posts had neutral sentiment relating to vaccines, whereas over 28% was expressed negative sentiment and less than 9% expressed positive sentiment (Figure 2). When isolating the two sampled countries’ specific sentiment profile, the sentiment was very similar in both the USA and UK.

764856bb-7b8a-47b3-8c51-c8a5f4d86f8d_figure2.gif

Figure 2. Overall sentiment to a COVID-19 vaccine (USA and UK combined).

The sentiment analysis measured by polarity (positive, neutral, negative). The polarity for the 2 countries is combined. Authors were most hesitant about a mandatory COVID-19 vaccine. Authors shared petitions to appeal restrictions that may be imposed on those who refuse the vaccine. Health and safety was the second most prevalent theme cited, as authors worried about adverse reactions and side effects. Authors hypothesised that the scientific process followed to produce the vaccine would be flawed due to institutions rushing to find an answer to the pandemic. Hesitancy mentions on average generated 4.8 engagements; 3.3 times higher than that seen in advocacy mentions. Authors mentioning developments in vaccine trials accounted for nearly a fifth of all advocacy conversation. These mentions also featured calls to action aimed at finding human volunteers in order to accelerate the research. Vaccine advocates expressed concern about the equitable distribution of the COVID-19 vaccine. This highlights a trend of institutional distrust that underlies vaccine-related conversation from both advocates and sceptics alike. Advocacy mentions generated an average of 1.4 engagements per mention.

In the USA, the majority of sentiment was neutral (63.2%) with negative being 28.7% and positive being 8.1%. In the UK, the majority was also neutral (63.8%) with negative being 27.5% and positive being 8.7% (Figure 3).

764856bb-7b8a-47b3-8c51-c8a5f4d86f8d_figure3.gif

Figure 3. Sentiment in the USA and UK (28 July – 28 August 2020).

The sentiment analysis measured by polarity (advocacy, neutral and hesitancy). The polarity is shown for each country. The USA saw a lower ratio of advocacy mentions and a higher ratio of hesitancy mentions compared to the combined aggregate. Conversely, the UK saw a higher ratio of advocacy mentions and a lower ratio of hesitancy mentions.

Theme analysis

While the overall sentiment showed consistency between the two countries, the theme analysis did show that the distribution of drivers of negative sentiment were different in each country. In total, nine core themes were identified and quantified from the negative sentiment. These themes were coded as Conspiracy, No danger, Hoax, Health and safety, Mandatory, Pharmaceutical, Politics, Scientific process, and Vaccine efficacy. The themes were coded and defined based on the different sentiment profile in both the USA and the UK (Table 2).

Table 2. Coded themes related to overall negative sentiment.

Themes on negative sentiments towards COVID-19 vaccine were identified, coded and a definition justifying the assigned code was provided. The % negative sentiments was then computed separately for tweets from the USA and UK. Mandatory vaccination was the dominant theme code in the UK while in both countries, health and safety concerns were dominant negative sentiments.

Theme codeDefinitionUSA
(% negative
conversation)
UK
(% negative
conversation)
ConspiracyAuthor believes that the COVID-19 vaccine is part of a conspiracy (not just
money making). Eg., mark of the beast, tracking chips etc.
3.7%3.4%
No dangerAuthor accepts COVID-19 is real but does not think it is very dangerous or
harmful.
0.8%0.5%
HoaxAuthor states that COVID-19 is a hoax, conspiracy or simply not real. Includes
"plandemic" mentions.
0.8%4.2%
Health and safetyAuthor references health safety issues, side effects of a COVID-19 vaccine or
concerns about ingredients of the vaccine.
15.1%16.4%
MandatoryAuthor is against making the vaccine mandatory or believes it should be
optional.
13.3%26.1%
PharmaceuticalAuthor doesn't trust the pharmaceutical industry. Eg., thinks they are tricking
people, trying to make money etc.
10.8%5.8%
PoliticsAuthor believes the vaccine is political in nature or mistrusts the government
about the vaccine.
7.2%4.2%
Scientific processAuthor thinks that the development of the vaccine is being rushed, has been
poorly tested or is otherwise scientifically flawed.
10.5%10.8%
Vaccine efficacyAuthor is doubtful or sceptical about how effective a vaccine will be.6.6%4.9%

In the USA, the main drivers of negative sentiment for the sample period were health and safety concerns, the fear of making a vaccine mandatory and the role that pharmaceutical companies will play in the release of vaccines. In the UK, the main driver of negative sentiment was the fear of making the vaccine mandatory (almost double the size of the sentiment in the USA). The role of health and safety was second and slightly higher than in the USA (even though it was first in the USA, the USA sentiment was slightly more distributed among the six themes. Third was scientific process, which aligned closely in number to the USA, but was only fourth most prevalent theme there (Table 2).

Discussion

The impacts of the COVID-19 pandemic coupled with rapid vaccine development and rollout has demanded a rapid understanding of the public sentiment concerning the vaccines and how this may affect vaccination uptake. In this study, we tapped into huge volumes of opinionated social media data for analysis to gain insights on a topical issue about people’s potential to accept new COVID-19 vaccines in the USA and UK. Through sentiment mining and analysis, this study shows in both countries, negative public sentiments towards COVID-19 vaccines were nearly fourfold higher than positive sentiments before rollout. Interestingly, neutral public sentiments towards future COVID-19 vaccines dominated over negative and positive sentiments. Our findings agree with those reported by Loomba S et al., who used a randomized controlled trial in the USA and UK to quantify how exposure to online misinformation resulted to a large proportion not intending to get vaccinated against COVID-1927. Thematic analyses in both countries showed complexity and differential distribution of the reasons for the negative sentiments. Negative vaccine sentiments can translate to attitude, and then vaccine hesitancy. Our results indicate that, at the time the study was conducted, more than a quarter of the population in the USA and UK would not accept vaccination against COVID-19.

Safety of rapidly developed COVID-19 vaccines was listed as the first and second main reasons of negative sentiment towards vaccination in the USA and UK respectively. This was not a surprising finding because, in general, vaccine safety ranks among the top reasons for lack of public vaccination confidence in most settings28. A poll conducted in the USA in June 2020 showed only about 50% of Americans were committed to receiving a COVID-19 vaccine, with acceptance commitment among some communities being as low as 40%29. One possible explanation for our findings is that the vaccines against COVID-19 were developed at a record speed and in the context of an infodemic, both these factors can exacerbate heightened negative safety sentiments30,31. As the vaccination rollout continues globally, and with millions of doses administered in the first quarter of 2021, preliminary safety reports from the USA show COVID-19 vaccination results to mild adverse events and in rare cases, allergic reactions32. The reports are in line with the expected safety profile. We propose widespread communication of up-to-date and accurate information on the observed effectiveness and safety profile of COVID-19 vaccines. Communication is at the core of any process to empower and change mindsets and perceptions. Understanding the audience and using language and methods that are accessible, reliable, and credible is critical to building public trust in COVID-19 vaccines and vaccination in general.

Before health regulatory approval for rollout to the public, vaccines are usually tested through a rigorous, well-established, and regulated processes33. Traditionally, vaccine development processes are often detached from political, media, and public attention. This did not happen with COVID-19 vaccine development due to the enormous attention the pandemic rightfully attracted. Therefore, it is not surprising that in our study, politics was a key theme identified as a driver of negative sentiment in both countries, albeit at moderate frequencies. Given that governments are major stakeholders for vaccinations, it is critical for leaders of government to not politicise the science of vaccine development as our results show this can be a driver of negative sentiments. Senior government leaders in the USA and the UK were among the first to publicly get vaccinated with new COVID-19 vaccines during the rollout. This is important in advancing positive sentiment of vaccines to the public. More must be done rapidly and openly to communicate accurate and up-to-date information on COVID-19 vaccines to improve public trust and positive sentiments.

Mandatory vaccination was listed as the first and second main reason of negative sentiment towards vaccination in the UK and USA respectively. With some degree of success, mandatory vaccination is legislated in some countries to address the resurgence of vaccine preventable diseases34,35. In the UK, discussions around mandatory vaccination featured in the mainstream media with senior health officials not completely ruling out such an option in mid-2020. Such discussions may have driven the high frequencies of negative sentiment observed in our study. Ethics on mandatory vaccination is a topic that generates a lot of controversies with individuals refusing to be vaccinated considered to cause harms to others36,37. Our findings suggest that careful considerations must be made by authorities prior developing legislation on mandatory COVID-19 vaccination as this can result in a backlash. Neither of these two countries have instituted a mandatory COVID-19 vaccination during the rollout. Other forms of legislation, such as incentivisation to be vaccinated can be considered in some settings36.

In the USA, lack of trust in the pharmaceutical industry was the third main reason cited for negative sentiment on COVID-19 vaccination. The same reason was ranked fourth in the UK. In general, mistrust by the public towards pharmaceutical industry is a key element driving vaccine hesitancy38. Further compounding the issue of the pharmaceutical industry in the context of COVID-19 vaccines is the relationship between governments and pharmaceutical companies, which may involve non-disclosure agreements39. Both the USA and the UK governments are key stakeholders in COVID-19 vaccine development through advanced market commitments as well as through regulatory processes39. The relationships between governments and the pharmaceutical industry remains under public scrutiny during the COVID-19 pandemic, hence the observed high rates of negative sentiments towards pharmaceutical industry was somewhat expected. Our results suggest that open and transparent communication from the pharmaceutical industry as well as the Governments has the potential to improve positive sentiment towards COVID-19 vaccines.

Scientific process was the third most frequently reported reason for negative sentiment in the UK and the same reason was ranked fourth in the USA. COVID-19 vaccines were developed at a rapid pace3. Mistrust in vaccine information is a key element of vaccine hesitancy38. Due to the rapid COVID-19 vaccine development process, public mistrust in the scientific process may have been driven by a lack of optimal communication as well as by misinformation. It is critical for researchers working in the field to continue communicating widely, openly and transparently on the reasons behind the remarkable success of COVID-19 vaccine development and how it was possible to achieve the success while maintaining expected standards of scientific rigour40.

There were other less frequent reasons for negative sentiments in both countries. The reasons were associated with vaccine efficacy, conspiracy, no danger and hoax. Taken together, our results show that reasons behind negative vaccine sentiments are many, complex, and can vary in scale across different countries.

There are limitations to this study. First, sentiments identified could be temporal and may have changed by the time COVID-19 vaccines are rolled out. There is a possibility of a shift in sentiment as more information such as safety, is made available to the public. This, however, provides further opportunity to extend this research to a longer time frame. A repeat mining and analysis of similar data will be needed to identify any changes in the sentiments. Second, it is hard to determine how representative the selected data was to make inference to the general population.

In conclusion, widespread access and use of safe, effective, and trusted vaccines will be crucial in the control of the COVID-19 pandemic. Our findings show that negative sentiments towards COVID-19 vaccines were prevalent in the third quarter of 2020 in the USA and the UK. Social media, such as twitter, has been an influential platform for information, disinformation and misinformation during the COVID-19 pandemic41. The findings of our study offer a snapshot of possible reasons that will make people to refuse COVID-19 vaccination. Tailor-made education and communication strategies addressing the identified and prevalent negative sentiments may result in higher uptake of future COVID-19 vaccines in the USA and UK.

Data availability

Underlying data

The raw data needed to replicate these analyses has not been made public by the data providers, meaning we are forbidden from sharing it in this paper. However, the reader can apply for access to the data through a direct application to BrandsEye for the purchase of this data. BrandsEye can be contacted on contact@brandseye.com. BrandsEye is a commercial research company that has had its data published in journals such as MethodsX (Elsivier) and the International Journal of Bank Marketing (Emerald). More details on how to apply to access these data can be found at https://www.brandseye.com.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 15 Jun 2021
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Lappeman J, Munyai K and Mugo Kagina B. Negative sentiment towards COVID-19 vaccines: A comparative study of USA and UK social media posts before vaccination rollout [version 1; peer review: 2 approved with reservations]. F1000Research 2021, 10:472 (https://doi.org/10.12688/f1000research.52061.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 15 Jun 2021
Views
11
Cite
Reviewer Report 06 Sep 2021
Daniel Thomas, Public Health Wales Communicable Disease Surveillance Centre, Wales, UK 
Approved with Reservations
VIEWS 11
This is a very interesting analysis of social media posts in two countries during Summer 2020 to assess public acceptability of COVID vaccination in advance of the rollout.

In terms of style it is well written and clear. ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Thomas D. Reviewer Report For: Negative sentiment towards COVID-19 vaccines: A comparative study of USA and UK social media posts before vaccination rollout [version 1; peer review: 2 approved with reservations]. F1000Research 2021, 10:472 (https://doi.org/10.5256/f1000research.55287.r90462)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
15
Cite
Reviewer Report 26 Jul 2021
Rakhi Tripathi, Centre for Digital Innovation, Fore School of Management New Delhi, New Delhi, Delhi, India 
Approved with Reservations
VIEWS 15
This article is well-written. It discusses the sentiments of citizens of the US and UK regarding COVID vaccination. The sentiments are extracted from social media and analyzed. The results are explained well especially the Table 2 where the themes related ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Tripathi R. Reviewer Report For: Negative sentiment towards COVID-19 vaccines: A comparative study of USA and UK social media posts before vaccination rollout [version 1; peer review: 2 approved with reservations]. F1000Research 2021, 10:472 (https://doi.org/10.5256/f1000research.55287.r89107)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 15 Jun 2021
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.