Can We Trust the Covid-19 Vaccines?

2021-12-07
Shin
Shin
Independent science writer

Scientific studies support vaccine safety, but certain individual reports don’t. Which side to trust?

A randomized controlled trial (RCT) is the gold-standard method for testing the safety and efficacy of a drug or biologic in humans. Because of RCTs, we know that the Covid-19 vaccines are safe and effective compared to the control group.

Beyond the clinical trial’s control group in the general population, however, we rely on observational studies to monitor vaccine safety and efficacy. We call this post-licensure or post-marketing surveillance. But as observational study design is inferior to RCT, can we trust that the Covid-19 vaccines are safe and effective outside of the RCTs?

As covering both vaccine safety and effectiveness are too extensive, I’ll focus on safety, especially the most commonly used mRNA and DNA vaccines.

Individual voices have raised concerns about vaccine safety. I’ll not name names here, but you most probably have heard or seen articles or videos declaring that Covid-19 vaccines are dangerous. They commonly cite the Vaccine Adverse Event Reporting System (VAERS), a surveillance system in the U.S. that relies on voluntary reporting from healthcare providers or patients. It’s basically a collection of anecdotes, which have been useful in catching vaccine-related adverse events early. But it also propels vaccine fears because we see disturbing reports like these:

So, can we still trust that the Covid-19 vaccines are safe outside of the RCTs? I think we can, but I’m not 100% sure and I intend to re-think vaccine safety, which is why I’m writing about this.

*All vaccines mentioned hereon refer to the Covid-19 vaccine. As this article is very lengthy, you can skip to the end for the summary/conclusion.

Why Phase III Clinical Trials Aren’t Enough

If a drug candidate works safely in cell culture and animal studies, the pharmaceutical company may apply for permission from the Food and Drug Administration (FDA) to begin clinical trial testing on humans, starting from phase I to IV.

Phase I clinical trial tests the drug at various doses in a small group of people to ensure and determine a safe dose. Phase II then tests if the drug works via a randomized controlled trial (RCT), usually in over a hundred participants. Next, phase III tests the drug in a larger group of people, usually thousands. Drug safety is also monitored in phases II and III.

The FDA will review all the clinical trial data again before approving or authorizing the drug for public use. Phase IV then observes how the drug works in the real world, outside of the clinical trials.

Phase IV is necessary because the drug may behave differently in the real world than in controlled conditions. RCTs have strict inclusion and exclusion criteria to ensure that results are more likely to be reproducible and to minimize potential harm in vulnerable populations.

The phase III trial of Pfizer’s mRNA vaccine, for example, stated:

“Adults 16 years of age or older who were healthy or had stable chronic medical conditions…were eligible for participation in the trial. Key exclusion criteria included a medical history of Covid-19, treatment with immunosuppressive therapy, or diagnosis with an immunocompromising condition.”

Phase IV is also needed because RCTs don’t study the entire population. The sample size will always be insufficient, especially if the drug is intended for general use, such as Covid-19 vaccines.

The phase III trial of Pfizer’s mRNA vaccine injected 21,720 participants with the mRNA vaccine and 21,728 with placebo and found that the vaccine posed no additional harm compared to the placebo. But this is true within that 21,728 participants only who were healthy or had stable diseases.

Plus, a sample size of 20,000 is only enough to detect an adverse event that occurs at the rate of 1–3 cases in 2000 people. (Detect as in showing statistically significant results at P < 0.05.) To detect an adverse event with an incidence rate of 1 in 10,000, at least 30,000 participants are needed:

The sample size limit explains why the phase III trials of Covid-19 vaccines have missed all the rare adverse events that were later detected by phase IV surveillance systems — such as mRNA vaccine-related myocarditis, DNA vaccine-related thrombotic thrombocytopenia, and DNA vaccine-related Guillain-Barre syndrome.

(The phase III trials of Moderna’s mRNA and Novavax’s subunit vaccines also have similar inclusion and exclusion criteria as Pfizer’s mRNA vaccine. The phase III trial of AstraZeneca’s DNA vaccine only included healthy adults aged 18–55 years. Participants in the phase III trial of Johnson & Johnson’s DNA vaccine were also mostly healthy 18–59-year-old adults who did not have medical conditions associated with increased risk of severe Covid-19. These phase III trials have about 15,000 to 30,000 participants.)

What phase IV surveillance studies show

To this end, I search PubMed, a biomedical literature database, with the keywords “(nation* OR surveillance OR cohort) AND (safe* OR risk) AND (BNT162b2 OR ChAdOx1nCoV-19 OR mRNA-1273 OR Ad26.COV2.S)” and derived 267 papers as of 5 December 2021.

After going through them, there are six notable large cohort studies on mRNA vaccine safety — three of them also examined DNA vaccine —that serve as phase IV surveillance studies. I picked those six because they have proper control (or comparison) groups, which most other studies don’t.

I detailed three of them previously here, but here’s a summary of them, as well as their respective study limitations mentioned by the authors:

*If you are only interested in seeing the top three surveillance studies, skip to the table below, where the death % is also presented.

1. Clalit Health Services (CHS) database of Israel (Barda et al., 2021); investigated 25 different adverse events:

2. Vaccine Safety Datalink (VSD) database of the U.S. (Klein et al., 2021); investigated 23 different adverse events:

3. VSD database of the U.S. (Xu et al., 2021); investigated deaths unrelated to Covid-19:

4. National Immunisation Management System (NIMS) database of the U.K. (Hippisley-Cox et al.,2021); investigated seven cardiovascular disorders:

5. NIMS Database of the U.K. (Patone et al., 2021; same research team as Hippisley-Cox et al.,2021); investigated seven neurological disorders:

6. National Health Service (NHS) database of Scotland (Simpson et al., 2021); investigated five blood clotting disorders:

***

[Extra] Other less extensive surveillance studies with control groups:

Are phase IV surveillance studies reliable?

Judging from these surveillance studies, the two U.K. studies (Patone et al. and Hippisley-Cox et al.) and the Scotland study (Simpson et al.) have the least limitations in study design.

The exclusion and inclusion criteria of the two U.K. studies (published separately here) are unbiased and straightforward:

“All patients of all ages will be included in the analyses since all patients are eligible to be considered for COVID-19 vaccination or likely to become so over time. Patients will be excluded if they have had three or mode vaccines or a combination of more than one vaccine type.”

Similarly, the Scotland study protocol (published separately here) included everyone registered with a general medical practice, representing 91% of the Scottish population. As the study authors wrote:

“Almost all residents in Scotland are registered with a general practice and have a unique Community Health Index (CHI) number used by NHS Scotland. We used the CHI number to deterministically link all datasets with vaccination records in Public Health Scotland…together, these captured all vaccination records, including those vaccinated in general practices, community vaccination hubs and other settings, such as care homes and hospitals in Scotland.”

***

Whereas the Israel study using the CHS database omitted several groups of people — such as residents of long-term care facilities, people confined to their homes for medical reasons, and health care workers— because of the inability to control for confounding variables in these people.

The Israel study follows a matching design, where a group of vaccinated people was carefully matched to unvaccinated people in terms of age, sex, residence, socioeconomic status, population sector, comorbidities, and pregnancy status. As healthcare workers and long-term care facility residents are at high risk for severe Covid-19 and prioritized for vaccination, there were not enough of them left in the unvaccinated group.

In contrast, the U.S. (Klein et al.) and U.K. (Patone et al. and Hippisley-Cox et al.) studies use a self-control design, where the vaccinated/unvaccinated and infected/uninfected groups consist of the same people at different time points. Patone et al. and Hippisley-Cox et al. compared risks at post-vaccination vs. pre-vaccination, whereas Klein et al. compared risks at 0–21th vs. 22–42th day of vaccination.

This design helps control for nearly all variables that could have differed from person to person. In other words, the risk of x is compared to oneself — at past self (pre-vaccination) or future self (sometime after vaccination) — rather than to someone else with similar baseline characteristics.

***

But the U.S. studies (Klein et al. and Xu et al.) have another limitation with its database, the Vaccine Safety Datalink (VSD) that collects vaccine-related data from several healthcare organizations at nine sites in the U.S.

VSD actively collects data and doesn’t rely on voluntary reporting (passive surveillance) like VAERS. Both VSD and VAERS are among the main vaccine surveillance systems in the U.S.

Such an active system of VSD is suitable for performing statistical analyses on vaccine safety — such as the prevalence, risks, and outcomes of a vaccine-related adverse event — as the data is collected systematically.

But VSD has one limitation: it tends to miss very rare events. For instance, the early detection of blood clotting concerns from the Johnson & Johnson’s DNA vaccine was detected by VAERS; VSD missed it.

After all, VSD only collects data from nine sites — containing data of about 3% of the U.S. total population only — while anyone can report to VAERS. At the end of November 2021, about 60% of the U.S. population is fully vaccinated (with another 10% that is partially vaccinated). So, VSD’s coverage is minimal, lacking socioeconomic diversity. This limitation probably explains why certain adverse events in the U.S. study had wide confidence intervals (see the 2nd bullet point above).

This is not to say that VSD data is unreliable, however. As VSD prioritizes information quality over quantity, we can be assured that the underlying raw data is trustworthy. It’s just that whether the VSD data (and results) apply to other sites in the U.S. or other countries is debatable.

***

So, the two U.K. studies (Patone et al. and Hippisley-Cox et al.) and the Scotland study (Simpson et al.) provide the most robust evidence on vaccine safety in the general population. They examined how the vaccines work in almost everyone who got the vaccine, a high-quality surveillance research. So, their findings should be the closest to the truth we have.

What were their findings again? Based on the bullet points above, I summarized the three top surveillance studies in a table here, with the added death rate information I extrapolated from the raw data:

https://img.particlenews.com/image.php?url=1u0Lxq_0dFpNC1900
Shin Jie Yong

As authorities have acknowledged, AstraZeneca’s DNA vaccine comes with the risk of blood clotting disorders and Guillain-Barre syndrome, especially in younger females. As a result, several European countries have minimized or banned the use of AstraZeneca’s vaccine in younger age groups.

Surprisingly, Pfizer’s mRNA vaccine is also associated with risks of blood clots and stroke — but not the other neurological disorders — in the U.K. NIMS database only. The Scotland NHS database, however, did not find such risks of Pfizer’s mRNA vaccines.

After reading the discussion sections of the three surveillance studies, no explanations were written on the link between Pfizer’s mRNA vaccine and stroke and blood clots. Plausible reasons I can think of are:

Even the best surveillance studies are not perfect

One limitation is that they can’t prove anything. Surveillance studies are observational in design, which has no randomization. Randomized controlled trials (RCTs), in contrast, randomize people into either the experimental or control group. Such randomization negates the countless variables that differ from person-to-person, ensuring that results are strictly due to the experimental condition. Observational studies control for controllable factors only, such as age and sex; genetic, behavioral, environmental, and cultural factors are almost never accounted for.

The second limitation is that not all adverse events are studied. The three top surveillance studies (Patone et al., Hippisley-Cox et al., and Simpson et al.) did not examine myocarditis (heart inflammation), for example. Myocarditis is a known risk of mRNA vaccines, especially in younger males. So, we can’t be sure that the other uninvestigated adverse events are not linked to the vaccines from these three surveillance studies.

Third, each of the surveillance studies is limited to one geography only. So, we can’t be 100% certain that the same pattern applies to other countries with different socioeconomic settings. For example, the U.K. (including Scotland) has arguably the best healthcare system in the world, so their NIMS and NHS databases might be able to catch adverse events with higher precision. But most other countries lack such an advanced healthcare system, so their analyses may show different results from the U.K.

Even though those surveillance studies are not perfect, their findings are the closest to the truth we have. In physics, it’s a common saying that there are no absolute truths in science, only approximate truths.

What’s the approximate truth about Covid-19 vaccines then? Answer: mRNA and DNA vaccines are safe for the vast majority.

For instance, based on the top three surveillance studies (see the table above), the adverse event that produced the highest excess cases is ischaemic stroke from Pfizer’s mRNA vaccine at 143 excess cases per 10 million people. So, if we vaccinate 10 million people with Pfizer’s mRNA vaccine, we would see 143 more stroke cases (of which 14.9% will die) than usual. But put it another way, the remaining 9,999,857 people did not develop stroke after getting Pfizer’s mRNA vaccine.

I said the vast majority. As humans are complex biological creatures, some outliers are bound to occur in our civilization, who may react to vaccines negatively, or the vaccine might trigger something dangerous in them.

After all, we can’t deny that the vaccines are associated with excess cases of several adverse events, of which some have even died, from the top three surveillance studies described above. This is where frightening anecdotes of people dying or getting severely ill after vaccination might come from.

Trust the surveillance studies or VAERS?

Speaking of anecdotes, the Vaccine Adverse Event Reporting System (VAERS) is basically a collection of anecdotes from voluntary reporting of healthcare professionals or patients in the U.S.

*Reminder: All vaccines mentioned in this section refer to Covid-19 vaccines.

VAERS is arguably the backbone of the dangerous vaccine narrative. Several independent people have performed their own analyses and interpretations of VAERS to show how dangerous the vaccines are.

***

I wrote about VAERS back in July 2021: Underreporting and Post-Vaccine Deaths in Vaccine Adverse Event Reporting System (VAERS) Explained. The points I raised back then still stand to this day. So, this section is a summary of my past article, with some newer input from other sources.

First, we have seen a huge spike in vaccine-related adverse events and deaths in VAERS during the past year. Then some people assumed that the vaccine caused these deaths, at least most or a proportion of them.

Sure, things can be more complicated than this. But this observation (the spike in numbers) and assumption (vaccines likely caused them) are arguably the foundation of the dangerous vaccine narrative based on VAERS. If this foundation is unreliable, the downstream complicated stuff becomes unreliable too.

For one, it’s expected that we see a huge spike in VAERS report this past year, given the sheer number of vaccines distributed. Plus, the numerator (number of vaccine-related adverse events or deaths) is misleading without the denominator (number of vaccine doses given). Second, VAERS does not contain data from unvaccinated populations, so it cannot determine if a vaccine caused something. Without a control (or comparison) group, we don’t know if the adverse events (including deaths) reported to VAERS are part of the background — that is, things we usually see, even before 2020.

After all, VAERS accepts reports regardless of whether they are likely or unlikely to be caused by the vaccines, and bad things — deaths, diseases, and illnesses — happen to people daily.

In 2019, 2.85 million people died in the U.S., which gives an average of 7,800 deaths per day. So, one can imagine if the most vulnerable populations are prioritized for vaccination at a massive scale, a drastic spike in post-vaccine adverse events and deaths will happen every day.

Even before the pandemic, about 10% and 12% of deaths in 18–64-year-olds and 9–39-year-olds, respectively, were unexplainable. So, in the context of mass vaccination, we have a candidate to blame for unexplainable deaths.

***

But if the spike in post-vaccine adverse events and deaths exceeded the background rate (i.e., what we normally see regardless of the pandemic), then it’s a signal that the vaccines could be dangerous.

Did it exceed though? At least for deaths, it didn’t. Even with an underreporting factor of 41-times (as some have claimed, which may or may not be accurate as the underreporting factor differs between adverse events), it’s not enough to surpass the 30-day mortality background rate.

The post-vaccine deaths (within 30 days) have to be multiplied by 100-times just to reach the background rate of 30-day mortality. In other words, even with an underreporting factor of 100, there are no excess deaths in VAERS.

Speaking of excess deaths, it’s another metric to judge vaccine safety. Another author of this publication has compared excess deaths, Covid-19 deaths, and vaccination rates between countries, writing that:

“If the vaccine is highly lethal, it has to be highly lethal everywhere. Finding one country that had some excess deaths at the same time as vaccinations doesn’t prove the vaccine is deadly, because those deaths could also be from covid. But finding one country, where there was mass vaccination with no excess deaths is good proof that the vaccine is not deadly. I just pointed to 6 countries as proof.”

The author has also written another brilliant article on how VAERS is better understood. Matt Timberlake has also done the same in a presentation with Yuri Deigin that was posted as a Youtube video.

All that said, this section is not to dismiss VAERS reports/anecdotes entirely. We cannot completely rule out that the vaccines might have caused a fraction of the adverse events (including deaths) in VAERS. After all, the top three surveillance studies described above did find excess adverse events associated with the mRNA and DNA vaccines. But to conclude that vaccines are dangerous based on VAERS alone isn't fair.

Key points

As randomized controlled trials (RCTs) mainly included healthy adults, we aren’t very sure if the vaccine will behave the same in the real world, necessitating surveillance studies. At least six large-scale surveillance studies on Covid-19 vaccines have been published. Based on the top three ones I identified, the mRNA and DNA vaccines are associated with increased risks of several adverse events — such as stroke, blood clotting disorders, and Guillain-Barre syndrome — leading to several excess cases and deaths.

But this happened to the tiny minority. For example, based on the top three surveillance studies identified, the adverse event that produced the highest excess cases is ischaemic stroke from Pfizer’s mRNA vaccine — at 143 excess cases per 10 million people, with about a 15% death rate. But put it another way, the remaining 9,999,857 people did not develop stroke after getting Pfizer’s mRNA vaccine. Thus, the Covid-19 vaccines are safe in the vast majority. But the tiny minority that the vaccines have harmed is unfortunate, which may lead some to overestimate vaccine risks.

To close, the topic of vaccine safety is sophisticated and vast. So, I must admit that not every single argument on vaccine safety is covered in this article. I’m not writing a textbook after all. Lastly, I’m only one person, so I may have made mistakes or overlooked certain things. In the end, even this article should be regarded as approximate truth, not an absolute one.

vaccine covid VAERS surveillance mRNA

This is third-party content from NewsBreak’s Contributor Program. Join today to publish and share your own content.

This user-generated article may contain information about current or recent events. We recommend verifying the details by cross-referencing multiple reliable sources.

Shin
40.6k Followers
Shin
MSc (Research) | Named Standford's world's top 1% scientists | Independent scientist | 10x first-author academic papers | 400+ articl...