<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.154058.2</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>All-cause mortality according to COVID-19 vaccination status: An analysis of the UK office for National statistics public data</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 2; peer review: 2 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Alessandria</surname>
                        <given-names>Marco</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Malatesta</surname>
                        <given-names>Giovanni</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Di Palmo</surname>
                        <given-names>Giovanni</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Cosentino</surname>
                        <given-names>Marco</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-6978-7775</uri>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Donzelli</surname>
                        <given-names>Alberto</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-4365-6814</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Life Sciences and Systems Biology, University of Turin, Torino, Italy</aff>
                <aff id="a2">
                    <label>2</label>Physics Graduate, Member of the Scientific Committee of the Fondazione Allineare Sanit&#x00e0; e Salute, Pistoia, Italy</aff>
                <aff id="a3">
                    <label>3</label>B.E., Data Analysis Specialist, Taranto, Italy</aff>
                <aff id="a4">
                    <label>4</label>Center for Research in Medical Pharmacology, University of Insubria, Varese, Italy</aff>
                <aff id="a5">
                    <label>5</label>MD, Specialist in Hygiene and Preventive Medicine, independent Medical-Scientific Commission; President, Fondazione Allineare Sanit&#x00e0; e Salute, Milano, Italy</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:adonzelli@ats-milano.it">adonzelli@ats-milano.it</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>20</day>
                <month>2</month>
                <year>2025</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2024</year>
            </pub-date>
            <volume>13</volume>
            <elocation-id>886</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>12</day>
                    <month>2</month>
                    <year>2025</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Alessandria M et al.</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/13-886/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>The mass vaccination campaign against COVID-19 has been commonly considered the best response to the global COVID-19 pandemic crisis. However, assessment of its real-world effect can be performed by analysis of all-cause mortality by vaccination status. The UK is perhaps the only country which has made publicly available all-cause mortality data by vaccination status.</p>
                </sec>
                <sec>
                    <title>Methods</title>
                    <p>Data from April 2021 to May 2023 published by the UK Office for National Statistics (ONS) were retrospectively analyzed by age groups and vaccination status; the standardized mortality ratio (SMR) for all-cause and non-COVID-19 mortality was calculated against the corresponding unvaccinated groups.</p>
                </sec>
                <sec>
                    <title>Results</title>
                    <p>We found that across all age groups, all-cause mortality SMRs increased from a certain date, dependent on the age group. Across all age groups, all-cause mortality SMRs were initially much lower than 1. However, due to their increase, by a certain date for the 18-39, 80-89 and 90+ age groups they exceeded the reference value. For the other age groups, the date at which the SMR would reach 1 can be predicted, provided the trend is maintained. Non-COVID-19 SMRs&#x2019; trends were very similar. Their initial values much lower than 1 are suggestive of significant biases in the ONS dataset, leading to underestimate the risks for the vaccinated people, as it is implausible that COVID-19 vaccines protect against non-COVID-19 deaths.</p>
                </sec>
                <sec>
                    <title>Conclusions</title>
                    <p>The increase over time in all-cause death SMRs in vaccinated people compared to unvaccinated, and their excess from the reference values for certain age groups, should be carefully considered to understand the underlying factors. Furthermore, since the initial values of the SMRs are much lower than 1, we assume the presence of significant biases in the ONS dataset, leading to understimate the risks for the vaccinated people, as it is implausible that COVID-19 vaccines protect against non-COVID-19 deaths. It would be desirable for other major countries to systematically collect all-cause mortality by vaccination status and, in the meantime, a pending indepth investigations, much greater caution should be exercised in promoting mass vaccination campaigns.</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>COVID-19; COVID-19 vaccinations; all-cause mortality; Standardized Mortality Ratio</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 1</title>
                <p>The new version has integrated or better explained the text based on the reviewers' requests, with a partial restructuring of the Abstract, the insertion of a new important bibliographic reference, a support from data of the ONS itself for the illustration of the concept of healthy-vaccinee bias, a paragraph on limitations, and a better formulation of the conclusions.</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec id="sec5" sec-type="intro">
            <title>1. Introduction</title>
            <p>Due to the COVID-19 pandemic crisis and the subsequent COVID-19 mass vaccination campaign, the interest has hugely soared in publicly available data on all-cause mortality. For example, data from England and Wales show in 2022, in comparison to the previous average five-year reference period, an excess mortality with a trend driven by more deaths than expected starting in March 2022.
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> From April 2021 to the end of May 2023 (the period covered by the ONS dataset) the total excess mortality amounted to 129,801 deaths above the five-year average.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup> A similar trend occurs in many other countries in the European Union (EU), as indicated by the graphs and maps provided by the European Mortality Monitoring Project (EuroMoMo), a routine public health mortality monitoring system aimed at detecting and measuring excess deaths related to public health threats across EU countries. According to EuroMoMo, the excess deaths in 2022 were 328,047 in 2022 and 305,301 in 2021 (
                <ext-link ext-link-type="uri" xlink:href="https://www.euromomo.eu/graphs-and-maps">Graphs and maps &#x2014; EUROMOMO</ext-link>, accessed May 1, 2024). This is clearly an anomaly, as previous mortality shocks over the past 120 years have almost always been followed by immediate rebounds back, in one to two years,
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup> with normalization of mortality risk.</p>
            <p>A similar observation has also been made
                <sup>
                    <xref ref-type="bibr" rid="ref39">4</xref>
                </sup> about excess mortality across 47 countries in the Western World since the COVID-19 Pandemic, based on &#x2018;Our World in Data&#x2019; estimates of January 2020 to December 2022. Indeed, excess mortality was registered in 87% of countries in 2020, in 89% in 2021 and in 91% in 2022. During 2021, when not only containment measures but also COVID-19 vaccines were used to tackle virus spread and infection, the highest number of excess deaths was recorded.
                <sup>
                    <xref ref-type="bibr" rid="ref39">4</xref>
                </sup>
            </p>
            <p>England and Wales benefit from one of the best public health data collection systems in the world, and are therefore uniquely positioned to monitor and investigate the above-mentioned phenomenon.
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> Moreover, the Office for National Statistics (ONS) of the United Kingdom (UK) has published all-cause mortality data in England,
                <sup>
                    <xref ref-type="bibr" rid="ref4">5</xref>
                </sup> stratified according to COVID-19 vaccination status, thus overcoming the intrinsic limitation of just identifying deaths due to COVID-19, as for instance happens so far in Italy and in most if not all EU countries, and allowing a direct assessment of the eventual consequences of COVID-19 vaccination for individual as well as public health in terms of change not only of COVID-19 mortality but also of all-cause mortality. In addition, the UK vaccinated more than 50% of its eligible population in the first four months of 2021 and by the end of 2021, 77% received at least one dose,
                <sup>
                    <xref ref-type="bibr" rid="ref5">6</xref>
                </sup> thus exceeding the aforementioned threshold earlier than most of the other EU countries. It is therefore possible that the trends observed in England and Wales anticipate what will later occur in EU.</p>
            <p>We decided therefore to analyze the ONS public data on all-cause mortality according to vaccination status, starting from the rates already officially provided by the ONS itself on its website.
                <sup>
                    <xref ref-type="bibr" rid="ref4">5</xref>
                </sup> We calculated the rate ratios RR by vaccination status for every age group. Furthermore, due to month-to-month variation in the populations of individual vaccination status, we decided to calculate Standardized Mortality Ratios (SMRs) for those vaccinated with any dose in the different age groups, and to evaluate any potential emerging trends over time. A previous version of this study, dealing with UK ONS data from January to May 2021, is available on 
                <ext-link ext-link-type="uri" xlink:href="http://Preprints.org">Preprints.org</ext-link>.
                <sup>
                    <xref ref-type="bibr" rid="ref6">7</xref>
                </sup>
            </p>
        </sec>
        <sec id="sec6" sec-type="methods">
            <title>2. Methods</title>
            <p>In this retrospective study we collected data from the UK ONS web-based platform.
                <sup>
                    <xref ref-type="bibr" rid="ref4">5</xref>
                </sup> This platform gathers total mortality data by vaccination status from April, 2021 until May, 2023. Data are publicly available under the Open Government license (
                <ext-link ext-link-type="uri" xlink:href="https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/">https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/</ext-link>, accessed on 12 February 2024), and can therefore be freely analyzed and published provided that the source is properly acknowledged.</p>
            <p>
Relying on the excel file provided by this platform, we utilized data from the spreadsheet named &#x201c;Table 2&#x201d;(extended data), inasmuch as, differently from other spreadsheets, it provides proper stratification by age and vaccination status to perform an estimate of the Standardization Mortality Rate (SMR) and Relative Risks (RR) for the All-causes death and Non-COVID-19 deaths variable. We could not consider Deaths involving COVID-19 inasmuch from the UK ONS dataset, the absolute frequency of deaths in many vaccination statuses and many age group indicated for this variable was &lt;3 mostly for the younger age groups and for many months of the year 2023. We were therefore unable to reliably calculate the RRs and SMRs. The spreadsheet used for this analysis provides seven age groups (18&#x2013;39, 40&#x2013;49, 50&#x2013;59, 60&#x2013;69, 70&#x2013;79, 80&#x2013;89, 90+ years) and each age group is further subdivided into several classes based on vaccination status:
                <list list-type="bullet">
                    <list-item>
                        <label>&#x2022;</label>
                        <p>Unvaccinated,</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>First dose less than 21 days before (1D&lt;21d),</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>First dose at least 21 days before (1D&#x2265;21d),</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>Second dose less than 21 days before (2D&lt;21d),</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>Second dose at least 21 days before (2D&#x2265;21d),</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>Third dose or booster less than 21 days before (3D&lt;21d),</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>Third dose or booster at least 21 days before (3D&#x2265;21d).</p>
                    </list-item>
                </list>
            </p>
            <p>Even if the ONS marks with a &#x201c;u&#x201d; (unreliable) any rates arising from a number of death lower than 20, nonetheless we decided to consider groups with a minimum of 10 deaths. Though being aware that the lower the number of deaths, the greater the uncertainty on both the rates and the RRs, this choice allowed us to identify trends of RR over time for each age group. Given the extremely variable nature of the RR trend over time, we decided to understand if this phenomenon was related to the distribution of populations between the various vaccination statuses and for each month of observation. In this regard, we created stacked graphs, in order to analyze the population distributions of the vaccination status for each age group and for each month of the entire observation period, inserting on the y-axis the person-years and on the x-axis the observation months (Supplementary materials, Tables S1-S7(extended data) and Figures S1A/B-S7A/B)((extended data)). From the stacked graphs, a dynamic distribution emerged over the entire observation period for all vaccination statuses. Furthermore, for all age groups was observed an almost constant distribution of the Unvaccinated population over period, unlike the 18-39 and 40-49 age groups where, for the first months of the observation, these groups were more representative compared to other vaccination status. Based on these observations, in order to manage the dynamic distribution of the vaccination statuses month per month, we decided to calculate the SMRs for each observation month. From the calculation of the SMRs boxes indicating &lt;3 deaths were excluded. Finally, for the 18-39, 40-49 age groups we decided do not consider the first six months and the first three months respectively while for the 50-59 we did not consider the first month, in order to compare a roughly constant distribution over time of the Unvaccinated population with the Vaccinated population and obtain a reliable estimate of the SMRs. This decision was made considering a percentage variation of no more than 1% between months in the unvaccinated population. Subsequently, we investigated the relation between SMRs and observation months applying a simple regression model and using SMRs as dependent variable and the observation months as independent variable. Finally, we calculated the intersection of the regression line with the reference line for the unvaccinated (y=1) to identify where possible, or predict where not, the moment in which deaths from all causes in the vaccinated group exceed those of the unvaccinated.</p>
            <sec id="sec7">
                <title>2.1 Statistical analysis</title>
                <p>To calculate the relative risk (RR) between the vaccinated and unvaccinated populations, we used the age-standardized rates indicated in the excel files provided by the UK ONS.
                    <sup>
                        <xref ref-type="bibr" rid="ref4">5</xref>
                    </sup> Their 95% confidence intervals (CI) were calculated according to the following formula
                    <sup>
                        <xref ref-type="bibr" rid="ref7">8</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref8">9</xref>
                    </sup>:
                    <disp-formula id="e1">

                        <mml:math display="block">
                            <mml:msub>
                                <mml:mi>CI</mml:mi>
                                <mml:mrow>
                                    <mml:mn>95</mml:mn>
                                    <mml:mo stretchy="true">(</mml:mo>
                                    <mml:mi>RR</mml:mi>
                                    <mml:mo stretchy="true">)</mml:mo>
                                </mml:mrow>
                            </mml:msub>
                            <mml:mo>=</mml:mo>
                            <mml:msup>
                                <mml:mi mathvariant="bold-italic">e</mml:mi>
                                <mml:mrow>
                                    <mml:mo stretchy="true">[</mml:mo>
                                    <mml:mo>ln</mml:mo>
                                    <mml:mrow>
                                        <mml:mo stretchy="true">(</mml:mo>
                                        <mml:mi mathvariant="normal">RR</mml:mi>
                                        <mml:mo stretchy="true">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mo>&#x00b1;</mml:mo>
                                    <mml:mn>1.96</mml:mn>
                                    <mml:mo>&#x2217;</mml:mo>
                                    <mml:msub>
                                        <mml:mi mathvariant="normal">SE</mml:mi>
                                        <mml:mrow>
                                            <mml:mo mathvariant="normal">ln</mml:mo>
                                            <mml:mrow>
                                                <mml:mo stretchy="true">(</mml:mo>
                                                <mml:mi mathvariant="normal">RR</mml:mi>
                                                <mml:mo stretchy="true">)</mml:mo>
                                            </mml:mrow>
                                        </mml:mrow>
                                    </mml:msub>
                                    <mml:mo stretchy="true">]</mml:mo>
                                </mml:mrow>
                            </mml:msup>
                            <mml:mo mathvariant="bold-italic">,</mml:mo>
                        </mml:math>
</disp-formula>where &#x201c;ln (RR)&#x201d; is the natural logarithm of the Relative Risk and &#x201c;SE
                    <sub>ln(RR)</sub>&#x201d; is the standard error of the natural logarithm of the RR.</p>
                <p>The SE
                    <sub>ln(RR)</sub> was calculated for each vaccination status of each of the age groups according to the formula:
                    <disp-formula id="e2">

                        <mml:math display="block">
                            <mml:mtext>SEln</mml:mtext>
                            <mml:mrow>
                                <mml:mo stretchy="true">(</mml:mo>
                                <mml:mi>RR</mml:mi>
                                <mml:mo stretchy="true">)</mml:mo>
                            </mml:mrow>
                            <mml:mo>=</mml:mo>
                            <mml:msqrt>
                                <mml:mrow>
                                    <mml:mrow>
                                        <mml:mo stretchy="true">(</mml:mo>
                                        <mml:mfrac>
                                            <mml:mrow>
                                                <mml:mi mathvariant="normal">V</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Pop</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mo>&#x2212;</mml:mo>
                                                <mml:mtext mathvariant="normal">Stand</mml:mtext>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">D</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Exp</mml:mi>
                                                <mml:mo>.</mml:mo>
                                            </mml:mrow>
                                            <mml:mrow>
                                                <mml:mi mathvariant="normal">V</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Pop</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mo>&#x2217;</mml:mo>
                                                <mml:mtext mathvariant="normal">Stand</mml:mtext>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">D</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Exp</mml:mi>
                                                <mml:mo>.</mml:mo>
                                            </mml:mrow>
                                        </mml:mfrac>
                                        <mml:mo stretchy="true">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mo>+</mml:mo>
                                    <mml:mrow>
                                        <mml:mo stretchy="true">(</mml:mo>
                                        <mml:mfrac>
                                            <mml:mrow>
                                                <mml:mi mathvariant="normal">Un</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Pop</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mo>&#x2212;</mml:mo>
                                                <mml:mtext mathvariant="normal">Stand</mml:mtext>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">D</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Exp</mml:mi>
                                                <mml:mo>.</mml:mo>
                                            </mml:mrow>
                                            <mml:mrow>
                                                <mml:mi mathvariant="normal">Un</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Pop</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mo>&#x2217;</mml:mo>
                                                <mml:mtext mathvariant="normal">Stand</mml:mtext>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">D</mml:mi>
                                                <mml:mo>.</mml:mo>
                                                <mml:mi mathvariant="normal">Exp</mml:mi>
                                                <mml:mo>.</mml:mo>
                                            </mml:mrow>
                                        </mml:mfrac>
                                        <mml:mo stretchy="true">)</mml:mo>
                                    </mml:mrow>
                                </mml:mrow>
                            </mml:msqrt>
                            <mml:mo>,</mml:mo>
                        </mml:math>

                        <label>(1)</label>
</disp-formula>
                </p>
                <p>Where, for each year, &#x201c;V.Pop.&#x201d; represents the vaccinated population, &#x201c;Un.Pop.&#x201d; represents the unvaccinated population, and &#x201c;Stand.D.Exp.&#x201d; represents the expected standardized deaths, that is, the deaths that would occur by applying the Age-standardised mortality rates per 100,000 person-years (Note 1, spreadsheet &#x201c;Note&#x201d; UK ONS web-based platform
                    <sup>
                        <xref ref-type="bibr" rid="ref5">6</xref>
                    </sup>) to the real population, calculated according to the formula:
                    <disp-formula id="e3">

                        <mml:math display="block">
                            <mml:mtext>Expected Standardized Deaths</mml:mtext>
                            <mml:mo>=</mml:mo>
                            <mml:mfrac>
                                <mml:mrow>
                                    <mml:mspace width="0.25em"/>
                                    <mml:mi mathvariant="normal">Age</mml:mi>
                                    <mml:mo>&#x2212;</mml:mo>
                                    <mml:mtext mathvariant="normal">standardized rate</mml:mtext>
                                    <mml:mo>&#x2217;</mml:mo>
                                    <mml:mtext mathvariant="normal">Population of each vaccine status</mml:mtext>
                                </mml:mrow>
                                <mml:mn>100.000</mml:mn>
                            </mml:mfrac>
                            <mml:mo>.</mml:mo>
                        </mml:math>
</disp-formula>
                </p>
                <p>The choice to use the &#x201c;Expected Standardized Deaths&#x201d; is justified by the fact that the calculated RR expresses the ratio between two standardized rates based on the European population. The P value was calculated according to Altman and Bland
                    <sup>
                        <xref ref-type="bibr" rid="ref9">10</xref>
                    </sup>:
                    <disp-formula id="e4">

                        <mml:math display="block">
                            <mml:mi>p</mml:mi>
                            <mml:mo>=</mml:mo>
                            <mml:mo>exp</mml:mo>
                            <mml:mrow>
                                <mml:mo stretchy="true">(</mml:mo>
                                <mml:mo>&#x2212;</mml:mo>
                                <mml:mn>0.717</mml:mn>
                                <mml:mo>&#x00d7;</mml:mo>
                                <mml:mi>z</mml:mi>
                                <mml:mo>&#x2212;</mml:mo>
                                <mml:mn>0.416</mml:mn>
                                <mml:mo>&#x00d7;</mml:mo>
                                <mml:msup>
                                    <mml:mi>z</mml:mi>
                                    <mml:mn>2</mml:mn>
                                </mml:msup>
                                <mml:mo stretchy="true">)</mml:mo>
                            </mml:mrow>
                        </mml:math>
</disp-formula>where 
                    <inline-formula>

                        <mml:math display="inline">
                            <mml:mi>z</mml:mi>
                            <mml:mo>=</mml:mo>
                            <mml:mfrac>
                                <mml:mrow>
                                    <mml:mo mathvariant="normal">ln</mml:mo>
                                    <mml:mrow>
                                        <mml:mo stretchy="true">(</mml:mo>
                                        <mml:mi mathvariant="normal">RR</mml:mi>
                                        <mml:mo stretchy="true">)</mml:mo>
                                    </mml:mrow>
                                </mml:mrow>
                                <mml:mi mathvariant="normal">SE</mml:mi>
                            </mml:mfrac>
                        </mml:math>
</inline-formula> and SE is the 
                    <xref ref-type="disp-formula" rid="e2">(1)</xref>.</p>
                <p>To calculate SMR indirect standardization method was applied according to Naing (2000).
                    <sup>
                        <xref ref-type="bibr" rid="ref10">11</xref>
                    </sup> Before to use the simple regression model, all the assumption of the model was verified: scatter plot was created to verify the linear relationship between variables, Shapiro-Wilk normality test was used to verify the residual distributions and Breusch-Pagan test was used to verify homoscedasticity of the variance of errors. To calculate the intersection of the regression line with the reference line of the unvaccinated for each age group we indicated the observation months with a progressive number and solved the equation of the regression line for x and assigning y=1. The x value obtained was compared with the numbers assigned of the observation months so that we could identify a specific moment in the observation period.</p>
                <p>Data was processed using R studio (version 2023.09.0).</p>
            </sec>
        </sec>
        <sec id="sec8" sec-type="results">
            <title>3. Results</title>
            <sec id="sec9">
                <title>3.1 About ONS dataset</title>
                <p>The UK ONS dataset we investigated is the latest version available.
                    <sup>
                        <xref ref-type="bibr" rid="ref4">5</xref>
                    </sup> It is based on the population in Census 2021, linking Census deidentified records to National Health Service (NHS) numbers. People with no NHS number or multiple entries are not included.</p>
                <p>The individuals were then linked via NHS number to vaccination data from the National Immunisation Management Service (NIMS) and ONS death registrations. The population was restricted to people in England, alive on 1 April 2021. Overall, ONS dataset population (51,786,812 people) covers 91.6% of the England population on Census Day 2021. The excluded population therefore amount to almost 4,600,000 people. Furthermore, 103,142 were excluded due to erroneous or inconsistent vaccination data, so the overall excluded population amounts to almost 4,700,000 people.</p>
                <p>Finally, of the 1,149,784 deaths that occurred in England between 1 April 2021 and 31 May 2023, 90.6% (1,041,524) could be linked to individuals in the 2021 Census.</p>
            </sec>
            <sec id="sec10">
                <title>3.2 Population distributions</title>
                <p>The stacked graphs showed a dynamic distribution over all observation period whose percentages and absolute frequencies are reported in Supplementary Material (Tables S1-S7 and Figures S1A/B&#x2013;S7A/B) (Extended data).
                    <sup>
                        <xref ref-type="bibr" rid="ref38">39</xref>
                    </sup>
                </p>
            </sec>
            <sec id="sec11">
                <title>3.3 Rate Ratios (RR)</title>
                <p>All-causes mortality rate ratios RR according to vaccination status are shown in Supplementary, Tables S8-S14(Extended data)
                    <sup>
                        <xref ref-type="bibr" rid="ref38">39</xref>
                    </sup> and Figures S8-S14(Extended data).
                    <sup>
                        <xref ref-type="bibr" rid="ref38">39</xref>
                    </sup> Similarly, RRs for non-COVID19 related deaths are shown in Tables S15-S21(Extended data)
                    <sup>
                        <xref ref-type="bibr" rid="ref38">39</xref>
                    </sup> and Figures S15-S21(Extended data).
                    <sup>
                        <xref ref-type="bibr" rid="ref38">39</xref>
                    </sup> Main results for both mortality causes are summarized below.</p>
                <p>

                    <italic toggle="yes">Deaths from all causes</italic>:</p>
                <p>In all age groups, those vaccinated with the first dose at least 21 days ago have a significantly higher risk of death from all causes than those not vaccinated in almost all months of the entire period, except for the 18-39 age group in which the RRs are significatively higher than 1 in half the months. The average RR values in all age groups are between 1.7 and 2.3, except for the 18-39 years group where the average is 1.5. In the age groups 18-39, 60-69, and older RRs present initial peaks higher than 3, up to a maximum of 5.5 in the 70-79 age group.</p>
                <p>As regards those vaccinated with 2 doses at least 21 days ago, in the age groups starting from 60 years, the risk of death from all causes in the initial months is much lower than the unvaccinated, with a tendency to increase. Since around a third of the entire period (between October and December 2021) RRs significantly exceeds the reference value, remaining higher in almost all the remaining months, although not significatively in the last few months for 60-69 and 90+ years age groups.</p>
                <p>The RRs for those vaccinated with three doses at least 21 days ago, for the age groups 60-69 years and older, present a growth trend which, starting from values much lower than one, reaches and exceeds the reference value:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>for the 60-69 years age group, the risk of death significantly exceeds that of the unvaccinated in the months of November and December 2022 and remains in the following months not significantly different from that of the unvaccinated;</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>for the 70-79 years age group the RR exceeds the reference value in June 2022 and always remains significantly higher, apart from the months of September 2022 and May 2023 where the values are not significative;</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>for the 80-89 years age group the RR exceeds the reference value in April 2022, reaches the maximum value (RR = 2.29, CI
                                <sub>95</sub> = 2.04-2.58) and then stabilizes on values always significantly higher than 1;</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>for vaccinated people aged 90 years and over, the reference value is exceeded in April 2022 (RR = 1.13, CI
                                <sub>95</sub> = 1.02-1.26), then remaining at values always significantly higher than 1, with a maximum of 1.85 in November 2022.</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <italic toggle="yes">Deaths non correlated to COVID19</italic>
                </p>
                <p>The rate ratios (RR) from non-Covid causes follow the trends already seen for deaths from all causes, with slightly higher values. Therefore, the above considerations can be repeated.</p>
            </sec>
            <sec id="sec12">
                <title>3.4 Standardized mortality ratios</title>
                <p>

                    <italic toggle="yes">Age groups</italic>
                </p>
                <p>The results of all regression models performed for the all-causes deaths and non-COVID19 deaths variable and for each age group are summarized in 
                    <xref ref-type="table" rid="T1">
Table 1</xref>. Furthermore, in table 1 are indicated the intersection of the regression line with the reference line of the unvaccinated also in the graphs where is not possible to visualize the intersection.</p>
                <table-wrap id="T1" orientation="portrait" position="float">
                    <label>
Table 1. </label>
                    <caption>
                        <title>Coefficient of determination (R2) of the regression analysis of SMRs and observation months and p-value of the regression line for each age group and for the All-causes death and Non-COVID-19 deaths variable; intersection: intersection of the regression line with the reference line for the unvaccinated (y=1).</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Age group</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Variables</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">R
                                    <sup>2</sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">p-value
</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Intersection</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">18-39</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">All-causes death</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.601</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">January, 2023</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Non-COVID-19 deaths</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.500</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.0005</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">January, 2023</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">40-49</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">All-causes death</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.712</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">September, 2023</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Non-COVID-19 deaths</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.463</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.0003</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">April, 2023</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">50-59</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">All-causes death</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.734</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">July, 2024</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Non-COVID-19 deaths</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.609</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">January, 2025</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">60-69</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">All-causes death</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.847</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">February, 2024</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Non-COVID-19 deaths</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.745</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">May, 2024</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">70-79</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">All-causes death</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.860</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">January, 2024</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Non-COVID-19 deaths</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.764</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">May, 2024</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">80-89</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">All-causes death</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.784</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">April, 2023</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Non-COVID-19 deaths</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.706</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">January, 2023</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">90+</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">All-causes death</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.695</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">September, 2022</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Non-COVID-19 deaths</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">0.705</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">&lt;0.0001</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">May, 2022</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>The regression model for 18-39 age group showed coefficient of determination R
                    <sup>2</sup>=0.601 and a p-value &lt;0.0001 for the All-causes death variable. For the non-COVID19 deaths regression model showed a R
                    <sup>2</sup>=0.500 and a p-value=0.0005 (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>). Both variables showed the intersection of the regression line in January 2023.</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>
Figure 1. </label>
                    <caption>
                        <title>Regression line of the SMR trend of the 18-39 age group.</title>
                    </caption>
                    <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/177063/fb15b94c-9a83-45a4-975f-82953159a93f_figure1.gif"/>
                </fig>
                <p>The regression model for 40-49 age group showed coefficient of determination R
                    <sup>2</sup>=0.712 and a p-value &lt;0.0001 for the All-causes death variable. For the non-COVID19 deaths regression model showed a R
                    <sup>2</sup>=0.463 and a p-value=0.0003 (
                    <xref ref-type="fig" rid="f2">Figure 2</xref>). The All-causes death variables showed the intersection of the regression line in September 2023 while the non-COVID19 deaths showed the intersection of the regression line in April 2023.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>
Figure 2. </label>
                    <caption>
                        <title>Regression line of the SMR trend of the 40-49 age group.</title>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/177063/fb15b94c-9a83-45a4-975f-82953159a93f_figure2.gif"/>
                </fig>
                <p>The regression model for 50-59 age group showed coefficient of determination R
                    <sup>2</sup>=0.734 and a p-value &lt;0.0001 for the All-causes death variable. For the non-COVID19 deaths regression model showed a R
                    <sup>2</sup>=0.609 and a p-value&lt;0.0001 (
                    <xref ref-type="fig" rid="f3">Figure 3</xref>). The All-causes death variables showed the intersection of the regression line in July 2023 while the non-COVID19 deaths showed the intersection of the regression line in January 2025.</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>
Figure 3. </label>
                    <caption>
                        <title>Regression line of the SMR trend of the 50-59 age group.</title>
                    </caption>
                    <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/177063/fb15b94c-9a83-45a4-975f-82953159a93f_figure3.gif"/>
                </fig>
                <p>The regression model for 60-69 age group showed coefficient of determination R
                    <sup>2</sup>=0.847 and a p-value &lt;0.0001 for the All-causes death variable. For the non-COVID19 deaths regression model showed a R
                    <sup>2</sup>=0.745 and a p-value&lt;0.0001 (
                    <xref ref-type="fig" rid="f4">Figure 4</xref>). The All-causes death variables showed the intersection of the regression line in February 2024 while the non-COVID19 deaths showed the intersection of the regression line in May 2024.</p>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>
Figure 4. </label>
                    <caption>
                        <title>Regression line of the SMR trend of the 60-69 age group.</title>
                    </caption>
                    <graphic id="gr4" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/177063/fb15b94c-9a83-45a4-975f-82953159a93f_figure4.gif"/>
                </fig>
                <p>The regression model for 70-79 age group showed coefficient of determination R
                    <sup>2</sup>=0.860 and a p-value &lt;0.0001 for the All-causes death variable. For the non-COVID19 deaths regression model showed a R
                    <sup>2</sup>=0.764 and a p-value&lt;0.0001 (
                    <xref ref-type="fig" rid="f5">Figure 5</xref>). The All-causes death variables showed the intersection of the regression line in January 2024 while the non-COVID19 deaths showed the intersection of the regression line in May 2024.</p>
                <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                    <label>
Figure 5. </label>
                    <caption>
                        <title>Regression line of the SMR trend of the 70-79 age group.</title>
                    </caption>
                    <graphic id="gr5" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/177063/fb15b94c-9a83-45a4-975f-82953159a93f_figure5.gif"/>
                </fig>
                <p>The regression model for 80-89 age group showed coefficient of determination R
                    <sup>2</sup>=0.784 and a p-value &lt;0.0001 for the All-causes death variable. For the non-COVID19 deaths regression model showed a R
                    <sup>2</sup>=0.706 and a p-value&lt;0.0001 (
                    <xref ref-type="fig" rid="f6">Figure 6</xref>). The All-causes death variables showed the intersection of the regression line in April 2023 while the non-COVID19 deaths showed the intersection of the regression line in January 2023.</p>
                <fig fig-type="figure" id="f6" orientation="portrait" position="float">
                    <label>
Figure 6. </label>
                    <caption>
                        <title>Regression line of the SMR trend of the 80-89 age group.</title>
                    </caption>
                    <graphic id="gr6" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/177063/fb15b94c-9a83-45a4-975f-82953159a93f_figure6.gif"/>
                </fig>
                <p>The regression model for 90+ age group showed coefficient of determination R
                    <sup>2</sup>=0.695 and a p-value &lt;0.0001 for the All-causes death variable. For the non-COVID19 deaths regression model showed a R
                    <sup>2</sup>=0.705 and a p-value&lt;0.0001 (
                    <xref ref-type="fig" rid="f7">Figure 7</xref>). The All-causes death variables showed the intersection of the regression line in September 2022 while the non-COVID19 deaths showed the intersection of the regression line in May 2022.</p>
                <fig fig-type="figure" id="f7" orientation="portrait" position="float">
                    <label>
Figure 7. </label>
                    <caption>
                        <title>Regression line of the SMR trend of the 90+ age group.</title>
                    </caption>
                    <graphic id="gr7" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/177063/fb15b94c-9a83-45a4-975f-82953159a93f_figure7.gif"/>
                </fig>
            </sec>
        </sec>
        <sec id="sec13" sec-type="discussion">
            <title>4. Discussion</title>
            <p>In the present study, we analyzed the UK ONS data on all-cause mortality according to vaccination status, which are publicly available on the ONS institutional website.
                <sup>
                    <xref ref-type="bibr" rid="ref4">5</xref>
                </sup> The main findings of our analysis are:

                <list list-type="alpha-lower">
                    <list-item>
                        <label>(a)</label>
                        <p>compared with unvaccinated, vaccinated with one or two doses show, in the period April 2021-May 2023, a substantially higher risk of all-causes and non-COVID-19 deaths
                            <bold>.</bold> Indeed, for both causes people vaccinated with one dose show a RR significatively higher than 1 through almost the whole period and in any of the age groups, except the 18-39 years, in which it is significatively higher in half the period. In people who received the second dose, from 60 to 90+ years of age the risk of all-causes and non-COVID-19 death is significatively higher than in unvaccinated people through about the final two thirds of the period. It should be noted that from 50 to 90+ years of age the RRs of all-causes and non-COVID-19 death have implausibly low initial values.</p>
                    </list-item>
                    <list-item>
                        <label>(b)</label>
                        <p>Also vaccinated with three doses have incredibly low initial values of RR both for all-causes and for non-COVID-19 deaths. Their RRs, for people aged 60-69 and older progressively grow up to reach and exceed the reference value from 60 years of age, and from 70 years and over the RRs remain significantly greater than 1.</p>
                    </list-item>
                    <list-item>
                        <label>(c)</label>
                        <p>A linear growth trend is revealed by regression analysis of Standardized Mortality Ratios of people vaccinated with any dose compared to the unvaccinated across all age groups, for both all-cause and non-COVID-19 deaths. The regression lines, both for all-cause deaths and for non-COVID-19 ones, start from very low values for all the age groups. For the age groups 18-39, 80-89 and 90+ years both regression lines intersect the reference line of unvaccinated during the study period. The same occurs for the age 50-59, limited to non-COVID-19 deaths, For the other age groups, we have predicted the month of the intersection (see 
                            <xref ref-type="table" rid="T1">Table 1</xref>).</p>
                    </list-item>
                </list>
            </p>
            <p>The results found for the RRs of the first and second doses are confirmed in other studies, e.g. in two studies carried out in an Italian province.
                <sup>
                    <xref ref-type="bibr" rid="ref11">12</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref12">13</xref>
                </sup> Both studies show a significantly higher risk of death from all causes for those vaccinated with one and two doses compared to the unvaccinated. Furthermore, they show an implausible high protection of the vaccine against deaths from all causes, too high to be attributed to protection from deaths from COVID-19, which are a minority percentage of total deaths. Both studies, however, are affected by important biases. The main one is the so-called Immortal Time Bias (ITB), as highlighted in an intervention published in an Italian epidemiology journal.
                <sup>
                    <xref ref-type="bibr" rid="ref13">14</xref>
                </sup> After correction of ITB, the unlikely protection provided by the third dose against death from all causes disappears entirely. Another recent study,
                <sup>
                    <xref ref-type="bibr" rid="ref14">15</xref>
                </sup> was based on the same dataset kindly provided by the authors of the article,
                <sup>
                    <xref ref-type="bibr" rid="ref12">13</xref>
                </sup> but corrected for the ITB. In its multivariable analysis, this study shows higher all-cause death hazard ratios (HRs) for individuals vaccinated with one and two doses compared to unvaccinated, and no protection against all-cause deaths for population vaccinated with 3 or more doses. Furthermore, the study
                <sup>
                    <xref ref-type="bibr" rid="ref14">15</xref>
                </sup> found a small but statistically significant reduction in life expectancy for vaccinated people with two and three or more doses</p>
            <p>The present study also shows extremely low initial risks of all-causes and nonCOVID-19 death, as well in the analysis of the RRs for those vaccinated with two and three doses, as in that of the SMRs for those vaccinated with any dose compared to the unvaccinated. These results appear difficult to justify, especially when referring to non-COVID-19 deaths, unless admitting the presence of some important selection bias. In fact, if the populations being compared were homogeneous, the risk difference of death from causes other than COVID-19 should be about zero, and both the RRs and SMRs for non-COVID deaths should not differ significantly from 1.</p>
            <p>Unfortunately, there is a lack of information on the health status of populations or about other factors that influence the risk of death, so we can only formulate some hypotheses, that are not necessarily alternative.</p>
            <sec id="sec14">
                <title>4.1 Underestimation of the unvaccinated population</title>
                <p>One hypothesis might be an underestimation of the unvaccinated population in the ONS dataset. We have seen that the population included in this dataset does not cover the entire population of England recorded in the 2021 census. The population left out of the dataset is around 4,700,000 people. There would be a selection bias with systematic effects throughout the period if this proportion of the total population were not equally distributed between vaccinated and unvaccinated, and if it included a greater proportion of unvaccinated. We can see from the last two ONS reports that, although they cover a larger population than previous reports, the criteria for inclusion (and therefore exclusion) are the same as those based on the previous census. They are therefore subject to the same limitations. The main one is that the excluded population is not randomly selected, and therefore the population covered by the dataset is not representative of the general population. The key to inclusion is having a National Health Service (NHS) number. The probability of a vaccinated person not having an NHS number is virtually zero, because without a number you cannot be vaccinated. However, this is not the case for the unvaccinated, some of whom may not have been registered with a General Practitioner (GP) and therefore do not have an NHS number. As deaths among the unvaccinated are certified in the same way as those among the vaccinated, they cannot escape ONS registration. This would result in a relative overestimation of mortality rates for the unvaccinated and consequently an underestimation of RRs and SMRs for the vaccinated.</p>
            </sec>
            <sec id="sec15">
                <title>4.2 The healthy-vaccinee bias</title>
                <p>Another possible contributory hypotheses is the so called healthy-vaccinee bias.
                    <sup>
                        <xref ref-type="bibr" rid="ref15">16</xref>
                    </sup>
                    <sup>&#x2013;</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref18">19</xref>
                    </sup> In 2021 a lower mortality among the vaccinated can also be explained partly by the healthy-adherer effect, or the healthy-vaccinee bias in the vaccination field. This effect is much more powerful than commonly thought: in fact, voluntary adherence to a treatment can be associated with a nearly halved mortality,
                    <sup>
                        <xref ref-type="bibr" rid="ref19">20</xref>
                    </sup>
                    <sup>&#x2013;</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref21">22</xref>
                    </sup> and even with a mortality reduction of 2.5 to 3 or more times
                    <sup>
                        <xref ref-type="bibr" rid="ref15">16</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref17">18</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref22">23</xref>
                    </sup>
                    <sup>&#x2013;</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref24">25</xref>
                    </sup> compared to the mortality of those who do not adhere. This effect is independent of the type of treatment to which one adheres voluntarily, being also found in randomized controlled trials in the placebo adherers (compared with placebo non-adherers). This effect may have several explanations. In the short time, individuals contingently ill tend to postpone vaccination.
                    <sup>
                        <xref ref-type="bibr" rid="ref24">25</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref25">26</xref>
                    </sup> In addition, doctors can renounce to vaccinate people considered close to death, whose subsequent death burdens the unvaccinated cohort disproportionately.</p>
                <p>However, the healthy-adherer effect can be detected over many years,
                    <sup>
                        <xref ref-type="bibr" rid="ref15">16</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref17">18</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref19">20</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref22">23</xref>
                    </sup> because subjects adhering to preventive treatments are usually at the same time more likely to engage in healthy lifestyles than patients not adhering.
                    <sup>
                        <xref ref-type="bibr" rid="ref16">17</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref20">21</xref>
                    </sup> A healthy lifestyle includes diet, exercise, lower tobacco and alcohol consumption, less risky behaviors,
                    <sup>
                        <xref ref-type="bibr" rid="ref26">27</xref>
                    </sup> and the search for better health care. These features&#x2014;difficult to capture in administrative databases&#x2014;are associated with morbidity and mortality outcomes in observational studies. Moreover, the trust in the intervention to which one adheres can exert a beneficial placebo effect. The healthy-adherer bias is more difficult to correct than the opposite effect of confounding by indication (subjects in worse health conditions are vaccinated first), which is relatively easier to correct, provided it is known e.g. the number of comorbidities, or the Charlson comorbidity index of the groups to be compared.
                    <sup>
                        <xref ref-type="bibr" rid="ref27">28</xref>
                    </sup> Unfortunately, the UK ONS public data do not include any information about comorbidities. It is likely that the healthy-vaccinee bias effect will continue to operate to varying degrees in 2022 and 2023, albeit to a diminishing extent during periods in which vaccination mandates have been in force.</p>
                <p>Moreover, it is plausible that the increase in the number of the vaccinated has diluted the opposite effect of confounding by indication.
                    <sup>
                        <xref ref-type="bibr" rid="ref27">28</xref>
                    </sup>
                </p>
                <p>A commonly used argument is the better known confounding by indication effect
                    <sup>
                        <xref ref-type="bibr" rid="ref27">28</xref>
                    </sup>: it is likely that fragile subjects with multiple diseases have been vaccinated as a priority, followed by the others. However, as the vaccination campaigns proceed, the composition of the vaccinated and unvaccinated populations should result less unbalanced with respect to the pre-existing state of health. The ONS declare that &#x201c;Changes in non-COVID-19 mortality by vaccination status are largely driven by the changing composition of the vaccination status groups. This is because of the priority given to clinically extremely vulnerable people or with underlying health conditions, and differences in timing of vaccination among eligible people".
                    <sup>
                        <xref ref-type="bibr" rid="ref3">3</xref>
                    </sup> However, a priority was also given to the healthier population of health workers. Moreover, the most fragile part of the population prioritized for the vaccination is a smaller portion (especially in the younger ages), and the composition of each age group progressively tends to be similar to that of the unvaccinated, in terms of general health conditions. Therefore, a decreasing trend would be expected, both because of the decreasing weight of the fragile fraction compared to the overall group and because of the harvesting effect, described below.</p>
                <p>The healthy-vaccinee/un-healthy-un-vaccinee bias might be further supported by the web page by the Office for National Statistics,
                    <sup>
                        <xref ref-type="bibr" rid="ref30">31</xref>
                    </sup> showing that unvaccinated have higher tendency: to live in more deprived areas, urban areas, or social rented housing, to be not born in the UK or do not have English as a main language, to have never worked or to be long-term unemployed, to be more limited by a disability, and to be male (more men die than women).
                    <sup>
                        <xref ref-type="bibr" rid="ref30">31</xref>
                    </sup>
                </p>
            </sec>
            <sec id="sec16">
                <title>4.3 The harvesting effect</title>
                <p>The RRs of the first doses generally show high initial mortality peaks, possibly linked to the priority given to the fragile subjects. The early death of the most fragile causes that those who move on to the second dose are healthier overall. It is unfortunate that the last two ONS datasets do not provide data for the first three months of 2021, corresponding to the start of the vaccination programme. In fact, since vaccinations began with the older classes, in April 2021 the latter had not only completed the vaccination with the first dose, but had already started the second. Therefore our hypothesis can be confirmed only in the age groups 18-39 and 40-49, where one can clearly perceive the initial mortality peak of the first doses, probably already decreasing, followed by the initial mortality peak of the second doses, starting from lower values and with a lower maximum compared to that of the first doses.</p>
                <p>As regards the third doses, the initial mortality peak disappears in all age groups, suggesting that many of the most &#x201c;fragile&#x201d; people have already died, and that a &#x2018;healthy-vaccinee effect&#x2019; might partly explain the initial very low RR values.</p>
                <p>Examining the SMR graphs, we note that, apart from the elderly, the points relating to all-cause deaths and non-COVID-19 deaths tend to overlap over time. This may indicate that the impact of COVID-19-related deaths vanishes, and that the risk of all-cause death and of deaths not related to COVID-19 is nearly the same. In fact, in the ONS dataset, approaching the end of the observation period, the COVID-19-deaths for the different vaccination statuses show an ever-increasing number of values indicated with &lt;3, what prevents one from calculating both the RRs and the SMRs. This justifies the choice not to take into consideration COVID-19 deaths, but only all-cause and non-COVID-19 deaths.</p>
                <p>Hence, the insistent push towards further vaccinations seems hardly motivated.</p>
            </sec>
            <sec id="sec17">
                <title>4.4 Loss of protective vaccine effectiveness and lower lethality of new variants</title>
                <p>Again, examining the SMRs, the fact that initially the regression line of non-COVID-19 deaths is above that of all-cause deaths might indicate that the vaccine initially has a protective effect on COVID-19 deaths, thus lowering the risk of all-cause deaths, that include those COVID-19 related, among vaccinated people. The fact that they subsequently converge may indicate either that the vaccine gradually loses its protective effectiveness, or that the risk of COVID-19 deaths decreases due to the increasingly lower lethality of the new variants, or that the two causes act together.</p>
                <p>The SMR graphs allow one to make a further consideration: in the 80-89 age group the convergence of the lines of all-cause deaths is much attenuated, and in the 90+ age group the lines are almost parallel, as one can see from the regression coefficients that differ less and less. This might indicate that COVID-19 still represents a risk for the elderly and that the vaccine therefore protects them by reducing the risk of all-cause deaths. Yet, it might also be due to the fact that the lower lethality of the new variants is offset by the fact that the vaccinated people get infected more than unvaccinated
                    <sup>
                        <xref ref-type="bibr" rid="ref28">29</xref>
                    </sup>
                    <sup>&#x2013;</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref35">36</xref>
                    </sup> and that by taking additional doses they are temporarily protected from the risk of dying from COVID-19.</p>
            </sec>
            <sec id="sec18">
                <title>4.5 Unintended effects of COVID-19 vaccines on the increasing deaths</title>
                <p>Last but not least: why are the SMRs of non-COVID-19 related deaths increasing? Why should the risk of those vaccinated with any dose increase compared to that of the unvaccinated? Apart from the risk of immediate adverse reactions/events, the doubt naturally arises that the vaccine
                    <strike>,
</strike> might cause damage to the immune system, exposing the vaccinated to a greater risk of death from pathologies non-COVID-19 related
                    <sup>
                        <xref ref-type="bibr" rid="ref36">37</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref37">38</xref>
                    </sup>
                </p>
            </sec>
        </sec>
        <sec id="sec28">
            <title>5. Limitation</title>
            <p>Although this study shows an increase in SMR for all causes of death in vaccinated compared to unvaccinated individuals over time, we acknowledge some limitations. First, the lack of individual data published by the UK Office for National Statistics (ONS), which would have allowed us to determine the exact time at which each subject transitioned to a different vaccination status, did not allow us to use a different statistical approach that could provide more robust measures of association. Second, the extremely low baseline risk for all causes of death and death from non-COVID-19 is likely due to differences in the representativeness of comorbidity between groups, which the UK ONS does not provide (and likely does not possess to a large extent: see healthy-vaccinee bias). Therefore, it was not possible to adjust the estimation of the model for these covariates.</p>
        </sec>
        <sec id="sec19" sec-type="conclusions">
            <title>6. Conclusions</title>
            <p>The English all-cause and non-COVID-19 mortality data by vaccination status, released by the UK ONS for the 26 months from April 2021 to May 2023, were analyzed by age group and vaccination status. Our findings show that all-cause deaths SMRs were increasing in any of the age groups considered. All-cause death SMRs, initially well below 1 for every age group, due to their increase, since a certain date exceeded the reference value of the unvaccinated people for the age groups 18-39, 80-89 and 90+. For the other age groups, it is possible to predict the date in which the SMR would reach the value 1, intersecting the unvaccinated level, provided that this trend is consistently maintained.</p>
            <p>Non-COVID-19 SMR values show a very similar trend: initially they are much lower than 1, but it is not plausible such a vaccine protection from non-COVID-19 deaths. Therefore, this suggests significant biases in the ONS dataset, leading to an underestimation of the risks for the vaccinated. Regardless of the interpretative hypotheses, the fact that all-cause mortality SMRs in vaccinated increase over time compared to those of unvaccinated requires further, urgent investigation.</p>
            <p>In any case, we hope that the ONS will resume the publication of the mortality data series by vaccination status, interrupted in May 2023, and that its example will be followed by other countries.</p>
            <p>Moreover, the precautionary principle should suggest much greater caution in promoting extensive vaccination campaigns, pending the acquisition of valid explanations of the alarming phenomenon observed.</p>
        </sec>
        <sec id="sec20">
            <title>Institutional review board statement</title>
            <p>Not applicable.</p>
        </sec>
        <sec id="sec21">
            <title>Informed consent statement</title>
            <p>Not applicable.</p>
        </sec>
        <sec id="sec22">
            <title>Author contributions</title>
            <p>Conceptualization, M.A., G.M., G.D.P., M.C. and A.D.; methodology, formal analysis and writing&#x2014;original draft preparation, M.A., G.M., G.D.P., M.C. and A.D.; writing&#x2014;review and editing, M.A., G.M., G.D.P., M.C. and A.D. All authors have read and agreed to the published version of the manuscript.</p>
        </sec>
        <sec id="sec23">
            <title>Disclaimer/publisher&#x2019;s note</title>
            <p>The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.</p>
        </sec>
    </body>
    <back>
        <sec id="sec26" sec-type="data-availability">
            <title>Data availability statement</title>
            <p>The data presented in this study are openly available on the UK ONS web page entitled &#x201c;Deaths by vaccination status, England&#x201d;, available online: 
                <ext-link ext-link-type="uri" xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/datasets/deathsbyvaccinationstatusengland">https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/datasets/deathsbyvaccinationstatusengland</ext-link> (accessed on 1 May 2024).</p>
            <sec id="sec27">
                <title>Extended data</title>
                <p>Zenodo: 
                    <bold>Supplementary Materials</bold>, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.13080361">https://doi.org/10.5281/zenodo.13080361</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref38">39</xref>
                    </sup>
                </p>
                <p>This project contains the following extended data:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <ext-link ext-link-type="uri" xlink:href="https://zenodo.org/records/12938319/files/Supplementary%20Tables%201-7%20(population).xlsx?download=1">Supplementary Tables 1-7 (population).xlsx</ext-link>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <ext-link ext-link-type="uri" xlink:href="https://zenodo.org/records/12938319/files/Supplementary%20Tables%2015-21%20(mortality%20non-Covid%20deaths).xlsx?download=1">Supplementary Tables 15-21 (mortality non-Covid deaths).xlsx</ext-link>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <ext-link ext-link-type="uri" xlink:href="https://zenodo.org/records/12938319/files/Supplementary%20Tables%208-14%20(mortality%20all%20causes).xlsx?download=1">Supplementary Tables 8-14 (mortality all causes).xlsx</ext-link>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <ext-link ext-link-type="uri" xlink:href="https://zenodo.org/records/12938319/files/Supplemetary%20figure.pptx?download=1">Supplemetary figure.pptx</ext-link>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>
Table 2</p>
                        </list-item>
                    </list>
                </p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            </sec>
        </sec>
        <ack>
            <title>Acknowledgement</title>
            <p>Dr. Chiara Giove, for administrative support</p>
        </ack>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hussain</surname>
                            <given-names>Z</given-names>
                        </name>
</person-group>:
                    <article-title>England and Wales have seen rise in excess deaths in 2022.</article-title>
                    <source>

                        <italic toggle="yes">BMJ.</italic>
</source>
                    <year>2022</year>;<volume>378</volume>:<fpage>o2283</fpage>.
                    <pub-id pub-id-type="doi">10.1136/bmj.o2283</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="other">
                    <article-title>Deaths registered weekly in England and Wales, provisional: week ending 26 May 2023.</article-title>(accessed on May 1, 2024).
                    <ext-link ext-link-type="uri" xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/bulletins/deathsregisteredweeklyinenglandandwalesprovisional/weekending26may2023">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sch&#x00f6;ley</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Aburto</surname>
                            <given-names>JM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kashnitsky</surname>
                            <given-names>I</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Life expectancy changes since COVID-19.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Hum. Behav.</italic>
</source>
                    <year>2022</year>;<volume>6</volume>:<fpage>1649</fpage>&#x2013;<lpage>1659</lpage>.
                    <pub-id pub-id-type="pmid">36253520</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41562-022-01450-3</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9755047</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref39">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mostert</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hoogland</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Huibers</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Excess mortality across countries in the Western World since the COVID-19 pandemic: &#x2018;Our World in Data&#x2019; estimates of January 2020 to December 2022.</article-title>
                    <source>

                        <italic toggle="yes">BMJ Public Health.</italic>
</source>
                    <year>2024</year>;<volume>2</volume>: e000282.
                    <pub-id pub-id-type="doi">10.1136/bmjph-2023-000282</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <label>5</label>
                <mixed-citation publication-type="other">
                    <article-title>Deaths by vaccination status, England.</article-title>(accessed on May 1, 2024).
                    <ext-link ext-link-type="uri" xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/bulletins/deathsinvolvingcovid19byvaccinationstatusengland/deathsoccurringbetween1april2021and31may2023">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <label>6</label>
                <mixed-citation publication-type="other">
                    <article-title>Our world in data - Share of people vaccinated against COVID-19, Apr 25, 2021.</article-title>(accessed on May 1, 2024).
                    <ext-link ext-link-type="uri" xlink:href="https://ourworldindata.org/covid-vaccinations?country=GBR">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Donzelli</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Malatesta</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Di Palmo</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>All-Cause Mortality According to COVID-19 Vaccination Status: an analysis of the UK Office for National Statistics Public Data.</article-title>
                    <source>

                        <italic toggle="yes">Preprints.</italic>
</source>
                    <year>2023</year>;<fpage>2023020414</fpage>.
                    <pub-id pub-id-type="doi">10.20944/preprints202302.0414.v1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <label>8</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Soliani</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Statistica Applicata.</italic>
</source>
                    <publisher-loc>Parma (PR), Italy</publisher-loc>:
                    <publisher-name>Uni. Nova</publisher-name>;<year>2008</year>.</mixed-citation>
            </ref>
            <ref id="ref8">
                <label>9</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Norman</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Streiner</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Biostatistica.</italic>
</source>
                    <edition>2nd ed.</edition>
                    <publisher-loc>Rozzano (MI)</publisher-loc>:
                    <publisher-name>Casa Editrice Ambrosiana</publisher-name>;<year>2015</year>.</mixed-citation>
            </ref>
            <ref id="ref9">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Altman</surname>
                            <given-names>DG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bland</surname>
                            <given-names>JM</given-names>
                        </name>
</person-group>:
                    <article-title>How to obtain the P value from confidence interval from a.</article-title>
                    <source>

                        <italic toggle="yes">BMJ.</italic>
</source>
                    <year>2011</year>;<volume>343</volume>:<fpage>d2304</fpage>.
                    <pub-id pub-id-type="doi">10.1136/bmj.d2304</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Naing</surname>
                            <given-names>NN</given-names>
                        </name>
</person-group>:
                    <article-title>Easy way to learn standardization: direct and indirect methods. Malays.</article-title>
                    <source>

                        <italic toggle="yes">J. Med. Sci.</italic>
</source>
                    <year>2000 Jan</year>;<volume>7</volume>(<issue>1</issue>):<fpage>10</fpage>&#x2013;<lpage>15</lpage>.
                    <pub-id pub-id-type="pmid">22844209</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3406211</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Acuti Martellucci</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Flacco</surname>
                            <given-names>ME</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Soldato</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Effectiveness of COVID-19 Vaccines in the General Population of an Italian Region before and during the Omicron Wave.</article-title>
                    <source>

                        <italic toggle="yes">Vaccines.</italic>
</source>
                    <year>2022</year>;<volume>10</volume>:<fpage>662</fpage>.
                    <pub-id pub-id-type="pmid">35632418</pub-id>
                    <pub-id pub-id-type="doi">10.3390/vaccines10050662</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9146679</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rosso</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Flacco</surname>
                            <given-names>ME</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Soldato</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>COVID-19 Vaccination Effectiveness in the General Population of an Italian Province: Two Years of Follo Up.</article-title>
                    <source>

                        <italic toggle="yes">Vaccines.</italic>
</source>
                    <year>2023</year>;<volume>11</volume>:<fpage>1325</fpage>.
                    <pub-id pub-id-type="pmid">37631893</pub-id>
                    <pub-id pub-id-type="doi">10.3390/vaccines11081325</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10459219</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Berrino</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Donzelli</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bellavite</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>COVID-19 vaccination and all-cause and non-COVID-19 mortality. A revaluation of a study carried out in an Italian Province.</article-title>
                    <source>

                        <italic toggle="yes">Epidemiol. Prev.</italic>
</source>
                    <year>2023 Nov-Dec</year>;<volume>47</volume>(<issue>6</issue>):<fpage>374</fpage>&#x2013;<lpage>378</lpage>. English.
                    <pub-id pub-id-type="pmid">38314545</pub-id>
                    <pub-id pub-id-type="doi">10.19191/EP23.6.A643.075</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alessandria</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Malatesta</surname>
                            <given-names>GM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Berrino</surname>
                            <given-names>F</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A Critical Analysis of All-Cause Deaths during COVID-19 Vaccination in an Italian Province.</article-title>
                    <source>

                        <italic toggle="yes">Microorganisms.</italic>
</source>
                    <year>2024</year>;<volume>12</volume>:<fpage>1343</fpage>.
                    <pub-id pub-id-type="pmid">39065111</pub-id>
                    <pub-id pub-id-type="doi">10.3390/microorganisms12071343</pub-id>
                    <pub-id pub-id-type="pmcid">PMC11278956</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pinsky</surname>
                            <given-names>PF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Miller</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kramer</surname>
                            <given-names>BS</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Evidence of a healthy volunteer effect in the prostate, lung, colorectal, and ovarian cancer screening trial.</article-title>
                    <source>

                        <italic toggle="yes">Am. J. Epidemiol.</italic>
</source>
                    <year>2007</year>;<volume>165</volume>:<fpage>874</fpage>&#x2013;<lpage>881</lpage>.
                    <pub-id pub-id-type="pmid">17244633</pub-id>
                    <pub-id pub-id-type="doi">10.1093/aje/kwk075</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dormuth</surname>
                            <given-names>CR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Patrick</surname>
                            <given-names>AR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shrank</surname>
                            <given-names>WH</given-names>
                        </name>
</person-group>:
                    <article-title>Statin adherence and risk of accidents: a cautionary tale.</article-title>
                    <source>

                        <italic toggle="yes">Circulation.</italic>
</source>
                    <year>2009</year>;<volume>119</volume>:<fpage>2051</fpage>&#x2013;<lpage>2057</lpage>.
                    <pub-id pub-id-type="pmid">19349320</pub-id>
                    <pub-id pub-id-type="doi">10.1161/CIRCULATIONAHA.108.824151</pub-id>
                    <pub-id pub-id-type="pmcid">PMC2744446</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Vestbo</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Anderson</surname>
                            <given-names>JA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Calverley</surname>
                            <given-names>PM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Adherence to inhaled therapy, mortality and hospital admission in COPD.</article-title>
                    <source>

                        <italic toggle="yes">Thorax.</italic>
</source>
                    <year>2009</year>;<volume>64</volume>:<fpage>939</fpage>&#x2013;<lpage>943</lpage>.
                    <pub-id pub-id-type="doi">10.1136/thx.2009.113662</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ladova</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vlcek</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vytrisalova</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Healthy adherer effect - the pitfall in the interpretation of the effect of medication adherence on health outcomes.</article-title>
                    <source>

                        <italic toggle="yes">J. Eval. Clin. Pract.</italic>
</source>
                    <year>2014</year>;<volume>20</volume>:<fpage>111</fpage>&#x2013;<lpage>116</lpage>.
                    <pub-id pub-id-type="pmid">24188465</pub-id>
                    <pub-id pub-id-type="doi">10.1111/jep.12095</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <collab>Coronary Drug Project Research Group</collab>:
                    <article-title>Influence of adherence to treatment and response of cholesterol on mortality in the Coronary Drug Project.</article-title>
                    <source>

                        <italic toggle="yes">N. Engl. J. Med.</italic>
</source>
                    <year>1980</year>;<volume>303</volume>:<fpage>1038</fpage>&#x2013;<lpage>1041</lpage>.
                    <pub-id pub-id-type="pmid">6999345</pub-id>
                    <pub-id pub-id-type="doi">10.1056/NEJM198010303031804</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Simpson</surname>
                            <given-names>SH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Eurich</surname>
                            <given-names>DT</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Majumdar</surname>
                            <given-names>SR</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A meta-analysis of the association between adherence to drug therapy and mortality.</article-title>
                    <source>

                        <italic toggle="yes">BMJ.</italic>
</source>
                    <year>2006</year>;<volume>333</volume>:<fpage>15</fpage>.
                    <pub-id pub-id-type="pmid">16790458</pub-id>
                    <pub-id pub-id-type="doi">10.1136/bmj.38875.675486.55</pub-id>
                    <pub-id pub-id-type="pmcid">PMC1488752</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jackson</surname>
                            <given-names>LA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jackson</surname>
                            <given-names>ML</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nelson</surname>
                            <given-names>JC</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Evidence of bias in estimates of influenza vaccine effectiveness in seniors.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Epidemiol.</italic>
</source>
                    <year>2006</year>;<volume>35</volume>:<fpage>337</fpage>&#x2013;<lpage>344</lpage>.
                    <pub-id pub-id-type="pmid">16368725</pub-id>
                    <pub-id pub-id-type="doi">10.1093/ije/dyi274</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Horwitz</surname>
                            <given-names>RI</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Viscoli</surname>
                            <given-names>CM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Berkman</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Treatment adherence and risk of death after a myocardial infarction.</article-title>
                    <source>

                        <italic toggle="yes">Lancet.</italic>
</source>
                    <year>1990</year>;<volume>336</volume>:<fpage>542</fpage>&#x2013;<lpage>545</lpage>.
                    <pub-id pub-id-type="doi">10.1016/0140-6736(90)92095-Y</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Furst</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Straka</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Janosek</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>Healthy vaccinee effect: a bias not to be forgotten in observational studies on COVID-19 vaccine effectiveness.</article-title>
                    <source>

                        <italic toggle="yes">Pol. Arch. Intern. Med.</italic>
</source>
                    <year>2024 Feb 28</year>;<volume>134</volume>(<issue>2</issue>):<fpage>16634</fpage>.
                    <pub-id pub-id-type="doi">10.20452/pamw.16634</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <label>25</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>F&#x00fc;rst</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bazalov&#x00e1;</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fry&#x010d;&#x00e1;k</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Does the healthy vaccinee bias rule them all? Association of COVID-19 vaccination status and all-cause mortality from an analysis of data from 2.2 million individual health records.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Infect. Dis.</italic>
</source>
                    <year>2024 May</year>;<volume>142</volume>:<fpage>106976</fpage>.
                    <pub-id pub-id-type="pmid">38401782</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.ijid.2024.02.019</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref25">
                <label>26</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>McCarthy</surname>
                            <given-names>NL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Weintraub</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vellozzi</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mortality rates and cause-of-death patterns in a vaccinated population.</article-title>
                    <source>

                        <italic toggle="yes">Am. J. Prev. Med.</italic>
</source>
                    <year>2013 Jul</year>;<volume>45</volume>(<issue>1</issue>):<fpage>91</fpage>&#x2013;<lpage>97</lpage>.
                    <pub-id pub-id-type="pmid">23790993</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.amepre.2013.02.020</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <label>27</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Redelmeier</surname>
                            <given-names>DA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Thiruchelvam</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <article-title>COVID Vaccine Hesitancy and Risk of a Traffic Crash.</article-title>
                    <source>

                        <italic toggle="yes">Am. J. Med.</italic>
</source>
                    <year>2023</year>;<volume>136</volume>:<fpage>153</fpage>&#x2013;<lpage>162.e5</lpage>.
                    <pub-id pub-id-type="pmid">36470796</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.amjmed.2022.11.002</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9716428</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <label>28</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Remschmidt</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wichmann</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Harder</surname>
                            <given-names>T</given-names>
                        </name>
</person-group>:
                    <article-title>Frequency and impact of confounding by indication and healthy vaccinee bias in observational studies assessing influenza vaccine effectiveness: A systematic review.</article-title>
                    <source>

                        <italic toggle="yes">BMC Infect. Dis.</italic>
</source>
                    <year>2015</year>;<volume>15</volume>:<fpage>429</fpage>.
                    <pub-id pub-id-type="pmid">26474974</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12879-015-1154-y</pub-id>
                    <pub-id pub-id-type="pmcid">PMC4609091</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <label>29</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eythorsson</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Runolfsdottir</surname>
                            <given-names>HL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ingvarsson</surname>
                            <given-names>RF</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Rate of SARS-CoV-2 Reinfection During an Omicron Wave in Iceland.</article-title>
                    <source>

                        <italic toggle="yes">JAMA Netw. Open.</italic>
</source>
                    <year>2022</year>;<volume>5</volume>(<issue>8</issue>):<fpage>e2225320</fpage>.
                    <pub-id pub-id-type="pmid">35921113</pub-id>
                    <pub-id pub-id-type="doi">10.1001/jamanetworkopen.2022.25320</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9350711</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref29">
                <label>30</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tseng</surname>
                            <given-names>HF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ackerson</surname>
                            <given-names>BK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bruxvoort</surname>
                            <given-names>KJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Effectiveness of mRNA-1273 vaccination against SARS-CoV-2 omicron subvariants BA.1, BA.2, BA.2.12.1, BA.4, and BA.5.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Commun.</italic>
</source>
                    <year>2023</year>;<volume>14</volume>:<fpage>189</fpage>.
                    <pub-id pub-id-type="pmid">36635284</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41467-023-35815-7</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9836332</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref30">
                <label>31</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chemaitelly</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ayoub</surname>
                            <given-names>HH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tang</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Long-term COVID-19 booster effectiveness by infection history and clinical vulnerability and immune imprinting: a retrospective population-based cohort study.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Infect. Dis.</italic>
</source>
                    <year>2023 Jul</year>;<volume>23</volume>(<issue>7</issue>):<fpage>816</fpage>&#x2013;<lpage>827</lpage>.
                    <pub-id pub-id-type="pmid">36913963</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S1473-3099(23)00058-0</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10079373</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref31">
                <label>32</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tamandjou</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Auvigne</surname>
                            <given-names>V</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Schaeffer</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Effectiveness of second booster compared to first booster and protection conferred by previous SARS-CoV-2 infection against symptomatic Omicron BA.2 and BA.4/5 in France.</article-title>
                    <source>

                        <italic toggle="yes">Vaccine.</italic>
</source>
                    <year>2023 Apr 24</year>;<volume>41</volume>(<issue>17</issue>):<fpage>2754</fpage>&#x2013;<lpage>2760</lpage>.
                    <pub-id pub-id-type="pmid">36964001</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.vaccine.2023.03.031</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10027956</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref32">
                <label>33</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shrestha</surname>
                            <given-names>NK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Burke</surname>
                            <given-names>PC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nowacki</surname>
                            <given-names>AS</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Effectiveness of the Coronavirus Disease 2019 Bivalent Vaccine.</article-title>
                    <source>

                        <italic toggle="yes">Open Forum Infect. Dis.</italic>
</source>
                    <year>2023 Apr 19</year>;<volume>10</volume>(<issue>6</issue>):<fpage>ofad209</fpage>.
                    <pub-id pub-id-type="pmid">37274183</pub-id>
                    <pub-id pub-id-type="doi">10.1093/ofid/ofad209</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10234376</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref33">
                <label>34</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Qassim</surname>
                            <given-names>SH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chemaitelly</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ayoub</surname>
                            <given-names>HH</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Population immunity of natural infection, primary-series vaccination, and booster vaccination in Qatar during the COVID-19 pandemic: an observational study.</article-title>
                    <source>

                        <italic toggle="yes">EClinicalMedicine.</italic>
</source>
                    <year>2023 Jul 20</year>;<volume>62</volume>:<fpage>102102</fpage>.
                    <pub-id pub-id-type="pmid">37533414</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.eclinm.2023.102102</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10393554</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref34">
                <label>35</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chalupka</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Richter</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chakeri</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Effectiveness of a fourth SARS-CoV-2 vaccine dose in previously infected individuals from Austria.</article-title>
                    <source>

                        <italic toggle="yes">Eur. J. Clin. Investig.</italic>
</source>
                    <year>2024 Mar</year>;<volume>54</volume>(<issue>3</issue>):<fpage>e14136</fpage>.
                    <pub-id pub-id-type="pmid">38032853</pub-id>
                    <pub-id pub-id-type="doi">10.1111/eci.14136</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref35">
                <label>36</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shrestha</surname>
                            <given-names>NK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Burke</surname>
                            <given-names>PC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nowacki</surname>
                            <given-names>AS</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Risk of Coronavirus Disease 2019 (COVID-19) among those up-to-date and not up-to-date on COVID-19 vaccination by US CDC criteria.</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2023 Nov 8</year>;<volume>18</volume>(<issue>11</issue>):<fpage>e0293449</fpage>.
                    <pub-id pub-id-type="pmid">37939032</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0293449</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10631626</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref36">
                <label>37</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Xu</surname>
                            <given-names>Q</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zhao</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An immune evasion mechanism with IgG4 playing an essential role in cancer and implication for immunotherapy.</article-title>
                    <source>

                        <italic toggle="yes">J. Immunother. Cancer.</italic>
</source>
                    <year>2020 Aug</year>;<volume>8</volume>(<issue>2</issue>):<fpage>e000661</fpage>.
                    <pub-id pub-id-type="pmid">32819973</pub-id>
                    <pub-id pub-id-type="doi">10.1136/jitc-2020-000661</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7443307</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref37">
                <label>38</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Uversky</surname>
                            <given-names>VN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Redwan</surname>
                            <given-names>EM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Makis</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>IgG4 Antibodies Induced by Repeated Vaccination May Generate Immune Tolerance to the SARS-CoV-2 Spike Protein.</article-title>
                    <source>

                        <italic toggle="yes">Vaccines (Basel).</italic>
</source>
                    <year>2023 May 17</year>;<volume>11</volume>(<issue>5</issue>):<fpage>991</fpage>.
                    <pub-id pub-id-type="pmid">37243095</pub-id>
                    <pub-id pub-id-type="doi">10.3390/vaccines11050991</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10222767</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref38">
                <label>39</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alessandria</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Supplementary material.</article-title>
                    <source>

                        <italic toggle="yes">Zenodo.</italic>
</source>
                    <year>2024</year>.
                    <pub-id pub-id-type="doi">10.5281/zenodo.13080361</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report367845">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.177063.r367845</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Aarstad</surname>
                        <given-names>Jarle</given-names>
                    </name>
                    <xref ref-type="aff" rid="r367845a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-6650-6667</uri>
                </contrib>
                <aff id="r367845a1">
                    <label>1</label>HVL Business School, Western Norway University of Applied Science, Bergen, Norway</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>27</day>
                <month>2</month>
                <year>2025</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Aarstad J</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport367845" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.154058.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Dear authors,</p>
            <p> </p>
            <p> I now understand better the issue of standardized mortality ratio (SMR) among vaccinated against the corresponding unvaccinated groups and find the paper acceptable for indexing.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Applied statistical analysis.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report342218">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.169038.r342218</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Pilz</surname>
                        <given-names>Stefan</given-names>
                    </name>
                    <xref ref-type="aff" rid="r342218a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r342218a1">
                    <label>1</label>Medical University of Graz, Graz, Austria</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>7</day>
                <month>1</month>
                <year>2025</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Pilz S</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport342218" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.154058.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This is an important retrospective study on the mortality rate according to vaccination status against SARS-CoV-2 in the UK. Based on publicly available national health data the authors show that mortality risk is, in general (for most time periods and age groups analyzed), higher in vaccinated versus unvaccinated individuals. SMRs in vaccinated individuals are lower than one in early periods of their observation period, but progressively increase over time and exceed one in several age groups suggesting that relative mortality risk progressively increases over time after vaccination. The discussion of these findings is well-written and includes several interesting views on potential biases in their findings. Overall, this is an interesting and important paper.</p>
            <p> I have only minor comments.</p>
            <p> The authors should aim to carefully explain very clearly the underlying analyses of their Tables and Figures so that they can also stand alone: e.g. in Table 1 it may not be clear for the reader that this is a regression analysis of SMRs and observation months (this has only been described in the text).</p>
            <p> The discussion is great, but a brief overall limitations section may improve the quality of the paper (e.g., retrospective study design, only age group data but no individual participant data, etc.). Several limitations have been nicely discussed but I would nevertheless suggest such a brief limitations section.</p>
            <p> The authors may check whether this article meets all the requirements of the STROBE guidelines. I do not request a STROBE guideline Table as a Supplement although this may be considered.</p>
            <p> The authors should carefully re-check the spelling and grammar of this article as there are some slight improvements required. E.g., Page 10, second paragraph, second line from the bottom &#x201c;the risk of death&#x201d; should be corrected to &#x201c;the risk difference of death&#x2026;&#x201d;. In addition, some parts of the article may be difficult to read and understand for the reader. Consider improving this.</p>
            <p> In the Abstract the authors write that &#x201c;the best way can be the analysis of all-cause mortality by vaccination&#x201d;. I would rather be cautious to state &#x201c;the best way&#x201d; and re-phrase this to something like&#x201d; Assessment of its real-world effect can be performed by analysis of all-cause mortality by vaccination status&#x201d;.</p>
            <p> In the results section of the Abstract the last sentence is rather a discussion of the data than a results presentation. Consider revising and/or removing some parts to the discussion of the Abstract.</p>
            <p> Regarding data analyses and discussion it would be great (if possible depending on statistical power) to focus also on groups with vaccinations less than 21 days before, as for these groups hardly any (or only minimal) vaccine effectiveness on COVID-19 mortality can be assumed so that any mortality difference may well reflect some sort of bias. No problem if the authors are not willing to address this.</p>
            <p> Regarding the overall conclusions I would suggest being more cautious regarding strong statements (such as a moratorium on promoting mass vaccination campaigns should be implemented) as the findings are only observational and require further confirmation and more in-depth investigations at best with inclusion of more potential confounders and IPD.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Epidemiology and clinical research in endocrinology</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment13144-342218">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Donzelli</surname>
                            <given-names>Alberto</given-names>
                        </name>
                        <aff>Fondazione "Allineare Sanit&#x00e0; e Salute", Italy</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>None</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>14</day>
                    <month>1</month>
                    <year>2025</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Dr. Stefan Pilz,</p>
                <p> we would like to thank you for your suggestions. Although you have kindly indicated that the acceptance of your suggestions is at our discretion, we have decided willingly to include them in the text, because we believe they are useful for improving the article</p>
                <p> </p>
                <p> This is an important retrospective study on the mortality rate according to vaccination status against SARS-CoV-2 in the UK. Based on publicly available national health data the authors show that mortality risk is, in general (for most time periods and age groups analyzed), higher in vaccinated versus unvaccinated individuals. SMRs in vaccinated individuals are lower than one in early periods of their observation period, but progressively increase over time and exceed one in several age groups suggesting that relative mortality risk progressively increases over time after vaccination. The discussion of these findings is well-written and includes several interesting views on potential biases in their findings. Overall, this is an interesting and important paper.</p>
                <p> I have only minor comments.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>.</bold> The authors should aim to carefully explain very clearly the underlying analyses of their Tables and Figures so that they can also stand alone: e.g. in Table 1 it may not be clear for the reader that this is a regression analysis of SMRs and observation months (this has only been described in the text).</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Thank you for this advice. We have added a sentence that specifics this aspect.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>. </bold>The discussion is great, but a brief overall limitations section may improve the quality of the paper (e.g., retrospective study design, only age group data but no individual participant data, etc.). Several limitations have been nicely discussed but I would nevertheless suggest such a brief limitations section.</p>
                <p> 
                    <bold>Author&#x2019;s response:</bold>&#x00a0;Thank you for this advice. We have added the &#x201c;Limitation&#x201d; section.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>. </bold>The authors may check whether this article meets all the requirements of the STROBE guidelines. I do not request a STROBE guideline Table as a Supplement although this may be considered.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Before submitting our paper, we checked the STROBE guidelines, but the most part of the items of the "STROBE Statements" are not applicable in our paper as we show a critical analysis of the data collected and provided by the ONS and the data analyzed was not collected by us. In the "Methods" section we described in detail what and how we used the information contained in the ONS dataset, but we cannot know how the ONS collected this data.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>
                    </bold>
                    <bold>. </bold>The authors should carefully re-check the spelling and grammar of this article as there are some slight improvements required. E.g., Page 10, second paragraph, second line from the bottom &#x201c;the risk of death&#x201d; should be corrected to &#x201c;the risk difference of death&#x2026;&#x201d;. In addition, some parts of the article may be difficult to read and understand for the reader. Consider improving this.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s respons</underline>e</bold>: We inserted your suggestion.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>. </bold>In the Abstract the authors write that &#x201c;the best way can be the analysis of all-cause mortality by vaccination&#x201d;. I would rather be cautious to state &#x201c;the best way&#x201d; and re-phrase this to something like&#x201d; Assessment of its real-world effect can be performed by analysis of all-cause mortality by vaccination status&#x201d;.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: You are right, we have reworded the sentence according to your suggestion</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>. </bold>In the results section of the Abstract the last sentence is rather a discussion of the data than a results presentation. Consider revising and/or removing some parts to the discussion of the Abstract.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Thank you, we decided to revise and move this sentence in &#x201c;Conclusion&#x201d; section of the abstract.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>. </bold>Regarding data analyses and discussion it would be great (if possible depending on statistical power) to focus also on groups with vaccinations less than 21 days before, as for these groups hardly any (or only minimal) vaccine effectiveness on COVID-19 mortality can be assumed so that any mortality difference may well reflect some sort of bias.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: In the data analysis phase we also considered groups with vaccinations less than 21 days before, but it was not possible to perform any calculations as most of the boxes indicated &lt;3 deaths.</p>
                <p> No problem if the authors are not willing to address this.</p>
                <p> 
                    <bold>
                        <underline>Q</underline>. </bold>Regarding the overall conclusions I would suggest being more cautious regarding strong statements (such as a moratorium on promoting mass vaccination campaigns should be implemented) as the findings are only observational and require further confirmation and more in-depth investigations at best with inclusion of more potential confounders and IPD.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Thank you, we did it</p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report311454">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.169038.r311454</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Aarstad</surname>
                        <given-names>Jarle</given-names>
                    </name>
                    <xref ref-type="aff" rid="r311454a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-6650-6667</uri>
                </contrib>
                <aff id="r311454a1">
                    <label>1</label>HVL Business School, Western Norway University of Applied Science, Bergen, Norway</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>19</day>
                <month>8</month>
                <year>2024</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2024 Aarstad J</copyright-statement>
                <copyright-year>2024</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport311454" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.154058.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Dear Editor and authors,</p>
            <p> </p>
            <p> Thank you for giving me the opportunity to referee the manuscript entitled &#x201c;All-cause mortality according to COVID-19 vaccination status: An analysis of the UK office for National statistics public data&#x201d;.</p>
            <p> I find the article very interesting and illuminating, particularly comparing all-cause mortality with non-covid mortality, and along with a very good discussion, it increases the study&#x2019;s validity and adds value to the study of covid-vaccines&#x2019; potential mortality effect.</p>
            <p> Concerning the Introduction, the authors relevantly address the research question and study objective. I believe, however, that the study by Mostert et al. (2024)(Ref-1) merits attention concerning excess mortality in Western countries.</p>
            <p> I assume the calculations are correct regarding the statistical analyses of the RRs CIs, but I recommend one or two references on which you base the calculations. Also, I did not understand what you mean by &#x201c;standardized rate&#x201d;. Altogether, I would like you to explain that part better, particularly for an audience unfamiliar with the approach, eventually in an appendix.</p>
            <p> I follow the logic in section 3.4, but I suspect you compare never vaccinated with ever vaccinated. Is that correct? I assume yes, but it was a bit unclear for me. In the Figures, you include the number of months, but would it be better to include their names? E.g., Apr. 2021, etc. In Figures 2, 3, 4, 5, and partly 6, the intersections are out of the sample, which you should state in the text.</p>
            <p> Very good and illuminating discussion. As you apply English/Welsh data, you may refer to the following web page by the Office for National Statistics, showing that unvaccinated tended to live in more deprived areas, urban areas, or social rented housing, were not born in the UK or did not have English as a main language, have never worked or are long-term unemployed, limited a lot by a disability, and are male (among you more men die than women). 
                <ext-link ext-link-type="uri" xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/vaccines">https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/vaccines</ext-link>
            </p>
            <p> Addressing the above mentioned issues adequately, I argue the study will meet the indexing standards.</p>
            <p> I wish you all the best when reviewing the manuscript.</p>
            <p> </p>
            <p> Sincerely,</p>
            <p> Referee 1.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Applied statistical analysis.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-311454-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Excess mortality across countries in the Western World since the COVID-19 pandemic: &#x2018;Our World in Data&#x2019; estimates of January 2020 to December 2022</article-title>.
                        <source>
                            <italic>BMJ Public Health</italic>
                        </source>.<year>2024</year>;<volume>2</volume>(<issue>1</issue>) :
                        <elocation-id>10.1136/bmjph-2023-000282</elocation-id>
                        <pub-id pub-id-type="doi">10.1136/bmjph-2023-000282</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
        <sub-article article-type="response" id="comment12326-311454">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Donzelli</surname>
                            <given-names>Alberto</given-names>
                        </name>
                        <aff>Fondazione "Allineare Sanit&#x00e0; e Salute", Italy</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>None</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>29</day>
                    <month>8</month>
                    <year>2024</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Authors&#x2019; responses</p>
                <p> Dear Dr. Jarle Aarstad,</p>
                <p> We want to thank you for your advice which contribute to improve our paper. Below the answers to your questions.</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>Dear Editor and authors,</p>
                <p> Thank you for giving me the opportunity to referee the manuscript entitled &#x201c;All-cause mortality according to COVID-19 vaccination status: An analysis of the UK office for National statistics public data&#x201d;.</p>
                <p> I find the article very interesting and illuminating, particularly comparing all-cause mortality with non-covid mortality, and along with a very good discussion, it increases the study&#x2019;s validity and adds value to the study of covid-vaccines&#x2019; potential mortality effect.</p>
                <p> Concerning the Introduction, the authors relevantly address the research question and study objective. I believe, however, that the study by Mostert et al. (2024)(Ref-1) merits attention concerning excess mortality in Western countries.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Thank you for your valuable feedback. We have added the reference in the "Introduction" section.</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>I assume the calculations are correct regarding the statistical analyses of the RRs CIs, but I recommend one or two references on which you base the calculations. 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Sorry, but we think do not understand, the reference regarding the statistical analyses of the RRs Cis are indicated just before the colons in the sentence above the formula and they are mentioned as 7 and 8 references.&#x00a0;</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>Also, I did not understand what you mean by &#x201c;standardized rate&#x201d;. 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Sorry, you are right. For &#x201c;standardized rate&#x201d; we mean the Age-standardized mortality rates per 100,000 person-years, standardized to the 2013 European Standard Population using five-year age groups from those aged 10 years and over as defined in "Note 1" of the spreadsheet called "Notes" of the ONS dataset. We changed the sentence.</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>Altogether, I would like you to explain that part better, particularly for an audience unfamiliar with the approach, eventually in an appendix.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Sorry but we are not sure we understand, could you possibly be more specific? We inserted all the steps of the calculations performed by us, and we are not sure what other steps we could describe in a further appendix. However, we also interpreted your perplexity as due to the fact that we have inserted a bibliographic reference in Italian, less useful to international researchers. We have therefore replaced the current entry n. 9 with the same reference text in English.</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>I follow the logic in section 3.4, but I suspect you compare never vaccinated with ever vaccinated. Is that correct? I assume yes, but it was a bit unclear for me. 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Exactly, you are correct, we used the same terminology used in in the Table 2 of the ONS dataset.</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>In the Figures, you include the number of months, but would it be better to include their names? E.g., Apr. 2021, etc.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Thank you, we replaced the numbers with the names.</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>In Figures 2, 3, 4, 5, and partly 6, the intersections are out of the sample, which you should state in the text.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Sorry, you are right. We added a sentence that specifics this aspect.</p>
                <p> </p>
                <p> 
                    <bold>Reviewer response: </bold>Very good and illuminating discussion. As you apply English/Welsh data, you may refer to the following web page by the Office for National Statistics, showing that unvaccinated tended to live in more deprived areas, urban areas, or social rented housing, were not born in the UK or did not have English as a main language, have never worked or are long-term unemployed, limited a lot by a disability, and are male (among you more men die than women).&#x00a0;
                    <ext-link ext-link-type="uri" xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/vaccines">https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/vaccines</ext-link>
                </p>
                <p> Addressing the above mentioned issues adequately, I argue the study will meet the indexing standards.&#x00a0;I wish you all the best when reviewing the manuscript.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Thank you for this advice. We have added a reflection on this aspect in the &#x201c;Discussion&#x201d; section.</p>
            </body>
        </sub-article>
        <sub-article article-type="response" id="comment13143-311454">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Donzelli</surname>
                            <given-names>Alberto</given-names>
                        </name>
                        <aff>Fondazione "Allineare Sanit&#x00e0; e Salute", Italy</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>None</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>14</day>
                    <month>1</month>
                    <year>2025</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Dr. Jarle Aarstad,</p>
                <p> We want to thank you for your advice which contribute to improve our paper. Below are the answers to your questions.</p>
                <p> Dear Editor and authors,</p>
                <p> </p>
                <p> 
                    <bold>Thank you for giving me the opportunity to referee the manuscript entitled &#x201c;All-cause mortality according to COVID-19 vaccination status: An analysis of the UK office for National statistics public data&#x201d;.</bold>
                </p>
                <p>
                    <bold> I find the article very interesting and illuminating, particularly comparing all-cause mortality with non-covid mortality, and along with a very good discussion, it increases the study&#x2019;s validity and adds value to the study of covid-vaccines&#x2019; potential mortality effect.</bold>
                </p>
                <p> 
                    <bold>
                        <underline>Q</underline>.</bold> Concerning the Introduction, the authors relevantly address the research question and study objective. I believe, however, that the study by Mostert et al. (2024)(Ref-1) merits attention concerning excess mortality in Western countries.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: Thank you for your valuable feedback. We have added the reference in the "Introduction" section.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>.</bold> I assume the calculations are correct regarding the statistical analyses of the RRs CIs, but I recommend one or two references on which you base the calculations.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: sorry, but we think do not understand, the reference regarding the statistical analyses of the RRs CIs are indicated just before the colons in the sentence above the formula and they are mentioned as 8 and 9 references.&#x00a0;</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>
                    </bold>
                    <bold>.</bold> Also, I did not understand what you mean by &#x201c;standardized rate&#x201d;.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: sorry, you are right. For &#x201c;standardized rate&#x201d; we mean the Age-standardised mortality rates per 100,000 person-years, standardised to the 2013 European Standard Population using five-year age groups from those aged 10 years and over as defined in "Note 1" of the spreadsheet called "Notes" of the ONS dataset. We changed the sentence.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>
                    </bold>
                    <bold>.</bold> Altogether, I would like you to explain that part better, particularly for an audience unfamiliar with the approach, eventually in an appendix.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: sorry but we think do not understand, could you be more specific? We inserted all the steps of the calculations performed by us and we would not know which other steps we could describe in a further appendix.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>
                    </bold>
                    <bold>.</bold> I follow the logic in section 3.4, but I suspect you compare never vaccinated with ever vaccinated. Is that correct? I assume yes, but it was a bit unclear for me.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: exactly, you are correct, we used the same terminology used in the Table 2 of the ONS dataset.</p>
                <p> </p>
                <p> 
                    <bold>Q.</bold>In the Figures, you include the number of months, but would it be better to include their names? E.g., Apr. 2021, etc. 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: thank you, we replaced the numbers with the names.</p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Q</underline>
                    </bold>
                    <bold>.</bold> In Figures 2, 3, 4, 5, and partly 6, the intersections are out of the sample, which you should state in the text.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: sorry, you are right. We added a sentence that specifics this aspect.</p>
                <p> </p>
                <p> 
                    <bold>Q.&#x00a0;</bold>Very good and illuminating discussion. As you apply English/Welsh data, you may refer to the following web page by the Office for National Statistics, showing that unvaccinated tended to live in more deprived areas, urban areas, or social rented housing, were not born in the UK or did not have English as a main language, have never worked or are long-term unemployed, limited a lot by a disability, and are male (among you more men die than women).&#x00a0;
                    <ext-link ext-link-type="uri" xlink:href="https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/vaccines">https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/articles/coronaviruscovid19latestinsights/vaccines</ext-link>
                </p>
                <p> Addressing the above mentioned issues adequately, I argue the study will meet the indexing standards.</p>
                <p> 
                    <bold>
                        <underline>Author&#x2019;s response</underline>
                    </bold>: thank you for this advice. We have added a reflection on this aspect in the &#x201c;Discussion&#x201d; section.</p>
                <p> I wish you all the best when reviewing the manuscript.</p>
            </body>
        </sub-article>
    </sub-article>
</article>
