Home Browse Seroconversion rates among different designs of COVID-19 vaccines:...
ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
▬
✚
Systematic Review

Seroconversion rates among different designs of COVID-19 vaccines: a network meta-analysis of randomized controlled trials

[version 1; peer review: 1 approved with reservations]
Gatot Soegiarto
https://orcid.org/0000-0002-9197-3873
1, Jonny Karunia Fajar
https://orcid.org/0000-0002-0309-5813
2, Laksmi Wulandari3, [...] Muhammad Anshory4, Muhammad Ilmawan
https://orcid.org/0000-0002-9459-609X
5, Anisa Asmiragani
https://orcid.org/0000-0002-5707-6060
5, Himma Illiyana
https://orcid.org/0000-0003-1634-4249
6, Azaria Adam7, Sutini Lamadi5, Umi Sa'adah8, Tubagus Yuantoko6, Esi Nanda6, Farida Rachmawati8, Nabila Rahmadani5, Randy Talilah9, Madyline Katipana10, Sharon Susanto11, Maria Hindom12, Ufi Anjasari11, Nur Hidayah13, Nanda Fadilla
https://orcid.org/0000-0003-1355-9316
14, Vanela Lekatompessy8, Uzi Phoenna
https://orcid.org/0000-0002-2793-356X
15, Fredo Tamara
https://orcid.org/0000-0002-2534-9108
2, Dessy Aprilia Kartini
https://orcid.org/0000-0003-2098-1267
5, Aditya Indra Mahendra
https://orcid.org/0000-0003-0983-993X
2, Andi Permana
https://orcid.org/0000-0003-3902-8783
5, Erwin Alexander Pasaribu
https://orcid.org/0000-0003-4675-0117
5, Kuldeep Dhama
https://orcid.org/0000-0001-7469-4752
16, Harapan Harapan
https://orcid.org/0000-0001-7630-8413
17
Gatot Soegiarto
https://orcid.org/0000-0002-9197-3873
1, Jonny Karunia Fajar
https://orcid.org/0000-0002-0309-5813
2, [...] Laksmi Wulandari3, Muhammad Anshory4, Muhammad Ilmawan
https://orcid.org/0000-0002-9459-609X
5, Anisa Asmiragani
https://orcid.org/0000-0002-5707-6060
5, Himma Illiyana
https://orcid.org/0000-0003-1634-4249
6, Azaria Adam7, Sutini Lamadi5, Umi Sa'adah8, Tubagus Yuantoko6, Esi Nanda6, Farida Rachmawati8, Nabila Rahmadani5, Randy Talilah9, Madyline Katipana10, Sharon Susanto11, Maria Hindom12, Ufi Anjasari11, Nur Hidayah13, Nanda Fadilla
https://orcid.org/0000-0003-1355-9316
14, Vanela Lekatompessy8, Uzi Phoenna
https://orcid.org/0000-0002-2793-356X
15, Fredo Tamara
https://orcid.org/0000-0002-2534-9108
2, Dessy Aprilia Kartini
https://orcid.org/0000-0003-2098-1267
5, Aditya Indra Mahendra
https://orcid.org/0000-0003-0983-993X
2, Andi Permana
https://orcid.org/0000-0003-3902-8783
5, Erwin Alexander Pasaribu
https://orcid.org/0000-0003-4675-0117
5, Kuldeep Dhama
https://orcid.org/0000-0001-7469-4752
16, Harapan Harapan
https://orcid.org/0000-0001-7630-8413
17
PUBLISHED 10 Mar 2022
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Pathogens gateway.

Abstract

BACKGROUND: The COVID-19 vaccination program, which uses various types of vaccines, has been applied since the beginning of 2021. However, the efficacy in the context of seroconversion rate remains unclear.
OBJECTIVE: To assess the seroconversion rates among different COVID-19 vaccines using a network meta-analysis approach.
METHODS: A network meta-analysis of randomized controlled trials (RCTs) was conducted during the study period. Data of interest, such as seroconversion rate and the type of COVID-19 vaccine, were extracted from each study. The analysis was performed using single-arm analysis by calculating the cumulative seroconversion rate. A network meta-analysis was conducted using the Bayesian method.
RESULTS: A total of 31 RCTs were included in our analysis. Our pooled calculation revealed that the seroconversion rates of inactivated messenger ribonucleic acid (mRNA), protein subunit, and vector COVID-19 vaccines during the follow-up periods were 93.2%, 93.9%, 65.3%, and 54.7%, respectively, at ≤ 15 days; 96.0%, 94.8%, 91.2%, and 89.7%, respectively, between days 16–30; and 98.5%, 98.6%, 98.5%, and 96.2%, respectively, between days 31–60.The indirect comparison revealed that in the follow-up periods of ≤ 15 and 16–30 days, the inactivated and mRNA COVID-19 vaccines had superior seroconversion rates compared with those of the protein subunit and vector vaccines. In the follow-up period of 31–60 days, the highest seroconversion rates were found in the inactivated, mRNA, and protein subunit COVID-19 vaccines.
CONCLUSION: This study provides valuable information regarding the comparison of seroconversion rates of COVID-19 vaccines.

Keywords

COVID-19; vaccine; seroconversion; efficacy; immunization.

Corresponding authors: Gatot Soegiarto, Jonny Karunia Fajar
Competing interests: No competing interests were disclosed.
Grant information: The author(s) declared that no grants were involved in supporting this work.
Copyright:  © 2022 Soegiarto G et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
How to cite: Soegiarto G, Fajar JK, Wulandari L et al. Seroconversion rates among different designs of COVID-19 vaccines: a network meta-analysis of randomized controlled trials [version 1; peer review: 1 approved with reservations]. F1000Research 2022, 11:299 (https://doi.org/10.12688/f1000research.110281.1) First published: 10 Mar 2022, 11:299 (https://doi.org/10.12688/f1000research.110281.1) Latest published: 10 Mar 2022, 11:299 (https://doi.org/10.12688/f1000research.110281.1)

Introduction

COVID-19 remains a global challenge.1 While the incidence of COVID-19 was reported to have decreased in recent months, recent reports have suggested that there has been a rising trend in COVID-19 incidence.2 This fluctuating incidence might be affected by the variants of concern,3 in which COVID-19 management also remained challenging,4 and the management of new variants of concern might differ from that of previous variants.5 The guidelines for COVID-19 management have been periodically published and updated.6 However, the efficacy of each treatment was inconclusive, particularly in the case of severe or critical illness.7–9 Therefore, the proper treatment of COVID-19 remains under investigation. While the potential of new drugs has been explored,10 the vaccination program appears to have the potential to end this pandemic.11

The COVID-19 vaccination program was introduced in early 2021 and implemented worldwide.12 This vaccination program was initially targeted to health workers, a population with high risk of infection, and continued to the public.12,13 To date, a wide variety of COVID-19 vaccines have been available, such as inactivated, messenger ribonucleic acid (mRNA), protein subunit, and vector vaccines.14 However, efficacy differs between vaccines, and the results from each study have varied.15 In this circumstance, conflict between pharmaceutical companies might occur. Therefore, the question of which vaccine has the best efficacy remains. In the content of vaccination, seroconversion was used to assess the early response of neutralizing antibody production.16 However, the report of seroconversion of COVID-19 vaccines varied in each study, particularly in the special cases with comorbidity.17–19 Moreover, to date, no study has directly compared the efficacy of COVID-19 vaccines. Therefore, the present study aimed to assess the indirect comparison of seroconversion rates among different COVID-19 vaccines using a network meta-analysis approach. Our present study provides preliminary evidence regarding potential COVID-19 vaccines.

Methods

Study design

A meta-analysis, following the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) protocols,20 was conducted to compare the seroconversion rates of different COVID-19 vaccine designs. To formulate a comprehensive comparison, the relevant articles were collected from PubMed, Embase, and Scopus, and the information of interest was extracted to compare the seroconversion rates among different COVID-19 vaccine designs.

Eligibility criteria

Articles were included in our analysis if they met the following inclusion criteria: (1) assessed the seroconversion rate of a COVID-19 vaccine; and (2) provided standardized data to determine the seroconversion rate of a COVID-19 vaccine. The following articles were excluded: reviews, commentaries, letters to the editor, non-randomized controlled trials (RCTs), and double publications.

Search strategy and data extraction

As of January 10, 2022, we searched for potential articles in PubMed, Scopus, and Web of Science. We determined potential COVID-19 vaccine designs to be involved in our study prior to searching the primary outcomes (seroconversion rate). We used the keywords adapted from medical subject headings: “COVID-19 vaccine” or “inactivatedCOVID-19 vaccine” or “mRNACOVID-19 vaccine” or “protein subunit COVID-19 vaccine” or “vector COVID-19 vaccine” and “efficacy” or “seroconversion”. The search was limited to RCTs and articles published in English. If a double publication was found, only articles with a larger sample size were included. We also browsed the reference list of relevant systematic reviews to obtain additional references. Subsequently, the following information of interest from the potential articles was extracted by two independent investigators: (1) first author name, (2) publication year, (3) study design, (4) age of patients, (5) sample size, (6) design of COVID-19 vaccine, (7) trade name of COVID-19 vaccine, (8) dosage of COVID-19 vaccine, (9) modified JADAD scale, and (10) seroconversion rate.

Assessment of the methodological quality

Prior to inclusion in our analysis, articles were appraised for quality using the modified JADAD scale. The scores ranged from 0 to 7. Scores of 5–7, 3–4, and 0–2 indicated high-, moderate-, and low-quality papers, respectively.21 Low-quality articles were excluded from the analysis. Using a pilot form, quality assessment was performed by two independent authors (JKF & MI). Discrepancies between the two authors were resolved by discussion.

Outcome measure

The primary outcome was the seroconversion rate of the COVID-19 vaccine, defined as the level of geometric mean titer (GMT) of neutralizing antibodies of greater than or equal to four-fold from the baseline. The predictors were different COVID-19 vaccine designs. To identify the potential COVID-19 vaccine designs, an initial evaluation of the available data in PubMed, Scopus, and Web of Science was performed. Of those, inactivated, mRNA, protein subunit, and vector COVID-19 vaccines were available for the analysis.

Statistical analysis

Before analyzing the data, the potential publication bias and heterogeneity across the studies was assessed. Publication bias was assessed using an Egger test, and a p-value < 0.05 indicated a publication bias. Heterogeneity among the studies was evaluated using the Q test. A p-value < 0.10 suggested that heterogeneity existed among studies, and that a random effect model should be applied for the data analysis. Otherwise, a fixed-effect model should be used. The cumulative seroconversion rate of COVID-19 vaccines was determined using a single arm model meta-analysis by calculating the pooled seroconversion events from the total sample size. The effect size was presented using the seroconversion percentage and 95% confidence interval (CI). The data were analyzed using R package software (R package, MA, US, RRID:SCR_001905). The pooled seroconversion rates are summarized in a forest plot. The seroconversion rates between different designs of COVID-19 vaccines were compared by calculating the effect size of each COVID-19 vaccine design. The highest seroconversion rate was considered the highest efficacy, and the Confidence in Network Meta-Analysis software version 1.9.1 (Bern, Switzerland, RRID:SCR_016488) was used to outline the network diagram of comparison among COVID-19 vaccines.

Results

Study selection

We collected 8,070 potential papers from the databases. Of these, 23 duplication papers were found, and 7,966 papers had irrelevant topics; therefore, those papers were excluded. Subsequently, 81 papers were included for further full-text reviews. Among these, 19 reviews and 32 papers with insufficient data and were excluded. Finally, a total of 31 papers were analyzed to compare the seroconversion rates among COVID-19 vaccines.22–52 The process of article selection in our study is presented in Figure 1, and the characteristics of the papers included in our analysis are summarized in Table 1.

ce482f3a-69bf-4381-8c69-6147559bf348_figure1.gif

Figure 1. A PRISMA flow chart of study selection.

Table 1. Baseline characteristics of study included in our meta-analysis.

AuthorAge (±SD)Sample sizeType of vaccineMerk vaccineDose of vaccineJadad Modified Scale
Al Kaabi et al 202136.2 (9.2)40832InactivatedWIV04, HB02, alum–onlyWIV04 = 5 μg/dose; HB02 = 4 μg/dose; alum-only = 0.5mg6
Ali et al 202114.2 (1.6)3732mRNAmRNA-1273200 μg5
Baden et al 202151.3 (24.7)30420mRNAmRNA-1273200 μg4.5
Che et al 202041.4 (10.84)750InactivatedInactivated SARS-CoV-2 vaccine50 EU, 100 EU, 150 EU6
Ella et al 202132.5 (24)375InactivatedBBV152Algel-IMDG = 3 μg; Algel-IMDG = 6 μg with; Algel = 6 μg7
Fadlyana et al 2021 (1)35.6 (11.3)1620InactivatedInactivated SARS-CoV-2 vaccine3 μg6.5
Falsey et al 202164.8 (21.4)32379Vector vaccineAZD1222 (ChAdOx1 nCoV-19)5 × 1010 viral particles7
Feng et al 2021N/A809InactivatedInactivated SARS-CoV-2 vaccine3 μg5.5
Formica et al 202138.9 (12.40)1288Protein subunit vaccineNVXCoV23735 μg, 25 μg6.5
Han et al 20218.4 (4.2)550InactivatedCoronaVac1.5 μg, 3 μg6
Jackson et al 202036.7 (7.9)45mRNAmRNA-127325 μg, 100 μg, 250 μg4.5
Kremsner et al 202038.6 (12.9)248mRNACVnCoV2-12 μg5.5
Li et al 202137.9 (9.6)144mRNABNT162b110 μg, 30 μg7
Liu et al 202158.2 (4.81)830mRNAChAd, BNTChAd = 0.5 mL, BNT = 0.3 mL6.5
Melo-González et al 2021N/A94InactivatedCoronaVac3 μg5.5
Pan et al 202138.0 (9.5)560InactivatedKCONVAC5 μg, 10 μg7
Polack et al 2020N/A43448mRNABNT162b230 μg5.5
Pu et al 202118-5996InactivatedNANA5.5
Richmond et al 202137.6 (11.9)148Protein subunit vaccineSCB-20193 μg, 9 μg, 30 μg7
Sadoff et al 202136.1 (10.1)805Vector vaccineAd26.COV2.S5 × 1010, 1 × 1011 viral particles5.5
Shu et al 202143.9 (11.3)880Protein subunit vaccineV-0110 μg, 25 μg7
Tanriover et al 2021N/A10218InactivatedCoronaVac3 μg7
Thomas et al 2021N/A44060mRNABNT162b230 μg5.5
Wu et al 202165.6 (4.3)395InactivatedCoronaVac1.5 μg, 3 μg, 6 μg7
Xia et al 2020 (a)36.0 (8.5)320InactivatedInactivated SARS-CoV-2 vaccine2.5 μg, 5 μg, 10 μg6
Xia et al 2020 (b)42·7 (8·1)640InactivatedBBIBP-CorV2 μg, 4 μg, 8 μg7
Yang et al 202032.6 (9.41)950Protein subunit vaccineZF200125 μg, 50 μg6
Zeng et al 202145.2 (9.1)540InactivatedCoronaVac1.5 μg, 3 μg, 6 μg7
Zhang et al 202041.8 (9.4)744InactivatedCoronaVac3 μg, 6 μg6
Zhang et al 202140.0 (9.2)180Protein subunit vaccineV-0110 μg, 25 μg, 50 μg7
Zhu et al 202037.2 (10.7)108Vector vaccineAd5 vectored COVID-19 vaccine5 × 1010, 1 × 1011, 1·5 × 1011 viral particles4

The seroconversion rates among different COVID-19 vaccines

In the follow-up period of ≤ 15 days, 24 papers assessing the seroconversion rate of COVID-19 vaccines were collected. In total, the seroconversion rate was 91.1% (Figure 2A). The seroconversion rates of inactivated (Figure 2B), mRNA (Figure 2C), protein subunit (Figure 2D), and vector COVD-19 vaccines (Figure 2E) were 93.2%, 93.9%, 65.3%, and 54.7%, respectively. Subsequently, in the follow-up period of 16–30 days, the cumulative seroconversion rate of COVID-19 vaccines was 94.1% (Figure 3A). The seroconversion rates of inactivated (Figure 3B), mRNA (Figure 3C), protein subunit (Figure 3D), and vector COVID-19 vaccines (Figure 3E) were 96.0%, 94.8%, 91.2%, and 89.7%, respectively. Alternatively, in the follow-up period of 31–60 days, the pooled seroconversion rate of COVID-19 vaccines was 98.0% (Figure 4A). The seroconversion rate of inactivated (Figure 4B), mRNA (Figure 4C), protein subunit (Figure 4D), and vector COVID-19 vaccines (Figure 4E) were 98.5%, 98.6%, 98.5%, and 96.2%, respectively.

ce482f3a-69bf-4381-8c69-6147559bf348_figure2.gif

Figure 2. A forest plot of the seroconversion rate among different type of COVID-19 vaccines at day ≤15.

A). All vaccine types; B). Inactivated vaccine; C). mRNA vaccine; D). Protein subunit vaccine; and E). Vector vaccine.

ce482f3a-69bf-4381-8c69-6147559bf348_figure3.gif

Figure 3. A forest plot of the seroconversion rate among different type of COVID-19 vaccines at day 16-30.

A). All vaccine types; B). Inactivated vaccine; C). mRNA vaccine; D). Protein subunit vaccine; and E). Vector vaccine.

ce482f3a-69bf-4381-8c69-6147559bf348_figure4.gif

Figure 4. A forest plot of the seroconversion rate among different type of COVID-19 vaccines at day 31-60.

A). All vaccine types; B). Inactivated vaccine; C). mRNA vaccine; D). Protein subunit vaccine; and E). Vector vaccine.

The indirect comparison of seroconversion rates among different COVID-19 vaccines

In the follow-up period of ≤ 15 days (Figure 5A), the seroconversion rates of inactivated and mRNA COVID-19 vaccines were superior to those of the protein subunit and vector COVID-19 vaccines. In the follow-up period of 16–30 days (Figure 5B), the seroconversion rates of inactivated and mRNA COVID-19 vaccines were significantly higher than those of protein subunit and vector COVID-19 vaccines. In the follow-up period of 31–60 days (Figure 5C), the seroconversion rate of the vector COVID-19 vaccine was inferior to that of the inactivated, mRNA, and protein subunit COVID-19 vaccines. The network diagrams of seroconversion rates among different COVID-19 vaccine designs are presented in Figure 5D, 5E, and 5F for the follow-up periods of ≤ 15, 16–30, and 31–60 days, respectively. The summary of indirect comparison of seroconversion rate among COVID-19 vaccines is outlined in Table 2.

ce482f3a-69bf-4381-8c69-6147559bf348_figure5.gif

Figure 5. The indirect comparison between different types of COVID-19 vaccines.

A). Follow up period at day ≤15; B). Follow up period at day 16-30; C). Follow up period at day 31-60; D). The networking among studies at day ≤15; E). The networking among studies at day 16-30; and F). The networking among studies at day 31-60.

Table 2. The summary of analysis on the indirect comparison of seroconversion rate between different types of COVID-19 vaccines.

Indirect comparisonNSSample sizeOR95%CIp
Follow up at day ≤15
Inactivated vs. mRNA16 vs. 515464 vs. 534544.063.58 – 4.60<0.0001
Inactivated vs. protein subunit16 vs. 115464 vs. 15029.5320.66 – 42.19<0.0001
Inactivated vs. vector16 vs. 215464 vs. 2162330.9527.37 – 34.99<0.0001
mRNA vs. protein subunit5 vs.153454 vs. 1507.275.19 – 10.20<0.0001
mRNA vs. vector5 vs. 253454 vs. 216237.637.30 – 7.97<0.0001
Protein subunit vs. vector1 vs. 2150 vs. 216231.050.75 – 1.470.7850
Follow up at day 16-30
Inactivated vs. mRNA13 vs. 4990 vs. 1590.970.37 – 2.530.9540
Inactivated vs. protein subunit13 vs. 6990 vs. 4531.971.17 – 3.320.0100
Inactivated vs. vector13 vs. 2990 vs. 1942.511.33 – 4.730.0040
mRNA vs. protein subunit4 vs. 6159 vs. 4532.030.77 – 5.350.1520
mRNA vs. vector4 vs. 2159 vs. 1942.580.92 – 7.260.0730
Protein subunit vs. vector6 vs. 2453 vs. 1941.270.66 – 2.440.4690
Follow up at day 31-60
Inactivated vs. mRNA1 vs. 532 vs. 4990.590.03 – 11.200.7260
Inactivated vs. protein subunit1 vs. 632 vs. 4480.360.02 – 7.740.5170
Inactivated vs. vector1 vs. 132 vs. 1582.770.15 – 50.420.4910
mRNA vs. protein subunit5 vs. 6499 vs. 4480.560.10 – 3.040.4980
mRNA vs. vector5 vs. 1499 vs. 1584.891.36 – 17.540.0150
Protein subunit vs. vector6 vs. 1448 vs. 1588.801.76 – 44.080.0080

Source of heterogeneity

In the follow-up period of ≤ 15 days, evidence of heterogeneity (p heterogeneity > 0.05) was observed in the models of analyses for all COVID-19 vaccines, inactivated COVID-19 vaccines, mRNA COVID-19 vaccines, and vector COVID-19 vaccines. Therefore, a random effect model was used. In the follow-up period of 16–30, evidence of heterogeneity was observed in all models of analyses; therefore, a random effect model was used. In the follow-up period of 31–60 days, all analyses were performed using a fixed effect model, because no evidence of heterogeneity was found (Supplementary files).20

Discussion

Our study reported on the seroconversion rate among different COVID-19 vaccines in the follow-up periods of ≤ 15, 16–30, and 31–60 days. We revealed that, in the follow-up period of ≤ 15 days, the highest seroconversion rate was that of the inactivated vaccine. In the follow-up period of 16–30 days, the highest seroconversion rates were those of the inactivated and mRNA vaccines. Conversely, in the follow-up period of 31–60 days, the highest seroconversion rates were those of the inactivated, mRNA, and protein subunit vaccines. To date, our study is the first to report on the seroconversion rates among different COVID-19 vaccines; therefore, comparisons among meta-analyses were not discussed. However, similar meta-analyses have been performed to assess the efficacy of COVID-19 vaccines. In total, nine meta-analysis studies have been conducted.53–61 While the majority of these studies focused on side effects of the vaccine, they also reported the efficacy of COVID-19 vaccines by assessing the reduced risk of infection, mortality, hospitalization, and admission to the ICU. The findings revealed that the mRNA vaccine had the highest efficacy in preventing COVID-19 infection.59 Those previous meta-analyses support our findings that, besides the mRNA vaccine, the inactivated vaccine had a higher seroconversion rate than that of the protein subunit and vector COVID-19 vaccines.

The theory underlying the comparison of the efficacy of COVID-19 vaccines remains debatable. It has been widely proposed that various vaccines have various immunogens and may be engulfed, processed, and presented by antigen-presenting cells (APCs) along with MCH antigens to CD4+ T cells. Resultingly, cytokine synthesis may occur and may activate humoral and cellular responses, including antibody production, CD8+ T cell activation, and macrophage stimulation. Subsequently, B lymphocytes may differentiate into plasma cells and produce specific antibodies to protect against the infection.62,63 In the inactivated vaccine, the immunogenic property is a killed or modified virus containing the whole pathogen, virus fragments, or virus epitope.64 In the mRNA vaccine, the mRNA will be taken up by APC and translated into protein in situ. The mRNA encodes the full-length, pre-fusion stabilized spike protein (S) of SARS-CoV-2.14 In the protein subunit vaccine, the immunogenic property is specific isolated proteins from SARS-COV2 virus (S glycoprotein), which is responsible for receptor binding to cellular ACE-2.65–67 This type of vaccine is similar to a vector vaccine, in which the S protein is produced to confer protection against COVID-19.68 Of those possible mechanisms, the inactivated vaccine may target a wide variety of epitopes,69 and therefore, this type of vaccine may have a wide protection against COVID-19 variants of concern compared to other types of COVID-19 vaccines. However, vaccine specificity may differ, which requires evaluation by comparing the total GMT levels.

To the best of our knowledge, the present study is the first to report a comparison of seroconversion rates among different COVID-19 vaccine designs. Our study provided valuable evidence that inactivated and mRNA vaccines provided an early seroconversion rate, and the protein subunit vaccine achieved a similar seroconversion rate to that of inactivated and mRNA vaccines in the follow-up period of 31–60 days. The results of our research may be used as a basis for evaluating the development of COVID-19 vaccines in the future.13 We hope that future vaccine development may take into account the results of seroconversion rates between different vaccine designs, as we reported in our study. Therefore, the expected protective effects of the vaccine could be achieved. However, our present study only assessed the seroconversion rate in a short follow-up period. Further studies assessing a long-term follow-up period are required.

Our current study had several important limitations. First, we did not include potential confounding factors in assessing the efficacy of COVID-19 vaccines, such as comorbidity, nutritional status, and transmission area. Therefore, the probability of the dependent effect remains open to discussion. Second, the different report formats among studies required manual calculation for the precise seroconversion rate information. Therefore, there is the possibility of human error in interpreting seroconversion rates. Third, the vaccine and booster dosages varied among the studies. Therefore, false-positive findings might exist. Fourth, we only focused on the seroconversion rate, in which this evaluation was only effective in assessing the sensitivity of vaccines. Further studies evaluating cumulative GMTs might be required. Fifth, in the current study, vaccine safety was not evaluated. Therefore, further studies assessing safety are needed.

Conclusion

Our study revealed that the inactivated and mRNA COVID-19 vaccines provided the highest seroconversion rates at early follow-up. The protein subunit COVID-19 vaccine achieved a seroconversion rate similar to that of the inactivated and mRNA vaccines at the follow-up period of 31–60 days. Our study might contribute to better insight into the seroconversion rates of different COVID-19 vaccines.

Data availability

All data underlying the results are available as part of the article and no additional sources of data are required.

Reporting guidelines

Figshare. PRISMA checklist. DOI: https://doi.org/10.6084/m9.figshare.19236714.v220

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

Competing interests

No competing interests were declared.

Grant information

This study received no external funding.

Author contribution

Idea/concept: GS, JKF. Design: GS, JKF, LW. Control/supervision: GS, LW, MA, KD, HH. Data collection/processing: MI, AA, HI, AAA, SL, US, TDY, EDN, FR, NR, RT, MVK, SS, MCH, UA, NH, NBF, VCL, UMP, FT, DAK, AIM, AP, EAP. Extraction/Analysis/interpretation: JKF, MI. Literature review: GS, JKF, MI. Writing the article: GS, JKF, MI. Critical review: GS, LW, MA, KD, HH. All authors have critically reviewed and approved the final draft and are responsible for the content and similarity index of the manuscript.

Acknowledgement

We thank Lembaga Pengelola Dana Pendidikan (LPDP) Republic of Indonesia for supporting this project.

References

  • 1.  Mutiawati E, Syahrul S, Fahriani M, et al.: Global prevalence and pathogenesis of headache in COVID-19: A systematic review and meta-analysis. F1000Res. 2020; 9: 1316. Publisher Full Text
  • 2.  Kibria HB, Jyoti O, Matin A: Forecasting the spread of the third wave of COVID-19 pandemic using time series analysis in Bangladesh. Inform. Med. Unlocked. 2022; 28: 100815. PubMed Abstract | Publisher Full Text
  • 3.  Thakur V, Bhola S, Thakur P, et al.: Waves and variants of SARS-CoV-2: understanding the causes and effect of the COVID-19 catastrophe. Infection. 2021. PubMed Abstract | Publisher Full Text
  • 4.  Krishnan A, Hamilton JP, Alqahtani SA, et al.: COVID-19: An overview and a clinical update. World J. Clin. Cases. 2021; 9: 8–23. PubMed Abstract | Publisher Full Text
  • 5.  Cascella M, Rajnik M, Aleem A, et al.: Features, Evaluation, and Treatment of Coronavirus (COVID-19). Treasure Island (FL): StatPearls; 2022.
  • 6.  Agarwal A, Rochwerg B, Lamontagne F, et al.: A living WHO guideline on drugs for covid-19. BMJ. 2020; 370: m3379.
  • 7.  Ozlusen B, Kozan S, Akcan RE, et al.: Effectiveness of favipiravir in COVID-19: a live systematic review. Eur. J. Clin. Microbiol. Infect. Dis. 2021; 40: 2575–2583. PubMed Abstract | Publisher Full Text
  • 8.  Wardhani SO, Fajar JK, Wulandari L, et al.: Association between convalescent plasma and the risk of mortality among patients with COVID-19: a meta-analysis. F1000Res. 2021; 10: 64. Publisher Full Text
  • 9.  Wardhani SO, Fajar JK, Soegiarto G, et al.: The association between therapeutic plasma exchange and the risk of mortality among patients critically ill with COVID-19: a meta-analysis. F1000Res. 2021; 10: 1280. PubMed Abstract | Publisher Full Text
  • 10.  Prasansuklab A, Theerasri A, Rangsinth P, et al.: Anti-COVID-19 drug candidates: A review on potential biological activities of natural products in the management of new coronavirus infection. J. Tradit. Complement. Med. 2021; 11: 144–157. PubMed Abstract | Publisher Full Text
  • 11.  The LM: COVID-19 vaccines: the pandemic will not end overnight. Lancet Microbe. 2021; 2: e1. Publisher Full Text
  • 12.  Yu H, Yang J, Marziano V, et al.: Can a COVID-19 vaccination program guarantee the return to a pre-pandemic lifestyle?. Res. Sq. 2021.
  • 13.  Fajar JK, Harapan H: Socioeconomic and attitudinal variables associated with acceptance and willingness to pay towards dengue vaccine: a systematic review. Arch. Clin. Infect. Dis. 2017; 12: e13914. Publisher Full Text
  • 14.  Kaur SP, Gupta V: COVID-19 Vaccine: A comprehensive status report. Virus Res. 2020; 288: 198114. PubMed Abstract | Publisher Full Text
  • 15.  Tentori K, Passerini A, Timberlake B, et al.: The misunderstanding of vaccine efficacy. Soc. Sci. Med. 2021; 289: 114273. PubMed Abstract | Publisher Full Text
  • 16.  Buttiron Webber T, Provinciali N, Musso M, et al.: Predictors of poor seroconversion and adverse events to SARS-CoV-2 mRNA BNT162b2 vaccine in cancer patients on active treatment. Eur. J. Cancer. 2021; 159: 105–112. PubMed Abstract | Publisher Full Text
  • 17.  Corti C, Antonarelli G, Scotte F, et al.: Seroconversion rate after vaccination against COVID-19 in patients with cancer-a systematic review. Ann. Oncol. 2022; 33: 158–168. PubMed Abstract | Publisher Full Text
  • 18.  Syahrul S, Maliga HA, Ilmawan M, et al.: Hemorrhagic and ischemic stroke in patients with coronavirus disease 2019: incidence, risk factors, and pathogenesis - a systematic review and meta-analysis. F1000Res. 2021; 10: 34. PubMed Abstract | Publisher Full Text
  • 19.  Yusuf F, Fahriani M, Mamada SS, et al.: Global prevalence of prolonged gastrointestinal symptoms in COVID-19 survivors and potential pathogenesis: A systematic review and meta-analysis. F1000Res. 2021; 10: 301. PubMed Abstract | Publisher Full Text
  • 20.  Fajar JK: Fajar, Jonny (2022): Supplementary files: Seroconversion rates among different designs of COVID-19 vaccines: a network meta-analysis of randomized controlled trials. Figshare Dataset. 2022; 1: 1. Publisher Full Text
  • 21.  Olivo SA, Macedo LG, Gadotti IC, et al.: Scales to assess the quality of randomized controlled trials: a systematic review. Phys. Ther. 2008; 88: 156–175. Publisher Full Text
  • 22.  Al Kaabi N, Zhang Y, Xia S, et al.: Effect of 2 Inactivated SARS-CoV-2 Vaccines on Symptomatic COVID-19 Infection in Adults: A Randomized Clinical Trial. JAMA. 2021; 326: 35–45. PubMed Abstract | Publisher Full Text
  • 23.  Ali K, Berman G, Zhou H, et al.: Evaluation of mRNA-1273 SARS-CoV-2 Vaccine in Adolescents. N. Engl. J. Med. 2021; 385: 2241–2251. PubMed Abstract | Publisher Full Text
  • 24.  Baden LR, El Sahly HM, Essink B, et al.: Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N. Engl. J. Med. 2021; 384: 403–416. PubMed Abstract | Publisher Full Text
  • 25.  Che Y, Liu X, Pu Y, et al.: Randomized, Double-Blinded, Placebo-Controlled Phase 2 Trial of an Inactivated Severe Acute Respiratory Syndrome Coronavirus 2 Vaccine in Healthy Adults. Clin. Infect. Dis. 2021; 73: e3949–e3955. PubMed Abstract | Publisher Full Text
  • 26.  Ella R, Reddy S, Jogdand H, et al.: Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBV152: interim results from a double-blind, randomised, multicentre, phase 2 trial, and 3-month follow-up of a double-blind, randomised phase 1 trial. Lancet Infect. Dis. 2021; 21: 950–961. PubMed Abstract | Publisher Full Text
  • 27.  Fadlyana E, Rusmil K, Tarigan R, et al.: A phase III, observer-blind, randomized, placebo-controlled study of the efficacy, safety, and immunogenicity of SARS-CoV-2 inactivated vaccine in healthy adults aged 18-59 years: An interim analysis in Indonesia. Vaccine. 2021; 39: 6520–6528. PubMed Abstract | Publisher Full Text
  • 28.  Falsey AR, Sobieszczyk ME, Hirsch I, et al.: Phase 3 Safety and Efficacy of AZD1222 (ChAdOx1 nCoV-19) Covid-19 Vaccine. N. Engl. J. Med. 2021; 385: 2348–2360. PubMed Abstract | Publisher Full Text
  • 29.  Feng Y, Chen J, Yao T, et al.: Safety and immunogenicity of inactivated SARS-CoV-2 vaccine in high-risk occupational population: a randomized, parallel, controlled clinical trial. Infect. Dis. Poverty. 2021; 10: 138. PubMed Abstract | Publisher Full Text
  • 30.  Formica N, Mallory R, Albert G, et al.: Different dose regimens of a SARS-CoV-2 recombinant spike protein vaccine (NVX-CoV2373) in younger and older adults: A phase 2 randomized placebo-controlled trial. PLoS Med. 2021; 18: e1003769. PubMed Abstract | Publisher Full Text
  • 31.  Han B, Song Y, Li C, et al.: Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine (CoronaVac) in healthy children and adolescents: a double-blind, randomised, controlled, phase 1/2 clinical trial. Lancet Infect. Dis. 2021; 21: 1645–1653. PubMed Abstract | Publisher Full Text
  • 32.  Jackson LA, Anderson EJ, Rouphael NG, et al.: An mRNA Vaccine against SARS-CoV-2 - Preliminary Report. N. Engl. J. Med. 2020; 383: 1920–1931. PubMed Abstract | Publisher Full Text
  • 33.  Kremsner PG, Mann P, Kroidl A, et al.: Safety and immunogenicity of an mRNA-lipid nanoparticle vaccine candidate against SARS-CoV-2: A phase 1 randomized clinical trial. Wien. Klin. Wochenschr. 2021; 133: 931–941. PubMed Abstract | Publisher Full Text
  • 34.  Li J, Hui A, Zhang X, et al.: Safety and immunogenicity of the SARS-CoV-2 BNT162b1 mRNA vaccine in younger and older Chinese adults: a randomized, placebo-controlled, double-blind phase 1 study. Nat. Med. 2021; 27: 1062–1070. PubMed Abstract | Publisher Full Text
  • 35.  Liu X, Shaw RH, Stuart ASV, et al.: Safety and immunogenicity of heterologous versus homologous prime-boost schedules with an adenoviral vectored and mRNA COVID-19 vaccine (Com-COV): a single-blind, randomised, non-inferiority trial. Lancet. 2021; 398: 856–869. PubMed Abstract | Publisher Full Text
  • 36.  Melo-Gonzalez F, Soto JA, Gonzalez LA, et al.: Recognition of Variants of Concern by Antibodies and T Cells Induced by a SARS-CoV-2 Inactivated Vaccine. Front. Immunol. 2021; 12: 747830. PubMed Abstract | Publisher Full Text
  • 37.  Pan HX, Liu JK, Huang BY, et al.: Immunogenicity and safety of a severe acute respiratory syndrome coronavirus 2 inactivated vaccine in healthy adults: randomized, double-blind, and placebo-controlled phase 1 and phase 2 clinical trials. Chin. Med. J. 2021; 134: 1289–1298. PubMed Abstract | Publisher Full Text
  • 38.  Polack FP, Thomas SJ, Kitchin N, et al.: Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N. Engl. J. Med. 2020; 383: 2603–2615. PubMed Abstract | Publisher Full Text
  • 39.  Pu J, Yu Q, Yin Z, et al.: The safety and immunogenicity of an inactivated SARS-CoV-2 vaccine in Chinese adults aged 18-59 years: A phase I randomized, double-blinded, controlled trial. Vaccine. 2021; 39: 2746–2754. Publisher Full Text
  • 40.  Richmond P, Hatchuel L, Dong M, et al.: Safety and immunogenicity of S-Trimer (SCB-2019), a protein subunit vaccine candidate for COVID-19 in healthy adults: a phase 1, randomised, double-blind, placebo-controlled trial. Lancet. 2021; 397: 682–694. PubMed Abstract | Publisher Full Text
  • 41.  Sadoff J, Le Gars M, Shukarev G, et al.: Interim Results of a Phase 1-2a Trial of Ad26.COV2.S Covid-19 Vaccine. N. Engl. J. Med. 2021; 384: 1824–1835. PubMed Abstract | Publisher Full Text
  • 42.  Shu YJ, He JF, Pei RJ, et al.: Immunogenicity and safety of a recombinant fusion protein vaccine (V-01) against coronavirus disease 2019 in healthy adults: a randomized, double-blind, placebo-controlled, phase II trial. Chin. Med. J. 2021; 134: 1967–1976. PubMed Abstract | Publisher Full Text
  • 43.  Tanriover MD, Doganay HL, Akova M, et al.: Efficacy and safety of an inactivated whole-virion SARS-CoV-2 vaccine (CoronaVac): interim results of a double-blind, randomised, placebo-controlled, phase 3 trial in Turkey. Lancet. 2021; 398: 213–222. PubMed Abstract | Publisher Full Text
  • 44.  Thomas SJ, Moreira ED Jr, Kitchin N, et al.: Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine through 6 Months. N. Engl. J. Med. 2021; 385: 1761–1773. PubMed Abstract | Publisher Full Text
  • 45.  Wu Z, Hu Y, Xu M, et al.: Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine (CoronaVac) in healthy adults aged 60 years and older: a randomised, double-blind, placebo-controlled, phase 1/2 clinical trial. Lancet Infect. Dis. 2021; 21: 803–812. PubMed Abstract | Publisher Full Text
  • 46.  Xia S, Zhang Y, Wang Y, et al.: Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBIBP-CorV: a randomised, double-blind, placebo-controlled, phase 1/2 trial. Lancet Infect. Dis. 2021; 21: 39–51. PubMed Abstract | Publisher Full Text
  • 47.  Xia S, Duan K, Zhang Y, et al.: Effect of an Inactivated Vaccine Against SARS-CoV-2 on Safety and Immunogenicity Outcomes: Interim Analysis of 2 Randomized Clinical Trials. JAMA. 2020; 324: 951–960. PubMed Abstract | Publisher Full Text
  • 48.  Yang S, Li Y, Dai L, et al.: Safety and immunogenicity of a recombinant tandem-repeat dimeric RBD-based protein subunit vaccine (ZF2001) against COVID-19 in adults: two randomised, double-blind, placebo-controlled, phase 1 and 2 trials. Lancet Infect. Dis. 2021; 21: 1107–1119. PubMed Abstract | Publisher Full Text
  • 49.  Zeng G, Wu Q, Pan H, et al.: Immunogenicity and safety of a third dose of CoronaVac, and immune persistence of a two-dose schedule, in healthy adults: interim results from two single-centre, double-blind, randomised, placebo-controlled phase 2 clinical trials. Lancet Infect. Dis. 2021. PubMed Abstract | Publisher Full Text
  • 50.  Zhang Y, Zeng G, Pan H, et al.: Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine in healthy adults aged 18-59 years: a randomised, double-blind, placebo-controlled, phase 1/2 clinical trial. Lancet Infect. Dis. 2021; 21: 181–192. PubMed Abstract | Publisher Full Text
  • 51.  Zhang J, Hu Z, He J, et al.: Safety and immunogenicity of a recombinant interferon-armed RBD dimer vaccine (V-01) for COVID-19 in healthy adults: a randomized, double-blind, placebo-controlled, Phase I trial. Emerg. Microbes Infect. 2021; 10: 1589–1597. PubMed Abstract | Publisher Full Text
  • 52.  Zhu FC, Li YH, Guan XH, et al.: Safety, tolerability, and immunogenicity of a recombinant adenovirus type-5 vectored COVID-19 vaccine: a dose-escalation, open-label, non-randomised, first-in-human trial. Lancet. 2020; 395: 1845–1854. Publisher Full Text
  • 53.  Zheng C, Shao W, Chen X, et al.: Real-world effectiveness of COVID-19 vaccines: a literature review and meta-analysis. Int. J. Infect. Dis. 2022; 114: 252–260. PubMed Abstract | Publisher Full Text
  • 54.  Chen M, Yuan Y, Zhou Y, et al.: Safety of SARS-CoV-2 vaccines: a systematic review and meta-analysis of randomized controlled trials. Infect. Dis. Poverty. 2021; 10: 94. PubMed Abstract | Publisher Full Text
  • 55.  Harder T, Kulper-Schiek W, Reda S, et al.: Effectiveness of COVID-19 vaccines against SARS-CoV-2 infection with the Delta (B.1.617.2) variant: second interim results of a living systematic review and meta-analysis, 1 January to 25 August 2021. Euro Surveill. 2021; 26. Publisher Full Text
  • 56.  Ling Y, Zhong J, Luo J: Safety and effectiveness of SARS-CoV-2 vaccines: A systematic review and meta-analysis. J. Med. Virol. 2021; 93: 6486–6495. PubMed Abstract | Publisher Full Text
  • 57.  Liu Q, Qin C, Liu M, et al.: Effectiveness and safety of SARS-CoV-2 vaccine in real-world studies: a systematic review and meta-analysis. Infect. Dis. Poverty. 2021; 10: 132. PubMed Abstract | Publisher Full Text
  • 58.  Kalaij AGI, Dirjayanto VJ, Yusuf SM, et al.: Immunogenicity and safety of adenovirus-based vector vaccines for COVID-19: a systematic review and meta-analysis. Med. J. Indones. 2021; 30: 264–278. Publisher Full Text
  • 59.  Pormohammad A, Zarei M, Ghorbani S, et al.: Efficacy and Safety of COVID-19 Vaccines: A Systematic Review and Meta-Analysis of Randomized Clinical Trials. Vaccines (Basel). 2021; 9. Publisher Full Text
  • 60.  McDonald I, Murray SM, Reynolds CJ, et al.: Comparative systematic review and meta-analysis of reactogenicity, immunogenicity and efficacy of vaccines against SARS-CoV-2. NPJ Vaccines. 2021; 6: 74. PubMed Abstract | Publisher Full Text
  • 61.  Sharif N, Alzahrani KJ, Ahmed SN, et al.: Efficacy, Immunogenicity and Safety of COVID-19 Vaccines: A Systematic Review and Meta-Analysis. Front. Immunol. 2021; 12: 714170. PubMed Abstract | Publisher Full Text
  • 62.  Pulendran B, Ahmed R: Immunological mechanisms of vaccination. Nat. Immunol. 2011; 12: 509–517. PubMed Abstract | Publisher Full Text
  • 63.  Fajar JK, Mahendra AI, Tamara F, et al.: The association between complete blood count and the risk of coronary heart disease. Turkiye Klinikleri J. Med. Sci. 2019; 39: 56–64. Publisher Full Text
  • 64.  Kyriakidis NC, Lopez-Cortes A, Gonzalez EV, et al.: SARS-CoV-2 vaccines strategies: a comprehensive review of phase 3 candidates. NPJ Vaccines. 2021; 6: 28. PubMed Abstract | Publisher Full Text
  • 65.  Wu Y, Huang X, Yuan L, et al.: A recombinant spike protein subunit vaccine confers protective immunity against SARS-CoV-2 infection and transmission in hamsters. Sci. Transl. Med. 2021; 13. PubMed Abstract | Publisher Full Text
  • 66.  Fajar JK, Pikir BS, Sidarta EP, et al.: The Gene Polymorphism of Angiotensin-Converting Enzyme Intron Deletion and Angiotensin-Converting Enzyme G2350A in Patients With Left Ventricular Hypertrophy: A Meta-analysis. Indian Heart J. 2019; 71: 199–206. PubMed Abstract | Publisher Full Text
  • 67.  Rohman MS, Fajar JK, Kuncahyo BH, et al.: Angiotensin-converting enzyme (ACE) I/D and bradykinin B2 receptor T/C genes polymorphism in patients with ACE inhibitors-related cough. Egypt. J. Med. Hum. Genet. 2018; 19: 307–313. Publisher Full Text
  • 68.  Doerfler W: Adenoviral Vector DNA- and SARS-CoV-2 mRNA-Based Covid-19 Vaccines: Possible Integration into the Human Genome - Are Adenoviral Genes Expressed in Vector-based Vaccines?. Virus Res. 2021; 302: 198466. PubMed Abstract | Publisher Full Text
  • 69.  Ella R, Vadrevu KM, Jogdand H, et al.: Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBV152: a double-blind, randomised, phase 1 trial. Lancet Infect. Dis. 2021; 21: 637–646. PubMed Abstract | Publisher Full Text

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 10 Mar 2022
Comment
Author details Author details
Competing interests
Grant information
Article Versions (1)
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
 - -
Citations
SEE MORE DETAILS
CITE
how to cite this article
Soegiarto G, Fajar JK, Wulandari L et al. Seroconversion rates among different designs of COVID-19 vaccines: a network meta-analysis of randomized controlled trials [version 1; peer review: 1 approved with reservations]. F1000Research 2022, 11:299 (https://doi.org/10.12688/f1000research.110281.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 10 Mar 2022
Views
19
Cite
Reviewer Report 06 Jun 2022
Jonghoon Kang, Department of Biology, Valdosta State University, Valdosta, GA, USA 
Approved with Reservations
VIEWS 19
https://doi.org/10.5256/f1000research.121867.r137394
In the manuscript, the authors describe their systematic review on the seroconversion rates among various COVID-19 vaccines. While their study looks interesting and important, several points need to be clarified:
  1. The authors called their method of
... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Kang J. Reviewer Report For: Seroconversion rates among different designs of COVID-19 vaccines: a network meta-analysis of randomized controlled trials [version 1; peer review: 1 approved with reservations]. F1000Research 2022, 11:299 (https://doi.org/10.5256/f1000research.121867.r137394)
The direct URL for this report is:
https://f1000research.com/articles/11-299/v1#referee-response-137394
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Report a concern

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 10 Mar 2022
Comment

Open Peer Review

Reviewer Status

Alongside their report, reviewers assign a status to the article:

Approved
The paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations
A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved
Fundamental flaws in the paper seriously undermine the findings and conclusions

Reviewer Reports

Invited Reviewers
1
Version 1
10 Mar 22 		read
  1. Jonghoon Kang, Valdosta State University, Valdosta, USA

Comments on this article

All Comments(0)

Add a comment
Sign up for content alerts

Browse by related subjects

    keyboard_arrow_left Back to all reports
    Alongside their report, reviewers assign a status to the article:
    Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
    Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
    Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
    Sign In
    If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

    The email address should be the one you originally registered with F1000.
    Email address not valid, please try again

    You registered with F1000 via Google, so we cannot reset your password.

    To sign in, please click here.

    If you still need help with your Google account password, please click here.

    You registered with F1000 via Facebook, so we cannot reset your password.

    To sign in, please click here.

    If you still need help with your Facebook account password, please click here.

    Code not correct, please try again
    Email us for further assistance.
    Server error, please try again.