ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article

Effect of the quality of anticoagulation on the risk of stroke, thrombotic events, hemorrhagic events, and death in patients with nonvalvular atrial fibrillation on acenocoumarol in Real-World Data

[version 1; peer review: awaiting peer review]
PUBLISHED 13 Sep 2024
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS AWAITING PEER REVIEW

Abstract

Background

Monitoring and strict control of anticoagulation therapy reduces the risk of thromboembolic or hemorrhagic events. The objective of this research was to explore the association of the quality of anticoagulation control with the occurrence of stroke, thrombotic or hemorrhagic events, or death during follow-up in patients with nonvalvular atrial fibrillation (NVAF) on vitamin K antagonists.

Methods

A retrospective and observational study was carried out in clinical practice (real world data). Data were collected on age, sex, income level, occupational status, ischemic stroke, thrombotic and hemorrhagic events, death, and the Charlson Comorbidity Index. Time in therapeutic range (TTR) was measured using TAONet software and TTR ≥60% was considered indicative of good anticoagulation control. Survival analysis was carried out using Kaplan-Meier curves and Cox regression models to compare time-to-event by quality of anticoagulation control. Determinants of anticoagulation quality were identified using logistic regression.

Results

Of 856 patients recruited, only 286 (33%) had a TTR ≥60%. Cox models including sociodemographic and clinical variables showed that the risk of all four events was much higher in the subsample with TTR <60% and the differences were statistically significant. Specifically, the hazard ratios (HRs) for this group were 1.94 (confidence interval [CI]: 1.13-3.30) for stroke, 1.60 (CI: 1.10-2.33) for thrombotic events, 1.61 (CI: 1.08-2.42) for hemorrhagic events and 2.97 (CIs: 1.86-4.75) for death.

Conclusions

The positive conclusion of the study was the markedly lower rate of events associated with TTR ≥60% and the negative conclusion was the low percentage of patients achieving good anticoagulation control. This implies that despite being “protected”, they continue to have a high risk of stroke, embolism, hemorrhagic complications and death. We believe it is necessary to develop and implement strategies to tackle this problem.

Keywords

nonvalvular atrial fibrillation; stroke; hemorrhagic event; survival analysis; comorbidity; anticoagulation

Introduction

Over the past fifty years, vitamin K antagonists (VKAs) have been the mainstay of anticoagulation therapy for the primary and secondary prevention of venous and arterial thromboembolic events.1 They have proven to be highly effective and are therefore used today by millions of people around the world with nonvalvular atrial fibrillation (NVAF), venous thromboembolic disease, mechanical valve prosthesis and other conditions.2,3 In Spain, the type of VKA used is acenocoumarol which inhibits the reduction of vitamin K by vitamin K reductase. This prevents carboxylation of certain glutamic acid residues near the N-terminals of clotting factors II, VII, IX and X, the vitamin K-dependent clotting factors. Its mechanism of action is to interfere with the vitamin K cycle, decreasing levels of the biologically active forms of coagulation factors, thus hindering the formation and growth of thrombi.1 Given its complex pharmacokinetics and pharmacodynamics, there is a wide individual variability in the therapeutic effect of anticoagulation with VKAs. Among other factors, genetic characteristics, medication interactions, environmental conditions, vitamin K intake, hypermetabolic states, diseases, comorbidities, and age can interfere with the coagulation process.46 Therefore, interactions with other medications, the anticoagulant effect and any reduction in thromboembolic events are factors to be taken into account in clinical practice together with the risk of bleeding associated with this therapy.1,7

Monitoring and strict control of anticoagulation therapy reduces the risk of thromboembolic or hemorrhagic events. The international normalized ratio (INR) is the standardized measure for expressing the results of prothrombin time tests and has served to validate the effectiveness of oral anticoagulation in numerous studies.8 The target therapeutic range is established based on the reason why a patient is anticoagulated, and is typically between 2.00 and 3.00, except in patients with mechanical valve prosthesis, in whom it is 2.50 to 3.50.3 The INR value at a given time determines the effectiveness of anticoagulant therapy with VKAs and is related to the risk of bleeding or thrombosis.2,8 We can also evaluate the quality of anticoagulation by monitoring the time in therapeutic range (TTR).811 TTR, expressed as the percentage of time that INR values remain within the therapeutic range, is commonly used as a measure of the quality of anticoagulation control over a certain time interval due to its association with the occurrence of bleeding and thromboembolic events.8,12

The results in the literature concerning the impact of good anticoagulation control differ by study design. In a systematic review, TTR was found to be negatively correlated with rates of bleeding and thromboembolic events. This effect was significant in observational studies, but not in randomized controlled trials.8 For this reason, it is crucial that the correlation between good control of anticoagulation and its benefits in terms of thrombotic and hemorrhagic events avoided be evaluated in clinical practice.

The objective of this study was to measure the association of the quality of anticoagulation control using VKAs with the occurrence of stroke, thrombotic or hemorrhagic events, or death during follow-up in patients diagnosed with NVAF.

Methods

Study design

A retrospective and observational study (real world data)10 was carried out through survival analysis of events recorded in anticoagulated patients from the beginning of treatment until the end of the follow-up. Real-world data (RWD) refers to data derived from sources outside of traditional clinical trials or controlled research settings, such as electronic health records (EHRs), medical claims, patient surveys, and more.13 The necessary data were obtained from the administrative and clinical databases of the Basque Health Service using the Oracle Analytics Server (OAS) manager (https://www.oracle.com/solutions/business-analytics/analytics-server/analytics-server.html) and the TAOnet® system (https://diagnostics.roche.com/es/es/products/digital/taonet-pro-pid00000580.html). The electronic medical record is fully implemented in the Basque Health Service and linked to patient administrative data. This allows all patients’ contacts with the health system and their resource use to be recorded (at the levels of primary care, as well as emergency, inpatient, hospital-at-home and/or specialist outpatient hospital care). In addition, the prescribing and dispensing of medicines are recorded based on electronic prescriptions (Anatomical Therapeutic Chemical [ATC] Classification). The Clinical Research Ethics Committee of the Basque Country approved the study protocol with code EOM2022071 on November 23, 2022.

All patients who started anticoagulation with VKA from January 1, 2020 to June 30, 2021 at the Araba Integrated Health Organization were recruited. The inclusion criteria were: (1) NVAF diagnosis; (2) Age equal to or greater than 18 years; (3) Able to provide written informed consent for the use and publication of their data. The following were understood as exclusion criteria: (1) Cognitive impairment defined as more than 4 errors on the Pfeiffer Test5; (2) Lack of language understanding; (3) Palliative care situation. Follow-up was measured in days from the date of prescription until the occurrence of the event or the end of follow-up on March 31, 2023. Data were collected on the following sociodemographic variables: age, sex, occupational status (worker, pensioner), and socioeconomic status (household income level). Patients’ co-payment category indicated their occupational status and also income level. The high and low socioeconomic status groups included people with a family income of greater than or equal to 18,000 euros and less than 18,000 euros respectively.14

The main clinical variables were whether ischemic stroke, thrombotic (stroke plus systemic embolism), or hemorrhagic events, or death had occurred and whether patients had been diagnosed with conditions in the Charlson Comorbidity Index (CCI), and if so, the date of the events and diagnoses. Thrombotic events considered included stroke, transient ischemic attack, deep vein thrombosis, pulmonary thromboembolism, splenic infarction, and acute myocardial infarction; and hemorrhagic events considered included hematuria, hematomas, intracranial hemorrhage, subarachnoid hemorrhage, upper and lower gastrointestinal hemorrhages, subconjunctival hemorrhage, epistaxis, hemoptysis, and other hemorrhages. The CCI quantifies the risk of mortality associated with 19 weighted comorbidities including congestive heart failure, cerebrovascular disease, chronic lung disease, and diabetes, and is an important prognostic factor.15,16 Both events and CCI diagnoses were identified using their ICD-9 and ICD-10 codes. Switches to direct oral anticoagulants (DOACs) and their dates were also recorded.

Data related to the quality of anticoagulation control were collected through TAONet software. This software is used in the management of outpatients and inpatients on anticoagulation therapy and records the INR over time and the TTR of each patient. To assess the patients’ INR control, the TTR over the last 6 months was calculated by the direct method (percentage of INR values within the therapeutic range).17,18 The times in TTR estimated by the direct mode are statistically significantly correlated with those estimated by the Rosendaal mode, that assigns an INR value for each day between collected lab values, assuming linear movement from one INR value to another.9,18 For patients with an event, the TAOnet value in the 6 months leading up to the event was also calculated. In accordance with the antithrombotic guidelines for NVAF,19 we set the INR target range at 2.0–3.0 and considered the quality of anticoagulation control to be good when the TTR was ≥60%.10,17,18

Statistical analysis

The statistical analysis was carried out using R software (R version 4.3.1) with a confidence level of 95%. A univariate descriptive analysis was performed first to detect differences in characteristics between groups by quality of anticoagulation control. Comparisons of categorical variables were performed using the chi-square test, while means of continuous variables were compared using Student’s t-test if the data were normally distributed and otherwise using the Mann-Whitney U test.

Subsequently, a non-parametric survival analysis was carried out using the Kaplan-Meier and Cox regression models to compare the time to event by quality of anticoagulation control.20 To compare the Kaplan-Meier survival curves, the log-rank test was used. Using Cox regression, the risk of an event was analyzed as a function of time, adjusted for age, sex, occupational status, income level, and comorbidity. Survival analysis was used to compare the time to an event in the sample depending on whether TTR was higher or lower than the cutoff set for good control (≥60%). The survival analysis was performed separately for stroke events, thrombotic events, hemorrhagic events, and death. Follow-up for each individual and event was established from the start of anticoagulation to the date of the specific event, death, switch to a DOAC, or end of follow-up.

A logistic regression was also carried out with the probability of having TTR values ≥60% as the outcome variable and age, sex, occupational status, income level and comorbidity as independent variables.

Results

We recruited 949 patients who had been started on anticoagulation therapy with acenocoumarol. Among these patients, 59 had not been on VKA therapy for a minimum of 6 months and 34 had missing data regarding control of anticoagulation in the TAOnet registry; hence, they were excluded from the study. Therefore, the final sample studied comprised 856 patients.

Table 1 summarizes the characteristics of these patients disaggregated by anticoagulation control according to TTR. Only 286 (33%) patients had TTR values ≥60% indicating good control. The mean age was similar in both groups by level of control. The analysis of crude differences showed that the group with TTR ≥60% had significantly fewer thrombotic events, strokes and deaths, while the differences in hemorrhagic events were not statistically significant. The distributions of socioeconomic variables, such as income level and occupational status, also did not differ significantly with TTR level. Overall, 41% of patients were switched to DOACs. Notably, switching was much less common in the good control group (TTR ≥60%) than in the poor control group (TTR <60%) (11% vs 57%). The average TTR in the entire sample was 52.6%, rising to 68.8% in the good control group and falling to 44.5% in the poor control group.

Table 1. Characteristics of the patients with nonvalvular atrial fibrillation disaggregated by level of anticoagulation control.

TTR≥60%TTR<60%Total
Total28633%57067%856100%
Sex*
Man17360%30053%47355%
Woman11340%27047%38345%
CCI*
06121%9216%15318%
1-211942%21237%33139%
2-36322%14525%20824%
>44315%12121%16419%
Thrombotic event*
Yes3813%10619%14417%
Stroke*
Yes186%6021%7526%
Hemorrhagic eventns
Yes3412%8315%11714%
Death***
Yes228%10118%12314%
Occupational statusns
Pensioner25489%51490%76890%
Worker3211%5610%8810%
Income levelns
High12142%22139%34240%
Low16558%34961%51460%
Switch to DOAC***
No25689.5%24643.2%50258.6%
Yes3010.5%32456.8%35441.4%
TTR≥60TTR<60Total
meansdmeansdmeansd
Initial agens75.710.776.311.176.110.9
TTR***68.8%15.4%44.5%14.2%52.6%18.6%
Follow-up (days)
Thrombosis***709.8298.5489.6348.9563.2309.2
Stroke***704.5309.6485.5344.1558.7348.5
Hemorrhage***718.3285.7504.0326.8575.6329.4
Death***770.4254.6530.9327.2610.9325.0

* : p<0.05;

** : p<0.01;

*** : p<0.001; sd: standard deviation.

Figures 1-3 show the Kaplan-Meier curves for each subsample by level of control (TTR< or TTR≥60%) for the four events analyzed (stroke, thrombotic and hemorrhagic events, and death). The differences between the subsamples were statistically significant for all four events according to the log-rank tests.

a4e14f7d-fd19-4113-95b5-63464e02e024_figure1.gif

Figure 1. Probability of stroke (a) and a thrombotic event (b) over the follow-up as represented by Kaplan-Meier curves.

TTR: time in therapeutic range. X-axis: time in days. Y-axis: probability. These figures were drawn by ourselves from the results.

a4e14f7d-fd19-4113-95b5-63464e02e024_figure2.gif

Figure 2. Probability of hemorrhagic event over the follow-up represented by Kaplan-Meier curves.

TTR: time in therapeutic range. X-axis: time in days. Y-axis: probability. This figure was drawn by ourselves from the results.

a4e14f7d-fd19-4113-95b5-63464e02e024_figure3.gif

Figure 3. Probability of death over the follow-up represented by Kaplan-Meier curves.

TTR: time in therapeutic range. X-axis: time in days. Y-axis: probability. This figure was drawn by ourselves from the results.

The multivariate survival analyses using Cox regression reported in Table 2 confirmed that, when adjusting for age, sex, income level, occupational status and CCI, the risk of each of the four events was much higher in the subsample with TTR <60% than in the good control group. Specifically, the HRs were 1.94 (CIs: 1.13-3.30) for stroke, 1.60 (CIs: 1.10-2.33) for thrombotic events, 1.61 (CIs: 1.08-2.42) for hemorrhagic events and 2.97 (CIs: 1.86-4.75) for death. Occupational status was not a significant factor in the risk of any event, while a low-income level was significantly associated with a higher risk of hemorrhage but not with the other events.

Table 2. Hazard ratios of events in patients with nonvalvular atrial fibrillation by quality of anticoagulation control.

HRLower CIUpper CIP
Thrombotic event
TTR <60%1.601.102.330.014
Age0.990.971.010.148
Sex: woman1.070.751.530.712
CCI 0reference
CCI 1-22.151.114.180.023
CCI 3-43.221.636.350.001
CCI >44.542.308.950.000
Low income0.880.621.240.463
Worker0.890.461.730.730
Event: stroke
TTR <60%1.941.133.300.015
Age1.000.971.030.906
Sex: woman1.260.782.030.336
CCI 0reference
CCI 1-24.421.3314.670.015
CCI 3-47.902.3726.350.001
CCI >46.831.9923.460.002
Low income0.810.501.310.389
Worker1.100.432.790.842
Hemorrhagic event
TTR <60%1.611.082.420.021
Age1.000.981.030.688
Sex: woman0.710.481.060.093
CCI 0reference
CCI 1-21.050.591.870.876
CCI 3-41.240.682.280.485
CCI >41.370.732.570.320
Low income1.911.242.940.003
Worker0.720.321.630.432
Event: death
TTR <60%2.971.864.750.000
Age1.081.051.110.000
Sex: woman0.740.501.070.109
CCI 0reference
CCI 1-26.541.5727.270.010
CCI 3-49.292.2338.720.002
CCI >410.532.5244.060.001
Low income0.970.651.460.886
Worker1.070.323.560.915

In the crude analysis, the percentages of women and higher comorbidity categories were significantly lower in the good control group (Table 1). These results were confirmed in the multivariate analysis analyzing the probability of good control with logistic regression in that the odds ratios (ORs) for women (OR:0.69; CIs: 0.50-0.93) and the higher comorbidity categories, namely, CCI of 3-4 (OR: 0.61; CIs: 0.39-0.97) and CCI >4 (OR: 0.50; CIs: 0.30-0.81), indicated significantly poorer control in these groups (Table 3).

Table 3. Logistic regression model estimating the likelihood of the time in therapeutic range being above 60%.

ORLower CIUpper CIP
Age1.010.991.020.425
Sex: woman0.690.500.93<0.05
CCI 0Reference
CCI 1-20.810.541.210.307
CCI 3-40.610.390.97<0.05
CCI >40.500.300.81<0.01
Low income0.950.701.290.743
Worker1.050.601.850.853

Discussion

The findings of this study confirm the benefits of achieving good anticoagulation control in clinical practice, the risks of the three cardiovascular events and death being significantly higher in the group with poor control (TTR <60%). Further, the HR (1.92) for the risk of stroke was almost twice as high in the poor control group, reflecting a greater preventive effect of anticoagulation when a patient’s INR is within the therapeutic range. Notably, in the survival analysis, the highest risk was for death (HR of 2.96), despite this being adjusted for ICC, underscoring the high excess mortality in the poor control group. These results are consistent with those published in the literature in which good control has been associated with HRs greater than 2 for the risk of events.2123 On the other hand, a systematic review suggested that a higher mean TTR on VKA therapy is associated with more effective prevention although the strength of the association decreases when adjusted for patient clinical characteristics.24 Control of anticoagulation in patients with NVAF is a key factor for achieving effectiveness by preventing strokes and safety by reducing hemorrhages. Achieving both these objectives increases the survival and quality of life of patients.25 Therefore, TTR is a key indicator to monitor to maximize the effectiveness of VKA therapy.26 Along the same lines, a systematic review indicated that 1 major hemorrhage and 1 thromboembolic event could be avoided per 100 patient-years if TTR were increased by 7% and 12%, respectively.8 Conversely, poor control of anticoagulation with VKA is associated with higher rates of cardiovascular events, and in turn, substantial increases in healthcare costs.27

Hardly any associations were found between socioeconomic variables and events in our results. Previously, it has been noted that some occupations may increase the risk of injury or trauma, which may influence the need to adjust anticoagulant doses to prevent serious bleeding.26 Moreover, the nature of patients’ work activity can affect their consistency in taking medications and, therefore, make it necessary to adapt the anticoagulation regimen to ensure treatment adherence.26 On the other hand, socioeconomic status may influence access to medical care, including follow-up visits and laboratory tests necessary to adjust acenocoumarol doses appropriately.28,29 Additionally, economic factors may affect patients’ ability to acquire and take medications.28 Nonetheless, as in a Spanish multicenter study,30 the risk of events in our results was not significantly associated with patients’ socioeconomic level or occupational status. Only when analyzing the risk of hemorrhage did a lower level of income appear as a significant risk factor. This lack of significant differences in events is consistent with the lack of significant differences in the probability of having an adequate TTR. It is plausible that social factors have little influence in the context of a Beveridge-type health system like ours with a single public system that ensures universal access to health care.31 Further, it may indicate that equity in the provision of anticoagulation therapy underlies the lack of differences in outcomes measured in terms of risk of events.

Good anticoagulation control was only associated with male sex and lower levels of comorbidity. The lack of significance of age is surprising. On the contrary, and as in the literature, the results of the Cox models indicated that in addition to good control, the risk of events depends on age and comorbidity which is consistent with the growing risk of cardiovascular events with age.16,32 A high level of comorbidity implies the use of other medications that may interact with the action of anticoagulation, making it necessary to adjust the doses of acenocoumarol to avoid hemorrhagic or thromboembolic complications,23,26 while conditions such as kidney or liver failure affect the metabolism of oral anticoagulants, meaning that doses need to be adjusted to maintain therapeutic levels.24 There are mixed results in the literature concerning adherence to acenocoumarol and good control, significant associations not always being found between adherence and therapeutic control.33,34 Genetic differences seem to influence the metabolism of vitamin K and cytochrome P450.35 Genetic variants in the warfarin-metabolizing enzyme, cytochrome P-450 2C9 (CYP2C9), and a key drug target of warfarin, vitamin K epoxide reductase (VKORC1), contribute to differences in patient responses to various doses of warfarin, though the role of these variants during initial anticoagulation is unclear.36 All this indicates that factors such as drug-diet interactions, genetic variability in drug metabolism, and frequent dose adjustments, which were not measured in this study, may hinder anticoagulation control, in turn, increasing the risk of events.37

Unlike the results of a meta-analysis of anticoagulated NVAF patients in which the mean TTR was 61%,38 our mean TTR was just 52.6% and two-thirds (67%) of our patients had a TTR <60%. In other studies conducted in Spain, the rate of good anticoagulation control has been similar (between 53% and 59%).30,39,40 Although the prevalence of poor control is higher in clinical registries that include patients from routine practice,8 even in relevant clinical trials such as RE-LY41 and ROCKET AF,42 between 30-40% of patients with NVAF who receive VKA have been outside the range, with INRs <2 or >3, more than 60-65% of the time. Similar to our results, two studies in Korean and Thai populations found good control rates of around 30%.10,43

As well as noncompliance with treatment or changes in dosage, potential causes of an inadequate INR include interruptions due to procedures requiring discontinuation of acenocoumarol, recent administration of vitamin K, diarrhea, or vomiting, the emergence of other diseases, changes in other medications, and changes in diet and lifestyle, such as increased dietary intake of vitamin K, increased tobacco consumption, and/or increased levels of physical activity.43,44 As in another study,39 we found that female sex and greater comorbidity were significantly associated with poor control. Other authors have considered female sex to be a possible modifier of TTR, and many reasons have been suggested for poorer control of oral anticoagulation in women, such as pharmacokinetics, hormonal effects, family and social factors, and less access to health services.19,45 Gender differences in VKA pharmacokinetics have been partially attributed to average body size and liver fat, as well as intrinsic differences in VKA metabolism. Furthermore, the metabolism carried out by cytochrome P450 can be altered by the effect of sex hormones, leading to an increase in the response to a VKA dose in women.

The results of our study indicate that a high proportion of patients with NVAF currently receiving VKA in our province are poorly anticoagulated. This implies that despite being “protected”, they continue to have a high risk of stroke, embolism, hemorrhagic complications and death. We believe it is necessary to develop and implement strategies to tackle this problem. In the clinical practice context in which the study was conducted, the consequence of poor control was that more than half of the patients (56.8%) were switched to DOACs. Given this high figure, the question arises as to whether patients with more comorbidities should have been prescribed a DOAC instead of acenocoumarol at the outset when NVAF was diagnosed.

One limitation of this study is its observational design associated with the data having been obtained from clinical practice. Nevertheless, our findings noting poor control of anticoagulation in real world data underline the need to closely monitor adherence as measured by time within the appropriate INR range. Another limitation to note is that the diagnosis of NVAF has been identified based on the ICD codes, without having validated the criteria for its diagnosis. On the other hand, the strengths of this study are that it included patients from routine clinical practice and that the results were adjusted for comorbidity, occupational status, and socioeconomic level.

As a positive conclusion of the study, we point out the great benefit observed in terms of events and deaths avoided when TTR reaches figures ≥60%. On the contrary, the low rate of good control found represents a key opportunity for improvement. This is important because achieving effective control of anticoagulation means decreasing the risk of cardiovascular events and therefore both increasing quality-adjusted life expectancy for patients and reducing costs for the health system.

Ethics approval and consent

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. Patients provided written informed consent for participating and the use and publication of their data. All procedures involving human subjects/patients were approved by the Clinical Research Ethics Committee of Araba (code number EOM 2022071; date 23/11/2022).

Authors’ contributions

MFP, GP, CP and JM conceived, designed the research and wrote the first version of introduction and discussion. OI obtained the data, and interpreted the data, helping to write results and discussion. MFP and JM designed the methods, performed the analyses, interpreted the data and wrote the methods and results. All authors revised the manuscript for important intellectual content and approved the final manuscript.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 13 Sep 2024
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Fernández-Pérez M, Pereda Á, Pisón C et al. Effect of the quality of anticoagulation on the risk of stroke, thrombotic events, hemorrhagic events, and death in patients with nonvalvular atrial fibrillation on acenocoumarol in Real-World Data [version 1; peer review: awaiting peer review]. F1000Research 2024, 13:1054 (https://doi.org/10.12688/f1000research.151517.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status:
AWAITING PEER REVIEW
AWAITING PEER REVIEW
?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 13 Sep 2024
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.