ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Systematic Review
Revised

Quality assessment of systematic literature on uterine fibroids: a systematic review

[version 2; peer review: 2 approved with reservations]
PUBLISHED 08 Mar 2024
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Background

A systematic literature review (SLR) is a research methodology that examines data and findings of other authors relative to specified research questions (RQ), collects multiple research studies, and summarises them to answer a research question using rigorous methods. Many SLRs have been published on uterine fibroids (UFs) in the last two decades but there is a dearth of knowledge on assessment of the quality to determine the reliability of results.

Methods

This study employed the SLR method to identify available SLRs published on UFs. Dybå and Dingsøyr quality standards and dichotomous grading scales were employed to determine the quality of primary studies. On February 3rd, 2022, an auto search was conducted twice over Citeseer, EBSCO, ACM, Springer Link, IEE Computer society digital library, and Scopus using 17 search strings. Two teams independently screened papers and compared notes with the inclusion/exclusion criteria. 11 criterial were adapted to evaluate the quality of the SLR’s.

Results

33 SLRs were subjected to data extraction after inclusion/exclusion criteria. Answers to our primary research question was positive as the aims and contexts of the SLRs are generally clear and the methodologies employed are all inclusive. The research outputs of the primary studies are valid and justifiable as their research statements were clear and findings unambiguous. Although some studies failed some quality criteria, answers to all RQs were affirmative as the percentage scores of the studies on each of the quality conditions is favourably high.

Conclusions

The auto search may be incomplete because some qualified SLRs may have been missed as the choice of search strings was limited and may have omitted terminologies. Notwithstanding, with average quality scores of 83% in reporting, 81.2% in rigour, and 79% in credibility, this study concludes that majority of the meta-analysis published so far on UF are valid and reliable.

Keywords

Medicine, meta-analysis, Past Studies, Quality Condition, Quality Assessment, Structured Review, Systematic Literature Review; Uterine Fibroids.

Revised Amendments from Version 1

The article has now been reviewed by an English Language Editor.

The incorrect reference no 16 is now corrected to be 26.

See the authors' detailed response to the review by Mary Ann Lumsden
See the authors' detailed response to the review by Andrea Etrusco

Introduction

Evidenced-based studies started in medicine and became generally accepted as expert opinions based on results obtained from scientific experiments appears more reliable than those obtained from medical advice.1 Evidence here refers to a combination of best quality scientific works on a topic or research question. A systematic literature review (SLR) is a main method of this synthesis. It is a methodologically rigorous review of research results aimed not just at aggregating all existing evidence on a research question but also targeted at supporting the development of evidence-based guidelines for practitioners.1 Its use in software engineering and computer sciences subject areas, and its application has been increasing since 20041 as it considers findings from varying sources to form a position. Notwithstanding this popularity, the quality of the SLRs’ results should be assessed to determine both the level of confidence to be placed on them as well as the required recommendations to offer.2

As an instance, we have two schools of thought regarding gynaecological conditions in pregnancy. Myomectomy during ceserean section (CS) was condemned for severe bleeding and potential hysterectomy. Whereas, there are advocates for myomectomy at sittings of surgery three to six months after delivery to promote uterus involution, myomas shrinkage, and reduce operative time and blood loss.3,4 Nowadays, gynaecologists are advocating for the removal of myoma due to its minimal operative time, mild (or no) complications to call for a second surgery, and gross reduction in the total cost of myomas surgery. Systematic literatures have reviewed the perioperative complications of caesarean myomectomy (CM) and found increased operative time and drop in haemoglobin in cases of caesarean myomectomy.3 in their Evidenced-based reviews, Arowolo et al.,5 also argued that Uterine artery embolization advantages over surgery is short-term and that the benefits were similar on the mid- and long-term. However, the qualities of these studies have not been evaluated to raise the confidence in their findings and reduce bias in their review process for better interpretation of results.

Primary studies assessment can actually be complicated since there is no specific definition for “quality”.2,6 However, some notable researchers such as Jadadet et al.,7 Dybå and Dingsøyr,8 Kitchenham et al.,,9 and Sjoberg et al.,10 have successfully developed guidelines and tools specifically meant for the purpose, but much more concerned about what the results are, their validity, and whether or not they will be locally useful.6,11 Since the “quality of a study is closely linked to the research methods used and the validity of the findings generated by the study”,10 this study comprehensively reviewed the quality of the past available related studies published by evaluating various methods used by primary studies of each of the selected SLRs to clearly established the validity of their results. Hence, the authors did not place a date or year bound/limit on the search engine in other to have a sizeable number of primary studies to work with having realized that not much SLRs has been done on leiomyomas or myomas to date – February 3rd, 2022.

Past related works

Quality is regarded as “an extent to which systematic errors or bias may be prevented through the review and analysis of primary studies”.12 Yet, researchers are less interested in quality assurance and assessment as only very small numbers of SLRs aimed at the quality assessment of their primary studies.

Orlando et al.,13 employed the National Institutes of Health Study Quality Assessment tools to perform quality assessment of SLR towards identifying the identifying best practices for non-hysteroscopic myomectomy for women with myomas but still desire future fertility. Their initial searches on selected databases returned 2,163 studies out of which only 51 met their inclusion criteria. The authors noted that the route of non-hysteroscopy myomectomy and intraoperative uterine artery occlusion did not significantly affect pregnancy rates or outcomes. Giving a clear insight into patient selection and intraoperative techniques for non-hysteroscopy myomectomy, the study recommended further research with well-designed clinical trials to highlight the relationships between myoma characteristics and reproductive outcomes.

Notwithstanding its high prevalence, the fibroids psychosocial impact was yet to be compared with other chronic conditions and evaluated across the quality-of-life indicators. Hence, Go, Virginia et al.,14 thoroughly appraised the available evidence against the UF psychosocial burden in premenopausal women and contrasted the quality of life validated and symptom scores before and after treatment. The authors engaged three independent reviewers to screen various abstracts and tiles of selected SLRs towards obtaining full text studies from notable databases for further assessment. They observed that quality-of-life scores in UF patients were usually low at baseline compared to after treatment and that, there are therapeutic success and improvement of both physical and emotional symptoms after treatment.

Tranoulis, Anastasios15 auto-searched some digital libraries and broad indexes to produce the first meta-analysis that could provide a convincing overview of efficacy and safety of laparoscopic uterine artery occlusion (LUAO). Comparing the long and short-terms morbidity of laparoscopic myomectomy (even without LUAO), the study modified the Jadad score to assess the quality of Randomized controlled trials (RCTs) but employed methodologic index for nonrandomized studies to evaluate the quality of observational studies (OSs).

Symptomatic uterine myomas, two independent researchers in Jeng et al.,16 carried out data selection to perform a comparative study of the clinical outcomes of uterine artery embolization and those of high-intensity focused ultrasound (HIFU) ablation in women with myomas. The study quality was assessed using the “Cochrane Handbook for Systematic Reviews” while the pooled mean difference and relative risks were both calculated at 95% confidence interval for the respective continuous data and dichotomous data. Although, the authors could not ascertain that HIFU is far better for desired pregnancy considering the confounding factors, they postulated that uterine artery embolization (UAE) lowers both postoperative re-intervention rate and pregnancy rate for women with uterine myomas and provide more significant alleviation of symptoms and improvement in quality of life.

Methods

Researchers have built several guidelines and checklist good enough for quality assessment in SLR.17 While majority of these tools rally round the validity of the research outcomes, a few others look more at the methodological characteristics of the study. Jadad et al.,7 and CASP18 are popular tools and commonly adapted in Sociology and Software Engineering19 but their scales are not directly applicable to Medicine. Hence, following the raising of the study questions and review of past related studies, Dybå and Dingsøyr8 11 criterial were adapted in this study to evaluate the quality of the SLR’s primary studies. In which case, each of these criteria, graded with a dichotomous scale (Yes=1; No=0), is categorized into the following four main issues for ease of quality assessments.

  • Reporting: Criteria (1, 2, and 3) are about the quality of the report of research aims, rationale, and context.

  • Rigor: Criteria (4, 5, 6, 7, and 8) have to do with the objectivity of the research methods used to establish the validity of data collection tools and the analysis methods, and hence the trustworthiness of the findings.

  • Credibility: Criteria (9 and 10) are connected directly to assess the credibility of the research methods to ensure the validity of the findings.

  • Relevance: Criterion 11 is concerned with the relevance of the study to the research community.at large.

The questions

The primary research question (RQ) is “How reliable are the meta-analysis in the Uterine Fibroids”?

This question is broken down into the following secondary questions to address the study objectives

  • RQ1: Are the SLRs studies centred on clear aims and description of context?

  • RQ2: How inclusive are the methodologies employed in the primary studies?

  • RQ3: Are the study output valid?

The search process

We conducted three independent searches on February 3rd and 4th 2022, and all were without publication date restriction. Our initial auto searches of five notable digital libraries and broad indexes for relevant SLRs (Citeseer, EBSCO, ACM,Springer Link, IEE Computer society digital library) did not return much related studies. Our second Search was over Scopus and returned 153 studies fleshed SLRs but PowerPoint templates or lecture notes. This search was complicated as it was done 17 times using the underlisted set of search strings (SS) since Scopus does not allow very simple construction of complex searches:

  • 1. “Fibroid OR leiomyomas OR myomas” AND “review of studies”

  • 2. “Fibroid OR leiomyomas OR myomas” AND “structured review”

  • 3. “Fibroid OR leiomyomas OR myomas” AND “systematic review”

  • 4. “Fibroid OR leiomyomas OR myomas” AND “literature review”

  • 5. “Fibroid OR leiomyomas OR myomas” AND “literature analysis”

  • 6. “Fibroid OR leiomyomas OR myomas” AND “in-depth survey”

  • 7. “Fibroid OR leiomyomas OR myomas” AND “literature survey”

  • 8. “Fibroid OR leiomyomas OR myomas” AND “meta-analysis”

  • 9. “Fibroid OR leiomyomas OR myomas” AND “past studies”

  • 10. “Fibroid OR leiomyomas OR myomas” AND “subject matter expert”

  • 11. “Fibroid OR leiomyomas OR myomas” AND “Analysis of research”

  • 12. “Fibroid OR leiomyomas OR myomas” AND “empirical body of knowledge”

  • 13. “Fibroid OR leiomyomas OR myomas” AND “overview of existing knowledge”

  • 14. “Fibroid OR leiomyomas OR myomas” AND “body of published research ”

  • 15. “Fibroid OR leiomyomas OR myomas” AND “review”

  • 16. “Fibroid OR leiomyomas OR myomas” AND “literature analysis”

  • 17. “Fibroid OR leiomyomas OR myomas” AND “literature listing”

However, our third search, which was limited to the source - “Science Direct” only, was simple and straightforward as the underlisted complex searches were applied only once using the independent search strings SS1 and SS2 in isolation:

SS1 Title, abstract or author-specified keywords

(leiomyomas OR myomas) AND (“literature review” OR “systematic review” OR “structured review” OR “review of study” OR “literature analysis” OR “in-depth survey” OR “literature survey”)

SS2 Title, abstract or author-specified keywords

(leiomyomas OR myomas) AND (“meta-analysis” OR “past studies” OR “subject matter expert” OR “Analysis of research” OR “empirical body of knowledge” OR “overview of existing knowledge” OR “body of published research”)

Having noted that not many SLRs are available on Fibroid studies, all searches were conducted without publication date restrictions. However, the searches were limited to document title and keywords, which usually carry the research subjects. To avoid human error, two researchers were engaged to independently conduct the literature search, and their results were compared for completeness. Searches over Scopus are mainly not fully fleshed out but they are still relevant to this study as their output helps to validate our search process when compared with papers found in our last search. Since 96 of 98 fully fleshed SLRs found therein were part of the total SLRs found in the third search, we adjudge our search process and procedure to be okay and accurate.

Study selection

The results of the three searches were integrated together to have 169 papers in total which we eventually subjected to initial screening over their title, abstract, and keywords. Sorting on the document title, the total papers was reduced to 65 having removed 104 articles including the 98 SLRs found in Scopus to avoid duplication since they are also found in Science Direct (our third search). We assume that the abstract or title of any quality papers should contain at least one of the search strings. Hence, searching over both the title and abstract columns to exclude papers that have no abstract20 or those that exclude literature review or any of the search strings (SS), another 12 articles were removed and the total SLRs were further reduced to 53, all of which were subsequently subjected to a more detailed assessment:

These 53 SLRs were electronically downloaded and two teams of two members each were formed to screen the papers for possible exclusion or inclusion. Consequently, the teams compared their notes to prevent false acceptance or false rejection, and differences were addressed following the underlisted exclusion criteria:

  • The SLR is not fully fleshed but a mere research or lesson note.

  • The topic is medicine or surgery and not related to Fibroid nor discusses systematic/literature reviews.

  • The SLR followed a vague search process.

Three papers6,21,22 were rejected in this process for not being full-fleshed research publications, but a mere research/lesson note or PowerPoint template. 15 SLRs were excluded based on unrelated topics or failure to discuss systematic literature but dissimilar domains like surgery or Microbiology. Similarly, two other papers23,24 did not follow a defined search process and were dropped to have just 33 SLRs subjected to data extraction (Figure 1).

bf5052a0-7eec-4d37-8807-ad570921eeb9_figure1.gif

Figure 1. The study selection flow diagram.

Data extraction process

A similar procedure to data selection was followed to extract data and identified the SRSs presented on Table 1. As a quality assurance measure, the following parameters were identified for each of the selected papers:

  • The publication date/year (to show how current the SLRs)

  • The type of the document (journal, workshop, book chapter, conference).

  • The number of primary studies in the SLR (as stated by the author).

  • The aspects of UF studied

Table 1. Quality scores for the 33 systematic literature reviews (SLRs).

Study NoYearDocument TypeNo of 1o studiesQ1Q2Q3Q4Q5Q6Q7Q8Q9Q10Q11
162020Journal article40811111111101
272015Journal article1500100011101
282019Journal article235111111011111
292014Journal article64511111011111
302018Journal article201611111111111
312015Journal article34511111111111
322017Journal article98611111111111
332016Journal article12211100111101
342010Journal article1700000011001
352012Journal article8510100011111
362014Journal article9911111111001
132020Journal article216311111011111
372018Journal article1811100001111
382012Journal article511111111111
392014Journal article67611111111111
402017Journal article534701001111011
412016Journal article75611111111111
422018Journal article90711111111111
432015Journal article311111111111
142020Journal article5711111111111
442020Journal article24910100111011
452019Journal article101000011011
462010Journal article2500000011001
472015Journal article19411111111111
482016Journal article93411000011111
492019Journal article2611111111111
502019Journal article56811111111111
152018Journal article1211111111111
512017Journal article1201000111001
522015Journal article397511111111111
352012Journal article8511111111111
532018Journal article9011111111111
542010Journal article19611111111111
TOTAL2728272223232326262633

Quality assessment

This study employed the Dybå and Dingsøyr7 criteria to evaluate the quality of the selected SLRs.25,26 The choice of this set of criteria was because it contains 11 criteria checklists (as against others with fewer criteria) and covers all the main aspects of any research quality – reporting, credibility, relevance, and rigor. Adapted to this work, the selected SLRs are therefore independently assessed with the following criteria:

Q1 Does the study answer the research questions defined or presents the results in a clear way?

Q2: Is the research aim clearly stated?

Q3: Is the context where the study was conducted adequately described?

Q4: Was the study appropriately designed to address its aims and objectives?

Q5: Was the recruitment strategy to drive the research aim appropriate?

Q6: Were there control group(s) to compare with the treatments?

Q7: Was the data collection method good enough to address research issues?

Q8: Was the data analysis necessarily difficult?

Q9: Has the relationship between researcher and participants been adequately considered?

Q10: Is the statement of findings clearly stated?

Q11: Is the research valuable to practice or research interest?

A dichotomous scale was used to score and grade the questions. In which case:

TRUET=1;FALSEF=0.

Our quality assessment procedure is like the one used for data selection (Figure 1) where:

  • 1. Two teams of two researchers each are formed and all the SLRs were individually assessed by each team.

  • 2. Each team member independent treated each study by answering the quality questions, giving adequate justification.

  • 3. The pair researchers compared their notes and agreed on terms to finalize their team results.

  • 4. To avoid human error, two teams of researchers were engaged to independently conduct the literature search. They placed their findings side-by-side to compare their results, settle disputes (if any), and produce a quality output as presented on Table 1.

Results

Our research questions are addressed on this section to ensure that they have all been answered and the SLRs’ qualities have been established. The results of the SLRs’ quality assessment are summarised on Table 2. The pass mark is fixed at 50%.

Table 2. Qualitative assessment of 33 systematic literature reviews (SLRs) on Leiomyomas or Myomas.

SLRsQuality scores (QS)% Scores (QS/33)Research question (RQ) addressedRelated Quality Conditions (QC)QC Met?
Q1
Q2
Q3
27
28
27
82
85
82
RQ1ReportingYes, by 83%
Q4
Q5
Q6
Q7
Q8
22
23
23
33
33
67
70
70
100
100
RQ2RigourYes, by 81.2%
Q9
Q10
26
26
79
79
RQ3CredibilityYes, by 79%
Q1133100NilRelevance

RQ1: Are the SLRs studies centred on Clear Aims and Description of Context?

The answer to the RQ1 is positive as evidenced on Table 2 where the average score of Q1, Q2, and Q3 which particularly address RQ1 is 83% affirmative. Although five studies failed on Q2 and six failed on both Q1 and Q3 each, the percentage Scores of each on the quality condition (reporting) is favourably high. The failure on Q1 is traced to the five articles that properly addressed their research questions but failed to make their results/findings clear enough. Other failures were due to the articles that did not have clear research goals and those with obscure research contexts. Majority of the study representing 83% of the total samples, subjectively elucidated the (research) participants actions and made use of qualitative approaches, which is the most appropriate to address their study goals.

RQ2: How inclusive are the methodologies employed in the primary studies?

Yes, Most of the primary studies employed complete and all-encompassing research methodologies going by their QC score of 81% in “Rigour” on Table 2. This answer to RQ2 is determined by the status of “rigour”, which is an absolute function of the average scores of Q4, Q5, Q6, and Q8.

Although 10 of the 33 primary studies did not employ appropriate recruitment strategies for their studies, and the research objectives of 11 are inappropriately designed. Exactly 10 are also silent on the control group(s) required to compare their research methods. However, all of them gave extensive description of their analysis processes and present sufficient data to support their findings (Q7 and Q8); they were simple in data collection and detailed in sample analysis.

RQ3: Are the study output valid and justifiable?

Yes, the research outputs of the primary studies are valid and justifiable considering the 79% QC score on the research “credibility” even though, some of them truly failed on Q10 as their research statements were unclear and finding ambiguous. Some researchers did not actually consider their influence in their research questions formulation, sample collection and even their choice of location (Q9), but this is limited to only five primary studies where the researchers disclosed their possibilities of being biased. Hence, adequate recognition was given to the relationship between the researcher and the participants

Study limitations

We may have missed some qualified studies that used other terminologies to describe their literature review. Notwithstanding, this cannot be major as our search strings did not leave out any related terminologies found in every literature reviewed except “research aggregation” and “study/research synthesis” which we stumbled on at the tail end of this study Future researchers should take notes of these terminologies to avoid omission of qualified SLRs for review.

Conclusion

All the SLRs passed all the quality questions (Table 2) with the lowest in Q4. They also met and greatly surpassed all the quality conditions (QC) to clearly confirm that the primary studies are valid and of good quality. Therefore, answer to our primary (RQ) raised is affirmative; the meta-analysis in the Uterine Fibroids are very reliable. However, the SLRs needed to appropriately design their studies to be specific on their goals and objectives. They should also be explicit on the control groups with which their treatments and research methods are compared.

It is important for auto search to be complete and error free for reliable outputs and valid findings. When planning future studies therefore, the researchers should extend their search strings to include other terminologies that may have been missed in this study.

Data availability

All data underlying the results are available as part of the article and no additional source data are required.

Reporting guidelines

Figshare: PRISMA checklist for ‘Quality assessment of systematic literatures on uterine fibroids: a systematic review’, https://doi.org/10.6084/m9.figshare.20654010.v1.55

Data are available under the terms of the Creative Commons Zero “No rights reserved” data waiver (CC0 1.0 Public domain dedication).

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 14 Sep 2022
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Okesola M, Okesola J, Ogunlana O and Afolabi I. Quality assessment of systematic literature on uterine fibroids: a systematic review [version 2; peer review: 2 approved with reservations]. F1000Research 2024, 11:1050 (https://doi.org/10.12688/f1000research.124879.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 14 Sep 2022
Views
15
Cite
Reviewer Report 18 Oct 2023
Andrea Etrusco, Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (PROMISE), Unit of Gynecologic Oncology, ARNAS "Civico - Di Cristina - Benfratelli",University of Palermo, Palermo, Italy 
Approved with Reservations
VIEWS 15
I read with great interest the Manuscript titled “Quality assessment of systematic literature on uterine fibroids: a systematic review”, which falls within the aim of this Journal.    

In my honest opinion, the topic is interesting enough ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Etrusco A. Reviewer Report For: Quality assessment of systematic literature on uterine fibroids: a systematic review [version 2; peer review: 2 approved with reservations]. F1000Research 2024, 11:1050 (https://doi.org/10.5256/f1000research.137116.r215409)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 13 Apr 2024
    Julius Okesola, Africa Centre of Excellence on Technology Enhanced Learning (ACETEL), National Open University of Nigeria, Abuja, 09, Nigeria
    13 Apr 2024
    Author Response
    1. Manuscript should be further revised by an English language editor:
    The article is now being reviewed by an English Language Editor.
     
    1. Your article should
    ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 13 Apr 2024
    Julius Okesola, Africa Centre of Excellence on Technology Enhanced Learning (ACETEL), National Open University of Nigeria, Abuja, 09, Nigeria
    13 Apr 2024
    Author Response
    1. Manuscript should be further revised by an English language editor:
    The article is now being reviewed by an English Language Editor.
     
    1. Your article should
    ... Continue reading
Views
17
Cite
Reviewer Report 31 Mar 2023
Mary Ann Lumsden, University of Glasgow, Glasgow, Scotland, UK 
Approved with Reservations
VIEWS 17
A systematic review of systematic reviews is an interesting concept and should be helpful.

However, it is always important to remember that all systematic reviews are only as good as the studies included in them and the ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Lumsden MA. Reviewer Report For: Quality assessment of systematic literature on uterine fibroids: a systematic review [version 2; peer review: 2 approved with reservations]. F1000Research 2024, 11:1050 (https://doi.org/10.5256/f1000research.137116.r165452)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 13 Apr 2024
    Julius Okesola, Africa Centre of Excellence on Technology Enhanced Learning (ACETEL), National Open University of Nigeria, Abuja, 09, Nigeria
    13 Apr 2024
    Author Response
    1. … In addition, there is an incorrect reference (No 16 which I think should perhaps be 26.
    Now corrected
     
    1. Overall this is a methodology
    ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 13 Apr 2024
    Julius Okesola, Africa Centre of Excellence on Technology Enhanced Learning (ACETEL), National Open University of Nigeria, Abuja, 09, Nigeria
    13 Apr 2024
    Author Response
    1. … In addition, there is an incorrect reference (No 16 which I think should perhaps be 26.
    Now corrected
     
    1. Overall this is a methodology
    ... Continue reading

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 14 Sep 2022
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.