ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Systematic Review

Identifying the most effective Traditional Chinese Medicine treatment modalities for premature ovarian insufficiency: a systematic review and network meta-analysis

[version 1; peer review: 1 approved with reservations, 1 not approved]
PUBLISHED 27 Apr 2023
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Global Public Health gateway.

Abstract

Background: This study aimed to systematically evaluate and compare the clinical efficacy of different modalities of Traditional Chinese Medicine (TCM) for the treatment of premature ovarian insufficiency (POI) and identify the most effective treatment modality.
Methods: Six electronic databases (PubMed, OVID, Scopus, CNKI, VIP and WanFang) were screened from their inception until 20/01/2022. This network meta-analysis (NMA) incorporated hormone replacement therapy (HRT) as the placebo and six different TCM treatment modalities as interventions. The primary outcome was total effective rate; the secondary outcomes were improvement in serum follicle-stimulating hormone (FSH), estradiol (E2), luteinizing hormone (LH) and anti-Müllerian hormone (AMH) levels. The Cochrane risk of bias tool was used to appraise the quality of the included studies. Random effect model was used for pairwise meta-analysis using RevMan 5.4. NMA was performed in STATA. The surface under the cumulative ranking curves (SUCRA) and mean rank (MR) were used as evaluation indexes.
Results: Overall, 37 randomized clinical trials involving 2,597 subjects that conformed to the inclusion criteria were included. Herbal medicine combined with catgut-embedding therapy was concluded to achieve the highest total effective rate (MD 4.35; 95% CI 1.32, 14.38) and improvement in AMH level (MD 0.74; 95% CI -0.74, 2.22). HRT combined with herbal medicine and acupuncture was determined to be the most effective treatment model for POI in improving their FSH (MD -13.17; 95% CI -18.17, -8.17), E2 (MD 34.29; 95% CI 14.41, 54.18) and LH (MD -15.01; 95% CI -19.95, -10.06) levels.
Conclusions: Combination of HRT, herbal medicine and acupuncture was the most effective treatment modality for patients with POI. We also found that combination of herbal medicine with conventional HRT for patients with POI could effectively improve the clinical effectiveness in all aspects. This result may provide guidance for future treatment guideline implementation for POI.
Registration: PROSPERO (CRD42020163873; 28/04/2020).

Keywords

Premature ovarian insufficiency, Chinese medicine, Acupuncture, Network meta-analysis, Systematic review

Introduction

Premature ovarian insufficiency (POI) is a pathological state of a woman below the age of 40 years suffering from irreversible diminished ovarian function in her reproductive age, it mainly manifests as oligomenorrhoea, hypomenorrhea, amenorrhea, elevated follicle-stimulating hormone (FSH) level (>25 U/L) and short or long term effects of estrogen deficiency.1 The ovarian reserve can be measured by serum anti-Müllerian hormone (AMH) levels. According to the Bologna criteria, a low ovarian reserve is defined as an AMH level below 0.5–1.1 ng/mL (3.6–7.9 pmol/L).2 Review data from 2020 reported that the prevalence of POI is about 10% among women below 40 years old.3 The occurrence of this disease has been increasing among populations living in urban cities. This has captured the attention of public health policy makers and a timely and appropriate preventive measure is urged to be implemented.

Hormone replacement therapy (HRT) is the most recommended medical intervention for patients with POI, referring to the European Society of Human Reproduction and Embryology (ESHRE) and International Menopause Society (IMS) guidelines, as well as the Chinese Medical Experts’ Consensus on Clinical Diagnosis and Treatment of POI, stipulated by the Obstetrics and Gynecology Society of Chinese Medical Association.1,46 However, there are risks of adverse reactions and associated diseases after HRT application.7,8 Hence, patients often seek out complementary medicine to improve their ovarian functions and increase chances of conception.

Various Traditional Chinese Medicine (TCM) treatments such as herbal medicine, acupuncture, moxibustion and catgut-embedding therapy have been applied as the treatment for patients with POI. These treatment modalities have been proven to be effective and safe to improve ovarian functions among patients with POI through numerous clinical trials and direct comparison by using meta-analysis.911 However, there are inadequate direct and indirect comparisons between different TCM treatment modalities that contribute to clinical health promotion and selection of the optimal therapeutic procedure. Therefore, there is a need to systematically evaluate and analyze the efficacy of these alternatives in order to provide a strong theoretical basis and scientific evidence for clinical practice and research. In this study, we compared the efficacy of different TCM treatment modalities for patients with POI by conducting network meta-analysis (NMA) to rank the therapeutic measures in line with their treatment effect through direct and indirect comparisons of the means, with the prospective to provide an evidence-based guidance for future clinical guidelines.

Methods

The study method is compliant with the Cochrane Handbook for Systematic Reviews of Interventions12 and the methods outlined in Lei Zhang et al.13 It followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) extension statement for network meta-analyses (PRISMA-NMA).14,57 It was registered in the International Prospective Systematic Registration Review (PROSPERO) with registration number CRD42020163873 on 28 April 2020.

Search strategy and literature screening

Records identified from six electronic databases, which included three English databases (PubMed (RRID:SCR_004846), OVID, Scopus (RRID:SCR_022559)) and three Chinese databases (CNKI, VIP, WanFang). Reported studies from the inception of each database until 20 January 2022 were screened. Search terms used were a combination of text words and medical subject headings (MeSH), including “Premature Ovarian Insufficiency”, “POI”, “Premature Ovarian Failure” or “Primary Ovarian Insufficiency”. Table 1 shows the search strategy details for each database. Only English and Chinese articles were included. Additionally, the reference lists of all eligible studies were screened to avoid missing eligible studies. The electronic search and literature screening were executed by two researchers (SYS and CM) independently. Any potential disagreement was assessed and discussed with a third reviewer (SKS).

Table 1. Search strategy.

DatabasesSearch term
PubMed(Premature ovarian insufficiency OR primary ovarian insufficiency OR premature ovarian failure OR primary ovarian failure OR ovarian insufficiency OR premature menopause OR premature ovarian dysfunction OR amenorrhoea OR “POI” OR “POF”) AND (Chinese medicine OR herbal medicine OR Chinese herb* OR Chinese drug OR traditional medicine OR alternative medicine OR complementary medicine OR acupuncture OR needling OR acupoint* OR “point, acupuncture” OR electroacupuncture OR warm* needle OR warm needling OR fire needling OR auricular acupressure OR auricular point* OR auricular needle OR ear acupuncture OR acupoint catgut embedding OR acusector OR moxibustion OR cupping OR massage OR tuina)
Article type: Clinical trial OR randomized controlled trial
Publication date: From the beginning until on 20 Jan 2022
Search result: 99 articles
OVID MEDLINE((Premature ovarian insufficiency or primary ovarian insufficiency or premature ovarian failure or primary ovarian failure or ovarian insufficiency or premature menopause or premature ovarian dysfunction or amenorrhoea or POI or POF) AND (Chinese medicine or herbal medicine or Chinese herb* or Chinese drug or traditional medicine or alternative medicine or complementary medicine or acupuncture or needling or acupoint* or electroacupuncture or warm* needle or warm needling or fire needling or auricular acupressure or auricular point* or auricular needle or ear acupuncture or acupoint catgut embedding or acusector or moxibustion or cupping or massage or tuina))
Publication type: Randomized controlled trial
Search result: 22 articles
ScopusALL (((premature AND ovarian AND insufficiency OR primary AND ovarian AND insufficiency OR premature AND ovarian AND failure OR primary AND ovarian AND failure OR ovarian AND insufficiency OR premature AND menopause OR premature AND ovarian AND dysfunction OR amenorrhoea OR poi OR pof) AND (Chinese AND medicine OR herbal AND medicine OR Chinese AND herb* OR Chinese AND drug OR traditional AND medicine OR alternative AND medicine OR complementary AND medicine OR acupuncture OR needling OR acupoint* OR electroacupuncture OR warm* AND needle OR warm AND needling OR fire AND needling OR auricular AND acupressure OR auricular AND point* OR auricular AND needle OR ear AND acupuncture OR acupoint AND catgut AND embedding OR acusector OR moxibustion OR cupping OR massage OR tuina)))
Document type: Clinical trial
Search result: 0 articles
CNKIProfessional search: ((TI=premature ovarian insufficiency OR TI=premature ovarian failure OR TI=premature ovarian diminished OR TI=ovarian insufficiency OR TI=ovarian failure) OR (KY=premature ovarian insufficiency OR KY=premature ovarian failure OR KY=premature ovarian diminished OR KY=ovarian insufficiency OR KY=ovarian failure) OR (AB=premature ovarian insufficiency OR AB=premature ovarian failure OR AB=premature ovarian diminished OR AB=ovarian insufficiency OR AB=ovarian failure)) AND ((TI=Chinese medicine OR TI=herbal medicine OR TI=integrative medicine OR TI=herb OR TI=acupuncture OR TI=moxibustion OR TI=acupoint OR TI=tuina OR TI=catgut-embedding OR TI=cupping) OR (KY=Chinese medicine OR KY=herbal medicine OR KY=integrative medicine OR KY=herb OR KY=acupuncture OR KY=moxibustion OR KY=acupoint OR KY=tuina OR KY=catgut-embedding OR KY=cupping) OR (AB=Chinese medicine OR AB=herbal medicine OR AB=integrative medicine OR AB=herb OR AB=acupuncture OR AB=moxibustion OR AB=acupoint OR AB=tuina OR AB=catgut-embedding OR AB=cupping))
Search result: 1,135 articles
(Note: Search was done in Chinese language.)
WanFang((TITLE=premature ovarian insufficiency OR TITLE=premature ovarian failure OR TITLE=premature ovarian diminished OR TITLE=ovarian insufficiency OR TITLE=ovarian failure) OR (KEYWORDS=premature ovarian insufficiency OR KEYWORDS=premature ovarian failure OR KEYWORDS=premature ovarian diminished OR KEYWORDS=ovarian insufficiency OR KEYWORDS=ovarian failure)) AND ((TITLE=Chinese medicine OR TITLE=herbal medicine OR TITLE=integrative medicine OR TITLE=herbal medicine OR TITLE=acupuncture OR TITLE=moxibustion OR TITLE=acupoint OR TITLE=tuina OR TITLE=catgut-embedding OR TITLE=cupping) OR (KEYWORDS=Chinese medicine OR KEYWORDS=herbal medicine OR KEYWORDS=integrative medicine OR KEYWORDS=herb OR KEYWORDS=acupuncture OR KEYWORDS=moxibustion OR KEYWORDS=acupoint OR KEYWORDS=tuina OR KEYWORDS=catgut-embedding OR KEYWORDS=cupping))
Source: Journal, conference report
Search result: 978 articles
(Note: Search was done in Chinese language.)
VIP(M=(premature ovarian insufficiency OR premature ovarian failure OR premature ovarian diminished OR ovarian insufficiency OR ovarian failure) AND (herbal medicine OR herb OR integrative medicine OR acupuncture OR moxibustion OR acupoint OR tuina OR catgut-embedding OR cupping))
Search result: 368 articles
(Note: Search was done in Chinese language.)

Inclusion criteria

All relevant TCM randomized controlled trials (RCTs) for POI were included according to the inclusion criteria.

Types of participant (P): Patients diagnosed with POI according to the European Society of Human Reproduction and Embryology (ESHRE) guideline1 or “Chinese expert consensus on premature ovarian insufficiency”.4

Types of Intervention (I): The treatment group received TCM treatment modalities, such as herbal medicine, acupuncture, moxibustion and catgut embedding therapy alone or in combination.

Comparisons (C): The control group received HRT or one of the aforementioned TCM treatments.

Outcomes (O):

  • Primary outcome measurement: Total effective rate.

    Total effective rate = (number of recovery cases + number of effective cases + number of efficient cases)/total number of cases × 100%.

    • (i) Recovery: clinical manifestations disappeared, menstrual cycle, serum FSH and E2 levels returned to normal, total effective rate ≥95%;

    • (ii) Effective: clinical manifestations were significantly improved, menstrual cycle, serum FSH and E2 levels were significantly improved, total effective rate ≥70% and <95%;

    • (iii) Efficient: clinical manifestations were slightly improved, menstrual cycle, serum FSH and E2 levels were slightly improved, total effective rate ≥30% and <70%;

    • (iv) Invalid: there was no improvement in clinical signs and symptoms, no improvement in menstrual cycle, no improvement in serum FSH and E2 levels, total effective rate <30%.

  • Secondary outcome measurements: Serum FSH, E2, luteinizing hormone (LH) and AMH levels.

Type of studies (S): RCTs.

Exclusion criteria

Studies were omitted if the studies did not meet the inclusion criteria, for instance animal studies, review articles, case reports, editorials, letters and comments.

Data collection

The name of authors, year of publication, subject age group, course of disease, types of TCM treatment modalities, number of subjects in intervention and comparison groups, were extracted into a spreadsheet. Two researchers (SYS and CM) performed the data extraction individually. In case of any discrepancies, another researcher (SKS) were asked to resolve the discrepancies via discussion.

Literature quality evaluation

The Cochrane risk of bias tool was used to appraise the quality and risk of bias of the included studies. The assessment was done independently by two researchers (SYS and CM).15 In this tool, the random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome reporting, incomplete outcome data, selective reporting, and other items were being evaluated in all the included studies. Low, unclear and high risk of bias were used to evaluate each element. In case of discrepancies, discussion among the researchers (SYS, CM and SKS) were done to resolve it.

Statistical analysis

For pairwise meta-analysis of each intervention pair, a random effect model was used, with RevMan (RRID:SCR_003581) 5.4 (Nordic Cochrane Centre, Cochrane Collaboration, 2020) being employed. Continuous outcomes between intervention groups can be compared by using standard mean differences (SMDs), while dichotomous outcomes can be analyzed using odds ratios (OR). The relative treatment effectiveness between each intervention pair were estimated using 95% confidence intervals.

A NMA was performed in Stata (RRID:SCR_012763) 14.0 (free alternative, RStudio) and the network evidence graph was generated using the ‘netplot’ command. To compare direct and indirect comparisons of each intervention, I2 and P-value of the global consistency were evaluated, and then the node-splitting analysis method was applied to detect inconsistencies. The inconsistency factor within each closed loop of evidence was used to detect inconsistency among studies. The evaluation indexes included surface under the cumulative ranking curves (SUCRA) and mean rank (MR). The SUCRA value reflected the possibility of the intervention measures, and the intervention was considered more effective if the MR was closer to 0. P<0.05 was considered statistically significant.11

To determine if there was a small sample effect or publication bias in the network, a comparison-adjusted funnel plot was used.

Results

Study selection

The selection procedure was recorded in Figure 1 according to the most updated PRISMA 2020 flow diagram for new systematic review.16 A total of 2,602 studies were firstly identified through six databases, including three English databases (PubMed, OVID and Scopus), as well as three Chinese databases (CNKI, VIP and WanFang). Of those, 586 duplicate records were eliminated using EndNote X9 (RRID:SCR_014001) (Clarivate Analytics, USA). By assessing the title and abstract, 1,940 studies were subsequently removed. Full articles of the remaining 76 studies were screened, of which 43 were removed for not reporting relevant outcome data, non-RCT, no full-text access, not relevant to TCM intervention, or intervention only included in one trial, which may lead to small study effects in a NMA. Eventually, 33 RCTs involving 2,597 subjects that conformed to the inclusion criteria were selected into this study and proceed with data extraction and analysis. Among them, all RCTs were Chinese articles. This NMA incorporated HRT as the placebo and six TCM treatment modalities. The characteristics and details of the included 33 RCTs are listed in Table 2.

b543fed7-6388-4bc8-b24b-d11198b719c3_figure1.gif

Figure 1. PRISMA flowchart showing steps in the selection of relevant trials.

Note: RCT, randomized controlled trials.

Table 2. Characteristics and details of the included 33 RCTs.

Author name, year (ref.)Admission timeSample size (T/C)Mean age/course of disease (T/C)Intervention groupControl groupOutcome
Xie Q 202224From Jan 2019 to Jan 202157/5728.41±5.16/28.75±5.33HRT + Herbal Medicine + AcupunctureHRT①②③④
Peng YL 202225From Jan 2019 to Dec 202046/4628.54±3.66/28.21±3.85Herbal Medicine + AcupunctureHerbal Medicine①②③④
Huang YS 202126From Mar 2018 to Mar 202030/3031.43±4.48/30.80±5.12Acupuncture + MoxibustionHRT①②③⑤
Chen JM 202127From May 2019 to Jan 202050/3030.19±6.55/31.65±7.55Herbal MedicineHRT①②③⑤
Yuan F 202128From Dec 2018 to Jun 202042/4236.05±3.48/35.65±3.51HRT + Herbal MedicineHRT①②③④
Chen L 202129From May 2017 to May 201935/3538.97±5.52/38.80±4.96HRT + Herbal MedicineHRT①②
Sui J 202130From Oct 2017 to Jan 201960/6232.45±0.93/34.61±0.61Herbal MedicineHRT①②③④⑤
Wang XW 202131From Jul 2019 to Jun 202025/2536.40±1.10/36.50±1.00Herbal MedicineHRT①②③④
Wang YY 202132From Mar 2018 to Mar 202026/2630.22±4.31/30.15±4.23Herbal Medicine + AcupunctureHRT①②③④
Tang HX 202133From Oct 2019 to Oct 202040/4031.63±3.46/32.57±3.60Herbal MedicineHRT①②③④⑤
Lin LL 202134From Jan 2018 to Jan 202020/2033.98±2.08/33.70±2.13Herbal Medicine + Cat-gut Embedding TherapyHRT①②③
Zhang H 202135From Jan 2019 to Mar 202060/6035.21±2.35/35.17±2.26HRT + Herbal MedicineHRT①②③④⑤
Hou M 202136From Nov 2019 to Oct 202030/3035.00±8.26/36.00±3.57AcupunctureHRT①②③
Wu Q 202137From Mar 2019 to Oct 201930/3031.57±5.04/31.63±4.54HRT + Herbal MedicineHRT①②③④⑤
Fu WJ 202138From Sep 2019 to Nov 202030/3036.43±2.18/35.29±2.43HRT + Herbal MedicineHRT①②③④
Ding AY 202139From Mar 2019 to Nov 201940/4035.40±2.50/35.10±2.80HRT + Herbal MedicineHRT①②③
Ma QW 202040From Sep 2017 to Jan 201960/6031.10±4.30/31.80±4.50HRT + Herbal MedicineHRT①②③④
Zhao JM 202041From Aug 2017 to Dec 201852/5231.17±3.69/31.62±3.75HRT + Herbal MedicineHRT①②③④
Luo C 202042From Mar 2017 to Jan 201930/3035.07±2.09/35.27±3.25Herbal MedicineHRT①②③④⑤
Wang TT 202043From Mar 2019 to Aug 202030/3032.45±4.15/32.44±4.12Herbal Medicine + AcupunctureHerbal Medicine
Chi L 202044From Jun 2017 to Mar 201951/5429.02±3.00/30.18±3.20Herbal MedicineHRT①②③⑤
Liu X 202045From May 2017 to Oct 201835/3531.55±3.16/30.81±3.25HRT + Herbal MedicineHRT
Ma K 201946From Oct 2016 to Sep 201843/4333.81±3.70/32.86±3.96Herbal MedicineHRT①②③④⑤
Zhong WP 201947From Jun 2016 to Dec 201720/2036.00±2.02/36.20±1.94Herbal MedicineHRT①②③④
Yuan YJ 201948From Aug 2016 to Nov 201845/4533.18±4.46/32.46±5.45Herbal MedicineHRT
Li J 201949From Apr 2017 to Apr 201844/4432.47±4.11/32.45±4.13HRT + Herbal MedicineHRT①②③④⑤
Zhang N 201950From Dec 2016 to Jun 201845/4528.20±4.60/30.20±4.10HRT + Herbal Medicine + AcupunctureHRT + Herbal Medicine①②③④
Zhou QY 201851From Dec 2017 to May 201830/3035.70±2.20/35.40±2.50HRT + Herbal MedicineHRT①②③
Li Xia 201852From Mar 2015 to Jul 201830/3022.40±9.08/25.71±7.12Herbal Medicine + AcupunctureHRT①②③④
Li Xiao 201853From Feb 2015 to Dec 201640/4031.81±4.29/31.78±4.26Herbal MedicineHRT①②③④
Yao L 200754From Jan 1988 to Dec 2003130/13036.00±2.09/30.80±5.40Herbal MedicineHRT①②③④
Cui LL 202255From Sep 2018 to Jan 202039/3836.00±6.00/37.00±6.00Herbal Medicine + Cat-gut Embedding TherapyHerbal Medicine①②③④⑤
Zeng X 202156From Dec 2019 to Jul 202048/4832.60±3.90/33.20±3.90HRT + Herbal MedicineHRT①②③

Risk of bias of the included studies

For the random sequence generation element, 21 studies reported an appropriate method for randomization, thus “low risk”. There were two studies allocated participants to interventions based on participants’ preference and hospital record number therefore “high risk”. The rest only reported random, so it is “unclear”.

In terms of allocation concealment, 30 studies were judged as having “high risk” of bias as there were inadequate concealment of allocations prior to assignment. Only one study reported clear allocation concealment by using sequentially numbered, opaque and sealed envelope, therefore it was judged as “low risk”. There were two studies reported using assignment envelopes but sufficient details such as whether the envelopes were sequentially numbered, opaque and sealed were not mentioned, thus “unclear”.

In terms of blinding of participants and personnel, only one study was stated as single-blinded design but did not address the outcome, therefore “unclear”. The rest of the studies were judged as “high risk” as there were no blinding and due to different treatment modalities, participants might have the wrong belief that the intervention was more effective for their treatment.

In terms of outcome assessment, all studies were judged as “unclear” due to inadequate information for evaluation. In terms of incomplete outcome data, only one study was judged as “high risk” of bias as there were missing outcome data across the intervention groups. The rest were “low risk”. In terms of selective reporting, only one study was judged as “high risk” of bias due to incomplete outcome of interest in the study. The rest were “low risk”. In terms of other bias, all studies were “low risk” except two, in which there were incorrect reported data and discrepancies found in the studies. The graph and summary of the risk of bias are listed in Figure 2.

b543fed7-6388-4bc8-b24b-d11198b719c3_figure2.gif

Figure 2. Graph and summary of the risk of bias.

Risk of bias A) graph and B) summary.

Results of NMA

Pairwise meta-analysis

Table 3 presents the results of the pairwise meta-analysis and heterogeneity estimates. All 33 studies reported total effective rate, 30 reported FSH, 29 reported E2, 20 reported LH and 13 reported AMH.

Table 3. Pairwise meta-analysis.

Outcome measurementComparisonNOR (95%CI)PI2 (%)
Total Effective RateG vs. A23.42 [1.02, 11.46]0.050
D vs. A112.34 [1.46, 3.76]*0.000438
E vs. A22.43 [0.16, 36.61]0.5280
F vs. A110.32 [1.12, 93.34]*0.04N/A
B vs. A143.74 [2.61, 5.35]*<0.00010
C vs. A15.17 [1.61, 16.64]*0.006N/A
C vs. B11.54 [0.24, 9.66]0.65N/A
E vs. D29.22 [2.02, 42.03]*0.0040
F vs. D14.04 [1.17, 13.96]*0.03N/A
Outcome measurementComparisonNSMD (95%CI)PI2 (%)
FSHG vs. A23.70 [2.18, 5.23]*<0.000010
D vs. A92.68 [0.48, 4.88]*0.0279
E vs. A23.29 [0.51, 6.07]*0.0257
F vs. A14.24 [-0.53, 9.01]0.08N/A
B vs. A134.82 [3.61, 6.02]*<0.0000183
C vs. A112.00 [8.43, 15.57]*<0.00001N/A
C vs. B110.20 [4.96, 15.44]*0.0001N/A
F vs. D11.38 [-0.11, 2.87]0.07N/A
E2G vs. A2-11.97 [-45.01, 21.08]0.4894
D vs. A98.52 [0.53, 16.51]*0.0496
E vs. A215.04 [1.06, 29.01]*0.0371
F vs. A18.56 [3.44, 13.68]*0.001N/A
B vs. A129.09 [5.49, 12.70]*<0.0000196
C vs. A128.43 [25.92, 30.94]*<0.00001N/A
C vs. B113.20 [9.06, 17.34]*<0.00001N/A
F vs. D122.89 [20.44, 25.34]*<0.00001N/A
LHD vs. A71.36 [0.36, 2.36]*0.00826
E vs. A20.87 [0.14, 1.61]*0.020
B vs. A85.20 [2.51, 7.88]*0.000192
C vs. A118.10 [15.75, 20.45]*<0.00001N/A
C vs. B15.90 [1.57, 10.23]*0.008N/A
F vs. D11.57 [1.12, 2.02]*<0.00001N/A
AMHG vs. A10.09 [-0.12, 0.30]0.39N/A
D vs. A60.68 [0.22, 1.14]*0.00499
B vs. A50.54 [-0.04, 1.13]0.0799
F vs. D10.15 [0.02, 0.28]*0.03N/A

The forest plot of total effective rate indicates that herbal medicine (OR 2.34, 1.46 to 3.76, I2=38%) and HRT + herbal medicine (OR 3.74, 2.61 to 5.35, I2=0%) were more effective than HRT alone. Herbal medicine and acupuncture (OR 9.22, 2.02 to 42.03, I2=0%) was more effective than herbal medicine alone.

The forest plot of FSH indicates that acupuncture + moxibustion (MD 3.70, 2.18 to 5.23, I2=0%), herbal medicine (MD 2.68, 0.48 to 4.88, I2=79%), herbal medicine + acupuncture (MD 3.29, 0.51 to 6.07, I2=57%) and HRT + herbal medicine (MD 4.82, 3.61 to 6.02, I2=83%) were more effective in improving FSH levels compared to HRT alone.

The forest plot of E2 indicates that all treatment modalities involved herbal medicine, including HRT + herbal medicine (MD 9.09, 5.49 to 12.70, I2=96%), HRT + herbal medicine + acupuncture (MD 28.43, 25.92 to 30.94, I2=n/a), herbal medicine (MD 8.52, 0.53 to 16.51, I2=96) and herbal medicine + acupuncture (MD 15.04, 1.06 to 29.01, I2=71%) showed higher effectiveness than HRT alone to improve E2 levels among patients with POI.

The forest plot of LH indicates that therapeutic effects of HRT + herbal medicine (MD 5.20, 2.51 to 7.88, I2=92%), herbal medicine (MD 1.36, 0.36 to 2.36, I2=26%) and herbal medicine + acupuncture (MD 0.87, 0.14 to 1.61, I2=0%) were more superior than HRT alone.

The forest plot of AMH indicates that herbal medicine (MD 0.68, 0.22 to 1.14, I2=99%) showed better efficacy compared to only HRT in improving AMH levels.

NMA on total effective rate

The results of the NMA showing comparisons of different treatments based on total effective rate are shown in Figure 3A. The total effective rate are presented in the form of a league table can be found in Figure 4A. A total of 33 RCTs (2,862 participants) with seven different treatment modalities were analyzed. The results of NMA indicate that herbal medicine combined with catgut-embedding therapy have the highest efficiency. According to the SUCRA, which presents treatment ranking to offer the most important benefit outcome (the highest total effective rate), herbal medicine combined with catgut-embedding therapy (87.8%) had the highest effective rate, followed by combination of HRT with herbal medicine and acupuncture (76.8%), HRT combined with herbal medicine (67.1%), acupuncture combined with moxibustion (63.1%), herbal medicine combined with acupuncture (27.3%), HRT alone (16.1%) and herbal medicine only (11.9%). This also showed that combination of TCM treatments with HRT are more effective than HRT alone. Table 4 (part A) and Figure 5A depict the rankings of these seven treatments.

b543fed7-6388-4bc8-b24b-d11198b719c3_figure3.gif

Figure 3. Network map results of treatment comparisons based on total effective rate, serum FSH, E2, LH and AMH levels.

A) Total effective rate. B) FSH, C) E2, D) LH and E) AMH levels. Note: FSH, follicle-stimulating hormone; E2, estradiol; LH, luteinizing hormone; AMH, anti-Müllerian hormone; HRT, hormone replacement therapy; Herb, herbal medicine; Catgut, catgut-embedding therapy; Acu, acupuncture; Moxa, moxibustion.

b543fed7-6388-4bc8-b24b-d11198b719c3_figure4.gif

Figure 4. League table showing the results of network meta-analysis comparisons based on total effective rates, serum FSH, E2, LH and AMH levels of all TCM treatment modalities including odds ratios (OR) and 95% credible intervals.

A) Total effective rate. B) FSH, C) E2, D) LH and E) AMH levels. OR>1 means the top-left treatment is better. Note: FSH, follicle-stimulating hormone; E2, estradiol; LH, luteinizing hormone; AMH, anti-Müllerian hormone; TCM, Traditional Chinese medicine; HRT, hormone replacement therapy; Herb, herbal medicine; Catgut, catgut-embedding therapy; Acu, acupuncture; Moxa, moxibustion.

Table 4. SUCRA ranking probabilities of all TCM treatment modalities for POI based on total effective rate.

TreatmentSUCRAPrBestMeanRank

  • A. Total effective rate

HRT16.10.06.0
HRT + Herb67.13.93.0
HRT + Herb + Acu76.821.42.4
Herb11.90.06.3
Herb + Acu27.30.15.4
Herb + Catgut87.866.21.7
Acu + Moxa63.18.53.2

  • B. FSH

HRT5.80.06.7
HRT + Herb67.40.03.0
HRT + Herb + Acu99.999.51.0
Herb23.10.05.6
Herb + Acu49.60.14.0
Herb + Catgut49.30.24.0
Acu + Moxa54.90.13.7

  • C. E2

HRT15.10.06.1
HRT + Herb51.60.03.9
HRT + Herb + Acu92.666.41.4
Herb40.80.04.6
Herb + Acu66.710.33.0
Herb + Catgut80.123.32.2
Acu + Moxa3.20.06.8

  • D. LH

HRT12.30.05.4
HRT + Herb71.00.02.4
HRT + Herb + Acu99.999.71.0
Herb40.40.04.0
Herb + Acu22.30.04.9
Herb + Catgut53.90.33.3

  • E. AMH

HRT16.70.04.3
HRT + Herb66.724.12.3
Herb65.816.52.4
Herb + Catgut67.245.52.3
Acu + Moxa33.613.93.7
b543fed7-6388-4bc8-b24b-d11198b719c3_figure5.gif

Figure 5. SUCRA ranking probabilities of total effective rate, serum FSH, E2, LH and AMH levels among all TCM treatment modalities.

A) Total effective rate. B) FSH, C) E2, D) LH and E) AMH levels. Note: SUCRA, surface under the cumulative ranking curves; FSH, follicle-stimulating hormone; E2, estradiol; LH, luteinizing hormone; AMH, anti-Müllerian hormone; TCM, Traditional Chinese medicine; HRT, hormone replacement therapy; Herb, herbal medicine; Catgut, catgut-embedding therapy; Acu, acupuncture; Moxa, moxibustion.

NMA on FSH levels

The results of the NMA showing comparisons of different treatments based on improvements of FSH levels are shown in Figure 3B. The league table results of the NMA on FSH levels are presented in Figure 4B. A total of 28 RCTs (2,384 participants) with seven different treatment modalities were analyzed. The results of NMA indicate that the combination of HRT with herbal medicine and acupuncture achieved the highest efficiency in improving the FSH levels. According to SUCRA, the combination of HRT with herbal medicine and acupuncture (99.9%) had the highest effective rate, followed by HRT combined with herbal medicine (67.4%), acupuncture combined with moxibustion (54.9%), herbal medicine combined with acupuncture (49.6%), herbal medicine combined with catgut-embedding therapy (49.3%), herb alone (23.1%) and HRT only (5.8%). Table 4 (part B) and Figure 5B depict the rankings of these seven treatments.

NMA on E2 levels

The results of the NMA showing comparisons of different treatments for the changes of E2 levels are shown in Figure 3C. The league table results for the E2 comparison are shown in Figure 4C. A total of 26 RCTs (2,108 participants) with seven different treatment modalities were analyzed. The results of NMA indicate that the combination of HRT with herbal medicine and acupuncture had the highest efficiency. It was also found that the combination of different treatment modalities pairing with herbal medicine were more effective than HRT alone. According to SUCRA, the combination of HRT with herbal medicine and acupuncture (92.6%) had the highest effective rate, followed by herbal medicine combined with catgut-embedding therapy (80.1%), herbal medicine combined with acupuncture (66.7%), HRT combined with herbal medicine (51.6%), herbal medicine alone (40.8%), HRT alone (15.1%) and acupuncture combined with moxibustion (3.2%). Table 4 (part C) and Figure 5C depict the rankings of these seven treatments.

NMA on LH levels

The results of the NMA showing treatment comparisons based on the difference of LH levels are shown in Figure 3D. The league table results of the NMA for LH levels are shown in Figure 4D. A total of 19 RCTs (1,505 participants) with six different treatment modalities were analyzed. The results of NMA indicate that the combination of HRT with herbal medicine and acupuncture have the highest efficacy. It was also discovered that treatment modalities combined with herbal medicine are more useful than HRT alone. According to SUCRA, the combination of HRT with herbal medicine and acupuncture (99.9%) had the highest effective rate, followed by HRT combined with herbal medicine (71.0%), herbal medicine combined with catgut-embedding therapy (53.9%), herbal medicine alone (40.4%), herbal medicine combined with acupuncture (22.3%) and HRT alone (12.3%). Table 4 (part D) and Figure 5D presents the ranking of these six treatments.

NMA on AMH levels

The results of the NMA showing treatment comparisons based on the improvement of AMH levels in five treatment modalities are shown in Figure 3E. The league table results regarding the comparison of the AMH levels are presented in Figure 4E. A total of 11 RCTs with reported AMH levels (1,030 participants) were analyzed. The results of NMA indicate that herbal medicine combined with catgut-embedding therapy had the highest efficiency and treatment modalities with the presence of herbal medicine are more effective compared to treatment without herbal medicine. According to SUCRA, herbal medicine combined with catgut-embedding therapy (67.2%) had the highest effective rate, followed by HRT combined with herbal medicine (66.7%), herbal medicine alone (65.8%), acupuncture combined with moxibustion (33.6%) and HRT alone (16.7%). Table 4 (part E) and Figure 5E depict the rankings of these five treatments.

Evaluation of statistical inconsistency

Although global inconsistency showed there that were no significant statistical differences for the outcomes, the node-splitting method was employed to further evaluate on the local inconsistency (Table 5). Overall, no statistical inconsistency for the outcomes were seen from the node-splitting outcome, except between direct and indirect comparisons of HRT with combination of HRT and herbal medicine, HRT with herbal medicine, HRT with combination of herbal medicine and acupuncture, herbal medicine with combination of HRT and herbal medicine, herbal medicine with combination of herbal medicine and acupuncture, as P<0.05 indicates for local inconsistency between the local comparisons. These might be due to ineffective sample size for the particular treatment comparisons.

Table 5. Side-splitting approach of total effective rate, serum FSH, E2, LH and AMH levels.

SideDirectIndirectDifferenceP>|z|
Coef.Std.ErrCoef.Std.ErrCoef.Std.Err

  • A. Total effective rate

AB1.3020180.18691132.6940490.6192193-1.3920310.63085630.027
AC1.6430140.68904541.8396271.020893-0.19661321.2316680.873
AD0.77365070.2225935-0.59229280.60840461.3659430.64407990.034
AE0.27454740.53149912.9250950.8082094-2.6505480.95687430.006
AF2.32541.1773032.0428710.74806810.28252861.3948650.839
AG-------
BC0.42900220.99971190.23232670.71943750.19667551.2316710.873
BD-1.5610140.4246506-0.40120630.3030283-1.1598070.51891970.025
DE2.2215810.7822485-0.42900570.5510822.6505870.95686550.006
DF1.3958810.71693631.6781981.196491-0.28231711.3948370.840

  • B. FSH

AB-4.385776.8296878-7.0198133.3603632.6340383.4632640.447
AC-123.379563-14.808313.9888232.8083125.2280160.591
AD-1.3306551.152858.46468953.094725-1.7953443.3018720.587
AE-------
AF-4.243.754363-2.3976743.16034-1.8423254.9074430.707
AG-------
BC-10.199993.902824-7.39093.478562-2.8090935.2280430.591
BD5.8761251.9979192.041321.5188853.8348062.5095280.126
DF-1.3799842.959344-3.2198933.9146741.8399094.9073890.708

  • C. E2

AB9.0923832.72133220.201919.597002-11.109539.9753170.265
AC28.439.62147422.8934210.148435.53657913.98440.692
AD8.6216673.561098-1.6524349.29464210.27419.9530240.302
AE-------
AF8.5600019.16899531.612039.457669-23.0520313.172620.080
AG-------
BC13.200079.76726518.719510.00883-5.51943413.984840.693
BD-5.4151766.761988-1.0627845.045681-4.3523938.4371780.606
DF22.890078.877762-0.2071729.73327123.0972413.173860.080

  • D. LH

AB-4.6324611.104242-12.197754.8077647.5652934.9329530.125
AC-18.13.135893-10.53183.808109-7.5682034.9331040.125
AD-2.0898321.3926770.795194931.73015-2.88502731.76070.928
AE-------
BC-5.8998713.644604-13.467063.324617.5671944.933180.125
DF-1.573.0609844.20005463.4475-5.77005463.521320.928

  • E. AMH

AB0.54476310.3262561.2278861.155475-0.68312281.2003930.569
AC0.684820.2711292-0.97168261.1055241.65655031.1381730.146
AE-------
BC-0.40666920.48283130.46810920.5217627-0.87477840.71087890.218
CD0.150.7004296-1.1870218.804011.3370218.817040.943

Small-study effects

There was a lack of strong evidence on the small-study effects across outcomes based on total effective rate and FSH level (Figure 6A and B).

b543fed7-6388-4bc8-b24b-d11198b719c3_figure6.gif

Figure 6. Funnel plot of total effective rate, serum FSH, E2, LH and AMH levels.

A) Total effective rate. B) FSH, C) E2, D) LH and E) AMH levels. Note: FSH, follicle-stimulating hormone; E2, estradiol; LH, luteinizing hormone; AMH, anti-Müllerian hormone.

However, among the outcome indicators of E2, LH and AMH (Figure 6C, D and E), it could be inferred that heterogeneity between studies were one of the reasons for those studies located on the lateral side of the funnel plot. Comparison-correction funnel plots based on E2, LH and AMH levels were made upon 26, 19 and 11 included studies, respectively (involving seven, six and five interventions, respectively). The asymmetrical funnel plots suggest probability of small-study effects in this study.

Sensitivity analysis

For the paired studies with significant heterogeneity (I2 > 50%), a sensitivity analysis was done by removing any single study one by one. Results showed that there were no significant changes, stipulating that the pooled results were consistent.

Discussion

Previous studies9,10,17 have demonstrated the efficacy of herbal medicine and acupuncture in treating POI. In this study, we utilized the advantages of NMA method to compare the efficacy of various TCM treatment modalities for this condition. Our findings revealed the comparative efficacy of six treatment modalities: HRT combined with herbal medicine and acupuncture, HRT combined with herbal medicine, herbal medicine combined with acupuncture, herbal medicine combined with catgut-embedding therapy, acupuncture combined with moxibustion and herbal medicine alone. Table 6 shows the compilation of SUCRA rank for each outcome measurement in NMA. Our results indicated that the combination of HRT with herbal medicine and acupuncture was the most effective treatment modality for patients with POI in the present study. These findings suggest that TCM treatment approaches could be considered as a promising therapeutic option for women with POI.

Table 6. Compilation of SUCRA Rank for each outcome measurement in NMA.

SUCRA RankOutcome measurement
Total effective rateFSHE2LHAMH
1Herb + CatgutHRT + Herb + AcuHRT + Herb + AcuHRT + Herb + AcuHerb + Catgut
2HRT + Herb + AcuHRT + HerbHerb + CatgutHRT + HerbHRT + Herb
3HRT + HerbAcu + MoxaHerb + AcuHerb + CatgutHerb
4Acu + MoxaHerb + AcuHRT + HerbHerbAcu + Moxa
5Herb + AcuHerb + CatgutHerbHerb + AcuHRT
6HRTHerbHRTHRT
7HerbHRTAcu + Moxa

To the best of our knowledge, this study is the first systematic evaluation covering all treatment modalities in TCM to provide reliable evidence to determine the efficacy and feasibility of TCM treatment for patients with POI. There are a variety of different treatment modalities in TCM and all seem effective in treatment.11,18 However, until now there have been no consensus or standard procedure of TCM treatment recommended for POI. This scientific direct and indirect comparison can provide important guidance on the pros and cons of each intervention and their treatment priority.

There is no record about POI found in the TCM literature. However, comparing its clinical manifestations, POI can be categorized as “amenorrhoea”, “oligomenorrhoea” and “infertility” based on TCM perspective. The pathogenesis is mainly related to malnourishment of the thoroughfare and conception vessels, as well as the uterus, which might be due to congenital insufficiency, physical and mental overwork, or sexual overstrain. TCM treats a disease based on syndrome differentiation. Different treatment modalities such as oral administration of herbal decoction, acupuncture, catgut-embedding therapy, moxibustion, electroacupuncture, ear acupressure and herbal enema, are suitable for the treatment of POI. In our study, 33 clinical trials using TCM treatment were screened and the therapeutic effect of seven treatment modalities were analyzed. It has been proven that comprehensive treatment models are more effective in improving ovarian function, compared to just using HRT as sole treatment. This would provide clinical practitioners with strong and reliable evidence, as well as a useful alternative during clinical decision-making.

We also found that the integration of herbal medicine into POI treatment, such as its combination with HRT, acupuncture or catgut-embedding therapy, can significantly improve the ovarian functions by observing on indicators including total effective rate, FSH, E2, LH and AMH levels. Therefore, herbal medicine may be considered as an intervention when HRT alone, the standard procedure recommended by recognized guidelines worldwide,1,4,5 cannot effectively cure POI. This study possesses significance in providing clinical guidance.

Acupuncture has been widely applied on POI treatment particularly in China.10,11,18 It has been demonstrated that acupuncture is safe and effective.1921 Through early intervention of acupuncture, it has also been found that acupuncture can increase pregnancy rate significantly.22,23 Our study has demonstrated that application of acupuncture in the treatment of POI is also useful to observe clinical improvement. However, it is suggested that acupuncture must be combined with herbal medicine and even HRT in order to optimize the therapeutic effects. This recommended treatment modality not only demonstrates the advantage of TCM treatment, it also provides a potential practical, safe and low-cost treatment option for both the patients and clinicians.

In this study, we found a shortage of rigorous clinical trials adhering to the international requirements, as well as a paucity of heterogeneity of study candidates, interventions, controls, and outcome measures, which challenge the process of systematic review and NMA. Due to inadequate data from the included studies, the safety of each intervention could not be evaluated. The risk of bias assessment in this study indicates that most of the studies did not clearly state the blinding of outcome assessors, which might impact on the reliability of data analysis outcome.

Conclusions

In conclusion, herbal medicine combined with catgut-embedding therapy was shown to be the most effective treatment model to improve total effective rate and AMH levels in the present study. The combination of HRT, herbal medicine and acupuncture was demonstrated to be the most effective treatment model for improving serum FSH, E2 and LH levels. An overview on SUCRA analysis outcomes showed that comprehensive treatment models with the integration of herbal medicine seemed more prone to improve ovarian functions. Monotherapies, such as solely using HRT or herbal medicine treatment, were found to have no obvious advantages on their curative effect for POI. The integration of herbal medicine to conventional HRT may be a favorable approach for enhancing the clinical utility of HRT in the management of POI. RCTs involving multiple centers and different countries are essential to further verify the conclusions of this study, which can also create international awareness on the efficacy of TCM treatments for POI.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 27 Apr 2023
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Sin YS, Chen M, Sng KS and Zhang J. Identifying the most effective Traditional Chinese Medicine treatment modalities for premature ovarian insufficiency: a systematic review and network meta-analysis [version 1; peer review: 1 approved with reservations, 1 not approved]. F1000Research 2023, 12:450 (https://doi.org/10.12688/f1000research.132981.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 27 Apr 2023
Views
6
Cite
Reviewer Report 04 Jun 2024
Cristina Laguna Benetti-Pinto, Department of Obstetrics and Gynecology, Universidade Estadual de Campinas, Campinas, State of São Paulo, Brazil 
Not Approved
VIEWS 6
I reviewed the manuscript “Identifying the most effective Traditional Chinese Medicine treatment modalities for premature ovarian insufficiency: a
systematic review and network meta-analysis” . The authors aimed to evaluate and compare the clinical efficacy of different modalities of Traditional ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Laguna Benetti-Pinto C. Reviewer Report For: Identifying the most effective Traditional Chinese Medicine treatment modalities for premature ovarian insufficiency: a systematic review and network meta-analysis [version 1; peer review: 1 approved with reservations, 1 not approved]. F1000Research 2023, 12:450 (https://doi.org/10.5256/f1000research.145942.r266528)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
14
Cite
Reviewer Report 01 Sep 2023
Muhammad Shahzad Aslam, School of Traditional Chinese Medicine, Xiamen University Malaysia, Sepang, Malaysia 
Approved with Reservations
VIEWS 14
  1. According to authors: Acupuncture has been widely applied on POI treatment particularly in China.10,11,18 It has been demonstrated that acupuncture is safe and effective.1921 I suggest to broaden the discussion in context to use of Acupuncture in Malaysia, US. We
... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Aslam MS. Reviewer Report For: Identifying the most effective Traditional Chinese Medicine treatment modalities for premature ovarian insufficiency: a systematic review and network meta-analysis [version 1; peer review: 1 approved with reservations, 1 not approved]. F1000Research 2023, 12:450 (https://doi.org/10.5256/f1000research.145942.r196644)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 27 Apr 2023
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.