ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

Protocol for a systematic review and meta-analysis on preoperative risk factors for failure after fixed sling implantation for post-prostatectomy stress urinary incontinence

[version 1; peer review: 1 approved with reservations]
PUBLISHED 06 Jan 2023
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Background: Post-prostatectomy urinary incontinence (PPI) is a bothersome complication affecting patients undergoing prostate surgery that in up 10% of cases will require an invasive treatment with fixed slings or artificial urinary sphincters (AUS). Although fixed slings have several advantages over AUS, failure rates after slings range between 15% and 45% while current knowledge of predictors of sling efficacy remains limited. By systematically combining and summarizing all relevant literature, the present review and meta-analysis aim to address this research need assessing the association between preoperative risk factors and sling failure.
Methods: Studies pertaining to fixed synthetic male perineal slings as treatment for adult male suffering from PPI, will be included. A systematic search will be conducted in PubMED, Scopus, Web of Science and Cochrane databases, and in the reference lists of retrieved articles. Independent reviewers will conduct study selection and data extraction. Outcomes will include failure to achieve the continence cure and overall success (cure plus improvement), measured as per included studies. Exposures will include any preoperative variables evaluated for association with sling failure. The QUIPS tool will be used for study quality assessment and a random-effects DerSimonian-Laird model, with Hartung-Knapp adjustment, will be used to pool adjusted and unadjusted odds ratios separately. Sensitivity analysis will be performed using the leave-one-out methodology and subgroup meta-analyses based on pre-specified studies’ characteristics will be conducted to explain the heterogeneity. Certainty of evidence will be assessed according to GRADE methodology and review reporting will comply with the PRISMA-P statement.
Discussion: By summarising all relevant literature in the field, our results will help to incorporate available evidence into clinical practice assisting healthcare professionals managing PPI patients in treatment decision-making. The present review will also provide researchers with the necessary, evidence-based groundwork to perform future high-quality prognostic studies in the field.
Registration: CRD42022307160.

Keywords

urinary incontinence, male, meta-analysis, prostatectomy, protocol, sling, systematic review

Introduction

Male stress urinary incontinence is mostly of iatrogenic origin. In particular, post-prostatectomy urinary incontinence (PPI) is a bothersome complication of prostate surgery, resulting in deleterious impact on patients’ quality of life.1,2

Most patients undergoing radical prostatectomy suffer from some degree of urinary leakage in the early postoperative period, and about 25% still require at least wearing one pad per day after one year, with little improvement afterward.3,4 In the Europa Uomo Patient Reported Outcome Study (EUPROMS), a cross-sectional survey conducted among 2943 prostate cancer patients currently receiving or having received treatment, 37% of all patients was using at least one pad per day because of urinary incontinence that was reported to be a moderate-to-big problem in 20% of post-prostatectomy patients.5

Approximately 5-10% of patients with PPI are refractory to conservative treatments and will require a surgical therapy.6 Fixed slings and artificial urinary sphincters (AUS) are the currently most used and recommended surgical options for PPI7 Because of highly predictable efficacy, high patient satisfaction rates, durability and several decades of use and research, AUS is considered the gold standard treatment of PPI despite being an expensive mechanical device associated with non-negligible complications and reoperations rates.8,9 Several types of slings are currently available that differ in materials, design, size, mechanism of action and technique of implantation.10 Advantages of male slings are the non-mechanical nature, immediate post-operative results, lower cost and lower rate of severe complications than AUS.8 However, failure rates after slings placement range between 15% and 45% while current knowledge of predictors of sling efficacy remains limited.1

Protocol

Rational and research aim

While several systematic reviews and meta-analyses exist on the benefits and complications associated to male slings, to our knowledge no studies have systematically reviewed and meta-analysed predictors of slings failure. By systematically combining and summarizing all relevant literature, the current review and meta-analysis aim to address this research need assessing the association between preoperative risk factors and failure of fixed perineal synthetic male slings as treatment for adult male suffering from PPI, assessing the magnitude of these associations, determining the certainty in the cumulative evidence, and identifying gaps in knowledge. By helping to incorporate all available evidence into clinical practice, our results will assist healthcare professionals in patients’ selection and counselling.

Methods

Review question

The review question was defined according to the PICOTS system as proposed by the CHARMS checklist and subsequent improvement (Table 1).11,12

Table 1. PICOTS criteria.

PopulationAdult males (aged ≥18 years) diagnosed with stress or stress-prevalent PPI
Index prognostic factorPelvic irradiation and incontinence severity
Comparator prognostic factorsAll other potential prognostic factors
OutcomesTreatment failure (failure to achieve cure and failure to achieve at least an improvement).
TimingAll prognostic factors must be assessed preoperatively to predict the outcome over a postoperative period of at least six months
SettingIncontinent males implanted with fixed (nonadjustable) synthetic perineal slings; the results may be useful for healthcare professionals treating and managing such patients

Registration and reporting

The protocol for the current review has been registered on PROSPERO of the Center for the Reviews and Dissemination (CRD) (registration number: CRD42022307160). We followed the recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for the development and reporting of this systematic review protocol (see Extended data for PRISMA-P checklist)13,14 and will adhere to the PRISMA 2020 principles15 during the process of conducting and reporting this review. In performing this review we will follow the Cochrane handbook for systematic reviews of interventions,16 the recommendations of the Cochrane Prognosis Methods Group1719 and other guidance20 for specifically conducting systematic reviews and meta-analyses of prognostic studies.

Search strategy

Systematic searches will be performed for all citations published in the following electronic databases from their inception: PubMed platform in MEDLINE, Web Of Science, SCOPUS and Cochrane CENTRAL Register of Controlled Trials. Therefore, the searches will not be limited by historical time-constraints.

Search terms and sequential strategies used in the search algorithms are displayed in Table 2. Furthermore, a scrupulous manual search will be performed in the reference lists of retrieved articles and reviews for potentially additional eligible studies.

Table 2.

Electronic search strategy.

#Searches SCOPUS
1TITLE-ABS-KEY (male AND sling)
2(TITLE-ABS-KEY (male AND sling AND incontinence) OR TITLE-ABS-KEY (advance AND sling) OR TITLE-ABS-KEY (advancexp) OR TITLE-ABS-KEY (virtue AND sling) OR TITLE-ABS-KEY (tiloop AND sling) OR TITLE-ABS-KEY (invance) OR TITLE-ABS-KEY (bams AND sling) OR TITLE-ABS-KEY (istop AND sling) OR TITLE-ABS-KEY (i-stop AND sling) OR TITLE-ABS-KEY (toms AND sling) OR TITLE-ABS-KEY (surgimesh AND M-sling))
3(TITLE-ABS-KEY (male AND sling AND incontinence) OR TITLE-ABS-KEY (advance AND sling) OR TITLE-ABS-KEY (advancexp) OR TITLE-ABS-KEY (virtue AND sling) OR TITLE-ABS-KEY (tiloop AND sling) OR TITLE-ABS-KEY (invance) OR TITLE-ABS-KEY (bams AND sling) OR TITLE-ABS-KEY (istop AND sling) OR TITLE-ABS-KEY (i-stop AND sling) OR TITLE-ABS-KEY (toms AND sling) OR TITLE-ABS-KEY (surgimesh AND M-sling) AND NOT TITLE-ABS-KEY (vaginal) AND NOT TITLE-ABS-KEY (women) AND NOT TITLE-ABS-KEY (midurethral sling) AND NOT TITLE-ABS-KEY (mid-urethral sling) AND NOT TITLE (review) AND NOT TITLE (editorial))
#Searches PUBMED
1male [Title/Abstract] AND sling [Title/Abstract]
2(((male sling [Title/Abstract]) OR (advance sling [Title/Abstract])) OR (advancexp [Title/Abstract])) OR (virtue sling [Title/Abstract])) OR (tiloop sling [Title/Abstract])) OR (invance [Title/Abstract])) OR (bams sling [Title/Abstract])) OR (istop sling [Title/Abstract])) OR (i-stop sling [Title/Abstract])) OR (toms sling [Title/Abstract])) OR (surgimesh M-sling [Title/Abstract])
3(((male sling [Title/Abstract]) OR (advance sling [Title/Abstract])) OR (virtue sling [Title/Abstract])) OR (tiloop sling [Title/Abstract])) OR (advancexp [Title/Abstract])) OR (invance [Title/Abstract])) OR (bams sling [Title/Abstract])) OR (istop sling [Title/Abstract])) OR (i-stop sling [Title/Abstract])) OR (toms sling [Title/Abstract]) NOT (vaginal [Title/Abstract])) NOT (women [Title/Abstract])) NOT (midurethral sling [Title/Abstract])) NOT (mid-urethral sling [Title/Abstract])) NOT (review [Title/Abstract])) NOT (editorial [Title/Abstract])
#Searches Cochrane
1(male sling*):ti,ab,kw
2(male sling* OR advance sling* OR advancexp OR virtue sling* OR tiloop sling OR invance OR bams sling OR stop sling OR i-stop sling OR toms sling OR surgimesh M-sling):ti,ab,kw
3(male sling* OR advance sling* OR advancexp OR virtue sling* OR tiloop sling OR invance OR bams sling OR stop sling OR i-stop sling OR toms sling OR surgimesh M-sling):ti,ab,kw NOT (vaginal OR women OR midurethral sling OR mid-urethral sling OR review OR editorial):ti,ab,kw
#Searches Web of Science
1((TI=(male sling)) OR AB=(male sling)
2(((((((((((((TI=(male sling)) OR AB=(male sling)) OR TI=(advance sling)) OR AB=(advance sling)) OR TI=(advancexp)) OR AB=(advancexp)) OR TI=(virtue sling)) OR AB=(virtue sling)) OR TI=(tiloop sling)) OR AB=(tiloop)) OR TI=(invance)) OR AB=(invance)) OR TI=(bams sling)) OR AB=(bams sling)) OR TI=(istop sling)) OR AB=(istop sling)) OR TI=(i-stop sling)) OR AB=(i-stop sling)) OR TI=(toms sling)) OR AB=(toms sling)) OR TI=(surgimesh M-sling)) OR AB=(surgimesh M-sling)))
3(((((((((((((((((((((((((((((((TI=(male sling)) OR AB=(male sling)) OR TI=(advance sling)) OR AB=(advance sling)) OR TI=(advancexp)) OR AB=(advancexp)) OR TI=(virtue sling)) OR AB=(virtue sling)) OR TI=(tiloop sling)) OR AB=(tiloop)) OR TI=(invance)) OR AB=(invance)) OR TI=(bams sling)) OR AB=(bams sling)) OR TI=(istop sling)) OR AB=(istop sling)) OR TI=(i-stop sling)) OR AB=(i-stop sling)) OR TI=(toms sling)) OR AB=(toms sling)) OR TI=(surgimesh M-sling)) OR AB=(surgimesh M-sling)) NOT TI=(midurethral sling)) NOT AB=(midurethral sling)) NOT TI=(mid-urethral sling)) NOT AB=(mid-urethral sling)) NOT AB=(women)) NOT TI=(women)) NOT AB=(vaginal)) NOT TI=(vaginal)) NOT DT=(Correction OR Addition OR Letter OR Review OR Editorial))

Study selection

Applicability to the review question will be based on the following criteria:

  • Inclusion criteria:

    • Longitudinal study in the form of randomised controlled trial and observational study (including prospective and retrospective study designs) involving the implantation of fixed synthetic perineal slings in male adults (aged ≥18 years) diagnosed with stress or stress-prevalent PPI assessed using any recognized diagnostic method, as follows: pad use, pad-test, stress test, urodynamics, bladder diary, symptomatology questionnaires.

    • The study includes at least one clearly defined risk factor and at least one clearly defined measure of continence. The risk factors must have occurred and measured preoperatively.

    • The outcomes have been measured after at least six month (mean/median follow-up) from surgery.

    • At least 30 patients have been assessed for the association between risk factors and outcomes.

    • The publication is in English, French, Spanish or Italian.

    • For inclusion in the quantitative meta-analysis, the study must report sufficient data on the association between any potential risk factor and outcome (effect size estimate and its variance or enough numerical information to calculate them). Studies that will not meet this criterion but only report p-values or qualitative findings (eg, ‘not significant’), and whose additional data will not be obtained on request, will be reported in a descriptive manner only, similarly to those that identified potential risk factors not featuring in any other study.

    • For studies published by the same research group, the choice of the study to be included will be made assessing each combination risk factor-outcome according to the following criteria in order of relevance: 1) the largest one reporting results of a multivariable analyses; 2) the largest one reporting results of an univariable analyses. This means that multiple studies by the same research group may still be included if reported risk factor-outcome combinations are different between studies.

    • Abstracts will be also considered for inclusion if in the form of indexed international conference abstract providing detailed description of key study characteristics (also by contacting the authors), and adjusted effect measures with variance.

  • Exclusion criteria:

    • The study does not meet any of the above inclusion criteria.

    • The study included more than 20% of patients with non-post-prostatectomy incontinence. No restrictions will be placed on other demographic characteristics.

    • The study involved:

      • the use of an adjustable sling;

      • the use of non-synthetic, absorbable or composite (autologous/absorbable plus synthetic) mesh materials;

      • analysis of re-do procedures;

    • The citation is a case report;

    • The citation is a review or meta-analysis, book chapter, thesis;

    • The citation is an expert consensus, editorial, letter, comment, animal study, communication, or an abstract non fulfilling the inclusion criteria;

    • Duplicated studies not fulfilling the inclusion criteria for studies published by the same research group.

A two-stage pilot-tested selection process will be undertaken. As a first step, relevant citations will be considered on the basis of their title and abstract. At the second step, the full-text of selected citations will be downloaded and assessed with regard to applicability and methodological quality.

Three reviewers (FG, FM, SM) will independently perform the selection process without consideration for the results. Both screening stages will be piloted on a random selection of ten citations. During both stages, disagreements will be resolved through discussion among reviewers and, if necessary, with the senior reviewer (ES) until mutual agreement is reached. All citations will be recoded in Zotero 5.0 and a Microsoft Excel spreadsheet. The selection process will be displayed in a PRISMA flow diagram.

Data extraction

Key information from each selected study will be extracted according to the CHARMS checklist12 in its modified version suitable for reviews of prognostic factors (CHARMS-PF).21

Key data will be extracted in duplicate using a pre-defined data extraction form and recorded in a Microsoft Excel spreadsheet (available as Extended data: ‘Data Collection Sheet’) where the coding process for each of the variables is defined. The spreadsheet was created by two reviewers and thereafter pilot-tested and finalized on a random selection of five studies. The form will be reviewed and modified, if necessary, after group discussion with the senior reviewer.

Data items

The major groups of variables to be coded for each eligible study are as follows: (1) study’s general information (e.g., first author, journal, year of publication, country of the first author and other involved countries, study frame and design, recruitment period), (2) participant characteristics (e.g., inclusion/exclusion criteria, number of eligible and treated patients, age at baseline, body mass index, incontinence severity and aetiology, history of irradiation, bladder neck contracture), (3) intervention characteristics (e.g., type of sling, any comparator treatment), (4) outcomes (e.g., outcomes types and definitions, endpoints, event rates, patients evaluated for risk factors, attrition) and (5) risk factors and relevant quantities (evaluated variables and measurement methods, type of statistical analyses such as univariable versus multivariable, set of variables in the multivariable model, modelling method, effect size estimates with variance and p-value).

Assessment of risk of bias

The quality of studies will be assessed for risk of bias (RoB) using the Quality in Prognosis Studies (QUIPS) tool,21 according to the recommendations of the Cochrane Prognosis Methods Group and the suggestions provided by Grooten WJA et al.22 The QUIPS tool consists of six domains: (1) study participation, (2) study attrition, (3) prognostic factor measurement, (4) outcome measurement, (5) study confounding, and (6) statistical analysis and reporting.21 Each domain encompasses three to seven prompting items that are rated on a four-grade scale (yes, partial, no, unsure). Eventually, the reviewer makes an overall judgment of the RoB within each domain (high, moderate or low RoB). This tool has demonstrated satisfactory reliability.21

Although for QUIPS it is recommended against calculating scores for overall study quality, in systematic reviews and meta-syntheses it is recommended to report a table of included papers in which each paper is classified as having high, moderate or low RoB.22 We based this classification on the criteria proposed by Grooten et al.22: a study satisfying low risk of bias in at least five domains and without any high risk rating will be designated as a study with an overall low RoB. If one or more domains will be classified as having high RoB, or ≥ 3 domains as moderate RoB, then this paper will be classified as high RoB. All papers in between will be classified as having moderate RoB. On the other hand, no prior criteria will be used to make the judgment of the RoB within each domain but each rater will make the decision based on a critical overall evaluation of their ratings of the included items. The QUIPS checklists (available as Extended data) will be operationalized by the reviewer team to assess and adapt the prompting items for our specific review question and assign the agreed-upon a priori relevance to each item according to recommendations on RoB assessment.19,21,22

Two authors (FG and SM) will independently perform the quality assessment after a piloted screening of five studies. They then will meet and review their judgments for agreement. If agreement will not be reached, a third author (ES) will render the decision. Lack of adjustment is a serious bias and all studies will be judged at high RoB with regard to unadjusted effect sizes (secondary meta-analysis – see below). Overall and study-level RoB assessment will be displayed using the ROBVIS web app.23

Meta-analysis design

Outcomes

The outcome of the present review will be the sling failure. Studies on male slings typically report two main types of treatment failures: the failure of “cure” including patients failing to achieve a complete (“dryness”) or pretty complete continence, and the failure to achieve at least an “improvement” of the baseline incontinence status (also called “social continence” or “overall success” or simply “success”). Although heterogeneity in the definitions of these outcomes is expected in sling literature, we aim to evaluate the association between risk factors and both failure to achieve cure (failure of cure - FoC) and failure to achieve overall success (failure of success – FoS). Methods of measurement will be as per included studies. “No pad use” and “use of at maximum one pad per day” will be the preferred definitions for cure and overall success, respectively, and whenever possible, to increase homogeneity, effect sizes will be calculated based on these definitions; otherwise, outcomes definitions will be as per the included studies.

Exposures

Exposures (possible risk factors) will include any preoperative variables evaluated for association with sling failure, independently from their possible causal relationships. Although our focus is mainly on “risk factors”, potential protective factors will be also included. Comparators will be absence or fewer values of all of these variables.

Effect size measures

Odds ratio (OR) with 95% confidence intervals (CI) will be reported as an overall synthesized measure of effect size. The association is reported following the convention that OR>1 indicates that the factor under evaluation is associated to an increased risk of failure, and OR<1 indicates that the factor has a protective effect. Studies on male slings are predominantly observational in nature and thus liable to confounding, thus current guidelines for prognostic studies recommend to report both crude and adjusted measures of association to better understand the role of confounding variables.18 Consequently, although most of the reported effect measures are expected to be derived from univariable (unadjusted) analyses, we will primarily focus on adjusted estimates because they presents a more accurate picture of the unique (“independent”) contribution of the risk factors to the outcome of interest.19 As a result, we will perform separate meta-analyses based on adjusted (primary meta-analysis) and unadjusted (secondary meta-analysis) ORs for both continence outcomes. Studies will be included in the primary meta-analysis only if adequate statistical control is provided to account for the effect of relevant covariates on the association between risk factors and outcomes. Adequate adjustment is defined as statistical control for at least one of two variables: pelvic irradiation and incontinence severity. These two variables are “index” risk factors usually measured in PPI literature and reported as negative prognosticators in several reviews, primary studies and guidelines on PPI surgery.2428 Therefore, for the other risk factors under review, it is important to understand whether they contribute additional and independent prognostic information to the index ones. For the severity of incontinence, different methods of measurement will be allowed (e.g., pad count, pad-test). The secondary meta-analysis of crude ORs will be performed separately on an expectedly much larger sample of studies, an established approach in reviews on prognostic factors to examine the robustness of results from the primary analysis, the role of comparator risk factors, and to find other risk factors not yet evaluated by multivariable analysis.18,2931 Meta-analyses will be performed if ORs from at least two studies could be pooled.32 Each study will contribute only one OR for metagroup and if a study reports effect sizes on several follow-ups or with different type of adjustment, we will choose based on the following criteria in order of importance: 1) sample of at least 30 patients; 2) latest follow-up; 3) the most adjusted one. Descriptive data will be used to characterize our study population. The meta-analysis design is schematically displayed in Figure 1.

987fe95d-7df4-460b-be83-b5746cf03b4d_figure1.gif

Figure 1. Meta-analysis design.

Main calculations

The type of effect size measure is expected to vary between studies, as a result, harmonization will be achieved by converting all effect measures into a common metric, the OR. Effect size conversion will be performed using RevMan calculator and Psychometrica, an online tool33 The reported standard errors will be used to calculate the inverse variance weights. When not directly reported, standard error will be calculated using confidence interval or p-value, according to Altman and Bland.34 For studies reporting hazard ratios (HR), it would be incorrect to take them as an approximation of OR because the outcome (treatment failure) is not a rare event. Therefore, HRs will be converted to ORs using baseline control risk estimates from the individual studies and the methods as outlined by Symons et al.35 and Shor et al.36 If studies do not provide baseline risks, we will use the average risk, prevalence of the risk factor, and the relative effect to estimate the baseline risk, according to Kooter et al.37 Whenever possible, in the absence of a reported effect size, we will calculate the crude OR and its standard error for dichotomous variables based on the reported or reconstructed 2 × 2 contingency table. When zero counts occurs in a cell of a 2 × 2 contingency table, the Haldane-Anscombe correction will be applied.38 This is a method to avoid error in the calculation of odds ratio by adding 0.5 to all the cells of a 2 × 2 contingency table if any of the cell expectations would cause a division by zero. Continuous outcome measures such as mean difference and standardized mean difference, will be converted to OR using the Suissa’s method39,40 or the Hasselblad and Heidges’ method,40 respectively. Considering that continuous risk factors are sometime handled as unit (or range) of exposure and sometime are classified into distinct exposure categories, to maximize the number of studies included in each metagroup, all ORs for continuous risk factors will be converted into estimates of the OR per unit (or range) of exposure by using the Hamling’s method for linear trend calculation.41 The values (doses) assigned to each exposure category will be based on the best information available: in particular, assignments will be made according to a slightly modified parametric method proposed by Shim et al., if medians of the categories were available or computable42; otherwise, a nonparametric method will be applied, using the categories midpoints.43 The method used is as follows: for open smallest category, the median (or the midpoint) is set as the dose assuming that the beginning is zero (e.g., 5 if <10) or the lowest value in the study population, as appropriate; when the categories are closed by specific values, then the median (or the midpoint) is set as the dose; for open largest category, the median (or the midpoint) of the previous category minus the starting value of the previous category is added to the starting value of the last category, and the ensuing value is set as the dose. All calculations will be performed in duplicate and using Excel spreadsheets.

Statistical methods

Random-effects models

Power to detect heterogeneity is low in meta-analyses of observational studies.44 Furthermore, inherent between-study clinical and methodological heterogeneity is expected a priori due to the characteristics of the male slings literature: different study designs (e.g., retrospective vs prospective studies), different population characteristics (e.g., aetiology of PPI) and different outcome definitions (e.g., more or less stringent definition of success and cure). As a result, in our meta-analysis it is unlikely that studies will be functionally equivalent and effect size is assumed to vary from one study to the next. Therefore, we will take a conservative approach and use random-effects models to derive the summary exposure effects and form CIs, because random-effects models account for any observed heterogeneity regardless of whether the heterogeneity is statistically significant, and allows statistical inferences to be made to a population of studies beyond those included in the meta-analysis.4547 The random-effects model weights the natural logarithm of each study's effect estimate by the inverse of its variance plus an estimate of the between-study variance (tau-squared) in the presence of between-study heterogeneity.47,48 Inverse-variance weighting is a method of aggregating two or more random variables that are weighted in inverse proportion to their variance in order to minimize the variance of the weighted average. The inverse variance is roughly proportional to sample size, but is a more nuanced measure, and serves to minimize the variance of the combined effect.49

The DerSimonian and Laird’s (DL) method of moments estimator, implemented in RevMan software, will be use to estimate the between-study variances.50 The pooled estimates will be then represented in forest plots. The p-values will be 2-sided and a statistically significant effect will be claimed at p-value <0.05.

Because the DL approach is suboptimal and may lead to too many statistically significant results (high type I error) when the number of studies is small and there is moderate or substantial heterogeneity,51 the approach described by Hartung and Knapp (HK method) will be applied in providing the final CIs around the pooled point estimates when less than 20 studies will be available.52,53 It has been showed that this approach consistently results in more adequate error rates (and CIs) and statistical tests, and consequently lower type I error than the DL method, more appropriately accounting for uncertainty in variance estimates, although the pooled effect estimates remain equal.52,54 For DL model, CIs and p-values are based on the normal distribution, whereas for the HK method, they are based on the t-distribution with the degrees of freedom equal to the number of trials minus one, and a weighted version of the DL standard error.52 This simple and robust modification to the common random-effects meta-analysis has been recommended in current guidelines19,55 to improve the summary results and was performed using the Excel spreadsheat provided by IntHout et al.52 Generally, results are more conservative with the HK method, giving wider CIs and larger p-values for the overall treatment effect, particularly in the scenario of less than 10 studies and moderate or substantial heterogeneity (I2 ≥ 30%).56

However, the HK approach is not without limitations.5658 When the heterogeneity is small and study sizes are imbalanced, the HK method may produce too wide, overly conservative CIs.56 Similarly, with very few studies (<5), especially if sample sizes are quite unequal, the HK method is often over-conservative, yielding spuriously wide and uninformative CIs, thereby leading to a loss of power and increasing the chance that relevant risk factors may be missed.5153,58,59 Furthermore, in case of very few studies and homogeneous study results, CIs using the HK method may be also misleadingly narrower (anti-conservative) than that of the random-effects and fixed-effect method as well.58 As a result, we will use an adaptive, hybrid meta-analytic approach,58 by applying both the random-effects DL and HK methods and selecting the more conservative (widest CIs) analysis to provide the final summary estimates, thus rejecting artificially narrow CIs. Furthermore, the HK method will be discarded in favour of the DL method if yielding inconclusively wide and erratic CIs. DL and fixed-effect models will be also reported together with the HK method as sensitivity analysis (see below).51,58,59

In a random-effects meta-analysis it is also important to consider the potential effect of a treatment or an exposure within an individual study setting, as this may be different from the average effect.60,61 This can be achieved by calculating the prediction interval (PI) that tells us how much the effect size varies in the same units as the effect size and using absolute values.46 The term ‘prediction interval’ relates to the use of this interval to predict the possible underlying effect in a new study that is similar to the studies in the meta-analysis. A more useful interpretation of the PI is as a description of the range (dispersion) of observed effect sizes. PIs have proved a popular way of expressing the real amount of heterogeneity in a random-effects meta-analysis.61 Actually, PI is considered the most important outcome in a random-effects meta-analysis when heterogeneity is substantial, reflecting the uncertainty we expect in the summary effect if a new study is included.60,61 The PI can be also used to estimate in a future setting the probability that a treatment or an exposure will have a true-positive or true-negative effect, and to perform better power calculations.62

PIs are, however, strongly based on the assumption of a normal distribution for the effects across studies, and can be very imprecise when based on only a few studies and if these studies are small, in which case they can appear spuriously wide or spuriously narrow.56,62 Accordingly, the use of PI is encouraged when the number of studies is reasonable, e.g. more than ten.17 Furthermore, PIs are inaccurate when there is low heterogeneity.56 As a result, in the present meta-analysis we plan to calculate the 95% PIs when at least 10 studies are available and I2 is at least 20%, using the Higgins-Thompson-Spiegelhalter equation and DerSimonian and Laird estimator of tau-squared and variance (with Hartung–Knapp variance estimator if Hartung–Knapp adjustment is applied).46

Assessment of heterogeneity

Heterogeneity between studies will be estimated statistically by the tau-squared, the χ2-based Cochran’s Q test and the I2 inconsistency Higgins’ statistic.63 Statistical significance is set at the 10% level (p-value <0.1) because of low power of the Q test. I2 statistic is the ratio of between-study variance over the sum of the within-study and between-study variances; it indicates the percentage of variance in observed effects that reflects variance in true effects rather than sampling error and is a recommended indicator of heterogeneity. I2 statistic ranges between 0% and 100% and, in agreement with the Cochrane handbook, 0 to 40% will be interpreted as “might not be important“, 30 to 60% as “may represent moderate heterogeneity”, 50 to 90% as “may represent substantial heterogeneity and 75 to 100% as “considerable heterogeneity”.16 Clinical heterogeneity is assumed to be mainly derived from the different types of treatment (e.g., different slings and implantation techniques) and different patients characteristics (e.g., age, incontinence aetiology and severity) among included studies, while methodological heterogeneity is caused by a variety of study designs (e.g., prospective and retrospective), and diverse follow-up lengths and sample sizes. Sub-group analysis and meta-regression will be used to address the cause of heterogeneity (see below).

Analysis of subgroups or subsets

When at least 10 studies will be available on a specific risk factor, subgroup analyses and random-effects meta-regressions will be carried out, also in absence of substantial inconsistency, based on the (pre-specified) following study characteristics: sling type (Advance vs. non-Advance), baseline incontinence severity (pad use, using cut-offs of three pads per day), sample size (cut-off of 100 patients), follow-up length (cut-off of 36 months), study design (retrospective vs. prospective), outcome definition (more vs. less stringent), level of confounder adjustment (cut-off of 4 covariates) and RoB (high vs. low-moderate).19,64 Subgroup analyses performed in the secondary meta-analysis will be useful to assess the robustness of statistically significant differences between subgroups in the primary meta-analysis.

Metabiases

To evaluate whether summary estimates are prone to small-study effects (e.g., arising from publication bias), funnel plots will be generated and Egger’s regression test will be used to evaluate the presence of asymmetry.65 Duval and Tweedie’s nonparametric trim-fill analysis will be used to determines how many studies would need to be included in the meta-analysis to make the funnel plot symmetrical, and calculate a meta-analytic effect size that adjust for publication bias.66 Briefly, this method initially removes the studies that are in the asymmetric part of the funnel plot, performing a new estimate of the pooled effect size. Then, using the new estimate as the axis of symmetry, studies previously removed are added again to the funnel plot, together with the same number of putative symmetric studies. A final pooled estimate is calculated based on the filled funnel plot.66 All these analyses will be performed only on meta-analyses featuring 10 or more studies.67

Sensitivity and influence analyses

Several sensitivity analyses will be conducted to test the robustness of the main findings. According to published recommendations, when the HK method is applied, sensitivity analyses should always be performed using the fixed-effect and/or the random-effects models to assess that HK model based estimates of CIs are actually the most conservative51,68 Therefore, results obtained applying the HK model will be reported together with those estimated with the fixed-effect and the random-effects DL methods. Fixed-effect model result will be also reported as sensitivity analysis when only the DL method is applied, unless no heterogeneity (I2=0) was detected (in this case both methods provide the same summary estimate). As stated above, a sensitivity analysis using the fixed-effect model is particularly useful in case of very few studies where both conventional random-effects methods and other modified methods (such as the HK method) become inaccurate.48,51,58,59,62

The publication bias-adjusted pooled estimates will be also used as a sensitivity analysis to assess whether the crude quantitative syntheses is robust or not (i.e. the result is reversed) to publication bias.16

A leave-one-out analysis69 will be performed to assess the robustness of the summary estimates by removing one study at a time from meta-analyses and recalculating the pooled effect estimates to evaluate whether the meta-analysis results were biased by any individual study. The results will be considered robust if no changes in direction and statistical significance of the effect size are observed on the exclusion of any studies, and the estimates in each case are well within the CIs of the overall estimate.

A sensitivity analysis will be also performed excluding studies in the form of randomized controlled trial or published as abstract only.

Furthermore, for the assessment of potential outliers and influential studies that may influence the robustness of the findings, multiple diagnostic measures will be applied when at least three studies will be available to ensure that the conclusions do not hinge on a few unusual studies.70 Outliers will be identified analysing the studentized deleted residuals (the deleted residual divided by its estimated standard deviation). Influential studies will be identified based on the following parameters: difference in fits value (DFFITS), which essentially indicates by how many standard deviations the predicted average effect for the ith study changes after excluding the ith study from the model fitting; Cook’s distance (Di), a value that summarizes how much all the fitted values change when the ith study is removed; COVRATIOi value (change in the variance–covariance matrix of the parameter estimates when excluding the ith study from the model fitting (a COVRATIOi value below 1, therefore, indicates that removal of the ith study actually yields more precise estimates of the model coefficients, or equivalently, that addition of the ith study actually reduces precision); QE statistics.70 If any outlier/influential studies will be identified, as further sensitivity analysis we will examine the effect of removing them from the meta-analysis.

Missing data

For missing data, study investigators will be contacted for unreported key data or additional details via electronic mail and researchgate.net if possible. Missing mean values and/or standard deviations are a common feature of meta-analyses of continuous outcome data. Calculation of missing mean values and standard deviation will be based on Wan’s methods71 or Cochrane method,16 as appropriate. Data displayed in graphs will be extracted when not retrieved otherwise using the software WebPlotDigitizer (https://automeris.io/WebPlotDigitizer/). If necessary, imputation of the average value borrowed from one or more studies in the meta-analysis will be used for standard deviation.72

Softwares

All statistical analyses will be performed using the statistical softwares Review Manager 5.4, (RevMan) [Computer program]. Version 5.4. The Cochrane Collaboration, 2020), Meta-Essentials73 for metaregression and PI calculation, JASP (The JASP Team (2017). JASP (Version 0.8.1.0) [Computer software]) for publication bias and outliers/influence analyses, and Microsoft Excel for MAC (version 2016) for all other calculations.

Assessment of confidence in cumulative evidence

To interpret the confidence in cumulative evidence, we will follow the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) guidance regarding the determination of certainty in estimates of association between risk factors and outcomes.74 This approach has been found to work well in assessing individual risk factors.74 The quality of evidence on each risk factor and from each type of analysis (primary and secondary) will be assessed separately. A summary of finding table will be provided. Grade assessment will be conducted in duplicate with disagreements resolved through discussion and, if necessary, with the senior reviewer (ES) until mutual agreement is reached. The assessment of a body of longitudinal observational studies in the field of prognostic research begins as high certainty in the evidence.74,75 The GRADE approach considers five factors that can decrease the confidence in estimates of effects: (1) RoB, (2) inconsistency, (3) indirectness, (4) imprecision and (5) publication bias; and three factors that can increase our confidence in estimates of effects from observational studies: (1) large estimates of treatment, (2) a dose–response gradient and (3) plausible confounding that would increase confidence in an estimate.76 Certainty is ultimately designated as high, moderate, low, or very low. We will downgrade for RoB if ≥50% of the studies will be at high RoB or if the results are no longer significant or even reversed after removing high RoB studies. An OR higher than 2.5 will be considered as a large estimates for dichotomous or dichotomized risk factors.77,78

Dissemination

The result of the review will be presented at national and international conferences and will be reported in peer-reviewed medical journals following the PRISMA statement.15

Study status

The research team performed a pilot search in the relevant databases in Mars 2022. This search was used to select the keywords and delineate the final search strategy, start the pilot phase of the studies selection process, customize the QUIPS tool, and create the data extraction form. The first full search and study selection has been completed. Data extraction, risk of bias assessment and data analysis are ongoing. A second full search is scheduled to be conducted in January 2023. After completion of the review, a last search will be performed before the submission of the final report.

Discussion

This planned review and meta-analysis will systematically explore the evidence available on the association between potential risk factors for failure after treatment of PPI with synthetic fixed perineal slings implantation. By collecting and summarizing information about possible mediating and moderating factors that can clarify why a non-negligible proportion of patients fail to achieve the cure or social continence after sling placement, the results from this review will provide healthcare professionals treating and managing such patients with data useful in everyday practice for decision-making and patient counselling. By helping to stratify patients according to the risk of sling failure, this information may streamline the selection of candidates who are most likely to benefit from sling and assist clinicians in directing high risk patients towards other therapeutic options, or in setting more realistic patients’ expectations regarding slings results. The present review will also provide researchers with the necessary, evidence-based groundwork to perform high-quality prognostic studies and to identify areas for future investigations in the field. A more in-depth knowledge of prognosticators of sling efficacy is expected to add valuable information to the understanding about the mechanism of action of slings. Furthermore, our findings may potentially help to formulate improved practice guidelines and recommendations for the prevention of sling failures and to develop statistical models for predicting individual risk and prognostic endpoints.

To our knowledge, this is the first systematic review evaluating risk factors for male sling failure and to present them in an evidence-based framework. The strengths of the present review are 1) use of a comprehensive search strategy with broad inclusion criteria (e.g., limited restrictions based on language and study design, no restrictions based on date of publication, possibility of abstracts inclusion), in order to ensure a wide-reaching coverage of relevant research including as much studies as possible, thus limiting the publication bias, 2) the conservative approaches used, aiming to limit type I error (false positive results), 3) use of rigorous methodologies based on latest available guidelines on performing a systematic review and meta-analysis on prognostic studies, 4) separate pooling of adjusted and unadjusted effect measures, 5) assessment of the study quality and of the certainty of evidence following current standards for RoB assessment in prognostic research and the GRADE methodology, 6) use of several methods for influence analyses and extensive sensitivity analyses to assess the robustness of the results to changes in methods and model assumptions.

However, we anticipate some methodological limitations in the conduct of this review. Being a review of observational studies, the clinical meaningfulness of summary result may be limited by real study diversity (heterogeneity), especially regarding type of sling, patients’ populations and methods of measurement of both exposures and outcomes. Studies are also expected to differ by design (e.g., retrospective and prospective) and by the number of covariates adjustment, which could potentially alter the magnitude of the associations. We will address this issue by subgroup analysis and meta-regression, when possible. Similarly, missing or imprecise data are frequent in such review, although we expect this issue to be solved by requesting authors to offer relevant data. The measurement methodologies and effect estimates from the individual studies will be assumed to be unbiased, although they may be biased due to flaws in the design or conduct of the studies. Several biases commonly affect observational studies reducing the significance of the review findings; biases of primary studies will be evaluated through the RoB assessment to provide a more insightful interpretation of the results.

In conclusion, the rationale and methodology of a systematic review and meta-analysis of risk factors for sling failure in patients suffering from PPI were described. Although there are some methodological limitations in conducting such kind of review, we believe they will not be serious enough to affect its value. The results of the review are expected to be a future guide for both clinicians and patients to choose the best treatment for this very bothersome condition.

Ethical considerations

Ethical approval is not required for this systematic review and meta-analysis because it will be based on secondary analysis of data already available in scientific databases and individual patient data will not be obtained or accessed. Even if authors of included studies will be asked to provide relevant missing data, any clinical information connecting with an individual patient will not be revealed.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 06 Jan 2023
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Sacco E, Marino F, Gavi F et al. Protocol for a systematic review and meta-analysis on preoperative risk factors for failure after fixed sling implantation for post-prostatectomy stress urinary incontinence [version 1; peer review: 1 approved with reservations]. F1000Research 2023, 12:19 (https://doi.org/10.12688/f1000research.129182.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 06 Jan 2023
Views
12
Cite
Reviewer Report 20 Jan 2023
Frank M. J. Martens, Department of Urology, Radboud University Medical Center, Nijmegen, The Netherlands 
Approved with Reservations
VIEWS 12
Protocol description for a systematic review/meta-analysis of pre-operative potential risk factors for failure of synthetic fixed perineal slings in males with stress urinary incontinence.

Relevance of meta-analysis: Predictors of success/failure are of great importance to counsel patients ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Martens FMJ. Reviewer Report For: Protocol for a systematic review and meta-analysis on preoperative risk factors for failure after fixed sling implantation for post-prostatectomy stress urinary incontinence [version 1; peer review: 1 approved with reservations]. F1000Research 2023, 12:19 (https://doi.org/10.5256/f1000research.141848.r159580)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 16 Nov 2023
    EMILIO SACCO, Universita Cattolica del Sacro Cuore, Italy
    16 Nov 2023
    Author Response
    Dear Reviewer,
    On behalf of all authors, I would like to thank you for the constructive comments. We hope that our replies and accompanying modifications will be considered satisfactory.
    Sincerely,
    ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 16 Nov 2023
    EMILIO SACCO, Universita Cattolica del Sacro Cuore, Italy
    16 Nov 2023
    Author Response
    Dear Reviewer,
    On behalf of all authors, I would like to thank you for the constructive comments. We hope that our replies and accompanying modifications will be considered satisfactory.
    Sincerely,
    ... Continue reading

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 06 Jan 2023
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.