Keywords
Snakebite, Systematic Review, Clinical Trials, Outcome Assessment, Treatment Outcome,Patient Reported Outcome Measures
This article is included in the Global Public Health gateway.
This article is included in the Neglected Tropical Diseases collection.
Snakebite, Systematic Review, Clinical Trials, Outcome Assessment, Treatment Outcome,Patient Reported Outcome Measures
Snakebite is a major public health problem in South Asia, Africa, and South America with an estimated 5.4 million people being bitten by snakes annually. It is estimated that snakebite causes up to 138,000 deaths worldwide each year, with three times as many people experiencing permanent disabilities.1 In 2017, the World Health Organization (WHO) classified snakebite envenoming as a neglected tropical disease and this was followed by the launch of the WHO global strategy to reduce the mortality and morbidity by 50% by 2030.2 One of the four key pillars of this strategy is to “ensure safe, effective treatment of snakebite”.2 However, clinical practice guidelines, including those from the WHO, have been found to have quality issues, including in the use of evidence to inform recommendations for snakebite management.3 These issues in guidelines is linked to the poor evidence base for interventions for snakebite management. We had previously found that systematic reviews on snakebite were of critically low quality.4 Investment in treatments for snakebite, including in the identification of new therapies, has increased in recent years, and this trend is expected to continue.5 Our earlier overview of systematic reviews on snakebite management has also highlighted the limitation of non-standardised measurement and reporting of outcomes.4 This non standardisation of outcomes limits the ability of researchers, healthcare providers, decision makers, and patients to undertake meaningful comparisons and understand the potential benefits or harms of different treatment modalities.6,7 Thus, there is an identified need for a core outcome set (COS)8 for intervention research on snakebite management including trials and systematic reviews. A COS is a minimal list of consensus outcomes that should be used in all clinical trials and evidence synthesis in a specific area or setting of health or health care.
The objective of this study is to identify what outcomes have been used in intervention research on snakebite through a global systematic review of outcomes. This conduct of a robust and comprehensive systematic review of outcomes is an essential first step in the development of a COS.8
This systematic review is a part of a larger project to develop a COS for intervention research on snakebite in South Asia. The protocol for the entire project, including the current systematic review was registered a priori (https://doi.org/10.17605/OSF.IO/PEKSJ). The COS development was registered a priori in the COMET database (https://cometinitiative.org/Studies/Details/1849). A summary of the methods for this systematic review is provided below.
The PRISMA checklist for this report of the review is available in Extended Dataset: Appendix 1.9
We included studies which met the following criteria:
• Health condition/Population: people with snakebite, irrespective of their sex/gender, species of snake, region, or any other factor.
• Intervention: any intervention regarding management of snakebite.
• Comparators: an active comparator or control group.
• Outcomes: the outcomes measured and reported, given the objective of identifying the full range of all outcomes.
• Study Design: we included studies with the following designs:
o Randomised trials.
o Non-randomised controlled trials.
o Secondary analysis of randomised or non-randomised controlled trials.
o Systematic reviews that included randomised or non-randomised controlled trials.
We excluded systematic reviews which solely included non-trial designs. Protocols and trial registry records pertaining to the above were also included.
• Other criteria: there were no limits based on date of publication.
We searched 15 electronic databases (PubMed, EMBASE, CINAHL, Cochrane Database of Systematic Reviews, ACP Journal Club, Database of Abstracts of Reviews of Effects, Cochrane Clinical Answers, Cochrane Central Register of Controlled Trials, Cochrane Methodology Register, Health Technology Assessment, NHS Economic Evaluation Database, Campbell Library, Epistemonikos, Scielo and Open dissertations) on 29th October 2021, with no language restrictions. The search strategies for all databases are presented in Extended Dataset: Appendix 2.9
We hand-searched nine trial registries (Australia New Zealand Trial Clinical Registry, Brazilian Clinical Trials Registry, Clinical Trial Registry of India, US trial registry (clinicaltrials.gov), Iranian Registry of Clinical Trials, Thai Clinical Trials Registry, Peruvian Clinical Trial Registry, Sri Lanka Clinical Trials Registry, and WHO International Clinical Trial Registry Platform) in November 2021. We also screened the reference lists of included studies and contacted snakebite experts to identify additional eligible studies.
At least two reviewers (SB and DB or JT) independently screened the records retrieved based on titles and abstracts (where available) in the first phase and subsequently screened the full texts of potentially eligible studies. Disagreements, if any, were resolved by consensus between three reviewers (SB, DB, and JT).
We extracted data using a standardised data extraction form in REDCap (a secure web application for building and managing online surveys and databases) containing key information pertaining to participant details (number and demographics: age, sex/gender, country and time period of the study), details on the bite (species information), study design, intervention and comparator group, reported outcomes (together with their definitions, measurement instruments and timepoints). The outcomes from trials were supplemented by additional outcomes from systematic reviews. All details pertaining to outcomes were extracted verbatim as recommended by the COMET Handbook.8
We analysed the verbatim information pertaining to reported outcomes. If we found multiple reports for the same study, we included these, but outcomes duplicated across these reports were only counted once. Outcomes which were not reported in the included trials, but which were defined or searched for in systematic reviews were also extracted verbatim. We classified the verbatim outcomes as per a taxonomy structure for outcomes in medical research10 which has been validated for various health conditions. As such, we mapped outcomes areas (mortality, physiological or clinical, life impact, resource use and adverse events) and sub-domains within these. We had an additional domain for composite outcomes, recognising that their individual elements might not be categorised as “unique” under the other domains so that information on composite outcomes could be used in the next steps in the COS development. We consolidated the outcomes based on similarity of outcome measures and definitions to create a set of the unique outcomes that had been used in intervention studies on snakebite envenomation. We summarized the results using frequencies and percentages for these unique outcomes.
Our protocol envisaged inclusion of studies published from 1990 onwards. However, we searched for studies irrespective of date of publication and removed this time limit. We also searched electronic databases and trial registries that were not listed in our protocol to enhance comprehensiveness. On a post-hoc basis, we included secondary analysis of trials because some outcomes are not reported as a part of the main publication of a trial. This inclusive approach helped capture maximal evidence. We did not separate outcomes by different age-groups and special populations as originally planned because of the lack of studies. The decision to retain composite outcomes was post-hoc.
We found 3277 records in our search in electronic databases, 69 in trial registries and another two records through hand-searching relevant websites. After removing duplicates, obtaining, and evaluating full texts, 107 records from 97 studies met our eligibility criteria and are included in this review. A detailed PRISMA flowchart showing the inclusion of studies is presented in Figure 1.
Reasons for exclusion of records that were assessed at the full text level are shown in Extended Dataset: Appendix 3.9
We included nine systematic reviews,4,11–18 and 88 trials and registry records. Out of the 88 trials and registry records, 84 are randomised trials,19–98 and 4 are non-randomised controlled trials.99–102 We found 10 post-hoc or secondary analysis of trials.103–112 Out of the 84 randomised trials, there was one adaptive,68 one factorial67 and one cross-over trial.66
The sample size ranged from eight to 1007 participants. Among the included trials, (26, 29.50%) were multicentric.19–23,26–28,34,41,49,50,55,64,66–68,70,74,81,85,89,90,99,113,114 Three (3.41%) trials were exclusively on children.23,25,76 Most of the studies (72, 81.8%) had only two arms of comparison. In 16 (18.2%) trials20,27,30,34,38,41,42,60,67,69,71,80–83,115 with more than two comparison arms, the number of arms ranged from three to eight. A total of 49 (55.7%) trials19–56,77,78,80,82,85,88,93,98,101,102 were restricted to participants with bites of a specific snake species/genus. Most of the trials started recruitment after the year 2000 (58, 65.91%).
A summary of the characteristics of the included studies is presented in Table 1 below.
We extracted verbatim data for 538 outcomes and categorised them into the following core areas: death/mortality (26, 4.83%), life impact (19, 3.53%), resource use (96, 17.84%), adverse events (80, 14.87%), physiological/clinical (288, 53.53%), and composite outcome (29, 5.39%). The proportionate frequency of outcomes by domain and sub-domains of physiological/clinical outcomes varied both by the type of intervention being evaluated and by geographic region (Extended Dataset: appendix 49). Trials from South Asia seldom measured life impact outcomes (0.47% of trials in contrast to 17.05% of North American trials which reported on life impact outcomes), but they frequently (29.28%) reported resource use outcomes. The focus of trials from South America, Southeast Asia and the rest of Asia is overwhelmingly in physiological/clinical outcomes. Blood and lymphatic system outcomes were proportionately much higher in African trials (64.00%) compared to South Asian (35.63%) trials. South Asian trials measured renal outcomes more (in 18.39% trials) compared to trials in other regions. Reporting of respiratory outcomes were uncommon except in Australia and Papua New Guinea (11.11%) trials.
Only 48 trials (54.54%) specifically identified their primary outcomes, out of which 10 (11.37%)47,60–62,67,77,84,89,97,98 had adverse events or effects as a primary outcome.
We consolidated the verbatim outcomes into 88 unique outcomes which we categorised as: mortality (1, 1.14%), life impact (6, 6.82%), resource use (15, 17.05%), adverse event (7, 7.95%), physiological/clinical (51, 57.95%), and composite (8, 9.09%).
The long list of the unique outcomes with summary information on their measurement and definitions is provided in Table 2 and discussed below.
Death/mortality outcomes
We found one unique outcome (1.14%) for mortality from 26 verbatim outcomes (4.83%) in 26 trials and five systematic reviews. Time points at which death was measured were until discharge from hospital, 28 days from discharge, 60 days from recruitment/intervention and 90 days from bite.
More detailed information tabulating this unique outcome, together with measures, definitions and time-points, is reported in Extended Dataset: Appendix 5.9
Life impact outcomes
We found six unique outcomes (6.82%) from 19(3.53%) verbatim outcomes from six trials and one systematic review. No trials or systematic reviews measured any life impact outcome related to social functioning, emotional functioning/well-being, cognitive functioning, perceived health status, compliance (including withdrawal from treatment), delivery of care or personal circumstances.
A clear definition with clear details on the outcome measurement instruments used was provided for all but one verbatim life impact outcome. Disability outcomes were measured long term (six months from discharge and 12 months from intervention). Serial measurement from baseline through 28 days (from bite) was common. More detailed information about these unique outcomes, together with their measures, definitions and time-points for measurements is provided in Extended Dataset: Appendix 5.9
Resource use outcomes
We found 15 unique (17.05%) resource use outcomes from 96 verbatim (17.84%) outcomes: two (2.27%) hospital use outcomes from 30 verbatim (5.58%) outcomes in 25 trials; 11 (12.5%) outcomes related to the need for further intervention from 65 verbatim (12.08%) outcomes in 25 trials, and two (2.27%) economic outcomes from two verbatim outcomes (0.37%) from one trial and one systematic review. No trials or systematic reviews reported on outcomes of societal or carer economic burden.
For almost all the resource use outcomes, the specific clinical criterion associated with the outcome was not reported. For example, none of the outcomes relating to the need for further intervention reported the specific clinical criteria that would lead to further intervention. More detailed information about these unique outcomes together with their measures, definitions and time-points for measurement is provided in Extended Dataset: Appendix 5.9
Adverse effect/events outcomes
Our synthesis led to seven (7.95%) unique adverse event outcomes from a total of 80 (14.87%) verbatim outcomes from 52 trials and six systematic reviews. There was substantial heterogeneity in the definitions used for these outcomes. Adverse effects and events were almost always measured in the acute setting with no long-term measurement of these outcomes. More detailed information about these unique outcomes together with their measures, definitions and time-points for measurement is provided in Extended Dataset: Appendix 6.9
Physiological or clinical outcomes
The 288 (53.53%) verbatim physiological/clinical outcomes from trials were consolidated into 51(57.95%) unique physiological/clinical outcomes and were classified as per the taxonomy into the following:
• Eye: one unique (1.14%) outcome from one (0.19%) verbatim outcome from one trial. Outcomes were assessed clinically with no clear criteria reported in the trials.
• Cardiac: three (3.41%) unique outcomes from seven (1.30%) verbatim outcomes from six trials. Outcomes were assessed clinically with no clear criteria reported in the trials.
• Psychiatric: four (4.55%) unique outcomes from four (0.74%) verbatim outcomes from two trials and one systematic review. psychiatric outcomes were measured with validated instruments and had good reporting of time points.
• Respiratory, thoracic, and mediastinal: three (3.41%) unique outcomes from four (0.74%) verbatim outcomes from three trials. Two of the outcomes are related to standard spirometry tests while the other was assessed clinically with no clear definition provided.
• Nervous system: five (5.68%) unique outcomes from 16(2.97%) verbatim outcomes from 13 trials and one systematic review. Many of the outcomes were measured clinically with no specific criteria mentioned.
• Injury and poisoning outcomes: three (3.41%) unique outcomes from 28(5.20%) verbatim outcomes from 20 trials. All the outcomes were laboratory measured.
• Immune system: three (3.41%) unique outcomes from three verbatim outcomes from one trial. All were laboratory measures.
• General: two (2.27%) unique outcomes from 16 (2.97%) verbatim outcomes from 14 trials. A standardised tool was used for one outcome and a clear definition was not provided for the other. Time points were not clear for both.
• Musculoskeletal and connective tissue: one (1.14%) unique outcome from eight (1.49%) verbatim outcomes from seven trials. Clear definitions were provided for the outcome measures and pertained to use of standard laboratory tests.
• Skin and subcutaneous tissue outcomes: six (6.82%) unique outcomes from 41 (7.62%) verbatim outcomes from 29 trials and one systematic review. Outcomes were assessed clinically with no clear criteria or time points reported for many outcome measures.
• Renal and urinary: six (6.82%) unique outcomes from 26(4.83%) verbatim outcomes from 14 trials and one systematic review. Outcome definitions were clearly reported (except for one outcome) and validated criteria or standard laboratory methods were used.
• Infection, infestation, and inflammation: seven (7.95%) unique outcomes from 21(3.90%) verbatim outcomes from 15 trials and 1 systematic review. There was substantial heterogeneity in outcome measures and definition with reporting being poor when clinical assessment was the basis of outcome measurement.
• Blood and lymphatic system: seven (7.95%) unique outcomes from 122(22.68%) verbatim outcomes from 49 trials and five systematic reviews. Laboratory tests were the basis of six of these outcomes with clinical assessment being the basis of outcome measurement in the other three.
No trial or systematic review measured endocrine outcomes, ear and labyrinth outcomes, gastrointestinal outcomes, hepatobiliary outcomes, puerperium, and perinatal outcomes, or vascular outcomes. We considered the following taxonomy sub-categories to be not relevant to the snakebite: familial, and genetic outcomes, metabolism and nutrition outcomes, outcomes relating to neoplasms: benign, malignant, and unspecified (including cysts and polyps), reproductive system and breast outcomes.
In general, reporting of time points was poor in many trials. More detailed information about these unique outcomes together with their measures, definitions and time-points for measurement is provided in Extended Dataset: Appendix 7.9
Composite outcomes
Our synthesis led to eight (9.09%) unique composite outcomes from 29(5.39%) verbatim outcomes from 21 trials and one verbatim outcome from two systematic reviews. There was substantial heterogeneity in outcome definitions as well as in the time points for measurement.
More detailed information on these unique outcomes together with measures, definitions and time-points for measurement is provided in Extended Dataset: Appendix 8.9
Only 15 trials22,66,78,82,88,90,116 included Patient Reported Outcome Measures (PROMs). The PROMs used in snakebite trials (with related citations on the measurement tools, where relevant) is presented in Table 3.
|
This systematic review of outcomes captured a total of 538 verbatim outcomes, which were consolidated into 88 unique outcomes, which had a wide variety of measures, definitions, and time points for their measurement. Outcome definitions and time points were infrequently or poorly reported. Outcomes related to resource use and life impact were included in few trials, with no trials using outcome related, societal or carer burden, social functioning, emotional functioning or well-being, cognitive functioning, perceived health status, compliance, and delivery of care or personal circumstances. The only trial which captured economic outcomes reported the average cost of antivenom without any comprehensive calculation of other direct or indirect costs. No trials had outcomes related to pregnancy. We also found that the primary outcome was explicitly stated in only a few of the trials. Outcome types (by the taxonomy domains) varied for both different geographic regions and different types of intervention being evaluated.
Heterogeneity in outcomes, their measures, definitions, and time points prevents comparison of effectiveness data, thus limiting the usefulness of trials and reviews to clinical practice.8 The major reason for evidence synthesis specialists not being able to conduct meta-analyses is heterogeneity in the ways in which outcomes are reported and measured.8,117 This systematic review has shown that this is likely to be a major problem for snakebite research. Therefore, if high-quality trials are to be done to develop a robust evidence base for the management of snakebite,4 this needs to be preceded by the development of COS for use in intervention research.
The variation in outcomes (by taxonomically domains) across geographic regions and types of intervention indicates the need for development of COS with a focus on specific regions. This is to be expected because the clinical features of envenomation and the consequent choice of type of intervention largely depends on the type of snake and this largely depends on the geographic region. As such, this review has confirmed the appropriateness of our intention to develop a COS with a specific South Asia focus. This is also in keeping with the WHO’s work to develop targeted therapeutic profiles for snakebite envenomation therapies on a geographic region basis.118 The scarce use of PROMs, resource use and life impact outcomes in snakebite research to date is a gap that needs to be filled. These outcomes have high relevance for, for example, patients, clinicians, and hospital administrators. Our systematic review identified several outcome measurements instruments, but their measurement properties (structural validity, internal consistency, cross-cultural validity, and reliability) and the feasibility of using them is unknown. We will address this in future steps of our COS development, which will not only involve public health professionals, social workers, health economists, but also patients and caregivers of people with snakebite. This would enhance the clinical and public health relevance of the COS. To achieve this, the inventory of outcomes from this systematic review will be supplemented by additional outcomes identified by stakeholders participating in the consensus development process in the next steps of COS development.8
There is also a need for better reporting of outcome definitions (including outcome measurement instruments) and time points of measurement in clinical trials for snakebite. While the uptake of COS in future trials119 will address this issue to some extent, there is also a need for funders, trialists, and journal editors to take this into account through the lifecycle of a trial, from its design stage to publication. The lack of specific mention of primary outcomes also needs to be addressed.120 Trialists should also ensure that their outcome measurement instruments are valid for their own setting or use ones which are validated in their geographic region, such that their cross-cultural validity and feasibility is enhanced.121 Improvements in trial outcome transparency and reporting should also arise from the forthcoming Outcome extensions for the Standard Protocol Items: Recommendations for Intervention Trials (SPIRIT) and CONsolidated Standards of Reporting Trials (CONSORT) statements.122 Beyond improvements in how outcomes are used in trials, there is also a need to conduct more trials in children, since we identified only three trials exclusively on children.
Strengths of this review include that we searched 15 electronic databases and eight trial registries to comprehensively capture outcomes from as many studies as possible, not only including those trials which have completed but also including trials that are not published, not completed, or were terminated early. We have used standard evidence synthesis methods to maintain quality and used a validated taxonomy to classify outcomes. In keeping with guidance on the use of the taxonomy, this standardised outcome classification system allowed us to remove “inconsistencies due to ambiguity and variation in how outcomes are described across different studies”.10 We acknowledge the limitation that, although we were able to successfully manage records in English and Spanish, we were unable to extract information from five records123–127 that were available in Portuguese and Chinese.
We have shown that trials evaluating therapies for snakebite envenoming have heterogeneity of outcomes and often omitted key information related to their measurement. Developing high quality region-specific COS for snakebite would facilitate improvements in the design and reporting of future trials and thereby strengthen their ability to have a positive impact on policy, practice, patient care and overall health. Particular attention also needs to be paid to improve the reporting of outcomes, and to include PROMs, resource use and life impact outcomes in trials on snakebite.
Figshare. Outcomes in intervention research on snakebite envenomation: a systematic review. DOI: https://doi.org/10.6084/m9.figshare.19777921.v1
This project contains the following underlying data in the extended dataset:
• Data file Appendix 1. PRISMA checklist
• Data file Appendix 2. Search strategies of all databases
• Data file Appendix 3. Reasons for exclusion at full text level
• Data file Appendix 4. Outcome core categories by region and intervention
• Data file Appendix 5. Detailed data on outcomes in categories of death, life impact and resource use
• Data file Appendix 6. Detailed data on outcomes in categories of adverse event
• Data file Appendix 7. Detailed data on outcomes in categories of physiological/clinical
• Data file Appendix 8. Detailed data on composite outcomes
Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Yes
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
References
1. Abouyannis M, Aggarwal D, Lalloo DG, Casewell NR, et al.: Clinical outcomes and outcome measurement tools reported in randomised controlled trials of treatment for snakebite envenoming: A systematic review.PLoS Negl Trop Dis. 15 (8): e0009589 PubMed Abstract | Publisher Full TextCompeting Interests: No competing interests were disclosed.
Reviewer Expertise: Antivenom development, antivenom access
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Not applicable
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Snakebite research, human-wildlife conflict, toxicology
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 1 08 Jun 22 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)