Keywords
Keywords: Meta-analysis, Risk Ratio, Odds Ratio, R, Shiny, Bayesian Meta-Analysis, Publication Bias, Heterogeneity, Meta-regression, Open-source Software
Meta-analysis is central to evidence-based practice, yet conducting comprehensive analyses—especially involving binary outcomes such as risk ratios (RR) and odds ratios (OR)—often demands specialized software and statistical programming skills. These requirements can pose barriers to many researchers.
We introduce RRORPair, an open-source R/Shiny web application for RR/OR meta-analysis. Built on widely-used R packages (meta, metafor, dmetar, and ggplot2), it offers an intuitive interface enabling data import via CSV, selection of analytical models, and extensive customization of visual outputs. RRORPair supports classical and Bayesian methods, publication bias detection, heterogeneity diagnostics, meta-regression, and subgroup or cumulative analyses.
RRORPair provides: Forest plots (standard, JAMA, RevMan5 style)
Funnel plots, Egger’s test, trim-and-fill, limit meta-analysis, and p-curve analysis
Heterogeneity statistics (I2, τ2), Baujat plots, and influence diagnostics
Meta-regression with up to three moderators, cumulative and subgroup analysis
Bayesian meta-analysis
Outputs include interactive plots and downloadable reports.
RRORPair is a powerful and user-friendly tool that makes advanced meta-analysis of binary outcomes accessible without programming. It supports robust evidence synthesis and encourages transparency and reproducibility in research.
Keywords: Meta-analysis, Risk Ratio, Odds Ratio, R, Shiny, Bayesian Meta-Analysis, Publication Bias, Heterogeneity, Meta-regression, Open-source Software
Meta-analysis allows researchers to synthesize results from multiple studies, enhancing statistical power and clarifying effects of interventions (Higgins et al., 2011). For binary outcomes, risk ratios (RR) and odds ratios (OR) are commonly used effect measures. However, conducting high-quality meta-analyses often involves steep learning curves with statistical software or access to commercial packages such as Comprehensive Meta-Analysis (CMA) or Stata.
To address these barriers, we developed RRORPair, an open-source, interactive web application built with R and Shiny. RRORPair allows users to conduct advanced meta-analytic procedures through an intuitive graphical interface without writing code. By integrating functions from popular R packages (meta, metafor, dmetar, ggplot2), the tool supports rigorous analyses, extensive visualization, and comprehensive diagnostics—enabling a wide range of users to undertake binary outcome meta-analyses.
Software and implementation
RRORPair is developed in R (≥4.0.0; R Core Team, 2023) using the Shiny web framework (≥1.7.0; Chang et al., 2023). It is designed as a modular application using the following R packages:
- meta: For traditional meta-analysis calculations (e.g., metabin; Balduzzi et al., 2019)
- metafor: For meta-regression, robust estimation, and publication bias methods (Viechtbauer, 2010)
- dmetar: For influence analysis, p-curve diagnostics, and enhanced visual outputs (Harrer et al., 2021)
- ggplot2 and ggbeeswarm: For customizable plots (Wickham, 2016)
- bayesmeta: For Bayesian meta-analyses
- shinyjs, bs4Dash, fontawesome: For UI customization and layout enhancements
- PerformanceAnalytics, dplyr: For data wrangling and diagnostics
User interface and workflow
RRORPair consists of the following modules:
- Data Import & Settings
- Meta-Analysis Summary
- Forest Plots
- Publication Bias Analysis
- Heterogeneity Assessment
- Meta-Regression
- Bayesian Analysis
- Advanced Analyses (e.g., subgroup and cumulative)
Users upload a CSV file containing:
- Required columns: eventintervention, totalintervention, eventcontrol, totalcontrol, author
- Optional: year (for cumulative meta-analysis), Reg, Reg2, Reg3 (moderators), subgroup
Analytical options
The user can choose:
- Effect measure: Risk Ratio (RR) or Odds Ratio (OR)
- Model: Fixed-effect or random-effects
- Heterogeneity estimator: e.g., Paule-Mandel, DL, ML, REML
Output and features
Functionality highlights
Forest Plots: Available in standard, JAMA-style, and RevMan5 formats
Bias Assessment: Funnel plots, contour-enhanced versions, Egger’s test, trim-and-fill, limit meta-analysis, p-curve
Heterogeneity Exploration: I2, τ2, Q-test, Baujat, influence, L’Abbé, and drapery plots
Meta-Regression: Up to three moderators with bubble plots and correlation matrices
Bayesian Analysis: Basic Bayesian RR/OR models
Cumulative/Subgroup Analysis: By year or subgroup variable
Influence Diagnostics: Leave-one-out analysis, outlier detection
All plots and summaries can be exported (e.g., PNG, TXT). Educational tooltips and embedded tutorials are included.
A researcher investigating the effect of a new drug on adverse event occurrence across 10 studies prepares a CSV with columns:
author, year, eventintervention, totalintervention, eventcontrol, totalcontrol, Reg (average age)
They upload the file, select RR, Paule-Mandel estimator, random-effects model, and explore:
Results Tab: Summary table with pooled RR, CI, prediction interval, heterogeneity stats
Forest Plot Tab: Customizable visual output
Bias Tab: Funnel plot, Egger’s test, p-curve
Heterogeneity Tab: Baujat plot identifies influential studies
Meta-Regression Tab: Bubble plot visualizes age as a moderator
RRORPair aims to democratize meta-analysis by making high-level statistical methods accessible via an interactive platform.
Comprehensive: RR, OR, publication bias, heterogeneity, regression, Bayesian options
User-Friendly: No programming required
Interactive & Exportable: Real-time adjustments, downloadable visuals
Open-Source: Transparent and community-extensible
Educational: Built-in guidance and references
The software and data are licensed under the Apache License 2.0, an OSI-approved open license.
All datasets used in this article are openly available.
Web Application: https://786miii.shinyapps.io/MIII786ORRR/
- Example data for demonstrating the RRORPair application is available on GitHub: https://github.com/mahmood789/RRORPair
- An archived version is available via Zenodo: https://doi.org/10.5281/zenodo.15879475. Ahmad, Mahmood (2025).
The datasets include:
- The values behind the reported outcomes and summary statistics
- Sample CSV files required to operate the tool
- Code and documentation for reproducing the study and generating figures
Example Data: Available via the GitHub repository. Users can format their own CSV files using required column specifications.
We thank the Ahmadiyya Muslim Research Association (AMRA) for their support. Special thanks to Luciano Candilio, Malik Takreem Ahmad, Niraj Kumar, Jonathan Bray, Reubeen Ahmad, and Prof Rui Providencia for their insights and feedback. We also appreciate the testing efforts of all co-authors.
| Views | Downloads | |
|---|---|---|
| F1000Research | - | - |
|
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)