Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma

Kenneth W. Witwer

doi:10.12688/f1000research.14060.1

Home Browse Alternative miRNAs? Human sequences misidentified as plant miRNAs...

ALL Metrics

-

Views

-

Downloads

Get PDF

Get XML

Export

▬

✚

Research Article

Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma

[version 1; peer review: 2 approved]

Kenneth W. Witwer ^1,2

PUBLISHED 28 Feb 2018

Author details Author details

¹ Department of Molecular and Comparative Pathobiology, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA
² Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA

Kenneth W. Witwer
Roles: Conceptualization, Data Curation, Formal Analysis, Investigation, Methodology, Project Administration, Writing – Original Draft Preparation, Writing – Review & Editing

OPEN PEER REVIEW

REVIEWER STATUS

Abstract

Background: A 2017 study reported that “Plant miRNAs found in human circulating system provide evidences of cross kingdom RNAi”. Analysis of two human blood plasma sequencing datasets was said to provide evidence for uptake of plant miRNAs into human plasma. The results were also purportedly inconsistent with contamination.
Methods: Sequences from public datasets and miRNA databases were compared with results downloaded from the website of the reporting journal.
Results: Only one putative plant miRNA (“peu-MIR2910) mapped consistently above background, and this sequence is found with 100% identity in a human rRNA. Several other rarer but consistently mapped putative plant miRNAs also have 100% or near 100% matches to human transcripts or genomic sequences, and some do not appear to map to plant genomes at all.
Conclusions: Reanalysis of public data suggests that dietary plant xenomiR uptake is not supported, but instead confirms previous findings that detection of rare plant miRNAs in mammalian sequencing datasets is artifactual. Some putative plant miRNAs, including MIR2910 and MIR2911, may represent human sequence contamination or other artifacts in plant studies, emphasizing the need for rigorous controls and data filtering strategies when assessing possible xenomiRNAs.

Keywords

microRNA, xenomiR, diet, RNAi, biofluid, plasma

Corresponding author: Kenneth W. Witwer

Competing interests: No competing interests were disclosed.

Grant information: The author(s) declared that no grants were involved in supporting this work.

Copyright: © 2018 Witwer KW. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

How to cite: Witwer KW. Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma [version 1; peer review: 2 approved]. F1000Research 2018, 7:244 (https://doi.org/10.12688/f1000research.14060.1) First published: 28 Feb 2018, 7:244 (https://doi.org/10.12688/f1000research.14060.1) Latest published: 28 Feb 2018, 7:244 (https://doi.org/10.12688/f1000research.14060.1)

Introduction

Reports of plant or other dietary miRNAs, or xenomiRs, entering mammalian circulation through the diet^1–4 generated initial excitement for the xenomiR transfer hypothesis, yet negative results of replication and reproduction studies have cast doubt on xenomiR transfer as a general mechanism^5–11. A prominent claim of xenomiR function¹ has also failed rigorous reproduction⁷, unmasked as the result of an uncontrolled variable in the original experiment. Analyses of public datasets have revealed that studies of xenomiRs and other foreign-origin nucleic acids are fraught with artifacts: combinations of contamination, amplification or sequencing errors, permissive analysis pathways, and batch effects^8,10,12–16. A particularly comprehensive study recently found that foreign miRNAs in human biofluids and tissues do not match human food consumption, are marked by batch effects, and are thus most parsimoniously explained as artifacts¹³. Studies of organisms with no exposure to plants have also found evidence of the same types of apparent plant contamination that plague some measurements of human samples^8,17. Liu et al.¹⁸ mapped sequencing data from two studies of human plasma and other samples^19,20 to various plant genomes using a 2010 plant miRNA database, PMRD²¹, concluding that previous reports of dietary xenomiR transfer are supported. In this brief report, these results are examined critically.

Methods

Plant mapping results from Liu et al.¹⁸ (total mapped counts) were downloaded from the BMC Genomics website. Accession numbers of sequencing datasets were checked against the publications of Ninomiya et al.¹⁹ and Yuan et al.²⁰, as well as the Sequence Read Archive (SRA). Data were sorted and analyzed in Microsoft Excel for Mac 2011, Version 14.7.1. Plant miRNA sequences were obtained from miRBase²². Because certain plant sequences have been removed from miRBase because they have been identified as ncRNA degradation artifacts, the plant microRNA database (PMRD)²¹ was consulted; however, repeated attempts to access the site were unsuccessful, so information was retrieved instead from miRMaid²³ or miRNEST 2.0²⁴. Supplementary File 1 contains the relevant count data from the Ninomiya et al.¹⁹ and Yuan et al.²⁰ studies.

An earlier version of this article can be found on bioRxiv (https://doi.org/10.1101/120634).

Results

Data evaluation

A cross-check of the source files and articles shows that the plasma data evaluated by Liu et al. were from 198 plasma samples, not 410 as reported. Ninomiya et al. sequenced six human plasma samples, six PBMC samples, and 11 cultured cell lines¹⁹. Yuan et al. sequenced 192 human plasma libraries (prepared from polymer-precipitated plasma particles)²⁰. Each library was sequenced once, and then a second time to increase total reads. Counts were presented as reads per million mapped reads (rpm)²⁰. In contrast, Liu et al. appear to have reported total mapped reads in their data table¹⁸. Yuan et al. also set an expression cutoff of 32 rpm (log2 rpm of 5 or above). With an average 12.5 million reads per sample (the sum of the two runs per library), and, on average, about half of the sequences mapped, the 32 rpm cutoff would translate to around 200 total reads in the average sample as mapped by Liu et al.¹⁸.

Only one putative plant miRNA above background levels

Consulting the Liu et al. mapping table¹⁸ and the SRA, results from duplicate sequencing runs from the Yuan et al. dataset were combined, and two samples without reliable replicates were eliminated. A total of 1294 putative plant miRNAs had at least one mapped read in at least one of the remaining 190 samples. However, many of these miRNAs were identical orthologs or paralogs, and most were mapped at one or fewer rpm on average, and in only a small minority of samples. Across all samples, only one putative plant miRNA mapped above a median 200 read cutoff, roughly corresponding to the 32 rpm cutoff of Yuan et al. (Table 1). All other RNAs, including previously reported xenomiRs such as MIR159a, MIR168a, and the plant ribosomal degradation fragment MIR2911^25–27, were thus below the level of background noise established by the original investigators. Indeed, previously reported xenomiRs were mapped in few samples and below 1 rpm. The absence of these RNAs is confirmed by Liu et al.’s analysis of the Ninomiya, et al. study¹⁹, where MIR159a, MIR168a, and MIR2911 mapped in none of the plasma samples. The single putative plant miRNA that mapped above background levels in this study was, again, peu-MIR2910 (Table 2).

Table 1. Summary of the most frequently mapping putative plant miRNAs in the Liu et al. analysis of datasets from Yuan et al..

Here, data from only 190 of 192 plasma samples were included, since all but the excluded 2 samples were successfully sequenced twice. miRNA inclusion criteria were: 1) Three total mapped reads according to Liu et al.’s data in at least 10% of the samples and 2) discoverable putative mature sequence through miRBase, miRMaid, or miRNEST 2.0. An “estimated median rpm” value was calculated based on median total counts, average reads, and the midoint of the reported mapping percentage range. miRNAs with perfect human matches are in red. Note that only MIR2910 consistently exceeds the rpm threshold set by Yuan et al..

Putative miRNA	Samples w/ reads ≥3	Average total counts	Median total counts	Max	Est. median rpm in avg sample
peu-MIR2910	190	1143.4	1072.5	2020	180.6
peu-MIR2916	190	119.7	115	315	19.4
tae-MIR2005	178	8.7	9	23	1.5
peu-MIR2914	169	14.3	9	348	1.5
tae-MIR2018	167	5.9	6	14	1.0
ath-MIRf10482-akr	161	7.3	6	29	1.0
ppt-MIR896	147	4.6	4	15	0.7
ptc-MIRf12412-akr	47	2.7	2	18	0.3
peu-MIR2911	42	2.6	2	10	0.3
ppt-MIR894	39	2.3	2	18	0.3
ptc-MIRf12524-akr	28	1.8	1	5	0.2

Table 2. Putative plant miRNA mapping from the Ninomiya et al. dataset. This dataset consisted of both cellular and plasma miRNA.

Here, all results are shown in the left half of the table, and plasma results on the right. miRNA inclusion criteria were: 1) Three total mapped reads according to Liu et al.’s data in at least 10% of the samples (cells and plasma together) and 2) discoverable putative mature sequence through miRBase, miRMaid, or miRNEST 2.0. “Avg rpm” is calculated from the total mapped reads and total reads per sample (not mapped reads). Putative miRNAs that met inclusion criteria in the Yuan et al. study are italicized, and sequences with perfect human matches are in red.

	Cells (n=17) and plasma (n=6)					Plasma only (n=6)
Putative miRNA	Samples w/reads ≥3	Average	Median	Max	avg rpm	Samples w/ reads ≥3	Average	Median	Max	avg rpm
*peu-MIR2910*	21	370	41.5	5369	21.3	6	1210	480.5	5369	83.2
ptc-MIRf10804-akr	17	26	26	60	1.2	0			0	0
*ptc-MIRf12412-akr*	17	63	61	156	2.8	0			0	0
*tae-MIR2018*	17	39	29	163	1.7	0			0	0
*ptc-MIRf12524-akr*	10	13	10.5	31	0.4	2	16	16	31	0.4
*tae-MIR2005*	7	17	11	69	0.4	0			0	0
ath-MIRf10045-akr	4	5	4	10	0.1	0			0	0
ath-MIRf10046-akr	4	5	4	10	0.1	0			0	0
*peu-MIR2914*	3	26	11	81	0.3	3	33.7	19	81	1.2
peu-MIR2915	3	5	4.5	8	0.0	0			0	0

Lowering the threshold: still only a handful of possible xenomiRs

Since only one plant miRNA appeared to map consistently above background, the inclusion threshold of Yuan et al. was relaxed to include all miRNAs with three or more mapped reads (Liu et al. data) in 10% or more of the samples from either study. These are rather permissive criteria but may at least screen out some false positives due to amplification and sequencing errors. All samples from the Ninomiya study were included, despite the fact that most were not plasma. 11 miRNAs satisfied these criteria for the Yuan et al. data (Table 1). (One low-mapping miRNA was excluded because its sequence could not be found in miRBase^22,28, miRMaid²³, miRNEST 2.0²⁴ or indeed through any searches attempted.) 10 satisfied the criteria from the Ninomiya study (Table 2), including one sequence that was part of another (compare ath-MIRf10046-akr and ath-MIRf10045-ak, Table 3). However, if only the plasma samples from the latter study are considered, three miRNAs remain (Table 2). In total, 15 putative miRNAs satisfied the permissive inclusion criteria, including five (Yuan only), four (Ninomiya only), and six (both) (Table 3).

Table 3. Putative plant miRNAs mapped by Liu et al. from the Yuan et al. or Ninomiya et al. studies.

Inclusion criteria were: 1) Three total mapped reads according to Liu et al.’s data in at least 10% of the samples in the respective studies and 2) discoverable putative mature sequence through miRBase, miRMaid, or miRNEST 2.0. miRNA status was considered unlikely if miRBase listed the miRNA as a non-miRNA or if the sequence mapped to non-miRNA regions. Human matches were exact (with an example given), “partial” (at least 15 nt stretches with 100% identity), or as otherwise described. Note that the ath-MIRf10046-akr is found within the ath-MIRf10045-akr sequence.

Putative miRNA	Yuan et al. or Ninomiya et al.	Sequence	miRBase	miRNA status in plant	Human matches?	Example match
peu-MIR2910	Both	UAGUUGGUGGAGCGAUUUGUC	No	rRNA fragment	18s rRNA	NR_003286.2
peu-MIR2916	Yuan	UGGGGACUCGAAGACGAUCAUAU	Yes	Possible, but 20 nt maps to rRNA	Partial
tae-MIR2005	Both	GGGUGUAUAGCUCAGUUGG	No	Unlikely: plant mitochondrial genome	Partial
peu-MIR2914	Both	CAUGGUGGUGACGGGUGACGGAG	No	rRNA fragment	Partial
tae-MIR2018	Both	GCCCGUCUAGCUCAGUUGGU	No	Unlikely; maps to many plant transcripts	Partial
ath-MIRf10482-akr	Yuan	UCUACUCGACUAGGUGGUCGAGUGG	No	Maps to Arabidopsis	Partial
ppt-MIR896	Yuan	GUCAAUUUGGCCGAGUGGUUAAGGC	No	tRNA fragment	Partial
ptc-MIRf12412-akr	Both	GCUGGGAUUACAGGCGUGAGCCACC	No	Does not map to Populus	Many exact	XR_001736898.1
peu-MIR2911	Yuan	GGCCGGGGGACGGGCUGGGA	No	rRNA fragment	1 mismatch in a 20-nt stretch	NC_018921.2
ppt-MIR894	Yuan	CGUUUCACGUCGGGUUCACC	Yes	Yes, but other transcriptome matches	No
ptc-MIRf12524-akr	Both	CCUGUAAUCCCAGCUACUCGGG	No	Does not map to Populus	Many exact	NG_053018.1
ath-MIRf10045-akr	Ninomiya	UCUACUCGACCUGGUGGUCGAGUGGU	No	Unlikely; chromosomal region	Partial
ath-MIRf10046-akr	Ninomiya	CUCGACCUGGUGGUCGAGUGGU	No	Part of above sequence	Partial
peu-MIR2915	Ninomiya	CCCGUCUAGCUCAGUUGGUA	No	tRNA fragment; sequence found in many transcripts	Partial
ptc-MIRf10804-akr	Ninomiya	CCUGUAAUCCCAGCACUUUGG	No	Unlikely; microsatellite sequence	Many exact, also hsa-miR- 3929 precursor (1 mismatch)	XR_001736898.1 (antisense)

To miR or not to miR

As miRNA discovery, validation, and annotation has advanced, numerous reported miRNAs have been reclassified as degradation fragments of other noncoding RNAs (ncRNAs). A classic example is MIR2911, a plant rRNA degradation fragment that has been misidentified as a microRNA. Interestingly, only 2 of the 15 miRNAs identified as plant miRNAs in this study are annotated in miRBase. Although some of these sequences may represent rare or unusually structured miRNAs, several are part of non-miRNA ncRNAs or other sequences that seem unlikely, at least at first glance, to give rise to microRNAs. Among the apparently misidentified miRNAs is MIR2910, the most abundant plant miRNA identified by Liu et al.. The MIR2910 sequence, UAGUUGGUGGAGCGAUUUGUC, is found in the highly conserved and expressed large subunit (LSU) rRNA of plants, and has been specifically removed from miRBase as a non-miRNA. Even the two identified miRNAs that remain in miRBase, MIR2916 and MIR894, are not above question. A 20 nucleotide stretch of MIR2916 map to rRNA, while the full MIR894 sequence appears to be found in a variety of plant transcripts.

Human sequences in the plant database and vice-versa

Curiously, several sequences did not map to the species to which they were ascribed by the PMRD²¹. Unfortunately, the PMRD could not be accessed directly during this study; however, other databases appear to provide access to its contents. Specifically, ptc-MIRf12412-akr and ptc-MIRf12524-akr did not map to Populus or to other plants. The poplar tree is also not a common dietary staple of human populations. In contrast, both sequences mapped with 100% identity and coverage to numerous human sequences (Table 3). ptc-MIRf10804-akr had numerous 100% identity human matches, plus a 1-mismatch alignment to the human miR-3929 precursor. Other miRNAs, including MIR2911, also displayed some lesser degree of matching to human transcripts or the genome. Strikingly, the putative MIR2910 sequence is not only a fragment of plant rRNA; it has a 100% coverage, 100% identity match in the human 18S rRNA (see NR_003286.2 in GenBank; Table 3). These matches of putative plant RNAs with human sequences are difficult to reconcile with the statement of Liu et al. that BLAST of putative plant miRNAs "resulted in zero alignment hit"¹⁸, suggesting that perhaps a mistake was made, and that the BLAST procedure was performed incorrectly.

Discussion

In mammalian studies, mapping of MIR2910 and other dubious plant miRNAs is best explained as mapping of human degradome fragments to plant RNAs that are in some cases genuine sequences but not miRNAs, and in other cases, human sequences that have contaminated plant RNA samples and databases. Re-analysis of the results of Liu et al.¹⁸ thus echoes the recent findings of Kang, Bang-Berthelsen, and colleagues¹³, as well as previous negative findings surrounding dietary xenomiRs, summarized above. A stringent data analysis procedure, such as filtering all reads against the ingesting organism genome/transcriptome with one or two mismatches, then requiring perfect matches of remaining reads against plant or other foreign organisms, would engender higher confidence that “foreign” RNAs are not simply amplification or sequencing artifacts. Indeed, pre-mapping to the ingesting organism’s genome may not be sufficient; as shown¹³, the largest number of xenomiRs in some human studies are from rodents, likely because of proximity in research laboratories. Therefore, it may be best to screen against mammalian sequences in general, and perhaps also against widespread microbe contaminants. Of course, even the most stringent analysis procedures cannot distinguish a physical contaminant from a “real” read; therefore strict process controls are also needed to assess possible contamination. In general, such controls have not been done in existing studies.

This report underlines the danger in assuming that xenomiRs in mammalian material originate from the diet. When the species and roles are reversed—for example, with the finding of human sequences in a list of poplar tree miRNAs—few analysts would conclude that poplar trees consume humans. The simplest explanation is that the sequenced plant material was contaminated with human nucleic acid. In the same way, the extremely low-level, variable, and batch-effect prone concentrations of several plant sequences in human plasma and tissue could be due to uptake from the diet, albeit at levels far too low to affect physiologic processes. However, artifact remains the simplest explanation.

Data availability

Data used in these analyses were downloaded from the supplementary materials of Liu et al.¹⁸ and are summarized in Supplementary File 1. Source data for the Ninomiya, et al. study¹⁹ are under DRA002550, DRX021324–DRX021346, and DRR023270–DRR023292 (DNA Data Bank of Japan), and, for the Yuan, et al. study²⁰, available as GSE71008 (Gene Expression Omnibus).

Competing interests

No competing interests were disclosed.

Grant information

The author(s) declared that no grants were involved in supporting this work.

Supplementary material

Supplementary File 1: Tabs for the miRNA counts from the Yuan et al. and Ninomiya et al. datasets.

Click here to access the data.

F1000 recommended

References

1. Zhang L, Hou D, Chen X, et al.: Exogenous plant MIR168a specifically targets mammalian LDLRAP1: evidence of cross-kingdom regulation by microRNA. Cell Res. 2012; 22(1): 107–126. PubMed Abstract | Publisher Full Text | Free Full Text
2. Chin AR, Fong MY, Somlo G, et al.: Cross-kingdom inhibition of breast cancer growth by plant miR159. Cell Res. 2016; 26(2): 217–28. PubMed Abstract | Publisher Full Text | Free Full Text
3. Liang H, Zhang S, Fu Z, et al.: Effective detection and quantification of dietetically absorbed plant microRNAs in human plasma. J Nutr Biochem. 2015; 26(5): 505–512. PubMed Abstract | Publisher Full Text
4. Baier SR, Nguyen C, Xie F, et al.: MicroRNAs Are Absorbed in Biologically Meaningful Amounts from Nutritionally Relevant Doses of Cow Milk and Affect Gene Expression in Peripheral Blood Mononuclear Cells, HEK-293 Kidney Cell Cultures, and Mouse Livers. J Nutr. 2014; 144(10): 1495–500. PubMed Abstract | Publisher Full Text | Free Full Text
5. Snow JW, Hale AE, Isaacs SK, et al.: Ineffective delivery of diet-derived microRNAs to recipient animal organisms. RNA Biol. 2013; 10(7): 1107–1116. PubMed Abstract | Publisher Full Text | Free Full Text
6. Witwer KW, McAlexander MA, Queen SE, et al.: Real-time quantitative PCR and droplet digital PCR for plant miRNAs in mammalian blood provide little evidence for general uptake of dietary miRNAs: Limited evidence for general uptake of dietary plant xenomiRs. RNA Biol. 2013; 10(7): 1080–1086. PubMed Abstract | Publisher Full Text | Free Full Text
7. Dickinson B, Zhang Y, Petrick JS, et al.: Lack of detectable oral bioavailability of plant microRNAs after feeding in mice. Nat Biotechnol. 2013; 31(11): 965–967. PubMed Abstract | Publisher Full Text
8. Tosar JP, Rovira C, Naya H, et al.: Mining of public sequencing databases supports a non-dietary origin for putative foreign miRNAs: underestimated effects of contamination in NGS. RNA. 2014; 20(6): 754–757. PubMed Abstract | Publisher Full Text | Free Full Text
9. Micó V, Martín R, Lasunción MA, et al.: Unsuccessful Detection of Plant MicroRNAs in Beer, Extra Virgin Olive Oil and Human Plasma After an Acute Ingestion of Extra Virgin Olive Oil. Plant Foods Hum Nutr. 2016; 71(1): 102–8. PubMed Abstract | Publisher Full Text
10. Auerbach A, Vyas G, Li A, et al.: Uptake of dietary milk miRNAs by adult humans: a validation study [version 1; referees: 3 approved]. F1000Res. 2016; 5: 721. PubMed Abstract | Publisher Full Text | Free Full Text
11. Witwer KW: Contamination or artifacts may explain reports of plant miRNAs in humans. J Nutr Biochem. 2015; 26(12): 1685. PubMed Abstract | Publisher Full Text
12. Lusk RW: Diverse and widespread contamination evident in the unmapped depths of high throughput sequencing data. PLoS One. 2014; 9(10): e110808. PubMed Abstract | Publisher Full Text | Free Full Text
13. Kang W, Bang-Berthelsen CH, Holm A, et al.: Survey of 800+ data sets from human tissue and body fluid reveals xenomiRs are likely artifacts. RNA. 2017; 23(4): 433–445. PubMed Abstract | Publisher Full Text | Free Full Text
14. Zhang Y, Wiggins BE, Lawrence C, et al.: Analysis of plant-derived miRNAs in animal small RNA datasets. BMC Genomics. 2012; 13: 381. PubMed Abstract | Publisher Full Text | Free Full Text
15. Bağcı C, Allmer J: One Step Forward, Two Steps Back; Xeno-MicroRNAs Reported in Breast Milk Are Artifacts. PLoS One. 2016; 11(11): e0145065. PubMed Abstract | Publisher Full Text | Free Full Text
16. Witwer KW, Hirschi KD: Transfer and functional consequences of dietary microRNAs in vertebrates: concepts in search of corroboration: negative results challenge the hypothesis that dietary xenomiRs cross the gut and regulate genes in ingesting vertebrates, but important questions persist. Bioessays. 2014; 36(4): 394–406. PubMed Abstract | Publisher Full Text | Free Full Text
17. Zheng LL, Deng KW, Deng AC, et al.: Exo-miRExplorer: A Comprehensive Resource for Exploring and Comparatively Analyzing Exogenous MicroRNAs. Front Microbiol. 2017; 8: 126. PubMed Abstract | Publisher Full Text | Free Full Text
18. Liu YC, Chen WL, Kung WH, et al.: Plant miRNAs found in human circulating system provide evidences of cross kingdom RNAi. BMC Genomics. 2017; 18(Suppl 2): 112. PubMed Abstract | Publisher Full Text | Free Full Text
19. Ninomiya S, Kawano M, Abe T, et al.: Potential small guide RNAs for tRNase ZL from human plasma, peripheral blood mononuclear cells, and cultured cell lines. PLoS One. 2015; 10(3): e0118631. PubMed Abstract | Publisher Full Text | Free Full Text
20. Yuan T, Huang X, Woodcock M, et al.: Plasma extracellular RNA profiles in healthy and cancer patients. Sci Rep. 2016; 6: 19413. PubMed Abstract | Publisher Full Text | Free Full Text
21. Zhang Z, Yu J, Li D, et al.: PMRD: plant microRNA database. Nucleic Acids Res. 2010; 38(Database issue): D806–D813. PubMed Abstract | Publisher Full Text | Free Full Text
22. Kozomara A, Griffiths-Jones S: miRBase: annotating high confidence microRNAs using deep sequencing data. Nucleic Acids Res. 2014; 42(Database issue): D68–73. PubMed Abstract | Publisher Full Text | Free Full Text
23. Jacobsen A, Krogh A, Kauppinen S, et al.: miRMaid: a unified programming interface for microRNA data resources. BMC Bioinformatics. 2010; 11: 29. PubMed Abstract | Publisher Full Text | Free Full Text
24. Szczesniak MW, Makalowska I: miRNEST 2.0: a database of plant and animal microRNAs. Nucleic Acids Res. 2014; 42(Database issue): D74–D77. PubMed Abstract | Publisher Full Text | Free Full Text
25. Zhou Z, Li X, Liu J, et al.: Honeysuckle-encoded atypical microRNA2911 directly targets influenza A viruses. Cell Res. 2015; 25(1): 39– 49. PubMed Abstract | Publisher Full Text | Free Full Text
26. Yang J, Hotz T, Broadnax L, et al.: Anomalous uptake and circulatory characteristics of the plant-based small RNA MIR2911. Sci Rep. 2016; 6: 26834. PubMed Abstract | Publisher Full Text | Free Full Text
27. Yang J, Kongchan N, Primo Planta C, et al.: The atypical genesis and bioavailability of the plant-based small RNA MIR2911: bulking up while breaking down. Mol Nutr Food Res. 2017; 61(9): 1600974. PubMed Abstract | Publisher Full Text | Free Full Text
28. Griffiths-Jones S, Grocock RJ, van Dongen S, et al.: miRBase: microRNA sequences, targets and gene nomenclature. Nucleic Acids Res. 2006; 34(Database issue): D140–4. PubMed Abstract | Publisher Full Text | Free Full Text

Comments on this article Comments (0)

Version 1

VERSION 1 PUBLISHED 28 Feb 2018

Author details Author details

¹ Department of Molecular and Comparative Pathobiology, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA
² Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA

Kenneth W. Witwer
Roles: Conceptualization, Data Curation, Formal Analysis, Investigation, Methodology, Project Administration, Writing – Original Draft Preparation, Writing – Review & Editing

Competing interests

No competing interests were disclosed.

Grant information

The author(s) declared that no grants were involved in supporting this work.

Article Versions (1)

version 1

Published: 28 Feb 2018, 7:244

https://doi.org/10.12688/f1000research.14060.1

Copyright

© 2018 Witwer KW. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Download

Export To

metrics

	Views	Downloads
F1000Research	-	-
PubMed Central Data from PMC are received and updated monthly.	-	-

Citations

0

SEE MORE DETAILS

CITE

how to cite this article

Witwer KW. Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma [version 1; peer review: 2 approved]. F1000Research 2018, 7:244 (https://doi.org/10.12688/f1000research.14060.1)

NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.

track

receive updates on this article

Track an article to receive email alerts on any updates to this article.

Open Peer Review

Version 1

VERSION 1

PUBLISHED 28 Feb 2018

Views

30

Reviewer Report 13 Apr 2018

Claus H. Bang-Berthelsen, Microbial Biotechnology and Biorefining, National Food Institute, Technical University of Denmark, Kongens Lyngby, Denmark

Approved

https://doi.org/10.5256/f1000research.15294.r31319

K. W. Witwer presents some interesting findings in his brief report: Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma. I consider the brief report scientifically good as well as well written.

... Continue reading

K. W. Witwer presents some interesting findings in his brief report: Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma. I consider the brief report scientifically good as well as well written.

Additionally, I would like to recognize the effort made by K. W. Witwer on examination of the methodology and critical reviewing a recent publication by Liu and colleagues in 2017¹. Here Liu et al. report plant cross kingdom RNAi in two human sRNA plasma sequencing studies. Here Witwer identify a number of methodology issues in the Liu et al. paper by reanalyzing the public available data that were used in their paper. Witwer concludes that the most likely explanation for the Liu et al. reported plant RNA results, detected in the human plasma datasets, are traces of human degradome fragments and not of plant origin.

The central conclusion in the manuscript are line with the findings that Kang et al. 2017² reported based on a massive analysis of public available sRNA datasets comprising 10 billion sequencing reads. All in all supporting the null hypothesis that presence of xenomiRs are technical/contamination artifacts.

Based on the overall impression of the paper it is scientifically sound and I can fully support the conclusions.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

References

1. Liu Y, Chen W, Kung W, Huang H: Plant miRNAs found in human circulating system provide evidences of cross kingdom RNAi. BMC Genomics. 2017; 18 (S2). Publisher Full Text
2. Kang W, Bang-Berthelsen CH, Holm A, Houben AJ, et al.: Survey of 800+ data sets from human tissue and body fluid reveals xenomiRs are likely artifacts.RNA. 23 (4): 433-445 PubMed Abstract | Publisher Full Text

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: RNA biology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

CITE

Report a concern

Respond or Comment

Views

31

Reviewer Report 08 Mar 2018

Jens Allmer, Applied Bioinformatics, Bioscience, Wageningen University & Research, Wageningen, The Netherlands

Approved

https://doi.org/10.5256/f1000research.15294.r31318

The article ‘Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma’ by Kenneth W. Witwer addresses the recurring claim of plant xeno-microRNAs found in human plasma. Such xenomiRs are allegedly ingested and enriched in ... Continue reading

The article ‘Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma’ by Kenneth W. Witwer addresses the recurring claim of plant xeno-microRNAs found in human plasma. Such xenomiRs are allegedly ingested and enriched in human; and this time Liu et al. claim evidence for cross kingdom RNAi via this route. Thus far, similar claims could not stand up against thorough validation as, for example, we (Bagci and Allmer, 2016¹) and Kenneth W. Witwer (Auerbach et al. 2016²) have shown before.

Here, Witwer has a closer look at the article ‘Plant miRNAs found in human circulating system provide evidence of cross kingdom RNAi’ by Liu et al. 2017³. Liu et al. 2017 claim that the plant miRNAs are not contamination, but only checked whether they contain sequencing adapters. Other sources of contamination were not considered. Additionally, Liu et al. 2017 reported to have used BLAST to check the plant miRNAs they found against the human genome without any similarities. Conversely, Witwer was able to find full-length identical alignments for these sequences in the human genome. For example, peu-MIR2910 is claimed by Liu et al to be conserved within comestible plants but a quick check on miRBase reveals that it is dead entry and not considered a miRNA anymore (http://www.mirbase.org/cgi-bin/mirna_entry.pl?acc=MI0012633). Witwer correctly finds the mature sequence for this miRNA (UAGUUGGUGGAGCGAUUUGUC) in human while Liu et al. used the precursor sequence (UAGUUGGUGG AGCGAUUUGU CUGGUUAAUU CCGUUAACGA ACGAGACCUC AGCCUGCUA) for their search. I repeated the latter and found that the first 50 nucleotides are identical with several human RNAs (e.g.: NR_046235) which supports Witwer’s findings. It is of note, that PMRD is still not reachable and that the sequences I used were provided by Liu et al. in their commentary on Witwer’s article in biorxiv⁴.

Witwer points out that mapping results were not normalized which is supported by the original manuscript by Liu et al. However, such normalization is of essence especially when the number of observations is very low (spurious even?).

I fully support the conclusions Kenneth W. Witwer draws in this article.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

References

1. Bağcı C, Allmer J: One Step Forward, Two Steps Back; Xeno-MicroRNAs Reported in Breast Milk Are Artifacts.PLoS One. 2016; 11 (1): e0145065 PubMed Abstract | Publisher Full Text
2. Auerbach A, Vyas G, Li A, Halushka M, et al.: Uptake of dietary milk miRNAs by adult humans: a validation study.F1000Res. 2016; 5: 721 PubMed Abstract | Publisher Full Text
3. Liu Y, Chen W, Kung W, Huang H: Plant miRNAs found in human circulating system provide evidences of cross kingdom RNAi. BMC Genomics. 2017; 18 (S2). Publisher Full Text
4. Witwer KW: Alternative miRNAs: Human Sequences Misidentified As Plant miRNAs In Plant Studies And In Human Plasma. bioRxiv. 2017.

Competing Interests: No competing interests were disclosed.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

CITE

Report a concern

Respond or Comment

Comments on this article Comments (0)

Version 1

VERSION 1 PUBLISHED 28 Feb 2018

Open Peer Review

Reviewer Status

Reviewer Reports

	Invited Reviewers
	1	2
Version 1 28 Feb 18	read	read

Jens Allmer, Wageningen University & Research, Wageningen, The Netherlands
Claus H. Bang-Berthelsen, Technical University of Denmark, Kongens Lyngby, Denmark

Comments on this article

All Comments(0)

Add a comment

Sign up for content alerts

Browse by related subjects

Back to all reports

Reviewer Report

30 Views

13 Apr 2018 | for Version 1

Claus H. Bang-Berthelsen, Microbial Biotechnology and Biorefining, National Food Institute, Technical University of Denmark, Kongens Lyngby, Denmark

30 Views Cite this report Responses(0)

Approved

K. W. Witwer presents some interesting findings in his brief report: Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma. I consider the brief report scientifically good as well as well written.

Additionally, I would like to recognize the effort made by K. W. Witwer on examination of the methodology and critical reviewing a recent publication by Liu and colleagues in 2017¹. Here Liu et al. report plant cross kingdom RNAi in two human sRNA plasma sequencing studies. Here Witwer identify a number of methodology issues in the Liu et al. paper by reanalyzing the public available data that were used in their paper. Witwer concludes that the most likely explanation for the Liu et al. reported plant RNA results, detected in the human plasma datasets, are traces of human degradome fragments and not of plant origin.

The central conclusion in the manuscript are line with the findings that Kang et al. 2017² reported based on a massive analysis of public available sRNA datasets comprising 10 billion sequencing reads. All in all supporting the null hypothesis that presence of xenomiRs are technical/contamination artifacts.

Based on the overall impression of the paper it is scientifically sound and I can fully support the conclusions.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

References

1. Liu Y, Chen W, Kung W, Huang H: Plant miRNAs found in human circulating system provide evidences of cross kingdom RNAi. BMC Genomics. 2017; 18 (S2). Publisher Full Text
2. Kang W, Bang-Berthelsen CH, Holm A, Houben AJ, et al.: Survey of 800+ data sets from human tissue and body fluid reveals xenomiRs are likely artifacts.RNA. 23 (4): 433-445 PubMed Abstract | Publisher Full Text

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

RNA biology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

31 Views

08 Mar 2018 | for Version 1

Jens Allmer, Applied Bioinformatics, Bioscience, Wageningen University & Research, Wageningen, The Netherlands

31 Views Cite this report Responses(0)

Approved

The article ‘Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma’ by Kenneth W. Witwer addresses the recurring claim of plant xeno-microRNAs found in human plasma. Such xenomiRs are allegedly ingested and enriched in human; and this time Liu et al. claim evidence for cross kingdom RNAi via this route. Thus far, similar claims could not stand up against thorough validation as, for example, we (Bagci and Allmer, 2016¹) and Kenneth W. Witwer (Auerbach et al. 2016²) have shown before.

Here, Witwer has a closer look at the article ‘Plant miRNAs found in human circulating system provide evidence of cross kingdom RNAi’ by Liu et al. 2017³. Liu et al. 2017 claim that the plant miRNAs are not contamination, but only checked whether they contain sequencing adapters. Other sources of contamination were not considered. Additionally, Liu et al. 2017 reported to have used BLAST to check the plant miRNAs they found against the human genome without any similarities. Conversely, Witwer was able to find full-length identical alignments for these sequences in the human genome. For example, peu-MIR2910 is claimed by Liu et al to be conserved within comestible plants but a quick check on miRBase reveals that it is dead entry and not considered a miRNA anymore (http://www.mirbase.org/cgi-bin/mirna_entry.pl?acc=MI0012633). Witwer correctly finds the mature sequence for this miRNA (UAGUUGGUGGAGCGAUUUGUC) in human while Liu et al. used the precursor sequence (UAGUUGGUGG AGCGAUUUGU CUGGUUAAUU CCGUUAACGA ACGAGACCUC AGCCUGCUA) for their search. I repeated the latter and found that the first 50 nucleotides are identical with several human RNAs (e.g.: NR_046235) which supports Witwer’s findings. It is of note, that PMRD is still not reachable and that the sequences I used were provided by Liu et al. in their commentary on Witwer’s article in biorxiv⁴.

Witwer points out that mapping results were not normalized which is supported by the original manuscript by Liu et al. However, such normalization is of essence especially when the number of observations is very low (spurious even?).

I fully support the conclusions Kenneth W. Witwer draws in this article.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

References

1. Bağcı C, Allmer J: One Step Forward, Two Steps Back; Xeno-MicroRNAs Reported in Breast Milk Are Artifacts.PLoS One. 2016; 11 (1): e0145065 PubMed Abstract | Publisher Full Text
2. Auerbach A, Vyas G, Li A, Halushka M, et al.: Uptake of dietary milk miRNAs by adult humans: a validation study.F1000Res. 2016; 5: 721 PubMed Abstract | Publisher Full Text
3. Liu Y, Chen W, Kung W, Huang H: Plant miRNAs found in human circulating system provide evidences of cross kingdom RNAi. BMC Genomics. 2017; 18 (S2). Publisher Full Text
4. Witwer KW: Alternative miRNAs: Human Sequences Misidentified As Plant miRNAs In Plant Studies And In Human Plasma. bioRxiv. 2017.

Competing Interests

No competing interests were disclosed.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

[1] 1. Zhang L, Hou D, Chen X, et al.: Exogenous plant MIR168a specifically targets mammalian LDLRAP1: evidence of cross-kingdom regulation by microRNA. Cell Res. 2012; 22(1): 107–126. PubMed Abstract | Publisher Full Text | Free Full Text

[2] 2. Chin AR, Fong MY, Somlo G, et al.: Cross-kingdom inhibition of breast cancer growth by plant miR159. Cell Res. 2016; 26(2): 217–28. PubMed Abstract | Publisher Full Text | Free Full Text

[3] 3. Liang H, Zhang S, Fu Z, et al.: Effective detection and quantification of dietetically absorbed plant microRNAs in human plasma. J Nutr Biochem. 2015; 26(5): 505–512. PubMed Abstract | Publisher Full Text

[4] 4. Baier SR, Nguyen C, Xie F, et al.: MicroRNAs Are Absorbed in Biologically Meaningful Amounts from Nutritionally Relevant Doses of Cow Milk and Affect Gene Expression in Peripheral Blood Mononuclear Cells, HEK-293 Kidney Cell Cultures, and Mouse Livers. J Nutr. 2014; 144(10): 1495–500. PubMed Abstract | Publisher Full Text | Free Full Text

[5] 5. Snow JW, Hale AE, Isaacs SK, et al.: Ineffective delivery of diet-derived microRNAs to recipient animal organisms. RNA Biol. 2013; 10(7): 1107–1116. PubMed Abstract | Publisher Full Text | Free Full Text

[6] 6. Witwer KW, McAlexander MA, Queen SE, et al.: Real-time quantitative PCR and droplet digital PCR for plant miRNAs in mammalian blood provide little evidence for general uptake of dietary miRNAs: Limited evidence for general uptake of dietary plant xenomiRs. RNA Biol. 2013; 10(7): 1080–1086. PubMed Abstract | Publisher Full Text | Free Full Text

[7] 7. Dickinson B, Zhang Y, Petrick JS, et al.: Lack of detectable oral bioavailability of plant microRNAs after feeding in mice. Nat Biotechnol. 2013; 31(11): 965–967. PubMed Abstract | Publisher Full Text

[8] 8. Tosar JP, Rovira C, Naya H, et al.: Mining of public sequencing databases supports a non-dietary origin for putative foreign miRNAs: underestimated effects of contamination in NGS. RNA. 2014; 20(6): 754–757. PubMed Abstract | Publisher Full Text | Free Full Text

[9] 9. Micó V, Martín R, Lasunción MA, et al.: Unsuccessful Detection of Plant MicroRNAs in Beer, Extra Virgin Olive Oil and Human Plasma After an Acute Ingestion of Extra Virgin Olive Oil. Plant Foods Hum Nutr. 2016; 71(1): 102–8. PubMed Abstract | Publisher Full Text

[10] 10. Auerbach A, Vyas G, Li A, et al.: Uptake of dietary milk miRNAs by adult humans: a validation study [version 1; referees: 3 approved]. F1000Res. 2016; 5: 721. PubMed Abstract | Publisher Full Text | Free Full Text

[11] 11. Witwer KW: Contamination or artifacts may explain reports of plant miRNAs in humans. J Nutr Biochem. 2015; 26(12): 1685. PubMed Abstract | Publisher Full Text

[12] 12. Lusk RW: Diverse and widespread contamination evident in the unmapped depths of high throughput sequencing data. PLoS One. 2014; 9(10): e110808. PubMed Abstract | Publisher Full Text | Free Full Text

[13] 13. Kang W, Bang-Berthelsen CH, Holm A, et al.: Survey of 800+ data sets from human tissue and body fluid reveals xenomiRs are likely artifacts. RNA. 2017; 23(4): 433–445. PubMed Abstract | Publisher Full Text | Free Full Text

[14] 14. Zhang Y, Wiggins BE, Lawrence C, et al.: Analysis of plant-derived miRNAs in animal small RNA datasets. BMC Genomics. 2012; 13: 381. PubMed Abstract | Publisher Full Text | Free Full Text

[15] 15. Bağcı C, Allmer J: One Step Forward, Two Steps Back; Xeno-MicroRNAs Reported in Breast Milk Are Artifacts. PLoS One. 2016; 11(11): e0145065. PubMed Abstract | Publisher Full Text | Free Full Text

[16] 16. Witwer KW, Hirschi KD: Transfer and functional consequences of dietary microRNAs in vertebrates: concepts in search of corroboration: negative results challenge the hypothesis that dietary xenomiRs cross the gut and regulate genes in ingesting vertebrates, but important questions persist. Bioessays. 2014; 36(4): 394–406. PubMed Abstract | Publisher Full Text | Free Full Text

[17] 17. Zheng LL, Deng KW, Deng AC, et al.: Exo-miRExplorer: A Comprehensive Resource for Exploring and Comparatively Analyzing Exogenous MicroRNAs. Front Microbiol. 2017; 8: 126. PubMed Abstract | Publisher Full Text | Free Full Text

[18] 18. Liu YC, Chen WL, Kung WH, et al.: Plant miRNAs found in human circulating system provide evidences of cross kingdom RNAi. BMC Genomics. 2017; 18(Suppl 2): 112. PubMed Abstract | Publisher Full Text | Free Full Text

[19] 19. Ninomiya S, Kawano M, Abe T, et al.: Potential small guide RNAs for tRNase ZL from human plasma, peripheral blood mononuclear cells, and cultured cell lines. PLoS One. 2015; 10(3): e0118631. PubMed Abstract | Publisher Full Text | Free Full Text

[20] 20. Yuan T, Huang X, Woodcock M, et al.: Plasma extracellular RNA profiles in healthy and cancer patients. Sci Rep. 2016; 6: 19413. PubMed Abstract | Publisher Full Text | Free Full Text

[21] 21. Zhang Z, Yu J, Li D, et al.: PMRD: plant microRNA database. Nucleic Acids Res. 2010; 38(Database issue): D806–D813. PubMed Abstract | Publisher Full Text | Free Full Text

[22] 22. Kozomara A, Griffiths-Jones S: miRBase: annotating high confidence microRNAs using deep sequencing data. Nucleic Acids Res. 2014; 42(Database issue): D68–73. PubMed Abstract | Publisher Full Text | Free Full Text

[23] 23. Jacobsen A, Krogh A, Kauppinen S, et al.: miRMaid: a unified programming interface for microRNA data resources. BMC Bioinformatics. 2010; 11: 29. PubMed Abstract | Publisher Full Text | Free Full Text

[24] 24. Szczesniak MW, Makalowska I: miRNEST 2.0: a database of plant and animal microRNAs. Nucleic Acids Res. 2014; 42(Database issue): D74–D77. PubMed Abstract | Publisher Full Text | Free Full Text

[25] 25. Zhou Z, Li X, Liu J, et al.: Honeysuckle-encoded atypical microRNA2911 directly targets influenza A viruses. Cell Res. 2015; 25(1): 39– 49. PubMed Abstract | Publisher Full Text | Free Full Text

[26] 26. Yang J, Hotz T, Broadnax L, et al.: Anomalous uptake and circulatory characteristics of the plant-based small RNA MIR2911. Sci Rep. 2016; 6: 26834. PubMed Abstract | Publisher Full Text | Free Full Text

[27] 27. Yang J, Kongchan N, Primo Planta C, et al.: The atypical genesis and bioavailability of the plant-based small RNA MIR2911: bulking up while breaking down. Mol Nutr Food Res. 2017; 61(9): 1600974. PubMed Abstract | Publisher Full Text | Free Full Text

[28] 28. Griffiths-Jones S, Grocock RJ, van Dongen S, et al.: miRBase: microRNA sequences, targets and gene nomenclature. Nucleic Acids Res. 2006; 34(Database issue): D140–4. PubMed Abstract | Publisher Full Text | Free Full Text

Alternative miRNAs? Human sequences misidentified as plant miRNAs in plant studies and in human plasma

Abstract

Keywords

Introduction

Methods

Results

Data evaluation

Only one putative plant miRNA above background levels

Table 1. Summary of the most frequently mapping putative plant miRNAs in the Liu et al. analysis of datasets from Yuan et al..

Table 2. Putative plant miRNA mapping from the Ninomiya et al. dataset. This dataset consisted of both cellular and plasma miRNA.

Lowering the threshold: still only a handful of possible xenomiRs

Table 3. Putative plant miRNAs mapped by Liu et al. from the Yuan et al. or Ninomiya et al. studies.

To miR or not to miR

Human sequences in the plant database and vice-versa

Discussion

Data availability

Competing interests

Grant information

Supplementary material

References

Comments on this article Comments (0)

Open Peer Review

Comments on this article Comments (0)

Open Peer Review

Reviewer Status

Reviewer Reports

Comments on this article

Browse by related subjects

Competing Interests Policy

Stay Updated