Keywords
Open access, Journal, Medicine, Bibliometrics, Citation
This article is included in the Research on Research, Policy & Culture gateway.
Open access, Journal, Medicine, Bibliometrics, Citation
Open access (OA) journals allow free (access to/availability of) academic articles, they enable any user to read, search, download, share, use them for indexing, print the full texts, or utilize them as data for software without being charged1. Over the past 20 years, there has been an increase in the number of OA medical journals. According to Web of Science, published OA articles as a proportion of total publications increased from 9.5% to 24% from 1998 to 2018. These OA journals provide an easily accessed source of information, a source that is accessible even for developing and low income countries2.
Bibliometric analysis are methods or applications used to measure the influence of authors or scientific papers, of which, citation analysis is the most commonly used methods3. Now several citation databases have become available, with the three largest being Web of Science, Scopus and PubMed. These databases record the number of times that a journal article has been cited by other papers4. The use of bibliometric analysis is becoming more popular to assess the performance of different aspects of the scholarly and scientific fields. Analysis can be at the level of the researchers themselves, journals, departments, universities, national organizations, and even entire nations5–8. There are several databases that can be used to perform the bibliometric analysis, with each database having its own characteristics; these include Google Scholar, Pubmed (Only biomedical citations), Scopus, and Web of Science4. According to the number, coverage, and quality of citations covered by the databases, Scopus has wide coverage of high quality journals, compared to high number of citations at the expense of quality for Google Scholar, and high quality at the expense of number of citations for Web of Science9–11.
It is claimed that the emergence of OA journals has led to better dissemination of knowledge with the additional benefit of more citations for the authors, although this is still a matter of debate12. In this study, we aim to study the OA status of medical journals and the impact of the open-access status on journal indices using the Scopus database.
We collected data on the included journals from Scopus Source List on 1st November 2018 (see Underlying data13). We filtered the list for medical journals (which include all specialties in medicine, as per Scopus categorization).
For each journal, we extracted the following citation metrics: Citation count, Percent Cited, CiteScore, CiteScore Percentile, SCImago Journal Rank, Source Normalized Impact per Paper (SNIP), and SCImago Quartiles. Details about these metrics and how they are calculated can be found on Scopus website.
Moreover, scholarly output is defined as sum of documents published in the serial title (e.g. 2017) in the 3 years prior to the year of the metric (e.g. 2014 – 16). Open access Journals covered by Scopus are indicated as Open Access if the journal is listed in the Directory of Open Access Journals (DOAJ) and/or the Directory of Open Access Scholarly Resources (ROAD).
We used SPSS version 22.0 (Chicago, USA) in our analysis. We used means (± standard deviation) to describe continuous variables (i.e. journal indices). We used counts (frequency) to describe other nominal variables (i.e. publishers and OA journals). We performed Mann-Whitney tests to analyze the difference between measurements and OA status, and we presented data as medians (25% to 75% quartiles). To analyze open access journals between radiology and medicine, we used the weighting cases function in SPSS and a Chi-square test. All underlying assumptions were met, unless otherwise indicated. A p value of 0.05 was considered as significant.
In the 2017 Scopus list of journals, there was 5835 medical journals. Regarding the 5 most common publishers, 890 (15.3%) journals were from Elsevier, 653 (11.2%) Springer Nature, 196 (6.8%) Taylor & Francis, 360 (6.2%) Wiley-Blackwell, and 304 (5.2%) Wolters Kluwer. 1293 (22.2%) journals were OA journals. Table 1 indicates the minimum, maximum, mean, and standard deviation of medical journal indices.
Upon analyzing the difference between medical OA and non-OA journals, we found significant differences in the following indices:
CiteScore (p< 0.001): with a median of 1.19 (25–75%: 0.53–2.21) for OA journals, and a median of 1.06 (25–75%: 0.26–2.18) for non-OA journals.
Scholarly output (p< 0.001): with a median of 157 (25–75%: 76–319.5) for OA, and a median of 205 (25–75%: 107–423) for non-OA journals.
Percent cited (p< 0.001): with a median of 52% (25–75%: 32%-70%) for OA, and a median of 48% (25–75%: 19%–68%) for non-OA journals.
SNIP (p< 0.001): with a median of 0.706 (25–75%: 0.370–1.023) for OA, and a median of 0.617 (25–75%: 0.176–1.013) for non-OA journals.
Upon comparing open access journals between the 5 most common publishers, we found a significant difference (p< 0.001). Post-hoc analysis showed that Wiley-Blackwell has significantly lower number of open access journals 16 (4.4%) open access journals compared to others. Table 2 shows the open access status for the most common publishers.
Our study found that OA medical journals had significantly higher CiteScores, Percent cited and SNIP; which is consistent with a number of previous studies made across a variety of disciplines including philosophy, political science, engineering, mathematics, physics, computer science and agriculture; all of which concluded that open access publications have a greater research impact (higher citation rate) than non-open access publications12,14–16. On the other hand, in a randomized controlled trial conducted on 11 biological and medical journals, it was found that only 2 of these journals showed positive and significant OA effects. In addition, it was found that OA advantage is declining by about 7% per year, from 32% in 2004 to 11% in 200717. Chua et al. found that there was significantly more citations in OA articles than in non-OA articles within almost identical journals’ impact factor18. Moreover, comparing citations in OA and non-OA articles in the same journal showed significant citation privilege for OA publications in several studies. For example, for the Journal of Postgraduate Medicine a comparison of citations per 100 articles per year before and after the journal became open access showed an increase between 3 and 4.5 times in citations19. In a longitudinal study of a cohort of OA and non-OA articles, it was shown that OA articles are cited earlier, and almost 2 times more frequently than non-OA articles in the first 4–16 months after publication in the same journal20. Regardless of all the aforementioned findings, our study found that non-OA medical journals have significantly higher Scholarly Output which can be strongly linked to the fact that most non-OA medical journals have been established years before OA journals, which have only recently emerged21.
We found that the number of OA journals varied among publishers, with Whiley-Blackwell having the least, with only 16 journals (4.4%), and the most with Springer Nature (206, 31.5%). In a previous study that analyzed OA articles published by different publishers, regardless of the discipline, they found that Elsevier had the highest number of OA articles, followed by Springer Nature and Whiley-Blackwell22. A longitudinal study comparing hybrid open access articles between publishers found great variation depending on the discipline23. For instance, medicine is the discipline which most frequently publishes in hybrid OA23.
Our study has potential limitations. In this study, we didn’t account for the effect of publishing OA articles in non-OA journals (hybrid journals), as “Gold” OA publishing (i.e. fully OA journals) relates to publication of articles that are freely available to view and these may occur in OA or hybrid journals. Moreover, future studies should consider analyzing specialties within medicine (e.g. oncology), where we believe there will be variations in the effect of OA publishing within these specialties.
Harvard Dataverse: Medical journals. https://doi.org/10.7910/DVN/YYUTGG13.
This project contains the following underlying data:
Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Yes
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Tropical Medicine, Editing & Publishing
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Yes
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Cardiology and QI
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Partly
If applicable, is the statistical analysis and its interpretation appropriate?
Partly
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Surgery, Medical education, microflora
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Partly
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Yes
References
1. Roldan-Valadez E, Orbe-Arteaga U, Rios C: Eigenfactor score and alternative bibliometrics surpass the impact factor in a 2-years ahead annual-citation calculation: a linear mixed design model analysis of Radiology, Nuclear Medicine and Medical Imaging journals.Radiol Med. 2018; 123 (7): 524-534 PubMed Abstract | Publisher Full TextCompeting Interests: No competing interests were disclosed.
Reviewer Expertise: Bibliometrics, linear-mixed models, statistical methods, medical imaging.
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||||
---|---|---|---|---|
1 | 2 | 3 | 4 | |
Version 1 07 Mar 19 |
read | read | read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)