ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Brief Report
Revised

National culture as a correlate of research performance and impact

[version 2; peer review: 2 approved with reservations]
Previously titled: National culture as a correlate of research impact and productivity
PUBLISHED 24 Sep 2019
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Research on Research, Policy & Culture gateway.

Abstract

National culture has been overlooked in discussions related to research performance and impact owing to individual, socio-political structure, and economic factors. This study shows the relationships between the dimensions of cultural value orientation of the nation and research performance & impact. More than 60 countries were included and Spearman correlation analysis was employed. The variables were taken from Geert Hofstede and Scimago Journal & Country Rank worksheets. This study found that (1) Power distance - the positive inclination of the culture toward power disparities among people - is negatively correlated with research impact; (2) Individualism - the level of independence a society keeps up among its individuals -  are positively correlated with research performance and research impact; (3) Indulgence - the degree to which society members do not attempt to control their urges - is positively correlated with research impact; and (4) after controlling the Log GDP per capita, uncertainty avoidance - the  manner in which that a society seeks to manage the actuality that the future can never be controlled - is negatively correlated with research impact.

Keywords

research impact, research productivity, national culture, individualism, indulgence, power distance, citations per document, self citations

Revised Amendments from Version 1

I changed the title of the article based on two components formed, i.e. research performance and impact, as the results of the principal component analysis on the Scimago Journal & Country Rank bibliometric variables. I added a table containing the results of the non-parametric test of differences on research performance and impact between the world’s regions. The table on descriptive statistics was constructed more comprehensively. A figure was added depicting PCA component plots.Two figures were added in the form of scatter plots that show the coordinate points connecting the national culture dimensions with research performance and impact of the highest and lowest groups. Discussions related to tables and figures were presented in more depth.

To read any peer review reports and author responses for this article, follow the "read" links in the Open Peer Review table.

Introduction

Makri (2018) recently released a report on the increasing number of publications in various countries. She stated that it’s unclear what has triggered and driven the strong gains in Egypt and Pakistan. Throughout the report, various variables believed to be responsible for the increasing number of publications, such as indexation duration, funding, global engagement, international collaboration, and political policies on science and higher education, are explained.

Several predictors of research performance and impact had been identified, i.e. author characteristics, co-authorship networks, citation history, journal impact factors, tweets (Xiaomei et al., 2017), cohort effects (in terms of scientific discipline), age, career stages, gender, the country of origin of the PhD holders, and reward structure of the research enactment (Claudia & Francisco, 2007). They are mostly at the individual and institutional level. At the country level, the predictors are the number of universities, GDP per capita, control of corruption, civil liberties (Mueller et al., 2016), country’s wealth and population size, country’s value of research tradition, tenure and promotion criterion, experimental costs, IRB (Institutional Review Boards) review flexibility, language barrier, and the training of new young researchers (Demaria, 2009).

However, national cultural orientation (in this paper, the term is used interchangeably with: national culture, national cultural value, national culture dimension) is yet to be analyzed, with the present study assuming that individual, institutional, and structural factors are also influenced by the cultural values of a nation. Hofstede Insights (2019) defined culture as the collective mental programming of the human mind which distinguishes one group of people from another, consisting of six dimensions, i.e. (1) power distance (PDI) – acceptance on the unequal power distribution in a society; (2) uncertainty avoidance (UAI) – intolerance of ambiguity and uncustomary thoughts and practices; (3) individualism (IDV) – projection of individuals’ “I” in a society rather than “we” (collectivism); (4) masculinity (MAS) – the toughness and competitiveness rather than the tenderness and cooperativeness (femininity) orientation; (5) long term orientation (LTOWVS) – the society’s preference of time-honored rather than pragmatic approaches (short term normative orientation); and (6) indulgence (IVR) – the society facilitation towards a fun and enjoyable life rather than restraint (suppression of needs gratification by strict social norms).

National culture is relatively stable (Maseland & van Hoorn, 2017) and is widely used to explain various performances at the country level, such as learning and academic performance (Signorini et al., 2009). The present study hypothesized that there are correlations between the national culture dimensions and research performance indicators. The research performance is assumed to be mediated by research culture, and the culture experiences stimulations and challenges from the national culture.

Methods

All following data were retrieved on August 18, 2019, and compiled into a worksheet (see Underlying data (Abraham, 2019) as the material of this present analysis. Countries’ region, total documents/DOC, citable documents/CITA, citations/CIT, self-citations/SELF, H-index/HINDEX, and citations per document/CPD (1996–18 August 2019) were obtained from the Scimago Journal & Country Rank/SCIMAGOJR (https://www.scimagojr.com/countryrank.php?out=xls), while national cultural orientations (PDI=power distance, IDV=individualism, MAS=masculinity, UAI=uncertainty avoidance, LTOWVS=long term orientation, IVR=indulgence) were acquired from Geert Hofstede web site (https://geerthofstede.com/wp-content/uploads/2016/08/6-dimensions-for-website-2015-08-16.xls). Countries’ GDP per Capita (1993–2018) were taken from the World Bank Open Data (http://api.worldbank.org/v2/en/indicator/NY.GDP.PCAP.PP.CD?downloadformat=excel), being calculated as natural logarithm (ln) of the average measures.

Principal component analysis (PCA) and Independent-samples Kruskal-Wallis H Test were done using IBM SPSS Statistics version 25 for Windows to get two major components from dimensions reduction of DOC, CITA, CIT, SELF, HINDEX, and CPD, as well as comparison between countries’ regions in terms of the reduced dimensions. Correlation analysis was conducted using JASP version 0.10.2 for Windows, and Partial correlation analysis was conducted using IBM SPSS Statistics.

Results

The data analysis results are presented in Table 1.

Table 1. Summary of the study’s results.

TypeDisplayResults
Descriptive statistics
of SCIMAGOJR measures
Table 2The DOC, CITA, CIT, SELF, CPD, HINDEX data are not normally distributed.
Principal component analysis
of SCIMAGOJR measures
Table 3 & Figure 1There are 2 components extracted with a total variance explained 92.073%, namely:
      •   Component 1: “Research Performance” (a synthesis of DOC, CITA, CIT, SELF,
HINDEX)
      •   Component 2: “Research Impact” (based on CPD alone)
The correlation between Components is weak (< 0.2). It might be that CPD is more
difficult to manipulate or be an object of the author’s engineering.
Comparison between regions
(Kruskal-Wallis H Test result)
Table 4Mean comparisons result in terms of Research Performance:
      •    Eastern Europe > Latin America
      •    Eastern Europe > Pacific Region
      •    Eastern Europe > Africa
      •    Middle East > Latin America
      •    Middle East > Pacific Region
      •    Middle East > Africa
      •    Asiatic Region > Pacific Region
Mean comparisons result in terms of Research Impact:
      •    Latin America > Middle East
      •    Latin America > Asiatic Region
      •    Latin America > Eastern Europe
Descriptive statistics of
national culture, research
performance, and research
impact
Table 5The data is not normally distributed; therefore, correlation analysis was done with
Spearman's correlation.
Plots of national cultures,
research performance, and
Log GDP per capita
Figure 2
(missing scores
do not bring up
the line)
Based on low vs. high research performance criteria (< -0.30 σ vs. > 0.30 σ), it is
found that, among 33 countries (7 low vs. 26 high), (1) United States, (2) China,
(3) United Kingdom, (4) Germany, and (5) Japan are countries with the highest
research performance. Descriptively, in each of these countries, the national cultural
orientations that play roles the most and the least are, respectively:
(1) Individualism, long term orientation;
(2) Long term orientation, individualism;
(3) Individualism, uncertainty avoidance;
(4) Long term orientation, power distance;
(5) Masculinity, indulgence.
For countries with the lowest research performance, there is no data available on
their national cultural orientation.
Plots of national cultures,
research impact, and Log
GDP per capita
Figure 3
(missing scores
do not bring up
the line)
Based on low vs. high research impact criteria (< -1.50 σ vs. > 1.50 σ), it is found
that, among 25 countries (4 low vs. 21 high), (1) Anguilla, (2) Bermuda, (3) Gambia,
(4) Federated States of Micronesia, and (5) Belize are the countries with the highest
research impact.
Unfortunately, data are not yet available about the orientation of their cultural values.
The complete data (six cultural orientations) available are from (1) Belgium, and (2)
United Kingdom. Descriptively, in each of these countries, the cultural orientations
that play roles the most and the least are, respectively:
(1) Uncertainty avoidance, power distance;
(2) Individualism, uncertainty avoidance (as well as power distance).
For countries with the lowest research impact, there is no data available on national
cultural orientation.
Spearman’s correlationTable 6The results, with q (adjusted p) < 0.00714, are:
      •    PDI is negatively correlated with Research Impact
      •    IDV is positively correlated with Research Performance and Research Impact
      •    IVR is positively correlated with Research Impact
      •    LGDP is positively correlated with Research Performance
Partial correlation (controlling
LGDP)
Table 7The directions of correlation between variables are the same as the results of
Spearman's correlation above, but there is an additional new result:
      •    UAI is negatively correlated with Research Impact

DOC = Total documents (1996–18 August 2019); CITA = Total citable documents; CIT = Total citations; SELF = Total self-citations; CPD = Citations per document; HINDEX = H-index; PDI = Power distance; IDV = Individualism (vs. Collectivism); IVR = Indulgence (vs. Restraint); LGDP = Natural logarithm of averaged (1993–2018) GDP per capita. The operational definition of DOC, CITA, CIT, SELF, CPD, and HINDEX could be found at https://www.scimagojr.com/help.php

Discussion

The purpose of this study is to show whether there are correlations between national cultural values and research performance and impact. Because correlation is not causation, the following analysis and interpretation do not attempt to state definitively that there is a causal effect from one variable to another. Even though in this discussion cultural value orientation is often used as an explanation of research performance and impact, this is more due to the chronological flow that culture comes and envelops, engulfs a country first than the SCIMAGOJR measures. The argument is in line with the proposition of Sen (2004) that culture is a constituent of development and economic behavior, as expressed as follows:

“The furtherance of well-being and freedoms that we seek in development cannot but include the enrichment of human lives through … forms of cultural expression and practice, which we have reason to value …. Cultural influence can make a major difference to work ethics, responsible conduct, spirited motivation, dynamic management, entrepreneurial initiatives, willingness to take risks, and a variety of other aspects of human behavior which can be critical to economic success.” (pp. 39–40).

In other words, culture can influence public policy which regulates human capital; whereas, research performance and impact depends on human capital, in addition to the fact that research is a contributor to economic growth and development (Blanco et al., 2015). However, this study is cautious for not trapping itself in cultural determinism.

The limitation of SCIMAGOJR data

There are a number of things that need to be stated from the beginning of this discussion, namely: Firstly, the SCIMAGOJR data (Table 2) includes both journal articles, conference proceedings papers, and does not exclude other types of documents (i.e. short survey, review) (Guerrero-Bote & Moya-Anegón, 2012). A number of countries or institutions exclude non-journal articles from evaluating their performance (e.g. Suryani et al., 2013), so the applicability of the results of this study to these countries might be limited. In this present study, data from SCIMAGOJR is used because, among others, it can be downloaded for free.

Table 2. Descriptive statistics of SCIMAGOJR indicators (1996–18 August 2019).

DOCCITACITSELFCPDHINDEX
Valid239239239239239239
Missing000000
Mean226870.448208895.2384.041e +61.209e +614.289191.904
Std. Error of Mean62573.38956718.7791.372e +6584905.3780.45117.893
Std. Deviation967361.125876851.0472.122e +79.042e +66.967276.624
Variance9.358e +117.689e +114.501e +148.177e +1348.54176521.054
Shapiro-Wilk0.2310.2370.1720.1060.9050.637
p of Shapiro-Wilk< .001< .001< .001< .001< .001< .001
Minimum2.0001.0009.0000.0002.0001.000
Maximum1.207e +71.070e +72.977e +81.344e +852.3002222.000

DOC = Total documents; CITA = Total citable documents; CIT = Total citations; SELF = Total self-citations; CPD = Citations per document; HINDEX = H-index

Secondly, in a number of dimensions of research performance and impact measurement (Table 3, Figure 1), Scopus, which supplies the data of SCIMAGOJR, has a number of limitations; for example (1) Scopus has poor coverage of articles, conference papers, and book chapters compared to Crossref, Dimensions, Google Scholar, and Microsoft Academic; (2) Scopus is somewhat late in indexing in-press articles compared to all four; (3) Socially, Scopus does not support open citation (Harzing, 2019). The first two limitations may affect the accuracy of research performance and impact measurements. The third limitation of Scopus is offset by its advantages, namely Scopus is still an extensive source of quality citation data (van Eck et al., 2018).

Table 3. Component loadings of principal component analysis.

Component 1Component 2Correlation between
Components
KMO of Sampling
Adequacy
Bartlett’s Test of
Sphericity
CIT0.981-0.0430.1590.662χ2 (15) = 3759.508,
p = 0.000
CITA0.982-0.087
CPD0.1970.974
DOC0.987-0.083
HINDEX0.8330.140
SELF0.947-0.104
Variance Explained75.498%16.575%
Name of component
given by the author
Research
Performance
Research
Impact

Applied rotation method is direct oblimin; KMO (Kaiser-Meyer-Olkin > 0.6) and Bartlett’s (p < 0.05) assumption were fulfilled; DOC = Total documents; CITA = Total citable documents; CIT = Total citations; SELF = Total self-citations; CPD = Citations per document; HINDEX = H-index

f11e947c-c641-4b7d-a621-8be0300b2d07_figure1.gif

Figure 1. Component plots.

Research performance across regions

Based on comparisons between regions (Table 4), over the past 23 years (1996–2019) (1) both Eastern Europe and Middle East have better research performance than Latin America, Pacific Region, and Africa; (2) Asiatic region has better research performance than Pacific Region. However, from the aspect of research impact, Latin America outperforms the Middle East, Asiatic Region, and Eastern Europe. Those findings show that research performance and research impact (Table 5) are not always directly proportional, they can even be inversely correlated (Figure 2, Figure 3).

Table 4. Comparison of research performance and impact between regions.

VariableTest statisticVisualization of mean rankPairwise comparison
Research
Performance
(Component 1)
χ2 (6, N = 204) = 41.952,
p = 0.000
f11e947c-c641-4b7d-a621-8be0300b2d07_T1.gifThere are significant differences (marked with
yellow lines in the visualization) between:
•    Pacific Region & Middle East (p = 0.000)
•    Pacific Region & Eastern Europe (p = 0.000)
•    Latin America & Middle East (p = 0.038)
•    Latin America & Eastern Europe (p = 0.005)
•    Africa & Middle East (p = 0.036)
•    Africa & Eastern Europe (p = 0.004)
•    Pacific Region & Asiatic Region (p = 0.01)
Research Impact
(Component 2)
χ2 (6, N = 204) = 29.363,
p = 0.000
f11e947c-c641-4b7d-a621-8be0300b2d07_T2.gifThere are significant differences (marked with
yellow lines in the visualization) between:
•    Middle East & Latin America (p = 0.020)
•    Asiatic Region & Latin America (p = 0.023)
•    Eastern Europe & Latin America (p = 0.001)

p-values have been adjusted by the Bonferroni correction for multiple tests; the significance level is 0.05

Table 5. Descriptive statistics of national cultural orientations, research performance and impact.

PDIIDVMASUAILTOWVSIVRLGDPResearch
Performance
Research
Impact
Valid686868689091190239239
Missing1711711711711491484900
Mean59.11843.85348.60367.13246.06745.3749.0081.004e -174.766e -16
Std. Error of
Mean
2.6712.9302.4202.8202.5602.3640.0880.0650.065
Std.
Deviation
22.02324.16419.95623.25724.28722.5551.2081.0001.000
Variance485.031583.918398.243540.893589.838508.7481.4601.0001.000
Shapiro-Wilk0.9850.9420.9800.9510.9680.9780.9790.2640.915
p of Shapiro-
Wilk
0.5870.0030.3340.0100.0240.1200.006< .001< .001
Minimum11.0006.0005.0008.0000.0000.0006.442-0.303-1.800
Maximum104.00091.000110.000104.000100.000100.00011.61412.8105.201

PDI = Power distance; IDV = Individualism (vs. Collectivism); MAS = Masculinity (vs. Femininity); UAI = Uncertainty avoidance; LTOWVS = Long term (vs. Short term) Normative Orientation; IVR = Indulgence (vs. Restraint); LGDP = Natural logarithm of averaged (1993–2018) GDP per capita; Research Performance = Z-scores of Component 1 from Principal Component Analysis/PCA extraction (based on DOC, CITA, CIT, SELF, HINDEX); Research Impact = Z-scores of Component 2 from PCA extraction (based on CPD); PCA = Principal Component Analysis

f11e947c-c641-4b7d-a621-8be0300b2d07_figure2.gif

Figure 2. Plots of national cultures, research performance, and Log GDP per capita.

PDI = Power distance; IDV = Individualism; MAS = Masculinity; UAI = Uncertainty avoidance; LTOWVS = Long term orientation; IVR = Indulgence; Res_Perform = Research Performance; LGDP = Log GDP per capita.

f11e947c-c641-4b7d-a621-8be0300b2d07_figure3.gif

Figure 3. Plots of national cultures, research impact, and Log GDP per capita.

PDI = Power distance; IDV = Individualism; MAS = Masculinity; UAI = Uncertainty avoidance; LTOWVS = Long term orientation; IVR = Indulgence; Res_Perform = Research Performance; LGDP = Log GDP per capita.

Eastern Europe’s superiority in terms of research performance may be due to the rise of democracy, the emergence of the need for research excellence standards, the promotion of international research collaboration, and cooperation with international bodies (such as the World Bank) that enable these countries to enjoy large research grants (Henderson et al., 2012; Švab, 2004).

Henderson et al. (2012) further stated a fact about research culture in Eastern Europe, as follows:

“Though not a uniform phenomenon across all disciplines or countries, some participants noted that in CEE (Central and Eastern Europe) research tends to be more dependent on political power. This can relate both to the partisan provision of financial resources and to researchers’ ambitions to convince political actors.”

It appears that political activities are melting pots of the interests of academics, politicians, and research funders, which provide work opportunities that has implication in improving research performance in the region’s countries. Those interests are given “energy” by the belief of the people that “Our people are not perfect, but our culture is superior to others.” (Kim, 2018, para. 6).

Makri’s finding (2018) regarding the progressive research achievement of Egypt confirmed the finding that the Middle East has been able to surpass Latin America, the Pacific Region, and Africa in terms of research performance. Different from Eastern Europe, the performance in Middle East has drivers centripetalized on the publishing business. Although some of the Middle East countries are plagued with protracted conflict (Gul et al., 2015), Habibzadeh (2019) noted that there is a “meeting point” between the career interests of faculty members in universities and the business interests of publishing in the countries. This is exacerbated by the relaxation of the promotion standard of faculty members, so that a surge in publication occurs in Scopus indexed journals—that grow rapidly quantitatively in those countries, but of which many have transformed into predatory ones. Habibzadeh (2019, p. 4) conveyed more about the phenomenon:

“Recently, some indexing systems, like Scopus, have also pursued the same strategy and delisted some of the low-quality journals published in the Middle East and Iran. Although some of the editors and publishers of the delisted journals have attributed these events to political issues, to be honest, I, for one, believe that in most instances, they, themselves, should bear the brunt of the situations they have for their poor work quality.” (p. 4)

Noteworthy is the fact mentioned by Plackett (2015), that:

“The predatory journal industry exists on a spectrum—at one end, some such journals maintain they are conducting valid peer review. At the other end of the spectrum, predatory journals sometimes blackmail academics who eventually realize they’ve published in a journal with a negative reputation.” (para. 21)

That is, the issue of predatory journals in the Middle East is not an easy problem to evaluate. This argument is reinforced by Jones’ (2015) argument, that the flourish of predatory journals is not the real problem. The fundamental problem, according to Jones, is information inequality; in which case, the prosocial role of librarians and publishers to keep potential writers away from illegitimate journals may still be difficult to expect. It is not surprising that, based on the results of this present study, even though research performance of Middle East outperforms Latin America, in terms of research impact, the opposite occurs, i.e. Latin America outperforms the Middle East, also the Asiatic Region, and Eastern Europe.

Research impact across regions

Latin America’s superiority in terms of research impact cannot be separated from the orientation of studies that aspires to decolonize the research itself (International Institute of Social Studies, 2019), even beginning from the decolonization of consciousness (Garza, 2010). Decolonization of research in the context of Latin America has the meaning of restoring the authentic identity of society, from an oppressed condition—by “capitalism, hegemony, racism, classism, sexism, etc.” (Garza, p. 110)—to an emancipated situation. There is hope for reconnection of the daily lives of people and their families, communities, and even living creatures, from those that have been being alienated by the oppression. The assumption is, “You actually cannot have meaningful, impactful research unless you engage communities” (Janes, 2017, p. 114). Studies conducted in Latin America are very directed towards liberating the fate of the society, especially from marginalized conditions in various fields of life, such as in health, agricultural, environmental, social, and other domains.

Meanwhile, the issues of (de-)colonization are studied very seriously by countries that experience a similar fate and become huge energy for doing high impact research. This is because many problems “have been attributed to the impact of ongoing colonization” (Waldram, as cited in Marsh et al., 2015, p. 2). The activities of the academic community of Latin America are increasingly supported by the AmeliCA project, namely The Latin American Initiative which focuses on developing scientific communication systems that are non-commercial, academic-led, and cooperative (Aguado-López & Becerril-Garcia, 2019), so that could improve citations per document of scientific works in Latin America.

According to SCIMAGOJR data (https://www.scimagojr.com/countryrank.php?region=Latin%20America&order=cd&ord=desc), retrieved on September 2019, the six countries with the highest combination of documents and citations are Panama, Puerto Rico, Uruguay, Costa Rica, Argentina, and Chile. Related to the literature in these countries, Ward (2016) stated its virtue, “Only with slow, careful, detailed analysis, concern, and empathy even can be liberated from the old ways of seeing” (p. xxiii). These qualities may attract citations repeatedly. This explanation, nevertheless, is still speculative and requires testing in subsequent empirical studies.

National culture and research performance and impact

Power distance (PDI) has a negative correlation with research impact (Table 6); this could be because PDI negatively correlates with democracy (Maleki & Hendriks, 2014). The lower level of democracy reduces the opportunity of the academic community to exchange and market (in the broad sense) scientific information, as well as debate openly. Likewise, democracy that does not flourish deters the use of research results in creating public policies. Science is co-opted or used as just a tool to achieve exclusive interests by ideologues, pundits, and political leaders; they ignore the state-of-the-art nature of the research (Branscomb & Rosenberg, 2012). In addition, PDI might manifest itself in academic writing in the form of rigid, authoritative, defensive, and dogmatic styles (Koutsantoni, 2005). All the conditions could reduce research impact.

Table 6. Correlations results between national cultures dimensions and research performance and impact.

PDIIDVMASUAILTOWVSIVRLGDPResearch
Performance
Research
Impact
PDIρ
p
q
95% CI
0.99% CI
IDVρ-0.612
p< .001***
q< .001****
95% CI-0.742, -0.438
0.99% CI-0.613, -0.611
MASρ0.0390.101
p0.7500.414
q1.0001.000
95% CI-0.201, 0.275-0.141, 0.331
0.99% CI0.038, 0.0410.099, 0.102
UAIρ0.268-0.237-0.206
p0.027*0.0510.092
q0.5671.0001.000
95% CI0.032, 0.476-0.450, 0.001-0.424, 0.034
0.99% CI0.267, 0.270-0.239, -0.236-0.207, -0.204
LTOWVSρ0.0280.124-0.042-0.030
p0.8290.3390.7460.816
q1.0001.0001.0001.000
95% CI-0.223, 0.276-0.130, 0.362-0.289, 0.210-0.278, 0.221
0.99% CI0.026, 0.0300.122, 0.125-0.044, -0.040-0.032, -0.028
IVRρ-0.3630.1730.138-0.100-0.441
p0.004**0.1830.2900.443< .001****
q0.1001.0001.0001.000< .001
95% CI-0.563, -0.122-0.083, 0.407-0.118, 0.377-0.343, 0.156-0.595, -0.255
0.99% CI-0.364, -0.3610.171, 0.1740.136, 0.139-0.102, -0.098-0.442, -0.440
LGDPρ-0.6090.6630.057-0.2220.245*0.372
p< .001***< .001***0.6480.0710.021< .001***
q< .001****< .001****1.0001.0000.462< .001****
95% CI-0.741, -0.4320.503, 0.779-0.186, 0.293-0.439, 0.0190.039, 0.4310.539
0.99% CI-0.610, -0.6080.662, 0.6640.055, 0.058-0.224, -0.2210.244, 0.2460.181, 0.178
Research
Performance
ρ-0.3320.5280.205-0.2310.2720.371, 0.3730.465
p0.006**< .001***0.0930.0580.009**0.086< .001***
q0.144< .001****1.0001.0000.2071.000< .001****
95% CI-0.528, -0.1010.332, 0.681-0.035, 0.423-0.445, 0.0070.069, 0.454-0.026, 0.3730.346, 0.570
0.99% CI-0.333, -0.3300.527, 0.5290.204, 0.207-0.233, -0.2300.271, 0.2730.180, 0.1830.465, 0.466
Research
Impact
ρ-0.6090.497-0.007-0.107-0.0540.5080.1200.288
p< .001***< .001***0.9560.3870.616< .001***0.098< .001***
q< .001****< .001****1.0001.0001.000< .001****1.000< .001****
95% CI-0.740, -0.4340.294, 0.658-0.245, 0.232-0.336, 0.135-0.258, 0.1550.338, 0.647-0.022, 0.2580.167, 0.400
0.99% CI-0.610, -0.6080.496, 0.499-0.008, -0.005-0.108, -0.105-0.055, -0.0520.507, 0.5090.120, 0.1210.287, 0.288

ρ = Spearman’s rho; * p < 0.05; ** p < 0.01; *** p < 0.001; q = adjusted p-values (Gaetano, 2018; Holm, 1979); the significance level is 0.00714; **** q < 0.00714; CI = Confidence Interval; 0.99% CI = 0.99286% CI.

The positive correlations between individualism (IDV) and research performance and impact could be explained using the findings of Deschacht & Maes (2017). They found that in countries with more individualistic cultures: (1) the scientists prioritize their self-development, (2) the records of scientific work are historically longer (usually Western countries), and (2) self-citations flourish more. This does not necessarily mean that there have been citation abuses, but that self-citation is used to refer to their prior works, thereby, preventing unnecessary repetitions of ideas in newer works (Deschacht, 2017). Although IDV and collaboration are often contested (e.g. Kemp, 2013), a “collaborative individualism” (Limerick & Cunnington, 1993) – stressing both working together and self-emancipation – is possible, explaining the positive correlation.

Indulgence (IVR) is positively correlated with research impact; this may be because IVR – the warranted one – facilitates academic freedom (Ohmann, 2011), as stated by Jefferson (2011) regarding psychological gratification, “Difference of opinion is advantageous … [F]ree inquiry must be indulged, and how can we wish others to indulge it while we refuse it ourselves” (p. 26). Conversely, a restraint (as opposed to indulgence) will facilitate the destruction of goal pursuit, e.g. designing and executing impactful studies, through psychological reactance and unwarranted indulgence (Buzinski & Price, 2015).

Sabbatical leave is a representative example of warranted IVR that faculty members could increase research impact through the special time (Robert Gordon University, 2016). Through the leave, faculty members are temporarily freed from normal academic routines and intensively entering the real world where social decisions and policy makings occur. The various experiences expressed in Harvey Mudd College (2019) showed that in undergoing sabbatical leave, faculty members really enjoyed their social, recreational, and cultural adventures, supporting their research life. All the conditions could increase the research quality and, eventually, research impact.

In addition, IVR facilitates open science, because, in the perspective of open science, science is indeed an art (Fleming, 2019; Kera, 2017; Thornton, as cited in BBC News, 2010). Meanwhile, open science practices (such as research sharing through social media and even cartoons and drawings, data archiving and aggregation, team-science, crowd and shared databases, replicability and repeatability improvement efforts, very big data curation and management, engagement with research stakeholders) could enhance research impact in terms of citations per document (CPD) (e.g. De Filippo & Sanz-Casado, 2018) even in terms of the economy of research (Adams, 2015). This is because open science increases public esteem in science.

IVR may also manifest itself in a “lovely” academic writing style (Kiriakos & Tienari, 2018). This style is not dry and cold, but rather dialogical, humanistic, more reflexive, and capable of showing authors’ courage and vulnerability. Compelling insights are more easily born from the writings that embody those qualities; as mentioned, “a thin line exists between interesting insights and self-indulgence” (Nadin & Cassell, 2006, p. 214). Scientific authors who read such works would be attracted to cite them, leading to an increase in the works’ impact. In addition, “strategic indulgence” is possible and known to be a creative process that enables one to balance academic activity (such as writing) with non-academic ones (Jia et al., 2018) – fostering insight.

Uncertainty avoidance (UAI) is found negatively correlated with research impact (Table 7). This is understandable considering that impactful research requires innovation. The characteristics of UAI - which are intolerant of ideas and practices that are ambiguous and not conventional - do not support innovation (Bauer & Suerdem, 2016). Uncertainty avoidance cultural orientation is difficult to challenge and scrape unfunctional attitudes and values that are already stable. Therefore, it will also be hard to produce breakthroughs in research and publication, reducing the potential for citations per document.

Table 7. Partial correlations between national cultures dimensions and research performance and impact, controlling Log GDP per capita (LGDP) (N = 60, df = 57).

PDIIDVMASUAILTOWVSIVR
Research Performancer-0.0610.3030.201-0.1760.0110.026
p0.6480.019*0.1270.1830.9320.847
Research Impactr-0.4950.432-0.086-0.261-0.1120.273
p0.000***0.001**0.5180.046*0.3970.037*

One premise advocated by Leiden Manifesto for Research Metrics is “Science and technology indicators are prone to conceptual ambiguity and uncertainty and require strong assumptions that are not universally accepted” (Hicks et al., 2015, para. 21). Higher UAI national culture would adhere to the invariance assumption that is detrimental to the development of science and publication real impact. Un-openness to the pluralistic approach in the impact measurement will invite citation cartels. Citations per document (CPD) will be seen reductionistically as the destination of scientific works, so that CPD will be easy to become a target of manipulation. In fact, we have been reminded that the production of knowledge and its memories must not forget the relevance of knowledge to diverse publics. What is needed is a “careful and conscientious citation ... [citation as] a form of engagement”, in which “citation as a crude measure of impact” is only the byproduct of the reflexive action (Mott & Cockayne, 2017, p. 2, 11). It will need lower UAI.

Conclusion

National culture dimensions, especially power distance, individualism, indulgence, and uncertainty avoidance are pivotal variables that are to be considered in justifying research impact. In addition, the only variable that correlates with research performance is individualism.

Owing to the fact that the national culture is relatively enduring, countries need to measure their elasticity of hopes and action plans in an effort to boost research performance and impact, by integrating the national culture in the estimate. National culture can be integrated as a moderating variable in the predictive relationship between GDP per capita and research performance and impact. Diversification of this study – based on the document and authors’ collaboration types, the indexing databases, the disciplines, as well as the history and development of the research in a country – is a future opportunity for further study.

Data availability

Source data

Geert Hofstede: Dimension data matrix. https://geerthofstede.com/research-and-vsm/dimension-data-matrix/ (Hofstede et al., 2010)

Scimago Journal & Country Rank: Download data. https://www.scimagojr.com/countryrank.php?out=xls (Scimago Lab, 2019)

GDP per capita, PPP (Current International $). http://api.worldbank.org/v2/en/indicator/NY.GDP.PCAP.PP.CD?downloadformat=excel (World Bank Open Data, 2018)

All source data was accessed and retrieved on the 18/8/2019

Underlying data

Figshare: National culture, research performance indicators, and log GDP Per capita. https://doi.org/10.6084/m9.figshare.7723211 (Abraham, 2019)

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Comments on this article Comments (0)

Version 3
VERSION 3 PUBLISHED 28 Feb 2019
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Abraham J. National culture as a correlate of research performance and impact [version 2; peer review: 2 approved with reservations]. F1000Research 2019, 8:237 (https://doi.org/10.12688/f1000research.18283.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 24 Sep 2019
Revised
Views
13
Cite
Reviewer Report 25 Nov 2019
Jonathan P. Tennant, IGDORE, Berlin, Germany 
Approved with Reservations
VIEWS 13
From what I can see, the author has made a number of important changes to this MS, which feels much stronger in its present version. This includes:
  • Almost completely rewriting the abstract
  • Far more
... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Tennant JP. Reviewer Report For: National culture as a correlate of research performance and impact [version 2; peer review: 2 approved with reservations]. F1000Research 2019, 8:237 (https://doi.org/10.5256/f1000research.22695.r54254)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
17
Cite
Reviewer Report 14 Oct 2019
Ludo Waltman, Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, The Netherlands 
Approved with Reservations
VIEWS 17
The author has made various improvements. However, the revised paper suffers from two problems that I would like to request the author to address. The first problem is a major one, while the second one is more minor.

... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Waltman L. Reviewer Report For: National culture as a correlate of research performance and impact [version 2; peer review: 2 approved with reservations]. F1000Research 2019, 8:237 (https://doi.org/10.5256/f1000research.22695.r54253)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Version 1
VERSION 1
PUBLISHED 28 Feb 2019
Views
85
Cite
Reviewer Report 15 Apr 2019
Ludo Waltman, Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, The Netherlands 
Approved with Reservations
VIEWS 85
This is a short paper that presents a brief but easy-to-understand analysis of the correlation between the cultural orientation of countries and countries’ scientific performance in terms of bibliometric statistics.
 
It would be helpful if the author ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Waltman L. Reviewer Report For: National culture as a correlate of research performance and impact [version 2; peer review: 2 approved with reservations]. F1000Research 2019, 8:237 (https://doi.org/10.5256/f1000research.20000.r46347)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
64
Cite
Reviewer Report 28 Mar 2019
Jonathan P. Tennant, IGDORE, Berlin, Germany 
Approved with Reservations
VIEWS 64
The author presents an interesting piece of insight into research impact through a cultural lens, which is quite distinct from a lot of more recent studies which tend to focus on ‘academic impact’ metrics. As a short note, I found ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Tennant JP. Reviewer Report For: National culture as a correlate of research performance and impact [version 2; peer review: 2 approved with reservations]. F1000Research 2019, 8:237 (https://doi.org/10.5256/f1000research.20000.r46349)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 3
VERSION 3 PUBLISHED 28 Feb 2019
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.