<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.172013.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Survey about Barriers and Solutions for Enhancing
                    <break/> Computational Reproducibility in Scientific Research</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Gelsleichter</surname>
                        <given-names>Yuri Andrei</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-0869-3000</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Banzi</surname>
                        <given-names>Rita</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Naudet</surname>
                        <given-names>Florian</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Vinatier</surname>
                        <given-names>Constant</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Kert&#x00e9;sz</surname>
                        <given-names>Istv&#x00e1;n</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Varga</surname>
                        <given-names>Monika</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-6886-5751</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a6">6</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Soil Science, Institute of Environmental Sciences, Hungarian University of Agriculture and Life Sciences, G&#x00f6;d&#x00f6;ll&#x0151;, 2100, Hungary</aff>
                <aff id="a2">
                    <label>2</label>Laboratory for Health Regulatory Policies, Mario Negri Institute for Pharmacological Research IRCCS, Milan, Italy</aff>
                <aff id="a3">
                    <label>3</label>CHU Rennes, Inserm, Irset (Institut de recherche en sant&#x00e9;, environnement et travail)-UMR_S 1085, CIC 1414 (Centre of Clinical Investigation of Rennes), University of Rennes, Rennes, France</aff>
                <aff id="a4">
                    <label>4</label>Institut Universitaire de France, Paris, France</aff>
                <aff id="a5">
                    <label>5</label>Institute of Food Science and Technology, Hungarian University of Agriculture and Life Sciences, Budapest, 1118, Hungary</aff>
                <aff id="a6">
                    <label>6</label>Institute of Animal Sciences, Hungarian University of Agriculture and Life Sciences, Kaposvar, 7400, Hungary</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:varga.monika@uni-mate.hu">varga.monika@uni-mate.hu</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>FN received funding from the French National Research Agency (ANR-17-CE36-0010), the French Ministry of Health and the French Ministry of Research. He is a work package leader in the OSIRIS project and for the doctoral network MSCA-DN SHARE-CTD. He is a PLOS One academic editor, he will not be involved in the handling of this paper.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>18</day>
                <month>11</month>
                <year>2025</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2025</year>
            </pub-date>
            <volume>14</volume>
            <elocation-id>1278</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>11</day>
                    <month>11</month>
                    <year>2025</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Gelsleichter YA et al.</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/14-1278/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>Rapid development and adoption of digital technologies across all research disciplines underlines the need for accessible and reusable computational data and code.</p>
                </sec>
                <sec>
                    <title>Methods</title>
                    <p>An anonymous, multidisciplinary survey covering open science, data publishing and reuse, as well as code publishing and reuse was conducted to gather insights into researchers&#x2019; practices, needs, and barriers.</p>
                </sec>
                <sec>
                    <title>Results</title>
                    <p>A total of 254 people initiated the survey, with 133 complete responses (mostly from Europe, equally distributed among scientific fields). Survey revealed that registered reports, replication studies and pre-registration are the least applied practices (52%, 38% and 42%), while open software and OA publishing demonstrated widespread adoption (83% and 69%) of the respondents, respectively. Data sharing is hindered mostly by 
                        <italic toggle="yes">lack of time</italic> (60%) and 
                        <italic toggle="yes">sufficient funding</italic> (44%). Among the predefined obstacles of code sharing, again, the 
                        <italic toggle="yes">lack of time to build proper documentation</italic> (65%), 
                        <italic toggle="yes">pressure to publish</italic> (51%), and the 
                        <italic toggle="yes">insufficient funding</italic> (42%) are the most mentioned reasons. On the other hand, most stimulating factors are the requirement of journals to share data/codes (score: 482), followed by incentives and rewards by institutions (score: 439). The survey showed that 28% of researchers never tried to reproduce a study, and when replication was attempted, researchers often found that open data (70%), open code (71%), and metadata (86%) were missing or incomplete. The analysis of open-ended responses highlighted the need for training, career-stage guidelines, and basic programming skills for researchers.</p>
                </sec>
                <sec>
                    <title>Conclusions</title>
                    <p>Although the likely low response rate may limit its representativeness, this study provides an up-to-date snapshot. A recurrent theme throughout the responses is the need for structural incentives and institutional support. Researchers claim that making work reproducible requires time, resources, and expertise; however, these efforts are rarely rewarded in conventional academic evaluation systems, highlighting the need for a systemic cultural shift.</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Open science; Open Data; Open Code; Research transparency; Science integrity; Open Survey; Reproducibility</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>European Union&#x2019;s Horizon Europe Research and Innovation Programme</funding-source>
                    <award-id>Grantagreement101094725</award-id>
                </award-group>
                <funding-statement>Funding&#13;
The OSIRIS project was funded by the European Union&#x2019;s Horizon Europe Research and Innovation Programme under grant agreement 101094725.&#13;
</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec5" sec-type="intro">
            <title>Introduction</title>
            <p>Reproducibility is crucial to scientific integrity and credibility, as it helps to verify how research data are generated and identify data manipulation or methodological flaws (
                <xref ref-type="bibr" rid="ref23">National Academies of Sciences, Engineering, and Medicine, 2019</xref>). Utilizers of scientific results (e.g., broader scientific communities, policymakers, clinicians, and the wider public) rely on scientific findings. If the results are not reproducible, it undermines trust and might lead to poor decisions in several areas, such as health, economics, and environmental regulation. Several studies have focused on unsuccessful replication attempts (
                <xref ref-type="bibr" rid="ref5">Begley &amp; Ellis, 2012</xref>; 
                <xref ref-type="bibr" rid="ref17">Ioannidis, 2005</xref>; 
                <xref ref-type="bibr" rid="ref22">Munaf&#x00f2; et al., 2017</xref>; 
                <xref ref-type="bibr" rid="ref24">Open Science Collaboration, 2015</xref>; 
                <xref ref-type="bibr" rid="ref33">The Brazilian Reproducibility Initiative et al., 2025</xref>) that increasingly brought the crisis narrative to the fore. Reproducibility is an important precondition and cornerstone of research quality (
                <xref ref-type="bibr" rid="ref23">National Academies of Sciences, Engineering, and Medicine, 2019</xref>), and has been widely discussed across various disciplines in the past decade, including psychology, medicine, economics, and biology (
                <xref ref-type="bibr" rid="ref5">Begley &amp; Ellis, 2012</xref>; 
                <xref ref-type="bibr" rid="ref17">Ioannidis, 2005</xref>; 
                <xref ref-type="bibr" rid="ref24">Open Science Collaboration, 2015</xref>).</p>
            <p>Currently, computational reproducibility has become critically important, as much of today&#x2019;s research work relies heavily on digitalized data and computational tools throughout the entire research life cycle from research design, through computer-aided data analysis, to automated reporting tools. Computational reproducibility can be defined as &#x201c;the ability to recreate results using the original data and code (or at least a detailed description of the analyses)&#x201d; (
                <xref ref-type="bibr" rid="ref9">Cr&#x00fc;well et al., 2023</xref>), and, computational scientist as &#x201c;an academic whose research has both code and data components&#x201d; (
                <xref ref-type="bibr" rid="ref31">Stodden, 2010</xref>). This concept holds that &#x201c;when you use the same data as in the published article, you can reproduce the same results&#x201d; (
                <xref ref-type="bibr" rid="ref18">Lakens, 2022</xref>), &#x201c;the data and the computer code used to analyze the data be made available to others&#x201d; (
                <xref ref-type="bibr" rid="ref26">Peng, 2011</xref>), thereby enabling the evaluation and reuse of research outputs, data, and code by other researchers. Research code or research software, defined as &#x201c;Software that is used to generate, process or analyse results that you intend to appear in a publication&#x201d; by (
                <xref ref-type="bibr" rid="ref14">Hettrick et al., 2014</xref>), is crucial for the reproducibility of research. Commonly refers to case-specifically developed computer code, from a few lines to a professional package, used in the process of scientific or academic research to analyze data, simulate models, or process information. Therefore, the sharing and evaluation of research codes are of key importance.</p>
            <p>In recent years, a few survey-based studies have been conducted on reproducibility (
                <xref ref-type="bibr" rid="ref3">Baker, 2016</xref>), data management and sharing (
                <xref ref-type="bibr" rid="ref32">Tenopir et al., 2011</xref>; 
                <xref ref-type="bibr" rid="ref35">Van Den Eynden et al., 2016</xref>), computational reproducibility (
                <xref ref-type="bibr" rid="ref2">AlNoamany &amp; Borghi, 2018</xref>; 
                <xref ref-type="bibr" rid="ref31">Stodden, 2010</xref>), as well as on discipline-related specificities, for example, computational reproducibility in computational biology (
                <xref ref-type="bibr" rid="ref4">Barone et al., 2017</xref>) and geosciences (
                <xref ref-type="bibr" rid="ref29">Reinecke et al., 2022</xref>). In terms of code and data sharing, the most comprehensive survey on computational reproducibility was prepared five years ago (
                <xref ref-type="bibr" rid="ref2">AlNoamany &amp; Borghi, 2018</xref>).</p>
            <p>In current scientific research, repleting with new digital tools and technologies in all disciplines, there is an emerging need for data and code reuse. Therefore, this study aimed to obtain an up-to-date overview that captures the current landscape of researchers&#x2019; needs, barriers, and practices across various disciplines, with the goal of improving scientific reproducibility.</p>
            <p>Accordingly, a survey-based study was conducted to address the following key research questions:
                <list list-type="order">
                    <list-item>
                        <label>1.</label>
                        <p>What are the main perceptions about practices that support computational reproducibility?</p>
                    </list-item>
                    <list-item>
                        <label>2.</label>
                        <p>How are code and data shared during the publication?</p>
                    </list-item>
                    <list-item>
                        <label>3.</label>
                        <p>What obstacles impede computational reproducibility in the practices of researchers?</p>
                    </list-item>
                    <list-item>
                        <label>4.</label>
                        <p>Which methods and tools are frequently employed to support computational reproducibility?</p>
                    </list-item>
                    <list-item>
                        <label>5.</label>
                        <p>How often do researchers attempt to replicate the studies of their peers, and how do they succeed?</p>
                    </list-item>
                    <list-item>
                        <label>6.</label>
                        <p>How do the responses to the above questions vary based on career stage, academic discipline, geographical location, and related factors?</p>
                    </list-item>
                </list>
            </p>
        </sec>
        <sec id="sec6" sec-type="methods">
            <title>Material and methods</title>
            <p>The present study followed the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) guidelines (
                <xref ref-type="bibr" rid="ref11">Eysenbach, 2004</xref>) for reporting results of internet e-surveys and reflects on all of its necessary elements in the current Method section. The study protocol was registered on the Open Science Framework (OSF) prior to data collection (
                <xref ref-type="bibr" rid="ref12">Gelsleichter et al., 2024</xref>). The original survey material, anonymized survey responses, and descriptive statistical analysis results are publicly available in (
                <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>).</p>
            <sec id="sec7">
                <title>Survey design</title>
                <p>To provide meaningful insights into Open Science (OS) practices and computational reproducibility, we considered an anonymous open survey to be the most suitable approach. This enables us to explore general awareness and individual attitudes, which are difficult to assess through direct observation or literature review. Survey questions were developed in several rounds, in consultation with members of our consortium OSIRIS (Open Science to Improve Reproducibility in Science, funded by the European Union under the grant agreement 101094725), resulting in six sections with 35 questions, along 12 pages: demographic questions (6 questions), open science practices, supporting computational reproducibility (8 questions), data publishing (6 questions), data reuse (1 question), tools and code publishing (12 questions), and code reuse (2 questions). The first technical section of the survey aimed to assess the awareness and extent of the use of practices supporting open science and computational reproducibility. A complete survey with the questions and study protocol is provided in the OSF (
                    <xref ref-type="bibr" rid="ref12">Gelsleichter et al., 2024</xref>).</p>
                <p>The survey was conducted online using the LimeSurvey, a free and open-source software (
                    <xref ref-type="bibr" rid="ref19">LimeSurvey, 2025</xref>). Instead of sending the survey directly to each participant, it was shared on social media channels (further details are provided in the next section). This survey was designed with the possibility of breaking down or filtering answers according to screening questions (i.e., filled out by researchers, carrying out quantitative research). Since we did not have control over participants&#x2019; invitation, a concern was raised about the software&#x2019;s technical level of participants; for example, if the survey becomes too complex at some point, they could answer improperly (just to move on) or drop the survey. To avoid this, skipping mechanisms were set in some questions, based on previous ones; for example, in the question of 
                    <italic toggle="yes">Choose the characteristics that describe the kind of research data you generate;</italic> if the participant responds that 
                    <italic toggle="yes">

                        <bold>I do not produce data in my research</bold>,
</italic> the system skipped ahead to the next section. This mechanism was implemented in ten questions, the following: 1.4, 2.7, 3.1, 3.2, 3.3, 4.1, 5.4, 5.5, 5.8, and 6.1. The respondents were able to edit their responses as backward navigation was enabled. Furthermore, because the survey was comprehensive and long, multiple fillings were not considered as an issue, so a checking mechanism was not implemented. To avoid personal data collection, IP checks and the use of cookies were not performed.</p>
                <p>To give the participant the necessary background of certain (more complex/technical) items, aiming to avoid any skipping, most of the items carried explanatory &#x2018;tooltip&#x2019; style messages along the survey, similar procedure as (
                    <xref ref-type="bibr" rid="ref29">Reinecke et al., 2022</xref>). Before conducting the survey, rounds of internal pre-pilot testing were carried out to provide feedback about technical usability, clarity of questions, and time requirement to complete the survey, involving OSIRIS colleagues and PhD students. Feedback was taken into account, often suggesting editions, simplifications, and sometimes the inclusion of new questions. A similar approach was done by (
                    <xref ref-type="bibr" rid="ref31">Stodden, 2010</xref>). The survey was conducted between 2024-02-23 and 2024-09-30.</p>
            </sec>
            <sec id="sec8">
                <title>Survey population and recruitment</title>
                <p>In line with the registered protocol, the survey targeted researchers regardless of their discipline, who collected quantitative (usually digital) data and analyzed and utilized them with computational methods and tools, to provide a general overview of attitudes, barriers, and practices in terms of computational reproducibility. In our interpretation, quantitative researchers, regardless of discipline, collect and use quantitative (usually digital) data and analyze and utilize them with computational methods and tools. Through this interpretation, various fields from the natural, applied, and social sciences are involved.</p>
                <p>To reach out to a wide range of researchers in terms of geographic and scientific coverage, the survey link was shared via the official social media channels of OSIRIS (LinkedIn, X) and was re-shared by OSIRIS partners via flyers at scientific conferences (
                    <xref ref-type="bibr" rid="ref15">iEMSs, 2024</xref> and local events of Hungarian University of Agriculture and Life Sciences) and through blog posts on scientific community websites (
                    <xref ref-type="bibr" rid="ref16">International Environmental Modelling and Software Society, 2024</xref>; 
                    <xref ref-type="bibr" rid="ref30">Springer Nature Research Communities, 2024</xref>). A similar approach was used by (
                    <xref ref-type="bibr" rid="ref2">AlNoamany &amp; Borghi, 2018</xref>). The survey distribution relied on volunteer sampling within the research community, which eliminated the need to maintain a sensitive database of names and email addresses, which would be necessary for direct email-based recruitment.</p>
            </sec>
            <sec id="sec9">
                <title>Ethics and consent</title>
                <p>The survey-related work did not contain any research study on humans (individuals, samples or data). Since it is about research practices and workflows in context of computational reproducibility, and study was designed as an anonymous one, not involving human subjects in a sensitive or identifiable way, with voluntary participation (no personal data or identifiable responses were collected, even IP was not collected, or any cookie was set), consequently we did not initiate and obtain ethical approval for that.</p>
                <p>The list of questions was designed in multiple rounds within the OSIRIS consortium which ensured that no harm or risk is posed to respondents.</p>
                <p>Respondents, clicking on the survey link were navigated to an introduction page, where detailed information about the study was provided, including the link to the study protocol and the full list of questions, in advance, before starting the survey itself. In possession of this knowledge, participants had the chance either to access the survey by checking the &#x201c;I agree to take part in the research&#x201d; box, or to leave it without any consequence. Accordingly, respondents took part with electronically checked written consent.</p>
                <p>In addition, the GDPR (Hungarian University of Agriculture and Life Sciences) office was consulted and informed about the nature and content of the study. They verbally informed us that GDPR is not a relevant issue in the case of this particular survey. The detailed consent page can be found in the OSF survey material in the OSF (
                    <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>).</p>
            </sec>
            <sec id="sec10">
                <title>Data analysis</title>
                <p>The survey comprised closed questions, supplemented by six open-ended questions at the end of the technical sections. These open-ended questions provided free text space for respondents to express their views about the given questions.</p>
                <p>Closed questions were analyzed by descriptive statistics, prepared using Quarto (
                    <xref ref-type="bibr" rid="ref1">Allaire et al., 2022</xref>) version 1.6.32 within RStudio (
                    <xref ref-type="bibr" rid="ref27">Posit team, 2025</xref>) version 2025.05.0+496. The R (
                    <xref ref-type="bibr" rid="ref28">R Core Team, 2024</xref>) used in the analysis can be found in (
                    <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>). Quarto made it possible to prepare the data analysis along with data visualization for the reporting materials, ensuring the reproducibility of the work.</p>
                <p>Both quantitative and qualitative data were summarized using numbers and percentages. In the case of questions that asked respondents to select and rank options from predefined lists, a simple weighted scoring method was applied to evaluate ranking. Depending on the number of ranked items, rank 1 = 3 points, rank 2 = 2 points, and rank 3 = 1 point, as well as rank 1 = 5 points, rank 2 = 4 points, rank 3 = 3 points, rank 4 = 2 points, and rank 5 = 1 point, scoring was applied to convert rank percentages into a single composite score for each item.</p>
                <p>Open-ended questions were partly categorized for a more conscious evaluation and interpretation of opinions. Categorization was made by MV and discussed, and consensus was reached between MV and YAG. Complete replies to open-ended questions can be seen in the respective OSF database (
                    <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>).</p>
                <p>The questions were also analyzed using demographic group breaks. This analysis can be found in (
                    <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>). Countries were categorized into two groups, developed and developing, based on the 
                    <xref ref-type="bibr" rid="ref34">UNDP classification (2025)</xref>.</p>
            </sec>
        </sec>
        <sec id="sec11" sec-type="results">
            <title>Results</title>
            <sec id="sec12">
                <title>Demographics of respondents</title>
                <p>The survey was initiated by 254 respondents; 194 of them (76.4%) completed the demographic stage and were distributed across the six inhabited continents: 
                    <italic toggle="yes">Respondents were mainly based in Europe 157 (80%), followed by Asia 18 (9.3%), North America 8 (4.1%), South America 7 (3.6%), Africa 2 (1%), and Oceania 1 (0.5%).</italic> In total, 133 respondents completed the survey. The majority of the drops were immediately after the demographics; therefore, the study only considered 133 complete responses. Owing to the skipping mechanisms described in the survey design, the number of respondents varied across questions. Respondents from Europe constituted 109/133 (82%) of the survey. Regarding the scientific field of respondents (
                    <xref ref-type="table" rid="T1">
Table 1</xref>), it is distributed across 
                    <italic toggle="yes">Natural sciences</italic> 32/133 (24%), 
                    <italic toggle="yes">Medical</italic> 28/133 (21%), 
                    <italic toggle="yes">Agricultural</italic> 27/133 (20.3%), 
                    <italic toggle="yes">Engineering &amp; Technology</italic> 26/133 (19.5%), and 
                    <italic toggle="yes">Social sciences &amp; Humanities</italic> 20/133 (15%). In line with the target population defined in the protocol, respondents were mostly 
                    <italic toggle="yes">Researchers and Academics</italic> (120 of 133 respondents, 90.2%). For the career stage (
                    <xref ref-type="table" rid="T1">
Table 1</xref>), most (50 out of 133 respondents, 38%) were 
                    <italic toggle="yes">Established researchers</italic> based on the 
                    <xref ref-type="bibr" rid="ref10">EURAXESS (2023)</xref> classification, followed by 
                    <italic toggle="yes">First stage researcher II</italic> (defined as: carry out research under supervision, graduate students; 30 out of 133, 22.6%). Considering the type of institutions, 67/133 (50.4%) responses were from 
                    <italic toggle="yes">universities or higher education institutes</italic>, 40/133 (30%) from 
                    <italic toggle="yes">research institutes or research centers</italic>, 8/133 (6%) from 
                    <italic toggle="yes">non-profit organizations</italic>, 7/133 (5.3%) from 
                    <italic toggle="yes">government agencies or their departments</italic>, 4/133 (3%) from 
                    <italic toggle="yes">commercial entities</italic>, 2/133 (1.5%) from 
                    <italic toggle="yes">government operated commercial entities</italic>, and 5/133 (3.8%) from 
                    <italic toggle="yes">other</italic> types of institutions (university clinic, university hospital, scientific journal, or did not want to disclose). The target population of the survey was not only computer scientists, but also all disciplines utilizing digital data collection and analysis tools. In line with this, as well as the well-balanced distribution of scientific fields among respondents, the survey represents various disciplines and provides a level of generalizability.</p>
                <table-wrap id="T1" orientation="portrait" position="float">
                    <label>
Table 1. </label>
                    <caption>
                        <title>Demographics, composed of 
                            <italic toggle="yes">type of institution, field of research, interest, career stage.</italic>
</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Category</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Subcategory</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Count</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="7" valign="top">
                                    <italic toggle="yes">Type of Institution</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">University or higher education institute</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">73</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Research institute (or research center)</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">40</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Non-profit organization</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Government agency or department</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Other
                                        <sup>1</sup>
                                    </italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Commercial entity</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Commercial where the government is a major stakeholder</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="5" valign="top">
                                    <italic toggle="yes">Field of Research</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Natural sciences</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">32</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Medical sciences</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">28</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Agricultural sciences</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">27</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Engineering and technology</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">26</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Social sciences and Humanities</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">20</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="5" valign="top">
                                    <italic toggle="yes">Interest</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Researchers and Academics</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">120</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Other
                                        <sup>2</sup>
                                    </italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Journal and Publication Professionals</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">General Public</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Policy Maker and Governance</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="6" valign="top">
                                    <italic toggle="yes">Career Stage</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Established Researcher</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">50</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">First Stage Researcher II</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">30</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Recognized Researcher</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">18</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Leading Researcher</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">17</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">First Stage Researcher I</italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <italic toggle="yes">Other
                                        <sup>3</sup>
                                    </italic>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>Meaning of Others in the Type of Institution
                            <sup>1</sup>: 
                            <italic toggle="yes">University Clinic, University hospital, Scientific journal,
</italic> and 
                            <italic toggle="yes">I do not want to disclose it.</italic> Each had one reply. </p>
                        <p>Meaning of Other in Interest
                            <sup>2</sup>: 
                            <italic toggle="yes">Data sharing support, Data steward, IT support, Research reform advocate, Research Support services,
</italic> and 
                            <italic toggle="yes">Statistical analysis.</italic> Each had one reply. </p>
                        <p>Meaning of Other at Career Stage
                            <sup>3</sup>: 
                            <italic toggle="yes">Retired researcher, now coordinating editor; Software developer (worked for researchers for 10 years), Semi-retired researcher, Data steward, Support staff, Research software engineer.</italic> Each had one reply and 
                            <italic toggle="yes">I do not want to disclose it</italic> had three replies.</p>
                    </table-wrap-foot>
                </table-wrap>
                <p>To illustrate the nature and focus of the respondent population, in the checkbox Question 3.3, which asks what 
                    <italic toggle="yes">kind of research data you generate,
</italic> among several listed options, 
                    <italic toggle="yes">Quantitative data</italic> (numeric files, survey responses, geospatial data), 
                    <italic toggle="yes">Omics data</italic> (information generated by studies ending with -omics: genomics, proteomics, phenomics, etc.), 
                    <italic toggle="yes">Imaging data</italic> were selected mostly (91%, 21%, and 21% among 120 respondents, respectively).</p>
            </sec>
            <sec id="sec13">
                <title>Open Science practices supporting computational reproducibility</title>
                <p>Regarding the awareness and extent of use of practices supporting open science and computational reproducibility, a question focused on the 
                    <italic toggle="yes">prevalence of various tools, methods and techniques, by listing 11 OS practices</italic> to cover the available solutions as much as possible (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>). Replies shows that the 
                    <italic toggle="yes">Use of open software</italic> is a highly adopted practice (100/120, 83% of the respondents use them 
                    <italic toggle="yes">Frequently</italic> or 
                    <italic toggle="yes">Always</italic>). Followed by 
                    <italic toggle="yes">Open access publication</italic> with 83/120, 69% of 
                    <italic toggle="yes">Frequently</italic> and 
                    <italic toggle="yes">Always</italic> options suggests that it is also a widely known and used practice (meaning that &#x201c;
                    <italic toggle="yes">there are no financial, legal or technical barriers to accessing it</italic>&#x201d;), (
                    <xref ref-type="bibr" rid="ref25">openaccess.nl, 2025</xref>).</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>Application of open science practices.</title>
                        <p>Contains the distribution between replies Never, Rarely, Sometimes, Frequently and Always in context of predefined practices. Number of responses: 120 of 133. Filtered by 'Question4' only for 'Researchers and Academics'.</p>
                    </caption>
                    <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure1.gif"/>
                </fig>
                <p>

                    <italic toggle="yes">Open data</italic>, 
                    <italic toggle="yes">Open research (including open scholarship)</italic>, 
                    <italic toggle="yes">Open code and open materials</italic> can be considered as less frequently applied practices among respondents with a range of 68&#x2013;79 from 120, 56-66% of 
                    <italic toggle="yes">Frequently</italic> or 
                    <italic toggle="yes">Always</italic> replies.</p>
                <p>On the less common side, 
                    <italic toggle="yes">Registered reports</italic>, 
                    <italic toggle="yes">Replication of studies</italic>, or 
                    <italic toggle="yes">Study pre-registration
</italic> belong to less known and applied practices, where 62/120, 46/120, and 50/120 respondents (52, 38%, and 42%, respectively) 
                    <italic toggle="yes">Never</italic> used these practices. 
                    <italic toggle="yes">Open peer review</italic> was among the least common practices with 60/120 (50% of responses) when combining 
                    <italic toggle="yes">Never</italic> (34/120, 28%) and 
                    <italic toggle="yes">Rarely</italic> (26/120, 22%).</p>
                <p>According to replies for question about 
                    <italic toggle="yes">Sharing of data</italic>, 
                    <italic toggle="yes">Code</italic> and 
                    <italic toggle="yes">Research documentation</italic> in case of work with public funding should be made accessible, according to respondents (96/133, 72%; 84/133, 63%; and 97/133, 73%, respectively). Although what is more notable here is the relatively high percentage of &#x2018;neutral&#x2019; responses (37/133, 28%; 43/133, 32% and 31/133, 23%) which implies that there is still a great need to raise awareness and to develop incentive schemes.</p>
                <p>In the question of revealing barriers to reproducibility (
                    <xref ref-type="fig" rid="f2">Figure 2</xref>), respondents were asked to select and rank three items deemed the most important in their view. Based on the &#x201c;Rank 1 = 3 points, Rank 2 = 2 points, Rank 3 = 1 point&#x201d; conversion, 
                    <italic toggle="yes">Incomplete or inadequate documentation</italic> received a score of 287 (3 &#x00d7; 120 &#x00d7; 59% + 2 &#x00d7; 120 &#x00d7; 20% + 1 &#x00d7; 120 &#x00d7; 22%) at first place, followed by 
                    <italic toggle="yes">Lack of standardization in data formats or software tools</italic> with 258 points (3 &#x00d7; 120 &#x00d7; 38% + 2 &#x00d7; 120 &#x00d7; 38% + 1 &#x00d7; 120 &#x00d7; 25%), and 
                    <italic toggle="yes">Data issue</italic> with 229 points (3 &#x00d7; 120 &#x00d7; 26% + 2 &#x00d7; 120 &#x00d7; 39% + 1 &#x00d7; 120 &#x00d7; 35%).</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Ranked obstacles to computational reproducibility.</title>
                        <p>
Figure introduces the experiences about the most common reasons why studies are not reproducible. Respondents were asked to select and rank three items (Rank1, Rank2, Rank3) deemed the most important in their view. Number of responses: 120 of 133. Filtered by 'Question4' only for 'Researchers and Academics'.</p>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure2.gif"/>
                </fig>
                <p>In the degree of efforts made toward reproducing others&#x2019; work, 33/120 (27.5%) respondents 
                    <italic toggle="yes">Never tried to reproduce a study</italic>, while only 9/120 (7.5%) respondents reported 
                    <italic toggle="yes">High degree of reproducibility</italic>, compared to the 24/120 (20%) respondents with the opinion of 
                    <italic toggle="yes">Low degree of reproducibility</italic> or 
                    <italic toggle="yes">Impossible to reproduce.</italic> The number of replies with a neutral 
                    <italic toggle="yes">Medium degree of reproducibility</italic> was 53/120 (43.3%). Another question illustrates that according to experience, open data, open code or metadata, gathering 
                    <italic toggle="yes">Never</italic>, 
                    <italic toggle="yes">Rarely</italic>, and 
                    <italic toggle="yes">Sometimes</italic> appear in the publications studied by respondents with 70, 71%, and 86%, respectively.</p>
                <p>Transparent and computationally reproducible research requires effort from researchers, accompanied by appropriate resources. A question to capture opinions about these resources was framed (
                    <xref ref-type="fig" rid="f3">Figure 3</xref>), asking for the selection and ranking of up to five items that they deemed the most important from amongst the predefined list of 11 (note, 
                    <italic toggle="yes">Not applicable</italic> replies were removed from the analysis). Based on the responses of 120 academics/researchers and on the applied five-point scoring system, the most important driver is whether 
                    <italic toggle="yes">Journals ask for the necessary data/code/metadata</italic> (with scores of 482, 5 &#x00d7; 120 &#x00d7; 52% + 4 &#x00d7; 120 &#x00d7; 22% + 3 &#x00d7; 120 &#x00d7; 11% + 2 &#x00d7; 120 &#x00d7; 6% + 1 &#x00d7; 120 &#x00d7; 9%). This is followed by 
                    <italic toggle="yes">Incentivizing and rewarding researchers for making their work more reproducible</italic> (with a score of 439, 5 &#x00d7; 120 &#x00d7; 28% + 4 &#x00d7; 120 &#x00d7; 29% + 3 &#x00d7; 120 &#x00d7; 29% + 2 &#x00d7; 120 &#x00d7; 9% + 1 &#x00d7; 120 &#x00d7; 5%), followed by 
                    <italic toggle="yes">Development and adoption of reproducibility guidelines, best practices, and standards</italic> (with a score of 432, 5 &#x00d7; 120 &#x00d7; 34% + 4 &#x00d7; 120 &#x00d7; 23% + 3 &#x00d7; 120 &#x00d7; 20% + 2 &#x00d7; 120 &#x00d7; 15% + 1 &#x00d7; 120 &#x00d7; 8%). In the shared 4th place, 
                    <italic toggle="yes">Development and adoption of standard data formats and software tools</italic>, as well as 
                    <italic toggle="yes">Dedicated support from institution with data and code preparation</italic>, both with a score of 394 (5 &#x00d7; 120 &#x00d7; 18% + 4 &#x00d7; 120 &#x00d7; 28% + 3 &#x00d7; 120 &#x00d7; 30% + 2 &#x00d7; 120 &#x00d7; 12% + 1 &#x00d7; 120 &#x00d7; 12% and 5 &#x00d7; 120 &#x00d7; 23% + 4 &#x00d7; 120 &#x00d7; 21% + 3 &#x00d7; 120 &#x00d7; 31% + 2 &#x00d7; 120 &#x00d7; 12% + 1 &#x00d7; 120 &#x00d7; 12%, respectively). The 5th item of the list is 
                    <italic toggle="yes">Investment in reproducibility education and training</italic> with a score of 372 (5 &#x00d7; 120 &#x00d7; 17% + 4 &#x00d7; 120 &#x00d7; 25% + 3 &#x00d7; 120 &#x00d7; 21% + 2 &#x00d7; 120 &#x00d7; 25% + 1 &#x00d7; 120 &#x00d7; 12%).</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Strategies deemed important to overcome the challenges in computational reproducibility.</title>
                        <p>Contains information about selection and ranking of up to five items (Rank1, Rank2, Rank3, Rank4, Rank5) that respondents deemed the most important from amongst the predefined list of 11. Number of responses: 120 of 133. Filtered by 'Question4' only for 'Researchers and Academics'.</p>
                    </caption>
                    <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure3.gif"/>
                </fig>
                <p>In addition, respondents were asked to check for the listed options that are considered important to overcome the barriers of computational reproducibility (
                    <xref ref-type="fig" rid="f4">Figure 4</xref>). Among the five options, respondents highlighted the role of training in the first place, followed by the need for dedicated support, as well as training of PhD students in the long run (66/120, 55%; 64/120, 53%; and 64/120, 53%, respectively). In addition, the question offered an open-ended option, in which five opinions were shared. Four mentioned time, funding, and more conscious workflow management during the research process. One respondent expressed strong aspirations, namely &#x201c;
                    <italic toggle="yes">better criteria for job recruitment. If you cannot do this unsupported, you&#x2019;re not supposed to be a researcher</italic>&#x201d;.</p>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>Figure 4. </label>
                    <caption>
                        <title>Actions to support computational work.</title>
                        <p>Contains information about predefined and selected options that are considered important to overcome the barriers of computational reproducibility. Number of responses: 120 of 133. Filtered by 'Question4' only for 'Researchers and Academics'.</p>
                    </caption>
                    <graphic id="gr4" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure4.gif"/>
                </fig>
                <p>At the end of section 2, an open field was provided to allow respondents to share their insights about good practices that could enhance computational reproducibility. Twenty-one respondents provided detailed opinions categorized into five main topics (with some insights):
                    <list list-type="order">
                        <list-item>
                            <label>1.</label>
                            <p>Incentives from journals/funding agencies/institutions (8 replies)</p>
                            <p>

                                <italic toggle="yes">&#x201c;Journals should not only require, but also review the code and data for each submission.&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>Actual technological solutions (4 replies)</p>
                            <p>

                                <italic toggle="yes">&#x201c;Using declarative deployment systems like Nix/Guix to limit issues related to dependencies and ease deployment.&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>3.</label>
                            <p>Importance of behavior change, focusing on early career researchers (3 replies)</p>
                            <p>

                                <italic toggle="yes">&#x201c;We also need to train people how to write good code and document things.&#x201d;</italic>
                            </p>
                            <p>

                                <italic toggle="yes">&#x201c;I also believe journals need more methodology review experts to evaluate thoroughness of reporting.&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>4.</label>
                            <p>Trainings, guidelines, hackathons for improving skills (2 replies)</p>
                            <p>&#x201c;Repro hackhaton.&#x201d;</p>
                        </list-item>
                        <list-item>
                            <label>5.</label>
                            <p>Suggestions for dedicated positions (both at institutions and in journals) (2 replies)</p>
                            <p>

                                <italic toggle="yes">&#x201c;Appoint Open-Science-Friendly engineers/researchers as referent within all research units to communicate with fellow researchers and convey good practices, with nationwide exchanges between referents within a national (possibly international) network.&#x201d;</italic>
                            </p>
                            <p>

                                <italic toggle="yes">&#x201c;Emphasize that it is a revolution, but it does not have to be all done right away =&gt; step-by-step process, project after project, improvements after improvements, mistakes are ok (even in codes and data). And not everybody can change how they do research at the same pace: list all that can be done and ask people what small changes they can do today? And what could they plan to do in the future?&#x201d;</italic>
                            </p>
                        </list-item>
                    </list>
                </p>
                <p>Detailed responses can be found in the respective OSF database (
                    <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>).</p>
            </sec>
            <sec id="sec14">
                <title>Sharing research data</title>
                <p>Considering the equilibrated range of disciplines that participated in the survey, qualitative data (interviews, focus groups, field notes, images, audio, video, etc.) were selected by 22% of respondents. 
                    <italic toggle="yes">If I do not produce data in my research</italic> or 
                    <italic toggle="yes">Not applicable</italic> was, the following answers were skipped and respondents were taken to the next section: In the survey, 33/120 (27.5%) respondents were skipped, and 87/120 (72.5%) went through.</p>
                <p>Respondents were asked to estimate the number of shared datasets over the past five years. As a result, more than half of the respondents (70/116, 60.3%) 
                    <italic toggle="yes">Practice data sharing in their own work</italic> (the responses are distributed as follows: 64 replies with 1-10 datasets, 3 replies with 14 datasets, 1 reply with 20 datasets and two replies with more than 30 datasets).</p>
                <p>Responses show the popularity of 
                    <italic toggle="yes">Data repositories</italic> (Zenodo, Dryad, Mendeley data, Figshare) with 56/87 (64%), followed by 
                    <italic toggle="yes">Supplementary materials</italic> 45/87 (51%), and 
                    <italic toggle="yes">Data papers</italic> (Data in Brief, Scientific Data, etc.) with 32/87 (37%) among researchers who practice data sharing. As this question was a checkbox selection, participants were able to choose more than one option; therefore, each item had a hundred percent possibility. Other free box options also highlighted the option of GitHub, the OSF repository, and the project websites of funding bodies.</p>
                <p>In response to the question (
                    <xref ref-type="fig" rid="f5">Figure 5</xref>) 
                    <italic toggle="yes">why making data publicly available is important</italic>, different motivations were grouped by the level of agreement. 
                    <italic toggle="yes">Because it is a good research practice</italic> 84/87, (96%) respondents 
                    <italic toggle="yes">Agree</italic> (30%) and 
                    <italic toggle="yes">Strongly Agree</italic> (66%). At the same time, 77/87 (89%) respondents considered it important for 
                    <italic toggle="yes">Enabling collaboration and contribution by other researchers</italic>, 
                    <italic toggle="yes">Agree</italic> (33%) and 
                    <italic toggle="yes">Strongly Agree</italic> (56%), and close ratios for 
                    <italic toggle="yes">Enabling validation and replication</italic> (89%) when combining 
                    <italic toggle="yes">Agree</italic> (29%) and 
                    <italic toggle="yes">Strongly Agree</italic> (60%), and 
                    <italic toggle="yes">Public benefits</italic> (84%) when combining 
                    <italic toggle="yes">Agree</italic> (32%) and 
                    <italic toggle="yes">Strongly Agree</italic> (52%). Respondents agree or strongly agree with the options of 
                    <italic toggle="yes">My funder requires</italic> and 
                    <italic toggle="yes">I can get credit and more citations</italic> with 49/87 (56%) and 57/87 (65%), respectively.</p>
                <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                    <label>Figure 5. </label>
                    <caption>
                        <title>Reasons to make data publicly available.</title>
                        <p>Contains the distribution between replies Strongly disagree, Disagree, Neutral, Agree and Strongly agree in context of the question why making data publicly available is important. Number of responses: 87 of 133. Filtered by 'Questions 4, 15 and 16'.</p>
                    </caption>
                    <graphic id="gr5" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure5.gif"/>
                </fig>
                <p>Considering the barriers (
                    <xref ref-type="fig" rid="f6">Figure 6</xref>), respondents were asked to judge 13 predefined reasons that hindered data sharing. Here, the most common reason was the lack of time (i.e., the pressure to publish articles) (70/116, 60%), followed by the lack of sufficient funding that supports data sharing (51/116, 44%), and the sensitive characteristics of data were mentioned in third place (48/116, 41%) with 
                    <italic toggle="yes">Agree</italic> or 
                    <italic toggle="yes">Strongly Agree.</italic> Data complexity, uncertainty about rights to share, and lack of permissions can be considered moderate barriers, with a relatively high ratio of neutral responses, suggesting some level of perplexity. Factors of 
                    <italic toggle="yes">Losing publication opportunities</italic>, 
                    <italic toggle="yes">Feeling of additional gain</italic>, 
                    <italic toggle="yes">Confidential commercial use</italic> or 
                    <italic toggle="yes">Lack of motivation</italic> with a relatively high number of 
                    <italic toggle="yes">Strongly Disagree</italic> and 
                    <italic toggle="yes">Disagree</italic> options (67/116, 58%; 57/116, 48%; 51/116, 44%; and 52/116, 45%) show that these cannot be considered as major barriers.</p>
                <fig fig-type="figure" id="f6" orientation="portrait" position="float">
                    <label>Figure 6. </label>
                    <caption>
                        <title>Barriers to making data publicly available.</title>
                        <p>Contains the distribution between replies Strongly disagree, Disagree, Neutral, Agree and Strongly agree in context of predefined barriers. Number of responses: 116 of 133. Filtered by 'Questions 4 and 15'.</p>
                    </caption>
                    <graphic id="gr6" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure6.gif"/>
                </fig>
                <fig fig-type="figure" id="f7" orientation="portrait" position="float">
                    <label>Figure 7. </label>
                    <caption>
                        <title>Actions made to enhance reproducibility.</title>
                        <p>Contains the distribution between replies Do not know, Never, Rarely, Sometimes, Frequently and Always in context of predefined steps to making code well-documented and reproducible. Number of responses: 74 of 133. Filtered by 'Questions 4, 25 and 26'.</p>
                    </caption>
                    <graphic id="gr7" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure7.gif"/>
                </fig>
                <p>At the end of Section 3, 11 comments/opinions arrived, categorized into the following three topics, accompanied by meaningful replies (some examples are highlighted):
                    <list list-type="order">
                        <list-item>
                            <label>1.</label>
                            <p>Regulations and requirements about data sharing (4 replies)</p>
                            <p>

                                <italic toggle="yes">&#x201c;Simply it is not a requirement by education institutions. Otherwise lots of data would be available. And data sharing habit would start right away at university&#x201d;.</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>Technical issues (3 replies)</p>
                            <p>

                                <italic toggle="yes">&#x201c;Make sure institutions/governments do not invent their own &#x201c;data license&#x201d; that is then hard to interpret.&#x201d;</italic>
                            </p>
                            <p>

                                <italic toggle="yes">&#x201c;Perfectionism (not wanting to publish data that is not processed/cleaned perfectly).&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>3.</label>
                            <p>Behavior change (1 reply)</p>
                            <p>

                                <italic toggle="yes">&#x201c;All publically funded research should require the data published.&#x201d;</italic>
                            </p>
                        </list-item>
                    </list>
                </p>
                <p>Detailed responses can be found in the respective OSF database (
                    <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>).</p>
            </sec>
            <sec id="sec15">
                <title>Data reuse</title>
                <p>Regarding the reuse of existing data in Section 4, the most commonly mentioned purposes of utilization are for research validation, providing background or context to the given actual research, to reuse them in the development of their own methodology, and for teaching material. The relatively low response rate (30%) for replication and meta-analysis might also originate from definitional difficulties despite the explanatory pop-up messages of the survey. In the 
                    <italic toggle="yes">Other</italic> open box option, respondents also mentioned crowd-science projects, systematic reviews, or derivates data (e.g., maps from point data were actually referred). Only 6% of the 120 respondents stated that they had never used existing data. This is strong evidence for promoting data sharing, responses, and individual quotes to outline the actual state of data sharing and reuse and also implies the need for harmonized expectations that would most likely be highly supportive in terms of making data openly available (or at least accessible in line with the FAIR principles) as a norm in the research process.</p>
            </sec>
            <sec id="sec16">
                <title>Insights about tools and code publishing</title>
                <p>The aim of the respective question was to discover the extent of the use of different types of digitalized tools for data management and analysis. Considering the replies, R programming, and conventional spreadsheets (62/120, 52% of respondents stated that they use them 
                    <italic toggle="yes">Always</italic> or 
                    <italic toggle="yes">Frequently</italic> in both cases) are on the most popular side. In the middle range, Python programming language and various types of statistical software (SAS, SPSS, JASP, PSPP, GRETL, SOFA, KNIME, Scilab, etc.) were mentioned with 38/120, 32% and 36/120, 30%, respectively, considering 
                    <italic toggle="yes">Always</italic>+
                    <italic toggle="yes">Frequently.</italic> On the other hand, the least applied methods/tools are various, specific skill-requiring programming languages, programming platforms, and database management (68/120, 57%; 68/120, 57%; and 60/120, 50% never use them, respectively). Still, 28/120 respondents (23%) used analogical data collection. From the breakdown, less developed countries use around three times more paper and nearly twice the number of spreadsheets and statistical software, while more developed countries use more programming languages.</p>
                <p>In addition to the eight predefined groups of tools, the next open-ended question aimed to identify other options. Here, seven additional responses arrived, highlighting mostly individual tools, for example, AI-based tools for preliminary analysis, various workflow tools, and application programming interfaces (in general, not further defined).</p>
                <p>In a next question, respondents were asked to share their insights on whether the research code should also be evaluated in the peer review process by checking the most appropriate reply from ten predefined options. Twenty-one respondents selected 
                    <italic toggle="yes">I do not know</italic> (21/120, 18%), suggesting uncertainty about the topic.</p>
                <p>Further, highly selected replies mostly state that it should be checked in various ways. Replies state that it should be performed only by a quick visual inspection (18), by machines (17), by a human staff of the journal (15), by a third-party operated cloud (13), a human researcher reviewer (13), or by a human from the journal staff, but only through a quick visual inspection (3). Compared to these numbers, only a few respondents (13) believed that the code should not be checked.</p>
                <p>To discover ways of utilizing the research code, respondents were asked to check multiple predefined options that apply to their activities. Accordingly, 109/120 (91%) used it for data analysis; 103/120, 86% for visualization; 88/120, 73% for data cleaning; 84/120, 70% for the automation of the research process; 84/120, 70% for the organization of data and research work; 67/120, 56% for the collection of data; and 52/120, 43% for communicating the research work. In case 
                    <italic toggle="yes">I do not use any code</italic> 7/120, 6% were selected, further questions were skipped, and the survey was completed, ready to finish, and submitted.</p>
                <p>To check the extent of sharing research codes, the next question aimed to gain insight into the number of shared research codes in the past five years, where, similar to data sharing activities, respondents were asked to type a number. Of the 133 people responded, 45 never shared codes, 55 shared 1-10 , and 13 shared more than 10 codes.</p>
                <p>Mostly cited reasons to 
                    <italic toggle="yes">making research code publicly available</italic> are the followings:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>70/74, 95% 
                                <italic toggle="yes">Good research practice,
</italic> where 
                                <italic toggle="yes">Agree</italic> (26%) and 
                                <italic toggle="yes">Strong Agree</italic> (69%).</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>63/74, 91% 
                                <italic toggle="yes">Enables validation and/or replication,
</italic> where 
                                <italic toggle="yes">Agree</italic> (26%) and 
                                <italic toggle="yes">Strong Agree</italic> (65%).</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>65/74, 88% 
                                <italic toggle="yes">Enables collaboration and contribution by other researchers,
</italic> where: 
                                <italic toggle="yes">Agree</italic> (23%) and 
                                <italic toggle="yes">Strong Agree</italic> (65%).</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>64/74, 87% 
                                <italic toggle="yes">Public benefits,
</italic> where 
                                <italic toggle="yes">Agree</italic> (30%) and 
                                <italic toggle="yes">Strong Agree</italic> (57%).</p>
                        </list-item>
                    </list>
                </p>
                <p>In the respective open-ended questions about code publishing, some of the challenges were highlighted, along with a claim for uncertainty about the question. A respondent raises attention to the point that code is useful only if it is &#x201c;nice and tidy,&#x201d; however, to make it such, it requires programming (coding) training, experience, and considerable time for cleaning and checking, commonly scarce resources in academia, unfortunately.</p>
                <p>Considering code-sharing and publication practices in Question 5.8, replies were filtered by the number of shared codes in Questions 4.1, 5.4, and 5.5. Accordingly, 60/74 (81%) replies confirmed that most of the respondents who shared code 
                    <italic toggle="yes">Use comment options to explain the code</italic> parts and document all steps in the script. A similar ratio 
                    <italic toggle="yes">Use README file for explanation</italic> 59/74 (79%) or code publishing platforms (GitLab, Bitbucket, GitHub, etc.) to make the code publicly available 52/74 (70%). Version control was underrepresented by 41/74 (56%), despite its importance in code development. Specific code publishing platforms (like MethodsX, SoftwareX, etc.), as well as community or educational networks, are not typically used (5, 4%, and 3%, respectively) among respondents. Under 
                    <italic toggle="yes">Other options</italic> free text box, OSF, R Markdown, and Software Heritage Archive were also mentioned as applied solutions.</p>
                <p>Continuing with the well-documented and easy-to-reproduce characteristics of shared codes (
                    <xref ref-type="fig" rid="f7">Figure 7</xref>), respondents were asked to decide on a Likert scale (using 
                    <italic toggle="yes">Always, Frequently, Sometimes, Rarely, Never</italic>, plus 
                    <italic toggle="yes">I do not know</italic>) about efforts. On the most applied side, 
                    <italic toggle="yes">Documentation of dependencies and installation instructions</italic> (53/74, 72%) for 
                    <italic toggle="yes">Always, Frequently</italic> and 
                    <italic toggle="yes">Sometimes</italic> combined), and 
                    <italic toggle="yes">Using code along with notebooks</italic> (48/74, 65%) for 
                    <italic toggle="yes">Always, Frequently</italic> and 
                    <italic toggle="yes">Sometimes</italic> combined) are marked as applied practices. Respondents who shared code frequently never used cloud computing resources (52/74, 70%), virtual environments (49/74, 66%), automation tools (such as workflow tools or Reprozip (
                    <xref ref-type="bibr" rid="ref7">Chirigati et al., 2016</xref>)) (42/74, 57%), or containerization tools (such as Docker (
                    <xref ref-type="bibr" rid="ref21">Merkel, 2014</xref>)) (38/74, 51%).</p>
                <p>For the respective open-ended questions about additional 
                    <italic toggle="yes">aspects of code documentation</italic>, seven replies were received. One part mentioned utilized tools (e.g., Guix, R script), and another part of replies highlighted the challenges of computational work:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <italic toggle="yes">&#x201c;I usually only write R scripts and comment them, I feel I should do more with version control but I do not&#x2026;&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <italic toggle="yes">&#x201c;I am aware of most of these tools and how it could/should be done (with containers etc.), but I never ventured so far, because my studies are not so general that I think anyone would touch it.&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <italic toggle="yes">&#x201c;Often projects have a combination of pipelines and notebooks this makes it very messy to share and takes time to organise but it is possible.&#x201d;</italic>
                            </p>
                        </list-item>
                    </list>
                </p>
                <p>Although respondents were aware of 
                    <italic toggle="yes">Good research practices</italic>, these replies were projected to the subsequent question (
                    <xref ref-type="fig" rid="f8">Figure 8</xref>) about 
                    <italic toggle="yes">barriers to making research code publicly available.</italic> Fully in line with these highlighted free-text opinions, among predefined barriers: the 
                    <italic toggle="yes">Lack of time to build proper documentation</italic> 73/113, 65% (
                    <italic toggle="yes">Agree</italic> (37%) and 
                    <italic toggle="yes">Strong Agree</italic> (28%)); the 
                    <italic toggle="yes">Pressure to publish</italic> 58/113, 51% (
                    <italic toggle="yes">Agree</italic> (32%) and 
                    <italic toggle="yes">Strong Agree</italic> (19%)); and 
                    <italic toggle="yes">insufficient funding to prepare code for sharing</italic> 47/113, 42% (
                    <italic toggle="yes">Agree</italic> (25%) and 
                    <italic toggle="yes">Strong Agree</italic> (17%)) are the most commonly mentioned reasons. The following reasons are not considered barriers, as respondents voted with 
                    <italic toggle="yes">Disagree</italic> and 
                    <italic toggle="yes">Strongly disagree</italic>: 
                    <italic toggle="yes">I may lose publication opportunities if I share code</italic> and 
                    <italic toggle="yes">I do not have permission</italic> both with 61/113, 54% (
                    <italic toggle="yes">Disagree</italic> (27%) and 
                    <italic toggle="yes">Strongly disagree</italic> (27%)).</p>
                <fig fig-type="figure" id="f8" orientation="portrait" position="float">
                    <label>Figure 8. </label>
                    <caption>
                        <title>Barriers to making code publicly available.</title>
                        <p>Contains the distribution between replies Strongly disagree, Disagree, Neutral, Agree and Strongly agree in context of predefined barriers to making code publicly available. Number of responses: 113 of 133. Filtered by 'Questions 4 and 25'.</p>
                    </caption>
                    <graphic id="gr8" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/189689/41e0ad14-582c-466c-bfad-95459ed2d96d_figure8.gif"/>
                </fig>
                <p>The open-ended question of the section provided space to add aspects of the limitations of code-sharing and publishing. In this question, six open-text replies arrived. The following three highlighted opinions raise points about the previously mentioned barriers:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <italic toggle="yes">&#x201c;There are activities that are more highly valued that i do instead (publishing).&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <italic toggle="yes">&#x201c;I have to actively fight my PhD advisor to package my code with guix and really document the deps down to the kernel, because he reckons a requirements.txt is enough and I&#x2019;m wasting the project&#x2019;s time.&#x201d;</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <italic toggle="yes">&#x201c;To me, publishing the code is a way to document the scientific process. Unfortunately, some people expect the code to be reusable without any effort (to analyze another dataset for instance), which is not the purpose of publishing the code (publishing a package/software is a totally different process). This misunderstanding often leads to uninteresting email debugging discussions, which could discourage a &#x201c;full publication&#x201d; strategy of the research code.&#x201d;</italic>
                            </p>
                        </list-item>
                    </list>
                </p>
            </sec>
            <sec id="sec17">
                <title>Insights about code reuse</title>
                <p>Regarding the reuse of the research code, respondents were asked to check all the options that apply to their practices. Accordingly, a high proportion of respondents utilized the code to improve their own research code or to learn new coding strategies (86/113, 76% and 75/113, 66%, respectively). Research validation, replication, or utilization as a teaching material was in the range of 46-51 respondents out of 113, 41-45%, while 15/113 (13%) did not use existing research codes. Considering the credibility of reused research codes, researchers deem open accessibility and well-documented codes crucial.</p>
                <p>Regarding the aspects of using existing code, the most important factor is well-established documentation, with 84%, followed by open-access code (83%), and 56% are concerned about acquiring code from a reputable source. Clearly defined rights to use, reference for code in research papers, immediate access, and the possibility to cite are less relevant, with 43, 50, 54, and 45%, respectively.</p>
            </sec>
        </sec>
        <sec id="sec18" sec-type="discussion">
            <title>Discussion</title>
            <p>Discussion is organized following the structure of research questions.</p>
            <sec id="sec19">
                <title>Perceptions about practices that support computational reproducibility</title>
                <boxed-text id="B1" orientation="portrait" position="float">
                    <p>Key message: Researchers associate reproducible practices with transparency, collaboration, and public benefit. While awareness of the importance of reproducibility is widespread, there is still a gap between recognition and consistent implementation, with many researchers being cautious about sharing before publication.</p>
                    <p>When research is publicly funded, more than 60% of the respondents agree to share codes, data, and documentation. However, nearly 20% of leading researchers disagree with sharing documentation, mentioning time and effort as a burden.</p>
                </boxed-text>
                <p>Considering the reasons why making data publicly available is important, responses highlighted the following reasons: Because it is a good research practice was considered by 84/87 (96%) of respondents with Agree 26/87 (30%) and Strongly Agree 57/87 (66%). In fact, social desirability (
                    <xref ref-type="bibr" rid="ref36">Fisher, 1993</xref>) is difficult to filter here. However, it is more meaningful that, in second place, 77/87 (89%) (Agree 29/87, 33% and Strongly Agree 49/87, 56%) of participants responded to 
                    <italic toggle="yes">Enabling collaboration and contribution by other researchers</italic>, together with similar ratios for 
                    <italic toggle="yes">Enabling validation and replication and public benefits</italic> 77/87 (89%) (Agree 25/87, 29% and Strongly Agree 52/87, 60%). Comparing the reasons for making the research code publicly available, a similar trend can be observed. Again, social desirability can appear; however, replies confirm that researchers are aware of the need to share data and codes.</p>
                <p>The results highlight a gap between awareness and consistent implementation of reproducible practices. As pointed out by (
                    <xref ref-type="bibr" rid="ref31">Stodden, 2010</xref>), researchers avoid revealing work before publication as a window of protection while ideas are still in development. In the same perspective (
                    <xref ref-type="bibr" rid="ref32">Tenopir et al., 2011</xref>), found that only 30.5% of the scientists agreed to share data before publication.</p>
                <p>On the other hand, the least indicated reasons for researchers sharing their code are the founder requirements, as well as obtaining more credit and citations. This shows a certain level of awareness, as good research practice, validation, and collaboration opportunities precede obligations among respondents. However, considering resources (
                    <xref ref-type="fig" rid="f3">Figure 3</xref>), respondents ranked journal requirements first as they would create equal requirements and established expectations, thereby promoting reproducibility.</p>
                <p>According to the replies, when the study received public funding, more than 60% of participants agreed to share Code, Data and Documentation. A similar point was noted by (
                    <xref ref-type="bibr" rid="ref32">Tenopir et al., 2011</xref>), publicly funded research must be public property. In contrast, it is interesting to point out that, in this research, nearly 20% of the leading researchers disagreed with sharing research documentation when looking at the demographic breakdown. This might be because the concept of documentation can be cumbersome and time-consuming. Accordingly, behavioral change and education in the context of OS practices are still strongly needed.</p>
            </sec>
            <sec id="sec20">
                <title>How code and data are shared during publication</title>
                <boxed-text id="B2" orientation="portrait" position="float">
                    <p>Key message: Open-source software is considered the cornerstone of reproducibility. A large majority of the respondents (83%) reported frequent or always using open-source tools. Open-access publication is one of the most widely adopted practices (69%), although open peer review is less common and often not under the direct control of researchers.</p>
                </boxed-text>
                <p>Open-source software is a key element in many tools and services, and it inherently supports reproducibility. As (NI4OS, 2023) states, &#x201c;the software-based services and infrastructure of OS are so important that it is safe to say that OS would not exist today without software, and, for a large part of that claim, without free and open-source software.&#x201d;</p>
                <p>The results show that the use of open software was adopted by 100/120, 83% (Frequently + Always) (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>) of respondents, demonstrating that the participants aligned OS practices with free software.</p>
                <p>Scientific communication is moving into a new stage defined by transparency and reproducibility (
                    <xref ref-type="bibr" rid="ref31">Stodden, 2010</xref>). The Association of Scientific, Technical &amp; Medical Publishers (STM) found that Open Access (gold and green) publications increased from 20% to 43% between 2013 and 2023 (
                    <xref ref-type="bibr" rid="ref37">STM, 2025</xref>), taking into account articles, reviews, and conference papers. In this survey, open access publication was in the second position among the most commonly used practices with 83/120, 69% (Frequently + Always in Question 2.1, 
                    <xref ref-type="fig" rid="f1">Figure 1</xref>). However, Open peer review is a less common practice, mostly outside the researcher&#x2019;s control. The results also highlight that other actors in the research ecosystem, such as journal publishers, play an essential role in disseminating good practices.</p>
            </sec>
            <sec id="sec21">
                <title>Obstacles impeding computational reproducibility</title>
                <boxed-text id="B3" orientation="portrait" position="float">
                    <p>Key message: Incomplete or inadequate documentation was the most frequently identified obstacle and was consistently ranked first by respondents. The lack of standardized practices across laboratories and research groups creates additional difficulties. Behind these shortcomings, the time and labor required to prepare materials for sharing, lack of time, and pressure to publish are mentioned. Cultural barriers such as reluctance to share unfinished work also contribute to inconsistent reproducibility. Structural obstacles include limited incentives, fragmented requirements, and lack of institutional support.</p>
                </boxed-text>
                <p>Incomplete or inadequate documentation is the top-ranked reason why the studies are not computationally reproducible. A similar aspect, lack of documentation, was found by (
                    <xref ref-type="bibr" rid="ref29">Reinecke et al., 2022</xref>). On this topic, there is a trade-off between sharing and reproducibility. Although researchers do not prepare proper documentation, they are not willing to share data, code, etc., for several reasons; consequently, less material is available for computational reproducibility. On the other hand, sharing without basic organization and documentation is unlocking this &#x2018;first&#x2019; barrier but not smoothing out the second one, still leaving a gap in this stage. Balance might be achieved through cultural change through training and coordinated requirements. To overcome the reproducibility barriers, respondents ranked first in Journals require data, code, metadata, etc. (with a calculated total score of 482, 
                    <xref ref-type="fig" rid="f3">Figure 3</xref>), followed by incentivizing and rewarding researchers to make their work more reproducible (with a score of 439, 
                    <xref ref-type="fig" rid="f3">Figure 3</xref>).</p>
                <p>Journal requirements for code sharing have increasingly appeared in the past, particularly in fields where computational methods are central to research. Having studied the actual policies for some of the most acknowledged publication platforms (without claiming to be exhaustive), the code-sharing requirements are as follows:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>The authors are encouraged to make all the custom codes used in their research publicly available. Code availability is required for some journals in 
                                <italic toggle="yes">Nature</italic> Portfolio (such as 
                                <italic toggle="yes">Nature Methods</italic>), code availability is 
                                <italic toggle="yes">required</italic> (Nature Journal).</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Strongly encourages code sharing, and in many cases, peer review and publication are required (Science).</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Requires that all data and codes needed to replicate the results are made available without restriction at the time of publication (PlosOne).</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Strong emphasis on reproducibility. The code should be shared for all results derived from the computational analyses (eLife).</p>
                        </list-item>
                    </list>
                </p>
                <p>However, these incentives on the journals&#x2019; side ideally should be accompanied by actions on the institutional side to create a more supportive research environment in the long run.</p>
                <p>
The inconsistent standardization within single laboratories or research groups, along with the lack of measures such as systematic code commenting and documentation practices, are obstacles to computational reproducibility (
                    <xref ref-type="bibr" rid="ref2">AlNoamany &amp; Borghi, 2018</xref>). Considering that a 5-year-old paper (
                    <xref ref-type="bibr" rid="ref20">Liu &amp; Salganik, 2019</xref>) highlights the same issues against computational reproducibility, it is an alarming sign that there is still much to do toward progress in this field. (
                    <xref ref-type="bibr" rid="ref38">Hocquet &amp; Wieber, 2021</xref>) draw attention also to the &#x201c;na&#x00ef;ve expectancy of total computational reproducibility&#x201d; as well as to the fact of epistemic issues in the actual practice. Accordingly, it is still an actual task to provide optionally specified guidance materials and train researchers about tools to standardize computing environments (e.g., dockerization and standardized OS platforms) in everyday research practice. The ranked items also highlighted the need for stronger collaboration between stakeholders (researchers, their institutions, and publishers) to create a more supportive environment.</p>
                <p>As barriers to making research codes publicly available, respondents placed the first lack of time, followed by pressure to publish. In the same direction (
                    <xref ref-type="bibr" rid="ref31">Stodden, 2010</xref>), found that the largest barriers to sharing code are the time to clean up and document it for release, followed by issues in the code by other users.</p>
                <p>The responses and individual opinions highlight the need for harmonized incentives and awareness raising in all stages of the researchers&#x2019; life cycle and point out that publishing data and code in a computationally reproducible manner requires additional efforts from both the provider and the utilizer.</p>
            </sec>
            <sec id="sec22">
                <title>Replication practices and success rates</title>
                <boxed-text id="B4" orientation="portrait" position="float">
                    <p>Key message: Almost one-third of the respondents reported that they had never tried to reproduce another study. Based on the identified reason, time and labor constraints limit researchers&#x2019; ability to invest in replication. When replication is attempted, researchers often find that open data (70%), open codes (71%), and metadata (86%) are missing or incomplete. Respondents suggested that replication would be more successful if it was incentivized and better integrated into everyday research practices.</p>
                </boxed-text>
                <p>The survey also aimed to reveal the degree of effort made to reproduce others&#x2019; work. Importantly, 33/120 (27.5%) respondents had never attempted to reproduce a study.</p>
                <p>In comparison with &#x201c;59% of all participants never ran somebody else&#x2019;s model to reproduce their results&#x201d; from (
                    <xref ref-type="bibr" rid="ref29">Reinecke et al., 2022</xref>), although their research focused on earth sciences researchers, instead of a broad target group like the present study. Consequently, these numbers suggest another intervention point to encourage reproducibility studies. However, considering time and labor constraints, it should be done and incentivized in a reasonable manner, linked strongly to actual research work. According to respondents&#x2019; experiences, Open data (84/120, 70%), Open code (85/120, 71%), or Metadata (103/120, 86%) are Never, Rarely, or only Sometimes available in the publications they are reading.</p>
            </sec>
        </sec>
        <sec id="sec23">
            <title>Study limitations and recommendations</title>
            <p>Given the method of distribution, we did not have information about either the reached population or response rate. However, the demographics of the population who completed the survey are described in detail in the Demographics section.</p>
            <p>The likely low response rate due to the survey&#x2019;s broad distribution limits its representativeness. Accordingly, the findings may not reflect the broader research community, especially because demographics (mainly region) of respondents cannot be considered representative, as most replies arrived from Europe (109/133, 82%). Despite these limitations, the study aligned findings with similar previous studies (e.g. 
                <xref ref-type="bibr" rid="ref20">Liu &amp; Salganik, 2019</xref>; 
                <xref ref-type="bibr" rid="ref29">Reinecke et al., 2022</xref>), demonstrating consistency in identified trends and challenges in open science practices. Nevertheless, it is well-balanced in terms of disciplinary breakdown, and despite limitations, it provides an up-to-date snapshot about the most and least common open science, data, and code sharing practices, key barriers, and highlights the need for a systemic cultural shift within the research ecosystem.</p>
            <p>As a recommendation, a lower number of questions may lead to more direct questions and focused results.</p>
        </sec>
        <sec id="sec24" sec-type="conclusions">
            <title>Conclusions</title>
            <p>Digital tools play a crucial role in reproducible research by enabling standardization and automation; supporting data provenance and metadata tracking to ensure traceability and integrity; and facilitating transparent and shareable reporting. The survey revealed that barriers to computational reproducibility remained largely unchanged over the past six years ago (
                <xref ref-type="bibr" rid="ref20">Liu &amp; Salganik, 2019</xref>) and three years ago (
                <xref ref-type="bibr" rid="ref29">Reinecke et al., 2022</xref>) pointed out the same challenges regarding data and code sharing. Issues such as inadequate documentation, incompatible computing environments, and unresolved software dependencies, as well as a lack of time, continue to hinder progress. This should be a key consideration and a focus on current and future metascience projects.</p>
            <p>Practices to support computational reproducibility, such as the use of open-source software and open access publishing, are now well established among researchers, demonstrating a strong foundation for open science principles. However, this widespread awareness has not yet translated into the consistent implementation of more demanding reproducibility practices, such as study (pre) registration, replication efforts, or open peer review, which remain significantly underutilized. Moreover, although most respondents agreed that data and code sharing are vital for scientific integrity and collaboration, actual sharing practices lag behind, with a large portion of researchers reporting little or no data or code publications in recent years.</p>
            <p>These persistent challenges underscore the importance of providing effective technical support for researchers in the form of standardized tools, training, and methodological guidance to help overcome practical obstacles and to utilize computational methods more routinely. Training initiatives were identified as crucial for embedding good practices early in the research lifecycle. Embedding data management and data analysis into PhD, or even Bachelor&#x2019;s (BS) and Master&#x2019;s (MS) programs, is crucial across disciplines, as most of them increasingly rely on collecting, managing, and interpreting data.</p>
            <p>A recurrent theme throughout the survey was the need for structural incentives and institutional support. Researchers claim that making work reproducible requires time, resources, and expertise; however, these efforts are rarely rewarded in outdated, conventional academic evaluation systems. Respondents also emphasized the role of journals, funding agencies, and institutions in promoting and rewarding open and reproducible research. These opinions highlight the need for the wider dissemination of new evaluation systems (DORA: 
                <xref ref-type="bibr" rid="ref6">Cagan, 2013</xref>; 
                <xref ref-type="bibr" rid="ref8">CoARA, 2022</xref>) that have not yet been widely applied.</p>
            <p>In conclusion, although awareness of open science and reproducibility is high, widespread and consistent applications are still lacking. Addressing this gap requires coordinated efforts to remove technical barriers, redesign incentive structures, and create a culture supporting transparency and collaboration. The insights from this survey suggest that meaningful progress will depend not only on individual effort but also on systemic change across the research ecosystem.</p>
        </sec>
        <sec id="sec25">
            <title>Software availability statement</title>
            <p>For the analysis, Quarto (
                <xref ref-type="bibr" rid="ref1">Allaire et al., 2022</xref>) version 1.6.32 within RStudio (
                <xref ref-type="bibr" rid="ref27">Posit team, 2025</xref>) version 2025.05.0+496. R (
                <xref ref-type="bibr" rid="ref28">R Core Team, 2024</xref>) was used, that is an open-source scientific and technical publishing system, available at 
                <ext-link ext-link-type="uri" xlink:href="https://quarto.org/">https://quarto.org/</ext-link>.</p>
        </sec>
    </body>
    <back>
        <sec id="sec28" sec-type="data-availability">
            <title>Data availability statement</title>
            <sec id="sec29">
                <title>Underlying data</title>
                <p>Open Science Framework (OSF): 3.1. Computational reproducibility checks, Folder &#x201c;Survey raw data and analysis&#x201d;, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.17605/OSF.IO/6YSRH">https://doi.org/10.17605/OSF.IO/6YSRH</ext-link>, 
                    <xref ref-type="bibr" rid="ref13">Gelsleichter et al., 2025</xref>.</p>
                <p>Folder contains the following files:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>
Survey_documents_from_LimeSurvey.zip &#x2013; the complete set of materials implemented in the LimeSurvey online platform</p>
                            <list list-type="bullet">
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>Folder &#x201c;form_and_questions&#x201d; contains the original survey materials, exported from the LimeSurvey platform, including a README - Computational reproducibility status survey.txt that supports overview of underlying files.</p>
                                </list-item>
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>Folder &#x201c;survey_responses&#x201d; contains the raw anonymous responses, exported to several formats allowed by LimeSurvey platform, along with a README.txt</p>
                                </list-item>
                            </list>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>
Survey_responses_analysis.zip contains the analysis of survey responses, organizing the respective files in the following folders:</p>
                            <list list-type="bullet">
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>Folder &#x201c;input&#x201d;: contains the raw input files and other annexes used for the analysis.</p>
                                </list-item>
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>Folder &#x201c;script&#x201d;: contains the complete analysis script to support reproducibility, as well as the result files</p>
                                </list-item>
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>Readme.txt</p>
                                </list-item>
                            </list>
                        </list-item>
                    </list>
</p>
            </sec>
            <sec id="sec30">
                <title>Extended data</title>
                <p>Open Science Framework (OSF): 3.1. Computational reproducibility checks, Folder &#x201c;Protocol_survey&#x201d;, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.17605/OSF.IO/6YSRH">https://doi.org/10.17605/OSF.IO/6YSRH</ext-link>, 
                    <xref ref-type="bibr" rid="ref12">Gelsleichter et al., 2024</xref>.</p>
                <p>
OSIRIS_survey_protocol.pdf contains the protocol of the study, the informed consent page of the survey, as well as the survey itself with the complete list of questions.</p>
            </sec>
            <sec id="sec31">
                <title>Reporting guidelines</title>
                <p>Open Science Framework (OSF): 3.1. Computational reproducibility checks, Folder &#x201c;CHERRIES checklist&#x201d;, Checklist for &#x2018;Survey about Barriers and Solutions for Enhancing Computational Reproducibility in Scientific Research&#x2019;, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.17605/OSF.IO/6YSRH">https://doi.org/10.17605/OSF.IO/6YSRH</ext-link>, 
                    <xref ref-type="bibr" rid="ref12">Gelsleichter et al., 2024</xref>.</p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            </sec>
        </sec>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Allaire</surname>
                            <given-names>JJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Teague</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Xie</surname>
                            <given-names>Y</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Quarto [Computer software].</article-title>
                    <source>

                        <italic toggle="yes">Zenodo.</italic>
</source>
                    <year>2022</year>.
                    <pub-id pub-id-type="doi">10.5281/ZENODO.5960048</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>AlNoamany</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Borghi</surname>
                            <given-names>JA</given-names>
                        </name>
</person-group>:
                    <article-title>Towards computational reproducibility: Researcher perspectives on the use and sharing of software.</article-title>
                    <source>

                        <italic toggle="yes">PeerJ Computer Science.</italic>
</source>
                    <year>2018</year>;<volume>4</volume>:<fpage>e163</fpage>.
                    <pub-id pub-id-type="pmid">33816816</pub-id>
                    <pub-id pub-id-type="doi">10.7717/peerj-cs.163</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7924683</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Baker</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>1,500 scientists lift the lid on reproducibility.</article-title>
                    <source>

                        <italic toggle="yes">Nature.</italic>
</source>
                    <year>2016</year>;<volume>533</volume>(<issue>7604</issue>):<fpage>452</fpage>&#x2013;<lpage>454</lpage>.
                    <pub-id pub-id-type="pmid">27225100</pub-id>
                    <pub-id pub-id-type="doi">10.1038/533452a</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Barone</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Williams</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Micklos</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <article-title>Unmet needs for analyzing biological big data: A survey of 704 NSF principal investigators.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Comput. Biol.</italic>
</source>
                    <year>2017</year>;<volume>13</volume>(<issue>10</issue>):<fpage>e1005755</fpage>.
                    <pub-id pub-id-type="pmid">29049281</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pcbi.1005755</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5654259</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Begley</surname>
                            <given-names>CG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ellis</surname>
                            <given-names>LM</given-names>
                        </name>
</person-group>:
                    <article-title>Raise standards for preclinical cancer research.</article-title>
                    <source>

                        <italic toggle="yes">Nature.</italic>
</source>
                    <year>2012</year>;<volume>483</volume>(<issue>7391</issue>):<fpage>531</fpage>&#x2013;<lpage>533</lpage>.
                    <pub-id pub-id-type="doi">10.1038/483531a</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cagan</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>San Francisco Declaration on Research Assessment.</article-title>
                    <source>

                        <italic toggle="yes">Dis. Model. Mech.</italic>
</source>
                    <year>2013</year>;<volume>6</volume>:<fpage>869</fpage>&#x2013;<lpage>870</lpage>.
                    <pub-id pub-id-type="pmid">23690539</pub-id>
                    <pub-id pub-id-type="doi">10.1242/dmm.012955</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3701204</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chirigati</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rampin</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shasha</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>ReproZip: Computational Reproducibility With Ease.</article-title>
                    <source>

                        <italic toggle="yes">Journal Article.</italic>
</source>
                    <year>2016</year>;<fpage>2085</fpage>&#x2013;<lpage>2088</lpage>.
                    <pub-id pub-id-type="doi">10.1145/2882903.2899401</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <mixed-citation publication-type="other">
                    <collab>CoARA</collab>:
                    <article-title>Agreement on Reforming Research Assessment.</article-title>
                    <year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://coara.eu/agreement/the-agreement-full-text/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cr&#x00fc;well</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Apthorp</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baker</surname>
                            <given-names>BJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>What&#x2019;s in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of 
                        <italic toggle="yes">Psychological Science.</italic>
                    </article-title>
                    <source>

                        <italic toggle="yes">Psychol. Sci.</italic>
</source>
                    <year>2023</year>;<volume>34</volume>(<issue>4</issue>):<fpage>512</fpage>&#x2013;<lpage>522</lpage>.
                    <pub-id pub-id-type="pmid">36730433</pub-id>
                    <pub-id pub-id-type="doi">10.1177/09567976221140828</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <mixed-citation publication-type="other">
                    <collab>EURAXESS</collab>:
                    <article-title>Research profiles descriptors.</article-title>
                    <year>2023</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://euraxess.ec.europa.eu/career-development/researchers">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eysenbach</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <article-title>Improving the Quality of Web Surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES).</article-title>
                    <source>

                        <italic toggle="yes">J. Med. Internet Res.</italic>
</source>
                    <year>2004</year>;<volume>6</volume>(<issue>3</issue>):<fpage>e132</fpage>.
                    <pub-id pub-id-type="pmid">15471760</pub-id>
                    <pub-id pub-id-type="doi">10.2196/jmir.6.3.e34</pub-id>
                    <pub-id pub-id-type="pmcid">PMC1550605</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref36">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fisher</surname>
                            <given-names>RJ</given-names>
                        </name>
</person-group>:
                    <article-title>Social Desirability Bias and the Validity of Indirect Questioning.</article-title>
                    <source>

                        <italic toggle="yes">J. Consum. Res.</italic>
</source>
                    <year>1993</year>;<volume>20</volume>(<issue>2</issue>):<fpage>303</fpage>&#x2013;<lpage>315</lpage>.
                    <pub-id pub-id-type="doi">10.1086/209351</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gelsleichter</surname>
                            <given-names>YA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Folly</surname>
                            <given-names>BB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Van Den Eynden</surname>
                            <given-names>V</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Study protocol&#x2014;Survey on computational reproducibility covering quantitative research.</article-title>
                    <year>2024</year>.
                    <pub-id pub-id-type="doi">10.17605/OSF.IO/6YSRH</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gelsleichter</surname>
                            <given-names>YA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Folly</surname>
                            <given-names>BB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Van Den Eynden</surname>
                            <given-names>V</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Study responses&#x2014;Survey on computational reproducibility covering quantitative research.</article-title>
                    <year>2025</year>.
                    <pub-id pub-id-type="doi">10.17605/OSF.IO/6YSRH</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <mixed-citation publication-type="data">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hettrick</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Antonioletti</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Carr</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <data-title>Uk Research Software Survey 2014.</data-title>[Dataset].
                    <source>

                        <italic toggle="yes">Zenodo.</italic>
</source>
                    <year>2014</year>.
                    <pub-id pub-id-type="doi">10.5281/ZENODO.14809</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref38">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hocquet</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wieber</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>Epistemic issues in computational reproducibility: Software as the elephant in the room.</article-title>
                    <source>

                        <italic toggle="yes">Eur. J. Philos. Sci.</italic>
</source>
                    <year>2021</year>;<volume>11</volume>(<issue>2</issue>):<fpage>38</fpage>.
                    <pub-id pub-id-type="doi">10.1007/s13194-021-00362-9</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <mixed-citation publication-type="other">
                    <collab>iEMSs</collab>:
                    <article-title>International Environmental Modelling and Software Society.</article-title>
                    <year>2024</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://iemss.org/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <mixed-citation publication-type="other">
                    <collab>International Environmental Modelling and Software Society</collab>:
                    <article-title>International Environmental Modelling and Software Society.</article-title>
                    <year>2024</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://iemss.org/page/2/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ioannidis</surname>
                            <given-names>JPA</given-names>
                        </name>
</person-group>:
                    <article-title>Why Most Published Research Findings Are False.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Med.</italic>
</source>
                    <year>2005</year>;<volume>2</volume>(<issue>8</issue>):<fpage>e124</fpage>.
                    <pub-id pub-id-type="pmid">16060722</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pmed.0020124</pub-id>
                    <pub-id pub-id-type="pmcid">PMC1182327</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lakens</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <article-title>Improving Your Statistical Inferences.</article-title>
                    <year>2022</year>.
                    <pub-id pub-id-type="doi">10.5281/zenodo.6409077</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <mixed-citation publication-type="book">
                    <collab>LimeSurvey</collab>:
                    <source>

                        <italic toggle="yes">LimeSurvey: An Open Source survey tool [Computer software].</italic>
</source>
                    <publisher-name>LimeSurvey GmbH</publisher-name>;<year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.limesurvey.org">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>DM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Salganik</surname>
                            <given-names>MJ</given-names>
                        </name>
</person-group>:
                    <article-title>Successes and Struggles with Computational Reproducibility: Lessons from the Fragile Families Challenge.</article-title>
                    <source>

                        <italic toggle="yes">Socius.</italic>
</source>
                    <year>2019</year>;<volume>5</volume>:<fpage>2378023119849803</fpage>.
                    <pub-id pub-id-type="pmid">37309413</pub-id>
                    <pub-id pub-id-type="doi">10.1177/2378023119849803</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10260256</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Merkel</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <article-title>Docker: Lightweight linux containers for consistent development and deployment [Computer software].</article-title>
                    <source>

                        <italic toggle="yes">Linux Journal.</italic>
</source>
                    <year>2014</year>.
                    <pub-id pub-id-type="doi">10.5555/2600239</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Munaf&#x00f2;</surname>
                            <given-names>MR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nosek</surname>
                            <given-names>BA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bishop</surname>
                            <given-names>DVM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A manifesto for reproducible science.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Hum. Behav.</italic>
</source>
                    <year>2017</year>;<volume>1</volume>(<issue>1</issue>):<fpage>Article 1</fpage>.
                    <pub-id pub-id-type="pmid">33954258</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41562-016-0021</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7610724</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <mixed-citation publication-type="book">
                    <collab>National Academies of Sciences, Engineering, and Medicine</collab>:
                    <source>

                        <italic toggle="yes">Reproducibility and Replicability in Science.</italic>
</source>
                    <publisher-name>National Academies Press</publisher-name>;<year>2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.nap.edu/catalog/25303">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <mixed-citation publication-type="journal">
                    <collab>Open Science Collaboration</collab>:
                    <article-title>Estimating the reproducibility of psychological science.</article-title>
                    <source>

                        <italic toggle="yes">Science.</italic>
</source>
                    <year>2015</year>;<volume>349</volume>(<issue>6251</issue>).
                    <pub-id pub-id-type="doi">10.1126/science.aac4716</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref25">
                <mixed-citation publication-type="other">
                    <collab>openaccess.nl</collab>:
                    <article-title>What is Open Access? | Open Access.</article-title>
                    <year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.openaccess.nl/en/what-is-open-access">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Peng</surname>
                            <given-names>RD</given-names>
                        </name>
</person-group>:
                    <article-title>Reproducible Research in Computational Science.</article-title>
                    <source>

                        <italic toggle="yes">Science.</italic>
</source>
                    <year>2011</year>;<volume>334</volume>(<issue>6060</issue>):<fpage>1226</fpage>&#x2013;<lpage>1227</lpage>.
                    <pub-id pub-id-type="pmid">22144613</pub-id>
                    <pub-id pub-id-type="doi">10.1126/science.1213847</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3383002</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <mixed-citation publication-type="book">
                    <collab>Posit team</collab>:
                    <source>

                        <italic toggle="yes">RStudio: Integrated Development Environment for R.</italic>
</source>
                    <publisher-name>Posit Software, PBC</publisher-name>;<year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.posit.co/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <mixed-citation publication-type="book">
                    <collab>R Core Team</collab>:
                    <source>

                        <italic toggle="yes">R: A Language and Environment for Statistical Computing.</italic>
</source>
                    <publisher-name>R Foundation for Statistical Computing</publisher-name>;<year>2024</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.R-project.org/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref29">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Reinecke</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Trautmann</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wagener</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The critical need to foster computational reproducibility.</article-title>
                    <source>

                        <italic toggle="yes">Environ. Res. Lett.</italic>
</source>
                    <year>2022</year>;<volume>17</volume>(<issue>4</issue>):<fpage>041005</fpage>.
                    <pub-id pub-id-type="doi">10.1088/1748-9326/ac5cf8</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref30">
                <mixed-citation publication-type="other">
                    <collab>Springer Nature Research Communities</collab>:
                    <article-title>Researchers of Springer Nature communities from different disciplines are invited to contribute to the important topic of science reproducibility by filling the survey (see link below) and by providing their views and insights.</article-title>
                    <year>2024</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://communities.springernature.com/posts/researchers-contribution-needed-deadline-of-computational-reproducibility-survey-is-extended">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref37">
                <mixed-citation publication-type="book">
                    <collab>STM</collab>:
                    <source>

                        <italic toggle="yes">Uptake of Open Access.</italic>
</source>
                    <publisher-name>STM Advances Trusted Research</publisher-name>;<year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://stm-assoc.org/oa-dashboard/oa-dashboard-2024/uptake-of-open-access/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref31">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Stodden</surname>
                            <given-names>V</given-names>
                        </name>
</person-group>:
                    <article-title>The Scientific Method in Practice: Reproducibility in the Computational Sciences.</article-title>
                    <source>

                        <italic toggle="yes">SSRN Electron. J.</italic>
</source>
                    <year>2010</year>.
                    <pub-id pub-id-type="doi">10.2139/ssrn.1550193</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref32">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tenopir</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Allard</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Douglass</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Data Sharing by Scientists: Practices and Perceptions.</article-title>
                    <source>

                        <italic toggle="yes">PLoS ONE.</italic>
</source>
                    <year>2011</year>;<volume>6</volume>(<issue>6</issue>):<fpage>e21101</fpage>.
                    <pub-id pub-id-type="pmid">21738610</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0021101</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3126798</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref33">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <collab>The Brazilian Reproducibility Initiative</collab>

                        <name name-style="western">
                            <surname>Amaral</surname>
                            <given-names>OB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Carneiro</surname>
                            <given-names>CFD</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Estimating the replicability of Brazilian biomedical science.</article-title>
                    <source>

                        <italic toggle="yes">Scientific Communication and Education.</italic>
</source>
                    <year>2025</year>.
                    <pub-id pub-id-type="doi">10.1101/2025.04.02.645026</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref34">
                <mixed-citation publication-type="other">
                    <collab>UNDP</collab>:
                    <article-title>Human Development Index (HDI).</article-title>
                    <year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://hdr.undp.org/data-center/human-development-index#/indicies/HDI">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref35">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Van Den Eynden</surname>
                            <given-names>V</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Knight</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vlad</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Towards Open Research: Practices, experiences, barriers and opportunities.</article-title>
                    <year>2016</year>.
                    <pub-id pub-id-type="doi">10.6084/M9.FIGSHARE.4055448.V1</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report442319">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.189689.r442319</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Ostermann</surname>
                        <given-names>Frank Olaf</given-names>
                    </name>
                    <xref ref-type="aff" rid="r442319a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-9317-8291</uri>
                </contrib>
                <aff id="r442319a1">
                    <label>1</label>University of Twente, Enschede, The Netherlands</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>22</day>
                <month>1</month>
                <year>2026</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2026 Ostermann FO</copyright-statement>
                <copyright-year>2026</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport442319" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.172013.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>A good thing about open peer review is that reviews can refer to a previous one. In this case, the first review has already done a remarkable job at evaluating the paper. In fact, there is no statement I would disagree with, and several statements that I strongly support. My review will thus briefly state those I particularly consider important and then try to add a few additional points from my perspective.&#x00a0;</p>
            <p> </p>
            <p> But first, I want to emphasize that the authors have done a commendable job at making their own work open and reproducible. There is extensive information on all aspects of the study available.&#x00a0;</p>
            <p> </p>
            <p> However, the paper itself is indeed quite exploratory in nature, and a different study design could allow more systematic and inferential analysis that goes beyond the descriptive statistics that are reported. On a sidenote, I could not find information on the members of the consortium that designed the survey - were they sufficiently diverse (backgrounds, career stages, ...) to replace a pilot study with respondent feedback?&#x00a0;</p>
            <p> </p>
            <p> I also view the lack of systematic definition of terminology as problematic - given the variety of terminology surrounding open and reproducible research (reproduction, replication, generalisation, robustness, reanalysis, repeatability, ...), it seems necessary to clarify the authors' use of these terms and their use in the survey.</p>
            <p> </p>
            <p> The referenced literature is not a strong point of this paper, which refers to "recent studies" several times, but then these studies are from more than 10 years ago. While of course newer literature is not always more relevant, in the context of open and reproducible research, recency matters. The reproducibility crisis was 'diagnosed' only two decades ago, with many papers during the following ten years or so trying to determine the scope of the problem. It's been only during the last decade that research proposing and evaluating solutions has become more prominent, and such works would be very relevant for this paper. There is a hint that the paper (or at least parts of it) has been in the works for some time and might need an update: it refers to studies from 2018 and 2019 as being "five years ago". I've also wondered whether there was a second round of literature review after the survey. The open survey questions might contain valuable hints at more recent studies, worthy following up. In any case, additional insights would be possible with a more systematic comparison with other surveys. From my own discipline, which is admittedly a smaller one and thus not often popping up in cross-disciplinary research, I could cite (Kedron et al.,2024)&#x00a0;as well as my own work.&#x00a0;</p>
            <p> </p>
            <p> Lastly, the interpretation and discussion of the survey outcomes could be more assertive. For example, the repeated claim that making work more reproducible requires significant time and effort and thus merits additional rewards - I think this needs some contextualization and critical appraisal. A basic level or reproducibility does not require that much effort or skill: non-proprietary software, structured documentation, and a deposition of code and data on a public repository. For most of the research that I have been reviewing over the past 15 years, achieving this basic level of reproducibility would not have been too hard. But maybe the survey respondents tried to provide an answer for a statement that is seems to be missing in the survey: Funding, rewards, and recognition for reproducing and replicating studies. Because that is the final goal, why we should make studies more reproducible: so that eventually there is a documented/published attempt at reproduction or replication. If only a tiny fraction of all output ever actually gets reproduced, then the question of why to spend even moderate effort on making something reproducible is a valid concern. This important perspective is only discussed in passing in a very short section.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>geographic information science, geodata engineering, participatory research, open and reproducible research</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-442319-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Reproducible Research Practices and Barriers to Reproducible Research in Geography: Insights from a Survey</article-title>.
                        <source>
                            <italic>Annals of the American Association of Geographers</italic>
                        </source>.<year>2024</year>;<volume>114</volume>(<issue>2</issue>) :
                        <elocation-id>10.1080/24694452.2023.2276115</elocation-id>
                        <fpage>369</fpage>-<lpage>386</lpage>
                        <pub-id pub-id-type="doi">10.1080/24694452.2023.2276115</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
        <sub-article article-type="response" id="comment15575-442319">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Varga</surname>
                            <given-names>Monika</given-names>
                        </name>
                        <aff>Institute of Animal Sciences, Magyar Agrar- es Elettudomanyi Egyetem - Kaposvari Campus, Kaposv&#x00e1;r, Somogy County, Hungary</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>2</day>
                    <month>3</month>
                    <year>2026</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Dr. Frank Olaf Ostermann,</p>
                <p> We are grateful for your insightful comments and for drawing our attention to areas requiring further elaboration. Your feedback has considerably improved the quality of our work. Below please find our point-by-point reply.</p>
                <p> </p>
                <p> *A good thing about open peer review is that reviews can refer to a previous one. In this case, the first review has already done a remarkable job at evaluating the paper. In fact, there is no statement I would disagree with, and several statements that I strongly support. My review will thus briefly state those I particularly consider important and then try to add a few additional points from my perspective.</p>
                <p> But first, I want to emphasize that the authors have done a commendable job at making their own work open and reproducible. There is extensive information on all aspects of the study available.</p>
                <p> 
                    <italic>Thank you for the observation! Appreciated!</italic>
                </p>
                <p> </p>
                <p> *However, the paper itself is indeed quite exploratory in nature, and a different study design could allow more systematic and inferential analysis that goes beyond the descriptive statistics that are reported. On a sidenote, I could not find information on the members of the consortium that designed the survey - were they sufficiently diverse (backgrounds, career stages, ...) to replace a pilot study with respondent feedback?</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> We have reframed the manuscript as an exploratory survey throughout the text. We clarified the scope and addressed representativeness concerns.</italic>
                </p>
                <p>
                    <italic> Also, the survey was designed by a diverse group of scientists from Agronomy, IT, Geomatics to Medical field, PhD to Senior researchers. Regarding the pilot, aside of technical aspects we collect feedback on survey length, typo, logical aspects, dropping and inclusion of questions.</italic>
                </p>
                <p>
                    <italic> These points were addressed in the text. </italic>
                </p>
                <p> </p>
                <p> *I also view the lack of systematic definition of terminology as problematic - given the variety of terminology surrounding open and reproducible research (reproduction, replication, generalisation, robustness, reanalysis, repeatability, ...), it seems necessary to clarify the authors' use of these terms and their use in the survey.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> The concept of &#x2018;Computational reproducibility&#x2019; was deeper explored and detailed. Also, the definition of &#x2018;Replication&#x2019; was also provided. Most of the survey questions gravitated around reproducibility, however pointing to computational reproducibility. As the tooltip (pop-up) tool in the survey platform was available. The definition of Replication studies was also present in the survey. </italic>
                </p>
                <p> </p>
                <p> *The referenced literature is not a strong point of this paper, which refers to "recent studies" several times, but then these studies are from more than 10 years ago. While of course newer literature is not always more relevant, in the context of open and reproducible research, recency matters. The reproducibility crisis was 'diagnosed' only two decades ago, with many papers during the following ten years or so trying to determine the scope of the problem. It's been only during the last decade that research proposing and evaluating solutions has become more prominent, and such works would be very relevant for this paper. There is a hint that the paper (or at least parts of it) has been in the works for some time and might need an update: it refers to studies from 2018 and 2019 as being "five years ago". I've also wondered whether there was a second round of literature review after the survey. The open survey questions might contain valuable hints at more recent studies, worthy following up. In any case, additional insights would be possible with a more systematic comparison with other surveys. From my own discipline, which is admittedly a smaller one and thus not often popping up in cross-disciplinary research, I could cite (Kedron et al.,2024) as well as my own work.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> By the time we wrote the protocol and first draft (end of 2023), the time span was the above mentioned. Thank you also for enlightenment with this citation, we have used gathering academic search tools for papers and these ones were, yet, left out. Both currently adjusted in the text, as eight studies were added. Some examples of peer-reviewed studies include Gomes et al. (2022); Trisovic et al. (2022); Nosek et al. (2022); and Wilkinson et al. (2016). We also incorporate Kedron et al. (2024) and Cerutti et&#x202f;al. (2021), as suggested by the reviewer.</italic>
                </p>
                <p> </p>
                <p> *Lastly, the interpretation and discussion of the survey outcomes could be more assertive. For example, the repeated claim that making work more reproducible requires significant time and effort and thus merits additional rewards - I think this needs some contextualization and critical appraisal. A basic level or reproducibility does not require that much effort or skill: non-proprietary software, structured documentation, and a deposition of code and data on a public repository. For most of the research that I have been reviewing over the past 15 years, achieving this basic level of reproducibility would not have been too hard. But maybe the survey respondents tried to provide an answer for a statement that is seems to be missing in the survey: Funding, rewards, and recognition for reproducing and replicating studies. Because that is the final goal, why we should make studies more reproducible: so that eventually there is a documented/published attempt at reproduction or replication. If only a tiny fraction of all output ever actually gets reproduced, then the question of why to spend even moderate effort on making something reproducible is a valid concern. This important perspective is only discussed in passing in a very short section.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> We are grateful for this incisive critique, which touches on a genuinely important conceptual distinction that our manuscript had not sufficiently developed. We agree that the claim that reproducibility requires "significant effort" warrants critical examination. We have now added a paragraph to address this concern. We thank the reviewer for bringing this perspective; it sharpens the practical contribution of the paper. </italic>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report439988">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.189689.r439988</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Samuel</surname>
                        <given-names>Sheeba</given-names>
                    </name>
                    <xref ref-type="aff" rid="r439988a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-7981-8504</uri>
                </contrib>
                <aff id="r439988a1">
                    <label>1</label>Technische Universitat Chemnitz, Chemnitz, Saxony, Germany</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>30</day>
                <month>12</month>
                <year>2025</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Samuel S</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport439988" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.172013.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The article reports the results of a multidisciplinary, international survey examining barriers, practices, and potential solutions related to computational reproducibility in scientific research. Using an anonymous multidisciplinary survey with 133 complete responses (mostly from Europe), the authors investigate the adoption of open science practices, existing barriers to code and data sharing, and potential solutions to enhance reproducibility. The results indicate high awareness and relatively widespread adoption of open-source software and open-access publishing, contrasted with low uptake of more demanding practices such as preregistration, registered reports, replication studies, and open peer review. Across domains, lack of time, pressure to publish, insufficient funding, and inadequate documentation emerge as the most prominent barriers to computational reproducibility. Respondents strongly emphasize the role of journals, institutions, and incentive structures in driving change.</p>
            <p> </p>
            <p> Strengths</p>
            <p> * Computational reproducibility is a central concern across scientific disciplines, and the study provides an up-to-date snapshot that complements and extends earlier survey-based research in this area.</p>
            <p> * The inclusion of respondents from different disciplines enhances the breadth of perspectives and supports cross-disciplinary comparisons.</p>
            <p> * The study protocol, survey instrument, anonymized data, and analysis scripts are openly available via OSF.</p>
            <p> * The combination of closed-ended questions with open-ended responses provides both quantitative trends and qualitative insights, adding depth to the interpretation of barriers and proposed solutions.</p>
            <p> </p>
            <p> Weaknesses</p>
            <p> * The respondent pool is heavily skewed towards Europe (80%), which limits the global representativeness of the findings, particularly for researchers in developing nations or different institutional cultures.</p>
            <p> * With only 133 complete responses from an initial 254 (and a likely low overall response rate given the social media recruitment), the study may suffer from self-selection bias, where researchers already interested in open science are more likely to participate. While the survey was initiated by many participants, only 133 complete responses were analyzed, which constrains subgroup analyses (e.g., by discipline, region, or career stage). The large number of questions (35 across multiple sections) likely contributed to dropout after the demographic section and may have affected response quality for later items.</p>
            <p> * The data is based on researchers' perceptions of their own practices. There may be a gap between what researchers claim to do and their actual day-to-day adherence to rigorous reproducibility standards. For example, High levels of agreement with statements framing open science practices as &#x201c;good research practice&#x201d; may reflect normative expectations rather than actual behavior.</p>
            <p> * The analysis relies almost entirely on descriptive statistics. While appropriate for an exploratory survey, more inferential or comparative analyses (even exploratory ones) could strengthen the contribution.</p>
            <p> </p>
            <p> </p>
            <p> Improvements</p>
            <p> * While the authors appropriately acknowledge limitations related to sampling and response rate, the manuscript would benefit from a clearer and more explicit framing of the study as exploratory rather than representative. Strengthening the language around what can and cannot be generalized to the broader research community would help readers interpret the findings more accurately.</p>
            <p> * The main manuscript would benefit from more explicit comparisons across career stages, disciplines, or regions (e.g., early-career vs. senior researchers, Europe vs. non-Europe). Even exploratory comparisons could yield actionable insights.</p>
            <p> * It is not sufficiently clear how the results of this study differ from those of earlier surveys on reproducibility, data sharing, or computational practices. A more explicit comparison with prior studies (e.g. what has changed, what remains unchanged, and what new patterns emerge) would strengthen the contribution and help readers understand the added value of this work. Literature review could be improved.</p>
            <p> * The motivation for conducting this survey should also be stated more clearly and earlier in the manuscript. While the introduction references the reproducibility &#x201c;crisis&#x201d; and prior literature, the specific gap that this study aims to fill&#x2014;beyond providing an updated snapshot&#x2014;remains somewhat implicit.</p>
            <p> * the decision to keep the survey open from 23.02.2024 to 30.09.2024 requires clarification. The manuscript does not explain why this relatively long data collection period was chosen, nor how it may have influenced participation, response consistency, or seasonal effects.</p>
            <p> * The paper occasionally uses terms related to reproducibility and replication interchangeably, which can be confusing in a technical survey and may be interpreted differently by respondents (Same applies for&#x00a0; other concepts). Providing brief, standardized definitions in the main text could improve conceptual clarity and consistency.</p>
            <p> * The demographic reporting of 254 respondents has been mentioned but not the 133 participants. This should be clarified to avoid confusion and to ensure that readers understand which population the results actually describe.</p>
            <p> * While the conclusions highlight the need for systemic change, the manuscript could benefit from a more structured set of recommendations targeted at specific stakeholders (e.g., journals, institutions, funders, training programs). Clear, prioritized action points would enhance the practical impact of the findings.</p>
            <p> * Given the survey&#x2019;s distribution through open science networks, respondents are likely more aware of and favorable toward reproducibility practices. A more explicit discussion of how this self-selection may inflate reported awareness or positive attitudes&#x2014;and how this affects interpretation&#x2014;would strengthen the methodological transparency.</p>
            <p> * The current title may overstate the study's outcomes by promising 'Solutions.' Since the data captures researcher viewpoints rather than validated interventions, the authors should rename the article to reflect its exploratory nature.</p>
            <p> * The manuscript could briefly outline how future research might build on this work.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Computer Science, Reproducible Research, Data Provenance, Semantic Web, Knowledge Graphs</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment15574-439988">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Varga</surname>
                            <given-names>Monika</given-names>
                        </name>
                        <aff>Institute of Animal Sciences, Magyar Agrar- es Elettudomanyi Egyetem - Kaposvari Campus, Kaposv&#x00e1;r, Somogy County, Hungary</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>2</day>
                    <month>3</month>
                    <year>2026</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Dr. Sheeba Samuel,</p>
                <p> We appreciated your effort to highlight edges where we need to draw more attention. Your comments are added great value for the publication. Below please find a point-by-point reply.</p>
                <p> </p>
                <p> * While the authors appropriately acknowledge limitations related to sampling and response rate, the manuscript would benefit from a clearer and more explicit framing of the study as exploratory rather than representative. Strengthening the language around what can and cannot be generalized to the broader research community would help readers interpret the findings more accurately.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> We have reframed the manuscript as an exploratory survey throughout the text. We have clarified the scope and addressed representativeness concerns. </italic>
                </p>
                <p> </p>
                <p> * The main manuscript would benefit from more explicit comparisons across career stages, disciplines, or regions (e.g., early-career vs. senior researchers, Europe vs. non-Europe). Even exploratory comparisons could yield actionable insights.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> The comparisons across career stages, disciplines, developed and developing countries, were added through the text, across several questions. Supporting document with figures is placed in &#x201c;Extended data&#x201d; under S5, S6, S7.</italic>
                </p>
                <p> </p>
                <p> * It is not sufficiently clear how the results of this study differ from those of earlier surveys on reproducibility, data sharing, or computational practices. A more explicit comparison with prior studies (e.g. what has changed, what remains unchanged, and what new patterns emerge) would strengthen the contribution and help readers understand the added value of this work. Literature review could be improved.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> The discussion was expanded comparing with other studies, eight peer-reviewed studies were added, including Gomes et al. (2022); Trisovic et al. (2022); Nosek et al. (2022); and Wilkinson et al. (2016). We also incorporate Kedron et al. (2024) and Cerutti et&#x202f;al. (2021), as suggested by the other reviewer. The discussion covers: what has changed (open science infrastructure, funder mandates, platform maturity), what has remained the same (time barriers, documentation gaps), and what new patterns emerge (cross-disciplinary consistency in behavioral inertia despite policy progress).&#x00a0; </italic>
                </p>
                <p> </p>
                <p> * The motivation for conducting this survey should also be stated more clearly and earlier in the manuscript. While the introduction references the reproducibility &#x201c;crisis&#x201d; and prior literature, the specific gap that this study aims to fill&#x2014;beyond providing an updated snapshot&#x2014;remains somewhat implicit.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> The motivation-related section was expanded, and the goals was further detailed. </italic>
                </p>
                <p> </p>
                <p> * the decision to keep the survey open from 23.02.2024 to 30.09.2024 requires clarification. The manuscript does not explain why this relatively long data collection period was chosen, nor how it may have influenced participation, response consistency, or seasonal effects.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> As per the study protocol, the survey was designed to be online for ~three months (from 23.02.2024 to 31.05.2024), however as the number of respondents still limited it was decided to extend until 30.09.2024, spanning ~six months. This was clarified in the manuscript. </italic>
                </p>
                <p> </p>
                <p> * The paper occasionally uses terms related to reproducibility and replication interchangeably, which can be confusing in a technical survey and may be interpreted differently by respondents (Same applies for&#x00a0; other concepts). Providing brief, standardized definitions in the main text could improve conceptual clarity and consistency.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> The concept of &#x2018;Computational reproducibility&#x2019; was deeper explored and detailed. Also, the definition of &#x2018;Replication&#x2019; was also provided. Most of the survey questions gravitated around reproducibility, however pointing to computational reproducibility. As the tooltip (pop-up) tool in the survey platform was available. The definition of Replication studies was also present in the survey. </italic>
                </p>
                <p> </p>
                <p> * The demographic reporting of 254 respondents has been mentioned but not the 133 participants. This should be clarified to avoid confusion and to ensure that readers understand which population the results actually describe.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> The respective participants&#x2019; section was expanded to distinguish between: 254 initial respondents (survey initiated), 194 who completed demographics and 133 who completed the full survey (final analytical sample). This breakdown addresses potential confusion regarding dropouts and sample composition. For clarity, we have indicated the current values in each analysis.</italic>
                </p>
                <p> </p>
                <p> * While the conclusions highlight the need for systemic change, the manuscript could benefit from a more structured set of recommendations targeted at specific stakeholders (e.g., journals, institutions, funders, training programs). Clear, prioritized action points would enhance the practical impact of the findings.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> We agree that actionable recommendations strengthen the practical impact of the work. We have expanded the "Study limitations and recommendations" section with a structured set of prioritized recommendations targeting journals, institutions, funders, and training programs, grounded directly in our survey findings. We have also noted the interdependence of these recommendations to avoid the impression that any single-actor intervention is sufficient. </italic>
                </p>
                <p> </p>
                <p> * Given the survey&#x2019;s distribution through open science networks, respondents are likely more aware of and favorable toward reproducibility practices. A more explicit discussion of how this self-selection may inflate reported awareness or positive attitudes&#x2014;and how this affects interpretation&#x2014;would strengthen the methodological transparency.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> We thank the reviewer for raising this important methodological point. We have substantially expanded the discussion of self-selection bias. Also reframed this limitation constructively: even among a motivated and (potential) self-selected group, substantial barriers persist, which is itself an informative finding for policy. A brief additional note on this point has been added to the limitations section. </italic>
                </p>
                <p> </p>
                <p> * The current title may overstate the study's outcomes by promising 'Solutions.' Since the data captures researcher viewpoints rather than validated interventions, the authors should rename the article to reflect its exploratory nature.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> The title was redesigned, &#x2018;solutions&#x2019; was replaced by &#x2018;insights&#x2019;, and &#x2018;exploratory was added.</italic>
                </p>
                <p> </p>
                <p> * The manuscript could briefly outline how future research might build on this work.</p>
                <p> 
                    <italic>Thank you for the observation!</italic>
                </p>
                <p>
                    <italic> A paragraph outlining optional future work was added. Specifically, we highlight opportunities for larger and more representative samples, longitudinal monitoring of changes in reproducibility practices, to determine which measures most effectively improve computational reproducibility.</italic>
                </p>
            </body>
        </sub-article>
    </sub-article>
</article>
