<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.111082.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Effects of the COVID-19 pandemic on university-based research conduct and training: Exploring university-based researchers&#x2019; perspectives and experiences</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Ory</surname>
                        <given-names>Marcia G.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Lee</surname>
                        <given-names>Shinduk</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1336-819X</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Radcliff</surname>
                        <given-names>Tiffany A.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Jani</surname>
                        <given-names>Sagar</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Rice-Ficht</surname>
                        <given-names>Allison</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a5">5</xref>
                    <xref ref-type="aff" rid="a6">6</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Waer</surname>
                        <given-names>Amy L.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1937-112X</uri>
                    <xref ref-type="aff" rid="a7">7</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Environmental and Occupational Health, Texas A&amp;M University, College Station, Texas, 77843, USA</aff>
                <aff id="a2">
                    <label>2</label>Center for Population Health and Aging, Texas A&amp;M University, College Station, Texas, 77843, USA</aff>
                <aff id="a3">
                    <label>3</label>College of Nursing, University of Utah, Salt Lake City, Utah, 84112, USA</aff>
                <aff id="a4">
                    <label>4</label>Department of Health Policy and Management, Texas A&amp;M University, College Station, Texas, 77843, USA</aff>
                <aff id="a5">
                    <label>5</label>Center for Microencapsulation and Drug Delivery, Texas A&amp;M University, College Station, Texas, 77843, USA</aff>
                <aff id="a6">
                    <label>6</label>Health Science Research Center, Texas A&amp;M Health Science Center, College Station, Texas, 77843, USA</aff>
                <aff id="a7">
                    <label>7</label>College of Medicine, Texas A&amp;M University, College Station, Texas, 77843, USA</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:mory@tamu.edu">mory@tamu.edu</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>A Rice-Ficht serves as managing partner, NanoRelease Technologies, LLC, San Antonio, TX. No other competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>19</day>
                <month>10</month>
                <year>2022</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2022</year>
            </pub-date>
            <volume>11</volume>
            <elocation-id>1195</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>24</day>
                    <month>6</month>
                    <year>2022</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Ory MG et al.</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/11-1195/pdf"/>
            <abstract>
                <p>
                    <bold>Background</bold>: The academic environment is critical for advancing knowledge through research and training of students who will serve as researchers, advocates, and leaders in the future, yet there is limited data on how the higher institution-based research enterprise is being impacted by the coronavirus disease 2019 (COVID-19) pandemic. The current study examines the perceived and expected impact of COVID-19 on engaging in a higher education institution setting, particularly focusing on student engagement in research and conduct of human subject research (HSR).</p>
                <p>
                    <bold>Method</bold>: The authors collected an online survey with faculty and staff in a large US university system focused on education, research, and service (6/8/2020-7/10/2020; N=709). The authors performed bivariate and multivariable logistic regression models to examine the differences in research impact by HSR.</p>
                <p>
                    <bold>Results</bold>: The majority of survey respondents (i.e., faculty and staff from a large US university system) perceived and expected at least some impact of COVID-19 on research and reported the impact to be negative. Researchers reported increased challenges in recruiting students for research activities and providing research-related learning opportunities for students. While COVID-19 impacted both HSR and non-HSR, HSR investigators have been disproportionately impacted by the pandemic.</p>
                <p>
                    <bold>Conclusions</bold>: Efforts are needed to further understand and overcome research challenges so that the university-based research environment can flourish for all researchers across disciplines and overcome the potentially lost learning opportunities for students. Lessons learned will help address future challenges to academic research activities and providing student research training.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>COVID-19</kwd>
                <kwd>pandemic</kwd>
                <kwd>academic research</kwd>
                <kwd>research training</kwd>
                <kwd>human subject research</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>Introduction</title>
            <p>The coronavirus disease 2019 (COVID-19) global pandemic has impacted most aspects of daily life. As of the time of the writing (June 2020), there were over 182 million confirmed COVID-19 cases and nearly four million mortality cases involving COVID-19 from around the globe (
                <xref ref-type="bibr" rid="ref11">CSSE, 2021</xref>). Alone in the United States, there were over 33.7 million confirmed COVID-19 cases and over 600,000 mortality cases involving COVID-19 (
                <xref ref-type="bibr" rid="ref11">CSSE, 2021</xref>). Mortality is only a part of the larger impact COVID-19 exerts on the social and political environment of people worldwide. The safety measures, such as social distancing, face coverings, travel restrictions, business closures, testing and quarantine, have impacted the daily activities and social norms and created a new normal of social and business interactions (
                <xref ref-type="bibr" rid="ref2">Bartik 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref6">Carel 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref8">Donthu and Gustafsson, 2020</xref>; 
                <xref ref-type="bibr" rid="ref10">Haleem and Mohd, 2020</xref>; 
                <xref ref-type="bibr" rid="ref24">UN, 2020</xref>). These changes are not only limited to the individuals but have also impacted whether and how organizations and institutions function (
                <xref ref-type="bibr" rid="ref8">Donthu and Gustafsson, 2020</xref>; 
                <xref ref-type="bibr" rid="ref12">Krishnamurthy, 2020</xref>; 
                <xref ref-type="bibr" rid="ref22">Soto-Acosta, 2020</xref>). Primarily led by a group of health science researchers, this study will focus on the impact of the pandemic on the university-based research enterprise.</p>
            <p>Given COVID-19 related health risks, higher education institutions have adopted additional safety protocols in response to the pandemic, with particular attention to social distancing, cleaning and disinfecting, and face covering (
                <xref ref-type="bibr" rid="ref1">ACHA, 2020</xref>; 
                <xref ref-type="bibr" rid="ref7">CDC, 2020</xref>). Similar to other disaster epochs, conducting human subject research amid the COVID-19 pandemic raises questions about &#x2018;ethics&#x2019; (
                <xref ref-type="bibr" rid="ref20">Packenham 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref28">WHO, 2020</xref>). As such, some major higher education institutions in the United States have adopted regulations for academic researchers to get permission to conduct their research and others were required to enforce local government or state-wide restrictions, such as stay-at-home orders that prevented on-premise research altogether for a prescribed timeframe. These new guidelines are likely to impact the research environment in both intended and unintended ways. For example, mandated preventive measures, such as social distancing and wearing of protective equipment designed to provide safety to both investigators and study participants are also likely to impact how researchers operate a lab or implement interventions and experiments. In addition, researchers in academic hospital settings may face greater challenges due to greater health concerns, safety risks, and increased volume of vulnerable patients.</p>
            <p>While the COVID-19 pandemic might offer opportunities for new research questions, new research approaches, and additional funding for some researchers, challenges in carrying out research have been reported from diverse health science fields (
                <xref ref-type="bibr" rid="ref18">Omary 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref21">Rhodus 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref25">Weiner 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref29">Yanow and Good, 2020</xref>). For example, 
                <xref ref-type="bibr" rid="ref29">Yanow and Good (2020)</xref> discussed potential challenges in conducting &#x2018;non-essential&#x2019; research and potential harm of neglecting research that are related to diseases other than COVID-19. 
                <xref ref-type="bibr" rid="ref16">Nicol 
                    <italic toggle="yes">et al.</italic> (2020)</xref> and 
                <xref ref-type="bibr" rid="ref25">Weiner 
                    <italic toggle="yes">et al.</italic> (2020)</xref> discussed potential challenges and solutions in conducting geriatric research and pediatric research, respectively. Difficulty in conducting health science research can restrict medical and health science students&#x2019; research training and associated competency, which is critical for their research development, as well as their ability to review scientific evidence and ability to make evidence-based clinical decisions. Despite the foreseeable impact of COVID-19 on research entities, there has been limited data on the topic. The National Institutes of Health survey on COVID-19 was one of the few data-based discussion of the topic, and its preliminary findings showed increases in non-research burden, changes in productivity, and increases in research expenses (
                <xref ref-type="bibr" rid="ref3">Bernard and Lauer, 2020</xref>). Another gap in understanding of COVID-19 impact on academic research is COVID-19 impacts on training of future researchers and professionals. For example, medical and health science students&#x2019; research competency is critical for their research development, as well as, their ability to review scientific evidence and make evidence-based clinical decisions.</p>
            <p>This paper attempts to address this gap by exploring researchers&#x2019; perspectives and early experiences of COVID-19 impact on their ability to conduct research. Given how diverse the research fields and methods are, each research entity can be uniquely impacted by COVID-19 (
                <xref ref-type="bibr" rid="ref29">Yanow and Good, 2020</xref>; 
                <xref ref-type="bibr" rid="ref13">Myers 
                    <italic toggle="yes">et al.</italic>, 2020</xref>). As a primary objective, this study focuses on the differential experiences and expectation of researchers based on whether they engage in human subject research (HSR) or not. HSR refers to research involving a living individual about whom data are obtained through interaction or intervention or identifiable, private information are obtained or generated (
                <xref ref-type="bibr" rid="ref15">NIH, 2020</xref>). While COVID-19 has impacted both researchers working with and without human subjects, researchers working with human subjects are hypothesized to face unique challenges in recruiting and interacting with human subjects, as well as in providing needed research training and learning opportunities for students. This exploratory study adds to the current literature by examining the COVID-19 impact on human subject research versus non-human subject research and the research training of students. This timely cross-sectional study can provide valuable insights regarding the immediate pandemic impact perceived by the researchers in an academic setting and can better inform the future pandemic preparation.</p>
        </sec>
        <sec id="sec2" sec-type="methods">
            <title>Methods</title>
            <sec id="sec3">
                <title>Ethical approval and consent</title>
                <p>The study was reviewed and approved by the Texas A&amp;M Institutional Review Board (IRB2020-0622M). All included study participants provided electronic informed consent by reviewing the study information and checking &#x201c;I agree to participate in this study.&#x201d;.</p>
            </sec>
            <sec id="sec4">
                <title>Study design and study respondents</title>
                <p>A cross-sectional online survey was collected (June 2020 &#x2013; July 2020) from 872 individuals in a large Research 1 university system focused on public state-wide educational, research, and service in the United States designated as a member of the American Association of Universities. Faculty and staff of the university system were sent recruitment emails through the university system email lists. Since multiple email lists were used, some individuals received multiple recruitment emails. The recruitment email contained a brief description of the study and a link to the online survey, and the survey began with detailed study information and consent section. 872 opened the online survey, and 863 (99.0%) provided informed consent to participate in the study. Among those who consented, 709 (82.2%) were eligible to participate in the study. A person was eligible to complete the survey if he/she was a current faculty or staff in the university system and engaged in any research activities. The final sample included in this study was 642 respondents who reported whether they engaged in HSR or not. Of 642 respondents included in this study, 238 self-reported engaging in HSR. Given the limited data availability, approximate response rate was calculated for a sub-group (principal investigators at the main campus location). This sub-group (n&#x2009;=&#x2009;248) constituted over 82% of the respondents from the main campus location and 48% of the overall respondents who reported their principal investigator status. The sub-group had about 11% response rates (248 out of ~2300). As a recruitment incentive, at the end of the survey, respondents were invited to participate in a drawing for a chance to win $100 gift cards, and five of eligible researchers were randomly selected and awarded from the drawing. A copy of the survey can be found in the Extended data (
                    <xref ref-type="bibr" rid="ref19">Ory, 2022</xref>).</p>
            </sec>
            <sec id="sec5">
                <title>Measures</title>
                <p>This study used an online survey that was developed by the researchers and was sent to a number of university system researchers from various disciplines via email to evaluate its face validity. The questions used in this study was presented in 
                    <xref ref-type="table" rid="T1">Table 1</xref>. Main outcomes were specified to capture several possible aspects of COVID-19 impact on research: (1) overall impact on their research; (2) impact on specific research activities; (3) impact on student engagement; and (4) direct COVID-19 related changes (example: social distancing and wearing of personal protective equipment). Aspects of overall impact included: perceived severity of the impact, directionality of the impact, expected severity of the impact, and changes in research focus. Specific research activities included: data collection, data analyses, and dissemination of the study findings. Particularly for HSR, this study also examined participant recruitment, participant retention, and participant interaction. Because engaging students in research is considered an important aspect of research activities in large university systems, three different areas of student engagement in research were included: student recruitment, student financial support, and research-related learning opportunities for students. The direct changes in research due to COVID-19 included specific concerns and safety measures (e.g., social distancing and wearing of protective equipment) in relation to impacts on research activities. The questions that used 5-Likert point scale ranging from &#x2018;very negative&#x2019; to &#x2018;very positive,&#x2019; were dichotomized into &#x2018;negative&#x2019; and &#x2018;neither or positive.&#x2019; Dichotomization was performed because there were too few respondents reporting positive impacts. For example, for the question, &#x2018;Taken all together, what has the impact of COVID-19 outbreak been on your research?,&#x2019; there were 4 (0.7%) respondents reporting &#x2018;very positive&#x2019; and 18 (3.3%) reporting &#x2018;somewhat positive.&#x2019;</p>
                <table-wrap id="T1" orientation="portrait" position="float">
                    <label>Table 1. </label>
                    <caption>
                        <title>Key survey questions about researchers&#x2019; perceived and expected impact of coronavirus disease 2019 (COVID-19) on their research.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Categories/Question</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Response categories</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">N</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>A. Research in general</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">How much has the COVID-19 outbreak impacted your research?</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">5 categories (1 = Not at all, 5 = Severely)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">547</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Taken all together, what has the impact of COVID-19 outbreak been on your research?</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = Somewhat or very negative, 0 = Neither or somewhat or very positive)
                                    <xref ref-type="table-fn" rid="tfn92">
                                        <sup>a</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">546</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">How much do you think the COVID-19 outbreak will impact your research in the future?</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">5 categories (1 = Not at all, 5 = Severely)
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">514</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Has the COVID-19 outbreak caused or needed you to change your research focus?</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">3 categories (1 = Not at all, 2 = Somewhat, 3 = A lot)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">538</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>B. Research activities</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Please rate the impact of the COVID-19 outbreak has already had on the following aspects of your research: Data collection</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = Somewhat or very negative, 0 = Neither or somewhat or very positive)
                                    <xref ref-type="table-fn" rid="tfn92">
                                        <sup>a</sup>
                                    </xref>
                                    <sup>,</sup>
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">506</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Please rate the impact of the COVID-19 outbreak has already had on the following aspects of your research: Data analyses</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = Somewhat or very negative, 0 = Neither or somewhat or very positive)
                                    <xref ref-type="table-fn" rid="tfn92">
                                        <sup>a</sup>
                                    </xref>
                                    <sup>,</sup>
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">502</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Please rate the impact of the COVID-19 outbreak has already had on the following aspects of your research: Dissemination of the study findings</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = Somewhat or very negative, 0 = Neither or somewhat or very positive)
                                    <xref ref-type="table-fn" rid="tfn92">
                                        <sup>a</sup>
                                    </xref>
                                    <sup>,</sup>
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">497</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>C. Student engagement</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Please rate the impact of the COVID-19 outbreak has already had on the following aspects of your research: Recruitment of students for research activities</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = Somewhat or very negative, 0 = Neither or somewhat or very positive)
                                    <xref ref-type="table-fn" rid="tfn92">
                                        <sup>a</sup>
                                    </xref>
                                    <sup>,</sup>
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">465</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Please rate the impact of the COVID-19 outbreak has already had on the following aspects of your research: Provision of financial support for students</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = Somewhat or very negative, 0 = Neither or somewhat or very positive)
                                    <xref ref-type="table-fn" rid="tfn92">
                                        <sup>a</sup>
                                    </xref>
                                    <sup>,</sup>
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">445</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Please rate the impact of the COVID-19 outbreak has already had on the following aspects of your research: Provision of research-related learning opportunities for students</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = Somewhat or very negative, 0 = Neither or somewhat or very positive)
                                    <xref ref-type="table-fn" rid="tfn92">
                                        <sup>a</sup>
                                    </xref>
                                    <sup>,</sup>
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">474</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>D. Direct COVID-19 Outbreak-related changes</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">How much will the following COVID-19 related concerns and changes affect your ability to conduct your research? (Needs for social distancing)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">3 categories (1 = Not at all, 2 = Somewhat, 3 = A lot)
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">529</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">How much will the following COVID-19 related concerns and changes affect your ability to conduct your research? (Needs for wearing personal protective equipment)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">3 categories (1 = Not at all, 2 = Somewhat, 3 = A lot)
                                    <xref ref-type="table-fn" rid="tfn93">
                                        <sup>b</sup>
                                    </xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">519</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <fn-group content-type="footnotes">
                            <fn id="tfn91">
                                <p>N = total number of valid responses;</p>
                            </fn>
                            <fn id="tfn92">
                                <label>
                                    <sup>a</sup>
                                </label>
                                <p>Originally 5 categories &#x2013; merged because of skewed response distribution (i.e., only a small number of respondents responding &#x2018;somewhat positive&#x2019; or &#x2018;very positive&#x2019;);</p>
                            </fn>
                            <fn id="tfn93">
                                <label>
                                    <sup>b</sup>
                                </label>
                                <p>Respondents could respond &#x2018;Not sure&#x2019; or &#x2018;Not Applicable&#x2019; to these questions, and such responses were excluded from N and the rest of the analyses.</p>
                            </fn>
                        </fn-group>
                    </table-wrap-foot>
                </table-wrap>
                <p>The primary independent variable was a dichotomous indicator, reflecting whether researchers engaged in HSR or not. This was determined based on respondents&#x2019; self-reported research types that they engaged in. Assessed covariates included principal investigator status (response categories: yes/no), number of years engaging in research, and use of experimentation or interventions. At the end of the survey, respondents reported their primary affiliation school/college, faculty status (response categories: faculty/staff/others) and sociodemographic characteristics (age, sex, race, and ethnicity). Primary affiliation was coded into multiple binary variables representing each school/college.</p>
            </sec>
            <sec id="sec6">
                <title>Analyses</title>
                <p>Sociodemographic characteristics of researchers and their research roles and experiences were described using frequency and percentage or mean and standard deviation and were compared based on engagement in HSR (e.g., Chi-square test for categorical variables and independent group t-test for interval variables). Each outcome variable was described using frequency and percentage, and bivariate analyses (i.e., bivariate logistic regression) were performed to examine the association between the outcome variables and engagement in HSR. For each outcome variable, multivariable logistic regression models were performed by adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions. All statistical analyses were performed using SAS 9.4 (SAS Institute Inc., Cary, North Carolina).</p>
            </sec>
        </sec>
        <sec id="sec7" sec-type="results">
            <title>Results</title>
            <sec id="sec8">
                <title>Study respondents</title>
                <p>The majority of respondents were ages 35&#x2013;64 years old (n&#x2009;=&#x2009;362, 78.8%), male (n&#x2009;=&#x2009;269, 56.6%), white (n&#x2009;=&#x2009;394, 90.8%), not Hispanic (n&#x2009;=&#x2009;424, 91.0%), faculty (n&#x2009;=&#x2009;415, 78.3%), and currently serving as a principal investigator (n&#x2009;=&#x2009;420, 81.6%). The respondents were from various fields of study including agriculture and life sciences (n&#x2009;=&#x2009;78, 15.2%), health sciences (n&#x2009;=&#x2009;60, 11.7%), liberal arts (n&#x2009;=&#x2009;56, 10.9%), engineering (n&#x2009;=&#x2009;55, 10.7%), sciences (biology, chemistry, mathematics, physics &amp; astronomy, and statistics) (n&#x2009;=&#x2009;51, 9.9%), education and human development (n&#x2009;=&#x2009;46, 8.9%), and other fields (n&#x2009;=&#x2009;168, 32.7%). On average, the respondents have engaged in research for over 19 years.</p>
                <p>Compared to the respondents who did not engage in HSR, those who engaged in HSR were significantly more likely to be females (n&#x2009;=&#x2009;106, 61.3% vs. n&#x2009;=&#x2009;100, 33.1%, p&#x2009;&lt;&#x2009;.001) and faculty (n&#x2009;=&#x2009;163, 84.9% vs. n&#x2009;=&#x2009;252, 74.6%, p&#x2009;=&#x2009;.02). Compared to those who did not engage in HSR, a greater percentage of respondents engaging in HSR were in education and human development (n&#x2009;=&#x2009;44, 24.0% vs. n&#x2009;=&#x2009;2, 0.6%, p&#x2009;&lt;&#x2009;.001) and less percentage in agriculture and life sciences (n&#x2009;=&#x2009;17, 9.3% vs. n&#x2009;=&#x2009;61, 18.4%, p&#x2009;=&#x2009;.006), engineering (n&#x2009;=&#x2009;6, 3.3% vs. n&#x2009;=&#x2009;49, 14.8%, p&#x2009;&lt;&#x2009;.001), or science (n&#x2009;=&#x2009;4, 2.2% vs. n&#x2009;=&#x2009;47, 14.2%, p&#x2009;&lt;&#x2009;.001). While a greater percentage of respondents engaging in HSR were in health sciences (n&#x2009;=&#x2009;28, 15.3% vs. n&#x2009;=&#x2009;32, 9.7%), the statistical significance was marginal (p&#x2009;=&#x2009;0.06). The respondents who engaged in HSR were also less likely to report using experimentation or interventions (n&#x2009;=&#x2009;122, 51.3% vs. n&#x2009;=&#x2009;252, 63.8%, p&#x2009;=&#x2009;.002) and had fewer years of experience engaged in research (16.0 vs. 20.8 years, p&#x2009;&lt;&#x2009;.001).</p>
            </sec>
            <sec id="sec9">
                <title>Impact on research in academic setting</title>
                <p>The majority perceived (n&#x2009;=&#x2009;504, 92.1%) and expected (n&#x2009;=&#x2009;494, 96.1%) at least some impact of COVID-19 on research, reported the impact to be negative (n&#x2009;=&#x2009;430, 78.8%), and made changes in their research focus because of COVID-19 (n&#x2009;=&#x2009;245, 45.5% somewhat and n&#x2009;=&#x2009;64, 11.9% a lot) (
                    <xref ref-type="table" rid="T2">Table 2</xref>). Compared to the respondents not engaging in HSR, the respondents engaging in HSR had significantly higher odds of perceiving (Odds Ratio (OR) &#x2009;=&#x2009; 2.25, 95% Confidence Interval (CI) = [1.07, 4.74], p&#x2009;=&#x2009;.03) and expecting (OR&#x2009;=&#x2009;4.86, 95% CI&#x2009;=&#x2009;[1.50, 15.79], p&#x2009;=&#x2009;.009) severe impacts of COVID-19 on research. Compared to the respondents not engaging in HSR, the respondents engaging in HSR were 2.28 times more likely to make some changes to their research focus and 3.73 times more likely to make a lot of changes to their research focus because of COVID-19. Adjusted associations between the perceived and expected impacts and engagement in HSR were comparable to the observed bivariate associations.</p>
                <table-wrap id="T2" orientation="portrait" position="float">
                    <label>Table 2. </label>
                    <caption>
                        <title>Bivariate and multivariable logistic regression models predicting impact of coronavirus disease 2019 (COVID-19) on research.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="middle"/>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of COVID-19 on research (magnitude)</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of COVID-19 on research (direction)</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Expected impact of COVID-19 on research in the future</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of COVID-19 on research focus</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Response categories</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">5 categories (1 = Not at all, 5 = Severely)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (0 = not negative, 1 = negative)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">5 categories (1 = Not at all, 5 = Severely)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">3 categories (1 = Not at all, 2 = Somewhat, 3 = A lot)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Total number of responses</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">547</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">546</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">514</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">538</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="5" valign="middle">Frequency (%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all: 43 (7.9%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative: 116 (21.2%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all: 20 (3.9%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all: 229 (42.6%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Slightly: 129 (23.6%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Negative: 430 (78.8%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Slightly: 145 (28.2%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Somewhat: 245 (45.5%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Moderately: 123 (22.5%)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Moderately: 156 (30.4%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">A lot: 64 (11.9%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Extensively: 161 (29.4%)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Extensively: 156 (30.4%)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Severely: 91 (16.6%)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Severely: 37 (7.2%)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Bivariate</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="4" valign="middle">Engaging in human subject research</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Slightly
                                    <break/>(OR = 0.68, 95% CI = [0.33, 1.40], 
                                    <italic toggle="yes">p</italic> = 0.296)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(OR = 0.89, 95% CI = [0.58, 1.36], 
                                    <italic toggle="yes">p</italic> = 0.586)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Slightly (OR = 0.80, 95% CI = [0.29, 2.23], 
                                    <italic toggle="yes">p</italic> = 0.669)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Somewhat
                                    <break/>(OR = 2.28, 95% CI = [1.54, 3.38], 
                                    <italic toggle="yes">p</italic> &lt; 0.001
                                    <xref ref-type="table-fn" rid="tfn2">**</xref>)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Moderately
                                    <break/>(OR = 0.88, 95% CI = [0.43, 1.80], 
                                    <italic toggle="yes">p</italic> = 0.717)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Moderately
                                    <break/>(OR = 1.07, 95% CI = [0.39, 2.95], 
                                    <italic toggle="yes">p</italic> = 0.898)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. A lot
                                    <break/>(OR = 3.73, 95% CI = [2.09, 6.64], 
                                    <italic toggle="yes">p</italic> &lt; 0.001
                                    <xref ref-type="table-fn" rid="tfn2">**</xref>)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Extensively
                                    <break/>(OR = 0.83, 95% CI = [0.41, 1.67], 
                                    <italic toggle="yes">p</italic> = 0.598)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Extensively
                                    <break/>(OR = 1.76, 95% CI = [0.64, 4.81], 
                                    <italic toggle="yes">p</italic> = 0.273)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Severely
                                    <break/>(OR = 2.25, 95% CI = [1.07, 4.74], 
                                    <italic toggle="yes">p</italic> = 0.033)
                                    <xref ref-type="table-fn" rid="tfn1">*</xref>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Severely
                                    <break/>(OR = 4.86, 95% CI = [1.50, 15.79], 
                                    <italic toggle="yes">p</italic> = 0.009)
                                    <xref ref-type="table-fn" rid="tfn1">*</xref>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Multivariable</bold>
                                    <xref ref-type="table-fn" rid="tfn3">
                                        <sup>
                                            <bold>a</bold>
                                        </sup>
                                    </xref>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="4" valign="middle">Engaging in human subject research</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Slightly
                                    <break/>(aOR = 0.76, 95% CI = [0.33, 1.73], 
                                    <italic toggle="yes">p</italic> = 0.511)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(aOR = 1.07, 95% CI = [0.67, 1.70], 
                                    <italic toggle="yes">p</italic> = 0.785)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Slightly (aOR = 0.995, 95% CI = [0.30, 3.36], 
                                    <italic toggle="yes">p</italic> = 0.993)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Somewhat
                                    <break/>(aOR = 2.46, 95% CI = [1.61, 3.78], 
                                    <italic toggle="yes">p</italic> &lt; 0.001
                                    <xref ref-type="table-fn" rid="tfn2">**</xref>)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Moderately
                                    <break/>(aOR = 1.03, 95% CI = [0.45, 2.37], 
                                    <italic toggle="yes">p</italic> = 0.941)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Moderately
                                    <break/>(aOR = 1.62, 95% CI = [0.48, 5.43], 
                                    <italic toggle="yes">p</italic> = 0.435)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. A lot
                                    <break/>(aOR = 4.26, 95% CI = [2.26, 8.02], 
                                    <italic toggle="yes">p</italic> &lt; 0.001
                                    <xref ref-type="table-fn" rid="tfn2">**</xref>)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Extensively
                                    <break/>(aOR = 1.04, 95% CI = [0.47, 2.34], 
                                    <italic toggle="yes">p</italic> = 0.920)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Extensively
                                    <break/>(aOR = 2.54, 95% CI = [0.76, 8.43], 
                                    <italic toggle="yes">p</italic> = 0.129)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Severely
                                    <break/>(aOR = 2.74, 95% CI = [1.15, 6.51], 
                                    <italic toggle="yes">p</italic> = 0.023)
                                    <xref ref-type="table-fn" rid="tfn1">*</xref>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Severely
                                    <break/>(aOR = 5.64, 95% CI = [1.42, 22.44], 
                                    <italic toggle="yes">p</italic> = 0.014)
                                    <xref ref-type="table-fn" rid="tfn1">*</xref>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>SD = standard deviation; ref = reference; OR = odds ratio; CI = confidence interval; aOR = adjusted odds ratio;</p>
                        <fn-group content-type="footnotes">
                            <fn id="tfn1">
                                <label>*</label>
                                <p>
                                    <italic toggle="yes">p</italic> &lt; 0.05;</p>
                            </fn>
                            <fn id="tfn2">
                                <label>**</label>
                                <p>
                                    <italic toggle="yes">p</italic> &lt; 0.001.</p>
                            </fn>
                            <fn id="tfn3">
                                <label>
                                    <sup>a</sup>
                                </label>
                                <p>Multivariable model after adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions.</p>
                            </fn>
                        </fn-group>
                    </table-wrap-foot>
                </table-wrap>
            </sec>
            <sec id="sec10">
                <title>Impact on research activities</title>
                <p>The majority of the study respondents reported negative impact of COVID-19 on data collection (n&#x2009;=&#x2009;387, 76.5%), and over 41% reported negative impact on data analyses (n&#x2009;=&#x2009;209) and dissemination of the study findings (n&#x2009;=&#x2009;206) (
                    <xref ref-type="table" rid="T3">Table 3</xref>). Compared to the respondents who did not engage in HSR, those who engaged in HSR were significantly more likely to report negative impact of COVID-19 on data collection (OR&#x2009;=&#x2009;2.16, 95% CI&#x2009;=&#x2009;[1.36, 3.45], p&#x2009;=&#x2009;.001). There was not any statistically significant association observed between engagement in HSR and impact of COVID-19 on data analyses (OR&#x2009;=&#x2009;0.94, 95% CI&#x2009;=&#x2009;[0.65, 1.36], p&#x2009;=&#x2009;.74) or dissemination (OR&#x2009;=&#x2009;1.35, 95% CI&#x2009;=&#x2009;[0.93, 1.95], p&#x2009;=&#x2009;.11). After adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions, the odds of the respondents who engaged in HSR to report negative impact on data collection remained higher than the odds of the respondents who did not engage in HSR (Adjusted Odds Ratio (aOR) &#x2009;=&#x2009; 2.74, 95% CI&#x2009;=&#x2009;[1.63, 4.62], p&#x2009;&lt;&#x2009;.001). The associations between engagement in HSR and impact of COVID-19 on data analyses (aOR&#x2009;=&#x2009;0.92, 95% CI&#x2009;=&#x2009;[0.61, 1.37], p&#x2009;=&#x2009;.67) and dissemination (aOR&#x2009;=&#x2009;1.28, 95% CI&#x2009;=&#x2009;[0.86, 1.92], p&#x2009;=&#x2009;.23) remained statistically insignificant after adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions.</p>
                <table-wrap id="T3" orientation="portrait" position="float">
                    <label>Table 3. </label>
                    <caption>
                        <title>Bivariate and multivariable logistic regression models predicting impact of coronavirus disease 2019 (COVID-19) on research activities.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="middle"/>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of COVID-19 on: Data collection</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of COVID-19 on: Data analyses</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of COVID-19 on: Dissemination</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Response categories</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = negative, 0 = not negative)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = negative, 0 = not negative)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2 categories (1 = negative, 0 = not negative)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Total number of responses</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">506</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">502</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">497</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Frequency (%)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Negative</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">387 (76.5%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">209 (41.6%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">206 (41.4%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">119 (23.5%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">293 (58.4%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">291 (58.6%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Bivariate</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Engaging in human subject research</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(OR = 2.16, 95% CI = [1.36, 3.45], 
                                    <italic toggle="yes">p</italic> = 0.001)
                                    <xref ref-type="table-fn" rid="tfn4">*</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(OR = 0.94, 95% CI = [0.65, 1.36], 
                                    <italic toggle="yes">p</italic> = 0.739)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(OR = 1.35, 95% CI = [0.93, 1.95], 
                                    <italic toggle="yes">p</italic> = 0.112)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Multivariable</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Engaging in human subject research</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(aOR = 2.74, 95% CI = [1.63, 4.62], 
                                    <italic toggle="yes">p</italic> &lt; 0.001)
                                    <xref ref-type="table-fn" rid="tfn5">**</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(aOR = 0.92, 95% CI = [0.61, 1.37], 
                                    <italic toggle="yes">p</italic> = 0.670)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not negative (ref) vs. Negative
                                    <break/>(aOR = 1.28, 95% CI = [0.86, 1.92], 
                                    <italic toggle="yes">p</italic> = 0.226)</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>SD = standard deviation; ref = reference; OR = odds ratio; CI = confidence interval; aOR = adjusted odds ratio;</p>
                        <fn-group content-type="footnotes">
                            <fn id="tfn4">
                                <label>*</label>
                                <p>
                                    <italic toggle="yes">p</italic> &lt; 0.05;</p>
                            </fn>
                            <fn id="tfn5">
                                <label>**</label>
                                <p>
                                    <italic toggle="yes">p</italic> &lt; 0.001.</p>
                            </fn>
                            <fn id="tfn6">
                                <label>
                                    <sup>a</sup>
                                </label>
                                <p>Multivariable model after adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions.</p>
                            </fn>
                        </fn-group>
                    </table-wrap-foot>
                </table-wrap>
            </sec>
            <sec id="sec11">
                <title>Impact on student engagement</title>
                <p>The majority of the study respondents reported negative impact of COVID-19 on recruiting students for research activities (n&#x2009;=&#x2009;327, 70.3%) and providing research-related learning opportunities for students (n&#x2009;=&#x2009;328, 69.2%), and 43.1% (n&#x2009;=&#x2009;192) reported negative impact on providing financial support for students. There was not any statistically significant difference observed in impact of COVID-19 on recruiting students for research activities (OR&#x2009;=&#x2009;1.13, 95% CI&#x2009;=&#x2009;[0.75, 1.71], p&#x2009;=&#x2009;.56), providing financial support for students (OR&#x2009;=&#x2009;0.98, 95% CI&#x2009;=&#x2009;[0.66, 1.45], p&#x2009;=&#x2009;.93), and providing research-related learning opportunities for students (OR&#x2009;=&#x2009;0.999, 95% CI&#x2009;=&#x2009;[0.67, 1.50], p&#x2009;=&#x2009;.997) based on engagement in HSR. The association between engagement in HSR and impact of COVID-19 on student engagements remained statistically insignificant after adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions.</p>
            </sec>
            <sec id="sec12">
                <title>Impact from social distancing and protective equipment</title>
                <p>The majority reported at least some impact of the needs for social distancing (n&#x2009;=&#x2009;465, 87.9%) or the needs for wearing personal protective equipment (n&#x2009;=&#x2009;368, 70.9%) on conducting research (
                    <xref ref-type="table" rid="T4">Table 4</xref>). Compared to the respondents who did not engage in HSR, those who engaged in HSR were significantly more likely to experience a lot of impact of the needs for social distancing (OR&#x2009;=&#x2009;1.83, 95% CI&#x2009;=&#x2009;[1.02, 3.31], p&#x2009;=&#x2009;.045) or personal protective equipment (OR&#x2009;=&#x2009;2.37, 95% CI&#x2009;=&#x2009;[1.42, 3.94], p&#x2009;&lt;&#x2009;.001) on their research. After adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions, the respondents who engaged in HSR remained significantly more likely to experience a lot of impact from the needs for social distancing (aOR&#x2009;=&#x2009;2.82, 95% CI&#x2009;=&#x2009;[1.46, 5.45], p&#x2009;=&#x2009;.002) or personal protective equipment (aOR&#x2009;=&#x2009;2.98, 95% CI&#x2009;=&#x2009;[1.69, 5.24], p&#x2009;&lt;&#x2009;.001) than those who did not engage in HSR.</p>
                <table-wrap id="T4" orientation="portrait" position="float">
                    <label>Table 4. </label>
                    <caption>
                        <title>Bivariate and multivariable logistic regression models predicting perceived impact of the coronavirus disease 2019 (COVID-19) safety regulations on research.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="middle"/>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of the needs for social distancing on research</th>
                                <th align="left" colspan="1" rowspan="1" valign="middle">Impact of the needs for wearing personal protective equipment on research</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Response categories</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">3 categories (1 = Not at all, 2 = Somewhat, 3 = A lot)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">3 categories (1 = Not at all, 2 = Somewhat, 3 = A lot)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Total number of responses</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">529</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">519</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Frequency (%)</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">64 (12.1%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">151 (29.1%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Somewhat</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">245 (46.3%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">258 (49.7%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">A lot</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">220 (41.6%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">110 (21.2%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Bivariate</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">Engaging in human subject research</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Somewhat
                                    <break/>(OR = 0.97, 95% CI = [0.54, 1.76], 
                                    <italic toggle="yes">p</italic> = 0.922)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Somewhat
                                    <break/>(OR = 1.14, 95% CI = [0.74, 1.76], 
                                    <italic toggle="yes">p</italic> = 0.549)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. A lot
                                    <break/>(OR = 1.83, 95% CI = [1.02, 3.31], 
                                    <italic toggle="yes">p</italic> = 0.045)
                                    <xref ref-type="table-fn" rid="tfn7">*</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. A lot
                                    <break/>(OR = 2.37, 95% CI = [1.42, 3.94], 
                                    <italic toggle="yes">p</italic> &lt; 0.001)
                                    <xref ref-type="table-fn" rid="tfn8">**</xref>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Multivariable</bold>
                                </td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                                <td colspan="1" rowspan="1">&#x2009;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="2" valign="middle">Engaging in human subject research</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Somewhat
                                    <break/>(aOR = 1.42, 95% CI = [0.74, 2.75], 
                                    <italic toggle="yes">p</italic> = 0.293)</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. Somewhat
                                    <break/>(aOR = 1.51, 95% CI = [0.93, 2.43], 
                                    <italic toggle="yes">p</italic> = 0.095)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. A lot
                                    <break/>(aOR = 2.82, 95% CI = [1.46, 5.45], 
                                    <italic toggle="yes">p</italic> = 0.002)
                                    <xref ref-type="table-fn" rid="tfn7">*</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Not at all (ref) vs. A lot
                                    <break/>(aOR = 2.98, 95% CI = [1.69, 5.24], 
                                    <italic toggle="yes">p</italic> &lt; 0.001)
                                    <xref ref-type="table-fn" rid="tfn8">**</xref>
                                </td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>SD = standard deviation; ref = reference; OR = odds ratio; CI = confidence interval; aOR = adjusted odds ratio;</p>
                        <fn-group content-type="footnotes">
                            <fn id="tfn7">
                                <label>*</label>
                                <p>
                                    <italic toggle="yes">p</italic> &lt; 0.05;</p>
                            </fn>
                            <fn id="tfn8">
                                <label>**</label>
                                <p>
                                    <italic toggle="yes">p</italic> &lt; 0.001.</p>
                            </fn>
                            <fn id="tfn9">
                                <label>
                                    <sup>a</sup>
                                </label>
                                <p>Multivariable model after adjusting for principal investigator status, number of years engaging in research, and use of experimentation or interventions.</p>
                            </fn>
                        </fn-group>
                    </table-wrap-foot>
                </table-wrap>
            </sec>
        </sec>
        <sec id="sec13" sec-type="discussion|conclusions">
            <title>Discussion and conclusions</title>
            <p>This study examined the university-based researchers&#x2019; perceived and expected impact of COVID-19 on conducting HSR and non-HSR. Consistent with other studies (
                <xref ref-type="bibr" rid="ref18">Omary 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref21">Rhodus 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref25">Weiner 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref29">Yanow and Good, 2020</xref>), the current study found that both researchers engaging in HSR and non-HSR perceived that their research was impacted negatively by COVID-19. As predicted, the perceived and expected impact tend to be more severe for HSR than in non-HSR. This study showed greater likelihoods of changing research focus, experiencing negative impacts on data collection, and experiencing negative impacts from the needs for social distancing or wearing of personal protective equipment among the researchers conducting HSR versus those not conducting HSR.</p>
            <p>Both researchers engaging and not engaging in HSR reported increased challenges in recruiting students for research activities and providing research-related learning opportunities for students. This finding can be particularly relevant for health science students who were pulled from direct patient contact in their clinical clerkships in mid-March 2020. The students returning to their clerkship rotations are likely to face unprecedented learning and training environments (
                <xref ref-type="bibr" rid="ref26">Weiner, 2020</xref>). Our medical students in particular where allowed to return to direct patient contact in June 2020 with the exception of limited access to COVID-19 positive patients or patients under investigation for COVID-19. This alone created the need for complex algorithms as it pertains to different medical specialties (e.g. Intensive Care Units) and required significant faculty and student instruction/education to navigate. This observation aligns with 
                <xref ref-type="bibr" rid="ref29">Yanow and Good (2020)</xref>&#x2019;s discussion of the uncertainty in day-to-day operation and productivity students and trainees are faced. According to the National Opinion Research Center (NORC)&#x2019;s January 2021 report on the COVID-19 impact on graduate school, only 24% of institutions agreed consistent graduate advising was received by students during the pandemic (
                <xref ref-type="bibr" rid="ref23">Stewart 
                    <italic toggle="yes">et al.</italic>, 2021</xref>).</p>
            <p>In the short-term, the limited ability to recruit and engage students in research activities can result in an inadequate workforce to meet current research needs. This can also reduce the opportunities for students to learn about the cutting-edge knowledge in the field and gain applicable research skills. In the long-term, this can potentially impact the quantity and quality of the future research workforce. This finding implies the importance of dedicated efforts to enable higher education institutions to continue to engage students in research activities and to provide quality research-related learning opportunities in the context of the pandemic. While the NORC report provides valuable insights regarding the innovations emerged in graduate schools during the pandemic (
                <xref ref-type="bibr" rid="ref23">Stewart 
                    <italic toggle="yes">et al.</italic>, 2021</xref>), the report did not discuss about the research training for students. Monitoring of future research pipeline and especially impact on academic medicine should be an area for future research.</p>
            <p>Compared to the researchers not engaging in HSR, those engaging in HSR can potentially face greater challenges in maintaining their research focus and data collection because of the short- and long-term changes generated by COVID-19 on individual attitudes, behaviors, lifestyle, and social norms (
                <xref ref-type="bibr" rid="ref2">Bartik 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref6">Carel 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref24">UN, 2020</xref>). Some HSR investigators could be influenced directly by COVID-19 and inevitably need to adapt their research as illustrated in the following examples. Research focusing on efficacy of diabetes education programs in community or clinical settings might inevitably be put on a hold until the appropriate safety measures were built into its research protocol. A major revision might include shift to an online education platform. While such shift to digital tools can create an opportunity for some researchers, the opportunity may not be appreciated by all researchers in the field and the changes can directly impact any ongoing research projects. For instance, in an evaluation research focusing on opioid overdose and naloxone administration training for health science students shifted the program delivery from in-person format to an online format. Shift to the online course format could limit the comprehensiveness of naloxone administration training. Furthermore, shift to the digital tools can restrict diversity of the training and research program reach. Another example is the delays or pause of clinical trials due to the government restrictions on travel to administer the proposed intervention. While executive orders restricting travel are perceived as a necessary or inevitable safety measures, such safety initiative negatively influences the progress of research and limits the opportunity to train students, who are likely to have limited time in a school, in research conduct.</p>
            <p>HSR could also be indirectly influenced. Previous studies showed that demographic characteristics and appearance of researchers and social interaction between human subjects and researchers can influence the data collected from the human subjects (
                <xref ref-type="bibr" rid="ref5">Campbell 
                    <italic toggle="yes">et al.</italic>, 2019</xref>; 
                <xref ref-type="bibr" rid="ref4">Bittmann, 2020</xref>). The needs for social distancing and wearing of personal protective equipment could influence both appearance of researchers and social interaction with human subjects. For example, a medical student commented about facial masks impeding verbal communication with her patients (
                <xref ref-type="bibr" rid="ref26">Weiner, 2020</xref>). In addition, COVID-19 can directly impact human subjects&#x2019; experiences with interpersonal interaction (
                <xref ref-type="bibr" rid="ref6">Carel 
                    <italic toggle="yes">et al.</italic>, 2020</xref>; 
                <xref ref-type="bibr" rid="ref9">Ghosh 
                    <italic toggle="yes">et al.</italic>, 2020</xref>), as well as their safety concern about participating in a research study. Depending on their locations, medical and health science students returning to their clerkship rotations might need to work with a greater volume of patients with lower health care capacity.</p>
            <p>The long- and short-term impacts of COVID-19 on both University budgets and household financial situations can also affect the provision of and meaning of research stipends to human subjects. Furthermore, the comparability of the study findings before, during, and after COVID-19 presents challenges for HSR, especially if the outcome variable of interest is impacted independently of any intervention efforts (e.g., lifestyle behaviors such as physical activity or substance abuse behaviors).</p>
            <sec id="sec14">
                <title>Limitations</title>
                <p>The current study findings are based on self-reported perceptions rather than objective measures, such as research productivity. While the questionnaires used in this study was face-validated by researchers from various disciplines, the questionnaires did not go through a vigorous validation and reliability assessments. Further limitations of the current study include the sample representativeness and study generalizability. While the overall response rate could not be estimated, the response rates among the principal investigators at the main campus location was about 11%. In terms of demographics, the faculty respondents consisted of a higher proportion of White (85%) and a smaller proportion of female (43%), as observed in the institutional and national faculty demographics. The latest institutional diversity data available showed 63% non-Hispanic White and 36% female (
                    <xref ref-type="bibr" rid="ref17">Office of Diversity, 2021</xref>). Nationwide full-time faculty in degree-granting postsecondary institutions data showed less than 70% White and 44% female (
                    <xref ref-type="bibr" rid="ref14">NCES, 2018</xref>). There were some over-representation of White faculty members in this study, which may be related to the selection bias or related to the differences in the target population (i.e., faculty engaging in research or teaching vs. faculty engaging in research and teaching).</p>
                <p>This study utilized the data collected from a large public Research 1 university system at a single point in time, and hence the study finding may not be generalizable to other types of universities or settings. However, given the common themes in COVID-19 associated changes (examples: social distancing, sanitation, and personal protective equipment), it can be assumed that the observed impact of COVID-19 on research is comparable in academic medicine and other settings and will continue to be a challenge as the pandemic timeline is uncertain. More studies from diverse research settings could help illuminate the impact of pandemics and other prolonged global emergencies on the research enterprise. Another limitation is that the sample had incomplete representation of researchers from diverse fields. While the study team attempted to make the survey relevant to all existing research fields by consulting about the survey questions and wording with researchers from various backgrounds, not all fields use common language and research methods. The study team received some questions from the respondents about the survey language (e.g., &#x2018;secondary data&#x2019;) and post-survey comments regarding relevancy of some questions (e.g., a question about participant interaction) in the survey to their fields. Therefore, this study focused on the general questions that were likely to be relevant in most fields. In addition, the survey questions are shared (
                    <xref ref-type="table" rid="T1">Table 1</xref>) for the readers&#x2019; information.</p>
                <p>Several brief reports and perspectives have anecdotally discussed the impact of COVID-19 on research and scientists (
                    <xref ref-type="bibr" rid="ref18">Omary 
                        <italic toggle="yes">et al</italic>., 2020</xref>; 
                    <xref ref-type="bibr" rid="ref29">Yanow and Good, 2020</xref>; 
                    <xref ref-type="bibr" rid="ref27">Wigginton 
                        <italic toggle="yes">et al</italic>., 2020</xref>). Despite the limitations, this study adds to the growing body of research based on primary data collected from researchers. First, this study provides important insights regarding the potentially lost learning opportunities for students to be addressed in higher education institutions, with specific focus on research training. Bridging from the lessons learned from the current pandemic, higher education institutions should develop the emergency standards of operation for faculty, staff, and students to enable continued learning and training opportunities. Further qualitative or mixed-methods evaluation of phenomenon can benefit the development of such emergency standards of operation. Lessons learned from this process will make us better equipped to deal with future challenges and the potential negative consequences to our ongoing academic research activities.</p>
                <p>Second, the empirical findings in this study showed that researchers engaging in HSR have been disproportionately impacted by COVID-19 and that efforts are needed to further understand and overcome their challenges. For example, the needs for social distancing and wearing personal protective equipment generated additional hurdles for researchers engaging in HSR. Potential solutions might be to consider pandemic or emergency preparation budget as a part of the grant budget or higher education institutions develop emergency fund for research in academic settings.</p>
                <p>While such efforts may already be underway in response to the swiftly changing circumstances, a natural progression of the current work would be to identify and examine the existing efforts and provide insights into ways that researchers, research institutions, and sponsoring agencies can adapt their research. These findings have strong implications for the academic medicine community, whether primarily lab-based studies or involving clinical or community-based research involving human subjects.</p>
                <p>Next steps include continuing to analyze the ongoing impact of COVID-19, as well as its vaccine deployment, on both our HSR and non-HSR throughout our institution and utilizing our findings to try and find creative ways to mitigate the negative effects of the pandemic we are currently still facing or other challenges that we will face in the future. It is critical to move beyond a simplistic view of negative research impacts to a better understanding of how academic research and associated training can be enriched by meeting challenges of the past year.</p>
            </sec>
        </sec>
        <sec id="sec15">
            <title>Data availability</title>
            <sec id="sec16">
                <title>Underlying data</title>
                <p>The data supporting the findings of the study are not made publicly available due to the data use restrictions stated in the informed consent form (approved by TAMU IRB) and considerations that their containing information that could compromise the privacy of research participants. Given that the data were collected from staff and faculty from a university system there are concerns that a combination of several key demographic characteristics, research fields, and research types can potentially identify an individual. For researchers with specific research/study questions relating to the data, the anonymized data can be available on request from the lead author [MO]. Upon reasonable request, with TAMU IRB approval, we can share whether participants engaged in any human subject research (yes/no) and key outcome data (i.e., COVID-19 impact on research) without any demographic characteristics, research fields, and research type data that can potentially identify an individual.</p>
            </sec>
            <sec id="sec17">
                <title>Extended data</title>
                <p>Texas Data Repository: Effects of the COVID-19 pandemic on university-based research conduct and training. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.18738/T8/W6IGCE">https://doi.org/10.18738/T8/W6IGCE</ext-link> (
                    <xref ref-type="bibr" rid="ref19">Ory, 2022</xref>).</p>
                <p>This project contains the following extended data:
                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>COV19Res_Online Survey_TDR_220411.pdf (A copy of the online questionnaire)</p>
                        </list-item>
                    </list>
                </p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero &#x201c;No rights reserved&#x201d; data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgements</title>
            <p>We thank Jason Moats, PhD, Texas A&amp;M Engineering Extension Service and core member of the Texas Emergency Management Advisory Group for his helpful insights on research impacts. Also, the authors wish to thank all respondents who volunteered to participate in this study and our colleagues who supported the study by providing insight and expertise and assisting with recruitment.</p>
        </ack>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <mixed-citation publication-type="other">
                    <collab>American College Health Association (ACHA)</collab>:
                    <article-title>ACHA guidelines preparing for COVID-19.</article-title>
                    <year>2020</year>. June 30, 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://www.acha.org/documents/resources/guidelines/ACHA_Preparing_for_COVID-19_March-3-2020.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bartik</surname>
                            <given-names>AW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bertrand</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cullen</surname>
                            <given-names>Z</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The impact of COVID-19 on small business outcomes and expectations.</article-title>
                    <source>

                        <italic toggle="yes">Proc. Natl. Acad. Sci. U. S. A.</italic>
</source>
                    <year>2020</year>;<volume>117</volume>(<issue>30</issue>):<fpage>17656</fpage>&#x2013;<lpage>17666</lpage>.
                    <pub-id pub-id-type="pmid">32651281</pub-id>
                    <pub-id pub-id-type="doi">10.1073/pnas.2006991117</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bernard</surname>
                            <given-names>MA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lauer</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>COVID-19 Survey of NIH and extramural staff &#x2013; Preliminary findings.</article-title>
                    <year>2020</year>. March 19, 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://acd.od.nih.gov/documents/presentations/12112020_PreliminaryFindings.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bittmann</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>The more similar, the better? How (mis) match between interviewers and respondents in survey situations affects item nonresponse and data quality.</article-title>
                    <source>

                        <italic toggle="yes">Survey Research Methods.</italic>
</source>
                    <year>2020</year>;<volume>14</volume>(<issue>3</issue>):<fpage>301</fpage>&#x2013;<lpage>323</lpage>.
                    <pub-id pub-id-type="doi">10.18148/srm/2020.v14i3.7621</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Campbell</surname>
                            <given-names>JI</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Musiimenta</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Burns</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The importance of how research participants think they are perceived: Results from an electronic monitoring study of antiretroviral therapy in Uganda.</article-title>
                    <source>

                        <italic toggle="yes">AIDS Care.</italic>
</source>
                    <year>2019</year>;<volume>31</volume>(<issue>6</issue>):<fpage>761</fpage>&#x2013;<lpage>766</lpage>.
                    <pub-id pub-id-type="pmid">30606037</pub-id>
                    <pub-id pub-id-type="doi">10.1080/09540121.2018.1556381</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Carel</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ratcliffe</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Froese</surname>
                            <given-names>T</given-names>
                        </name>
</person-group>:
                    <article-title>Reflecting on experiences of social distancing.</article-title>
                    <source>

                        <italic toggle="yes">Lancet.</italic>
</source>
                    <year>2020</year>;<volume>396</volume>(<issue>10244</issue>):<fpage>87</fpage>&#x2013;<lpage>88</lpage>.
                    <pub-id pub-id-type="pmid">32619416</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S0140-6736(20)31485-9</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <mixed-citation publication-type="other">
                    <collab>Centers for Disease Control and Prevention (CDC)</collab>:
                    <article-title>Considerations for Institutions of Higher Education.</article-title>
                    <year>2020</year>. November 27, 2020.
                    <ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/coronavirus/2019-ncov/community/colleges-universities/considerations.html">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Donthu</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gustafsson</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Effects of COVID-19 on business and research.</article-title>
                    <source>

                        <italic toggle="yes">J. Bus. Res.</italic>
</source>
                    <year>2020</year>;<volume>117</volume>:<fpage>284</fpage>&#x2013;<lpage>289</lpage>.
                    <pub-id pub-id-type="pmid">32536736</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.jbusres.2020.06.008</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ghosh</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sharma</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Choudhury</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>COVID-19 and physician-patient relationship: potential effects of &#x2018;masking&#x2019;, &#x2018;distancing&#x2019; and &#x2018;others.&#x2019;.</article-title>
                    <source>

                        <italic toggle="yes">Fam. Pract.</italic>
</source>
                    <year>2020</year>;<volume>38</volume>(<issue>2</issue>):<fpage>193</fpage>&#x2013;<lpage>194</lpage>.
                    <pub-id pub-id-type="pmid">32914855</pub-id>
                    <pub-id pub-id-type="doi">10.1093/fampra/cmaa092</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Haleem</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mohd</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>Effects of COVID-29 pandemic in daily life.</article-title>
                    <source>

                        <italic toggle="yes">Current Medicine Research and Practice.</italic>
</source>
                    <year>2020</year>;<volume>10</volume>(<issue>2</issue>):<fpage>78</fpage>&#x2013;<lpage>79</lpage>.
                    <pub-id pub-id-type="pmid">32292804</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.cmrp.2020.03.011</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <mixed-citation publication-type="other">
                    <collab>Johns Hopkins University Center for Systems Science and Engineering (CSSE)</collab>:
                    <article-title>COVID-19 dashboard.</article-title>
                    <year>2021</year>. June 30, 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://coronavirus.jhu.edu/map.html">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Krishnamurthy</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>The future of business education: A commentary in the shadow of the COVID-19 pandemic.</article-title>
                    <source>

                        <italic toggle="yes">J. Bus. Res.</italic>
</source>
                    <year>2020</year>;<volume>117</volume>:<fpage>1</fpage>&#x2013;<lpage>5</lpage>.
                    <pub-id pub-id-type="pmid">32501309</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.jbusres.2020.05.034</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Myers</surname>
                            <given-names>KR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tham</surname>
                            <given-names>WY</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yin</surname>
                            <given-names>Y</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Unequal effects of the COVID-19 pandemic on scientists.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Hum. Behav.</italic>
</source>
                    <year>2020</year>;<volume>4</volume>(<issue>9</issue>):<fpage>880</fpage>&#x2013;<lpage>883</lpage>.
                    <pub-id pub-id-type="pmid">32669671</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41562-020-0921-y</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <mixed-citation publication-type="other">
                    <collab>National Center for Education Statistics (NCES)</collab>:
                    <article-title>Table 315.20. Full-time faculty in degree-granting postsecondary institutions, by race/ethnicity, sex, and academic rank: Fall 2015, fall 2016, and fall 2017.</article-title>
                    <year>2018</year>. March 19, 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://nces.ed.gov/programs/digest/d18/tables/dt18_315.20.asp">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <mixed-citation publication-type="other">
                    <collab>National Institutes of Health (NIH)</collab>:
                    <article-title>Human Subjects Research.</article-title>
                    <year>2020</year>. October 29, 2020.
                    <ext-link ext-link-type="uri" xlink:href="https://grants.nih.gov/sites/default/files/HS_infographic_NIH_rev%20rp4%20508c.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nicol</surname>
                            <given-names>GE</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Piccirillo</surname>
                            <given-names>JF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mulsant</surname>
                            <given-names>BH</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Action at a distance: Geriatric research during a pandemic.</article-title>
                    <source>

                        <italic toggle="yes">J. Am. Geriatr. Soc.</italic>
</source>
                    <year>2020</year>;<volume>68</volume>(<issue>5</issue>):<fpage>922</fpage>&#x2013;<lpage>925</lpage>.
                    <pub-id pub-id-type="pmid">32207542</pub-id>
                    <pub-id pub-id-type="doi">10.1111/jgs.16443</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <mixed-citation publication-type="other">
                    <collab>Office for Diversity</collab>:
                    <article-title>Data: Faculty.</article-title>nd.<year>2021 March 19</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://accountability.tamu.edu/All-Metrics/Mixed-Metrics/Faculty-Demographics">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Omary</surname>
                            <given-names>MB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Eswaraka</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kimball</surname>
                            <given-names>SD</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The COVID-19 pandemic and research shutdown: Staying safe and productive.</article-title>
                    <source>

                        <italic toggle="yes">J. Clin. Investig.</italic>
</source>
                    <year>2020</year>;<volume>130</volume>(<issue>6</issue>):<fpage>2745</fpage>&#x2013;<lpage>2748</lpage>.
                    <pub-id pub-id-type="pmid">32243259</pub-id>
                    <pub-id pub-id-type="doi">10.1172/JCI138646</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ory</surname>
                            <given-names>MG</given-names>
                        </name>
</person-group>:
                    <article-title>Online Survey (6/8/2020-7/10/2020).</article-title>
                    <year>2022</year>. Texas Data Repository, [dataset], V1.
                    <pub-id pub-id-type="doi">10.18738/T8/W6IGCE</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Packenham</surname>
                            <given-names>JP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rosselli</surname>
                            <given-names>RT</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ramsey</surname>
                            <given-names>SK</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Conducting science in disasters: Recommendations from the NIEHS working group for special IRB considerations in the review of disaster related research.</article-title>
                    <source>

                        <italic toggle="yes">Environ. Health Perspect.</italic>
</source>
                    <year>2020</year>;<volume>125</volume>(<issue>9</issue>):<fpage>094503</fpage>.
                    <pub-id pub-id-type="pmid">28949918</pub-id>
                    <pub-id pub-id-type="doi">10.1289/EHP2378</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rhodus</surname>
                            <given-names>EK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bardach</surname>
                            <given-names>SH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Abner</surname>
                            <given-names>EL</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>COVID-19 and geriatric clinical trials research.</article-title>
                    <source>

                        <italic toggle="yes">Aging Clin. Exp. Res.</italic>
</source>
                    <year>2020</year>;<volume>32</volume>:<fpage>2169</fpage>&#x2013;<lpage>2172</lpage>.
                    <pub-id pub-id-type="pmid">32939681</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s40520-020-01705-x</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Soto-Acosta</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>COVID-19 pandemic: Shifting digital transformation to a high-speed gear.</article-title>
                    <source>

                        <italic toggle="yes">Inf. Syst. Manag.</italic>
</source>
                    <year>2020</year>;<volume>37</volume>(<issue>4</issue>):<fpage>260</fpage>&#x2013;<lpage>266</lpage>.
                    <pub-id pub-id-type="doi">10.1080/10580530.2020.1814461</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Stewart</surname>
                            <given-names>DW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Davoren</surname>
                            <given-names>AK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Neumeister</surname>
                            <given-names>JR</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Graduate schools respond to COVID-19: Promising pathways to innovation and sustainability in stem education.</article-title>
                    <year>2021</year>. June 30, 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://www.norc.org/PDFs/Graduate%20Studies%20COVID/Graduate%20Schools%20Respond%20to%20COVID-19%20Executive%20Summary.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <mixed-citation publication-type="other">
                    <collab>United Nations (UN)</collab>:
                    <article-title>Everyone Included: Social Impact of COVID-19.</article-title>
                    <year>2020</year>. November 27, 2020.
                    <ext-link ext-link-type="uri" xlink:href="https://www.un.org/development/desa/dspd/everyone-included-covid-19.html">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref25">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Weiner</surname>
                            <given-names>DL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Balasubramaniam</surname>
                            <given-names>V</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shah</surname>
                            <given-names>SI</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>COVID-19 impact on research, lessons learned from COVID-19 research, implications for pediatric research.</article-title>
                    <source>

                        <italic toggle="yes">Pediatr. Res.</italic>
</source>
                    <year>2020</year>;<volume>88</volume>:<fpage>148</fpage>&#x2013;<lpage>150</lpage>.
                    <pub-id pub-id-type="pmid">32544922</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41390-020-1006-3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Weiner</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Excited, scared, ready: Medical students head back to clerkships.</article-title>
                    <source>

                        <italic toggle="yes">AAMC.</italic>
</source>
                    <year>2020 June 2</year>. June 30, 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://www.aamc.org/news-insights/excited-scared-ready-medical-students-head-back-clerkships">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wigginton</surname>
                            <given-names>NS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cunningham</surname>
                            <given-names>RM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Katz</surname>
                            <given-names>RH</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Moving academic research forward during COVID-19.</article-title>
                    <source>

                        <italic toggle="yes">Science.</italic>
</source>
                    <year>2020</year>;<volume>368</volume>(<issue>6496</issue>):<fpage>1190</fpage>&#x2013;<lpage>1192</lpage>.
                    <pub-id pub-id-type="pmid">32467332</pub-id>
                    <pub-id pub-id-type="doi">10.1126/science.abc5599</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <mixed-citation publication-type="other">
                    <collab>World Health Organization (WHO)</collab>:
                    <article-title>Ethical standards for research during public health emergencies: Distilling existing guidance to support COVID-19 R&amp;D.</article-title>
                    <year>2020</year>. June 30, 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://www.who.int/blueprint/priority-diseases/key-action/liverecovery-save-of-ethical-standards-for-research-during-public-health-emergencies.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref29">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yanow</surname>
                            <given-names>SK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Good</surname>
                            <given-names>MF</given-names>
                        </name>
</person-group>:
                    <article-title>Nonessential research in the new normal: The impact of COVID-19.</article-title>
                    <source>

                        <italic toggle="yes">Am. J. Trop. Med. Hyg.</italic>
</source>
                    <year>2020</year>;<volume>102</volume>(<issue>6</issue>):<fpage>1164</fpage>&#x2013;<lpage>1165</lpage>.
                    <pub-id pub-id-type="pmid">32333545</pub-id>
                    <pub-id pub-id-type="doi">10.4269/ajtmh.20-0325</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report225226">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.122760.r225226</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Hermawan</surname>
                        <given-names>Daniel</given-names>
                    </name>
                    <xref ref-type="aff" rid="r225226a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-9336-799X</uri>
                </contrib>
                <aff id="r225226a1">
                    <label>1</label>Business Administration Department, Parahyangan Catholic University, Bandung, West Java, Indonesia</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>30</day>
                <month>11</month>
                <year>2023</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2023 Hermawan D</copyright-statement>
                <copyright-year>2023</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
                <license>
                    <license-p>The author(s) is/are employees of the US Government and therefore domestic copyright protection in USA does not apply to this work. The work may be protected under the copyright laws of other jurisdictions when used in those jurisdictions.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport225226" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.111082.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>1. This paper give an overview of university-based researchers&#x2019; perspectives and experiences, focusing on student engagement in research and conduct of human subject research (HSR), however "experiences" in this context is not yet clearly defined and quite few discuss in this paper.</p>
            <p> </p>
            <p> 2. Several parts of this paper still lack of references.</p>
            <p> </p>
            <p> 3. Elaborate human subject research (HSR) from a large US university system's overview in Introduction.</p>
            <p> </p>
            <p> 4. Several Table, i.e. Table 1. need to discuss more, since quite unclear.</p>
            <p> </p>
            <p> 5. Explain the reason to choose bivariate and multivariable logistic regression models in this research.</p>
            <p> </p>
            <p> 6. Title can be revised to be more concise.</p>
            <p> </p>
            <p> 7. Give implication of this research if Covid-19 situation or similar occur again in the future.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Marketing, communication, innovation</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
</article>
