<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="brief-report" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.52161.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Brief Report</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Modifications to the delivery of NHS face-to-face general practice consultations during the COVID-19 pandemic in England</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Duncan</surname>
                        <given-names>Lorna J.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-9629-030X</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Cheng</surname>
                        <given-names>Kelly F.D.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-1295-6662</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Centre for Academic Primary Care, Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK</aff>
                <aff id="a2">
                    <label>2</label>Bristol Medical School, University of Bristol, Bristol, UK</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:lorna.duncan@bristol.ac.uk">lorna.duncan@bristol.ac.uk</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>31</day>
                <month>3</month>
                <year>2021</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>10</volume>
            <elocation-id>261</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>17</day>
                    <month>3</month>
                    <year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Duncan LJ and Cheng KFD</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/10-261/pdf"/>
            <abstract>
                <p>
                    <bold>Background: </bold>To minimise transmission of SARS-CoV-2, the virus causing COVID-19, delivery of general practice consultations has been modified to enable the separation of diagnosed or suspected COVID-19 patients from others. Remote triage and consultations are currently the default model, with adapted face-to-face contact used when clinically necessary. This study aimed to identify the modified face-to-face delivery models used across England, together with evidence for their effectiveness.</p>
                <p>

                    <bold>Methods: </bold>In June 2020, a cross-sectional survey was sent by email to the 135 Clinical Commissioning Groups (CCGs) in England to identify local organisation of face-to-face general practice consultations since March 2020. An email was also sent to Public Health England (PHE) requesting information about COVID-19 outbreaks in general practice.</p>
                <p> 
                    <bold>Results: </bold>All CCGs responded. Separation of COVID-19 patients from others was achieved using combinations of the following models: 
                    <list list-type="bullet">
                        <list-item>
                            <p>zoned surgeries (used in 47% of CCGs), where COVID-19 and other patients are seen separately within their own practice;</p>
                        </list-item>
                        <list-item>
                            <p>&#x2018;hot&#x2019; or &#x2018;cold&#x2019; hubs (used in 90% of CCGs), separate sites where COVID-19 or other patients registered at one of several collaborating practices are seen;</p>
                        </list-item>
                        <list-item>
                            <p>&#x2018;hot&#x2019; and &#x2018;cold&#x2019; home visits (used in 70% of CCGs).</p>
                        </list-item>
                    </list> CCGs used one of seven combinations of these models, with some showing flexibility according to changing local need through hub availability. Concomitant PHE data showed less than 2% of COVID-19 outbreaks in England were linked to general practice.</p>
                <p> 
                    <bold>Conclusions: </bold>Varied, flexible ways of delivering face-to-face general practice consultations were identified. While outbreaks in general practice constituted a small proportion of total outbreaks, investigation of these, and evaluation of the modified delivery in terms of management of COVID-19 and other conditions, as well as impacts on staff and patients, will aid both future management of the pandemic and identification of the aspects of adapted practice which may be of benefit beyond this.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>COVID-19</kwd>
                <kwd>SARS-CoV-2</kwd>
                <kwd>coronavirus</kwd>
                <kwd>general practice</kwd>
                <kwd>primary care</kwd>
                <kwd>face-to-face consultation</kwd>
                <kwd>delivery model</kwd>
                <kwd>transmission</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/501100013374">
                    <funding-source>NIHR School for Primary Care Research</funding-source>
                </award-group>
                <funding-statement>This research was part-funded by the National Institute for Health Research School for Primary Care Research (NIHR SPCR), as part of the Evidence Synthesis Working Group (ESWG).&#13;
This report is independent research by the National Institute for Health Research. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health.</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>Introduction</title>
            <p>While more than 80% of patients with COVID-19 may not require hospitalisation,
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> many will seek treatment in general practice. In order to minimise transmission of the causative severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) during general practice (GP) consultations, NHS England&#x2019;s Standard Operating Procedure was revised in March 2020 to a remote triage and consultation default, with adapted models for face-to-face contact when clinically necessary.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup> The use of telephone, video and online consultations in English general practice has been studied elsewhere.
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup> In this paper we report on the delivery of face-to-face general practice consultations during the pandemic, largely focussed on the spring and summer of 2020.</p>
            <p>When, after remote triage, a face-to-face general practice consultation is considered necessary, the requirement to separate those patients with suspected or diagnosed COVID-19 [&#x2018;COVID-19&#x2019; patients] from others is clear. Protection must be afforded to all on-site and NHS guidance suggests two possible ways to manage patients, premises and workforce for optimal infection prevention and control (IPC), alongside dedicated home visiting services for those shielding:
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup>
                <list list-type="order">
                    <list-item>
                        <label>(i)</label>
                        <p>
                            <underline>Zoned practices:</underline> In this model, patient cohorts are separated within their own practices. Designated areas e.g., &#x2018;red&#x2019; and &#x2018;green&#x2019; zones, may be used to manage COVID-19 and other patients, respectively. Careful management is needed to minimise cross-contamination between groups, including separate walkways and consultation rooms, and staff allocated to one zone only. Zoning may therefore be impractical in some surgeries.</p>
                    </list-item>
                    <list-item>
                        <label>(ii)</label>
                        <p>
                            <underline>Hot and cold hubs:</underline> A primary care hub may be designated as either &#x2018;hot&#x2019; or &#x2018;cold&#x2019;, to treat COVID-19 or other patients respectively. It is available to patients registered at one of several collaborating practices. Where hot hubs are sited separately to non-COVID services, IPC procedures may be more straightforward than in zoned practices.
                            <sup>
                                <xref ref-type="bibr" rid="ref2">2</xref>,
                                <xref ref-type="bibr" rid="ref4">4</xref>
                            </sup>
                        </p>
                    </list-item>
                    <list-item>
                        <label>(iii)</label>
                        <p>
                            <underline>Dedicated home visiting:</underline> Home visiting services, modified to minimise cross-contamination, are necessary for those patients unable to access other face-to-face services, or where such provision is otherwise considered appropriate during the pandemic. Staff work exclusively with COVID-19 or other patients, and the number of activities undertaken during visits should be maximised to limit the requirement for additional face-to-face consultations. This service may be organised collaboratively, such as across Primary Care Networks, or by individual practices.</p>
                    </list-item>
                </list>
            </p>
            <p>NHS guidance indicates that decisions regarding model use should be determined locally, in agreement with the relevant Clinical Commissioning Group (CCG) responsible for planning and commissioning NHS health care services in the area. It also recognises that flexible models may be required as patient demand and workforce capacity fluctuates throughout the pandemic.
                <sup>
                    <xref ref-type="bibr" rid="ref4">4</xref>
                </sup>
            </p>
            <p>This study aimed to identify the ways in which delivery of NHS face-to-face general practice has been re-organised across England to meet IPC standards during the pandemic, together with any evidence regarding the effectiveness of these measures.</p>
        </sec>
        <sec id="sec2" sec-type="methods">
            <title>Methods</title>
            <sec id="sec3">
                <title>1. CCG survey</title>
                <p>A cross-sectional survey of the 135 CCGs in England was conducted to identify how face-to-face general practice consultations were being delivered across the country.</p>
                <p>
                    <underline>Survey design</underline>
                </p>
                <p>Survey questions were devised by the study team. They concerned models of face-to-face consultations in use and the patient populations each were available to; prior use of the hub model; and planned evaluations. Questions were pre-tested with a researcher experienced in survey design, two CCGs and one provider of primary healthcare. Minor changes to wording were made for clarity. The final questionnaire is available as 
                    <italic toggle="yes">Extended data</italic>.
                    <sup>
                        <xref ref-type="bibr" rid="ref13">13</xref>
                    </sup>
                </p>
                <p>
                    <underline>Data collection</underline>
                </p>
                <p>Questions were sent by email to all CCGs in June 2020 under the 
                    <ext-link ext-link-type="uri" xlink:href="https://www.legislation.gov.uk/ukpga/2000/36/contents">Freedom of Information (FOI) Act 2000</ext-link>. This legislation enables public access to recorded information held by public authorities in England. Responsibility for cleansing data lies with the authorities responding to FOI requests
                    <sup>
                        <xref ref-type="bibr" rid="ref5">5</xref>
                    </sup> and research ethics approval was not required.</p>
                <p>Individual CCGs were identified on the 
                    <ext-link ext-link-type="uri" xlink:href="https://www.england.nhs.uk/ccg-details/">NHS England</ext-link> website and their specific FOI procedures were followed. FOI regulations mandate a response timeframe of 20 working days. Where, rarely, replies were not received within this time, follow-up emails were sent, and telephone calls made if necessary. All responses were collated in an Excel spreadsheet for analysis.</p>
                <p>
                    <underline>Data analysis</underline>
                </p>
                <p>Data was extracted for each survey question, with any queries regarding response interpretation discussed between the authors. Email and telephone communication with CCGs was also used occasionally for clarification or updates. Numeric and narrative analyses were undertaken for responses to each question. Different face-to-face delivery models were identified, and each CCG was assigned to a model combination of best fit for nationwide comparison.</p>
            </sec>
            <sec id="sec4">
                <title>2. Public Health England (PHE) query</title>
                <p>Specific data on clusters or outbreaks of acute respiratory infections with at least one linked case testing positive for SARS-CoV-2 are recorded for hospitals and care homes in the weekly 
                    <ext-link ext-link-type="uri" xlink:href="https://www.gov.uk/government/statistics/national-flu-and-covid-19-surveillance-reports">COVID-19 surveillance reports</ext-link>
                    <italic toggle="yes">,</italic> published by Public Health England (PHE).
                    <sup>
                        <xref ref-type="bibr" rid="ref6">6</xref>,
                        <xref ref-type="bibr" rid="ref7">7</xref>
                    </sup> [&#x2018;Clusters&#x2019; are cases linked to a setting through surveillance testing; &#x2018;outbreaks&#x2019; are reported directly from settings]. To obtain similar information regarding general practice, an email was sent to PHE in December 2020, under the FOI Act 2000. The questions asked are available as 
                    <italic toggle="yes">Extended data</italic>.
                    <sup>
                        <xref ref-type="bibr" rid="ref14">14</xref>
                    </sup>
                </p>
            </sec>
        </sec>
        <sec id="sec5" sec-type="results">
            <title>Results</title>
            <sec id="sec6">
                <title>1. CCG survey</title>
                <p>
                    <underline>Responses</underline>
                </p>
                <p>Replies were received from all CCGs, 99% in June and July 2020, with the final response received on 2
                    <sup>nd</sup> October.</p>
                <p>
                    <underline>Response interpretation</underline>
                </p>
                <p>Terminology used in responses varied &#x2013; &#x2018;hot sites&#x2019;, &#x2018;hot clinics&#x2019; and &#x2018;resilience hubs&#x2019; could be used to refer to the same service for example. Colour-coding, e.g., &#x2018;green&#x2019; and &#x2018;amber&#x2019; sites, could also be used differently, and service provision for non-COVID patients was not always clear. As a consequence the distinction between hot hubs, cold hubs and zoned practices was not always immediately evident. Complete response sets, including any additional documentation provided on model pathways and usage data, were therefore used to interpret and categorise all face-to-face consultation types according to the models in this paper.</p>
                <p>The following interpretation of the data is the authors&#x2019; own and has not been approved or otherwise by the CCGs.</p>
                <p>
                    <underline>Adapted delivery models</underline>
                </p>
                <p>General practice face-to-face delivery has been modified in each CCG using combinations of the three models previously described:
                    <list list-type="order">
                        <list-item>
                            <label>(i)</label>
                            <p>Zoned practices (model 1 in 
                                <xref ref-type="fig" rid="f1">Figure 1</xref>), available to the entire patient populations served, were reported by 63 (47%) of CCGs. All but 12 of these also used hubs at the time of reporting. Most commonly, two closed &#x2018;red&#x2019; and &#x2018;green&#x2019; areas with different entrances and exits were used. Rarely, cohorts could also be separated temporally, with COVID-19 patients alone seen at certain times. The latter model was described in updated NHS England guidance (version 2, dated 5
                                <sup>th</sup> April 2020) for surgeries where provision of separate spaces for different cohorts was not possible.
                                <sup>
                                    <xref ref-type="bibr" rid="ref2">2</xref>
                                </sup>
                            </p>
                        </list-item>
                        <list-item>
                            <label>(ii)</label>
                            <p>&#x2018;Hot&#x2019; or &#x2018;cold&#x2019; hubs (models 2 and 3 in 
                                <xref ref-type="fig" rid="f1">Figure 1</xref>), were reported by 90% of CCGs. All of these had hot hubs, with 17% also using cold hubs. Hubs were generally available to all of the combined patient populations served. Occasionally however, cold hubs had more specific uses - a &#x2018;super-green&#x2019; hub for patients requiring additional shielding for example and a &#x2018;purple&#x2019; hub for routine treatments including vaccinations and maternity checks. Hub reach extended from several practices to entire CCGs. They were sited in re-purposed buildings (surgeries for example, or hubs that usually offered extended GP access), a racecourse, temporary structures (e.g., portacabins and marquees) or provided as drive-through facilities. Most CCGs indicated they had used hubs prior to the pandemic, mainly for the provision of extended hours GP access for patients.</p>
                            <p>The use of &#x2018;co-located&#x2019; hubs was indicated in 21 CCGs, whereby hot hubs were sited adjacent to cold hubs (n=4) or cold practices (n=17).</p>
                        </list-item>
                        <list-item>
                            <label>(iii)</label>
                            <p>&#x2018;Hot&#x2019; and/or &#x2018;cold&#x2019; home visiting services, were specified by 70% of CCGs - 15% for hot appointments only, 10% for cold and 45% for both cohorts. These usually served patients unable to access other face-to-face services but were occasionally the main form of COVID-19 service provision. Delivery could be provided by practices, collaborative networks or CCG acute visiting services, and in some cases operated out of hubs. A small number of CCGs offered home monitoring of COVID-19 patients, via pulse oximetry for example, as an additional service.</p>
                        </list-item>
                    </list>
                </p>
                <p>The different means of delivering face-to-face services were compared for each CCG. Overall approaches taken were found to fit one of seven model combinations, albeit with some distinctions, notably the different usage of home visits and co-located hubs.</p>
                <p>The seven model combinations are illustrated in 
                    <xref ref-type="fig" rid="f1">Figure 1</xref>, and their distribution among CCGs shown in 
                    <xref ref-type="fig" rid="f2">Figure 2</xref>. The diverse spread of models and size of CCGs seen in 
                    <xref ref-type="fig" rid="f2">Figure 2</xref> reflect the varied geography and population across England. A degree of cross-CCG working was evident in replies, and a small number of CCGs had access to hubs across neighbouring boundaries.
                    <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                        <label>Figure 1. </label>
                        <caption>
                            <title>Models used to separate COVID-19 and other patients during face-to-face NHS GP consultations in England.</title>
                            <p>Authors&#x2019; interpretations of CCG responses according to the following definitions:
                                <list list-type="bullet">
                                    <list-item>
                                        <label>&#x2022;</label>
                                        <p>Zoned practice: co-location of hot and cold services on a single site, serving own practice list</p>
                                    </list-item>
                                    <list-item>
                                        <label>&#x2022;</label>
                                        <p>Hot or cold hub: site of multi-practice working for COVID-19 or other patients respectively</p>
                                    </list-item>
                                </list>
                            </p>
                        </caption>
                        <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/55399/420118f1-f5ff-4a94-a8c2-803870dc89ef_figure1.gif"/>
                    </fig>
                    <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                        <label>Figure 2. </label>
                        <caption>
                            <title>Local models used to separate COVID-19 and other patients during face-to-face GP consultations across England.</title>
                            <p>Model combinations:*</p>
                            <p>1: zoned practices (+/- home visits)</p>
                            <p>2: hot hubs + cold practices (+/- home visits)</p>
                            <p>3: hot hubs, cold hubs + cold practices (+/- home visits)</p>
                            <p>4: hot home visits + cold practices</p>
                            <p>5: hot hubs, cold hubs + zoned practices (+/- home visits)</p>
                            <p>6: hot hubs, cold hubs, zoned practices + cold practices (+/- home visits)</p>
                            <p>7: zoned practices, cold practices + hot home visits.</p>
                            <p>*Authors&#x2019; interpretations of CCG responses according to the following definitions:
                                <list list-type="bullet">
                                    <list-item>
                                        <label>&#x2022;</label>
                                        <p>Zoned practice: co-location of hot and cold services on a single site, serving own practice list</p>
                                    </list-item>
                                    <list-item>
                                        <label>&#x2022;</label>
                                        <p>Hot or cold hub: site of multi-practice working for COVID-19 or other patients respectively</p>
                                    </list-item>
                                </list>
                            </p>
                            <p>N.B. 15 CCGs did not describe face-to-face consultations for &#x2018;cold&#x2019; patients. 14 of these were assigned to model combination 2 as hot hubs were described which were not co-located with cold services; and 1 was assigned to model combination 5.</p>
                            <p>The face-to-face delivery data we have presented was correct between March 2020 and the date of response [June/July (n=134) and October (n=1) 2020].</p>
                        </caption>
                        <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/55399/420118f1-f5ff-4a94-a8c2-803870dc89ef_figure2.gif"/>
                    </fig>
                </p>
                <p>
                    <underline>Evaluations and flexible models</underline>
                </p>
                <p>87% of CCGs reported on-going, complete or intended reviews, generally of hub and/or telephone triage use, although one CCG was considering the potential of its drive-through model for influenza vaccinations, and others were intending to consider staff or patient perspectives. In total 23 CCGs reported using reviews to facilitate dynamic models, with hubs either available but as yet unused (n=3) or having been used initially and then stood down (n=20). [Assignment to model combinations 1-7 was based on provision at the time of CCG reporting.] More recent communication (Oct 12th-16th 2020) with three such CCGs using the zoned practice model (#1) confirmed that, despite COVID-19 incidence requiring local lockdowns at that time,
                    <sup>
                        <xref ref-type="bibr" rid="ref6">6</xref>,
                        <xref ref-type="bibr" rid="ref7">7</xref>
                    </sup> GP escalation plans had not yet been necessary although hub sites remained available. Some other CCGs also indicated lower use of COVID-19 face-to-face consultations than anticipated.</p>
                <p>17 CCGs provided data on face-to-face contact across 21 hot hubs. While representing only a small proportion of total hubs, wide variations in usage were seen, with average weekly consultation numbers ranging from 2 to 79 per hot hub (March to July 2020).</p>
            </sec>
            <sec id="sec7">
                <title>2. PHE FOI response</title>
                <p>PHE data received detailed regional outbreaks or clusters of acute respiratory infections with possible/confirmed COVID-19 cases linked to GP surgeries. 
                    <xref ref-type="table" rid="T1">Table 1</xref> shows this data as monthly totals from March to December 2020, alongside numbers of English face-to-face GP consultations obtained from NHS Digital.
                    <sup>
                        <xref ref-type="bibr" rid="ref8">8</xref>
                    </sup> In the March-August timeframe covered by model usage in this study, 25 outbreaks or clusters with possible/confirmed COVID-19 cases were reported in England in the context of over 104 million face-to-face GP appointments. This represented less than 2% of all COVID-19 outbreaks or clusters in England [calculated using data in 
                    <ext-link ext-link-type="uri" xlink:href="https://www.gov.uk/government/statistics/national-flu-and-covid-19-surveillance-reports">COVID-19 surveillance reports</ext-link>].
                    <sup>
                        <xref ref-type="bibr" rid="ref6">6</xref>,
                        <xref ref-type="bibr" rid="ref7">7</xref>
                    </sup> Numbers increased in October and November, alongside rising face-to-face appointment levels, but continued to represent a small proportion of totals.
                    <sup>
                        <xref ref-type="bibr" rid="ref8">6</xref>,
                        <xref ref-type="bibr" rid="ref7">7</xref>
                    </sup> Final figures may in fact be lower after investigation of unconfirmed cases by local PHE Health Protection Teams.
                    <table-wrap id="T1" orientation="portrait" position="float">
                        <label>Table 1. </label>
                        <caption>
                            <title>Possible COVID-19 outbreaks/clusters and total face-to-face consultations in English general practice surgeries, March-December 2020.</title>
                        </caption>
                        <table content-type="article-table" frame="hsides">
                            <thead>
                                <tr>
                                    <th align="left" colspan="1" rowspan="1" valign="top">Month
                                        <xref ref-type="table-fn" rid="tfn1">*</xref>
                                    </th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">North East</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">Yorkshire and Humber</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">North West</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">East of England</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">East Midlands</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">West Midlands</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">South East</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">South West</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">London</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">England</th>
                                    <th align="left" colspan="1" rowspan="1" valign="top">Monthly GP face-to-face appointments, England
                                        <xref ref-type="table-fn" rid="tfn2">**</xref>
                                    </th>
                                </tr>
                            </thead>
                            <tbody>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>March</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>0</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">31,841,558</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>April</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>2</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">14,960,202</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>May</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>7</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">15,459,694</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>June</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>13</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">19,526,124</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>July</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>3</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">22,352,108</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>Aug</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>7</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">20,763,100</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>Sept</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>14</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">30,185,304</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>Oct</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">25</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">8</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">23</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">18</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>99</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">33,741,240</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>Nov</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">8</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">12</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">24</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">13</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">13</td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>102</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">27,773,964</td>
                                </tr>
                                <tr>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>Total</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>14</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>24</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>43</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>20</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>24</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>50</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>24</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>24</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>24</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">
                                        <bold>247</bold>
                                    </td>
                                    <td align="left" colspan="1" rowspan="1" valign="top">216,603,294</td>
                                </tr>
                            </tbody>
                        </table>
                        <table-wrap-foot>
                            <fn id="tfn1">
                                <label>*</label>
                                <p>Monthly data calculated from weekly totals given in Public Health England response to FOI request. [March: 02/03/2020 to 29/03/2020; April: 30/03/2020 to 26/04/2020; May: 27/04/2020 to 31/05/2020; June: 01/06/2020 to 28/06/2020; July: 29/06/2020 to 26/07/2020; Aug: 27/07/2020 to 30/08/2020; Sept: 31/08/2020 to 27/09/2020; Oct: 28/09/2020 to 01/11/2020; Nov: 02/11/2020 to 29/11/2020]. Some 'possible' COVID-19 cases reported may be excluded after investigation by local PHE Health Protection Teams, and final numbers may therefore be lower.</p>
                            </fn>
                            <fn id="tfn2">
                                <label>**</label>
                                <p>Face-to-face general practice appointment data obtained from NHS Digital.
                                    <sup>
                                        <xref ref-type="bibr" rid="ref8">8</xref>
                                    </sup>
                                </p>
                            </fn>
                        </table-wrap-foot>
                    </table-wrap>
                </p>
            </sec>
        </sec>
        <sec id="sec8" sec-type="discussion">
            <title>Discussion</title>
            <sec id="sec9">
                <title>Model selection</title>
                <p>All CCGs reported the use of zoned practices, hubs and/or home visits in varying combinations for face-to-face GP consultations. Factors influencing model selection included COVID-19 appointment demand, presence of pre-established collaborative networks and GP preferences to provide continuity of care. On-going model assessments enabled responsiveness to changing demand, mainly through altered hub availability, but also by changed provision of home monitoring for COVID-19 patients.</p>
                <p>CCG mergers on 1st April 2020, which decreased total numbers from 191 to 135, may also have impacted model patterning within CCGs. While the &#x2018;hot hubs + cold practices&#x2019; model combination #2 was the most frequently used nationwide, larger CCGs tended to report &#x2018;mixed&#x2019; models, giving model combination #5 the greatest overall coverage (
                    <xref ref-type="fig" rid="f2">Figure 2</xref>). Patterning within these mixed model combinations (#5-#7) could not always be identified, but in one CCG five areas of zoning and a sixth using a hot hub were identified, and in some others more diffuse patterning was noted.</p>
            </sec>
            <sec id="sec10">
                <title>Variations within models</title>
                <p>The distinction between the zoned practice and hub models used is not as clear as indicated in our 
                    <italic toggle="yes">Introduction.</italic> The co-location of hot hubs with cold services means that the requirement for strict management between hot and cold areas is as important here as in the zoned practice model. Indeed, several CCGs using co-located hubs and some using zoned practices specified the use of separate entrances and exits, with some also indicating separate car parking facilities. By contrast, other zoned practices shared more similarities with distinctly sited hubs, where red and green areas were split between main and branch surgeries for example, or additional structures such as portacabins were used on site, to separate patient cohorts registered within one practice. Thus, it is not necessarily the case that the hub model provides clearer separation and thereby simpler IPC adherence than zoned practices, as indicated in the guidelines.
                    <sup>
                        <xref ref-type="bibr" rid="ref2">2</xref>,
                        <xref ref-type="bibr" rid="ref4">4</xref>
                    </sup>
                </p>
                <p>Usage of home visits also varied. In at least two CCGs this was the main or only form of COVID-19 face-to-face consultation. In 30% of CCGs however, the use of specific hot and/or cold home visits was not reported. Home monitoring, via pulse oximetry for example, was an additional service indicated by a small number of CCGs at the time of reporting.</p>
            </sec>
            <sec id="sec11">
                <title>SARS-CoV-2 transmission</title>
                <p>While the risk of transmission can be minimised in face-to-face consultations, it cannot be eliminated, particularly with the significant pre-symptomatic and asymptomatic transmission associated with COVID-19.
                    <sup>
                        <xref ref-type="bibr" rid="ref9">9</xref>
                    </sup> PHE data shows a total of 247 possible or confirmed COVID-19 outbreaks or clusters in English GP surgeries over the first nine months of the pandemic, in the context of more than 216 million face-to-face appointments. While these numbers are a small proportion of total (all source) outbreaks in the UK, investigation of any confirmed outbreak may guide future measures to reduce transmission.</p>
                <p>The variability in possible/confirmed outbreaks or clusters in general practice over time, as well as by region (shown in 
                    <xref ref-type="table" rid="T1">Table 1</xref>), may partly be accounted for by changing COVID-19 incidence rates, but also by other factors including differences in testing rates, population risk factors, and the numbers and means of delivery of face-to-face consultations taking place locally.</p>
            </sec>
            <sec id="sec12">
                <title>Evaluation</title>
                <p>In addition to minimising SARS-CoV-2 transmission, the success of IPC delivery models used during the pandemic will be measured in terms of the management of COVID-19 and other conditions, and the perspectives of patients and staff. Several patient surveys have now been undertaken.
                    <sup>
                        <xref ref-type="bibr" rid="ref10">10</xref>
                    </sup>
                    <sup>&#x2013;</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref12">12</xref>
                    </sup> The authors have also reported on a survey of the public, investigating experiences and understanding of the changes to general practice.
                    <sup>
                        <xref ref-type="bibr" rid="ref15">15</xref>
                    </sup> These patient findings, taken together with staff perspectives
                    <sup>
                        <xref ref-type="bibr" rid="ref3">3</xref>
                    </sup> and quantitative evaluations should provide helpful insights into the effective use of the adapted models.</p>
            </sec>
            <sec id="sec13">
                <title>Limitations</title>
                <p>There are several limitations to this study. As already described, terms used to describe novel concepts (e.g., hot/cold hubs, zoning) varied and could not readily be checked. This may, for a small number of CCGs, have led to misinterpretation of responses and consequent misassignment to model combinations. Studies at Primary Care Network or practice level would likely reveal more granular detail, particularly with respect to the &#x2018;mixed model&#x2019; combinations identified. In terms of the PHE FOI request, data on outbreaks/clusters from &#x2018;GP surgeries&#x2019; was provided, and it is unclear whether this includes hubs and all home visiting services. Finally, the service delivery details provided by CCGs were mainly received in summer 2020 and, as has been identified, these are dynamic models and may since have been modified.</p>
            </sec>
        </sec>
        <sec id="sec14" sec-type="conclusions">
            <title>Conclusions</title>
            <p>This study provides an overview of nationwide IPC adaptation of face-to-face GP consultations in the spring and summer of 2020, with varied and dynamic models implemented to suit different and changing local conditions. Numbers of COVID-19 outbreaks linked to English GP surgeries indicate their relative success in minimising transmission. Shared learning from evaluation of these outbreaks across the different models may be instructive however for future management of SARS-CoV-2 transmission within general practice, where numbers of face-to-face consultations will need to increase again in future. Broader evaluation of the changes is also needed, including analysis of their impact on the management of non-COVID conditions, as well as on staff and patients. Taken together, this will identify beneficial elements of the rapidly enforced adaptations to inform practice both during this pandemic and beyond.</p>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgements</title>
            <p>We would like to thank each CCG, as well as Public Health England for responding to our requests for information.</p>
        </ack>
        <sec id="sec15">
            <title>Data availability</title>
            <sec id="sec16">
                <title>Underlying data</title>
                <p>The Re-use of Public Sector Information Regulations (RPSI) 2005 and copyright requirements have been invoked as imposing requirements around certain types of further use of survey data provided by some Clinical Commissioning Groups (CCGs). This may also apply to data received from other CCGs and Public Health England (PHE) and it is therefore not possible to share this data under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).</p>
                <p>The data may be available from individual CCGs and PHE on request, with reference to the authors and this publication. Alternatively, Freedom of Information requests similar to those made by the authors may be used. Full details of these are provided in the 
                    <italic toggle="yes">Extended data</italic> and 
                    <italic toggle="yes">Methods</italic> section.</p>
            </sec>
            <sec id="sec17">
                <title>Extended data</title>
                <p>
Figshare: Survey sent to Clinical Commissioning Groups in England, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.6084/m9.figshare.14156741.v1">https://doi.org/10.6084/m9.figshare.14156741.v1</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref13">13</xref>
                    </sup>
                </p>
                <p>Figshare: Questions sent to Public Health England, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.6084/m9.figshare.14156762.v1">https://doi.org/10.6084/m9.figshare.14156762.v1</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref14">14</xref>
                    </sup>
                </p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            </sec>
        </sec>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Verity</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Okell</surname>
                            <given-names>LC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dorigatti</surname>
                            <given-names>I</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Estimates of the severity of coronavirus disease 2019: a model-based analysis.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Infect Dis.</italic>
</source>
                    <year>2020</year>;<volume>20</volume>:<fpage>669</fpage>&#x2013;<lpage>677</lpage>.
                    <pub-id pub-id-type="pmid">32240634</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S1473-3099(20)30243-7</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7158570</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="other">
                    <collab>NHS_England</collab>:
                    <article-title>Guidance and standard operating procedures.</article-title>
                    <source>

                        <italic toggle="yes">General practice in the context of coronavirus (COVID-19).</italic>
</source>
                    <year>2020</year>[Accessed 31 Oct 2020].
                    <ext-link ext-link-type="uri" xlink:href="https://www.england.nhs.uk/coronavirus/publication/managing-coronavirus-covid-19-in-general-practice-sop/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Murphy</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Scott</surname>
                            <given-names>LJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Salisbury</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Implementation of remote consulting in UK primary care following the COVID-19 pandemic: a mixed-methods longitudinal study.</article-title>
                    <source>

                        <italic toggle="yes">Br J Gen Pract.</italic>
</source>
                    <year>2021</year>;<volume>71</volume>:<fpage>e166</fpage>&#x2013;<lpage>e177</lpage>.
                    <pub-id pub-id-type="pmid">33558332</pub-id>
                    <pub-id pub-id-type="doi">10.3399/BJGP.2020.0948</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7909923</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="web">
                    <collab>NHS_England_and_NHS_Improvement</collab>:
                    <article-title>GP Preparedness update letter.</article-title>
                    <year>2020</year>[Accessed 25 Feb 2021].
                    <ext-link ext-link-type="uri" xlink:href="https://www.england.nhs.uk/coronavirus/primary-care/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Savage</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hyde</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>Using freedom of information requests to facilitate research.</article-title>
                    <source>

                        <italic toggle="yes">Int J Soc Res Method.</italic>
</source>
                    <year>2014</year>;<volume>17</volume>:<fpage>303</fpage>&#x2013;<lpage>317</lpage>.
                    <pub-id pub-id-type="doi">10.1080/13645579.2012.742280</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="web">
                    <collab>Public_Health_England</collab>:
                    <article-title>National COVID-19 surveillance reports.</article-title>
                    <year>2020</year>[Accessed 31 Oct 2020].
                    <ext-link ext-link-type="uri" xlink:href="https://www.gov.uk/government/publications/national-covid-19-surveillance-reports">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="web">
                    <collab>Public_Health_England</collab>:
                    <article-title>National flu and COVID-19 surveillance reports.</article-title>
                    <year>2020</year>[Accessed 25 Feb 2021].
                    <ext-link ext-link-type="uri" xlink:href="https://www.gov.uk/government/statistics/national-flu-and-covid-19-surveillance-reports">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="web">
                    <collab>NHS_Digital</collab>:
                    <article-title>Appointments in General Practice.</article-title>
                    <year>2020</year>[Accessed 25 Feb 2021].
                    <ext-link ext-link-type="uri" xlink:href="https://digital.nhs.uk/data-and-information/publications/statistical/appointments-in-general-practice">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="web">
                    <collab>European_Centre_for_Disease_Prevention_and_Control</collab>:
                    <article-title>Transmission of COVID-19.</article-title>
                    <year>2020</year>[Accessed 25 Feb 2021].
                    <ext-link ext-link-type="uri" xlink:href="https://www.ecdc.europa.eu/en/covid-19/latest-evidence/transmission">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="other">
                    <collab>Public_Health_England</collab>:
                    <article-title>Wider Impacts of COVID-19 on Health (WICH) monitoring tool.</article-title>
                    <year>2020</year>[Accessed 3 Sept 2020].
                    <ext-link ext-link-type="uri" xlink:href="https://analytics.phe.gov.uk/apps/covid-19-indirect-effects/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <label>11</label>
                <mixed-citation publication-type="other">
                    <collab>Healthwatch_Swindon</collab>:
                    <article-title>PPG chairs&#x2019; quick survey of Swindon GP practices.</article-title>
                    <year>2020</year>[Accessed 31 Oct 2020].
                    <ext-link ext-link-type="uri" xlink:href="https://www.healthwatchswindon.org.uk/report/2020-08-14/ppg-chairs&#146;-survey-swindon-gp-practices">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <label>12</label>
                <mixed-citation publication-type="web">
                    <collab>National_Voices</collab>:
                    <article-title>What we need now.</article-title>
                    <year>2020</year>[Accessed 25 Feb 2021].
                    <ext-link ext-link-type="uri" xlink:href="https://www.nationalvoices.org.uk/publications/our-publications">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>13</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Duncan</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Survey sent to Clinical Commissioning Groups in England.</article-title>
                    <source>

                        <italic toggle="yes">figshare. Journal Contribution.</italic>
</source>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.6084/m9.figshare.14156741.v1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>14</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Duncan</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Questions sent to Public Health England.</article-title>
                    <source>

                        <italic toggle="yes">figshare. Journal Contribution.</italic>
</source>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.6084/m9.figshare.14156762.v1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Duncan</surname>
                            <given-names>LJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cheng</surname>
                            <given-names>KFD</given-names>
                        </name>
</person-group>:
                    <article-title>Public perception of NHS general practice during the first six months of the COVID-19 pandemic in England.</article-title>
                    <source>

                        <italic toggle="yes">F1000Research.</italic>
</source>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.12688/f1000research.52392.1</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report83182">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.55399.r83182</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Atherton</surname>
                        <given-names>Helen</given-names>
                    </name>
                    <xref ref-type="aff" rid="r83182a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-7072-1925</uri>
                </contrib>
                <aff id="r83182a1">
                    <label>1</label>Warwick Medical School, Coventry, UK</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>4</day>
                <month>5</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Atherton H</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport83182" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.52161.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This is a useful and clear report summarising the modifications made in general practice during the height of the pandemic.</p>
            <p> </p>
            <p> There are a few key things that would strengthen the manuscript particularly in terms of message. 
                <list list-type="bullet">
                    <list-item>
                        <p>The abstract background says the study looked at 'evidence for their effectiveness' which is an overstatement as this is very much a descriptive study. It would be more accurate to remove that.&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>At present the paper is written as though we are still 'in' this stage of the pandemic. With vaccinations and the benefit of time changes are happening. It would be useful to couch the study as a description of service delivery in a time of crisis. Hot hubs are not going to be used in the same way now rates are extremely low. Your report is a really useful for any future lockdowns/rise in rates and as a learning tool and you don't couch it in those terms at present.&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>I completely appreciate why you used survey methodology but it isn't ideal as you later highlight. Using FOI requests is such a good idea but does make this a slightly different approach, and probably worth discussing pros/cons in the discussion for the benefit of other researchers. I was interested as to whether it is worth it for the data you get.</p>
                    </list-item>
                    <list-item>
                        <p>The data analysis section is very thin and would benefit from some extra detail.</p>
                    </list-item>
                    <list-item>
                        <p>The PHE element is probably the weakest bit, the link between the models and the outbreaks is tenuous as you don't have any other data around what happened there. Where you describe the 25 outbreaks it would be useful to have more context in the text - how many cases, which models, where. If this is not available I think this needs to be highlighted.</p>
                    </list-item>
                    <list-item>
                        <p>There are several limitations to be added to the discussion&#x00a0; - for example the bit about the CCG mergers, which is important.&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>The section in the discussion about transmission is useful context but comes a bit late in terms of understanding that bit of the work.&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>The section on evaluation doesn't add anything at this point. Could you say instead what the practical application of your findings might be?&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>Overall the manuscript lacks a bit of context, which is fine if it is just a descriptive exercise, but at the moment it isn't sure if it is something more than that. If it is a useful descriptive tool that is fine, but the conclusion probably needs to be toned down. In particular the line 'indicate their relative success in minimising transmission' - you just don't have the data to say that.</p>
                    </list-item>
                    <list-item>
                        <p>Figure is really good and the succinct messaging was appreciated.&#x00a0;</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>No source data required</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>No</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Access to general practice</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment7058-83182">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Duncan</surname>
                            <given-names>Lorna</given-names>
                        </name>
                        <aff>University of Bristol, UK</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>20</day>
                    <month>8</month>
                    <year>2021</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Dr Atherton,</p>
                <p> </p>
                <p> Many thanks for taking the time to review this paper. We have used your detailed and helpful comments to improve our manuscript. Our specific responses to each of your points are listed below.</p>
                <p> </p>
                <p> 
                    <bold>Key points to strengthen the manuscript:</bold>
                </p>
                <p> </p>
                <p> 1.&#x00a0;
                    <italic>The abstract background says the study looked at 'evidence for their effectiveness' which is an overstatement as this is very much a descriptive study. It would be more accurate to remove that.&#x00a0;</italic>
                </p>
                <p> </p>
                <p> We have removed this sentence further to your feedback. Please see also our response to your point 5 below.</p>
                <p> </p>
                <p> 2.&#x00a0;
                    <italic>At present the paper is written as though we are still 'in' this stage of the pandemic. With vaccinations and the benefit of time changes are happening. It would be useful to couch the study as a description of service delivery in a time of crisis. Hot hubs are not going to be used in the same way now rates are extremely low. Your report is a really useful for any future lockdowns/rise in rates and as a learning tool and you don't couch it in those terms at present.</italic>
                </p>
                <p> </p>
                <p> We have now ensured the entire manuscript is written from a historic perspective, looking back to the first wave of the pandemic in spring and early summer 2020. We wrote this report during the second wave as incidence fluctuated, and we had difficulty deciding how to contextualise it. We are grateful for your perspective and agree that this revision has given a much clearer context for the findings.&#x00a0;</p>
                <p> </p>
                <p> 3.&#x00a0;
                    <italic>I completely appreciate why you used survey methodology but it isn't ideal as you later highlight. Using FOI requests is such a good idea but does make this a slightly different approach, and probably worth discussing pros/cons in the discussion for the benefit of other researchers. I was interested as to whether it is worth it for the data you get.</italic>
                </p>
                <p> </p>
                <p> We have now included further discussion of the pros and cons of the use of both surveys and FOI requests in the new &#x2018;strengths and limitations&#x2019; section. We were somewhat limited in the design of our study as COVID-19 restrictions required it to be completed remotely, and because it was initially intended as a 6-week project. Despite the limitations however, we feel this survey using FOI requests yielded useful information, either for case site selection and further investigation, or for retrospective analysis for initial management of any future epidemics, or future lockdowns as you suggest. Although it was not possible to include a comparative table of the CCG data received, we hope that the additional information now included in our summary analysis table (as 
                    <italic>Underlying data</italic>) supports this and is found useful. Please see also our response to your point 8 below.</p>
                <p> </p>
                <p> 4. 
                    <italic>The data analysis section is very thin and would benefit from some extra detail. </italic>
                </p>
                <p> </p>
                <p> We have now incorporated more detail in our methodology section and have also added a summary version of our analysis spreadsheet as 
                    <italic>Underlying data</italic>. It is unfortunate that we are unable to include copies of the CCG and PHE responses under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0) used in this article. However, on considering your comments, we realised it may be helpful to offer permissible detail from which figures 1 and 2 were derived by adding a version of our analysis spreadsheet with the raw data removed. Of course this includes only an interpretation of the data received.</p>
                <p> </p>
                <p> 5.&#x00a0;
                    <italic>The PHE element is probably the weakest bit, the link between the models and the outbreaks is tenuous as you don't have any other data around what happened there. Where you describe the 25 outbreaks it would be useful to have more context in the text - how many cases, which models, where. If this is not available I think this needs to be highlighted.</italic>
                </p>
                <p> </p>
                <p> We agree that the data we have concerning general practice-linked COVID-19 outbreaks is limited and we are grateful to you for highlighting the possible inference of a direct link between the models used and outbreaks from the text. This was not our intention and we have now given a fuller account of the reasoning for requesting this data and for including it in our report. We have also separated this work out in each section of the report.</p>
                <p> </p>
                <p> To the best of our knowledge, this data has not otherwise been made publicly available and we feel it offers useful context around the scale of outbreaks in general practice. We requested further information both from PHE and NHS England &amp; NHS Improvement and have now mentioned this in our methodology section and reported the finding that transmission in staff was more common in general practice than that involving patients in one region. PHE was not able to provide more detail on specific outbreaks due to the potential for deductive disclosure however, and the table we have included in our report provides the most detailed data made available to us.</p>
                <p> </p>
                <p> 6.&#x00a0;
                    <italic>There are several limitations to be added to the discussion - for example the bit about the CCG mergers, which is important.&#x00a0;</italic>
                </p>
                <p> </p>
                <p> We have now expanded on our limitations section, to include discussion around the CCG mergers and several other items. Please see our response to item 8 below for more information.</p>
                <p> </p>
                <p> 7.&#x00a0;
                    <italic>The section in the discussion about transmission is useful context but comes a bit late in terms of understanding that bit of the work.</italic>
                </p>
                <p> </p>
                <p> We agree and thank you for highlighting this. We have now moved this section to the introduction and expanded it.</p>
                <p> </p>
                <p> 8.&#x00a0;
                    <italic>The section on evaluation doesn't add anything at this point. Could you say instead what the practical application of your findings might be?&#x00a0;</italic>
                </p>
                <p> </p>
                <p> [Combined response for items 3, 6 and 8]. We have replaced both the &#x2018;evaluation&#x2019; and &#x2018;limitations&#x2019; sections with a fuller &#x2018;strengths and limitations&#x2019; section. This includes further discussion of the survey methodology, using FOI requests at CCG level, the CCG mergers and possible applications of our study. We agree that this is likely to be far more useful than the two previously included sections &#x2013; many thanks.</p>
                <p> </p>
                <p> 9.&#x00a0;
                    <italic>Overall the manuscript lacks a bit of context, which is fine if it is just a descriptive exercise, but at the moment it isn't sure if it is something more than that. If it is a useful descriptive tool that is fine, but the conclusion probably needs to be toned down. In particular the line 'indicate their relative success in minimising transmission' - you just don't have the data to say that. </italic>
                </p>
                <p> </p>
                <p> This report is intended to offer a description of the face-to-face services offered in general practice in the initial phases of the pandemic. The information we included concerning outbreaks in general practice perhaps confused this although we do feel it adds some useful context to our data. We have now removed the line you mention and agree that our conclusion now more clearly represents our study.</p>
                <p> </p>
                <p> 10.&#x00a0;
                    <italic>Figure is really good and the succinct messaging was appreciated.&#x00a0;</italic>
                </p>
                <p> </p>
                <p> Many thanks, we are pleased you found this helpful! Thank you very much also for each of your comments which we feel have helped us to improve this report.</p>
            </body>
        </sub-article>
    </sub-article>
</article>
