<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.165927.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Study Protocol</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Harmful health effects of e-cigarettes (vapes) and other non-tobacco oral nicotine products, trends in their use, and interventions: living protocol for a living evidence map and linked research digests</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: awaiting peer review]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Hollands</surname>
                        <given-names>Gareth J</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-0492-3924</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Shemilt</surname>
                        <given-names>Ian</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Sutcliffe</surname>
                        <given-names>Katy</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Stansfield</surname>
                        <given-names>Claire</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Sowden</surname>
                        <given-names>Amanda J</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Thomas</surname>
                        <given-names>James</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-4805-4190</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>EPPI Centre, UCL Social Research Institute, University College London, London, England, WC1H 0NS, UK</aff>
                <aff id="a2">
                    <label>2</label>Centre for Reviews and Dissemination, University of York, York, England, YO10 5DD, UK</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:gareth.hollands@ucl.ac.uk">gareth.hollands@ucl.ac.uk</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>20</day>
                <month>6</month>
                <year>2025</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2025</year>
            </pub-date>
            <volume>14</volume>
            <elocation-id>609</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>16</day>
                    <month>6</month>
                    <year>2025</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Hollands GJ et al.</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/14-609/pdf"/>
            <abstract>
                <p>There is a recognised need to further understand potential harms from the use of e-cigarettes and other non-tobacco oral nicotine products (ONPs), particularly among children and young people. This protocol describes a programme of work that aims to continually identify and classify the evolving international evidence base on the effects of these products on human health, trends in their use, and related interventions. In terms of its methods, we will produce and maintain a living evidence map, available in an online interactive format, and updated continually over the planned duration of the project (~5 years from registration). A wide range of electronic databases will be searched, with eligible articles including a focus on the use of e-cigarettes or ONPs in humans. Should satisfactory levels of machine performance be reached (by reference to human performance benchmarks), we intend to automate the bulk screening of articles for inclusion using Large Language Model (LLM) decisions. A similar approach will be applied to the automated coding of a range of characteristics of included articles, including their type of research, and the nature of harms and products being examined. In conjunction with the production of the living evidence map, we will produce regular descriptive surveillance reports (research digests) that will summarise the current contents of the map. Ongoing production and maintenance of this living evidence map and linked outputs will enable potential users &#x2013; including across research, policy, and charitable sectors &#x2013; to more efficiently establish an overview of the landscape of relevant research and surveil key developments.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>vaping; vapes; e-cigarettes; oral nicotine products; health; harms; living evidence map; evidence synthesis</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>NIHR</funding-source>
                    <award-id>NIHR200701</award-id>
                </award-group>
                <funding-statement>This work has been commissioned by the National Institute for Health Research (NIHR) Policy Research Programme (PRP) for the Department of Health and Social Care (DHSC). It is funded through the NIHR Policy Research Programme contract with the EPPI Centre at UCL (Reviews facility to support national policy development and implementation, NIHR200701). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the NIHR or the DHSC. We thank DHSC colleagues for their critical feedback throughout the development of this protocol. </funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>Introduction</title>
            <p>The development of this living evidence map is informed by the evolving research and policy landscape, both in the context of England and the United Kingdom (in which the work has been commissioned and will be conducted), and more widely. In this section we briefly summarise these considerations and the related scientific literature. We focus particularly on children, adolescents and young adults, as those groups are considered of highest priority in identifying emerging and escalating harms.</p>
            <sec id="sec2">
                <title>Trends in use of e-cigarettes (vapes) and other non-tobacco oral nicotine products</title>
                <p>Recent years, especially since 2021, have seen a marked increase in England in the use of e-cigarettes, also termed vapes or electronic nicotine delivery systems (ENDS) 
                    <xref ref-type="fn" rid="fn1">[1]</xref>.
                    <sup>
                        <xref ref-type="bibr" rid="ref1">1</xref>
                    </sup> Although the largest increases in persistent e-cigarette use have been seen in those with a history of regular smoking (reflecting their use as a smoking cessation tool), there has also been a substantial increase in adolescents and young adults, including those who have never smoked.
                    <sup>
                        <xref ref-type="bibr" rid="ref2">2</xref>
                    </sup> Prior to this relatively recent trend, e-cigarettes were mainly used by adults trying to quit smoking. While data from 2024 suggest that rates in 11-17 year olds appear to have now stabilised, levels of use remain significant, with 18% reporting having ever vaped and 7.2% reporting being current users.
                    <sup>
                        <xref ref-type="bibr" rid="ref1">1</xref>
                    </sup> This increase in prevalence has been linked to the wide range of single use (disposable) devices that have concurrently entered the market, as well as deliberately youth-friendly branding and advertising.
                    <sup>
                        <xref ref-type="bibr" rid="ref3">3</xref>
                    </sup> In recent survey data, more than half of those aged 11-17 who vape report doing so using a disposable device,
                    <sup>
                        <xref ref-type="bibr" rid="ref1">1</xref>
                    </sup> although following the announcement in January 2024 of an impending UK ban on disposable vapes, there has been a shift away from their use (from 63% to 35% amongst 16-to-24-year-olds).
                    <sup>
                        <xref ref-type="bibr" rid="ref4">4</xref>
                    </sup>
                </p>
                <p>Alongside e-cigarettes, an increasing array of other non-combustible and non-tobacco oral nicotine products (ONPs) is becoming available, including pouches, lozenges, tablets, gummies and gum.
                    <sup>
                        <xref ref-type="bibr" rid="ref5">5</xref>,
                        <xref ref-type="bibr" rid="ref6">6</xref>
                    </sup> Many of these ONPs use synthetic nicotine (i.e., not derived from tobacco). Aside from variants licensed and intended for use in nicotine replacement therapy in smoking cessation, such as some types of lozenges and gums, consumer ONPs (as is the case for e-cigarettes) have not typically been approved for therapeutic purposes. These products have also been marketed towards use by children and young people, both in terms of branding and advertising, as well as the product forms aligning with confectionery products and featuring appealing flavours. The use of nicotine pouches is being monitored in the Smoking Toolkit study
                    <sup>
                        <xref ref-type="bibr" rid="ref7">7</xref>
                    </sup> which surveys usage of tobacco and nicotine products in those aged 16 and over in England, with data from October 2024 reporting low but increasing usage of nicotine pouches (current prevalence of 0.9%) relative to e-cigarettes (12.7%).</p>
            </sec>
            <sec id="sec3">
                <title>Evidence of harmful health effects of use</title>
                <p>There is scientific consensus that the use of e-cigarettes and other ONPs is likely less harmful than is tobacco use, as well as strong evidence that they can be an effective smoking cessation tool for adult smokers.
                    <sup>
                        <xref ref-type="bibr" rid="ref8">8</xref>
                    </sup> However, there is also a growing literature documenting health harms. For example, a recent overview of reviews examining the potential harmful effects of e-cigarette use in people under 25 years old, found consistent associations between use and diagnosis or exacerbation of asthma, cough, depression, suicidal outcomes, and smoking, marijuana and alcohol use behaviours [Golder et al, unpublished report]. It is plausible that over time and with prolonged population use, incidence of known harms will escalate, and new, currently unknown harms will emerge. There are also many known potential harms for which there is currently a relative absence of evidence, including oral health, fertility, and brain development. Finally, the methodological quality of review-level evidence for harms of e-cigarette use has been assessed as of generally low quality suggesting that there is a need for continued development of the evidence base [Golder et al, unpublished report].</p>
            </sec>
            <sec id="sec4">
                <title>Current policy context in the United Kingdom</title>
                <p>The work outlined in this protocol was commissioned broadly concurrently with significant developments in related policy in the United Kingdom, principally the need to gain further understanding of potential harms from the use of e-cigarettes, particularly among children and young people given the recent rise in youth vaping. The Tobacco and Vapes Bill 2024-25 was introduced to Parliament in 2024, with its stated aim being to create a smoke-free UK. It includes measures to regulate vapes and nicotine to reduce their appeal and accessibility to children. It will ban the advertising and sponsorship of all vapes and other nicotine products, as well as provide powers to regulate the flavours, packaging and shop displays of these products to prevent them from being deliberately promoted to children. The Bill will also enable licensing schemes and related enforcement for the retail of tobacco, vapes and other nicotine products. At the time of writing, the Bill passed its second reading in the House of Lords on Wednesday 23rd March 2025 and is approaching committee stage. Royal Assent is expected to be reached by the end of this Parliamentary session.</p>
                <p>Further UK governmental policy work on vaping beyond the Tobacco and Vapes Bill includes the single-use ban and the Vaping Products Duty. Under separate environmental legislation, the Department for Environment, Food and Rural Affairs (DEFRA) have laid regulations that will ban the sale and supply of any single-use vapes from 1 June 2025.
                    <sup>
                        <xref ref-type="bibr" rid="ref9">9</xref>
                    </sup> The ban will come into force on the same day across England, Wales, Scotland and Northern Ireland. Additionally, at the Autumn Budget 2024, the UK Government announced the Vaping Products Duty will come into force in October 2026, introducing a flat-rate excise duty of &#x00a3;2.20 per 10 ml to all vaping liquids to discourage young people from taking up vaping.</p>
            </sec>
            <sec id="sec5">
                <title>Scope of this work</title>
                <p>Given its purpose to support policy development concerning actions to reduce or mitigate the potential harms of using e-cigarettes and other ONPs, this living evidence map will principally seek to describe the extent and nature of existing research that directly examines health impacts. However, its scope will also encompass key related areas, including evidence of trends in the use of e-cigarettes and ONPs including relationships with the use of tobacco products (e.g. in general use or as a smoking cessation aid); evidence of the public&#x2019;s perceptions of and discourse around the potential harmful effects of these products; and evidence on interventions targeting e-cigarette and ONP use. In parallel to other consumable products (most obviously tobacco products), a wide variety of interventions and policies may be applied to such products, and these can be categorised in many ways. A key commonly-drawn dimension is whether interventions are: i) targeted at or delivered directly to individuals or groups, or ii) are population-level interventions delivered at scale. The former includes pharmacological and behavioural support interventions.
                    <sup>
                        <xref ref-type="bibr" rid="ref10">10</xref>
                    </sup> The latter includes economic interventions such as taxes
                    <sup>
                        <xref ref-type="bibr" rid="ref11">11</xref>
                    </sup> and interventions that target physical environments at both micro and macro scales,
                    <sup>
                        <xref ref-type="bibr" rid="ref12">12</xref>
                    </sup> including those that alter the characteristics of products and related marketing and promotional activities.
                    <sup>
                        <xref ref-type="bibr" rid="ref13">13</xref>,
                        <xref ref-type="bibr" rid="ref14">14</xref>
                    </sup> Such interventions can be implemented within or outwith formal regulatory or legislative contexts.
                    <sup>
                        <xref ref-type="bibr" rid="ref15">15</xref>
                    </sup>
                </p>
            </sec>
        </sec>
        <sec id="sec6">
            <title>Overall purpose and aims</title>
            <p>The primary purpose of this living evidence map is to support ongoing policy development processes in the United Kingdom that concern addressing potential harmful health impacts of the use of e-cigarettes and other non-tobacco ONPs, particularly in relation to children and young people. It will enable potential users - including stakeholders involved in commissioning this research, but also from wider government, research, policy, healthcare professional, and charitable sectors &#x2013; to surveil the evolving international evidence base and more efficiently establish an understanding and overview of the landscape of relevant research, including its key characteristics. It will also underpin a linked wider programme of work including a suite of systematic reviews or other evidence syntheses. Given its intention to support policy development around harms of these products, the map principally seeks to describe the extent and nature of existing research that directly examines harmful health effects, but it will also encompass key cognate areas of the literature concerning trends in the use of these products, and interventions. Production of the map will be semi-automated (i.e. combining human and machine effort), with the intention to incrementally increase the degree of automation as far as is practicable. Potential benefits of increasing automation include enabling manual resources that are saved to instead be deployed towards additional aspects of map production or linked outputs, and substantial automation could increase the likelihood of the map being able to remain updated beyond the current timescale. It will be published as an open-access, online, interactive web database, and is initially intended to be produced and updated for a period of five years upon initial registration of this protocol.</p>
            <p>The specific aims of the living map are as follows:
                <list list-type="roman-lower">
                    <list-item>
                        <label>i)</label>
                        <p>To continually identify and classify the evolving international evidence base of research studies on the effects of e-cigarette and other non-tobacco oral nicotine product use on human health;</p>
                    </list-item>
                    <list-item>
                        <label>ii)</label>
                        <p>To directly inform the production of regular descriptive surveillance reports (termed &#x2018;research digests&#x2019;) over its duration that describe how the evidence base is evolving, including identification of emerging phenomena and of evidence gaps;</p>
                    </list-item>
                    <list-item>
                        <label>iii)</label>
                        <p>To periodically support the efficient identification of evidence to be used in the conduct of systematic reviews or other evidence syntheses for prioritised research questions.</p>
                    </list-item>
                </list>
            </p>
            <p>This protocol focuses mainly on the production of the living evidence map (i.e. Aim i), and to a lesser extent on the linked regular surveillance reports (&#x2018;research digests&#x2019;) (i.e. Aim ii). In the section 
                <italic toggle="yes">&#x2018;Additional evidence synthesis outputs&#x2019;</italic> we also outline how we anticipate the map will be used in relation to Aim iii. Because the nature of the intended outputs linked to Aim iii (systematic reviews or other evidence syntheses) is not yet specified and will be developed in consultation with stakeholders and reflecting evolving policy priorities, we will subsequently develop specific protocols to address this aspect.</p>
        </sec>
        <sec id="sec7" sec-type="methods">
            <title>Methods</title>
            <p>We will produce a living evidence map to continually identify and classify the evolving body of published research evidence on the health impacts of e-cigarettes and other emerging non-tobacco oral nicotine products, and related bodies of evidence on trends in their use, and on interventions. Evidence maps are systematic and visual representations of the availability of evidence given a particular focus or domain relevant to a research question
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>,
                    <xref ref-type="bibr" rid="ref17">17</xref>
                </sup> and provide users with both a view of the broad research landscape and the possibility to focus on individual records of research studies [Shemilt et al, unpublished report]. They commonly consist of a framework of primary dimensions (rows and columns) and secondary dimensions as a set of filters, enabling exploration of the map&#x2019;s contents. Additionally, sectors of the map can be delineated to focus on specific topics or subsets of the overall map contents.</p>
            <p>The &#x2018;living&#x2019; aspect (of &#x2018;living evidence map&#x2019;) reflects our intention to keep this map continually updated with new research studies as they are published and to republish updated versions of the map at regular intervals during the project lifespan [Shemilt et al, unpublished report]. It also reflects the likelihood that key characteristics of the body of research included in the map may evolve over its lifetime, thus requiring changes in the scope of the map and how the evidence it contains is classified. Similarly, the purpose and aims of the map may evolve over time due, for example, to changes in the policy landscape it is designed to inform. Finally, the methods and procedures used to produce the map may also evolve based, for example, on embedded evaluations of automation tools that will be developed and deployed to assist its production. Correspondingly, this protocol is considered a living document and may be re-published in an updated separate version to incorporate any substantive changes to the protocol in the lifetime of the map. Any such potential changes will be discussed with commissioners prior to commencing production of each version of the living map.</p>
            <p>The proposed methods for the living map, including our judgement that large-scale automation of screening and data extraction processes is likely feasible, have been informed by an initial exploratory developmental phase that involved production of, and collaborative discussion focused on, a rapid semi-automated evidence map [Hollands et al, unpublished report].</p>
            <sec id="sec8">
                <title>Eligibility criteria</title>
                <p>The following criteria will determine whether reports of studies are included or excluded from the living evidence map:</p>
                <p>

                    <bold>Population</bold>: Humans, with an inclusive scope across children, adolescents and adults. It is noted that while there is currently particularly high policy interest in impacts on children, adolescents and younger adults (e.g. under 25 years of age), we do not at present intend to limit inclusion in the map to evidence that focuses on these groups (by for example, limiting the map to research that focuses solely, or to at least some extent, on children and young people). We will exclude reports of studies in animals and in vitro or other types of studies that lack evaluation or assessment in humans.</p>
                <p>

                    <bold>Exposure, intervention, or topic focus:</bold> Use of e-cigarettes (i.e. nicotine and non-nicotine vapes or vaporisers or electronic nicotine delivery systems (ENDS)) or other non-tobacco oral nicotine products (ONPs) (e.g. nicotine pouches, lozenges, tablets, gummies, gum, spray). For reports of intervention studies, we will include any intervention or policy that explicitly aims to alter the use of these products. These may aim to reduce the use of, or the harms linked directly to, e-cigarettes and ONPs, or aim to increase use of these products whether for therapeutic (e. g. smoking cessation) or other reasons, such as commercial promotional activities or alterations to product design to increase appeal and use.</p>
                <p>

                    <bold>Outcomes:</bold> Any quantitative or qualitative measure or assessment of e-cigarette or ONP use, or of any health effects or harms that are directly or causally linked to e-cigarette or other ONP use (either as specified or as is considered plausible). This encompasses those relating to physical health (such as concerning respiratory, cardiovascular, oral, and neurological/developmental harms, as well as injuries and accidents), mental health (including depression, anxiety, and suicide), and behavioural impacts on substance use. The latter includes effects on concurrent or subsequent use of other nicotine and tobacco products (e.g. cigarette smoking, or the use of oral and heated tobacco products), as well as of alcohol and other recreational drugs including the vaping of cannabis. We will also include quantitative or qualitative measures of perceptions of the harms of e-cigarette or ONP use.</p>
                <p>

                    <bold>Study designs:</bold> We will include all empirical research and will not limit inclusion by study design. We will include both primary and secondary research (e.g. systematic reviews) designs. Given an intended function of the map is to aid in identifying emerging phenomena related to harms, we will include descriptive designs considered to be less methodologically robust, such as case reports and case studies, but which may provide useful early evidence. We will exclude non-empirical research papers including commentaries, editorials, and non-systematic reviews.</p>
                <p>

                    <bold>Publication types:</bold> Peer-reviewed journal articles published since 2003 (the year in which e-cigarettes became commercially available, preceding their estimated entry into Europe in 2005
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>
                    </sup>) will be included, including those reporting protocols of otherwise-eligible empirical research. We will exclude preprints, commentaries, editorials, correspondence, conference abstracts, theses and dissertations. We will limit to English language reports only due to both the substantial numbers of records to be processed (any of which may require additional manual reading and oversight) and our intent to extensively use automated processes that may perform differently dependent on the language of the text.</p>
            </sec>
            <sec id="sec9">
                <title>Identifying the evidence</title>
                <p>Initially, the following electronic databases will be searched, containing scholarly research across health care, behavioural and social sciences and multi-disciplinary fields. The following list may be modified over the course of the map&#x2019;s development subject to evaluation of how effectively these sources contribute to identification of eligible reports:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Applied Social Sciences Index and Abstracts (ASSIA) (ProQuest)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>CINAHL (EBSCO)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Cochrane Library - Databases of Systematic Reviews and controlled trials</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Database of promoting health effectiveness reviews (DoPHER)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Embase (OVID)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Emerging Sources Citation Index (Web of Science)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Epistemonikos</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Health Management Information Consortium (OVID)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>MEDLINE (OVID)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>OpenAlex</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>PsycInfo (OVID)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Science Citation Index (Web of Science)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Social Science Citation Index (Web of Science)</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>The Trials Register of Promoting Health Interventions (TRoPHI)</p>
                        </list-item>
                    </list>
                </p>
                <p>The search strategies for the full set of databases will be developed in collaboration with an Information Specialist. The MEDLINE search terms have been informed by those published for other relevant reviews,
                    <sup>
                        <xref ref-type="bibr" rid="ref10">10</xref>,
                        <xref ref-type="bibr" rid="ref19">19</xref>,
                        <xref ref-type="bibr" rid="ref20">20</xref>
                    </sup> [Golder et al, unpublished report]. This initial search will involve conventional Boolean searching using terms for e-cigarettes and non-tobacco oral nicotine products. It will exclude animal-only studies and records classed as preprints, commentaries, editorials, correspondence, conference abstracts, theses and dissertations. We will use a range of topic relevant terms and synonyms and search the title and abstract fields of records as well as controlled vocabulary within individual databases, such as Medical Subject Headings (MeSH).</p>
                <p>OpenAlex is an open-access knowledge graph comprising ~250 million bibliographic records of research articles (reports) from across science, connected in a large network graph of conceptual, citation and other (e.g. author) relationships. OpenAlex is automatically and continuously updated with new records as new research reports are published online. We have primarily developed OpenAlex tools in EPPI Reviewer
                    <sup>
                        <xref ref-type="bibr" rid="ref21">21</xref>
                    </sup> to perform regular automated searches of the OpenAlex knowledge graph to support continual, semi-automated updating of living evidence maps and living systematic reviews. OpenAlex tools enable three different kinds of searches of the OpenAlex knowledge graph: custom search, network graph search and auto-update search. Custom search features will first be used to run the Boolean search of OpenAlex as part of the initial search described above, and we will investigate options of using focused or sensitive Boolean searches of this source.</p>
                <p>Subsequently, our continual updating searches will comprise all three kinds of OpenAlex searches: custom search (updated), network graph search, and auto-update search. A network graph search will retrieve all records that are connected, in OpenAlex, to a specified set of &#x2018;seed&#x2019; records, via a specified set of network graph relationships, on the date of the search. Specified &#x2018;seed&#x2019; records will be the accumulating corpus of unique eligible reports already selected for inclusion in the map (which have either been retrieved from OpenAlex or matched to a corresponding OpenAlex record from another source database record). Specified network graph relationships will be: (a) one-step forwards (i.e. records that cite &#x2018;seed&#x2019; records) or backwards (records that are cited by &#x2018;seed&#x2019; records) citation relationships (i.e. equivalent to citation searching); and (b) a one-step forwards (&#x2018;recommended by&#x2019; seed records) &#x2018;related publications&#x2019; relationship 
                    <xref ref-type="fn" rid="fn2">[2]</xref>. An auto-update search will likewise be &#x2018;seeded&#x2019; by the accumulating set of unique eligible reports already selected for inclusion in the map. These &#x2018;seed&#x2019; records will be subscribed to our novel machine learning &#x2018;recommender&#x2019; model (the &#x2018;auto-update model&#x2019;),
                    <sup>
                        <xref ref-type="bibr" rid="ref22">22</xref>
                    </sup> which will automatically score all records (reports) newly added to the OpenAlex dataset each ~1 month in its &#x2018;snapshots&#x2019; and recommend those most likely to be eligible for inclusion in this map. We will select the top 250 ranked records by auto-update model score from each &#x2018;snapshot&#x2019;. Initially, we will run updated custom and network graph searches, and import records from all three kinds of OpenAlex searches into EPPI Reviewer, every four months, i.e. at the beginning of each updating cycle, following the publication of each updated version of the map.</p>
            </sec>
            <sec id="sec10">
                <title>Selection procedure</title>
                <p>Each time the initial database or continual updating searches are run, all bibliographic records will be imported into EPPI Reviewer. Any records of articles published before 1st January 2003 will be removed. Duplicates (both within the set of searches, and in relation to records already existing in the map) will be semi-automatically identified and discarded using &#x2018;manage duplicates&#x2019; tools. The process for then selecting eligible records for inclusion in the map is as follows.</p>
                <p>First, in a pilot phase, in order to inform development of operationalisations of our eligibility criteria that are able to be applied consistently, a random sample of 100 title-abstract records (and corresponding full-text reports when needed) drawn from the full search results will be screened for inclusion/exclusion by two human reviewers independently and their decisions compared and discussed to reach final decisions. Additional samples of 100 records (and corresponding full-text reports) will be screened by both reviewers until a high degree of agreement on inclusion/exclusion decisions (90% or more) is achieved. At this stage, we will also discuss any apparent &#x2018;borderline&#x2019; eligibility examples. The objectives of the pilot phase will be to identify revisions to screening codes, as well as to foster consistency between researchers, thus ensuring we apply criteria and screening processes that minimise the exclusion of potentially important records and minimise inclusion of clearly irrelevant records.</p>
                <p>Second, manual screening will be undertaken by one trained researcher (&#x2018;single screening&#x2019;) to provide a set of records for use when developing and evaluating a subsequent automated screening workflow. For this, a set of title-abstract (plus corresponding full-text article) records &#x2013; comprising a minimum of 1000 records - will be drawn from the full search results at random and screened to assess eligibility, with the further option of referring records for a &#x2018;second opinion&#x2019; if eligibility is judged uncertain. &#x2018;Second opinions&#x2019; will be resolved by team discussion and consensus, involving two or more researchers (including the original screener). We will aim to retrieve and upload corresponding full-text articles (usually PDFs) for each of these records (reports) using a manual search via the DOI or OpenAlex link in each record. The set of human-screened title-abstract (and corresponding full-text article) records will then be considered the (quasi) &#x2018;gold-standard&#x2019; benchmark for assessing performance of subsequent automated inclusion/exclusion screening, and will enable calculation of metrics such as % agreement and inter-rater reliability metrics that adjust for chance in agreements of inclusion and exclusion decisions (for example, Cohen&#x2019;s kappa). While we are not necessarily aiming for such a stringent overall kappa value when assessing performance, the benchmark sample size of &#x2265;1000 is justified based on the formula for the standard error of kappa with the aim to achieve a kappa of at least 0.9 (typically interpreted as almost perfect agreement), with a conservative assumed base rate of 75% of records being included 
                    <xref ref-type="fn" rid="fn3">[3]</xref>, and with a confidence interval no wider than 0.05 to exclude the possibility of any less than strong agreement.
                    <sup>
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup> This benchmark sample size also exceeds sample sizes typically used in inter-rater agreement studies.
                    <sup>
                        <xref ref-type="bibr" rid="ref24">24</xref>
                    </sup>
                </p>
                <p>Third, for developing and evaluating an automated screening workflow, in accordance with a standard procedure,
                    <sup>
                        <xref ref-type="bibr" rid="ref25">25</xref>
                    </sup> the overall set of manually screened records and their corresponding screening meta-data will be split into three samples of different sizes and compositions, using stratified random assignment. We will develop a series of Large Language Model (LLM) prompts to elicit machine inclusion/exclusion screening decisions via ChatGPT 4o 
                    <xref ref-type="fn" rid="fn4">[4]</xref>
                    <sup>
                        <xref ref-type="bibr" rid="ref26">26</xref>
                    </sup> functionality embedded within EPPI Reviewer software.
                    <sup>
                        <xref ref-type="bibr" rid="ref21">21</xref>
                    </sup> The first sample will be used in early rounds of developing these LLM prompts, aimed at identifying a set of prompts (with or without a decision algorithm) that maximises recall as much as possible (with a target of 0.95 recall). The second sample will be used to further develop and finalise the set of prompts (with or without a decision algorithm), aimed at maximising precision without compromising recall in relation to the approximate level attained in the first sample. The third sample will be used to evaluate the finalised set of prompts (with or without a decision algorithm).</p>
                <p>Should we achieve satisfactory performance for automated inclusion/exclusion screening, we intend to subsequently automate the bulk screening of all records that are identified by searches, to determine their inclusion into or exclusion from the map. If we are unable to automate screening satisfactorily then we will amend the protocol accordingly to employ an alternative workflow for screening that applies a greater degree of manual screening and oversight (i.e. a semi-automated workflow). Furthermore, should there be any substantive changes to our planned processes in the lifetime of the map, that suggest that we can no longer consider our corroboration of this screening process to be valid, a comparable testing process will be newly conducted. Such possible substantive changes could involve, for example, alterations of inclusion/exclusion criteria or the nature of the search strategies, or advances or other changes in the computing technologies we deploy. As previously mentioned, reflecting that this document is a living protocol, we will also consider whether any such changes made to our processes merit publishing an updated version of this protocol.</p>
                <p>In addition, once we have accumulated a sufficient number of manual screening decisions, we will investigate training, calibrating, evaluating and (contingent on evaluated performance) deploying a binary machine learning classifier, designed to distinguish between records (reports) of eligible (included) and ineligible (excluded) studies, using machine learning tools in EPPI Reviewer. This classifier would be calibrated and deployed to automatically exclude (discard) further retrieved records (reports) prior to screening, reducing the numbers of records to be screened with minimal risk of losing relevant potentially eligible reports.</p>
            </sec>
            <sec id="sec11">
                <title>Classifying the evidence</title>
                <p>We will aim to classify included reports in relation to the following eight characteristics, each represented by sets of coding options, and hereforth termed &#x2018;code sets&#x2019;. The code sets below are provisional and illustrative, being informed by initial discussions with commissioners, rapid exploratory mapping work to feed into those discussions, and examination of relevant literature such as existing systematic reviews of evidence on e-cigarette harms. The formulation and categorisation of the characteristics and code sets that we focus on may evolve over the lifetime of the map. Developments to code sets may stem from the map&#x2019;s contents (e.g. new categorical distinctions emerging as new evidence is encountered, or improved operationalisations arising from resolving queries and inconsistencies) or from top-down or external influences (e.g. applying new conceptual knowledge as it is encountered via wider discussion, or changes in research and policy landscapes and priorities).</p>
                <p>

                    <bold>Code set 1 - Broad focus or topic</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Direct effects or harms of e-cigarette or ONP use (excluding smoking/tobacco product use)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Longitudinal trends in e-cigarette or ONP use and/or its relationship with concurrent or subsequent smoking/tobacco product use</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Public discourse or perceptions concerning effects or harms of e-cigarette or ONP use</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Effects of interventions or policies to reduce or increase e-cigarette or ONP use</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>Code set 2 - Effects or harms of e-cigarette or ONP use</bold> 
                    <italic toggle="yes">(where relevant - coding applied only to those coded in 1(Broad focus or topic) as category &#x2018;Direct effects or harms of e-cigarette or ONP use&#x2019;)</italic>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Respiratory (e.g. lung injury, asthma etc)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Cardiovascular</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Cancer</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Immune/allergy</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Injuries</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Oral health</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Fertility</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Pregnancy and perinatal</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Infectious disease</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Mental health</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Biological/physiological/cellular</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Substance use (excluding smoking/tobacco product use)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Long-term population-level impacts (e.g. mortality)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Other (specify)</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>Code set 3 - Broad class of research</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Primary research report</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Study protocol</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Systematic review or other evidence synthesis</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>Code set 4 - Product focus</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>E-cigarettes (nicotine and non-nicotine)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Nicotine pouches</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Gummies</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Gum</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Lozenges</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Tablets</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Spray</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>Code set 5 - Population</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Exclusively children and/or adolescents (&lt;18 years)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Population includes, or is exclusively, adults (18+ years)</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>Code set 6 - Country</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>UK</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Non-UK Europe</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>USA</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>
Canada</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Mexico</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>
Australia</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>
New Zealand</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>
China</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Japan</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Other (specify)</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>Code set 7 - Detailed type of intervention or policy to reduce or increase e-cigarette or ONP use</bold> 
                    <italic toggle="yes">(where relevant - coding applied only to those coded in 1(Broad focus or topic) as category &#x2018;Effects of interventions or policies to reduce or increase e-cigarette or ONP use&#x2019;)</italic>
                </p>
                <p>

                    <bold>

                        <italic toggle="yes">Individually/group delivered to reduce use</italic>
</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Pharmacological</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Behavioural support</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>

                        <italic toggle="yes">Population-level delivered to reduce use</italic>
</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Economic/fiscal (with or without legislation or regulation)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Physical environmental including characteristics of products and (non-economic) promotions (with or without legislation or regulation)</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>

                        <italic toggle="yes">Individually/group delivered to increase use (e.g. for therapeutic or marketing purposes)</italic>
</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Pharmacological</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Behavioural support</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>

                        <italic toggle="yes">Population-level delivered to increase use (e.g. for therapeutic or marketing purposes)</italic>
</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Economic/fiscal (with or without legislation or regulation)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Physical environmental including characteristics of products and (non-economic) promotions (with or without legislation or regulation)</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>Code set 8 - Detailed type of study design (supplementing code set 3)</bold> 
                    <xref ref-type="fn" rid="fn5">[5]</xref>
                </p>
                <p>

                    <bold>

                        <italic toggle="yes">Primary research</italic>
</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Cross-sectional survey</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Other descriptive (e.g. qualitative, case study or case report)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>RCT (i.e. control/comparison to a group(s) who do not receive intervention for vaping cessation), including cluster-randomised</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Longitudinal design (e.g. simple pre/post comparison, interrupted time series, cohort or repeat cross-sectional)</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Other quasi-experimental design (e.g. non-randomised controlled trial, controlled before-and-after)</p>
                        </list-item>
                    </list>
                </p>
                <p>

                    <bold>

                        <italic toggle="yes">Secondary research</italic>
</bold>

                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Systematic review</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Overview of reviews</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Evidence map</p>
                        </list-item>
                    </list>
                </p>
                <p>We intend to automate the classification (coding) of included reports, using a similar approach to that applied for automating screening to determine inclusion into the map. For each code set, in an initial pilot phase, we will develop mutually exclusive codes that are considered both appropriately granular to be useful and sufficiently comprehensive to apply to the range of research we encounter. When developing code sets, records will initially be coded in increments of ~5-10 articles by two reviewers working independently. Further increments of articles will be extracted by both reviewers until no substantive changes to the coding structure are required to accommodate the evidence, and agreement is maximised as far as possible. For developing and evaluating the automated coding workflow, a similar corroboration process will be used for as is described for screening (in &#x2018;Selection procedure&#x2019;), albeit less extensive, in part because we consider the accuracy of coding to be of a lower relative priority than determining the accuracy of screening. This is because errors in screening can result in records being lost permanently from the map&#x2019;s confines, while errors in coding will not prevent the record from remaining findable in the overall map (such as when the map&#x2019;s contents are searched or explored in different ways) and may be relatively minor for any given record (e.g. an error in relation to one code set only). Furthermore, coding of each record&#x2019;s many characteristics will likely require more human effort per record than will screening, meaning generating benchmark samples of manually-coded records will be more resource-intensive. The combination of these factors is reflected in each code set that we develop and apply being evaluated in relation to a smaller manually-coded benchmark sample, the size of which will be contingent on the time available and observed inclusion rates, but including a minimum of 100 records which, if possible, will include at least some examples of each code within the given code set. The levels of agreement for the automated coding workflow &#x2013; which may vary substantially between the code sets - will be reported to allow the map&#x2019;s users to judge the likely reliability of its classifications. As for screening processes (see &#x2018;Selection procedure&#x2019;), should we make changes to our automated coding processes that mean that we can no longer have sufficient confidence in our prior testing of them, we will conduct further tests for corroboration purposes.</p>
                <p>We will initially prioritise effort towards developing and implementing code sets 1-3 which are considered to be of immediate priority as well as likely to be highly feasible to code given current tools. We intend to incrementally implement further code sets using a similar process and corroborate the performance of automating each. We will also consider supplementing the outlined standard processes of identifying evidence by populating the map with additional key exemplar papers as identified by the research team, collaborators, and advisory team, and related academic and policy networks, particularly in the early stages of its development before the existing literature is comprehensively represented via the standard processes. Once an initial version of the map (v1) is complete and functioning as expected, we will seek and address feedback from stakeholders &#x2013; including in relation to the map&#x2019;s content as well as its presentation or useability - and proceed to develop further updated versions on a regular basis (3 times a year i.e. approximately every 4 months 
                    <xref ref-type="fn" rid="fn6">[6]</xref>).</p>
                <p>Implementing the protocol as currently described depends on whether we are able to substantially automate the map, and on our current understanding of its likely scope. However, if, for example, a lesser degree of automation proves possible than is anticipated (in which case we will consider whether additional manual coding is possible and justified, including relative to its likely importance to users), or ongoing input from stakeholders (including the wider research team, the Scientific Advisory Panel (SAP), and the commissioners of this work) prompts changes in the map&#x2019;s scope or content, then the outlined procedures may necessarily change to reflect changing priorities and resources. Any substantial deviations from the current version of the protocol will be recorded in updated versions of the protocol.</p>
            </sec>
            <sec id="sec12">
                <title>Production of linked research digests</title>
                <p>In conjunction with the production of the living evidence map, we will produce regular descriptive surveillance reports (research digests) three times a year i.e. approximately every 4 months, reflecting the planned frequency of updates of the map itself. These research digests will consist of a standardised basic report to summarise the current contents of the living evidence map. While the exact content and format of these reports will develop iteratively in consultation with commissioners of this review and other stakeholders, we anticipate it will principally tabulate frequencies of data and correspondingly describe the nature of the evidence as follows.</p>
                <p>In a series of tables, we will tabulate and cross-tabulate frequencies of reports included in the map, and the data extraction codes that have been applied to them (i.e. with each code set providing a categorical variable(s)). Coding data will be systematically presented for all code sets individually (see &#x2018;Classifying the evidence&#x2019; for these proposed code sets), supplemented by selected cross-tabulations of code sets deemed to be of highest priority or interest.</p>
                <p>Taking code sets 1-5 as illustrative examples, this could involve reporting, in a series of tables, the numbers of reports that focused broadly on direct effects or harms (relative to other broad types of reports), which harms those reports focused on, how many were primary research, how many focused on e-cigarettes, and how many focused on children and adolescents. Cross-tabulations of these data in additional tables would therefore allow, for example, identification of how many primary research reports focused on respiratory harms in children and adolescents linked to e-cigarette use. Tables will be accompanied by narrative explanation of the numbers, including highlighting notably large or emerging clusters of reports with particular combinations of characteristics, or their absence (i.e. apparent evidence gaps). Additional complementary information could be derived from direct comparison to the comparable data in previous reports, thus enabling mapping of gradual trends in the development of the evidence base, or the initial appearance of new clusters of evidence.</p>
            </sec>
            <sec id="sec13">
                <title>Additional evidence synthesis outputs</title>
                <p>The continual production of the living evidence map (and corresponding research digests) will also underpin and inform a linked wider programme of less frequent but more detailed evidence synthesis work. Because the nature of the intended outputs linked to our Aim iii (systematic reviews or other evidence syntheses) is not yet specified and will be developed in consultation with stakeholders and reflecting evolving policy priorities, we will subsequently develop specific protocols to address these aspects. However, here we provide a brief indication of how we anticipate this aspect could develop.</p>
                <p>At approximately 12-month intervals, we will produce a report of a systematic review or other evidence synthesis that will likely involve drawing substantially (but not necessarily exclusively) on evidence from the map. The research questions to be examined will be informed by current policy priorities as well as the contents of the map, and collectively agreed with the commissioners of the review. As illustration, the types of more detailed evidence synthesis outputs presented in these reports could include:
                    <list list-type="bullet">
                        <list-item>
                            <label>-</label>
                            <p>Formal systematic or rapid reviews if, for example, there was a) a clear and important policy question, and the map&#x2019;s contents suggested the existence of b) a coherent body of relevant studies, and c) an evidence base of manageable scope and size. The living evidence map could both help to corroborate b) and c), as well as support rapid and efficient identification of at least some of the relevant evidence in conducting an agreed review</p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>Higher-level or overarching evidence synthesis products such as interactive evidence portal(s) directly stemming from the contents of the map and with some additional assessment of evidence strength, summarising agreed key aspects of the map&#x2019;s contents but without requiring end users to engage with the underlying studies
                                <sup>
                                    <xref ref-type="bibr" rid="ref27">27</xref>
                                </sup>
                            </p>
                        </list-item>
                        <list-item>
                            <label>-</label>
                            <p>More detailed additional coding, assessment and/or synthesis of evidence within specific priority aspects or areas of the living map itself</p>
                        </list-item>
                    </list>
                </p>
                <p>In supporting the development of these kinds of more detailed evidence synthesis outputs, the living evidence map could help identify viable research questions from observing noteworthy clusters of evidence. Furthermore, should a research question be developed independently of the map, the map could then allow us to ascertain whether any proposed evidence synthesis activities are likely able to draw on sufficient evidence to make them feasible and useful. In principle the existence of an up-to-date map should therefore reduce the likelihood of spending undue time reviewing in detail parts of the map (or aspects of research questions) that have already been well addressed by previous research, or of conducting uninformative or inefficiently-focused reviews of few studies. A final key benefit of a living evidence map is that it should increase efficiency in conducting any subsequent evidence syntheses. While it will not guarantee absolute comprehensiveness i.e. containing all eligible records pertaining to a given evidence synthesis or research question, it is likely that at least a substantial proportion of the relevant evidence will already be contained within the map and so will also have been annotated with information about its characteristics. Such bodies of known and annotated evidence will therefore provide a strong foundation to support subsequent evidence syntheses.</p>
            </sec>
            <sec id="sec14">
                <title>Stakeholder engagement</title>
                <p>The work described in this protocol will be developed in an ongoing collaboration with commissioners in The Department of Health and Social Care (DHSC). The nature of this collaboration will develop iteratively but we anticipate will involve regular meetings to discuss progress and resolve issues that arise with the living map as well as the development of future linked outputs. Feedback will also be sought on whether any changes to the scope and policy relevance of the map or linked digests (and relatedly to the protocol) may be necessary. Regular meetings will typically coincide with the timing of the production cycle of living map updates and linked digests (i.e. approximately every four months).</p>
                <p>Additionally, we will convene a Scientific Advisory Panel (SAP) with a membership external to both the research team and to DHSC. Its membership is yet to be confirmed and will be subject to agreement with DHSC, but the expectation is that it will comprise at least two academic researchers active in e-cigarette and/or relevant smoking-related research, and at least one member each from: i) a relevant charity or other third-sector organisation, and ii) the wider public (i.e. not employed in a role in this area), with all members ideally having a high level of knowledge or direct experience of the product landscape, related trends, or the relevant scientific literature particularly in the context of England and/or the wider UK. The purpose of the SAP will be to generally advise and respond to the research team&#x2019;s requests for feedback in their capacity as topic experts in relation to the focus of the map. This will include identifying whether there are new products or trends the map will need to pick up (as this is a rapidly evolving area), discussing specific technical queries arising from the living evidence map or linked outputs (e.g. whether specific boundary examples of reports should be deemed to meet our inclusion criteria, or how specific reports should most appropriately be categorised within our coding structure), and providing feedback on the general useability (e.g. accessibility, presentation and functioning) of the map itself. Such discussions will also likely involve discussion of the structure of the map and its coding schemes and whether they could be further optimised by, for example, reconfiguring categories, and making clarifications or changes to the wording of terms or definitions. More specific terms of reference (e.g. if regular SAP group meetings will be held and if so, how often, and/or if feedback will be sought largely on an ad hoc individual basis only) will be developed in discussions with DHSC and the members of the SAP.</p>
            </sec>
            <sec id="sec15">
                <title>Dissemination activities</title>
                <p>We envisage the map may be useful to multiple potential audiences and users including stakeholders directly involved in commissioning and developing the planned research, as well as wider research, policy, practitioner, and charitable sector communities. Therefore, beyond the directly commissioned outputs, we intend to disseminate the existence of this work through academic and other stakeholder networks including presentations and social media posts. We will also consider producing academic articles (e.g. describing the methodological development processes or aspects of the map&#x2019;s content).</p>
            </sec>
            <sec id="sec16">
                <title>Equity considerations</title>
                <p>Although this project does not include a specific focus on equity issues, we have planned to extract and report equity-related data on population characteristics as follows. First, in the living evidence map, we plan to classify (code) included studies in terms of the degree to which their populations involve children and/or adolescents (&lt;18 years). Second, in our linked research digests, we will report the latter data as part of our plan to present coding data for all code sets. This approach to considering equity issues in this project was informed by, and aligns with, developing EPPI Centre guidance on this topic.
                    <sup>
                        <xref ref-type="bibr" rid="ref28">28</xref>
                    </sup>
                </p>
            </sec>
        </sec>
        <sec id="sec17">
            <title>Ethical issues relating to this work</title>
            <p>This is secondary research that only uses existing articles and with no new data being collected.</p>
        </sec>
        <sec id="sec18">
            <title>Study registration</title>
            <p>The protocol for the living evidence map will be registered on the Open Science Framework at 
                <ext-link ext-link-type="uri" xlink:href="https://osf.io/8qbwv/">https://osf.io/8qbwv/</ext-link>.</p>
        </sec>
        <sec id="sec19">
            <title>Software availability</title>
            <p>Not applicable for this article.</p>
        </sec>
    </body>
    <back>
        <sec id="sec22" sec-type="data-availability">
            <title>Data availability</title>
            <p>No data are associated with this article.</p>
        </sec>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="other">
                    <collab>Action on Smoking and Health</collab>:
                    <article-title>Use of vapes (e-cigarettes) among young people in Great Britain (ASH Fact Sheet; July 2024).</article-title>
                    <year>2024</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://ash.org.uk/uploads/Use-of-vapes-among-young-people-in-Great-Britain-2024.pdf?v=1738083753">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jackson</surname>
                            <given-names>SE</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tattan-Birch</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shahab</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Trends in long term vaping among adults in England, 2013-23: population based study.</article-title>
                    <source>

                        <italic toggle="yes">BMJ.</italic>
</source>
                    <year>2024</year>;<volume>386</volume>:<fpage>e079016</fpage>.
                    <pub-id pub-id-type="doi">10.1136/bmj-2023-079016</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="other">
                    <collab>Office for Health Improvement &amp; Disparities</collab>:
                    <article-title>Youth vaping: call for evidence analysis.</article-title>
                    <year>2023</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.gov.uk/government/calls-for-evidence/youth-vaping-call-for-evidence/outcome/youth-vaping-call-for-evidence-analysis">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jackson</surname>
                            <given-names>SE</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shahab</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tattan-Birch</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Changes in vaping trends since the announcement of an impending ban on disposable vapes: A population study in Great Britain.</article-title>
                    <source>

                        <italic toggle="yes">Addiction.</italic>
</source>
                    <year>2025</year>.
                    <pub-id pub-id-type="doi">10.1111/add.70057</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cornacchione Ross</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kowitt</surname>
                            <given-names>SD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rubenstein</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Prevalence and correlates of flavored novel oral nicotine product use among a national sample of youth.</article-title>
                    <source>

                        <italic toggle="yes">Addict. Behav.</italic>
</source>
                    <year>2024</year>;<volume>152</volume>:<fpage>107982</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.addbeh.2024.107982</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dennison Himmelfarb</surname>
                            <given-names>CR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Benowitz</surname>
                            <given-names>NL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Blank</surname>
                            <given-names>MD</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Impact of Smokeless Oral Nicotine Products on Cardiovascular Disease: Implications for Policy, Prevention, and Treatment: A Policy Statement From the American Heart Association.</article-title>
                    <source>

                        <italic toggle="yes">Circulation.</italic>
</source>
                    <year>2025</year>;<volume>151</volume>(<issue>1</issue>):<fpage>e1</fpage>&#x2013;<lpage>e21</lpage>.
                    <pub-id pub-id-type="doi">10.1161/CIR.0000000000001293</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Buss</surname>
                            <given-names>V</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kock</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>West</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Trends in electronic cigarette use in England (16th January 2025 update).</article-title>
                    <year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://smokinginengland.info/graphs/e-cigarettes-latest-trends">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lindson</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Butler</surname>
                            <given-names>AR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>McRobbie</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Electronic cigarettes for smoking cessation.</article-title>
                    <source>

                        <italic toggle="yes">Cochrane Database Syst. Rev.</italic>
</source>
                    <year>2025</year>;<volume>1</volume>:<fpage>CD010216</fpage>.
                    <pub-id pub-id-type="doi">10.1002/14651858.CD010216.pub9</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="other">
                    <collab>Department for Environment, Food &amp; Rural Affairs</collab>:
                    <article-title>Single-use vapes ban: what businesses need to do.</article-title>
                    <year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.gov.uk/guidance/single-use-vapes-ban">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Butler</surname>
                            <given-names>AR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lindson</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Livingstone-Banks</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Interventions for quitting vaping.</article-title>
                    <source>

                        <italic toggle="yes">Cochrane Database Syst. Rev.</italic>
</source>
                    <year>2025</year>;<volume>1</volume>:<fpage>CD016058</fpage>.
                    <pub-id pub-id-type="doi">10.1002/14651858.CD016058.pub2</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chaloupka</surname>
                            <given-names>FJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yurekli</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fong</surname>
                            <given-names>GT</given-names>
                        </name>
</person-group>:
                    <article-title>Tobacco taxes as a tobacco control strategy.</article-title>
                    <source>

                        <italic toggle="yes">Tob. Control.</italic>
</source>
                    <year>2012</year>;<volume>21</volume>(<issue>2</issue>):<fpage>172</fpage>.
                    <pub-id pub-id-type="doi">10.1136/tobaccocontrol-2011-050417</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Swinburn</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Egger</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Raza</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>Dissecting Obesogenic Environments: The Development and Application of a Framework for Identifying and Prioritizing Environmental Interventions for Obesity.</article-title>
                    <source>

                        <italic toggle="yes">Prev. Med.</italic>
</source>
                    <year>1999</year>;<volume>29</volume>(<issue>6</issue>):<fpage>563</fpage>&#x2013;<lpage>570</lpage>.
                    <pub-id pub-id-type="doi">10.1006/pmed.1999.0585</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hollands</surname>
                            <given-names>GJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bignardi</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Johnston</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The TIPPME intervention typology for changing environments to change behaviour.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Hum. Behav.</italic>
</source>
                    <year>2017</year>;<volume>1</volume>:<fpage>0140</fpage>.
                    <pub-id pub-id-type="doi">10.1038/s41562-017-0140</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>14</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Marteau</surname>
                            <given-names>TM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hollands</surname>
                            <given-names>GJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nambiar</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <chapter-title>Changing behaviour at scale to prevent NCDs. </chapter-title>
                    <person-group person-group-type="editor">

                        <name name-style="western">
                            <surname>Banatvala</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bovet</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>, editors.
                    <source>

                        <italic toggle="yes">Noncommunicable Diseases: a Compendium.</italic>
</source>
                    <publisher-loc>Abingdon (UK)</publisher-loc>:
                    <publisher-name>Routledge</publisher-name>;<year>2023</year>; pp.<fpage>347</fpage>&#x2013;<lpage>354</lpage>.</mixed-citation>
            </ref>
            <ref id="ref15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Marteau</surname>
                            <given-names>TM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mantzari</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hollands</surname>
                            <given-names>GJ</given-names>
                        </name>
</person-group>:
                    <article-title>Do nudges need a regulatory push? Comparing the effectiveness and implementation of exemplar nudge (size-based) and non-nudge (price-based) dietary interventions.</article-title>
                    <source>

                        <italic toggle="yes">Soc. Sci. Med.</italic>
</source>
                    <year>2025</year>;<volume>373</volume>:<fpage>118004</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.socscimed.2025.118004</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Campbell</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tricco</surname>
                            <given-names>AC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Munn</surname>
                            <given-names>Z</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mapping reviews, scoping reviews, and evidence and gap maps (EGMs): the same but different&#x2014; the &#x201c;Big Picture&#x201d; review family.</article-title>
                    <source>

                        <italic toggle="yes">Syst. Rev.</italic>
</source>
                    <year>2023</year>;<volume>12</volume>(<issue>1</issue>):<fpage>45</fpage>.
                    <pub-id pub-id-type="doi">10.1186/s13643-023-02178-5</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <label>17</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shemilt</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hollands</surname>
                            <given-names>GJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Stansfield</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <source>

                        <italic toggle="yes">Debunk, Inform, Avoid? Debunking vaccine-related misinformation: a rapid evidence review. Report produced for the International Public Policy Observatory (IPPO).</italic>
</source>
                    <publisher-loc>London</publisher-loc>:
                    <publisher-name>EPPI Centre, UCL Social Research Institute, University College London</publisher-name>;<year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://eppi.ioe.ac.uk/CMS/portals/0/Debunking%20RER_Final%20Report_Final%20Version_12-2022.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <label>18</label>
                <mixed-citation publication-type="other">
                    <collab>Public Health England</collab>:
                    <article-title>Electronic cigarettes.</article-title>
                    <year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://assets.publishing.service.gov.uk/media/5a7df89c40f0b62302688532/Ecigarettes_report.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hartmann-Boyce</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tattan-Birch</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brown</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Oral nicotine pouches for cessation or reduction of use of other tobacco or nicotine products.</article-title>
                    <source>

                        <italic toggle="yes">Cochrane Database Syst. Rev.</italic>
</source>
                    <year>2025</year>;<volume>2</volume>:<fpage>CD016220</fpage>.
                    <pub-id pub-id-type="doi">10.1002/14651858.CD016220</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hollands</surname>
                            <given-names>GJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Naughton</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Farley</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Interventions to increase adherence to medications for tobacco dependence.</article-title>
                    <source>

                        <italic toggle="yes">Cochrane Database Syst. Rev.</italic>
</source>
                    <year>2019</year>;<volume>8</volume>:<fpage>CD009164</fpage>.
                    <pub-id pub-id-type="doi">10.1002/14651858.CD009164.pub3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <label>21</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thomas</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Graziosi</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brunton</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <source>

                        <italic toggle="yes">EPPI-Reviewer: advanced software for systematic reviews, maps and evidence synthesis [Computer software].</italic>
</source>
                    <publisher-loc>London</publisher-loc>:
                    <publisher-name>EPPI Centre</publisher-name>;<year>2023</year>.</mixed-citation>
            </ref>
            <ref id="ref22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tenti</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Thomas</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pe&#x00f1;aloza</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>ContReviews: A content-based recommendation system for updating Living Evidences in health care.</article-title>
                    <source>

                        <italic toggle="yes">Knowl.-Based Syst.</italic>
</source>
                    <year>2025</year>;<volume>311</volume>:<fpage>112981</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.knosys.2025.112981</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <label>23</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wallrich</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Assessing interrater agreement in meta-analyses &#x2013; What sample size do I need?</article-title>
                    <year>2023</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.lukaswallrich.coffee/blog/assessing-interrater-agreement-in-meta-analyses-what-sample-size-do-i-need/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Han</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tan</surname>
                            <given-names>HW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Julious</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A descriptive study of samples sizes used in agreement studies published in the PubMed repository.</article-title>
                    <source>

                        <italic toggle="yes">BMC Med. Res. Methodol.</italic>
</source>
                    <year>2022</year>;<volume>22</volume>(<issue>1</issue>):<fpage>242</fpage>.
                    <pub-id pub-id-type="doi">10.1186/s12874-022-01723-5</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref25">
                <label>25</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shemilt</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Thomas</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Churchill</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Generative artificial intelligence tools versus conventional screening by humans for selecting eligible study reports for evidence synthesis: A living study within a review (SWAR) [Project registration and materials].</article-title>
                    <year>2025</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://osf.io/g7mkb/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <label>26</label>
                <mixed-citation publication-type="other">
                    <collab>OpenAI</collab>:
                    <article-title>ChatGPT-4o [Large language model].</article-title>
                    <year>2024</year>.</mixed-citation>
            </ref>
            <ref id="ref27">
                <label>27</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>White</surname>
                            <given-names>H</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">The Strategic Use of Evidence and Gap Maps to Build the Evidence Architecture. CEDIL Methods Working Paper 5.</italic>
</source>
                    <publisher-loc>London and Oxford</publisher-loc>:
                    <publisher-name>Centre of Excellence for Development Impact and Learning (CEDIL)</publisher-name>;<year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://cedilprogramme.org/wp-content/uploads/2021/11/CEDIL-Methods-Working-Paper-5-Evidence-and-Gap-Maps.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <label>28</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shemilt</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hollands</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>D&#x2019;Souza</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Considering and reporting methods for investigating health equity issues in systematic reviews and other evidence syntheses. (Version 1.0. October 2024). </article-title>
                    <publisher-loc>London</publisher-loc>:
                    <publisher-name>EPPI Centre, Social Science Research Unit, UCL Institute of Education, University College London</publisher-name>;<year>2024</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://eppi.ioe.ac.uk/cms/Default.aspx?tabid=3939">Reference Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
        <fn-group content-type="footnotes">
            <fn id="fn1">
                <label>
                    <sup>1</sup>
                </label>
                <p>E-cigarettes being the most commonly used term for these products in the scientific literature and our preferred term in this protocol.</p>
            </fn>
            <fn id="fn2">
                <label>
                    <sup>2</sup>
                </label>
                <p>OpenAlex &#x2018;related publications&#x2019; (records) are recommended by &#x2018;seed&#x2019; publications (records) based on their ranking (top ranked are those which score highest) on a composite metric that combines all of the various network graph relationships available within the OpenAlex knowledge graph.</p>
            </fn>
            <fn id="fn3">
                <label>
                    <sup>3</sup>
                </label>
                <p>An initial sample of 100 records screened in early-stage development of this work suggested 62% of records would be included and so using this estimate of 75% is more conservative in requiring a larger sample size.</p>
            </fn>
            <fn id="fn4">
                <label>
                    <sup>4</sup>
                </label>
                <p>Or a newer model, should one become available that is better suited to this task.</p>
            </fn>
            <fn id="fn5">
                <label>
                    <sup>5</sup>
                </label>
                <p>We do not intend to systematically extract risk of bias or quality appraisal information for included records. It is possible, however, that we may develop an approach to annotating notably &#x2018;high-quality&#x2019; studies (or bodies of studies) that are included in the map, such as through using known study design characteristics to infer likely explanatory power (e.g. systematic reviews identifying evidence of sufficient certainty, large-scale observational studies, randomised controlled trials).</p>
            </fn>
            <fn id="fn6">
                <label>
                    <sup>6</sup>
                </label>
                <p>In terms of timing, we intend to produce the first version of the map (v1) within an approximately six-month period subsequent to approval of this protocol by its commissioners and its public registration. This is because it is likely the initial development and corroboration of processes will take additional time. However, following that, we intend that each subsequent full version of the map would be published in accordance with a regular four-month cycle i.e. v2 would be published approximately four months after v1, and so forth.</p>
            </fn>
        </fn-group>
    </back>
</article>
