<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.145823.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Using X, Facebook QR codes to optimise recruitment to a feasibility trial Enhancing Men&#x2019;s Awareness of Testicular Diseases (E-MAT) in a cluster randomised Study Within A Trial (SWAT): Lessons learned.</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Shiely</surname>
                        <given-names>Frances</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-0969-8321</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Cooke</surname>
                        <given-names>Eoghan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>McCarthy</surname>
                        <given-names>Megan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-1415-8461</uri>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Dahly</surname>
                        <given-names>Darren</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Harrington</surname>
                        <given-names>Janas</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Shorter</surname>
                        <given-names>Gillian W.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5752-2297</uri>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Davoren</surname>
                        <given-names>Martin P.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                    <xref ref-type="aff" rid="a6">6</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Hegarty</surname>
                        <given-names>Josephine</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Murphy</surname>
                        <given-names>Aileen</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a7">7</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Kirby</surname>
                        <given-names>Ann</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a7">7</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Murphy</surname>
                        <given-names>David</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-9685-8292</uri>
                    <xref ref-type="aff" rid="a8">8</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Robertson</surname>
                        <given-names>Steve</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <xref ref-type="aff" rid="a9">9</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Rovito</surname>
                        <given-names>Michael J.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a10">10</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Fitzgerald</surname>
                        <given-names>Serena</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>O'Connor</surname>
                        <given-names>Alan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a11">11</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>O'Riordan</surname>
                        <given-names>M&#x00ed;che&#x00e1;l</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a11">11</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Saab</surname>
                        <given-names>Mohamad M</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-7277-6268</uri>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>HRB Clinical Research Facility, University College Cork, Cork, Ireland</aff>
                <aff id="a2">
                    <label>2</label>School of Public Health, University College Cork, Cork, Ireland</aff>
                <aff id="a3">
                    <label>3</label>HRB Trials Methodology Research Network, University College Cork, Cork, Ireland</aff>
                <aff id="a4">
                    <label>4</label>Catherine McAuley School of Nursing and Midwifery, University College Cork, Cork, Ireland</aff>
                <aff id="a5">
                    <label>5</label>Drug and Alcohol Research Network, School of Psychology, Queen's University Belfast, Belfast, Northern Ireland, UK</aff>
                <aff id="a6">
                    <label>6</label>Sexual Health Centre, Cork, Ireland</aff>
                <aff id="a7">
                    <label>7</label>School of Economics, University College Cork, Cork, Ireland</aff>
                <aff id="a8">
                    <label>8</label>School of Computer Science and Information Technology, University College Cork, Cork, Ireland</aff>
                <aff id="a9">
                    <label>9</label>School of Allied Health Professions, Nursing and Midwifery, The University of Sheffield, England, UK</aff>
                <aff id="a10">
                    <label>10</label>Department of Health Sciences, University of Central Florida, Orlando, Florida, USA</aff>
                <aff id="a11">
                    <label>11</label>Gaelic Athletic Association, Dublin, Ireland</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:F.Shiely@ucc.ie">F.Shiely@ucc.ie</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>28</day>
                <month>3</month>
                <year>2024</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2024</year>
            </pub-date>
            <volume>13</volume>
            <elocation-id>235</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>13</day>
                    <month>3</month>
                    <year>2024</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2024 Shiely F et al.</copyright-statement>
                <copyright-year>2024</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/13-235/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>Eight out of ten adults use social media, yet its efficacy in recruitment in clinical trials remains under-explored. The purpose of this SWAT was to determine which recruitment method, X, Facebook or QR code via posters, was more efficient and cost effective for recruiting participants to the host trial.</p>
                </sec>
                <sec>
                    <title>Methods</title>
                    <p>A cluster randomised cross-over design evaluated three recruitment strategies, X, Facebook and QR code. Seven Gaelic Athletic Association (GAA) clubs were randomised to receive either X, Facebook, or QR code. The seven clubs were re-randomised twice more, two weeks apart. There were two primary outcomes: 1. proportion of participants who consent to participate, relative to the number of players contacted; and 2. proportion of participants who consent to participate, relative to the number of players who clicked the link to register their interest.</p>
                </sec>
                <sec>
                    <title>Results</title>
                    <p>Fifty participants were randomised to three recruitment methods, and 47 were retained in the host trial. Participants mainly heard about the study through friends, with some engagement via social media platforms Facebook and X, and little to no engagement with the QR code. Primary outcomes were hindered by the inability to disaggregate data by GAA club. Economic outcomes revealed QR code as the costliest strategy, and while X was cheaper than Facebook in terms of the number of clicks, Facebook demonstrated better recruitment and retention and thus reduced the costs per participant.</p>
                </sec>
                <sec>
                    <title>Conclusions</title>
                    <p>While the inability to disaggregate data by club was a limitation, the study revealed that Facebook outperformed X and QR codes in terms of recruitment and participant retention and was thus considered to be more cost effective. The findings emphasise the importance of considering engagement patterns and cost-effectiveness in designing recruitment strategies for clinical trials, especially within the dynamic landscape of social media use.</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Cluster randomised controlled trial; feasibility study; recruitment; SWAT; social media; testicular neoplasms; men&#x2019;s health.</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/501100001590">
                    <funding-source>Health Research Board</funding-source>
                    <award-id>DIFA-2020-028</award-id>
                </award-group>
                <funding-statement>Health Research Board, Definitive Intervention and Feasibility Awards (HRB DIFA) (Grant number: DIFA-2020-028</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec5" sec-type="intro">
            <title>Introduction</title>
            <p>Successful trial recruitment is challenging, with fewer than 50% of trials meeting their targets.
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> The evidence available to trialists to support decisions on design, conduct and reporting of randomised trials is sparse, suggesting further trial methodological work is needed.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup> PRioRiTy I
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup> &amp; II
                <sup>
                    <xref ref-type="bibr" rid="ref4">4</xref>
                </sup> studies identified the most important unanswered research questions in recruitment and retention, respectively, and one of the top ten recruitment priorities was the use of technology in the recruitment process. Eight out of ten adults use social media, yet its efficacy in recruitment in clinical trials remains under-explored.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>
                </sup> The purpose of this study within a trial (SWAT) was to determine which recruitment method (X, formerly Twitter), Facebook, or quick response [QR] codes via posters) was more efficient and cost effective for recruiting participants to the primary host trial. We also aimed to determine if the recruitment method influenced retention in the host trial. The SWAT protocol is registered in the Northern Ireland SWAT repository as SWAT 162.</p>
        </sec>
        <sec id="sec6" sec-type="methods">
            <title>Methods</title>
            <sec id="sec7">
                <title>Study design and randomisation</title>
                <p>We used a cluster randomised cross-over design to evaluate the three recruitment strategies (X, Facebook and QR code). Seven Gaelic Athletic Association [
                    <xref ref-type="fn" rid="fn1">1</xref>] (GAA &#x2013; Irish football and hurling) clubs agreed to participate in the SWAT and were randomised using Research Randomizer (
                    <ext-link ext-link-type="uri" xlink:href="https://www.randomizer.org/">https://www.randomizer.org/</ext-link>) to either Facebook (n = 2), X (n = 3) or QR code (n = 2) for a period of two weeks. After two weeks, the seven clubs were re-randomised to either one of the other recruitment methods, i.e., the two Facebook clubs were then randomised to get either X or QR. After a further two weeks, the GAA clubs changed to the final remaining recruitment method for one further two-week period. Clubs were asked to post the Facebook and X posts twice per week between 12pm and 1pm. We were dependent on the clubs to do the posting when we directed them to but had no control over this occurrence. In relation to the QR code, 10 posters were displayed in each club for the two-week period of their randomisation.</p>
            </sec>
            <sec id="sec8">
                <title>Population</title>
                <p>Participants were eligible to participate in the SWAT if they were assigned male at birth, members (i.e., players and coaches) of the target GAA clubs, residing in the Republic of Ireland, and aged 18 to 50 years (age group at risk for testicular diseases).</p>
            </sec>
            <sec id="sec9">
                <title>Patient and Public Involvement (PPI)</title>
                <p>Two PPI collaborators on the host trial are members of the participating GAA clubs and were involved in the development of the grant application which included the SWAT. They provided background information on player demographics, determining the potential recruitment strategies for the SWAT, and identified the appropriate time in the GAA season to start the recruitment. Both collaborators were compensated for their time and are included as co-authors (AOC and MOR).</p>
            </sec>
            <sec id="sec10">
                <title>Primary outcomes: Primary recruitment</title>
                <p>
                    <list list-type="order">
                        <list-item>
                            <label>1.</label>
                            <p>Proportion of participants who consent to participate in the host trial, relative to the number of players contacted via each recruitment method.</p>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>Proportion of participants who registered their interest to participate, relative to those consented to the host trial via each social recruitment method.</p>
                        </list-item>
                    </list>
                </p>
            </sec>
            <sec id="sec11">
                <title>Secondary outcomes: Primary retention and cost-per-strategy</title>
                <p>
                    <list list-type="order">
                        <list-item>
                            <label>1.</label>
                            <p>Proportion of participants randomised who remain to the conclusion of the study.</p>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>Unit cost per person who registered their interest by clicking the link/scanning QR code.</p>
                        </list-item>
                        <list-item>
                            <label>3.</label>
                            <p>Unit cost per person consented to the host trial.</p>
                        </list-item>
                        <list-item>
                            <label>4.</label>
                            <p>Unit cost per person retained at end point of the host trial.</p>
                        </list-item>
                    </list>
                </p>
            </sec>
            <sec id="sec12">
                <title>Host trial description</title>
                <p>
                    <italic toggle="yes">Title</italic>
                </p>
                <p>Enhancing Men&#x2019;s Awareness of Testicular Diseases (E-MAT): A Feasibility Study (
                    <ext-link ext-link-type="uri" xlink:href="https://clinicaltrials.gov/ct2/show/NCT05146466">ClinicalTrials.gov</ext-link> Identifier: NCT05146466).</p>
                <p>
                    <italic toggle="yes">Aim of host trial</italic>
                </p>
                <p>To examine the feasibility of conducting a definitive trial to test the effect of E-MAT
                    <sub>VR</sub> (Virtual Reality) (intervention) compared to E-MAT
                    <sub>E</sub> (Electronic information only) (control) on testicular knowledge and testicular self-examination behaviours among male GAA players over three months. We developed a three-level Virtual Reality (VR) educational game called &#x201c;Enhancing Men&#x2019;s Awareness of Testicular diseases&#x201d; or E-MAT
                    <sub>VR</sub>, delivered using a VR headset, handheld controllers, and voiceover.
                    <sup>
                        <xref ref-type="bibr" rid="ref6">6</xref>
                    </sup>
                    <sup>,</sup>
                    <sup>
                        <xref ref-type="bibr" rid="ref7">7</xref>
                    </sup> E-MAT
                    <sub>VR</sub> uses light humour to educate men about testicular diseases and encourages them to examine their testicles and seek medical help for symptoms of concern. The feasibility study compares E-MAT
                    <sub>VR</sub> to a traditional electronic intervention that uses plain text and images via a Tablet or E-MAT
                    <sub>E</sub>. The primary outcomes measured in the feasibility trial were testicular knowledge and testicular self-examination behaviours. The feasibility trial took place in nine geographically distributed GAA sports clubs in County Cork, a southern region in Ireland, over a three-month period. For each of the nine participating GAA clubs, individual participants were randomised to either the intervention or control arm. Risk of contamination was low due to the geographical dispersion of the GAA clubs.</p>
            </sec>
            <sec id="sec13">
                <title>Data collection</title>
                <p>Outcomes were measured at baseline (T0, pre-engagement with E-MAT
                    <sub>VR</sub> or E-MAT
                    <sub>E</sub>), immediately post-test (T1, post engagement with E-MAT
                    <sub>VR</sub> or E-MAT
                    <sub>E</sub>), and three months post-test (T2) using electronic surveys. We expected that players would pass the study link to other players. To capture this, at T0 we asked the participants if they learned about either of the three recruitment methods directly, link through WhatsApp, or if they were referred by a friend.</p>
                <p>
                    <italic toggle="yes">Facebook</italic>
                </p>
                <p>The GAA club has a record of self-identified males on the club Facebook page, which gives us the total number targeted (denominator). We were dependent on the clubs to make the Facebook posts.</p>
                <p>
                    <italic toggle="yes">X</italic>
                </p>
                <p>On X there is an Engagement Application Programming Interface (API) which measures engagements - a count of the number of time a user has interacted with the X post, how often it has been favourited, liked, reposted, replied, and shared. We were dependent on the clubs to make the X posts.</p>
                <p>
                    <italic toggle="yes">QR code</italic>
                </p>
                <p>The QR code was displayed by means of a professionally designed poster at each club. Ten posters were displayed in each club for the 2-week period of their randomisation. We were able to monitor the number of people who used the QR code.</p>
            </sec>
            <sec id="sec14">
                <title>Costing methodology</title>
                <p>Micro-costing techniques were used to estimate cost-per-strategy. Costs include direct design and distribution for each strategy; print (received from the company who created the posters and Facebook and X posts), collection costs (travel as per the University&#x2019;s travel allowance) and personnel costs (valued using national salary scales for staff grade level as per national guidelines
                    <sup>
                        <xref ref-type="bibr" rid="ref8">8</xref>
                    </sup>). Trial data were used to identify and measure the quantity of each resource and market values were employed to value them in Euros, for the year 2022.</p>
            </sec>
            <sec id="sec15">
                <title>Data analysis</title>
                <p>Exploratory data analysis was conducted, and outliers reconciled. Analysis was conducted on an intention-to-treat basis using the cluster randomisation scheme. Analysis was conducted using R (version 4.0.3; R Project for Statistical Computing, Vienna, Austria) and, in all cases, a 2-sided type I error rate of 0.05 was taken as statistically significant.</p>
            </sec>
        </sec>
        <sec id="sec16" sec-type="results">
            <title>Results</title>
            <p>Nine GAA clubs were recruited to the host trial. Seven agreed to participate in the SWAT. Fifty participants, from seven GAA clubs, were randomised to the three recruitment methods. 
                <xref ref-type="table" rid="T1">Table 1</xref> shows the number of male members in each club, i.e., target population. In total, 47 out of 50 SWAT participants were retained in the host trial.</p>
            <table-wrap id="T1" orientation="portrait" position="float">
                <label>Table 1. </label>
                <caption>
                    <title>Characteristics of the SWAT GAA clubs.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">GAA Club</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">No. male members &gt;18 years</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">GAA Club Facebook (Likes)</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">GAA Facebook Clicks</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">GAA Club X (Followers)</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">X Clicks</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">QR Code posters</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">QR code poster clicks</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">No. recruited from each club</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">No. retained from each club</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">53</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">987</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2,804</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">11</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">11</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">451</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2,600</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3,241</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">15</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">15</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">166</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2,092</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5,295</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">350</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4,000</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">15,800</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">110</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3,085</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4,920</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Unknown</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2,179</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3,640</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">50</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3,859</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2,709</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">NA
                                <xref ref-type="table-fn" rid="tfn1">*</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>Total</bold>
                            </td>
                            <td colspan="1" rowspan="1"/>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>177</bold>
                                <xref ref-type="table-fn" rid="tfn2">
                                    <bold>^</bold>
                                </xref>
                            </td>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>234</bold>
                                <xref ref-type="table-fn" rid="tfn2">
                                    <bold>^</bold>
                                </xref>
                            </td>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>13</bold>
                                <xref ref-type="table-fn" rid="tfn2">
                                    <bold>^</bold>
                                </xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>50</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>47</bold>
                            </td>
                        </tr>
                    </tbody>
                </table>
                <table-wrap-foot>
                    <fn-group content-type="footnotes">
                        <fn id="tfn1">
                            <label>*</label>
                            <p>NA = Not available.</p>
                        </fn>
                        <fn id="tfn2">
                            <label>^</label>
                            <p>Unable to ascertain which of the clubs the clicks came from.</p>
                        </fn>
                    </fn-group>
                </table-wrap-foot>
            </table-wrap>
            <p>At T0 we asked participants where they heard about the feasibility trial (
                <xref ref-type="table" rid="T2">Table 2</xref>). The majority heard about it exclusively from a friend (n = 20). Facebook and X were the next most common. Only one participant heard about the trial through the QR code.</p>
            <table-wrap id="T2" orientation="portrait" position="float">
                <label>Table 2. </label>
                <caption>
                    <title>Where participants heard about the feasibility trial.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Where participants heard about the trial</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Number of participants</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Friend</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">20</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Facebook</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">X</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Other</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Facebook link by text message (e.g., WhatsApp)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">X link by text message (e.g., WhatsApp)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">QR code</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Facebook and X</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Facebook, X and Friend</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Facebook and Facebook link by WhatsApp</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Facebook, Facebook link by WhatsApp and X</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>Total</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>50</bold>
                            </td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>We had two primary outcomes: 1) the proportion of participants who consent to participate, relative to the number of players contacted via each recruitment method; and 2) the proportion of participants who consent to participate, relative to the number of players who clicked the link to register their interest via each recruitment method. We were unable to disaggregate our data by GAA club thus we were unable to present data for the primary outcomes. We worked with a design company and used one Facebook link, one X link and one QR code link for 
                <italic toggle="yes">ALL</italic> of the GAA clubs.</p>
            <p>However, we are able to present some useful data, to assist others who use these recruitment methods in the future. The data presented in 
                <xref ref-type="table" rid="T3">Table 3</xref> are for the 16 people who entered the host trial, but not coming exclusively from the SWAT. Though X had the most clicks, it had fewer people who consented to the trial when compared to Facebook. Engagement via the QR code was poor.</p>
            <table-wrap id="T3" orientation="portrait" position="float">
                <label>Table 3. </label>
                <caption>
                    <title>Numbers of clicks, consented and retained per recruitment method.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top"/>
                            <th align="left" colspan="1" rowspan="1" valign="top">X</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Facebook</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">QR Code</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>No. Clicks</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">234</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">177</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">13</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>No. Consented</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>No. Retained</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>We were able to identify the peak hours of use for X and Facebook, using the Engagement API which provides access to post impression and engagement metrics. X peaks in use at 12pm, 6pm and 9pm. Facebook peaks in use at 8am and 8pm. In terms of the days of the week that showed most usage, X peaked on Tuesday and Thursday while Facebook peaked on Friday. This may have been the days the X and Facebook posts were made but we do not have that information from each club to clarify this.</p>
            <sec id="sec17">
                <title>Secondary outcomes</title>
                <p>We had four secondary outcomes. Of the 50 participants randomised to the SWAT, 47 were retained. As so few were lost to follow-up (n = 3), we could not assess primary retention across the three recruitment methods. The remaining three secondary outcomes were economic outcomes related to cost-per-strategy. 1) unit cost per person who registered their interest by clicking the link/scanning QR code; 2) unit cost per person consented to the host trial; 3) unit cost per person retained at end point of the host trial. We were unable to disaggregate the SWAT information (n = 50) from the host feasibility trial (n = 74). Thus, the information presented below, and in 
                    <xref ref-type="table" rid="T4">Tables 4</xref> and 
                    <xref ref-type="table" rid="T5">5</xref>, is for the host trial. We first determined the total costs per recruitment strategy. As can be seen in 
                    <xref ref-type="table" rid="T4">Table 4</xref>, the QR code was the most expensive, while X and Facebook had equivalent total costs. As per 
                    <xref ref-type="table" rid="T4">Tables 4</xref> and 
                    <xref ref-type="table" rid="T5">5</xref>, in all cases, the QR code was the most expensive. While X was cheaper than Facebook in terms of the number of clicks, the engagement was better with Facebook resulting in more being consented and retained through Facebook, thereby reducing costs per participant.</p>
                <table-wrap id="T4" orientation="portrait" position="float">
                    <label>Table 4. </label>
                    <caption>
                        <title>Total cost per strategy (&#x20ac;, 2022).</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top"/>
                                <th align="left" colspan="1" rowspan="1" valign="top">X</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Facebook</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">QR code</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Digital design and distribution
                                    <sup>
                                        <xref ref-type="table-fn" rid="tfn3">1</xref>
                                    </sup>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac;50.33</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac;50.33</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac; 50.33</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Poster design, printing and distribution
                                    <sup>
                                        <xref ref-type="table-fn" rid="tfn4">2</xref>
                                    </sup>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">-</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">-</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac;380.56</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Communication and follow-up: personnel time 
                                    <sup>
                                        <xref ref-type="table-fn" rid="tfn5">3</xref>
                                    </sup>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac;3,689.97</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac;3,689.97</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac;3,689.97</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Total</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>&#x20ac;3,740.30</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>&#x20ac;3,740.30</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>&#x20ac;4,120.86</bold>
                                </td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <fn-group content-type="footnotes">
                            <fn id="tfn3">
                                <label>
                                    <sup>1</sup>
                                </label>
                                <p>Design company cost &#x20ac;151 equally split between 3 strategies (Source: Trial documentation).</p>
                            </fn>
                            <fn id="tfn4">
                                <label>
                                    <sup>2</sup>
                                </label>
                                <p>Poster design (&#x20ac;160), printing (&#x20ac;113.65) and delivery (&#x20ac;106.91) (Source: Trial documentation).</p>
                            </fn>
                            <fn id="tfn5">
                                <label>
                                    <sup>3</sup>
                                </label>
                                <p>Research Assistant salary &#x20ac;31,617 pa (Source: Trial documentation).</p>
                            </fn>
                        </fn-group>
                    </table-wrap-foot>
                </table-wrap>
                <table-wrap id="T5" orientation="portrait" position="float">
                    <label>Table 5. </label>
                    <caption>
                        <title>Economic outcomes.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <tbody>
                            <tr>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>X</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Facebook</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>QR Code</bold>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Outcome 1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac; /Clicks</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">15.98</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">21.13</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">316.99</td>
                            </tr>
                            <tr>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>X</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Facebook</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>QR Code</bold>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Outcome 2</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac; /Consent</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">623.38</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">415.59</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4,120.86</td>
                            </tr>
                            <tr>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>X</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Facebook</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>QR Code</bold>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Outcome 3</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x20ac; /Retained</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">748.06</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">534.33</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4,120.86</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
        </sec>
        <sec id="sec18" sec-type="discussion">
            <title>Discussion</title>
            <p>The results of our study provide insights into the effectiveness and cost-effectiveness of different recruitment methods in the context of a community sports club setting. Our study involved nine GAA clubs (n = 74), with seven participating in the SWAT (n = 50) who were randomised to three recruitment methods. Most participants heard about the study exclusively from a friend, highlighting the importance of interpersonal networks in disseminating information within the GAA community; replicated in other studies showing the centrality of social networks on and offline in transmitting health care information.
                <sup>
                    <xref ref-type="bibr" rid="ref9">9</xref>
                </sup> This is likely a feature of communication in all sports clubs in the community. Facebook and X were also prominent sources of information, with only one participant discovering the study through the poster with QR code. This indicates the limited effectiveness of QR codes as a standalone recruitment method in this context. When compared to other social media recruitment methods Facebook and X, the QR code was also relatively expensive. We do not recommend using it in a trial in the community. X and Facebook set-up costs were equal, but initial engagement, i.e., numbers of clicks, was greater in X, thereby reducing the cost per participant. However, the proportion who consented from the engagement was greater with Facebook, thus Facebook can be considered cost effective compared to X when considering those consented and retained.</p>
            <sec id="sec19">
                <title>Lessons learned</title>
                <p>
                    <list list-type="order">
                        <list-item>
                            <label>1.</label>
                            <p>The inability to disaggregate data by GAA club due to the use of a single Facebook link, one X link and one QR code link for ALL of the GAA clubs is a limitation. Understanding the aggregate is useful, but there may be diversity in recruitment that is under-explored, such as impact on recruitment by individual or group characteristic (e.g., ethnicity
                                <sup>
                                    <xref ref-type="bibr" rid="ref10">10</xref>
                                </sup>). Creating separate links (Facebook, X, QR code) for each of the GAA clubs would have allowed for a more granular analysis of the recruitment process. This would have provided valuable insights into the effectiveness of each method within individual clubs and could have informed targeted recruitment strategies.</p>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>Monitoring X and Facebook interactions in a sport club setting is challenging, as it was not possible to disentangle the SWAT participant data from general GAA club data. The reason for this was because we did not have direct administrative access to the club accounts. To conduct recruitment in the way we did, and to be able to evaluate it, researchers would need to be given user/administrator rights to each club&#x2019;s Facebook and X accounts.</p>
                        </list-item>
                        <list-item>
                            <label>3.</label>
                            <p>In addition to members of the GAA club, there were other individuals that follow the GAA Club&#x2019;s X and Facebook pages, so relying on club membership to determine the denominator was not meaningful.</p>
                        </list-item>
                        <list-item>
                            <label>4.</label>
                            <p>Many of the participants heard about the study from friends, therefore, we were unable to determine which recruitment method they were recruited through.</p>
                        </list-item>
                        <list-item>
                            <label>5.</label>
                            <p>While we were focused on three recruitment methods, as we can see in 
                                <xref ref-type="table" rid="T1">Table 1</xref>, some people accessed the Facebook and X links via Text Message or WhatsApp, making it difficult to track the reach of the recruitment method.</p>
                        </list-item>
                        <list-item>
                            <label>6.</label>
                            <p>We were overambitious when defining our outcomes and for a small SWAT, there were too many. The &#x2018;keep it simple&#x2019; approach &#x2013; fewer outcomes &#x2013; would have been better.</p>
                        </list-item>
                        <list-item>
                            <label>7.</label>
                            <p>It is evident that the hours of use for X and Facebook which would help identify suitable times to post information on the study in future trials. For this community of users, X spikes in use at 12pm, 6pm, and 9pm. Facebook peaks in use at 8am and 8pm. In terms of the days of the week that showed most usage, X peaked on Tuesday and Thursday while Facebook peaked on Friday. This may have been the days the X and Facebook posts were made but we do not have the required information from each GAA club to determine that.</p>
                        </list-item>
                    </list>
                </p>
            </sec>
        </sec>
        <sec id="sec20" sec-type="conclusion">
            <title>Conclusion</title>
            <p>In conclusion, we have tentative evidence on the ability to recruit males to healthcare trials which demonstrated better value for money through Facebook, followed by X, with little to no-engagement with QR codes. Engaging with social networks is essential to support recruitment. The limitations of data tracking and customisation to evaluate recruitment methods in research studies are highlighted, especially when dealing with multiple groups or recruitment methods in a pragmatic community setting. We encourage others to evaluate their recruitment methods in SWATs to support or refute our conclusions and support trial engagement. These insights can inform future research, particularly future definitive trials, allowing for more robust recruitment of participants, data collection and analysis, ultimately enhancing the validity and reliability of research findings.</p>
            <sec id="sec21">
                <title>Ethical considerations</title>
                <p>Ethical approval for this SWAT was obtained from the Clinical Research Ethics Committee (CREC), University College Cork in December 2021 (CREC Review Reference Number: ECM 06/2023 PUB). We confirm that we obtained written, informed consent from all participants enrolled in this study.</p>
            </sec>
        </sec>
    </body>
    <back>
        <sec id="sec25" sec-type="data-availability">
            <title>Data availability statement</title>
            <sec id="sec26">
                <title>Underlying data</title>
                <p>The data underlying the results are available as part of the article and no additional source data are required, except for social media data and the data from the QR code posters. The social media data came from the Facebook page and X pages of the GAA clubs. This data is in the form of posts, likes, followers and clicks. The QR code posters contained data on clicks only. The social media data cannot be shared due to the ethical and copyright restrictions surrounding social media data. The Methods section contains detailed information to allow replication of the study. Also, the study is small due to its nature and it could potentially identify the GAA clubs if we release it publicly. Any queries about the methodology should be directed to the corresponding author. If someone requests the data or have questions about the methodology, we are happy to discuss this with them.</p>
            </sec>
            <sec id="sec22">
                <title>Reporting guidelines</title>
                <p>We await reporting guidelines for SWATs which are being led by the University of York and are expected to be published in 2024.</p>
            </sec>
        </sec>
        <ack>
            <title>Acknowledgements</title>
            <p>We wish to express our appreciation to the GAA clubs who facilitated the data collection for this SWAT, and to their members for partaking.</p>
        </ack>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gardner</surname>
                            <given-names>HR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fraser</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>MacLennan</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A protocol for a systematic review of non-randomised evaluations of strategies to improve participant recruitment to randomised controlled trials.</article-title>
                    <source>

                        <italic toggle="yes">Syst. Rev.</italic>
</source>
                    <year>2016</year>;<volume>5</volume>(<issue>1</issue>):<fpage>131</fpage>.
                    <pub-id pub-id-type="pmid">27485111</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13643-016-0308-3</pub-id>
                    <pub-id pub-id-type="pmcid">PMC4971680</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Treweek</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bevan</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bower</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Trial forge guidance 1: what is a study within a trial (SWAT)?</article-title>
                    <source>

                        <italic toggle="yes">Trials.</italic>
</source>
                    <year>2018</year>;<volume>19</volume>(<issue>1</issue>):<fpage>139</fpage>.
                    <pub-id pub-id-type="pmid">29475444</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13063-018-2535-5</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5824570</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Healy</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Galvin</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Williamson</surname>
                            <given-names>PR</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Identifying trial recruitment uncertainties using a James Lind Alliance priority setting partnership&#x2013;the PRioRiTy (Prioritising recruitment in randomised trials) study.</article-title>
                    <source>

                        <italic toggle="yes">Trials.</italic>
</source>
                    <year>2018</year>;<volume>19</volume>(<issue>1</issue>):<fpage>147</fpage>.
                    <pub-id pub-id-type="pmid">29490702</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13063-018-2544-4</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5831203</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Brunsdon</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Biesty</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brocklehurst</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>What are the most important unanswered research questions in trial retention? A James Lind Alliance Priority Setting Partnership: the PRioRiTy II (Prioritising Retention in Randomised Trials) study.</article-title>
                    <source>

                        <italic toggle="yes">Trials.</italic>
</source>
                    <year>2019</year>;<volume>20</volume>(<issue>1</issue>):<fpage>593</fpage>.
                    <pub-id pub-id-type="pmid">31615577</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13063-019-3687-7</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6794792</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fox</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>The social life of health information, 2011: Pew Internet &amp; American Life Project Washington, DC.</article-title>
                    <year>2011</year>.</mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Saab</surname>
                            <given-names>MM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Landers</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cooke</surname>
                            <given-names>E</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Feasibility and usability of a virtual reality intervention to enhance men&#x2019;s awareness of testicular disorders (E-MAT).</article-title>
                    <source>

                        <italic toggle="yes">Virtual Real.</italic>
</source>
                    <year>2019</year>;<volume>23</volume>:<fpage>169</fpage>&#x2013;<lpage>178</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s10055-018-0368-x</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Saab</surname>
                            <given-names>MM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Landers</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cooke</surname>
                            <given-names>E</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Enhancing men&#x2019;s awareness of testicular disorders using a virtual reality intervention: A pre&#x2013;post pilot study.</article-title>
                    <source>

                        <italic toggle="yes">Nurs. Res.</italic>
</source>
                    <year>2018</year>;<volume>67</volume>(<issue>5</issue>):<fpage>349</fpage>&#x2013;<lpage>358</lpage>.
                    <pub-id pub-id-type="pmid">30059354</pub-id>
                    <pub-id pub-id-type="doi">10.1097/NNR.0000000000000303</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="other">
                    <collab>(HIQA) HIaQA</collab>:
                    <article-title>Guidelines for the Economic Evaluation of Health Technologies in Ireland. Dublin.</article-title>
                    <year>2020</year>.</mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wright</surname>
                            <given-names>K</given-names>
                        </name>
</person-group>:
                    <article-title>Social networks, interpersonal social support, and health outcomes: A health communication perspective.</article-title>
                    <source>

                        <italic toggle="yes">Front. Commun.</italic>
</source>
                    <year>2016</year>;<volume>1</volume>:<fpage>10</fpage>.
                    <pub-id pub-id-type="doi">10.3389/fcomm.2016.00010</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dawson</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Banister</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Biggs</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Trial Forge Guidance 3: randomised trials and how to recruit and retain individuals from ethnic minority groups&#x2014;practical guidance to support better practice.</article-title>
                    <source>

                        <italic toggle="yes">Trials.</italic>
</source>
                    <year>2022</year>;<volume>23</volume>(<issue>1</issue>):<fpage>672</fpage>.
                    <pub-id pub-id-type="pmid">35978338</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13063-022-06553-w</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9383663</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
        <fn-group content-type="footnotes">
            <fn id="fn1">
                <label>

                    <sup>1</sup>
                </label>
                <p>

                    <ext-link ext-link-type="uri" xlink:href="https://www.gaa.ie/">https://www.gaa.ie/</ext-link>
                </p>
            </fn>
        </fn-group>
    </back>
    <sub-article article-type="reviewer-report" id="report289144">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.159827.r289144</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Boumparis</surname>
                        <given-names>Nikolaos</given-names>
                    </name>
                    <xref ref-type="aff" rid="r289144a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-3693-0168</uri>
                </contrib>
                <aff id="r289144a1">
                    <label>1</label>Swiss Research Institute for Public Health and Addiction, Zurich, Switzerland</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>19</day>
                <month>6</month>
                <year>2024</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2024 Boumparis N</copyright-statement>
                <copyright-year>2024</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport289144" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.145823.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This study investigates the effectiveness and cost-effectiveness of three recruitment methods (X, Facebook and QR codes) for a feasibility trial aimed at increasing male awareness of testicular disease.&#x00a0;</p>
            <p> </p>
            <p> - The manuscript is well written and generally easy to follow. The inclusion of a patient and public involvement component is appreciated as it ensures that the design and conduct of the study is informed by the target population.</p>
            <p> </p>
            <p> - However, the inability to disaggregate data by GAA club due to the use of a single link for each recruitment method severely limits the findings.</p>
            <p> </p>
            <p> - The inability to present primary outcomes due to data aggregation issues is a major drawback.&#x00a0;</p>
            <p> </p>
            <p> -The aim of the study was to evaluate different social media-based recruitment methods. However, the high incidence of participants being referred by friends dilutes the ability to accurately assess which recruitment method was most effective.</p>
            <p> </p>
            <p> - The study appropriately highlights the limitations and provides some good lessons for future studies.&#x00a0;</p>
            <p> </p>
            <p> - Although the manuscript states that "exploratory data analysis was performed" and "outliers were reconciled", these statements lack sufficient detail to ensure reproducibility. The manuscript should explicitly state the criteria used to identify outliers, and any impact of outlier handling on the results and conclusions should be discussed to provide transparency on how these decisions may have influenced the results.</p>
            <p> </p>
            <p> Overall, a lot of things went wrong in this study, but it is still a useful paper because it describes several lessons learned that could prevent future studies from making the same mistakes. It also provides some valuable insights of different recruitment methods for clinical trials in similar contexts.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>No</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Digital health, addiction, randomised controlled trials, systematic reviews and meta-analyses.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
</article>
