<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.142038.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Mobile applications (apps) for tobacco cessation: Behaviour change potential and heuristic analysis using the Mobile Application Rating Scale (MARS)</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Bhat</surname>
                        <given-names>Bhargav</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Nayak</surname>
                        <given-names>Prajna Pramod</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Vasthare</surname>
                        <given-names>Ramprasad</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-0181-7069</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Singhal</surname>
                        <given-names>Deepak Kumar</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Public Health Dentistry, Manipal College of Dental Sciences, Manipal Academy of Higher Education, Manipal, Karnataka, 576104, India</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:nayak.prajna@manipal.edu">nayak.prajna@manipal.edu</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>26</day>
                <month>10</month>
                <year>2023</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2023</year>
            </pub-date>
            <volume>12</volume>
            <elocation-id>1413</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>17</day>
                    <month>10</month>
                    <year>2023</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2023 Bhat B et al.</copyright-statement>
                <copyright-year>2023</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/12-1413/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>Given the high prevalence of tobacco use, India presents a significant challenge in tobacco control. Yet, the support received for tobacco cessation is suboptimal. Hence, the aim was to identify and heuristically evaluate &#x2018;high-quality&#x2019; and &#x2018;engaging&#x2019; tobacco cessation mobile apps using the Mobile Application Rating Scale (MARS). Also, to categorize and analyse their features with respect to engagement, functionality, aesthetics, and information quality.</p>
                </sec>
                <sec>
                    <title>Methods</title>
                    <p>A systematic search of tobacco cessation apps was done within app stores of prominent smartphone platforms developed by Apple and Android. The following search terms: &#x2018;quit smoking,&#x2019; &#x2018;smoking cessation, &#x2018;stop smoking,&#x2019; &#x2018;smoking therapy,&#x2019; &#x2018;quit tobacco,&#x2019; &#x2018;cigarette cessation,&#x2019; &#x2018;cold turkey,&#x2019; and &#x2018;quit cigarette.&#x2019; Pearson&#x2019;s correlations were used to analyse correlations between app scores (Total score app-quality/mean score) and downloads/ratings and number of downloads with the overall MARS score. A Chi-square test was performed to analyse any association between app focus and app release dates.</p>
                </sec>
                <sec>
                    <title>Results</title>
                    <p>Total MARS scores ranged from 3.1 to 4.9. Quitsure app (4.9), Craving to Quit! app (4.8) and Stop Tobacco Mobile Trainer: Quit Smoking App (4.74) were ranked the highest according to the MARS overall mean score. Older apps focussed more on mere goal setting or substance use, as compared to behaviour change; whereas, recently developed apps are now focussing more on behaviour change.</p>
                </sec>
                <sec>
                    <title>Conclusions</title>
                    <p>The content and functionality of behaviour change-focused apps were of higher quality than those of other app categories. These recently developed mHealth apps can effectively supersede the traditional smoking cessation methods.</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>smoking cessation</kwd>
                <kwd>mobile health</kwd>
                <kwd>mHealth</kwd>
                <kwd>tobacco use cessation</kwd>
                <kwd>mobile app</kwd>
                <kwd>oral health</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>Introduction</title>
            <p>Tobacco use is the world&#x2019;s most significant threat that is responsible for numerous preventable morbidities, most of which have the potential to kill consumers prematurely. Six of the top eight causes of mortality have smoking as a risk factor. The 20th century has seen an estimated 100 million fatalities worldwide as a result of the tobacco epidemic.
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> India is currently experiencing a second-stage tobacco pandemic. Each year, 800,000 to 900,000 people in India die from diseases linked to tobacco use. It is crucial to act swiftly to stop this preventable disease.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup>
            </p>
            <p>Given the high prevalence of tobacco use, India represents a significant challenge in tobacco control. According to the latest Global Adult Tobacco Survey (GATS) India (2016&#x2013;17), 28.6% of smokers in India use tobacco, with male smokers having a greater prevalence (42.4%) than female smokers (14.2%). According to this nationally representative survey, 52% of tobacco users are ready to give up the habit.
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref4">4</xref>
                </sup> Tobacco cessation programs run at hospitals and rehabilitation centres provide face-to-face and telephone-based behavioural interventions (e.g., brief motivational advice, group or individual counselling, telephone counselling and quit lines) and pharmacotherapy (e.g., nicotine replacement therapies, bupropion) to support smoking cessation. Yet, tobacco cessation support is suboptimal owing to the lack of access to smoking cessation resources, lack of clinician knowledge or skills, and lack of clinician time. The majority of people making independent attempts fail to maintain their quit status for even one month. Hence, use of mHealth intervention for smoking cessation represents one of the best methods to curb the global public health threat of the tobacco epidemic.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>
                </sup>
            </p>
            <p>In the recent times, mobile phones, the Internet and mobile communication have become an inevitable part of our lives. According to estimates, 3.5 billion smartphones were in use worldwide as of June 2020, providing a sizable number of users to help coordinate and conduct mobile interventions to distribute information.
                <sup>
                    <xref ref-type="bibr" rid="ref6">6</xref>
                </sup> An &#x201c;app&#x201d; is the most frequent term for a mobile application that is created to run on portable wireless mobile phones like smartphones.
                <sup>
                    <xref ref-type="bibr" rid="ref7">7</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref8">8</xref>
                </sup> With over three billion downloads of mHealth apps worldwide in 2015, an effective, high-quality smoking cessation app can be an easy-to-use resource that can provide personalized smoking cessation support to thousands of people, including remote smokers, at the right time and location. Past reviews show that mobile apps have tremendous behavioural change potential.
                <sup>
                    <xref ref-type="bibr" rid="ref6">6</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref7">7</xref>
                </sup>
                <sup>&#x2013;</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref9">9</xref>
                </sup>
            </p>
            <p>The utilization of mobile applications in healthcare can offer a range of benefits, including ease of access to information and the potential for enhanced patient engagement and adherence to treatment. However, there are some drawbacks to the use of mobile applications, particularly as the information on apps may not be regulated. As a result, some of the apps that patients access may contain substantial inaccuracies.
                <sup>
                    <xref ref-type="bibr" rid="ref8">8</xref>
                </sup>
            </p>
            <p>The use of smoking cessation interventions utilizing smartphone technology is on the rise globally. However, the effects on cessation rate and prevention of relapses are not often evaluated.
                <sup>
                    <xref ref-type="bibr" rid="ref10">10</xref>
                </sup> Moreover, few studies are reporting the effectiveness of smartphone apps for tobacco cessation. What&#x2019;s more, rankings within the leading app stores are highly volatile and primarily based on the usability of apps. Hence, the behaviour change potential of apps cannot be solely judged based on app &#x2018;ratings&#x2019; or &#x2018;popularity&#x2019; in app stores.</p>
            <p>Recently many evaluation criteria/scales have been developed to evaluate app efficacy. Evaluation based on addressing the 5 As (Ask, Advise, Assess, Assist and Arrange) of tobacco cessation, App Behaviour Change Scale (ABACUS), adherence to clinical practice guidelines for tobacco control, Mobile Application Rating Scale (MARS) have been commonly used in recent studies.
                <sup>
                    <xref ref-type="bibr" rid="ref11">11</xref>
                </sup>
                <sup>&#x2013;</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref15">15</xref>
                </sup> The latter evaluation method, MARS was developed by Stoyanov SR, is widely used and validated by many studies (
                <xref ref-type="fig" rid="f1">Figure 1</xref>).
                <sup>
                    <xref ref-type="bibr" rid="ref15">15</xref>
                </sup>
                <sup>&#x2013;</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref18">18</xref>
                </sup> Hence, we aimed to identify and heuristically evaluate &#x2018;high-quality&#x2019; and &#x2018;engaging&#x2019; tobacco cessation mobile apps using MARS. The objectives were to identify tobacco cessation apps on Apple and Android app stores and to categorize and analyse their features as regards to engagement, functionality, aesthetics, and information quality. Thereby recommending directions for the improvement of these apps.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>Mobile Application Rating Scale (MARS) description.</title>
                </caption>
                <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/155532/cd9136b1-5eed-4519-aa7d-8dd8fdacd26e_figure1.gif"/>
            </fig>
        </sec>
        <sec id="sec2" sec-type="methods">
            <title>Methods</title>
            <sec id="sec3">
                <title>Ethics statement</title>
                <p>The study was registered with Kasturba Hospital ethics committee, approval number [IEC2 &#x2013; 19 (2022), dated 21/06/2022.</p>
            </sec>
            <sec id="sec4">
                <title>Search strategy</title>
                <p>A systematic search of tobacco cessation apps was done within the Apple and Android app stores. The following search terms were used: &#x2018;smoking cessation, &#x2018;quit smoking,&#x2019; &#x2018;stop smoking,&#x2019; &#x2018;smoking therapy,&#x2019; &#x2018;quit tobacco,&#x2019; &#x2018;cigarette cessation,&#x2019; &#x2018;cold turkey,&#x2019; and &#x2018;quit cigarette.&#x2019; All the apps rated 4* and above, with downloads of more than 10,000 were included in the study. Apps that did not target tobacco cessation and those not in English were excluded from the study. We also eliminated the duplicate apps, including earlier versions. To begin with, we identified all apps based on their focus area:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Substance use: information about the ill-effects of tobacco and thereby motivating users to quit.</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Goal setting: monitoring and tracking the process of quitting.</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Behaviour change: using therapeutic techniques such as cognitive behaviour therapy (CBT), acceptance commitment therapy (ACT) and mindfulness.</p>
                        </list-item>
                    </list>
                </p>
                <p>Subsequently, extracted data from each app were assessed using the MARS rating scale. The MARS evaluation tool is divided into three broad sections: App overall quality, App subjective quality, and App specific quality. It consists of 23 questions designed to help analyse the mobile applications' engagement, functionality, aesthetics, information, and subjective quality. In addition, there are six additional app-specific questions that can be customized to represent the goal health behaviour/function of the application/study. The average scores for each of these four sub-schemes were calculated, and the average scores of these sub-quotas used to evaluate the overall quality score of the application ranged from 0 to 5. Therefore, the total score of these sub-categories would be 0 to 5 and the average score would be calculated by dividing the total score by 4, i.e., four domains. The subjective quality section of the App and the App-specific section of the App were calculated similarly. These, however, were considered as separate from the app quality score. (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>)</p>
                <p>Data regarding the App&#x2019;s features were entered in a 
                    <ext-link ext-link-type="uri" xlink:href="https://www.microsoft.com/en-gb/">Microsoft Excel</ext-link> sheet v 2019 and subjected to statistical analysis to conclude. The two reviewers were trained in the use of MARS using a 37-minute video on 
                    <ext-link ext-link-type="uri" xlink:href="https://youtu.be/25vBwJQIOcE?si=kvkj4xL4r9O6qVIy">YouTube</ext-link>. Subsequently, they conducted an independent assessment of a standard application and discussed their scores.</p>
            </sec>
            <sec id="sec5">
                <title>Statistical analysis</title>
                <p>Data were analysed using descriptive and analytical statistics. Quantitative variables were expressed as means and standard deviations. Kendall&#x2019;s coefficient of concordance was used to calculate the interrater agreement between two raters. Pearson&#x2019;s correlations were used to analyse correlations between app scores (Total score app-quality/mean score) and downloads/ratings and number of downloads with the overall MARS score. A Chi-square test was performed to analyse any association between app focus and app release dates with a p-value of &lt;0.05 considered as significant.</p>
            </sec>
        </sec>
        <sec id="sec6" sec-type="results">
            <title>Results</title>
            <p>A total of 670 apps were retrieved from within the Apple and Android App stores (Android 482; iOS 188). After screening the description available on the web page, 48 apps were excluded as they were duplicate apps present in both the Play stores. [19] Of the 622 apps filtered, 558 apps didn&#x2019;t meet the inclusion criteria and were excluded from the study. After all the exclusions, 20 apps (Android,17; iOS, 3) were subjected to analysis. A flowchart illustrating the selection and exclusion of apps at various stages of the study is shown in the 
                <xref ref-type="fig" rid="f2">Figure 2</xref>. Interrater agreement between two raters showed high reliability (0.804).</p>
            <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                <label>Figure 2. </label>
                <caption>
                    <title>Flowchart for identification of Apps through systematic screening of the available tobacco cessation apps.</title>
                </caption>
                <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/155532/cd9136b1-5eed-4519-aa7d-8dd8fdacd26e_figure2.gif"/>
            </fig>
            <p>All apps were free in their basic version, but 14 required payments to view their upgraded versions. As per their primary focus area, two apps targeted only substance use, while 14 apps focused on goal setting and four apps were aimed at behaviour change (
                <xref ref-type="fig" rid="f3">Figure 3</xref>). Five apps had an app-based community that allowed virtual help. All apps were available for general age groups (
                <xref ref-type="table" rid="T1">Table 1</xref>). Fifteen apps had second or higher versions and the last update of most apps was after June 2023. The mean app rating by consumers in the Google Play store was more than 4 (according to the inclusion criteria) (
                <xref ref-type="table" rid="T2">Table 2</xref>).</p>
            <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                <label>Figure 3. </label>
                <caption>
                    <title>Pie diagram depicting the distribution of apps based on their primary focus.</title>
                </caption>
                <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/155532/cd9136b1-5eed-4519-aa7d-8dd8fdacd26e_figure3.gif"/>
            </fig>
            <table-wrap id="T1" orientation="portrait" position="float">
                <label>Table 1. </label>
                <caption>
                    <title>Basic attributes of mHealth apps for tobacco cessation.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Characteristics of the app</th>
                            <th align="left" colspan="1" rowspan="1" valign="top"/>
                            <th align="left" colspan="1" rowspan="1" valign="top">Apps n (%)</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Platform</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Android</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">17</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">iOS</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Cost</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Free upgraded versions</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid upgraded versions</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">14</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Year of release</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2010-2014</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">2015-2018</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">2019-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Number of downloads</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Up to ten thousand</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">Up to one million</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">12</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">More than one million</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Primary focus</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Substance use</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">Goal setting</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">14</td>
                        </tr>
                        <tr>
                            <td colspan="1" rowspan="1"/>
                            <td align="left" colspan="1" rowspan="1" valign="top">Behaviour change</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <table-wrap id="T2" orientation="portrait" position="float">
                <label>Table 2. </label>
                <caption>
                    <title>General attributes of apps included in the study.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">No.</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">App name</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Rating</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Last update</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Cost</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smoke Free- Stop Smoking Now</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">17-06-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quitsure</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">26-07-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Now: Quit Smoking for Good</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">17-07-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Stop Tobacco Mobile Trainer. Quit Smoking App</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">22-06-2022</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Easy Quit Stop Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">24-11-2022</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smokefree &#x2013; stop smoking now</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">17-06-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smoking Log</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">15-07-2022</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Free</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">8</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Now: My Quitbuddy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">17-07-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Free</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Craving To Quit!</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">09-05-2022</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit It- Stop Smoking Today</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">17-06-2019</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">11</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Tracker: Stop Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">24-03-2022</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">12</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smokefree: Quit smoking slowly</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.1</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">13-11-2020</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">13</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Kwit- Quit Smoking for Good</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">28-07-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">14</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quitstart</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">16-05-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Free</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">15</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Stop smoking - Stay sober</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">05-02-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">16</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">No Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">20-11-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">17</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Qwit</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.1</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10-08-2023</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Free</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">18</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking- Stop Tobacco Mobile Trainer</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5 years ago</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Paid</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">19</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking- Get Healthy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3 years ago</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Free</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">20</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">10 months ago</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Free</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>
                <xref ref-type="table" rid="T3">Table 3</xref> gives the mean app quality ratings scored under engagement, functionality, aesthetics and information domains. The Craving To Quit! and QuitSure apps recorded a score of 4.75 and above in all four domains. Whereas, the SmokeFree: Quit smoking slowly and Qwit apps had scores of 3.7 or below in all the domains. The average score of the above four domains, that is the App quality mean score, was highest for the QuitSure app (4.88) and Craving To Quit! app (4.83).</p>
            <table-wrap id="T3" orientation="portrait" position="float">
                <label>Table 3. </label>
                <caption>
                    <title>Mean app quality ratings scored under engagement, functionality, aesthetics and information domains.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">No.</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">App name</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Engagement mean score</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Functionality mean score</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Esthetics mean score</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Information mean score</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smoke Free- Stop Smoking Now</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quitsure</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.8</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Now: Quit Smoking for Good</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.2</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Stop Tobacco Mobile Trainer. Quit Smoking App</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Easy Quit Stop Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smokefree-stop smoking now</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smoking Log</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">8</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Now: My Quitbuddy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Craving To Quit!</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.8</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.8</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit It- Stop Smoking Today</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.33</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">11</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Tracker: Stop Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.25</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">12</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smokefree: Quit smoking slowly</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.33</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">13</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Kwit- Quit Smoking for Good</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.8</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.8</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">14</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quitstart</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.8</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">15</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Stop smoking - Stay sober</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">16</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">No Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.8</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.33</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">17</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Qwit</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">18</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking- Stop Tobacco Mobile Trainer</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.67</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.2</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">19</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking- Get Healthy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">20</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.8</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.6</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>The MARS overall mean score was then calculated by calculating an average of App quality mean score, App subjective mean score and App specific mean score. We observed that the QuitSure app (4.9), Craving To Quit! app (4.8) and Stop Tobacco Mobile Trainer: Quit Smoking App (4.74) were ranked the highest according to the MARS overall mean score. Whereas, Smokefree: Quit smoking slowly (3.1) and Qwit (3.2) scored the least (
                <xref ref-type="table" rid="T4">Table 4</xref>).</p>
            <table-wrap id="T4" orientation="portrait" position="float">
                <label>Table 4. </label>
                <caption>
                    <title>The scores of each Mobile Application Rating Scale (MARS) domain and overall MARS score of the studied apps.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">No.</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Android app name</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">App quality mean score</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">App subjective mean score</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">App specific mean score</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">MARS overall mean score</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smoke Free- Stop Smoking Now</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.55</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.25</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.33</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.37</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quitsure</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.88</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.83</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.9</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Now: Quit Smoking for Good</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.53</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.16</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.23</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Stop Tobacco Mobile Trainer. Quit Smoking App</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.73</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.74</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Easy Quit Stop Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.65</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.38</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smokefree-stop smoking now</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.66</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.52</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smoking Log</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.61</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.66</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.42</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">8</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Now: My Quitbuddy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.59</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.25</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.66</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.5</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Craving To Quit!</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.83</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.83</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.8</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit It- Stop Smoking Today</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.52</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.33</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.28</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">11</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Tracker: Stop Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.27</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.25</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.16</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.23</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">12</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Smokefree: Quit smoking slowly</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.35</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.11</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">13</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Kwit- Quit Smoking for Good</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.69</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.66</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.7</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">14</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quitstart</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.93</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.83</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.75</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">15</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Stop smoking - Stay sober</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.66</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.68</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">16</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">No Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.62</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.33</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.48</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">17</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Qwit</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.49</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.16</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.21</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">18</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking- Stop Tobacco Mobile Trainer</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.44</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4.56</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">19</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking- Get Healthy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.66</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.77</bold>
                            </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">20</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Quit Smoking</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.85</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.75</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.83</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3.81</bold>
                            </td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>We examined if there was any correlation between average review scores and overall MARS scores. There was a moderate, positive correlation seen, which was statistically significant (r = 0.395, n = 20, p = 0.038). Also, a moderate, positive correlation between the number of downloads and the overall MARS score was seen (r = 0.480, n = 20, p = 0.013).</p>
            <p>A Chi-square test was performed to analyse any association between app focus and app release dates. Older apps focussed more on mere goal setting or substance use, as compared to behaviour change. Apps that have been recently developed are now focussing more on behaviour change and these results were statistically significant (P value = 0.000).</p>
        </sec>
        <sec id="sec7" sec-type="discussion">
            <title>Discussion</title>
            <p>This study reviewed mobile applications for quitting smoking and used the MARS scale to rate the apps' quality. It is one of the most popular scales for evaluating the value and content of mHealth apps. It is a multidimensional tool for assessing the quality using semantic analysis and synthesis of existing literature.
                <sup>
                    <xref ref-type="bibr" rid="ref15">15</xref>
                </sup> Engagement, functionality, aesthetics, and information quality are the four main dimensions that are assessed (
                <xref ref-type="fig" rid="f1">Figure 1</xref>). The initial validation study demonstrated strong objectivity and reliability for the overall scale and subscales.
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref17">17</xref>
                </sup> The MARS' applicability for quality assessment was proved by a validation study with metric evaluation.
                <sup>
                    <xref ref-type="bibr" rid="ref17">17</xref>
                </sup> As a result, MARS might be utilised to make the quality of apps transparent to patients and healthcare stakeholders.</p>
            <p>Our study found more than 622 smoking cessation apps in both platforms. It is concerning that the app stores for smoking cessation applications is saturated with apps of low quality, perhaps making it difficult for users who aren't the most selective to find higher-quality apps. This study reviewed 20 of these apps aimed at helping people quit smoking in order to evaluate their quality and distinguishing characteristics.</p>
            <p>In this study, we classified apps based on their primary goals: goal setting, substance use, and behaviour change. Most of apps with the primary focus as goal setting functioned as trackers for cravings, calendars, number of cigarettes not smoked and the amount of money saved. These results are similar to the study conducted by Vilardaga 
                <italic toggle="yes">et al</italic>.,
                <sup>
                    <xref ref-type="bibr" rid="ref9">9</xref>
                </sup> and Hoeppner 
                <italic toggle="yes">et al</italic>.,
                <sup>
                    <xref ref-type="bibr" rid="ref11">11</xref>
                </sup>
            </p>
            <p>The results of our study are consistent with the results of earlier reviews. Education and behavioural methods are the two areas that most frequently appear in mHealth apps.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref9">9</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref18">18</xref>
                </sup> By changing their behaviour, people can better their prognosis, lessen pain or suffering, and take control of their health. According to the findings of our study, the apps that focus on behaviour modification had higher user ratings and overall MARS scores with many features.</p>
            <p>Goal-setting and substance use are two additional crucial components of tobacco cessation applications. These apps function by asking users to enter their cigarette consumption before creating their own objective goals for quitting. The app also offers resources and data to help users track their progress towards their goals and maintain their motivation to stop using tobacco. However, it has been noted that the number of goal-setting apps has dropped over time.</p>
            <p>Our study thus points to a potential market for developing behaviour change targeting apps that offer knowledge and expertise for controlling the quitting process. Like in previous studies, apps that utilize behaviour change and cognitive techniques, which are evidence based, such as the 5 A&#x2019;s, acceptance and commitment therapy and hypnosis were having the highest MARS score among all the apps.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref13">13</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref14">14</xref>
                </sup>
            </p>
            <p>The aesthetic and information subscales had slightly lower mean scores than the engagement and functionality subscales, which shows that even though the apps had good graphics, a pleasing visual appearance, and accurate descriptions and information, it is still crucial that the target audience is well-engaged and is persuaded to use the apps. The results of previous studies using MARS for quality assessment of mobile apps for the management of tinnitus
                <sup>
                    <xref ref-type="bibr" rid="ref20">20</xref>
                </sup> and asthma management
                <sup>
                    <xref ref-type="bibr" rid="ref21">21</xref>
                </sup> showed the engagement and aesthetic scores were lower, which indicates that these factors are less important in the design of health management apps. These noticeable features could be improved and developed in the next version of the apps.</p>
            <p>Generally, while creating an app, developers must take into account both intriguing and crucial features as well as high-quality, fact-based material. The typical mean scores for engagement and functionality point to prospective areas that could be improved. Further research like randomised controlled trials need to be done to determine whether these apps result in behaviour change, and not just improvement in knowledge.</p>
            <p>This study contains some limitations. First, popularity is the basis for app store rankings. As a result, the top apps that each search displayed did not always represent the best apps. We did not have access to numerous international apps created exclusively for use within each nation as phone numbers were required for registration and app usage. Applications go through upgrades and modifications frequently. Several apps assessed may have been upgraded to newer versions since the MARS evaluation was conducted. The most recent version and these updates could change the outcome of this research. Also, given that the apps were only used once and the quality ratings were based on brief usage, it's probable that some features were overlooked by the reviewers while evaluating the apps. The strength of our study is that the raters paid for the upgraded version of a number of apps to access the full version so as to not miss any distinguishable features of those apps.</p>
        </sec>
        <sec id="sec8" sec-type="conclusions">
            <title>Conclusions</title>
            <p>The content and functionality of behaviour change-focused applications were of higher quality than those of other app categories. These recently developed mHealth apps can effectively supersede the traditional smoking cessation methods. This study can be a reference for those who use and create smoking cessation apps. Users can select the best smoking cessation app for their needs by using the classification of the application.</p>
        </sec>
    </body>
    <back>
        <sec id="sec11" sec-type="data-availability">
            <title>Data availability</title>
            <sec id="sec12">
                <title>Underlying data</title>
                <p>Open Science Framework: Underlying data for &#x2018;Mobile applications (apps) for tobacco cessation: Behaviour change potential and heuristic analysis using the Mobile Application Rating Scale (MARS)&#x2019;, 
                    <ext-link ext-link-type="uri" xlink:href="https://www.doi.org/10.17605/OSF.IO/JNBPF">https://www.doi.org/10.17605/OSF.IO/JNBPF</ext-link>.
                    <sup>

                        <xref ref-type="bibr" rid="ref19">19</xref>
</sup>
                </p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0)</p>
            </sec>
        </sec>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chhabra</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hussain</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rashid</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Recent trends of tobacco use in India.</article-title>
                    <source>

                        <italic toggle="yes">J. Public Health.</italic>
</source>
                    <year>2021 Feb</year>;<volume>29</volume>:<fpage>27</fpage>&#x2013;<lpage>36</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s10389-019-01091-3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="other">
                    <collab>Tobacco Cessation in Dental Settings- Reference Manual for Dental Professionals</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://dciindia.gov.in/Download/Reference%20Manual%20for%20Tobacco%20Cessation.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nagpal</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nagpal</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mehendiratta</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Usage of betel quid, areca nut, tobacco, alcohol and level of awareness towards their adverse effects on health in a north Indian rural population.</article-title>
                    <source>

                        <italic toggle="yes">Oral Health Dent Manag.</italic>
</source>
                    <year>2014 Mar 1</year>;<volume>13</volume>(<issue>1</issue>):<fpage>81</fpage>&#x2013;<lpage>86</lpage>.
                    <pub-id pub-id-type="pmid">24603921</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="other">
                    <collab>Tobacco dependence treatment guidelines</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://ntcp.mohfw.gov.in/assets/document/Guideline-manuals/Tobacco-Dependence-Treatment-Guidelines.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bustamante</surname>
                            <given-names>LA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>M&#x00e9;nard</surname>
                            <given-names>CG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Julien</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Behavior change techniques in popular mobile apps for smoking cessation in France: content analysis.</article-title>
                    <source>

                        <italic toggle="yes">JMIR Mhealth Uhealth.</italic>
</source>
                    <year>2021 May 13</year>;<volume>9</volume>(<issue>5</issue>):<fpage>e26082</fpage>.
                    <pub-id pub-id-type="pmid">33983130</pub-id>
                    <pub-id pub-id-type="doi">10.2196/26082</pub-id>
                    <pub-id pub-id-type="pmcid">PMC8160788</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Udugama</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kadhiresan</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kozlowski</surname>
                            <given-names>HN</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Diagnosing COVID-19: The Disease and Tools for Detection.</article-title>
                    <source>

                        <italic toggle="yes">ACS Nano.</italic>
</source>
                    <year>2020</year>;<volume>14</volume>(<issue>4</issue>):<fpage>3822</fpage>&#x2013;<lpage>3835</lpage>.
                    <pub-id pub-id-type="doi">10.1021/acsnano.0c02624</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nayak</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nayak</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vikneshan</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Smartphone apps: A state-of-the-art approach for oral health education.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Oral Research.</italic>
</source>
                    <year>2019 Oct 31</year>;<volume>8</volume>(<issue>5</issue>):<fpage>386</fpage>&#x2013;<lpage>393</lpage>.
                    <pub-id pub-id-type="doi">10.17126/joralres.2019.060</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Parker</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bharmal</surname>
                            <given-names>RV</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sharif</surname>
                            <given-names>MO</given-names>
                        </name>
</person-group>:
                    <article-title>The availability and characteristics of patient-focused oral hygiene apps.</article-title>
                    <source>

                        <italic toggle="yes">Br. Dent. J.</italic>
</source>
                    <year>2019 Apr 26</year>;<volume>226</volume>(<issue>8</issue>):<fpage>600</fpage>&#x2013;<lpage>604</lpage>.
                    <pub-id pub-id-type="pmid">31028329</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41415-019-0197-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Vilardaga</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Casellas-Pujol</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>McClernon</surname>
                            <given-names>JF</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mobile applications for the treatment of tobacco use and dependence.</article-title>
                    <source>

                        <italic toggle="yes">Curr. Addict. Rep.</italic>
</source>
                    <year>2019 Jun 15</year>;<volume>6</volume>:<fpage>86</fpage>&#x2013;<lpage>97</lpage>.
                    <pub-id pub-id-type="pmid">32010548</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s40429-019-00248-0</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6994183</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wallace</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Clark</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>White</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>&#x201c;It&#x2019;s on my iPhone&#x201d;: attitudes to the use of mobile computing devices in medical education, a mixed-methods study.</article-title>
                    <source>

                        <italic toggle="yes">BMJ Open.</italic>
</source>
                    <year>2012</year>;<volume>2</volume>(<issue>4</issue>):<fpage>e001099</fpage>.
                    <pub-id pub-id-type="pmid">22923627</pub-id>
                    <pub-id pub-id-type="doi">10.1136/bmjopen-2012-001099</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3432838</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hoeppner</surname>
                            <given-names>BB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hoeppner</surname>
                            <given-names>SS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Seaboyer</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>How smart are smartphone apps for smoking cessation? A content analysis.</article-title>
                    <source>

                        <italic toggle="yes">Nicotine Tob. Res.</italic>
</source>
                    <year>2016 May 1</year>;<volume>18</volume>(<issue>5</issue>):<fpage>1025</fpage>&#x2013;<lpage>1031</lpage>.
                    <pub-id pub-id-type="pmid">26045249</pub-id>
                    <pub-id pub-id-type="doi">10.1093/ntr/ntv117</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5942604</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Robinson</surname>
                            <given-names>CD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Seaman</surname>
                            <given-names>EL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Grenen</surname>
                            <given-names>E</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A content analysis of smartphone apps for adolescent smoking cessation.</article-title>
                    <source>

                        <italic toggle="yes">Transl. Behav. Med.</italic>
</source>
                    <year>2020 Feb</year>;<volume>10</volume>(<issue>1</issue>):<fpage>302</fpage>&#x2013;<lpage>309</lpage>.
                    <pub-id pub-id-type="pmid">30476293</pub-id>
                    <pub-id pub-id-type="doi">10.1093/tbm/iby113</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7295698</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Thornton</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Quinn</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Birrell</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Free smoking cessation mobile apps available in Australia: a quality review and content analysis.</article-title>
                    <source>

                        <italic toggle="yes">Aust. N. Z. J. Public Health.</italic>
</source>
                    <year>2017 Dec 1</year>;<volume>41</volume>(<issue>6</issue>):<fpage>625</fpage>&#x2013;<lpage>630</lpage>.
                    <pub-id pub-id-type="pmid">28749591</pub-id>
                    <pub-id pub-id-type="doi">10.1111/1753-6405.12688</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Seo</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cho</surname>
                            <given-names>SI</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yoon</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Classification of smoking cessation apps: quality review and content analysis.</article-title>
                    <source>

                        <italic toggle="yes">JMIR Mhealth Uhealth.</italic>
</source>
                    <year>2022 Feb 17</year>;<volume>10</volume>(<issue>2</issue>):<fpage>e17268</fpage>.
                    <pub-id pub-id-type="pmid">35175213</pub-id>
                    <pub-id pub-id-type="doi">10.2196/17268</pub-id>
                    <pub-id pub-id-type="pmcid">PMC8895289</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Stoyanov</surname>
                            <given-names>SR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hides</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kavanagh</surname>
                            <given-names>DJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mobile app rating scale: a new tool for assessing the quality of health mobile apps.</article-title>
                    <source>

                        <italic toggle="yes">JMIR Mhealth Uhealth.</italic>
</source>
                    <year>2015 Mar 11</year>;<volume>3</volume>(<issue>1</issue>):<fpage>e3422</fpage>.
                    <pub-id pub-id-type="doi">10.2196/mhealth.3422</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Stoyanov</surname>
                            <given-names>SR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hides</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kavanagh</surname>
                            <given-names>DJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Development and validation of the user version of the Mobile Application Rating Scale (uMARS).</article-title>
                    <source>

                        <italic toggle="yes">JMIR Mhealth Uhealth.</italic>
</source>
                    <year>2016 Jun 10</year>;<volume>4</volume>(<issue>2</issue>):<fpage>e5849</fpage>.
                    <pub-id pub-id-type="doi">10.2196/mhealth.5849</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Terhorst</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Philippi</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sander</surname>
                            <given-names>LB</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Validation of the Mobile Application Rating Scale (MARS).</article-title>
                    <source>

                        <italic toggle="yes">PLoS One.</italic>
</source>
                    <year>2020 Nov 1</year>;<volume>15</volume>(<issue>11 November</issue>):<fpage>e0241480</fpage>.
                    <pub-id pub-id-type="pmid">33137123</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0241480</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7605637</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Roy</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nayak</surname>
                            <given-names>PP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shenoy</surname>
                            <given-names>PR</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Availability and Content Analysis of Smartphone Applications on Conservative Dentistry and Endodontics Using Mobile Application Rating Scale (MARS).</article-title>
                    <source>

                        <italic toggle="yes">Current Oral Health Reports.</italic>
</source>
                    <year>2022 Dec</year>;<volume>9</volume>(<issue>4</issue>):<fpage>215</fpage>&#x2013;<lpage>225</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s40496-022-00325-w</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <label>19</label>
                <mixed-citation publication-type="data">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nayak</surname>
                            <given-names>PP</given-names>
                        </name>
</person-group>:
                    <data-title>Underlying data for &#x2018;Mobile applications (apps) for tobacco cessation: Behaviour change potential and heuristic analysis using the Mobile Application Rating Scale (MARS)&#x2019;.</data-title>[Dataset].
                    <source>

                        <italic toggle="yes">Open Science Framework.</italic>
</source>
                    <year>2023</year>.
                    <pub-id pub-id-type="doi">10.17605/OSF.IO/JNBPF</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ramsey</surname>
                            <given-names>RR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Caromody</surname>
                            <given-names>JK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Voorhees</surname>
                            <given-names>SE</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A Systematic Evaluation of Asthma Management Apps Examining Behavior Change Techniques.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Allergy and Clinical Immunology: In Practice.</italic>
</source>
                    <year>2019 Nov 1</year>;<volume>7</volume>(<issue>8</issue>):<fpage>2583</fpage>&#x2013;<lpage>2591</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.jaip.2019.03.041</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sereda</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Smith</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Newton</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mobile apps for management of tinnitus: Users&#x2019; survey, quality assessment, and content analysis.</article-title>
                    <source>

                        <italic toggle="yes">JMIR Mhealth Uhealth.</italic>
</source>
                    <year>2019</year>;<volume>7</volume>(<issue>1</issue>):<fpage>e10353</fpage>.
                    <pub-id pub-id-type="pmid">30672739</pub-id>
                    <pub-id pub-id-type="doi">10.2196/10353</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6364200</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report327336">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.155532.r327336</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Harish</surname>
                        <given-names>Ranjani</given-names>
                    </name>
                    <xref ref-type="aff" rid="r327336a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <contrib contrib-type="author">
                    <name>
                        <surname>Sharma</surname>
                        <given-names>Nitika</given-names>
                    </name>
                    <xref ref-type="aff" rid="r327336a1">1</xref>
                    <role>Co-referee</role>
                </contrib>
                <contrib contrib-type="author">
                    <name>
                        <surname>Vincy</surname>
                        <given-names>Catherine</given-names>
                    </name>
                    <xref ref-type="aff" rid="r327336a1">1</xref>
                    <role>Co-referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-1699-2695</uri>
                </contrib>
                <aff id="r327336a1">
                    <label>1</label>Madras Diabetes Research Foundation, Chennai, Tamil Nadu, India</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>18</day>
                <month>10</month>
                <year>2024</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2024 Harish R et al.</copyright-statement>
                <copyright-year>2024</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport327336" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.142038.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <bold>General Comments:&#x00a0; </bold>The aim of the study was to identify tobacco cessation apps on Apple and Android app stores and to categorize and analyse their features as regards to engagement, functionality, aesthetics, and information quality. Thereby recommending directions for the improvement of these apps.</p>
            <p> </p>
            <p> 
                <bold>Specific Comments:</bold>
            </p>
            <p> 
                <bold>Title:</bold>
                <bold> </bold> 
                <list list-type="order">
                    <list-item>
                        <p>Please specify the type of review in the title to facilitate better understanding of the article.&#x00a0;</p>
                    </list-item>
                </list> 
                <bold>Abstract:</bold> 
                <list list-type="order">
                    <list-item>
                        <p>MARS (Mobile Application Rating Scale) could have been incorporated into the keywords to enhance the specificity.</p>
                    </list-item>
                </list> 
                <bold>Introduction</bold> 
                <list list-type="order">
                    <list-item>
                        <p>Kindly give reference for the following lines in the introduction section: &#x201c;The majority of people making independent attempts fail to maintain their quit status for even one month.&#x201d;</p>
                    </list-item>
                    <list-item>
                        <p>The second para of this section provides statistics on tobacco cessation from India. However, the following paragraph discusses global statistics on smartphone users, which appears to be out of sync with the flow of information. To maintain coherence, it would be better to align the information properly.</p>
                    </list-item>
                    <list-item>
                        <p>The rationale of the review was well articulated in the introduction although a little more background on MARS and its scoring system and how it helps in heuristically evaluating the mhealth applications could be provided to strengthen the foundation of the study.</p>
                    </list-item>
                </list> 
                <bold>Methodology:</bold> 
                <list list-type="order">
                    <list-item>
                        <p>The introduction highlights that rankings in app stores are highly volatile and primarily influenced by app usability, meaning that an app's behaviour change potential cannot be fully assessed based on its ratings or popularity alone. However, the inclusion criteria in the methods section focus on selecting apps with a rating of 4 stars or higher and more than 10,000 downloads. Justify.</p>
                    </list-item>
                    <list-item>
                        <p>The inclusion of only apps with a rating of 4 stars or higher and over 10,000 downloads might exclude newer or less popular apps that could still be effective. This introduces a bias towards more established apps. Kindly justify.</p>
                    </list-item>
                    <list-item>
                        <p>The reviewers were trained using a 37-minute YouTube video. Please answer the following questions:</p>
                        <p> a)&#x00a0;It may not be sufficient for thorough, expert-level assessment using the MARS tool. Kindly comment.</p>
                        <p> b)&#x00a0;While a high interrater reliability (0.804) is reported, no additional details are provided on how discrepancies between reviewers were resolved. This could affect the validity of the scoring and analysis if disagreements were not consistently addressed. Justify.</p>
                        <p> c) How reliable and authentic was the video? It is suggested to include the link for the video in the references.&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>There&#x2019;s no mention of how frequently the apps were updated or if the study accounted for updates during the research period in the methods section. App features and functionalities can change significantly with updates, which could affect the evaluation. It is suggested to include details regarding the same.</p>
                    </list-item>
                    <list-item>
                        <p>Less information is provided on the availability of the mhealth application, especially if is it limited to India (developed) or Indian context. This may be an important factor as some of the apps belonging to the western population could not be practical for lifestyle or behaviour change therapies among Asian Indians.</p>
                    </list-item>
                    <list-item>
                        <p>Statistical analyses used in the review seem basic thus undermining the actual benefits of the application and how it could be practically applied. Although the review outlines the combined effects of all the 20 applications, additional specifications or features of at least the top 5 applications could be briefed out to demonstrate how pragmatic these apps are for everyday practise.</p>
                    </list-item>
                </list> 
                <bold>Results:</bold> 
                <list list-type="order">
                    <list-item>
                        <p>It is recommended to provide a separate breakdown in Figure 2 for each reviewer, rather than presenting an overall summary. For example, indicate how many apps were identified by Reviewer 1 and how many were identified by Reviewer 2 using the search terms.</p>
                    </list-item>
                    <list-item>
                        <p>While the study title emphasizes behaviour change, "Mobile applications (apps) for tobacco cessation: Behaviour change potential and heuristic analysis using the Mobile Application Rating Scale (MARS)," the majority of the apps reviewed (14) primarily focused on goal-setting, with only 4 targeting behaviour change directly. Justify.</p>
                    </list-item>
                    <list-item>
                        <p>The final number of apps subjected to analysis (20 out of 670) is very small (only 3 apps from iOS). The sample size may be too small to yield reliable or meaningful statistical significance. This limits the generalizability of the findings</p>
                    </list-item>
                    <list-item>
                        <p>"Chi-square test was performed to analyse any association between app focus and app release dates. Older apps focused more on mere goal setting or substance use, as compared to behaviour change. Apps that have been recently developed are now focusing more on behaviour change and these results were statistically significant (P value = 0.000)."</p>
                        <p> </p>
                        <p> What is the definition of older apps? According to table 1, 50% apps were release between years 2019-2023 and an equal number were updated in 2023. This contradicts the results where the authors have mentioned that there were only 4 apps targeting behaviour change.</p>
                    </list-item>
                    <list-item>
                        <p>Table showing correlation and chi square test is missing.</p>
                    </list-item>
                    <list-item>
                        <p>It is suggested to remove pie chart as this is not adding any value to the manuscript.</p>
                    </list-item>
                    <list-item>
                        <p>Further explanation of statistical tests, confidence intervals, and potential confounding factors would enhance the clarity and rigor of the analysis. Additionally, providing more detail on the interpretation of correlations and the significance of app focus trends would strengthen the discussion of results.</p>
                    </list-item>
                </list> 
                <bold>Discussion:</bold> 
                <list list-type="order">
                    <list-item>
                        <p>This is the line from discussion section: &#x201c;According to the findings of our study, the apps that focus on behaviour modification had higher user ratings and overall MARS scores with many features.&#x201d;</p>
                        <p> a)&#x00a0;Since, authors are talking a lot about these apps. In the results section as well It is suggested to include the app names based on this categorisation in the results section for clearer reference.</p>
                        <p> b)&#x00a0;Also, while the study notes that most apps focussed on goal setting. There is little exploration of the implications of having a majority of apps focused on goal setting rather than behaviour change.</p>
                    </list-item>
                    <list-item>
                        <p>Some points mentioned in other sections of the study are repeated, such as the focus on the MARS scale and its dimensions. Kindly avoid such repetitions.</p>
                    </list-item>
                    <list-item>
                        <p>"Our study found more than 622 smoking cessation apps in both platforms. It is concerning that the app stores for smoking cessation applications is saturated with apps of low quality, perhaps making it difficult for users who aren't the most selective to find higher-quality apps."</p>
                        <p> </p>
                        <p> For the above statement, What criteria were used to determine low quality of an app?</p>
                    </list-item>
                    <list-item>
                        <p>The discussion mentions similarities with previous studies but does not provide a detailed comparison or analysis of how the current findings add to or differ from existing literature.</p>
                    </list-item>
                    <list-item>
                        <p>The recommendation for developing more behavior change-focused apps lacks specificity and concrete suggestions on features.</p>
                    </list-item>
                    <list-item>
                        <p>Kindly review the calculation for the apps excluded. The number mentioned in results (558) and the number mentioned in fig 2 (54) gives a difference of 10 which is missed out in the review. Recheck and update the table or the count.</p>
                    </list-item>
                    <list-item>
                        <p>While the discussion does a great job of highlighting the importance of behavior change apps, it could benefit from a deeper exploration of why behavior change techniques (e.g., cognitive-behavioral therapy, acceptance and commitment therapy) are more effective in driving smoking cessation. A more detailed explanation of the mechanisms behind these techniques, backed by literature, would strengthen the argument and provide additional value to readers who may be unfamiliar with these approaches.</p>
                    </list-item>
                </list> 
                <bold>Final Comments:&#x00a0;</bold>
            </p>
            <p> </p>
            <p> The study aimed to evaluate tobacco cessation apps on Apple and Android app stores, analyzing their features related to engagement, functionality, aesthetics, and information quality. However, it faces issues with justifying its inclusion criteria, addressing the small sample size, and providing specific recommendations for improving behaviour change-focused apps.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however we have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment12833-327336">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Nayak</surname>
                            <given-names>Prajna</given-names>
                        </name>
                        <aff>Manipal Academy of Higher Education, India</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>Authors do not have any competing interests</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>15</day>
                    <month>11</month>
                    <year>2024</year>
                </pub-date>
            </front-stub>
            <body>
                <p>General Comments:&#x00a0;The aim of the study was to identify tobacco cessation apps on Apple and Android app stores and to categorize and analyze their features as regards to engagement, functionality, aesthetics, and information quality. Thereby recommending directions for the improvement of these apps.</p>
                <p> </p>
                <p> Specific Comments:</p>
                <p> Title: Please specify the type of review in the title to facilitate better understanding of the article.</p>
                <p> Author Response :&#x00a0;We thank the reviewer for their suggestion, the &#x2018;abstract&#x2019; has been edited to make it clear. We could not add the type of review in the title, as it can lengthen the title further (19 words).</p>
                <p> </p>
                <p> Abstract:</p>
                <p> MARS (Mobile Application Rating Scale) could have been incorporated into the keywords to enhance the specificity.</p>
                <p> Author Response :&#x00a0;We have now added it ma&#x2019;am.</p>
                <p> </p>
                <p> Introduction 
                    <list list-type="order">
                        <list-item>
                            <p>Kindly give reference for the following lines in the introduction section: &#x201c;The majority of people making independent attempts fail to maintain their quit status for even one month.&#x201d;</p>
                        </list-item>
                        <list-item>
                            <p>The second para of this section provides statistics on tobacco cessation from India. However, the following paragraph discusses global statistics on smartphone users, which appears to be out of sync with the flow of information. To maintain coherence, it would be better to align the information properly.</p>
                        </list-item>
                        <list-item>
                            <p>The rationale of the review was well articulated in the introduction although a little more background on MARS and its scoring system and how it helps in heuristically evaluating the mhealth applications could be provided to strengthen the foundation of the study.</p>
                        </list-item>
                    </list> Author Response : 
                    <list list-type="order">
                        <list-item>
                            <p>We have now added the reference, ma&#x2019;am.</p>
                        </list-item>
                        <list-item>
                            <p>.We have now provided India statistics to synchronize with the tobacco cessation statistics.</p>
                        </list-item>
                        <list-item>
                            <p>We have now provided details on the MARS scale. More details are available in the methodology section ma&#x2019;am.</p>
                        </list-item>
                    </list> Methodology: 
                    <list list-type="order">
                        <list-item>
                            <p>The introduction highlights that rankings in app stores are highly volatile and primarily influenced by app usability, meaning that an app's behavior change potential cannot be fully assessed based on its ratings or popularity alone. However, the inclusion criteria in the methods section focus on selecting apps with a rating of 4 stars or higher and more than 10,000 downloads. Justify.</p>
                        </list-item>
                        <list-item>
                            <p>The inclusion of only apps with a rating of 4 stars or higher and over 10,000 downloads might exclude newer or less popular apps that could still be effective. This introduces a bias towards more established apps. Kindly justify.</p>
                        </list-item>
                        <list-item>
                            <p>The reviewers were trained using a 37-minute YouTube video. Please answer the following questions:</p>
                            <p> a)&#x00a0;It may not be sufficient for thorough, expert-level assessment using the MARS tool. Kindly comment.</p>
                            <p> b)&#x00a0;While a high interrater reliability (0.804) is reported, no additional details are provided on how discrepancies between reviewers were resolved. This could affect the validity of the scoring and analysis if disagreements were not consistently addressed. Justify.</p>
                            <p> c) How reliable and authentic was the video? It is suggested to include the link for the video in the references.&#x00a0;</p>
                        </list-item>
                        <list-item>
                            <p>There&#x2019;s no mention of how frequently the apps were updated or if the study accounted for updates during the research period in the methods section. App features and functionalities can change significantly with updates, which could affect the evaluation. It is suggested to include details regarding the same.</p>
                        </list-item>
                        <list-item>
                            <p>Less information is provided on the availability of the mhealth application, especially if is it limited to India (developed) or Indian context. This may be an important factor as some of the apps belonging to the western population could not be practical for lifestyle or behavior change therapies among Asian Indians.</p>
                        </list-item>
                        <list-item>
                            <p>Statistical analyses used in the review seem basic thus undermining the actual benefits of the application and how it could be practically applied. Although the review outlines the combined effects of all the 20 applications, additional specifications or features of at least the top 5 applications could be briefed out to demonstrate how pragmatic these apps are for everyday practice.</p>
                        </list-item>
                    </list> Author Response :&#x00a0; 
                    <list list-type="order">
                        <list-item>
                            <p>We have now added the justification in the 1
                                <sup>st</sup> para of Discussion, ma&#x2019;am.</p>
                        </list-item>
                        <list-item>
                            <p>We have now added the justification in the 1
                                <sup>st</sup> para of Discussion and also mentioned in the limitations, ma&#x2019;am.</p>
                        </list-item>
                        <list-item>
                            <p>Since the video was uploaded by the developer of the scale himself, we used it as a reference for understanding the scale better. We have also added on how the discrepancies were resolved in the Methods section. 
                                <ext-link ext-link-type="uri" xlink:href="https://www.youtube.com/watch?v=25vBwJQIOcE">(13) MARS training video - YouTube</ext-link> , we have now added the link to the video, ma&#x2019;am.</p>
                        </list-item>
                        <list-item>
                            <p>As the study was conducted in a relatively short period of time, we have not mentioned updates during study period.</p>
                        </list-item>
                        <list-item>
                            <p>Since the Apple and Android App stores both show all the apps, irrespective of the country that developed the app, we could not isolate the Indian apps. Also, we did not have access to numerous international apps created exclusively for use within each nation as phone numbers were required for registration and app usage.</p>
                        </list-item>
                        <list-item>
                            <p>As this could lengthen the manuscript, we could not brief on top 5 apps. Instead, we have tried to summarize the results of top 20 apps distinctly.</p>
                        </list-item>
                    </list> Results: 
                    <list list-type="order">
                        <list-item>
                            <p>It is recommended to provide a separate breakdown in Figure 2 for each reviewer, rather than presenting an overall summary. For example, indicate how many apps were identified by Reviewer 1 and how many were identified by Reviewer 2 using the search terms.</p>
                        </list-item>
                        <list-item>
                            <p>While the study title emphasizes behavior change, "Mobile applications (apps) for tobacco cessation: Behavior change potential and heuristic analysis using the Mobile Application Rating Scale (MARS)," the majority of the apps reviewed (14) primarily focused on goal-setting, with only 4 targeting behavior change directly. Justify.</p>
                        </list-item>
                        <list-item>
                            <p>The final number of apps subjected to analysis (20 out of 670) is very small (only 3 apps from iOS). The sample size may be too small to yield reliable or meaningful statistical significance. This limits the generalizability of the findings</p>
                        </list-item>
                        <list-item>
                            <p>"Chi-square test was performed to analyze any association between app focus and app release dates. Older apps focused more on mere goal setting or substance use, as compared to behavior change. Apps that have been recently developed are now focusing more on behavior change and these results were statistically significant (P value = 0.000)."</p>
                            <p> What is the definition of older apps? According to table 1, 50% apps were release between years 2019-2023 and an equal number were updated in 2023. This contradicts the results where the authors have mentioned that there were only 4 apps targeting behavior change.</p>
                        </list-item>
                        <list-item>
                            <p>Table showing correlation and chi square test is missing.</p>
                        </list-item>
                        <list-item>
                            <p>It is suggested to remove pie chart as this is not adding any value to the manuscript.</p>
                        </list-item>
                        <list-item>
                            <p>Further explanation of statistical tests, confidence intervals, and potential confounding factors would enhance the clarity and rigor of the analysis. Additionally, providing more detail on the interpretation of correlations and the significance of app focus trends would strengthen the discussion of results.</p>
                        </list-item>
                    </list> Author Response :&#x00a0; 
                    <list list-type="order">
                        <list-item>
                            <p>Though both authors downloaded, selected and excluded apps together and then reviewed each app independently.</p>
                        </list-item>
                        <list-item>
                            <p>Since we had to unbiasedly select the apps out of 54 apps, we included only the highly rated and most downloaded apps. Focus of the apps were checked later during the study.</p>
                        </list-item>
                    </list> Nevertheless, other 14 apps, though had primary focus as goal setting, also had behavior counselling in their content. Hence, we have included them. 
                    <list list-type="order">
                        <list-item>
                            <p>Though we initially got 670 apps, the actual tobacco cessation apps were only 54. (Figure 2 flowchart for app identification). Hence, 20 out of 54 were selected, ma&#x2019;am.</p>
                        </list-item>
                        <list-item>
                            <p>We have now added a table mentioning the app release dates and app primary focus. (Table 6).</p>
                        </list-item>
                        <list-item>
                            <p>We have now added it ma&#x2019;am (Table 5)</p>
                        </list-item>
                        <list-item>
                            <p>We have removed the pie chart now.</p>
                        </list-item>
                        <list-item>
                            <p>We have now mentioned.</p>
                        </list-item>
                    </list> Discussion: 
                    <list list-type="order">
                        <list-item>
                            <p>This is the line from discussion section: &#x201c;According to the findings of our study, the apps that focus on behavior modification had higher user ratings and overall MARS scores with many features.&#x201d;</p>
                            <p> a)&#x00a0;Since, authors are talking a lot about these apps. In the results section as well It is suggested to include the app names based on this categorization in the results section for clearer reference.</p>
                            <p> b)&#x00a0;Also, while the study notes that most apps focused on goal setting. There is little exploration of the implications of having a majority of apps focused on goal setting rather than behavior change.</p>
                        </list-item>
                        <list-item>
                            <p>Some points mentioned in other sections of the study are repeated, such as the focus on the MARS scale and its dimensions. Kindly avoid such repetitions.</p>
                        </list-item>
                        <list-item>
                            <p>"Our study found more than 622 smoking cessation apps in both platforms. It is concerning that the app stores for smoking cessation applications is saturated with apps of low quality, perhaps making it difficult for users who aren't the most selective to find higher-quality apps."</p>
                            <p> </p>
                            <p> For the above statement, What criteria were used to determine low quality of an app?</p>
                        </list-item>
                        <list-item>
                            <p>The discussion mentions similarities with previous studies but does not provide a detailed comparison or analysis of how the current findings add to or differ from existing literature.</p>
                        </list-item>
                        <list-item>
                            <p>The recommendation for developing more behavior change-focused apps lacks specificity and concrete suggestions on features.</p>
                        </list-item>
                        <list-item>
                            <p>Kindly review the calculation for the apps excluded. The number mentioned in results (558) and the number mentioned in fig 2 (54) gives a difference of 10 which is missed out in the review. Recheck and update the table or the count.</p>
                        </list-item>
                        <list-item>
                            <p>While the discussion does a great job of highlighting the importance of behavior change apps, it could benefit from a deeper exploration of why behavior change techniques (e.g., cognitive-behavioral therapy, acceptance and commitment therapy) are more effective in driving smoking cessation. A more detailed explanation of the mechanisms behind these techniques, backed by literature, would strengthen the argument and provide additional value to readers who may be unfamiliar with these approaches.</p>
                        </list-item>
                    </list> Author Response :&#x00a0; 
                    <list list-type="order">
                        <list-item>
                            <p>We have now named those apps focusing on behavior change in the results section. Although the primary focus of majority of apps was goal setting, they also had behavior modification components in them.</p>
                        </list-item>
                        <list-item>
                            <p>We have now removed the repetitions, ma&#x2019;am.</p>
                        </list-item>
                        <list-item>
                            <p>Most of the other apps had mere goal setting or basic details of health affects before and after quitting tobacco. Hence we had mentioned like so. We thank the reviewers for drawing attention on this, and we have now corrected the sentence.</p>
                        </list-item>
                        <list-item>
                            <p>We have now added.</p>
                        </list-item>
                        <list-item>
                            <p>We have now added ma&#x2019;am.</p>
                        </list-item>
                        <list-item>
                            <p>We have corrected it.</p>
                        </list-item>
                        <list-item>
                            <p>We have now briefly explained important behavior change techniques for smoking cessation.</p>
                        </list-item>
                    </list>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report236779">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.155532.r236779</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Rey-Re&#x00f1;ones</surname>
                        <given-names>Cristina</given-names>
                    </name>
                    <xref ref-type="aff" rid="r236779a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r236779a1">
                    <label>1</label>Research Support Unit-Camp de Tarragona, Catalan Institute of Health, Tarragona, Spain</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>25</day>
                <month>1</month>
                <year>2024</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2024 Rey-Re&#x00f1;ones C</copyright-statement>
                <copyright-year>2024</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport236779" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.142038.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Dear Author's,</p>
            <p> </p>
            <p> I trust this message finds you well. I recently read your article titled "Mobile Applications (Apps) for Tobacco Cessation: Behavior Change Potential and Heuristic Analysis Using the Mobile Application Rating Scale (MARS) [Version 1; Peer Review: Awaiting Peer Review]." I commend you on addressing a pertinent contemporary need in your research.</p>
            <p> </p>
            <p> The work is presented with clarity and precision. Notably, a total of 21 bibliographic citations are included, with 13 (61%) sourced from the last five years.</p>
            <p> </p>
            <p> In light of the commendable effort, I would like to offer a couple of constructive suggestions for consideration. Firstly, it would be beneficial to specify which of the applications studied have scientific evidence supporting their efficacy, effectiveness, and efficiency. This additional detail would enhance the comprehensiveness of your analysis.</p>
            <p> </p>
            <p> Additionally, I would like to suggest broadening the scope of your study by incorporating other forms of tobacco consumption, such as "vaping" or "e-cigarette," in addition to traditional tobacco use. This expansion would contribute to a more comprehensive understanding of the subject matter.</p>
            <p> </p>
            <p> Once again, congratulations on your valuable contribution to the field. I appreciate your dedication to advancing research in this area.</p>
            <p> </p>
            <p> Kind regards,
                <inline-graphic xlink:href="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAUCAQAAAAngNWGAAAA/0lEQVR4AYXNMSiEcRyA4cfmGHQbCZIipkuxnJgMStlMNmeyD2dwmc8+sZgxYJd9ErIZFHUyYYD7fkr6l4/rnvmtl7+KitrqV/fq2Y5eLY3Z9S48eRLe7BmVZ9qhTLhQ0algzZWQOVKSsCF8OjAnwbxDTWFDUhPK/jMr1H6HE/IqRky2DyvCefuwItwZzodVoYRiLqMkVCXrwpJ9twZ+sgfDYEFYl8wIWxZ9uFf7zkallxlJh4YrLGsKjZRx7VGHhLqwgFUN45DGdb8MeXGpgB4ABZdeDcpZEY51A+hyLKz4S1W4MQWm3AibWtgWmk6dyISa1pSdyWTOlLXVp0+eL9D/ZPfBTNanAAAAAElFTkSuQmCC"/>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>mhealth, tobacco, nursing</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment12832-236779">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Nayak</surname>
                            <given-names>Prajna</given-names>
                        </name>
                        <aff>Manipal Academy of Higher Education, India</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>Authors do not have any conflicting interests</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>15</day>
                    <month>11</month>
                    <year>2024</year>
                </pub-date>
            </front-stub>
            <body>
                <p>We thank the reviewer for their suggestions, we have now made the following corrections:</p>
                <p> 1. As mentioned by the reviewer to add scientific evidence available for the applications studied, we have now added a column in table 2 on the sources of information if available. This will enable readers on the legitimacy of the source.</p>
                <p> 2. We could not add the incorporate other forms of tobacco consumption, such as "vaping" or "e-cigarette," in addition to traditional tobacco use. Because, we had not used these terms in our &#x2018;Search strategy&#x2019;. Addition of these would have resulted in apps designed to assist in quitting e-cigarettes too. Hence, we are afraid we will not be able to incorporate them, now.</p>
            </body>
        </sub-article>
    </sub-article>
</article>
