<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.167902.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Artificial Intelligence in Dietary Recommendations for Type 1 Diabetes: Evaluating the Performance of ChatGPT-4o, Bing AI, and Bard AI</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Alqahtani</surname>
                        <given-names>Nasser S</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-8759-1955</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Community Health Department, Northern Border University, Arar, Saudi Arabia</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:nalqahtaniphd@gmail.com">nalqahtaniphd@gmail.com</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>22</day>
                <month>8</month>
                <year>2025</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2025</year>
            </pub-date>
            <volume>14</volume>
            <elocation-id>812</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>7</day>
                    <month>8</month>
                    <year>2025</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Alqahtani NS</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/14-812/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>Effective dietary management is essential for individuals with type 1 diabetes (T1D). Artificial intelligence (AI) tools such as ChatGPT-4o, Bard AI, and Bing AI are increasingly being used to assist in healthcare tasks, including nutrition advice. This study evaluates the performance of these AI models in generating dietary recommendations when compared to input from human dietitians.</p>
                </sec>
                <sec>
                    <title>Methods</title>
                    <p>Sixty expert-written, hypothetical T1D patient cases were submitted to ChatGPT-4o, Bard AI, and Bing AI. Each model&#x2019;s responses were assessed as either &#x201c;Correct&#x201d; or &#x201c;Incomplete&#x201d; relative to dietitian recommendations. Descriptive statistics and McNemar&#x2019;s test were used to compare pairwise performance across models.</p>
                </sec>
                <sec>
                    <title>Results</title>
                    <p>ChatGPT-4o provided correct recommendations in 60% of cases, followed by Bard AI (50%) and Bing AI (26.7%). McNemar&#x2019;s test showed that ChatGPT-4o significantly outperformed Bing AI (p &lt; 0.05), while performance differences between ChatGPT-4o and Bard AI were not statistically significant (p &gt; 0.05). ChatGPT-4o demonstrated superior resilience across case complexity levels, showed the highest rate of unique correct answers, and exhibited only modest agreement with other models. This highlights ChatGPT-4o&#x2019;s relative independence and robustness. An interactive version of the analysis can be accessed here: 
                        <uri xlink:href="https://cnpdata.shinyapps.io/ai_diabetes/">https://cnpdata.shinyapps.io/ai_diabetes/</uri>
                    </p>
                </sec>
                <sec>
                    <title>Conclusions</title>
                    <p>ChatGPT-4o generated more accurate dietary suggestions than Bing AI and performed comparably to Bard AI. However, AI tools still lack the contextual nuance of human dietitians and should be used to supplement, rather than replace, professional guidance in diabetes care.</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Artificial intelligence</kwd>
                <kwd>Type 1 diabetes</kwd>
                <kwd>Dietary recommendations</kwd>
                <kwd>ChatGPT</kwd>
                <kwd>Bard AI</kwd>
                <kwd>Bing AI</kwd>
                <kwd>Digital health</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>Deanship of Scientific Research at Northern Border University, Arar, KSA</funding-source>
                    <award-id>NBU-FFR-2025-2975-13</award-id>
                </award-group>
                <funding-statement>The author extends his appreciation to the Deanship of Scientific Research at Northern Border University, Arar, KSA, for funding this research work through the project number &#x201c;NBU-FFR-2025-2975-13</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec5" sec-type="intro">
            <title>Introduction</title>
            <p>Diabetes mellitus represents a growing global public health concern. Although previously more prevalent in high-income countries, the condition now affects populations worldwide. This is largely due to increasingly sedentary lifestyles and the consumption of energy-dense, nutrient-poor diets (
                <xref ref-type="bibr" rid="ref15">Saeedi et al., 2019</xref>). Type 1 diabetes (T1D), in particular, is characterised by the autoimmune destruction of pancreatic &#x03b2;-cells, leading to insufficient insulin production and the abnormal regulation of blood glucose levels. Maintaining blood glucose within the target range of 70&#x2013;180 mg/dL is essential to avoid acute complications such as hypoglycaemia and hyperglycaemia (
                <xref ref-type="bibr" rid="ref13">Ogurtsova et al., 2017</xref>). However, achieving this target remains a challenge for most individuals with T1D.</p>
            <p>The global burden of diabetes has grown rapidly. The World Health Organization has estimated 422 million cases as of 2014, a fourfold increase since 1980 and approximately two million deaths up until 2019 (
                <xref ref-type="bibr" rid="ref20">Tyler &amp; Jacobs, 2020</xref>). Challenges for conventional diabetes care include late diagnosis, limited access to multidisciplinary care, and the need for frequent patient follow-ups. Diabetes management also implies active and constant self-regulation by patients, specifically when it comes to their eating choices, which can considerably impact glycaemic control (
                <xref ref-type="bibr" rid="ref8">Hermanns et al., 2022</xref>). There is increasing demand for scalable digital tools to support nutrition guidance, especially in resource-limited settings.</p>
            <p>Lately, advanced AI chatbots have been built upon large language models (LLMs), such as ChatGPT, Google Bard, and Microsoft Bing Chat. These chatbots have been investigated in the context of diabetes nutritional counselling. Such systems can digest a patient&#x2019;s profile and generate personalised meal recommendations, potentially extending professional guidance to increasing numbers of people. For example, a prototype &#x201c;AI dietitian&#x201d; leveraging ChatGPT yielded meal plans consistent with expert nutrition standards. Indeed, registered dietitians rated 96% of the responses as appropriate (
                <xref ref-type="bibr" rid="ref19">Sun et al., 2023</xref>). Others have noted that ChatGPT could support patient education and individualised dietary advice during diabetes care (
                <xref ref-type="bibr" rid="ref18">Sridhar &amp; Gumpeny, 2025</xref>). By embedding LLM chatbots in apps or web portals, patients can receive tailored, on-demand nutrition advice without waiting for clinic appointments (
                <xref ref-type="bibr" rid="ref12">Kassem et al., 2025</xref>). This helps improve accessibility and scalability.</p>
            <p>
These AI tools could also integrate with wearable health sensors, such as continuous glucose monitors, to adjust recommendations in real time (
                <xref ref-type="bibr" rid="ref21">Wang et al., 2025</xref>). This can further enhance personalisation. Nevertheless, current LLMs are not diabetes-specific and can &#x201c;hallucinate&#x201d; errors if unchecked (
                <xref ref-type="bibr" rid="ref18">Sridhar &amp; Gumpeny, 2025</xref>). Any AI-generated diet plan must, therefore, be rigorously evaluated for medical accuracy and appropriateness before clinical use. Ultimately, robust human oversight and validation are essential to ensure that AI-driven guidance is safe, effective, and clinically aligned.</p>
            <p>The goal of this study is:
                <list list-type="order">
                    <list-item>
                        <label>1.</label>
                        <p>Assess whether new dialogue models ChatGPT-4o, Bard AI (Bing AI Reference Design), and Bing AI can provide dietary recommendations for a hypothetical person with T1D.</p>
                    </list-item>
                    <list-item>
                        <label>2.</label>
                        <p>Compare those recommendations to the reference recommendations of a licensed human dietitian.</p>
                    </list-item>
                </list>
            </p>
            <p>The results may aid in establishing the extent to which these devices can function as reliable, inexpensive adjuncts to diabetes nutrition education and self-management.</p>
        </sec>
        <sec id="sec6" sec-type="methods">
            <title>Methods</title>
            <sec id="sec7">
                <title>Study design</title>
                <p>This comparative analysis evaluated the performance of three major LLMs ChatGPT-4o (OpenAI), Bard AI (Google), and Bing AI (Microsoft) when generating dietary recommendations for patients with T1D. A panel of clinical experts developed 60 hypothetical T1D cases. Per case, these incorporated pertinent clinical and lifestyle information, such as insulin regimen, weight, level of activity, and glucose targets.</p>
                <p>All three AI models processed each case separately, and a total dietary assessment and an individualised personalised nutrition plan were carried out with the prompt to do so. The outputs were then compared against the standard of care provided by a registered clinical dietitian.</p>
            </sec>
            <sec id="sec8">
                <title>Evaluation and scoring</title>
                <p>AI responses were independently reviewed by two clinical experts and classified as one of the following two options:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <bold>Correct:</bold> Complete and clinically appropriate dietary guidance, comparable to that of a human dietitian.</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>

                                <bold>Incomplete:</bold> Missing essential components, overly generic, or lacking contextual relevance.</p>
                        </list-item>
                    </list>
                </p>
                <p>Discrepancies between reviewers were resolved by discussion.</p>
            </sec>
            <sec id="sec9">
                <title>Case construction</title>
                <p>The 60 Hypothetical Cases of Type 1 Diabetes were developed in scientific method to guarantee clinical realism and scientific integrity by following these steps:
                    <list list-type="order">
                        <list-item>
                            <label>1.</label>
                            <p>

                                <bold>Expert Authorship</bold>
                            </p>
                            <list list-type="bullet">
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>All cases were created by clinical dietitians licenced as senior specialist from The Saudi Commission for Health Specialties.</p>
                                </list-item>
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>These specialists have worked across tertiary hospitals, diabetes centres in Arar and Riyadh, Saudi Arabia.</p>
                                </list-item>
                            </list>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>

                                <bold>Clinical Validity and Diversity</bold>
                            </p>
                            <list list-type="bullet">
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>Each case scenario has evidence-based parameters relevant to routine T1D, including:</p>
                                    <list list-type="bullet">
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>Age, sex, body weight, insulin regimen and dosage.</p>
                                        </list-item>
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>Physical activity and lifestyle.</p>
                                        </list-item>
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>Glycaemic targets and recent glucose trends.</p>
                                        </list-item>
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>Patients&#x2019; history and medical diagnosis.</p>
                                        </list-item>
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>Biochemistry/Laboratory results.</p>
                                        </list-item>
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>In some cases, details given like meal timing, daily carbohydrate intake.</p>
                                        </list-item>
                                    </list>
                                </list-item>
                            </list>
                            <p>

                                <bold>Source reliability</bold>
                            </p>
                            <list list-type="bullet">
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>Case was adapted from:</p>
                                    <list list-type="bullet">
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>Validated educational material used in American Association of Diabetes Educators (AADE).</p>
                                        </list-item>
                                        <list-item>
                                            <label>&#x25aa;</label>
                                            <p>International standards of care for T1D published by the American Diabetes Association (ADA).</p>
                                        </list-item>
                                    </list>
                                </list-item>
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>All results reviewed and evaluated by senior clinical dietitians.</p>
                                </list-item>
                            </list>
                        </list-item>
                        <list-item>
                            <label>3.</label>
                            <p>

                                <bold>Standardization and Ethical Integrity</bold>
                            </p>
                            <list list-type="bullet">
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>No real patient data were used.</p>
                                </list-item>
                                <list-item>
                                    <label>&#x25cb;</label>
                                    <p>This study has no human subjects were involved; hence it adhered fully to ethical standards for AI evaluation research.</p>
                                </list-item>
                            </list>
                        </list-item>
                    </list>
                </p>
            </sec>
            <sec id="sec10">
                <title>Statistical analysis</title>
                <p>All statistical analyses were conducted using R version 4.4.0 with relevant packages including dplyr, ggplot2, irr, DescTools, and reshape2. Initial analysis quantified the frequency and percentage of correct versus incomplete responses for each model. Numbers and percentages were used to quantify the data.</p>
                <p>To evaluate statistical differences in performance between models, McNemar&#x2019;s test was applied to pairwise comparisons of model outputs. Cohen&#x2019;s kappa coefficients were computed for each pair of models to assess the degree of agreement beyond chance. The magnitude of agreement was interpreted using standard benchmarks: slight (&#x03ba; = 0.01&#x2013;0.20), fair (&#x03ba; = 0.21&#x2013;0.40), moderate (&#x03ba; = 0.41&#x2013;0.60), substantial (&#x03ba; = 0.61&#x2013;0.80), and almost perfect (&#x03ba; = 0.81&#x2013;1.00). Each coefficient was reported with its corresponding p-value.</p>
                <p>A complementarity framework was applied to examine the unique and overlapping contributions of each model. Each case was then categorised based on whether only one, multiple, or none of the models provided a correct response. Frequencies for each pattern were calculated to reveal instances where specific models demonstrated a unique value.</p>
                <p>To assess model sensitivity to task difficulty, each case was classified into one of three complexity categories based on the number of models that provided a correct response: Simple (all three correct), Moderate (two correct), and Complex (zero or one correct). Model accuracy was then computed within each complexity stratum to explore performance variations across difficulty levels. Model outputs were binaries (1 = Correct, 0 = Incomplete), and Pearson correlation coefficients were calculated among the models to assess pairwise linear relationships in decision patterns.</p>
                <p>A heatmap visualisation of the correlation matrix was used to highlight areas of redundancy or divergence in performance. All tests were two-tailed, and statistical significance was determined at an alpha level of 0.05. Finally, ShinyApp (a package in R) was used to create an interactive version of the analysis.</p>
            </sec>
        </sec>
        <sec id="sec11" sec-type="results">
            <title>Results</title>
            <sec id="sec12">
                <title>Overall model accuracy</title>
                <p>Descriptive analysis of response outcomes revealed clear differences in accuracy among the AI models. ChatGPT-4o demonstrated the highest correctness rate, answering 36 out of 60 cases correctly (60%). Bard AI correctly solved 30 cases (50%). Bing AI only generated 16 correct responses (26.7%) (
                    <xref ref-type="table" rid="T1">
Table 1</xref>, 
                    <xref ref-type="fig" rid="f1">
Figure 1</xref>).</p>
                <table-wrap id="T1" orientation="portrait" position="float">
                    <label>
Table 1. </label>
                    <caption>
                        <title>Summary of responses analysis by AI model.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Model</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Correct</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Incomplete</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>ChatGPT-4o</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">36 (60%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">24 (40%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Bard AI</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">30 (50%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">30 (50%)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Bing AI</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">16 (26.7%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">44 (73.3%)</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>
Figure 1. </label>
                    <caption>
                        <title>Correct vs. Incomplete response rates for ChatGPT-4o, Bard AI, and Bing AI.</title>
                    </caption>
                    <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/185047/fe5dbbe0-8272-4d7f-9647-a9a55589ef9a_figure1.gif"/>
                </fig>
            </sec>
            <sec id="sec13">
                <title>McNemar pairwise comparisons</title>
                <p>To statistically evaluate differences in model performance across paired comparisons, a McNemar&#x2019;s chi-square test was conducted for each model pair. The comparison between ChatGPT-4o and Bard AI did not yield a statistically significant difference in accuracy (&#x03c7;
                    <sup>2</sup> = 1.14, p = 0.29). However, significant differences were observed between ChatGPT-4o and Bing AI (&#x03c7;
                    <sup>2</sup> = 10.028, p = 0.002), as well as between Bard AI and Bing AI (&#x03c7;
                    <sup>2</sup> = 5.63, p = 0.02). These findings indicate that both ChatGPT-4o and Bard AI outperform Bing AI at a statistically meaningful level, while the gap between ChatGPT-4o and Bard AI is not significant (
                    <xref ref-type="table" rid="T2">
Table 2</xref>).</p>
                <table-wrap id="T2" orientation="portrait" position="float">
                    <label>
Table 2. </label>
                    <caption>
                        <title>McNemar test pairwise comparison table.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Model pair</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">McNemar's &#x03c7;
                                    <sup>2</sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
p-value
</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">ChatGPT-4o vs Bard AI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1.14</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0.29</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">ChatGPT-4o vs Bing AI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">10.028</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0.002</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Bard AI vs Bing AI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.63</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0.02</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec id="sec14">
                <title>Inter-model agreement: Cohen&#x2019;s Kappa</title>
                <p>Although overall accuracy is informative, it is also critical to examine how frequently the models agree with one another. Cohen&#x2019;s kappa was calculated for each model pair to quantify agreement beyond chance. Agreement between ChatGPT-4o and Bard AI was modest (&#x03ba; = 0.27, p = 0.035), which was categorized as &#x201c;fair agreement&#x201d;. The agreement between ChatGPT-4o and Bing AI was slightly negative (&#x03ba; = -0.097, p = 0.34), indicating less than chance agreement. Bard AI and Bing AI yielded a &#x03ba; of 0 (p = 1), reflecting slight or no agreement (
                    <xref ref-type="table" rid="T3">
Table 3</xref>).</p>
                <table-wrap id="T3" orientation="portrait" position="float">
                    <label>
Table 3. </label>
                    <caption>
                        <title>Cohen&#x2019;s kappa agreement table among models.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Model pair</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Kappa coefficient (P-value)</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Agreement strength</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">ChatGPT-4o vs Bard AI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0.27 (0.035)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Fair</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">ChatGPT-4o vs Bing AI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">-0.097 (0.34)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Less than chance agreement</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Bard AI vs Bing AI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0 (1)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Slight</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec id="sec15">
                <title>Model complementarity</title>
                <p>Complementarity, or the ability of different models to independently provide correct answers when others fail, was examined. For 10 cases, ChatGPT-4o uniquely answered correctly while Bard and Bing AI failed. Bard and Bing AI each had four uniquely correct responses. Only four cases were solved correctly by all three models, while 12 cases were missed by all. These results align with the overall accuracy findings in this study and demonstrate that ChatGPT-4o not only outperforms the other two AI models but also provides the most correct responses in cases where Bard AI and Bing AI both fail (
                    <xref ref-type="fig" rid="f2">
Figure 2</xref>).</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>
Figure 2. </label>
                    <caption>
                        <title>Distribution of correct responses across models highlighting complementarity and unique contributions.</title>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/185047/fe5dbbe0-8272-4d7f-9647-a9a55589ef9a_figure2.gif"/>
                </fig>
            </sec>
            <sec id="sec16">
                <title>Sensitivity to case complexity</title>
                <p>To explore performance sensitivity across varying levels of question difficulty, the dataset was stratified into three cases: Simple (three models correct), Moderate (two models correct), and Complex (zero or one models correct). Accuracy rates across these categories are visualized in 
                    <xref ref-type="fig" rid="f3">
Figure 3</xref>. In simple cases, all models performed at 100% accuracy. For Moderate cases, ChatGPT-4o continued to perform strongly (86.4% accuracy), while Bing AI dropped to 30.8%. The trend held in Complex cases, where ChatGPT-4o maintained 33.3% accuracy, outperforming Bard AI (13.3%) and Bing AI (13.3%). These findings suggest that ChatGPT-4o is more resilient to complexity, while the other models degrade more sharply in performance under challenging conditions (
                    <xref ref-type="fig" rid="f3">
Figure 3</xref>).</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>
Figure 3. </label>
                    <caption>
                        <title>Model accuracy across case complexity categories: Simple, Moderate, and Complex.</title>
                    </caption>
                    <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/185047/fe5dbbe0-8272-4d7f-9647-a9a55589ef9a_figure3.gif"/>
                </fig>
            </sec>
            <sec id="sec17">
                <title>Correlation of model decisions</title>
                <p>Finally, the degree of linear correlation between model outputs was examined using a Pearson correlation heatmap (
                    <xref ref-type="fig" rid="f4">
Figure 4</xref>). The correlation matrix confirms limited agreement between model predictions, which is consistent with previous findings. Notably, ChatGPT-4o and Bard AI showed a moderate positive correlation (r = 0.27), while ChatGPT-4o and Bing AI displayed a weak negative correlation (r = -0.12) (
                    <xref ref-type="fig" rid="f4">
Figure 4</xref>).</p>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>
Figure 4. </label>
                    <caption>
                        <title>Heat map of Pearson correlation coefficients between model outputs for 60 T1D dietary recommendation cases.</title>
                    </caption>
                    <graphic id="gr4" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/185047/fe5dbbe0-8272-4d7f-9647-a9a55589ef9a_figure4.gif"/>
                </fig>
                <p>An interactive version of the analysis can be accessed here: 
                    <ext-link ext-link-type="uri" xlink:href="https://cnpdata.shinyapps.io/ai_diabetes/">https://cnpdata.shinyapps.io/ai_diabetes/</ext-link>
                </p>
            </sec>
        </sec>
        <sec id="sec18" sec-type="discussion">
            <title>Discussion</title>
            <p>The above comparative analysis demonstrates that LLM chatbots can often produce appropriate dietary guidance for T1D patients, with ChatGPT-4o performing best. In this study, ChatGPT-4o provided fully correct nutrition plans in 60% of cases, compared to 50% for Google Bard and 26.7% for Microsoft Bing. Both ChatGPT-4o and Bard significantly outperformed Bing AI (McNemar&#x2019;s test, p &lt; 0.05), while the difference between ChatGPT-4o and Bard was not statistically significant. Notably, in 10 cases, ChatGPT-4o uniquely answered correctly while both other models failed. Only four cases were solved correctly by all three models.</p>
            <p>These results are consistent with emerging literature on AI-supported nutrition counselling. Recent studies have found that ChatGPT&#x2019;s dietary advice often aligns with expert standards. 
                <xref ref-type="bibr" rid="ref19">Sun et al. (2023)</xref>, for instance, showed that ChatGPT&#x2019;s nutrition recommendations for diabetes were largely consistent with best practices, and professional dietitians rated most of its answers as appropriate. Another analysis likewise found that ChatGPT-generated meal plans for diabetes closely follow the American Diabetes Association&#x2019;s plate method (
                <xref ref-type="bibr" rid="ref3">Chatelan et al., 2023</xref>). In that evaluation, the meals included the recommended balance of non-starchy vegetables, proteins, and carbohydrates.</p>
            <p>However, the study also highlighted some of ChatGPT&#x2019;s known limitations. It was found that repeated queries could yield varying menus due to the model&#x2019;s non-determinism (
                <xref ref-type="bibr" rid="ref3">Chatelan et al., 2023</xref>), and some menus included suboptimal or inappropriate foods without warning (e.g. spinach and avocado in a renal diet plan). Even ChatGPT-4o left a substantial minority of scenarios unaddressed, indicating that current chatbots still miss important details in complex diabetic meal planning. The above findings reinforce that although LLMs can simulate expert guidance, their outputs must be carefully reviewed. This is because the models can occasionally produce misleading or incomplete advice.</p>
            <p>There are several reasons why ChatGPT-4o is able to outperform ChatGPT-2o in generating dietetic recommendations. First, its big model size and breadth of available training data on medical literature, nutritional science (
                <xref ref-type="bibr" rid="ref6">Garcia, 2023</xref>), and conversational language (
                <xref ref-type="bibr" rid="ref17">Sharma &amp; Gaur, 2024</xref>) allow the model to answer both scientifically grounded questions and generalise across various dietary situations. This kind of extensive pre-training enables ChatGPT-4o to emulate evidence-based clinical inferences and personalised nutritional advice (
                <xref ref-type="bibr" rid="ref6">Garcia, 2023</xref>; 
                <xref ref-type="bibr" rid="ref17">Sharma &amp; Gaur, 2024</xref>). ChatGPT-4o also works in real time and tends to generate responses that are immediate, uniform, and standardised. In contrast, dieticians&#x2019; recommendations can vary according to individual experiences and/or understandings (
                <xref ref-type="bibr" rid="ref2">Bayram &amp; Ozturkcan, 2024</xref>; 
                <xref ref-type="bibr" rid="ref14">Papastratis et al., 2024</xref>). These aspects likely enabled ChatGPT-4o to (a) exhibit higher performance than Bard and Bing AI and (b) perform similar to, or better than, human dietitians in controlled settings (
                <xref ref-type="bibr" rid="ref14">Papastratis et al., 2024</xref>).</p>
            <p>From a practical standpoint, AI-based tools such as ChatGPT-4o might function as useful supplements for dietitians engaged in T1D care (
                <xref ref-type="bibr" rid="ref20">Tyler &amp; Jacobs, 2020</xref>; 
                <xref ref-type="bibr" rid="ref7">Guan et al., 2023</xref>). In particular, there is the potential to provide rapid, accessible guideline-adherent recommendations that improve care delivery, particularly in areas with limited access to trained nutrition specialists (
                <xref ref-type="bibr" rid="ref5">ElSayed &amp; Aleppo, 2023</xref>). This is especially relevant in low-resource settings, where AI might function as &#x2018;gap filler&#x2019; in patient care (
                <xref ref-type="bibr" rid="ref10">Hou et al., 2023</xref>). It could also promote patient self-administration by providing users with instant, individualised dietary advice (
                <xref ref-type="bibr" rid="ref6">Garcia, 2023</xref>; 
                <xref ref-type="bibr" rid="ref17">Sharma &amp; Gaur, 2024</xref>). As intimated, these tools should not replace human insight and clinical (re) assessment, especially not in complex cases that require nuanced judgement (
                <xref ref-type="bibr" rid="ref14">Papastratis et al., 2024</xref>; 
                <xref ref-type="bibr" rid="ref9">Hieronimus et al., 2024</xref>). That said, they could play a valuable role in diabetes care by extending coverage, amplifying effectiveness, and empowering patients (
                <xref ref-type="bibr" rid="ref20">Tyler &amp; Jacobs, 2020</xref>; 
                <xref ref-type="bibr" rid="ref7">Guan et al., 2023</xref>).</p>
            <p>The evolving literature favours extending AI&#x2019;s reach into the broader realm of diabetes care. Indeed, recent evidence suggests that AI-enabled systems (including LLMs) have tremendous potential to support and even impact decision-making, remote monitoring, and personalised treatment (
                <xref ref-type="bibr" rid="ref20">Tyler &amp; Jacobs, 2020</xref>; 
                <xref ref-type="bibr" rid="ref7">Guan et al., 2023</xref>; 
                <xref ref-type="bibr" rid="ref5">ElSayed &amp; Aleppo, 2023</xref>). Technologies that enhance patient access and engagement in care support while promoting glycaemic control, especially in underserved populations, are available for use (
                <xref ref-type="bibr" rid="ref10">Hou et al., 2023</xref>; 
                <xref ref-type="bibr" rid="ref4">Daly &amp; Hovorka, 2021</xref>). Thus, the present study not only validates the utility of ChatGPT-4o as an adjunct dietary tool but also adds to the increasing range of roles AI technologies are playing in areas such as precision medicine and chronic condition management (
                <xref ref-type="bibr" rid="ref7">Guan et al., 2023</xref>; 
                <xref ref-type="bibr" rid="ref20">Tyler &amp; Jacobs, 2020</xref>).</p>
            <p>The potential clinical impact of reliable AI dietary advice in diabetes is substantial. Sun et al. have, for instance, emphasised how diabetes nutrition management is often hindered by a &#x201c;low supply of registered clinical dietitians&#x201d; (2023, p. 1). In many health systems, patients face long waits or a lack of coverage for nutrition counselling. An AI chatbot such as ChatGPT can, in contrast, provide on-demand, personalised guidance 24 hours a day. ChatGPT is also available via smartphone or computer and can deliver immediate meal suggestions or educational explanations. This can help patients make healthier choices between clinic visits. Early evidence also suggests that people find such AI guidance motivating. A recent study reported that patients using ChatGPT described receiving informational support, personalised recommendations, reminders, and encouragement, with an overall &#x201c;positive impact on [diabetes mellitus] self-management&#x201d; (
                <xref ref-type="bibr" rid="ref1">Alanzi et al., 2025</xref>, p. 1). Thus, if properly integrated (e.g. with glucose-monitoring apps or telehealth services), AI-driven advice could reinforce dietary adherence and thereby improve glycaemic control and reduce complications.</p>
            <p>This study has several strengths, which point to its credibility and clinical value. First, the carefully constructed, real-world, contextualised, hypothetical cases maximise conformity between the dietary scenarios presented and what clinical care providers face during daily T1D management activities (
                <xref ref-type="bibr" rid="ref11">Joslin, 2021</xref>). Such an approach enhances the results&#x2019; generalisability to real healthcare conditions. Second, integrating AI models (ChatGPT-4o, Bard AI, and Bing AI) allows one to compare a wide range of industry-standard digital health technologies. This can, in turn, engender a holistic view of AI performance in dietary recommendation tasks (
                <xref ref-type="bibr" rid="ref14">Papastratis et al., 2024</xref>; 
                <xref ref-type="bibr" rid="ref17">Sharma &amp; Gaur, 2024</xref>). Finally, the use of well-established statistical approaches (e.g. McNemar&#x2019;s test and paired t-tests) resulted in robust evidence for comparing the relative accuracy between the models (
                <xref ref-type="bibr" rid="ref6">Garcia, 2023</xref>). These techniques increased the results&#x2019; credibility and the conclusions&#x2019; appropriateness vis-&#x00e0;-vis AI&#x2019;s comparative effects in dietetic practice (
                <xref ref-type="bibr" rid="ref16">Sharma et al., 2023</xref>).</p>
            <p>Despite the above strengths, there are some limitations to this study. Although designed by experts, the sample of theoretical cases does not exactly reproduce the multiple facets involved when dealing with actual patients. This could impact the results&#x2019; generalisability to live clinic settings (
                <xref ref-type="bibr" rid="ref5">ElSayed &amp; Aleppo, 2023</xref>). The AI-created dietary recommendations were also not subjected to clinical trials or related to patient outcomes. This prevents one from drawing any conclusions related to those recommendations&#x2019; efficacy or safety in clinical terms (
                <xref ref-type="bibr" rid="ref14">Papastratis et al., 2024</xref>).</p>
            <p>Another limitation is that evaluation judgments related to whether responses were &#x201c;correct&#x201d; versus &#x201c;incomplete&#x201d; were the classification criteria, which may introduce bias. This is because, even when based on expert feedback (
                <xref ref-type="bibr" rid="ref9">Hieronimus et al., 2024</xref>), decisions entail some necessary subjectivity. Moreover, as AI continues to develop rapidly, tools such as ChatGPT-4o, Bard AI, and Bing AI will improve rapidly. The results from this study might, therefore, become redundant as subsequent versions of the model are developed (
                <xref ref-type="bibr" rid="ref16">Sharma et al., 2023</xref>). Finally, the evaluation provided each chatbot with a single prompt and did not permit interactive follow-ups. In real clinical use, patients or clinicians would likely refine their questions over multiple turns, which can improve accuracy.</p>
            <p>Ethical and safety concerns must be considered when incorporating AI tools such as ChatGPT-4o into clinical nutrition and diabetes care. While it is possible that AI systems would provide convenient and timely dietary recommendations, rigorous validation and clinical oversight must be available to ensure that the advice is correct, safe, and consistent with evidence-based recommendations (
                <xref ref-type="bibr" rid="ref14">Papastratis et al., 2024</xref>; 
                <xref ref-type="bibr" rid="ref16">Sharma et al., 2023</xref>). Unless thoroughly tested, AI-generated guidance runs the risk of recommending the wrong diet, particularly in complex cases (
                <xref ref-type="bibr" rid="ref9">Hieronimus et al., 2024</xref>). It is also necessary to individualise recommendations according to each patient&#x2019;s needs. AI systems might oversimplify or fail to consider the context of coexisting conditions, psychosocial influences, and cultural preferences. These are factors that a human dietitian tends to properly account for (
                <xref ref-type="bibr" rid="ref3">Chatelan et al., 2023</xref>; 
                <xref ref-type="bibr" rid="ref16">Sharma et al., 2023</xref>).</p>
            <p>In sum, the danger of excessive dependence on unsupervised AI is clear. Although AI can improve care, it should not be used to substitute the subtle clinical judgment and empathy of skilled professionals (
                <xref ref-type="bibr" rid="ref6">Garcia, 2023</xref>; 
                <xref ref-type="bibr" rid="ref17">Sharma &amp; Gaur, 2024</xref>). The need for a balanced implementation of AI as a supportive, rather than an equal partner, is critical to protect patient safety and maintain ethical standards during care provision (
                <xref ref-type="bibr" rid="ref5">ElSayed &amp; Aleppo, 2023</xref>).</p>
            <p>Further investigations into AI-based dietary advice could validate its effectiveness through the use of actual patient data and clinical results. Research based on real patient presentations and care would, in turn, be stronger evidence of AI&#x2019;s use and constraints in real-life scenarios. There is also a need for longitudinal studies to determine the potential longer-range clinical effects of AI-guided dietary planning on glycaemic control, adherence to dietary plan, and the complication rate in people with T1D. Moreover, investigating how AI systems such as ChatGPT-4o can be suitably integrated into the care ecosystem (e.g., EHR) would reduce the time taken to get to care. AI might also bypass being too subjective and avoid basing decisions on a patient&#x2019;s partial record by providing personalised suggestions that consider the individual&#x2019;s whole medical history.</p>
            <p>Promising directions in computational modelling include the process of hybrid models. These can take advantage of AI-generated insights in combination with clinician reviews, thereby balancing efficiency and clinical safety. These sorts of models could, in turn, harness the AI&#x2019;s speed and scale while retaining the essential human oversight that is critical for nuanced decision-making during patient care.</p>
        </sec>
        <sec id="sec19" sec-type="conclusion">
            <title>Conclusion</title>
            <p>In conclusion, the above comparative evaluation suggests that modern AI Chabot particularly ChatGPT-4o, show real promise in their ability to serve as supplementary tools during diabetes nutrition therapy. These models can rapidly generate individualised meal guidance and thereby potentially expand access to expert-level advice. This aligns with a growing consensus that AI can enhance chronic disease self-management. Indeed, patients are increasingly reporting the benefits of using ChatGPT for health education and support.</p>
            <p>Moving forward, clinical trials are needed to test whether integrating AI chatbots into diabetes care through mobile apps or telehealth platforms genuinely improves adherence, patient satisfaction, and metabolic outcomes. If successfully implemented, AI-driven dietary counselling could reduce the burden on healthcare providers and empower patients to more effectively manage their condition. This can ultimately improve both clinical outcomes and overall quality of life.</p>
        </sec>
        <sec id="sec20">
            <title>Preregistered data analysis</title>
            <p>The author did not preregister the research at an independent registry.</p>
        </sec>
        <sec id="sec21">
            <title>Ethical considerations</title>
            <p>This study did not involve human participants, real patient data, or animal subjects. Instead, it utilised hypothetical clinical scenarios. Ethical approval and informed consent were, therefore, not required. All AI-generated responses were assessed in a research context without interacting with the actual individuals.</p>
        </sec>
        <sec id="sec22">
            <title>Author contributions</title>
            <p>(CRediT Taxonomy)
                <list list-type="bullet">
                    <list-item>
                        <label>&#x2022;</label>
                        <p>Conceptualisation, Methodology, Data curation, Writing review and editing: Nasser S. Alqahtani</p>
                    </list-item>
                </list>
            </p>
        </sec>
        <sec id="sec23">
            <title>Software availability</title>
            <p>The AI models used in this study, including 
                <bold>ChatGPT-4o</bold>, 
                <bold>Bard AI</bold>, and 
                <bold>Bing AI</bold>, were accessed via their respective web-based platforms. These tools are proprietary large language models (LLMs) developed by 
                <bold>OpenAI</bold>, 
                <bold>Google</bold>, and 
                <bold>Microsoft</bold>, respectively. While the models themselves are proprietary and not available for direct download, access to these AI platforms can be obtained by visiting their respective websites:
                <list list-type="bullet">
                    <list-item>
                        <label>&#x2022;</label>
                        <p>

                            <bold>ChatGPT-4o</bold>: Accessed via 
                            <ext-link ext-link-type="uri" xlink:href="https://chat.openai.com/">

                                <bold>Open AI&#x2019;s platform</bold>
</ext-link>.</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>

                            <bold>Bard AI</bold>: Accessed via 
                            <ext-link ext-link-type="uri" xlink:href="https://bard.google.com/">

                                <bold>Google Bard</bold>
</ext-link>.</p>
                    </list-item>
                    <list-item>
                        <label>&#x2022;</label>
                        <p>

                            <bold>Bing AI</bold>: Accessed via 
                            <ext-link ext-link-type="uri" xlink:href="https://www.bing.com/chat">

                                <bold>Microsoft Bing</bold>
</ext-link>.</p>
                    </list-item>
                </list>
            </p>
        </sec>
    </body>
    <back>
        <sec id="sec26" sec-type="data-availability">
            <title>Data availability</title>
            <p>All datasets generated and analysed during this study are publicly available in an open-access data repository to facilitate transparency and replication of results. The complete data supporting the findings including the values underlying the summary statistics (means, percentages), the numerical data used to construct all tables and figures, and the annotated responses from ChatGPT-4o, Bard AI, and Bing AI can be accessed at ZENODO via the following persistent identifier: 
                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.16524383">https://doi.org/10.5281/zenodo.16524383</ext-link>.</p>
            <p>No restrictions or embargoes apply to the data, and it is shared under a 
                <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/legalcode">
CC-BY 4.0 International license</ext-link> permitting reuse with attribution. This includes the hypothetical T1D patient case inputs, the AI-generated dietary recommendation outputs, and the expert evaluations used for scoring and statistical analyses.</p>
            <p>If additional materials or clarifications are required to replicate the study, they can be obtained by contacting the corresponding author.</p>
        </sec>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alanzi</surname>
                            <given-names>TM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Impact of ChatGPT on Diabetes Mellitus Self-Management Among Patients in Saudi Arabia.</article-title>
                    <source>

                        <italic toggle="yes">Cureus.</italic>
</source>
                    <year>2025</year>;<volume>17</volume>:<fpage>e81855</fpage>.
                    <pub-id pub-id-type="pmid">40342454</pub-id>
                    <pub-id pub-id-type="doi">10.7759/cureus.81855</pub-id>
                    <pub-id pub-id-type="pmcid">PMC12059614</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bayram</surname>
                            <given-names>HM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ozturkcan</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>AI Showdown: Info Accuracy on Protein Quality Content in Foods From ChatGPT 3.5, ChatGPT 4, Bard AI and Bing Chat.</article-title>
                    <source>

                        <italic toggle="yes">Br. Food J.</italic>
</source>
                    <year>2024</year>;<volume>3</volume>:<fpage>4</fpage>&#x2013;<lpage>126</lpage>.
                    <pub-id pub-id-type="doi">10.1108/BFJ-05-2023-0525</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chatelan</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Clerc</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fonta</surname>
                            <given-names>P-A</given-names>
                        </name>
</person-group>:
                    <article-title>ChatGPT and Future Artificial Intelligence Chatbots: What May be the Influence on Credentialed Nutrition and Dietetics Practitioners?</article-title>
                    <source>

                        <italic toggle="yes">J. Acad. Nutr. Diet.</italic>
</source>
                    <year>2023</year>;<volume>123</volume>:<fpage>1525</fpage>&#x2013;<lpage>1531</lpage>.
                    <pub-id pub-id-type="pmid">37544375</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.jand.2023.04.013</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Daly</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hovorka</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>Technology in the Management of Type 2 Diabetes: Present Status and Future Prospects.</article-title>
                    <source>

                        <italic toggle="yes">Diabetes. Obes. Metab.</italic>
</source>
                    <year>2021</year>;<volume>23</volume>:<fpage>1722</fpage>&#x2013;<lpage>1732</lpage>.
                    <pub-id pub-id-type="pmid">33950566</pub-id>
                    <pub-id pub-id-type="doi">10.1111/dom.14361</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7611289</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>ElSayed</surname>
                            <given-names>NA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Aleppo</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <article-title>Facilitating Positive Health Behaviors and Well-Being to Improve Health Outcomes: Standards of Care in Diabetes&#x2013;2023.</article-title>
                    <source>

                        <italic toggle="yes">Diabetes Care.</italic>
</source>
                    <year>2023</year>;<volume>46</volume>:<fpage>S68</fpage>&#x2013;<lpage>S96</lpage>.
                    <pub-id pub-id-type="pmid">36507648</pub-id>
                    <pub-id pub-id-type="doi">10.2337/dc23-S005</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9810478</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Garcia</surname>
                            <given-names>MB</given-names>
                        </name>
</person-group>:
                    <article-title>ChatGPT as a Virtual Dietitian: Exploring Its Potential as a Tool for Improving Nutrition Knowledge.</article-title>
                    <source>

                        <italic toggle="yes">Appl. Syst. Innov.</italic>
</source>
                    <year>2023</year>;<volume>6</volume>:<fpage>96</fpage>.
                    <pub-id pub-id-type="doi">10.3390/asi6050096</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Guan</surname>
                            <given-names>Z</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Artificial Intelligence in Diabetes Management: Advancements, Opportunities, and Challenges.</article-title>
                    <source>

                        <italic toggle="yes">Cell Rep. Med.</italic>
</source>
                    <year>2023</year>;<volume>4</volume>:<fpage>101213</fpage>.
                    <pub-id pub-id-type="pmid">37788667</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.xcrm.2023.101213</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10591058</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hermanns</surname>
                            <given-names>N</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Coordination of Glucose Monitoring, Self-Care Behaviour and Mental Health: Achieving Precision Monitoring in Diabetes.</article-title>
                    <source>

                        <italic toggle="yes">Diabetologia.</italic>
</source>
                    <year>2022</year>;<volume>65</volume>:<fpage>1883</fpage>&#x2013;<lpage>1894</lpage>.
                    <pub-id pub-id-type="pmid">35380233</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s00125-022-05756-8</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9522821</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hieronimus</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hammann</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Podszun</surname>
                            <given-names>MC</given-names>
                        </name>
</person-group>:
                    <article-title>Can the AI tools ChatGPT and Bard Generate Energy, Macro-and Micro-Nutrient Sufficient Meal Plans for Different Dietary Patterns?</article-title>
                    <source>

                        <italic toggle="yes">Nutr. Res.</italic>
</source>
                    <year>2024</year>;<volume>128</volume>:<fpage>105</fpage>&#x2013;<lpage>114</lpage>.
                    <pub-id pub-id-type="pmid">39102765</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.nutres.2023.112854</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hou</surname>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Exercise Modalities for Type 2 Diabetes: A Systematic Review and Network Meta-Analysis of Randomized Trials.</article-title>
                    <source>

                        <italic toggle="yes">Diabetes Metab. Res. Rev.</italic>
</source>
                    <year>2023</year>;<volume>39</volume>:<fpage>e3591</fpage>.
                    <pub-id pub-id-type="pmid">36423199</pub-id>
                    <pub-id pub-id-type="doi">10.1002/dmrr.3591</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Joslin</surname>
                            <given-names>EP</given-names>
                        </name>
</person-group>:
                    <article-title>The Prevention of Diabetes Mellitus.</article-title>
                    <source>

                        <italic toggle="yes">J. Am. Med. Assoc.</italic>
</source>
                    <year>2021</year>;<volume>325</volume>:<fpage>190</fpage>.
                    <pub-id pub-id-type="doi">10.1001/jama.2020.25681</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kassem</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Investigation and Assessment of AI&#x2019;s Role in Nutrition &#x2013; An Updated Narrative Review of the Evidence.</article-title>
                    <source>

                        <italic toggle="yes">Nutrients.</italic>
</source>
                    <year>2025</year>;<volume>17</volume>:<fpage>190</fpage>.
                    <pub-id pub-id-type="pmid">39796624</pub-id>
                    <pub-id pub-id-type="doi">10.3390/nu17010190</pub-id>
                    <pub-id pub-id-type="pmcid">PMC11723148</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ogurtsova</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>IDF Diabetes Atlas: Global Estimates for the Prevalence of Diabetes for 2015 and 2040.</article-title>
                    <source>

                        <italic toggle="yes">Diabetes Res. Clin. Pract.</italic>
</source>
                    <year>2017</year>;<volume>128</volume>:<fpage>40</fpage>&#x2013;<lpage>50</lpage>.
                    <pub-id pub-id-type="pmid">28437734</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.diabres.2017.03.024</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Papastratis</surname>
                            <given-names>I</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Can ChatGPT Provide Appropriate Meal Plans for NCD Patients?</article-title>
                    <source>

                        <italic toggle="yes">Nutrition.</italic>
</source>
                    <year>2024</year>;<volume>121</volume>:<fpage>112291</fpage>.
                    <pub-id pub-id-type="pmid">38359704</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.nut.2023.112291</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Saeedi</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Global and Regional Diabetes Prevalence Estimates for 2019 and Projections for 2030 and 2045.</article-title>
                    <source>

                        <italic toggle="yes">Diabetes Res. Clin. Pract.</italic>
</source>
                    <year>2019</year>;<volume>157</volume>:<fpage>107843</fpage>.
                    <pub-id pub-id-type="pmid">31518657</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.diabres.2019.107843</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sharma</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A Critical Review of ChatGPT as a Potential Substitute for Diabetes Educators.</article-title>
                    <source>

                        <italic toggle="yes">Cureus.</italic>
</source>
                    <year>2023</year>;<volume>15</volume>:<fpage>e37569</fpage>.
                    <pub-id pub-id-type="pmid">37193444</pub-id>
                    <pub-id pub-id-type="doi">10.7759/cureus.37569</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10183197</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sharma</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gaur</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Optimizing Nutritional Outcomes: The Role of AI in Personalized Diet Planning.</article-title>
                    <source>

                        <italic toggle="yes">International Journal for Research Publication and Seminar.</italic>
</source>
                    <year>2024</year>;<volume>15</volume>:<fpage>107</fpage>&#x2013;<lpage>116</lpage>.
                    <pub-id pub-id-type="doi">10.36676/jrps.v15.i2.15</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sridhar</surname>
                            <given-names>GR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gumpeny</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Prospects and Perils of ChatGPT in Diabetes.</article-title>
                    <source>

                        <italic toggle="yes">World J. Diabetes.</italic>
</source>
                    <year>2025</year>;<volume>16</volume>:<fpage>98408</fpage>.
                    <pub-id pub-id-type="pmid">40093292</pub-id>
                    <pub-id pub-id-type="doi">10.4239/wjd.v16.i3.98408</pub-id>
                    <pub-id pub-id-type="pmcid">PMC11885976</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sun</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An AI Dietitian for Type 2 Diabetes Mellitus Management Based on Large Language and Image Recognition Models: Preclinical Concept Validation Study.</article-title>
                    <source>

                        <italic toggle="yes">J. Med. Internet Res.</italic>
</source>
                    <year>2023</year>;<volume>25</volume>:<fpage>e51300</fpage>.
                    <pub-id pub-id-type="pmid">37943581</pub-id>
                    <pub-id pub-id-type="doi">10.2196/51300</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10667983</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tyler</surname>
                            <given-names>NS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jacobs</surname>
                            <given-names>PG</given-names>
                        </name>
</person-group>:
                    <article-title>Artificial Intelligence in Decision Support Systems for Type 1 Diabetes.</article-title>
                    <source>

                        <italic toggle="yes">Sensors.</italic>
</source>
                    <year>2020</year>;<volume>20</volume>:<fpage>3214</fpage>.
                    <pub-id pub-id-type="pmid">32517068</pub-id>
                    <pub-id pub-id-type="doi">10.3390/s20113214</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7308977</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>X</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sun</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Xue</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Artificial Intelligence Applications to Personalized Dietary Recommendations: A Systematic Review.</article-title>
                    <source>

                        <italic toggle="yes">Healthcare.</italic>
</source>
                    <year>2025</year>;<volume>13</volume>:<fpage>1417</fpage>.
                    <pub-id pub-id-type="pmid">40565444</pub-id>
                    <pub-id pub-id-type="doi">10.3390/healthcare13121417</pub-id>
                    <pub-id pub-id-type="pmcid">PMC12193492</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report412410">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.185047.r412410</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Soliman</surname>
                        <given-names>Saeed</given-names>
                    </name>
                    <xref ref-type="aff" rid="r412410a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-3538-4441</uri>
                </contrib>
                <aff id="r412410a1">
                    <label>1</label>Cairo University, Cairo, Egypt</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>23</day>
                <month>9</month>
                <year>2025</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Soliman S</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport412410" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.167902.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <list list-type="bullet">
                    <list-item>
                        <p>The study evaluated ChatGPT-4o, Bard AI, and Bing AI on their ability to generate dietary recommendations for 60 hypothetical type 1 diabetes (T1D) cases created by expert dietitians.</p>
                    </list-item>
                    <list-item>
                        <p>ChatGPT-4o produced correct recommendations in 60% of cases, outperforming Bard AI (50%) and Bing AI (26.7%).</p>
                    </list-item>
                    <list-item>
                        <p>Statistical analysis (McNemar&#x2019;s test) confirmed ChatGPT-4o significantly outperformed Bing AI, while differences with Bard AI were not statistically significant.</p>
                    </list-item>
                    <list-item>
                        <p>ChatGPT-4o showed greater resilience in handling complex cases and provided more unique correct answers compared with other models.</p>
                    </list-item>
                    <list-item>
                        <p>The authors conclude that while AI tools&#x2014;particularly ChatGPT-4o&#x2014;show promise in supporting dietary guidance, they should only supplement and not replace human dietitians due to risks of incomplete or hallucinatory advice.</p>
                    </list-item>
                </list> 
                <bold>Review Report</bold>
            </p>
            <p> 
                <bold>Strengths:</bold> 
                <list list-type="bullet">
                    <list-item>
                        <p>The methodology is well designed, using 60 systematically developed, clinically validated hypothetical T1D cases.</p>
                    </list-item>
                    <list-item>
                        <p>Statistical rigor is applied with McNemar&#x2019;s test, Cohen&#x2019;s kappa, and complementarity analysis, strengthening the validity of comparisons.</p>
                    </list-item>
                    <list-item>
                        <p>The study openly provides data and an interactive dashboard, supporting transparency and reproducibility.</p>
                    </list-item>
                </list> 
                <bold>Limitations:</bold> 
                <list list-type="bullet">
                    <list-item>
                        <p>The binary classification of outputs as &#x201c;Correct&#x201d; or &#x201c;Incomplete&#x201d; may oversimplify nuanced dietary guidance and introduces subjective judgment.</p>
                    </list-item>
                    <list-item>
                        <p>No real patient outcomes were measured; thus, the clinical impact of AI-generated recommendations remains uncertain.</p>
                    </list-item>
                    <list-item>
                        <p>The evaluation is based on single-turn prompts, whereas real-world interactions typically involve iterative clarifications that could improve AI performance.</p>
                    </list-item>
                </list> 
                <bold>Critical Issue &#x2013; Hallucination Risk:</bold> 
                <list list-type="bullet">
                    <list-item>
                        <p>A key limitation across all large language models (LLMs) is the tendency to 
                            <bold>hallucinate</bold>&#x2014;that is, to generate factually incorrect, irrelevant, or fabricated content presented confidently.</p>
                    </list-item>
                    <list-item>
                        <p>In the context of dietary recommendations for T1D, hallucination could lead to unsafe advice, omission of critical nutritional details, or inappropriate food suggestions.</p>
                    </list-item>
                    <list-item>
                        <p>The article correctly identifies this as a common challenge with LLMs and underscores the need for 
                            <bold>human oversight</bold> and contextual tailoring by trained dietitians.</p>
                    </list-item>
                </list> 
                <bold>Overall Assessment:</bold>
            </p>
            <p> This is a timely and well-conducted evaluation that highlights both the promise and pitfalls of AI in diabetes care. The study demonstrates ChatGPT-4o&#x2019;s comparative strength while appropriately cautioning against uncritical reliance due to hallucination risks and lack of clinical nuance. It adds valuable evidence to the growing body of work on AI-assisted dietary management.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>public health, family medicine</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment14664-412410">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Alqahtani </surname>
                            <given-names>Nasser</given-names>
                        </name>
                        <aff>Community Health, Northern Border University, Arar, Northern Borders Province, Saudi Arabia</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>25</day>
                    <month>9</month>
                    <year>2025</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Thank you for your comment.&#x00a0;</p>
                <p> I really appreciate this insightful comment. In response, I have added explicit discussion of the hallucination risk of LLMs, noting their potential to generate factually incorrect or misleading dietary advice. We emphasize that such risks reinforce the need for human oversight and contextual tailoring by trained dietitians.</p>
                <p> Thank you again.</p>
            </body>
        </sub-article>
    </sub-article>
</article>
