<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.164015.2</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Quantitative AI yields algorithmic RNA biomarkers from a rheumatoid arthritis clinical trial, accurately predicting individual patient responses to anti-TNF treatment, providing a novel approach to companion diagnostic discovery. &#x202f;&#x202f;</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 2; peer review: 2 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Horgan</surname>
                        <given-names>Kevin</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-0647-9078</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>McDermott</surname>
                        <given-names>Michael F</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-1015-0745</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Harrington</surname>
                        <given-names>Douglas</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Simonyan</surname>
                        <given-names>Vahan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Lilley</surname>
                        <given-names>Patrick</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a6">6</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Liquid Biosciences Inc., 26895 Aliso Creek Road B800, California, 92656, USA</aff>
                <aff id="a2">
                    <label>2</label>Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds, Leeds, England, LS9 7TF, UK</aff>
                <aff id="a3">
                    <label>3</label>Department of Rheumatic Diseases, Clinical Sciences Institute, University of Galway, Galway, H91 V4AY, Ireland</aff>
                <aff id="a4">
                    <label>4</label>Montana Department of Health and Human Services, Helena, MT, 59601, USA</aff>
                <aff id="a5">
                    <label>5</label>Department of Biochemistry and Molecular Medicine, The George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, 20052, USA</aff>
                <aff id="a6">
                    <label>6</label>Ignite Biomedical Inc., Framingham, MA, 01701, USA</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:kevinh@liquidbiosciences.com">kevinh@liquidbiosciences.com</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>Kevin Horgan and Patrick Lilley have equity in Liquid Biosciences. All other authors report no financial relationships with any organizations that might have an interest in the submitted work in the previous three years. &#13;
&#13;
The reported gene expression variables are included in issued U.S. Patent 9,845,505</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>14</day>
                <month>2</month>
                <year>2026</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2025</year>
            </pub-date>
            <volume>14</volume>
            <elocation-id>663</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>11</day>
                    <month>2</month>
                    <year>2026</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2026 Horgan K et al.</copyright-statement>
                <copyright-year>2026</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/14-663/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>The derivation of novel biomarkers from biomedical data to accurately predict individual patient&#x2019;s responses, would be an advance. We hypothesized that quantitative AI designed to analyze complex data, based on evolutionary computation, could identify algorithmic biomarkers from baseline data in a clinical trial, predictive of individual therapeutic responses.</p>
                </sec>
                <sec>
                    <title>Methods</title>
                    <p>A previously published randomized placebo controlled clinical trial in which patients with active rheumatoid arthritis (RA) naive to anti-tumor necrosis factor (TNF) therapy, were randomized to receive infliximab or placebo was analyzed. Baseline peripheral blood gene expression data, plus the treatment variable, infliximab or placebo, yielding 52,379 variables were available for 59 patients. The variable for analysis was a decrease in Disease Activity Score-28 (DSA28) score of 1.2. At 14 weeks, 20 of the 30 patients receiving infliximab had responded, and ten of the 29 patients receiving placebo had responded.</p>
                </sec>
                <sec>
                    <title>Findings</title>
                    <p>The AI derived a discovery algorithm, with 4 gene expression variables plus treatment assignment, that predicted responders versus non-responders for all 59 patients, with 100% accuracy. We present the discovery algorithm to enable transparent verification. Excluding the 4 gene expression variables, we then derived similarly accurate predictive algorithms with 4 other gene expression variables. We tested the hypothesis that the software could derive algorithms as predictors of treatment response applying just these 8 discovery gene expression variables to 6 previously published independent datasets. In each validation analysis, the accuracy of the algorithmic predictors surpassed those benchmarks previously reported, using a variety of analytic approaches.</p>
                </sec>
                <sec>
                    <title>Conclusions</title>
                    <p>AI based on evolutionary computation summarized a clinical trial, with transparent biomarker algorithms derived from baseline data, correctly predicting the outcome for all patients. The biomarker variables, validated in 6 independent cohorts, are now in development as a clinical test. This approach may expedite the discovery of companion diagnostics. </p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Biomarkers</kwd>
                <kwd>algorithmic</kwd>
                <kwd>AI</kwd>
                <kwd>evolutionary computation</kwd>
                <kwd>precision medicine</kwd>
                <kwd>clinical trial</kwd>
                <kwd>anti-TNF</kwd>
                <kwd>rheumatoid arthritis</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 1</title>
                <p>We appreciate the opportunity to revise our paper. We have carefully reviewed and commented on the reviewer comments. We have made minor revisions to address specific points raised by the reviewers. Some reviewer comments were quite general and did not provide enough specificity to directly address. An important point, is that we present an example of an algorithm to allow independent verification of our approach. To our knowledge, such transparency is very unusual, if not unique, in publications of this nature. Hence, we consider that to be a particular strength of the publication that will raise the bar for the future.</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec id="sec5" sec-type="intro">
            <title>Introduction</title>
            <p>The completion of the Human Genome Project in 2003 was accompanied by optimism that a profusion of novel diagnostics and therapeutics would rapidly ensue. Technical innovations and digitization have since produced vast amounts of data without clearly impacting the trajectory of clinical advances.
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> The lack of predictive biomarkers with sufficient accuracy to inform therapeutic decisions for individual patients is an unresolved problem, thwarting the realization of the vision of precision medicine.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>,
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup> Why has the explosive growth in biomedical data not enabled greater progress, especially with respect to the discovery and development of predictive biomarkers? The typical explanation is the daunting complexity of biology.</p>
            <p>Living organisms are complex systems, containing orders of magnitude more information than non-living entities.
                <sup>
                    <xref ref-type="bibr" rid="ref4">4</xref>
                </sup> Biological functions, including disease and drug responsiveness, result from complex networks of cellular and molecular interactions that can potentially be described mathematically, reflecting mechanisms and constraints under which biological systems operate.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref9">9</xref>
                </sup> These interactions are typically nonlinear and multi-dimensional which complicates their analysis and definition.
                <sup>
                    <xref ref-type="bibr" rid="ref10">10</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref13">13</xref>
                </sup> This explains why single variable biomarkers are typically inadequate providers of clinically useful predictive insight.
                <sup>
                    <xref ref-type="bibr" rid="ref11">11</xref>
                </sup>
            </p>
            <p>Identifying causal factors from data is an inverse problem. What would an ideal analytic solution to the inverse problem as applied to biological complexity to yield actionable insight, including predictive biomarkers, look like? In a complex system, information is present in the relationships between components, as well as in the individual components themselves. An effective analytic solution would reveal the specific molecular networks that underly biological functions, diseases and therapeutic effects, respectively. The analytic approach would not assess the components in isolation. Instead, it would identify the relevant components in terms of their mathematical relationships with other components to reflect accurately their frequently non-linear nature. In essence, the solution would distil essential information into transparent explanatory and predictive quantitative algorithms, which could then be translated into clinical tests. Such an analytic solution could be applied to all forms of biomedical data, including clinical trial data. Randomized clinical trial outcomes are conventionally analyzed using a pre-specified hypothesis and statistical tests, based on the average overall response, in order to assess whether treatment is effective at a population level. Much information from clinical trials is neglected with this approach, resulting in a lack of guidance for clinicians and patients as to which individuals might benefit from the therapy. The ability to summarize clinical trial data in terms of transparent summary, quantitative, easily validated algorithms predictive of individual patient outcomes would have significant potential for informing both clinical practice and research.</p>
            <p>Since machine learning is not adequate, in part because of its black box solutions, and in part because prevalent methods do not have a broad palette of mathematical functions to characterize many interactions present in biological systems, we developed a novel approach.
                <sup>
                    <xref ref-type="bibr" rid="ref14">14</xref>,
                    <xref ref-type="bibr" rid="ref15">15</xref>
                </sup> We devised a novel analytic solution based on an evolutionary computation foundation fused with mathematics, the science of complex emergent systems, information theory and its subset, algorithmic compression theory. The software incorporated a comprehensive set of mathematical functions, to produce transparent interpretable predictive algorithms from complex biomedical data, specifically designed to model the nonlinear and high dimension relationships that define complex emergent systems. The algorithms produced are verifiably accurate mathematical solutions that can predict the outcome of interest.</p>
            <p>To test the software, we applied it to a previously published placebo-controlled clinical trial of infliximab in RA, conducted by a pharmaceutical company with baseline peripheral blood transcriptomic data.
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>,
                    <xref ref-type="bibr" rid="ref17">17</xref>
                </sup> Infliximab is a monoclonal anti-TNF antibody effective in treating a range of immune mediated disease including RA
                <italic toggle="yes">.</italic> The hypothesis was that the software would produce transparent, interpretable, discovery algorithms predictive of individual treatment responses that could be independently validated. We selected this trial because it was randomized and placebo controlled, with tens of thousands of RNA data points available for each patient to provide a rigorous test. The software produced a discovery algorithm comprised of biomarker measurements, a clinical variable in addition to mathematical functions, with 100% accuracy in predicting both infliximab and placebo treatment outcomes. The biomarkers were four RNA gene expression variables. The discovery algorithm is shown, in different formats, to enable independent validation. When those four gene expression variables in the original algorithm were excluded from subsequent analyses, using exactly the same analytic approach, additional algorithms were derived, with four different gene expression variables and similar 100% predictive accuracy.</p>
            <p>Having identified the eight discovery gene expression variables, we then hypothesized that application of the software, using only those eight variables to previously published data from six additional RA studies containing baseline gene expression data, would also derive accurate predictors of clinical outcomes following anti-TNF treatment. In each case, using just these eight gene expression variables, the software provided an algorithm more predictive of treatment response than reported in the original publications, thereby independently validating both the gene expression variables as response predictors, and the superior predictivity of our methodology relative to the various approaches, including different variants of machine learning, previously reported. The gene expression variables we discovered are now in development as a clinical test, which will need to be validated prospectively in future studies for clinical use.</p>
        </sec>
        <sec id="sec6" sec-type="methods">
            <title>Methods</title>
            <sec id="sec7">
                <title>Discovery cohort</title>
                <p>The discovery cohort was from a published randomized, double-blind placebo-controlled trial of infliximab, in RA patients na&#x00ef;ve to biologics therapy following an inadequate response to methotrexate.
                    <sup>
                        <xref ref-type="bibr" rid="ref16">16</xref>,
                        <xref ref-type="bibr" rid="ref17">17</xref>
                    </sup> Participants were recruited between April 6
                    <sup>th</sup>, 2011 and March 29
                    <sup>th</sup>, 2012 from three European clinical centers: one in Romania and two in Moldova.
                    <sup>
                        <xref ref-type="bibr" rid="ref17">17</xref>
                    </sup> The study was conducted in accordance with principles of Good Clinical Practice and was approved by the National Ethics Committee in Romania and the National Ethics Committee, Clinical Research of Drugs and Methods of Treatment in Moldova, with all subjects providing informed written consent.
                    <sup>
                        <xref ref-type="bibr" rid="ref17">17</xref>
                    </sup>
                </p>
                <p>Active disease was defined as at least 6 tender and 6 swollen joints, with a rheumatoid arthritis magnetic resonance imaging score of &#x2265;1 in the radio-carpal or intercarpal joints, as objective confirmation of disease activity. The participants were all on stable doses of methotrexate, steroids, and/or non-steroidal anti-inflammatory drugs. At weeks 0, 2, 6, and 14, the participants received either infliximab 3 mg/kg or placebo. The participants were of mean age of 50 years
                    <strike>,
</strike> predominantly female (92%), and rheumatoid factor positive (91.5%), with a mean baseline Disease Activity Score-28 (DAS28) score of 6.2. The primary endpoint was a magnetic resonance imaging assessment of disease activity. This endpoint was not used in our analysis, because the imaging data were not available for individual participants. The study had 80% power to yield a significant difference in DAS28 score.
                    <sup>
                        <xref ref-type="bibr" rid="ref17">17</xref>
                    </sup> The trial used the European League against Rheumatism (EULAR) DAS28 score to evaluate response, defined as a decrease of 1.2, as a binary dependent variable for the analysis at 14 weeks, yes or no. Baseline peripheral blood gene expression data for 59 patients were available plus one additional variable reflecting treatment, either infliximab or placebo, resulting in a total of 52,379 potentially independent variables.
                    <sup>
                        <xref ref-type="bibr" rid="ref16">16</xref>
                    </sup> The participant flow is shown diagrammatically in the original publication, where the study protocol is referenced.
                    <sup>
                        <xref ref-type="bibr" rid="ref17">17</xref>
                    </sup>
                </p>
            </sec>
            <sec id="sec8">
                <title>Validation cohorts</title>
                <p>To independently validate the gene expression variables in the discovery algorithms, we applied these variables to 6 previously published studies with available baseline gene expression data from patients with active RA, treated with anti-TNF therapies.
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup> These studies were done in different geographies, used different methodologies to process the samples and gene expression data, and in some cases, used different anti-TNF therapies but with a similar 14 week efficacy primary endpoint, except for one study.
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup> Summary details on the discovery and validation studies are provided in 
                    <xref ref-type="table" rid="T1">
Table 1</xref>, with details available in the original publications.
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup> Written informed consent for all participants and local ethics approval was obtained for each of the studies that provided validation data as detailed in the original publications.
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup>
                </p>
                <table-wrap id="T1" orientation="portrait" position="float">
                    <label>
Table 1. </label>
                    <caption>
                        <title>Discovery and validation studies of blood-based gene expression data of anti-TNF responsiveness in RA.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">First author</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">MacIsaac et al. (2014)
                                    <sup>
                                        <xref ref-type="bibr" rid="ref16">16</xref>,
                                        <xref ref-type="bibr" rid="ref17">17</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Lequerre et al. (2005)
                                    <sup>
                                        <xref ref-type="bibr" rid="ref18">18</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Julia et al. (2009)
                                    <sup>
                                        <xref ref-type="bibr" rid="ref19">19</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Bienkowska et al. (2009)
                                    <sup>
                                        <xref ref-type="bibr" rid="ref20">20</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Toonen et al. (2011)
                                    <sup>
                                        <xref ref-type="bibr" rid="ref21">21</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Nakamura et al. (2016)
                                    <sup>
                                        <xref ref-type="bibr" rid="ref22">22</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Tanino et al. (2010)
                                    <sup>
                                        <xref ref-type="bibr" rid="ref23">23</xref>
                                    </sup>
                                </th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">GEO accession</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GSE58795</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GSE3592</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GSE12051</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GSE15258</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GSE33377</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GSE78068</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">GSE20690</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Phase</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Discovery</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Validation</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Validation</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Validation</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Validation</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Validation</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Validation</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Location</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Moldova &amp; Romania</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">France</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Spain</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">USA</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Netherlands</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Japan</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Japan</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA classification criteria</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA ACR (1987)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA ACR (1987)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA ACR (1987)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA (1987)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA ACR (1987)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA ACR (1987) or EULAR/ACR (2010)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Not reported</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Treatment</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">infliximab or placebo</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">infliximab</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">infliximab</td>
                                <td align="char" char="&#x00d7;" colspan="1" rowspan="1" valign="top">infliximab adalimumab, and etanercept</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">infliximab and adalimumab</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">infliximab</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">infliximab</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">RA treatment population</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MTX resistant. No prior TNF therapy</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MTX resistant.
                                    <break/>DAS28&gt;=5.1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MTX resistant. DAS28&gt;3.2. No prior TNF therapy</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Active RA: No TNF in past 6 months</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">DMARD resistant. DAS28&gt;3.2. No prior TNF therapy</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MTX resistant</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MTX resistant</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Platform</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Rosetta/Merck custom Affymetrix 2.0 microarray</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Affymetrix Human Genome U133A Array</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Illumina H-6 mRNA Sentrix Human-6 Expression BeadChip</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Affymetrix Human Genome U133 Plus 2.0 Array</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Affymetrix GeneChip Exon 1.0 ST</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Agilent-014850 Whole Human Genome Microarray 4x44K G4112F</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Agilent-014850 Whole Human Genome Microarray 4x44K G4112F</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Efficacy</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">14-week EULAR criteria</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">14-week EULAR criteria</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">14-week EULAR criteria</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">14-week EULAR criteria</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">14-week EULAR Criteria</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">6-month CDAI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">14-week serum CRP</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>GEO &#x2013; gene expression omnibus; RA &#x2013; rheumatoid arthritis; ACR &#x2013; American College of Rheumatology; MTX &#x2013; methotrexate; EULAR &#x2013; European League Against Rheumatism; DAS28 &#x2013; disease activity score 28; TNF &#x2013; tumor necrosis factor; DMARD &#x2013; disease modifying anti-rheumatic drugs; CRP &#x2013; C-reactive protein; CDAI &#x2013; clinical disease activity index.</p>
                    </table-wrap-foot>
                </table-wrap>
            </sec>
            <sec id="sec9">
                <title>Microarray data</title>
                <p>The gene expression profiles analyzed were downloaded from the GEO database. Because all the data used were previously published, de-identified and publicly available, neither ethics committee approval nor informed consent were required. Datasets were downloaded and transposed so that gene expression values and clinical variables were changed from rows to columns, and subject records were changed from columns to rows. Data files were saved in CSV format and imported into the software for analysis, without any pre-processing of the biomarker measures.</p>
            </sec>
            <sec id="sec10">
                <title>Analysis</title>
                <p>The software is a quantitative analytic platform based on evolutionary computation, designed as a scalable, unbiased methodology to produce transparent algorithms based on mathematical relationships from complex data, without any prior assumptions other than the patient selection criteria and designs of the original studies yielding data for analysis. The software fuses evolutionary principles, signal processing functions, and information theory, and requires no domain expertise or prior knowledge of the nature of a problem in terms of explanatory variables, dimensionality or underlying mathematical relationships. A distinctive feature is that the software uses all available data to derive the algorithms, without any filtering process to exclude variables based on commonly used thresholds or feature selection methods. This enables the identification of variables typically discarded by feature selection methods used in biomarker discovery. This includes such methods&#x2019; tendency to discard potential explanatory variables, with relatively low expression or nonlinear relationships to the outcome, but which may be functionally important because of the nonlinear and binary threshold interactions pervasive in complex biologic systems. The software identifies key variables in the context of their mathematical relationships with each other and associated with outcomes of interest, and is not dependent on baseline differences in biomarker levels between responders and non-responders. The software automatically excludes overfitted algorithms and automatically divides the data into three distinct, random subsets that are sequentially processed: a training set, a selection set, and a test set. Analysis of the training subset provides an ensemble of candidate algorithms, which are then evaluated on the selection subset, to select a final algorithm, which is then validated on the test set. An overfitted algorithm would not be validated on the test set, ensuring that overfitted algorithms are not selected. The training, selection, and test data subsets are scrupulously segregated, to avoid any information leakage between the discrete components of the process. In the discovery analysis of the MacIsaac et al. data, there were 18 patients in the training set, 21 in the selection set and 20 in the test set (
                    <xref ref-type="table" rid="T2">
Table 2</xref>).</p>
                <table-wrap id="T2" orientation="portrait" position="float">
                    <label>
Table 2. </label>
                    <caption>
                        <title>Discovery algorithm metrics.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top"/>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Analysis of data from MacIsaac et al.
                                    <sup>
                                        <xref ref-type="bibr" rid="ref16">16</xref>
                                    </sup>
                                </th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Training set: 9 placebo, 9 infliximab</bold>
</td>
                                <td colspan="1" rowspan="1"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Errors/total</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0/18</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Accuracy</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">100%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Misclassification rate</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Validation set: 11 placebo, 10 infliximab</bold>
</td>
                                <td colspan="1" rowspan="1"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Errors/total</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0/21</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Accuracy</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">100%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Misclassification rate</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Test set: 9 placebo, 11 infliximab</bold>
</td>
                                <td colspan="1" rowspan="1"/>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Errors/total</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0/20</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Accuracy</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">100%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2003;Misclassification</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Overall Accuracy</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">100%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Overall Sensitivity</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">100%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Overall Specificity</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">100%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Number of gene expression variables</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>The 8 variables in the discovery algorithms were then applied to the analyses of six additional published data sets in patients with RA, using both baseline gene expression data and response outcomes to anti-TNF therapy, for independent validation. The intent was to prospectively validate the 8 variables and also to benchmark the predictivity of the algorithmic biomarkers that incorporated them, relative to prior predictors using traditional analytic approaches, including machine learning.</p>
            </sec>
        </sec>
        <sec id="sec11" sec-type="results">
            <title>Results</title>
            <sec id="sec12">
                <title>Discovery analysis: Derivation of MacIsaac et al. algorithm</title>
                <p>The software initially yielded an algorithmic biomarker set with five variables and twelve sequential mathematical instructions as shown in 
                    <xref ref-type="table" rid="T3">
Table 3</xref>. There were four gene expression variables expressed quantitatively: 
                    <italic toggle="yes">SPTY2D1</italic>, 
                    <italic toggle="yes">Clorf105</italic>, KCTD4 and UL84 and the fifth variable was treatment assignment: infliximab or placebo. The algorithm is also presented in the form of an equation in 
                    <xref ref-type="fig" rid="f1">
Figure 1a</xref>, and in schematic form in 
                    <xref ref-type="fig" rid="f1">
Figure 1b</xref>. The three different depictions of the algorithm allow transparent validation of the discovery algorithm using the MacIsaac et al. GSE58795 dataset.</p>
                <table-wrap id="T3" orientation="portrait" position="float">
                    <label>
Table 3. </label>
                    <caption>
                        <title>Discovery algorithm as series of operations.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Instruction</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Input registers</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Explanation</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[03] = SINCPI(r[03])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[03] = 19</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Calculate the sine of 19, divide that by 19 and push the result (0.00788827419278696) into memory register 03</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[06] = SUB(r[13], r[02])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[13] = KCTD4, r[02] = 7</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Subtract 7 from the measurement of RNA KCTD4, then push the result into register 06</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[04] = ADD(r[15], r[01])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[15] = Treatment_num, r[01] = 2</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Add Treatment_num to 2 and push the result into register 04. Treatment_num 0 is placebo, Treatment_num 1 is infliximab</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[05] = ADD(r[10], r[06])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[10] = SPTY2D1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Add the value in register 06 to the measurement of RNA SPTY2D1 and push the result into register 05</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[01] = DIV(r[02], r[04])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[02]= 7</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Divide 7 by the value in register 04 and push the result into register 01</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[00] = SINCPI(r[09])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[09] = UL84</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Calculate the sine of the measurement of RNA UL84, divide that by the measurement of RNA UL84, and push the result into register 00</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">IF(r[00] &lt; r[03])</td>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">If the value in register 00 is less than the value in register 03, then execute the following instruction, otherwise skip it</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">IF(r[11] &lt; r[01])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[11] = C1orf105</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">If the measurement of RNA C1orf105 is less than the value in register 01, then execute the following instruction, otherwise skip it</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[00] = ADD(r[04], r[05])</td>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">If both of the above IF statements are TRUE, then add the value in register 04 to the value in register 05 and push the result into register 00. If one or both of the above IF statements are false, skip this instruction</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[05] = DIV(r[11], r[00])</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[11] = C1orf105</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Divide the measurement of RNA C1orf105 by the value in register 00, and push the result into register 05</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[04] = CONSTDIV(7, 5)</td>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">Divide 7 by 5 and push the result into register 04</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">r[00] = ADD(r[04], r[05])</td>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">Add the value in register 04 to the value in register 05, and push the result into register 00</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Final interpretation</td>
                                <td colspan="1" rowspan="1"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">If the contents of memory register 00 are negative, then patient is predicted to be a non-responder, otherwise a responder</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>KCDT4 - potassium channel tetramerization domain containing 4; SPTY2D1 - suppressor of Ty 5 homolog; UL84 - gene for human CMV protein UL84; C1orf105 - chromosome 1 open reading frame.</p>
                    </table-wrap-foot>
                </table-wrap>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>
Figure 1. </label>
                    <caption>
                        <title>Discovery algorithm as an equation (a) and in schematic form (b).</title>
                        <p>The discovery algorithm containing 4 variables is transparently depicted as an equation and also in schematic form to complement its depiction as a sequence of operations in 
                            <xref ref-type="table" rid="T3">
Table 3</xref>, to facilitate both understanding and independent validation using the data from GSE58795 from MacIsaac et al. accessible at 
                            <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE58795">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE58795</ext-link>.
                            <sup>
                                <xref ref-type="bibr" rid="ref16">16</xref>
                            </sup>
                        </p>
                    </caption>
                    <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/196224/4dd55a3f-7153-4fc2-807e-86c62435ddc8_figure1.gif"/>
                </fig>
                <p>A calculation for an individual patient, with a resulting value of less than zero indicated treatment non-response, and a value of zero or more indicated treatment response. The algorithmic variables were not those with the highest levels of expression. Agnostic evolutionary selection of treatment as a variable, either infliximab or placebo, into the predictive algorithm is evidence that the treatment has a mathematically significant impact on the response outcome for some patients. Although expected a priori, the treatment assignment variable was selected agnostically by the evolutionary process, and not pre-specified. Users of the software cannot influence or require any variable to be incorporated into an algorithm.</p>
                <p>The performance metrics for the components of the discovery analyses are shown in 
                    <xref ref-type="table" rid="T2">
Table 2</xref>. The overall accuracy was 100%, with 100% sensitivity and specificity. Repeat analyses consistently yielded exactly the same variables, and the mathematical instructions encoded in all algorithms were, without exception, mathematically equivalent in terms of binary outcome: response or non-response. Omission of any of the mathematical instructions from the algorithm degraded predictivity. Therefore, the algorithm was optimized and devoid of superfluous calculations. Accuracy and reliability were consistent across training, validation and test sets analysed. When the initial four gene expression variables were excluded from subsequent analyses, four additional gene expression variables were identified as components of algorithms, also with 100% accuracy: PTPRC, TPM3, ARHGDIB and SIAH1 (
                    <xref ref-type="table" rid="T4">
Table 4</xref>). The software selects the minimum number of variables for maximum accuracy. The fact that a second group of four variables provided algorithms with 100% accuracy implies that these variables are highly correlated with the original four, containing almost as much information.</p>
                <table-wrap id="T4" orientation="portrait" position="float">
                    <label>
Table 4. </label>
                    <caption>
                        <title>Gene expression variables present in discovery algorithms.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="2" rowspan="1" valign="top">Expression Variable</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Function</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">SPTY2D1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Suppressor of Ty 5 homolog</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Tumor suppressor gene in thyroid cancer
                                    <sup>
                                        <xref ref-type="bibr" rid="ref24">24</xref>
                                    </sup>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">C1orf105</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Chromosome 1 open reading frame</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Vascular remodeling, coronary artery disease and atrial fibrillation
                                    <sup>
                                        <xref ref-type="bibr" rid="ref25">25</xref>,
                                        <xref ref-type="bibr" rid="ref26">26</xref>
                                    </sup>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">KCTD4</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Potassium channel tetramerization domain containing 4</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Expressed in sepsis and esophageal cancer
                                    <sup>
                                        <xref ref-type="bibr" rid="ref27">27</xref>,
                                        <xref ref-type="bibr" rid="ref28">28</xref>
                                    </sup>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">UL84</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Gene for human CMV protein UL84</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Prior CMV infection associated with treatment response in RA
                                    <sup>
                                        <xref ref-type="bibr" rid="ref29">29</xref>,
                                        <xref ref-type="bibr" rid="ref30">30</xref>
                                    </sup>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">PTPRC</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Protein Tyrosine Phosphatase Receptor Type C or CD45</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Genetic variants associated with anti-TNF response in RA
                                    <sup>
                                        <xref ref-type="bibr" rid="ref31">31</xref>,
                                        <xref ref-type="bibr" rid="ref32">32</xref>
                                    </sup>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">TPM3</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Tropomyosin 3</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Tropomyosin isoform associated with neoplasia, myopathy and as an autoantigen in RA
                                    <xref ref-type="bibr" rid="ref33">
                                        <sup>33</sup>
                                    </xref>
                                    <sup>&#x2013;</sup>
                                    <xref ref-type="bibr" rid="ref35">
                                        <sup>35</sup>
                                    </xref>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">ARHGDIB</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Rho GDP Dissociation Inhibitor Beta</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Negative regulator of Rho guanosine triphosphate (RhoGTP) ases, reduced in osteoarthritis synovial fluid and elevated in early RA synovial fluid
                                    <xref ref-type="bibr" rid="ref36">
                                        <sup>36</sup>
                                    </xref>
                                    <sup>,</sup>
                                    <xref ref-type="bibr" rid="ref37">
                                        <sup>37</sup>
                                    </xref>
                                </td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">SIAH1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Siah E3 Ubiquitin Protein Ligase 1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Downregulated in both RA and tuberculosis, may influence amplitude of inflammatory gene response
                                    <sup>
                                        <xref ref-type="bibr" rid="ref38">38</xref>
                                    </sup>
                                </td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>CMV &#x2013; cytomegalovirus; RA - rheumatoid arthritis; TNF- tumor necrosis factor; GDP- guanosine triphosphate.</p>
                    </table-wrap-foot>
                </table-wrap>
            </sec>
            <sec id="sec13">
                <title>Validation of discovery gene expression variables by analysis of six independent datasets</title>
                <p>We then tested the hypothesis that the eight variables from the discovery algorithms could be used to derive algorithms predicting individual treatment anti-TNF response outcomes from six additional published RA clinical trial data sets, providing independent validation of the variables.
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup> These data sets were chosen because they were derived from clinical trials similar to the discovery trial, though none were placebo controlled. While the eight variables used were the same for all six dataset analyses, distinct algorithmic operations were necessary for each validation, because of variation in quantitation instruments, measurement scale, data preparation and normalization methods used by the original researchers across the individual datasets. Summary information on the clinical studies is shown in 
                    <xref ref-type="table" rid="T1">
Table 1</xref>, with further details available in the original publications.
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup> In each case, the algorithms we produced had superior performance to the analyses presented in the original publications as shown in 
                    <xref ref-type="table" rid="T5">
Table 5</xref>, even though only a subset of the eight discovery variables were available in some datasets. The original analyses used a wide range of analytic methods including the most common machine learning approaches: neural networks, support vector machines and random forests.</p>
                <table-wrap id="T5" orientation="portrait" position="float">
                    <label>
Table 5. </label>
                    <caption>
                        <title>Discovery and validation studies of blood-based gene expression data of anti-TNF responsiveness in RA.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">
First author</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">MacIsaac
                                    <sup>
                                        <xref ref-type="bibr" rid="ref16">16</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Lequerre
                                    <sup>
                                        <xref ref-type="bibr" rid="ref18">18</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Julia
                                    <sup>
                                        <xref ref-type="bibr" rid="ref19">19</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Bienkowska
                                    <sup>
                                        <xref ref-type="bibr" rid="ref20">20</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Toonen
                                    <sup>
                                        <xref ref-type="bibr" rid="ref21">21</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Nakamura
                                    <sup>
                                        <xref ref-type="bibr" rid="ref22">22</xref>
                                    </sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Tanino
                                    <sup>
                                        <xref ref-type="bibr" rid="ref23">23</xref>
                                    </sup>
                                </th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Number of patients</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">59</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">30</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">44</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">46 &#x2013; leaving out intermediate responses or 75 including intermediate responses</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">42</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">140 (infliximab treated)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">68</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Classifier Method</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">OLS regression</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">UHC</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">SVM, DDA, RF, &amp; k-NN</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">RF</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">K-means cluster analysis</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Logistic regression</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">LOO</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Cross-validation analyses</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">None</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">LOO</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">LOO</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">LOO, NN, LDA and SVM</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">None</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">None</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">None</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Original reported results</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">None reported</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 90% Spec 70%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 94% Spec 86%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 88% Spec 84%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 61% Spec 71%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 79% Spec 47%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 68%
                                    <break/>Spec 86%</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Current analysis</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 100%
                                    <break/>Spec 100%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 100%
                                    <break/>Spec 100%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 100%
                                    <break/>Spec 86%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 100%
                                    <break/>Spec 86%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 100%
                                    <break/>Spec 96%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 95%
                                    <break/>Spec 91%</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Sens 96%
                                    <break/>Spec 84%</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <p>UHC &#x2013; unsupervised hierarchical clustering; OLS &#x2013; orthogonal least squares; LOO &#x2013; leave one out; LDA - linear discriminant analysis; SVM &#x2013; support vector machine; RF &#x2013; random forest; DLDA &#x2013; Diagonal Linear Discriminant Analysis; DQDA &#x2013; Diagonal Quadratic Discriminant Analysis.</p>
                    </table-wrap-foot>
                </table-wrap>
                <p>The weighted-average sensitivity and specificity of the individual models from the analyses we conducted across all 7 datasets, with a total of 400 subjects treated with anti-TNF therapy, were 98.5% and 90.9% respectively, surpassing the accuracy of all the prior published individual analyses, as shown in 
                    <xref ref-type="fig" rid="f2">
Figure 2</xref>. Accuracy for the marketed TNF response predictor from two reports, Mellors et al. and Jones et al., is also presented for comparison.
                    <sup>
                        <xref ref-type="bibr" rid="ref39">39</xref>,
                        <xref ref-type="bibr" rid="ref40">40</xref>
                    </sup> The marketed predictor consists of 23 variables and was derived using machine learning, with a combination of neural networks and random forests. The actual model has not been published.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>
Figure 2. </label>
                    <caption>
                        <title>Performance metrics of discovery algorithmic biomarker predictor compared to other predictors.</title>
                        <p>Weighted-average accuracy of the individual analyses we conducted using 7 datasets, on all 400 subjects receiving anti-TNF therapy had 98.5% sensitivity and 90.9% specificity as shown. This surpassed the performance metrics for all the individual previously reported analyses which are also shown.
                            <sup>
                                <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                                <xref ref-type="bibr" rid="ref23">23</xref>
                            </sup> No metrics were provided for MacIsaacs et al. study used for discovery.
                            <sup>
                                <xref ref-type="bibr" rid="ref16">16</xref>,
                                <xref ref-type="bibr" rid="ref17">17</xref>
                            </sup> Accuracy for a marketed TNF predictor from two reports, Jones et al. and Mellors et al., is also presented for comparison.
                            <sup>
                                <xref ref-type="bibr" rid="ref30">30</xref>,
                                <xref ref-type="bibr" rid="ref31">31</xref>
                            </sup>
                        </p>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/196224/4dd55a3f-7153-4fc2-807e-86c62435ddc8_figure2.gif"/>
                </fig>
            </sec>
        </sec>
        <sec id="sec14" sec-type="discussion">
            <title>Discussion</title>
            <p>To address the stagnation in biomarker discovery and development we applied a novel analytic approach, based on evolutionary computation and information theory incorporating mathematical functions, to a placebo controlled randomized clinical trial with 52,379 baseline gene expression variables for each of 59 patients. This provided discovery biomarker algorithms perfectly predictive of individual responses to both active therapy and placebo. The algorithms contained subsets of 4 variables from a total of 8 variables. The eight discovery variables were then validated, using the same analytic approach, as components of algorithmic predictors when applied to data from six independent clinical trials with different TNF inhibitors, on 3 continents, in multiple ethnicities, despite differences in response criteria, gene expression processing platforms and measurement scale differences, thereby providing extremely high confidence as to their validity.</p>
            <p>The MacIsaacs et al. clinical trial study that provided the discovery data, was conducted by a major pharmaceutical company but did not provide a predictor of therapeutic response, nor did it identify any of the 8 variables we discovered as predictive.
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>
                </sup> In each of the six validation analyses, our derived algorithms all containing 4 or fewer variables, had sensitivity and specificity superior to benchmarks in the original publications, which used a variety of mainstream analytic approaches including several types of machine learning.</p>
            <p>None of the publications for the six validation datasets identified the eight predictive algorithmic biomarkers we discovered
                <sup>
                    <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref23">23</xref>
                </sup> or reported an algorithm that might be the basis for a predictive test. To enable conclusive independent confirmation of our novel approach, we show an example of a perfectly predictive discovery algorithm, depicted three different ways: as a series of computer instructions, as an algebraic equation and also in schematic form.</p>
            <p>The performance metrics for the algorithms we report surpass those of the marketed predictor of anti-TNF response derived using machine learning, consisting of 23 variables, which only identify non-responders with a specificity of 77.3-86.8% and sensitivity of 50.0-60.2%.
                <sup>
                    <xref ref-type="bibr" rid="ref39">39</xref>,
                    <xref ref-type="bibr" rid="ref40">40</xref>
                </sup>
            </p>
            <p>Precision medicine requires highly predictive biomarkers to inform treatment decisions for individual patients. With the availability of more therapeutic options, selecting the most appropriate for an individual patient is an increasingly difficult challenge. Clinicians currently rely on trial and error approaches.</p>
            <p>The necessary biomarkers, to align patients with the optimal therapy, have not been forthcoming despite huge increases in the production of biomedical data. The asymmetry between the tens of thousands of publications describing novel biomarkers, and the tiny fraction of those that ultimately become clinical diagnostic tests, as noted in 2014, has persisted, representing a profound failure of biomarker discovery.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>,
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup> Why?</p>
            <p>The torrent of data enabled by technical advances and digitization led to a 2008 conclusion that the traditional scientific method needed to be refined, as standard hypothesis testing was not compatible with the availability of &#x201c;big data&#x201d;.
                <sup>
                    <xref ref-type="bibr" rid="ref41">41</xref>
                </sup> Computers analyzing large datasets can yield important previously undetectable correlations as seen in astronomy, cosmology and meteorology.
                <sup>
                    <xref ref-type="bibr" rid="ref42">42</xref>,
                    <xref ref-type="bibr" rid="ref43">43</xref>
                </sup> However, in biomedical research, this approach has yielded an underwhelming dividend, as illustrated by the poverty of novel clinically useful biomarkers.</p>
            <p>We hypothesized that prior analytic approaches have not been able to reveal useful biomarkers, because of their lack of suitability for analyzing complex biomedical data, neglecting biology and disease as complex systems.
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup>
            </p>
            <p>Our software solution differs from the various types of machine learning, by fusing evolutionary computation with algorithmic information theory, incorporating a wide range of mathematical functions to directly address the non-linearity and high dimensionality of complex biomedical data yielding transparent quantitative predictive algorithms. Transparency is necessary for both informing medical decisions and providing scientific insight,
                <sup>
                    <xref ref-type="bibr" rid="ref14">14</xref>,
                    <xref ref-type="bibr" rid="ref15">15</xref>,
                    <xref ref-type="bibr" rid="ref44">44</xref>
                </sup> for patients, physicians and regulators, and also to provide a basis for the development of clinical tests.</p>
            <p>The software automatically eliminates overfitted algorithms from consideration. Confirmation that the selected algorithm is not overfitted is done in the third stage of the automated process. The application of concepts from evolutionary biology - inheritance, random variation, and natural selection - explains why evolutionary computation can handle large high dimensional data so efficiently.
                <sup>
                    <xref ref-type="bibr" rid="ref45">45</xref>
                </sup> Information theory is a mathematical framework for understanding information at a fundamental level, which includes the concepts of randomness and algorithmic compression.
                <sup>
                    <xref ref-type="bibr" rid="ref46">46</xref>,
                    <xref ref-type="bibr" rid="ref47">47</xref>
                </sup> That nature, in all its manifestations, is algorithmic, and that scientific comprehension is a process of finding predictive algorithms that compress information into its essence, is the basis for our approach.
                <sup>
                    <xref ref-type="bibr" rid="ref47">47</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref49">49</xref>
                </sup> Our algorithmic focus is complemented by the emerging understanding that biology reflects molecular networks that are algorithmic.
                <sup>
                    <xref ref-type="bibr" rid="ref49">50</xref>
                </sup> Biological functions, including therapeutic response and disease are recognized to be mediated by molecular networks, variously defined as modules, motifs or cores.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>,
                    <xref ref-type="bibr" rid="ref50">51</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref53">54</xref>
                </sup> It has been proposed that understanding of molecular networks will be necessary for a deeper understanding of biological information flow and that this will require an algorithmic framework.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>,
                    <xref ref-type="bibr" rid="ref49">50</xref>
                </sup> The incorporation of many mathematical functions into the software allows the underlying molecular interactions, which are frequently non-linear, to be modeled in the selected algorithms, thereby maximizing their predictivity, without any a priori assumptions as to their nature. The incorporation of mathematical functions into the algorithms aligns with emerging perspectives around the need to incorporate mathematics into biology.
                <sup>
                    <xref ref-type="bibr" rid="ref54">55</xref>
                </sup>
            </p>
            <p>We posit that our approach is practical and effective with modest sample sizes because of its focus on defining the most salient signals, as represented by the mathematical relationships between variables, which is predominantlywhere the information resides in complex systems. The evolutionary foundation of our approach allows large numbers of variables to be analyzed without the need to use arbitrary thresholds and feature selection to eliminate variables from consideration. The number of potential permutations of algorithmic memory registers containing only the final eight variables, combined with available mathematical functions in the analysis we report, is in excess of 10
                <sup>61</sup>. When considering all possible 52,379 biomarkers in the discovery dataset for each patient, the treatment arm variable, the software&#x2019;s complete palette of available mathematical functions, and a limit of only 16 instructions per algorithm, the total number of potential discovery algorithms is 4.749 times 10
                <sup>1253</sup>.</p>
            <p>The discovery algorithm that we present incorporates the sine function, showing that molecular interactions underlying the response to therapy in RA can be represented using mathematical functions that also depict relationships in other biological contexts. This implies that the algorithm depicts a fundamental phenomenon.</p>
            <p>We identify lower expression variables that are likely to have disproportionate biological effects because of their non-linear interactions that other analytic approaches cannot readily detect and have frequently been excluded from consideration. These variables, which are not well studied, are likely to provide insights into the molecular mechanisms underlying responsiveness to anti-TNF therapy in RA. Individually, the eight variables were not highly correlated with response, and would not be useful response predictors, either individually or collectively, in the absence of the mathematical components of the algorithm.</p>
            <p>As well as revealing predictive algorithmic biomarkers, our approach may also enable the identification and understanding of the molecular networks mediating disease and therapeutic effects. These algorithms may help with the identification and prioritization of novel therapeutic targets, particularly those that might be amenable to emerging approaches that modulate specific RNA transcripts. The accuracy we report defines three distinct patient subsets: the first are anti-TNF responders, the second are placebo responders and the third are non-responders to either anti-TNF therapy or to placebo. The potential to predict patients in these three categories will be a focus of future studies to inform the most appropriate individualized therapeutic interventions.</p>
            <p>There are no prior reports directly linking SPTY2D1, KCTD4, and c1orf105 to either RA, immune-mediated diseases or to responses to therapy.
                <sup>
                    <xref ref-type="bibr" rid="ref24">24</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref28">28</xref>
                </sup> TPM3 has been reported as an autoantigen in RA, and to be associated with both myopathy and renal cancer.
                <sup>
                    <xref ref-type="bibr" rid="ref33">33</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref35">35</xref>
                </sup> ARHGDIB expression is upregulated in RA, whereas SIAH1 is downregulated.
                <sup>
                    <xref ref-type="bibr" rid="ref36">36</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref38">38</xref>
                </sup> TPM3, ARHGDIB and SIAH1 have not been associated with therapeutic outcomes. Prior cytomegalovirus exposure has been associated with poor responses to therapy in early RA
                <sup>
                    <xref ref-type="bibr" rid="ref29">29</xref>,
                    <xref ref-type="bibr" rid="ref30">30</xref>
                </sup> which may explain the UL84 gene variable association as it encodes for a cytomegalovirus protein. Mutations in PTPRC, also known as CD45, have been associated with RA patient response to anti-TNF therapy.
                <sup>
                    <xref ref-type="bibr" rid="ref31">31</xref>,
                    <xref ref-type="bibr" rid="ref32">32</xref>
                </sup>
            </p>
            <p>The discovery variables we report and have validated, are in development as components of a clinical PCR test using clinical grade instruments and protocols. PCR tests are versatile and reliable for deployment in clinical laboratories. The discovery algorithm, derived on research instruments such as we have presented here, is not appropriate for clinical use, as its sole purpose is to identify the most informative variables. Research-stage instruments have different quantitation levels, dynamic range and reliability compared to clinical-grade assay processes and technology. Therefore, the clinical test we have in development will require derivation of novel algorithms, which will then need to be prospectively validated for clinical use.</p>
            <p>We envision that the clinical test will provide the basis for an ensemble of algorithms, each predictive of different specific clinical endpoints, in addition to DAS28, at different time points, thereby providing a comprehensive efficacy profile for individual patients, most informative to clinicians, to maximize clinical relevance.</p>
            <p>We are applying the same gene expression variables to other diseases responsive to anti-TNF therapy. Our hypothesis is that the same variables will be the basis of algorithms predictive of individual treatment response to anti-TNF therapies in other diseases where anti-TNF therapy is of proven efficacy, implying that the variables we have identified are of fundamental biological importance in mediating the efficacy of anti-TNF therapy in general.</p>
            <p>Our analytic approach may provide a novel paradigm for future synchronous development of novel therapies and companion diagnostics. Proof of concept clinical studies could routinely incorporate baseline biomarker profiling to yield transparent algorithms predictive of both efficacy and safety signals. The predictive algorithmic biomarkers could then be expeditiously incorporated into and validated in subsequent registration studies, potentially yielding highly predictive companion diagnostics to inform both regulatory approval and reimbursement decisions. Such algorithmic biomarkers could also be incorporated into the product label to inform prescribing decisions for individual patients.</p>
            <p>In the future, we envision all therapies could be accompanied by algorithmic biomarkers, predictive of efficacy and safety endpoints of interest, to objectively and quantitatively inform administration decisions for individual patients. The algorithmic biomarkers could be promptly updated as new data emerge to optimize clinical utility. In addition, clinical trial outcomes could be routinely summarized in terms of the algorithms.</p>
            <p>Optimal translation of biomedical data into actionable information requires analytic methodology designed to yield mathematically informed algorithmic insight from complex high dimensional non-linear data. The novel analytic approach that we present addresses that challenge. This is the only reported method that provides transparent, simple algorithmic biomarkers that accurately reflect biology as a complex system and quantitatively predicts individual therapeutic responses, that can readily be translated into clinical tests. This may have implications for the discovery and development of companion diagnostics and the analysis of clinical trials.</p>
            <p>Currently, the gulf between actual health care and that which could be provided, has arguably never been wider.
                <sup>
                    <xref ref-type="bibr" rid="ref55">56</xref>
                </sup> We contend that bridging that gulf will require solving the &#x201c;biomarker problem&#x201d; with biomarkers that reliably identify those patients who are most likely to benefit from a particular agent.
                <sup>
                    <xref ref-type="bibr" rid="ref56">57</xref>
                </sup> As we have shown here, this will be done by a focus on medicine as an information science, acknowledging that &#x201c;to be useful, data must be analyzed, interpreted, and acted on. Thus, it is algorithms, not data sets, that will prove transformative.&#x201d;
                <sup>
                    <xref ref-type="bibr" rid="ref57">58</xref>
                </sup>
            </p>
        </sec>
        <sec id="sec15">
            <title>Ethical considerations</title>
            <p>The study that provided the discovery data was conducted in accordance with principles of Good Clinical Practice and was approved by the National Ethics Committee in Romania and the National Ethics Committee, Clinical Research of Drugs and Methods of Treatment in Moldova, with all subjects providing informed written consent.
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>,
                    <xref ref-type="bibr" rid="ref17">17</xref>
                </sup> Written informed consent for all participants and local ethics approval was obtained for each of the studies that provided validation data as detailed in the original publications.
                <sup>
                    <xref ref-type="bibr" rid="ref18">18</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref23">23</xref>
                </sup>
            </p>
        </sec>
    </body>
    <back>
        <sec id="sec18" sec-type="data-availability">
            <title>Data availability</title>
            <p>Gene Expression Omnibus (GEO) database: All the gene expression profiles analyzed were downloaded from, and are freely available at, the GEO database. No software is required to view the datasets or to replicate the discovery algorithm we report.</p>
            <p>For discovery analysis, GSE58795 - 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE58795">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE58795</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>
                </sup>
            </p>
            <p>For validation analyses,</p>
            <p>GSE3592 - 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE3592">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE3592</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref18">18</xref>
                </sup>
            </p>
            <p>GSE12051 - 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE12051">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE12051</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref19">19</xref>
                </sup>
            </p>
            <p>GSE15258 - 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE15258">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE15258</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref20">20</xref>
                </sup>
            </p>
            <p>GSE33377 - 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE33377">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE33377</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref21">21</xref>
                </sup>
            </p>
            <p>GSE78068 - 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE78068">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE78068</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref22">22</xref>
                </sup>
            </p>
            <p>GSE20690 - 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE20690">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE20690</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref23">23</xref>
                </sup>
            </p>
            <sec id="sec19">
                <title>Reporting guidelines</title>
                <p>The report was written to comply with the STARD 2015 guideline &#x2013; BMJ 2015:351:h5527 PMID: 26511519</p>
                <p>Figshare: STARD-2015-Checklist forQuantitative AI based on evolutionary computation yields algorithmic RNA biomarkers from a randomized rheumatoid arthritis clinical trial, accurately predicting individual patient responses to anti-TNF treatment.docx, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.6084/m9.figshare.28707170.v1">https://doi.org/10.6084/m9.figshare.28707170.v1</ext-link>
                </p>
                <p>This project contains the following underlying data:</p>
                <p>STARD-2015-Checklist.docx</p>
                <p>Data is available under 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">CC BY 4.0</ext-link> license.</p>
                <p>The clinical trial used for discovery analysis was registered - 
                    <ext-link ext-link-type="uri" xlink:href="http://ClinicalTrials.gov">ClinicalTrials.gov</ext-link> registration: 
                    <ext-link ext-link-type="uri" xlink:href="https://clinicaltrials.gov/study/NCT01313520">NCT01313520</ext-link>
                </p>
            </sec>
        </sec>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Joyner</surname>
                            <given-names>MJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Paneth</surname>
                            <given-names>N</given-names>
                        </name>
</person-group>:
                    <article-title>Promises, promises, and precision medicine.</article-title>
                    <source>

                        <italic toggle="yes">J. Clin. Invest.</italic>
</source>
                    <year>2019</year>;<volume>129</volume>(<issue>3</issue>):<fpage>946</fpage>&#x2013;<lpage>948</lpage>.
                    <pub-id pub-id-type="pmid">30688663</pub-id>
                    <pub-id pub-id-type="doi">10.1172/JCI126119</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6391102</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Barker</surname>
                            <given-names>AD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Compton</surname>
                            <given-names>CC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Poste</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <article-title>The National Biomarker Development Alliance accelerating the translation of biomarkers to the clinic.</article-title>
                    <source>

                        <italic toggle="yes">Biomark. Med.</italic>
</source>
                    <year>2014</year>,<year>2014</year>;<volume>8</volume>(<issue>6</issue>):<fpage>873</fpage>&#x2013;<lpage>876</lpage>.
                    <pub-id pub-id-type="doi">10.2217/bmm.14.52</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Barker</surname>
                            <given-names>AD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Alba</surname>
                            <given-names>MM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mallick</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An Inflection Point in Cancer Protein Biomarkers: What was and What&#x2019;s Next.</article-title>
                    <source>

                        <italic toggle="yes">Mol. Cell. Proteomics.</italic>
</source>
                    <year>2023</year>;<volume>22</volume>(<issue>7</issue>):<fpage>100569</fpage>.
                    <pub-id pub-id-type="pmid">37196763</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.mcpro.2023.100569</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10388583</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hopfield</surname>
                            <given-names>JJ</given-names>
                        </name>
</person-group>:
                    <article-title>Physics, Computation, and Why Biology Looks so Different.</article-title>
                    <source>

                        <italic toggle="yes">J. Theor. Biol.</italic>
</source>
                    <year>1994</year>;<volume>171</volume>:<fpage>53</fpage>&#x2013;<lpage>60</lpage>.
                    <pub-id pub-id-type="doi">10.1006/jtbi.1994.1211</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nurse</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>Life, logic and information.</article-title>
                    <source>

                        <italic toggle="yes">Nature.</italic>
</source>
                    <year>2008</year>;<volume>454</volume>(<issue>7203</issue>):<fpage>424</fpage>&#x2013;<lpage>426</lpage>.
                    <pub-id pub-id-type="doi">10.1038/454424a</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nurse</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>Complexity and Biology.</article-title>
                    <source>

                        <italic toggle="yes">Cell.</italic>
</source>
                    <year>2014</year>;<volume>157</volume>(<issue>1</issue>):<fpage>272</fpage>&#x2013;<lpage>273</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.cell.2014.03.013</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Berger</surname>
                            <given-names>SI</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Iyengar</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>Role of systems pharmacology in understanding drug adverse events.</article-title>
                    <source>

                        <italic toggle="yes">Wiley Interdiscip. Rev. Syst. Biol. Med.</italic>
</source>
                    <year>2011</year>;<volume>3</volume>(<issue>2</issue>):<fpage>129</fpage>&#x2013;<lpage>135</lpage>.
                    <pub-id pub-id-type="pmid">20803507</pub-id>
                    <pub-id pub-id-type="doi">10.1002/wsbm.114</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3057924</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Savic</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Caseley</surname>
                            <given-names>EA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>McDermott</surname>
                            <given-names>MF</given-names>
                        </name>
</person-group>:
                    <article-title>Moving towards a systems-based classification of innate immune-mediated diseases.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Rev. Rheumatol.</italic>
</source>
                    <year>2020</year>;<volume>16</volume>:<fpage>222</fpage>&#x2013;<lpage>237</lpage>.
                    <pub-id pub-id-type="pmid">32107482</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41584-020-0377-5</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Coffey</surname>
                            <given-names>DS</given-names>
                        </name>
</person-group>:
                    <article-title>Self-organization, complexity and chaos: The new biology for medicine.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Med.</italic>
</source>
                    <year>1998</year>;<volume>4</volume>:<fpage>882</fpage>&#x2013;<lpage>885</lpage>.
                    <pub-id pub-id-type="pmid">9701230</pub-id>
                    <pub-id pub-id-type="doi">10.1038/nm0898-882</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Goldberger</surname>
                            <given-names>AL</given-names>
                        </name>
</person-group>:
                    <article-title>Giles f. Filley lecture. Complex systems.</article-title>
                    <source>

                        <italic toggle="yes">Proc. Am. Thorac. Soc.</italic>
</source>
                    <year>2006</year>;<volume>3</volume>(<issue>6</issue>):<fpage>467</fpage>&#x2013;<lpage>471</lpage>.
                    <pub-id pub-id-type="pmid">16921107</pub-id>
                    <pub-id pub-id-type="doi">10.1513/pats.200603-028MS</pub-id>
                    <pub-id pub-id-type="pmcid">PMC2647633</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rea</surname>
                            <given-names>TJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brown</surname>
                            <given-names>CM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sing</surname>
                            <given-names>CF</given-names>
                        </name>
</person-group>:
                    <article-title>Complex adaptive system models and the genetic analysis of plasma HDL-cholesterol concentration.</article-title>
                    <source>

                        <italic toggle="yes">Perspect. Biol. Med.</italic>
</source>
                    <year>2006</year>;<volume>49</volume>(<issue>4</issue>):<fpage>490</fpage>&#x2013;<lpage>503</lpage>.
                    <pub-id pub-id-type="pmid">17146134</pub-id>
                    <pub-id pub-id-type="doi">10.1353/pbm.2006.0063</pub-id>
                    <pub-id pub-id-type="pmcid">PMC1764123</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mazzocchi</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>Complexity in biology. Exceeding the limits of reductionism and determinism using complexity theory.</article-title>
                    <source>

                        <italic toggle="yes">EMBO Rep.</italic>
</source>
                    <year>2008</year>;<volume>9</volume>(<issue>1</issue>):<fpage>10</fpage>&#x2013;<lpage>14</lpage>.
                    <pub-id pub-id-type="pmid">18174892</pub-id>
                    <pub-id pub-id-type="doi">10.1038/sj.embor.7401147</pub-id>
                    <pub-id pub-id-type="pmcid">PMC2246621</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Herrington</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>Y</given-names>
                        </name>
</person-group>:
                    <article-title>Clinical heterogenity in the age of big data, advanced analytics and complexity theory.</article-title>
                    <source>

                        <italic toggle="yes">Trans. Am. Clin. Climatol. Assoc.</italic>
</source>
                    <year>2023</year>;<volume>133</volume>:<fpage>56</fpage>&#x2013;<lpage>68</lpage>.
                    <pub-id pub-id-type="pmid">37701617</pub-id>
                    <ext-link ext-link-type="uri" xlink:href="https://pmc.ncbi.nlm.nih.gov/articles/PMC10493739/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wilkinson</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Arnold</surname>
                            <given-names>KF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Murray</surname>
                            <given-names>EJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Time to reality check the promises of machine learning-powered precision medicine.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Digit Health.</italic>
</source>
                    <year>2020</year>;<volume>2</volume>:<fpage>e677</fpage>&#x2013;<lpage>e680</lpage>.
                    <pub-id pub-id-type="pmid">33328030</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S2589-7500(20)30200-4</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9060421</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Price</surname>
                            <given-names>WN</given-names>
                        </name>
</person-group>:
                    <article-title>Big data and black-box medical algorithms.</article-title>
                    <source>

                        <italic toggle="yes">Sci. Transl. Med.</italic>
</source>
                    <year>2018</year>;<volume>10</volume>:<fpage>471</fpage>.
                    <pub-id pub-id-type="pmid">30541791</pub-id>
                    <pub-id pub-id-type="doi">10.1126/scitranslmed.aao5333</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6345162</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>MacIsaac</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baumgartner</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kang</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Pre-treatment whole blood gene expression is associated with 14-week response assessed by dynamic contrast enhanced magnetic resonance imaging in infliximab-treated rheumatoid arthritis patients.</article-title>
                    <source>

                        <italic toggle="yes">PLoS ONE.</italic>
</source>
                    <year>2014</year>;<volume>9</volume>(<issue>12</issue>):<fpage>e111937</fpage>.
                    <pub-id pub-id-type="pmid">25504080</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0113937</pub-id>
                    <pub-id pub-id-type="pmcid">PMC4264695</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Beals</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baumgartner</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Peterfy</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Magnetic resonance imaging of the hand and wrist in a randomized, double-blind, multicenter, placebo-controlled trial of infliximab for rheumatoid arthritis: Comparison of dynamic contrast enhanced assessments with semi-quantitative scoring.</article-title>
                    <source>

                        <italic toggle="yes">PLoS ONE.</italic>
</source>
                    <year>2017</year>;<volume>12</volume>(<issue>12</issue>):<fpage>e0187397</fpage>.
                    <pub-id pub-id-type="pmid">29236711</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0187397</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5728526</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lequerre</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gauthier-Jauneau</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bansard</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Gene profiling in white blood cells predicts infliximab responsiveness in rheumatoid arthritis.</article-title>
                    <source>

                        <italic toggle="yes">Arth. Res. Ther.</italic>
</source>
                    <year>2006</year>;<volume>8</volume>:<fpage>R105</fpage>.
                    <pub-id pub-id-type="pmid">16817978</pub-id>
                    <pub-id pub-id-type="doi">10.1186/ar1990</pub-id>
                    <pub-id pub-id-type="pmcid">PMC1779405</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Julia</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Erra</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Palacio</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An eight-gene blood expression profile.</article-title>
                    <source>

                        <italic toggle="yes">PloS ONE.</italic>
</source>
                    <year>2009</year>;<volume>4</volume>:<fpage>e7556</fpage>.
                    <pub-id pub-id-type="pmid">19847310</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0007556</pub-id>
                    <pub-id pub-id-type="pmcid">PMC2762038</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bienkowska</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dagin</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Batliwalla</surname>
                            <given-names>F</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Convergent random forest predictor: Methodology for predicting drug response from genome-scale data applied to anti-TNF response.</article-title>
                    <source>

                        <italic toggle="yes">Genomics.</italic>
</source>
                    <year>2009</year>;<volume>94</volume>:<fpage>423</fpage>&#x2013;<lpage>432</lpage>.
                    <pub-id pub-id-type="pmid">19699293</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.ygeno.2009.08.008</pub-id>
                    <pub-id pub-id-type="pmcid">PMC4476397</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Toonen</surname>
                            <given-names>EJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gilissen</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Franke</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Validation study of existing gene expression signatures for anti-TNF treatment in patients with rheumatoid arthritis.</article-title>
                    <source>

                        <italic toggle="yes">PLoS ONE.</italic>
</source>
                    <year>2012</year>;<volume>7</volume>(<issue>3</issue>):<fpage>e33199</fpage>.
                    <pub-id pub-id-type="pmid">22457743</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0033199</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3310059</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nakamura</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Suzuki</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Iijima</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Identification of baseline gene expression signatures predicting therapeutic responses to three biologic agents in rheumatoid arthritis: a retrospective observational study.</article-title>
                    <source>

                        <italic toggle="yes">Arth. Res. Ther.</italic>
</source>
                    <year>2016</year>;<volume>18</volume>:<fpage>159</fpage>.
                    <pub-id pub-id-type="pmid">27435242</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13075-016-1052-8</pub-id>
                    <pub-id pub-id-type="pmcid">PMC4952232</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tanino</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Matoba</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nakamura</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Prediction of efficacy of anti-TNF biologic agent, infliximab, for rheumatoid arthritis patients using a comprehensive transcriptome analysis of white blood cells.</article-title>
                    <source>

                        <italic toggle="yes">Biochem. Biophys. Res. Commun.</italic>
</source>
                    <year>2009 18</year>;<volume>387</volume>(<issue>2</issue>):<fpage>261</fpage>&#x2013;<lpage>265</lpage>.
                    <pub-id pub-id-type="pmid">19577537</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.bbrc.2009.06.149</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ram&#x00ed;rez-Moya</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wert-Lamas</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Acu&#x00f1;a-Ru&#x00ed;z</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Identification of an interactome network between lncRNAs and miRNAs in thyroid cancer reveals SPTY2D1-AS1 as a new tumor suppressor.</article-title>
                    <source>

                        <italic toggle="yes">Sci. Rep.</italic>
</source>
                    <year>2022</year>;<volume>12</volume>(<issue>1</issue>):<fpage>7706</fpage>.
                    <pub-id pub-id-type="pmid">35562181</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41598-022-11725-4</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9095586</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref25">
                <label>25</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Li</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kong</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ma</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Identification of potential M2 macrophage-associated diagnostic biomarkers in coronary artery disease.</article-title>
                    <source>

                        <italic toggle="yes">Biosci. Rep.</italic>
</source>
                    <year>2022</year>;<volume>42</volume>(<issue>12</issue>):<fpage>BSR20221394</fpage>.
                    <pub-id pub-id-type="pmid">36222281</pub-id>
                    <pub-id pub-id-type="doi">10.1042/BSR20221394</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9744721</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <label>26</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zhang</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Huang</surname>
                            <given-names>X</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>X</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Identification of potential crucial genes in atrial fibrillation: a bioinformatic analysis.</article-title>
                    <source>

                        <italic toggle="yes">BMC Med. Genet.</italic>
</source>
                    <year>2020</year>;<volume>13</volume>(<issue>1</issue>):<fpage>104</fpage>.
                    <pub-id pub-id-type="pmid">32682418</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s12920-020-00754-5</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7368672</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <label>27</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kim</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Noh</surname>
                            <given-names>JH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lee</surname>
                            <given-names>MJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Effects of mitochondrial transplantation on transcriptomics in a polymicrobial sepsis model.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Mol. Sci.</italic>
</source>
                    <year>2023</year>;<volume>24</volume>(<issue>20</issue>):<fpage>15326</fpage>.
                    <pub-id pub-id-type="pmid">37895006</pub-id>
                    <pub-id pub-id-type="doi">10.3390/ijms242015326</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10607172</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <label>28</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zheng</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yu</surname>
                            <given-names>X</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Xu</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>KCTD4 interacts with CLIC1 to disrupt calcium homeostasis and promote metastasis in esophageal cancer.</article-title>
                    <source>

                        <italic toggle="yes">Acta Pharm. Sin. B.</italic>
</source>
                    <year>2023</year>;<volume>13</volume>(<issue>10</issue>):<fpage>4217</fpage>&#x2013;<lpage>4233</lpage>.
                    <pub-id pub-id-type="pmid">37799381</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.apsb.2023.07.013</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10547965</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref29">
                <label>29</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Colletti</surname>
                            <given-names>KS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Smallenburg</surname>
                            <given-names>KE</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Xu</surname>
                            <given-names>Y</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Human cytomegalovirus UL84 interacts with an RNA stem-loop sequence found within the RNA/DNA hybrid region of oriLyt.</article-title>
                    <source>

                        <italic toggle="yes">J. Virol.</italic>
</source>
                    <year>2007</year>;<volume>81</volume>:<fpage>7077</fpage>&#x2013;<lpage>7085</lpage>.
                    <pub-id pub-id-type="pmid">17459920</pub-id>
                    <pub-id pub-id-type="doi">10.1128/jvi.00058-07</pub-id>
                    <pub-id pub-id-type="pmcid">PMC1933308</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref30">
                <label>30</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Davis</surname>
                            <given-names>JM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Knutson</surname>
                            <given-names>KL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Strausbauch</surname>
                            <given-names>MA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Immune response profiling in early rheumatoid arthritis: discovery of a novel interaction of treatment response with viral immunity.</article-title>
                    <source>

                        <italic toggle="yes">Arthritis Res. Ther.</italic>
</source>
                    <year>2013</year>;<volume>15</volume>(<issue>6</issue>):<fpage>R199</fpage>.
                    <pub-id pub-id-type="pmid">24267267</pub-id>
                    <pub-id pub-id-type="doi">10.1186/ar4389</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3978471</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref31">
                <label>31</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cui</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Saevarsdottir</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Thomson</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Rheumatoid arthritis risk allele PTPRC is also associated with response to anti-tumor necrosis factor alpha therapy.</article-title>
                    <source>

                        <italic toggle="yes">Arthritis Rheum.</italic>
</source>
                    <year>2010</year>;<volume>62</volume>(<issue>7</issue>):<fpage>1849</fpage>&#x2013;<lpage>1861</lpage>.
                    <pub-id pub-id-type="pmid">20309874</pub-id>
                    <pub-id pub-id-type="doi">10.1002/art.27457</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3652476</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref32">
                <label>32</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Plant</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Prajapati</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hyrich</surname>
                            <given-names>KL</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Replication of association of the PTPRC gene with response to anti-tumor necrosis factor therapy in a large UK cohort.</article-title>
                    <source>

                        <italic toggle="yes">Arthritis Rheum.</italic>
</source>
                    <year>2012</year>;<volume>64</volume>(<issue>3</issue>):<fpage>665</fpage>&#x2013;<lpage>670</lpage>.
                    <pub-id pub-id-type="pmid">21952740</pub-id>
                    <pub-id pub-id-type="doi">10.1002/art.33381</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3427899</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref33">
                <label>33</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Poulsen</surname>
                            <given-names>TBG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Damgaard</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>J&#x00f8;rgensen</surname>
                            <given-names>MM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Identification of Novel Native Autoantigens in Rheumatoid Arthritis.</article-title>
                    <source>

                        <italic toggle="yes">Biomedicine.</italic>
</source>
                    <year>2020</year>;<volume>8</volume>(<issue>6</issue>):<fpage>141</fpage>.
                    <pub-id pub-id-type="pmid">32486012</pub-id>
                    <pub-id pub-id-type="doi">10.3390/biomedicines8060141</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7345460</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref34">
                <label>34</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lambert</surname>
                            <given-names>MR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gussoni</surname>
                            <given-names>E</given-names>
                        </name>
</person-group>:
                    <article-title>Tropomyosin 3 (TPM3) function in skeletal muscle and in myopathy.</article-title>
                    <source>

                        <italic toggle="yes">Skelet. Muscle.</italic>
</source>
                    <year>2023</year>;<volume>13</volume>(<issue>1</issue>):<fpage>18</fpage>.
                    <pub-id pub-id-type="pmid">37936227</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13395-023-00327-x</pub-id>
                    <pub-id pub-id-type="pmcid">PMC10629095</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref35">
                <label>35</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Galea</surname>
                            <given-names>LA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hildebrand</surname>
                            <given-names>MS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Witkowski</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>ALK-rearranged renal cell carcinoma with TPM3::ALK gene fusion and review of the literature.</article-title>
                    <source>

                        <italic toggle="yes">Virchows Arch.</italic>
</source>
                    <year>2023</year>;<volume>482</volume>(<issue>3</issue>):<fpage>625</fpage>&#x2013;<lpage>633</lpage>.
                    <pub-id pub-id-type="pmid">36370168</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s00428-022-03451-z</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref36">
                <label>36</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ritter</surname>
                            <given-names>SY</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Subbaiah</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bebek</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Proteomic analysis of synovial fluid from the osteoarthritic knee: comparison with transcriptome analyses of joint tissues.</article-title>
                    <source>

                        <italic toggle="yes">Arthritis Rheum.</italic>
</source>
                    <year>2013</year>;<volume>65</volume>(<issue>4</issue>):<fpage>981</fpage>&#x2013;<lpage>992</lpage>.
                    <pub-id pub-id-type="pmid">23400684</pub-id>
                    <pub-id pub-id-type="doi">10.1002/art.37823</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3618606</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref37">
                <label>37</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lequerr&#x00e9;</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bansard</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vittecoq</surname>
                            <given-names>O</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Early and long-standing rheumatoid arthritis: distinct molecular signatures identified by gene-expression profiling in synovia.</article-title>
                    <source>

                        <italic toggle="yes">Arthritis Res. Ther.</italic>
</source>
                    <year>2009</year>;<volume>11</volume>:<fpage>R99</fpage>.
                    <pub-id pub-id-type="pmid">19563633</pub-id>
                    <pub-id pub-id-type="doi">10.1186/ar2744</pub-id>
                    <pub-id pub-id-type="pmcid">PMC2714155</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref38">
                <label>38</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Badr</surname>
                            <given-names>MT</given-names>
                        </name>

                        <name name-style="western">
                            <surname>H&#x00e4;cker</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <article-title>Gene expression profiling meta-analysis reveals novel gene signatures and pathways shared between tuberculosis and rheumatoid arthritis.</article-title>
                    <source>

                        <italic toggle="yes">PLoS ONE.</italic>
</source>
                    <year>2019</year>;<volume>14</volume>(<issue>3</issue>):<fpage>e0213470</fpage>.
                    <pub-id pub-id-type="pmid">30845171</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0213470</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6405138</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref39">
                <label>39</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mellors</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Withers</surname>
                            <given-names>JB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ameli</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Clinical validation of a blood-based predictive test for stratification of response to tumor necrosis factor inhibitor therapies in rheumatoid arthritis patients.</article-title>
                    <source>

                        <italic toggle="yes">Network and Systems Medicine.</italic>
</source>
                    <year>2020</year>;<volume>3</volume>(<issue>1</issue>):<fpage>91</fpage>&#x2013;<lpage>104</lpage>.
                    <pub-id pub-id-type="doi">10.1089/nsm.2020.0007</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref40">
                <label>40</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jones</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rapisardo</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zhang</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Analytical and clinical validation of an RNA sequencing-based assay for quantitative, accurate evaluation of a molecular signature response classifier in rheumatoid arthritis.</article-title>
                    <source>

                        <italic toggle="yes">Expert. Rev. Mol. Diagn.</italic>
</source>
                    <year>2021</year>;<volume>21</volume>(<issue>11</issue>):<fpage>1235</fpage>&#x2013;<lpage>1243</lpage>.
                    <pub-id pub-id-type="pmid">34727834</pub-id>
                    <pub-id pub-id-type="doi">10.1080/14737159.2021.2000394</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref41">
                <label>41</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Anderson</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>The End of Theory: The Data Deluge Makes the Scientific Method Obsolete 
                        <italic toggle="yes">Wired</italic> 16.07 retrieved Jan 13
                        <sup>th</sup> 2025.</article-title>
                    <year>2008</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.wired.com/2008/06/pb-theory/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref42">
                <label>42</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pontzen</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">The Universe in a Box: Simulations and the Quest to Code the Cosmos.</italic>
</source>
                    <publisher-name>Riverhead Books</publisher-name>;<year>2023</year>.
                    <isbn>9780593330487</isbn>.</mixed-citation>
            </ref>
            <ref id="ref43">
                <label>43</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Doyne Farmer</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Making Sense of Chaos: A Better Economics for a Better World.</italic>
</source>
                    <publisher-name>Yale University Press</publisher-name>;<year>2024</year>.
                    <isbn>9780300273779</isbn>.</mixed-citation>
            </ref>
            <ref id="ref44">
                <label>44</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Naughton</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>Machine-learning systems are problematic. That&#x2019;s why tech bosses call them &#x2018;AI&#x2019;.</article-title>
                    <source>

                        <italic toggle="yes">The Guardian.</italic>
</source>
                    <year>2022</year>. Retrieved June 22
                    <sup>nd</sup>2025.
                    <ext-link ext-link-type="uri" xlink:href="https://www.theguardian.com/commentisfree/2022/nov/05/machine-learning-systems-are-problematic-thats-why-tech-bosses-call-them-ai">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref45">
                <label>45</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sipper</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Olson</surname>
                            <given-names>RS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Moore</surname>
                            <given-names>JH</given-names>
                        </name>
</person-group>:
                    <article-title>Evolutionary computation: the next major transition of artificial intelligence?</article-title>
                    <source>

                        <italic toggle="yes">BioData Min.</italic>
</source>
                    <year>2017</year>;<volume>10</volume>:<fpage>26</fpage>.
                    <pub-id pub-id-type="pmid">28775766</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13040-017-0147-3</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5534026</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref46">
                <label>46</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gleich</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">The Information: A History, a Theory, a Flood.</italic>
</source>
                    <publisher-name>Pantheon Books (US)</publisher-name>;<year>2011</year>.
                    <isbn>978-0-375-423-72-7</isbn>.</mixed-citation>
            </ref>
            <ref id="ref47">
                <label>47</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Robertson</surname>
                            <given-names>DS</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Phase Change: The Computer Revolution in Science and Mathematics.</italic>
</source>
                    <publisher-name>Oxford University Press</publisher-name>;<year>2003</year>.
                    <isbn>0195157486</isbn>.</mixed-citation>
            </ref>
            <ref id="ref48">
                <label>48</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zenil</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Schmidt</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tenner</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <chapter-title>Causality, information and biological computation: an algorithmic software approach to life, disease and the immune system.</chapter-title>
                    <source>

                        <italic toggle="yes">Chapter in From Matter to Life: Information and Causality.</italic>
</source>
                    <person-group person-group-type="editor">

                        <name name-style="western">
                            <surname>Walker</surname>
                            <given-names>SI</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Davies</surname>
                            <given-names>PCW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ellis</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>, editors.
                    <publisher-name>Cambridge University Press</publisher-name>;<year>2017</year>; pages<fpage>244</fpage>&#x2013;<lpage>280</lpage>.
                    <isbn>9781107150539</isbn>.</mixed-citation>
            </ref>
            <ref id="ref49">
                <label>50</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Arthur</surname>
                            <given-names>WB</given-names>
                        </name>
</person-group>:
                    <article-title>Algorithms and the Shift in Modern Science. Beijer Discussion Paper Series No. 269.</article-title>
                    <year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://beijer.kva.se/publication/algorithms-and-the-shift-in-modern-science/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref50">
                <label>51</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lim</surname>
                            <given-names>WA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lee</surname>
                            <given-names>CM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tang</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>Design principles of regulatory networks: searching for the molecular algorithms of the cell.</article-title>
                    <source>

                        <italic toggle="yes">Mol. Cell.</italic>
</source>
                    <year>2013</year>;<volume>49</volume>(<issue>2</issue>):<fpage>202</fpage>&#x2013;<lpage>212</lpage>.
                    <pub-id pub-id-type="pmid">23352241</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.molcel.2012.12.020</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3664230</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref51">
                <label>52</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alon</surname>
                            <given-names>U</given-names>
                        </name>
</person-group>:
                    <article-title>Network motifs: theory and experimental approaches.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Rev. Genet.</italic>
</source>
                    <year>2007</year>;<volume>8</volume>(<issue>6</issue>):<fpage>450</fpage>&#x2013;<lpage>461</lpage>.
                    <pub-id pub-id-type="doi">10.1038/nrg2102</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref52">
                <label>53</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gallo</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>De Renzis</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sharpe</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Versatile system cores as a conceptual basis for generality in cell and developmental biology.</article-title>
                    <source>

                        <italic toggle="yes">Cell Syst.</italic>
</source>
                    <year>2024</year>;<volume>15</volume>(<issue>9</issue>):<fpage>790</fpage>&#x2013;<lpage>807</lpage>.
                    <pub-id pub-id-type="pmid">39236709</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.cels.2024.08.001</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref53">
                <label>54</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hartwell</surname>
                            <given-names>LH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hopfield</surname>
                            <given-names>JJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Leibler</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>From molecular to modular cell biology.</article-title>
                    <source>

                        <italic toggle="yes">Nature.</italic>
</source>
                    <year>1999</year>;<volume>402</volume>(<issue>6761 Suppl</issue>):<fpage>C47</fpage>&#x2013;<lpage>C52</lpage>.
                    <pub-id pub-id-type="doi">10.1038/35011540</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref54">
                <label>55</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rajapakse</surname>
                            <given-names>I</given-names>
                        </name>
</person-group>:
                    <article-title>Conversation with Dr Steve Smale and Dr. Lee Hartwell.</article-title>
                    <source>

                        <italic toggle="yes">Not. Am. Math. Soc.</italic>
</source>
                    <year>2021</year>;<volume>68</volume>(<issue>9</issue>):<fpage>1578</fpage>&#x2013;<lpage>1582</lpage>.
                    <pub-id pub-id-type="doi">10.1090/noti2356</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref55">
                <label>56</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Angus</surname>
                            <given-names>DC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Huang</surname>
                            <given-names>AJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lewis</surname>
                            <given-names>RJ</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The Integration of Clinical Trials With the Practice of Medicine: Repairing a House Divided.</article-title>
                    <year>2024</year>;<volume>332</volume>(<issue>2</issue>):<fpage>153</fpage>&#x2013;<lpage>162</lpage>.
                    <pub-id pub-id-type="pmid">38829654</pub-id>
                    <pub-id pub-id-type="doi">10.1001/jama.2024.4088</pub-id>
                    <pub-id pub-id-type="pmcid">PMC12045079</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref56">
                <label>57</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sawyers</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>The cancer biomarker problem.</article-title>
                    <source>

                        <italic toggle="yes">Nature.</italic>
</source>
                    <year>2008</year>;<volume>452</volume>:<fpage>548</fpage>&#x2013;<lpage>552</lpage>.
                    <pub-id pub-id-type="doi">10.1038/nature06913</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref57">
                <label>58</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Obermeyer</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Emanuel</surname>
                            <given-names>EJ</given-names>
                        </name>
</person-group>:
                    <article-title>Predicting the Future - Big Data, Machine Learning, and Clinical Medicine.</article-title>
                    <source>

                        <italic toggle="yes">N. Engl. J. Med.</italic>
</source>
                    <year>2016</year>;<volume>375</volume>(<issue>13</issue>):<fpage>1216</fpage>&#x2013;<lpage>1219</lpage>.
                    <pub-id pub-id-type="pmid">27682033</pub-id>
                    <pub-id pub-id-type="doi">10.1056/NEJMp1606181</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5070532</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report403742">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.180451.r403742</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Roudier</surname>
                        <given-names>Jean</given-names>
                    </name>
                    <xref ref-type="aff" rid="r403742a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r403742a1">
                    <label>1</label>INSERM, Luminy, France</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>10</day>
                <month>10</month>
                <year>2025</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Roudier J</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport403742" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.164015.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>"Some kind of mathematical analysis (a genius in a black box) is performed using 50.000 biomarkers expression data from a study of clinical outcome in 59 patients with RA under Infliximab or placebo.</p>
            <p> </p>
            <p> From there, 8 markers are identified which are supposedly predictive of&#x00a0; clinical response to Infliximab.</p>
            <p> The expression of these 8 markers is studied in another 6&#x00a0; &#x00a0;50.000 markers &#x00a0;expression and clinical outcome studies in RA patients under Infliximab or Placebo.</p>
            <p> </p>
            <p> The genius in a black box mathematical analysis supposedly allows to predict responders and non responders with 100% accuracy.</p>
            <p> </p>
            <p> This article is interesting but &#x00a0;presented as</p>
            <p> </p>
            <p> "I got a great mathematical toolbox that allows me to predict clinical response to infliximab in patients with RA&#x00a0; from 50.000 biomarkers expression data ".</p>
            <p> </p>
            <p> I suggest to shorten the &#x00a0;introduction and discussion and 
                <bold>try to&#x00a0;explain simply for a layperson what kind of mathematical/statistical treatment of the expression data has been done</bold>&#x00a0;.</p>
            <p> </p>
            <p> </p>
            <p> </p>
            <p> </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>No</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>No</p>
            <p>Reviewer Expertise:</p>
            <p>immunogenetics of Rheumatoid arthritis</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment15405-403742">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Horgan</surname>
                            <given-names>Kevin</given-names>
                        </name>
                        <aff>Liquid Biosciences Inc, Aliso Viejo, California, USA</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>Corresponding author. Conflicts of interest presented in manuscript.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>4</day>
                    <month>2</month>
                    <year>2026</year>
                </pub-date>
            </front-stub>
            <body>
                <p>The reviewers reservations about whether the the work is clearly and accurately presented and whether it cites the current literature are difficult to address without identification of specific concerns. &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0; &#x00a0;</p>
                <p> </p>
                <p> Similarly, the apparent reservations about study design are also difficult to address without specifics.</p>
                <p> </p>
                <p> Regarding the presentation of sufficient details of methods and analysis to allow replication. Anticipating that this is a concern in all publications, we have transparently provided an example of an algorithm to enable independent verification of our approach, utilizing the publicly available data that we cite.</p>
                <p> </p>
                <p> Regarding the apparent reservations about the conclusions drawn, without specific insight on the nature of the reservations it is not possible to directly address.</p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report398676">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.180451.r398676</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Solomon</surname>
                        <given-names>Daniel H.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r398676a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <contrib contrib-type="author">
                    <name>
                        <surname>Marks</surname>
                        <given-names>Kathryne</given-names>
                    </name>
                    <xref ref-type="aff" rid="r398676a1">1</xref>
                    <role>Co-referee</role>
                </contrib>
                <aff id="r398676a1">
                    <label>1</label>Harvard Medical School, Boston, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>22</day>
                <month>8</month>
                <year>2025</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2025 Solomon DH and Marks K</copyright-statement>
                <copyright-year>2025</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport398676" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.164015.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Comments: 
                <list list-type="order">
                    <list-item>
                        <p>The authors pointed out several genes of interest. However, it was unclear if there was an increase in transcription or a decrease. This seems like an important detail to leave out.</p>
                    </list-item>
                    <list-item>
                        <p>Were all 8 genes used in the final predictive model? If not, why not and how were some eliminated?</p>
                    </list-item>
                    <list-item>
                        <p>I was a bit unclear on why placebo patients were being considered. I would find it helpful if the authors showed the 2x2 contingency table used to generate sensitivity and specificity.</p>
                    </list-item>
                    <list-item>
                        <p>The authors need to comment on the heterogeneity of the cohorts.</p>
                    </list-item>
                    <list-item>
                        <p>Is a 14 week follow-up adequate?</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Partly</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however we have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment14487-398676">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Horgan</surname>
                            <given-names>Kevin</given-names>
                        </name>
                        <aff>Liquid Biosciences Inc, Aliso Viejo, California, USA</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>Author review. Kevin Horgan and Patrick Lilley have equity interests in Liquid Biosciences, the developer and owner of the software used in the study.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>1</day>
                    <month>9</month>
                    <year>2025</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Response to review from&#x00a0;Daniel H. Solomon,&#x00a0;Harvard Medical School, Boston, USA and &#x00a0;&#x00a0;</p>
                <p> Kathryne Marks,&#x00a0;Brigham and Women's Hospital, Boston, Massachusetts, USA&#x00a0;</p>
                <p> </p>
                <p> 
                    <bold>1.&#x00a0;The authors pointed out several genes of interest. However, it was unclear if there was an increase in transcription or a decrease. This seems like an important detail to leave out.&#x00a0;</bold>
                </p>
                <p> </p>
                <p> 
                    <italic>Authors answer: We thank you for your perceptive and helpful comments. The mRNA/transcription biomarkers&#x2019; data values were measurements of the 
                        <underline>state</underline> of a patient at a single baseline timepoint.&#x00a0; Therefore, there is no increase or decrease to be reported, in a longitudinal sense.&#x00a0; However, it may be that the reviewer intended to refer to the baseline differences between future responders and non-responders &#x2013; usually reported as a difference of means with a p value.&#x00a0; If this is the case, the comment and the aforementioned metrics have an underlying assumption, which is that the biomarkers would be consistently higher or lower in responders than non-responders.&#x00a0; This assumption is based on each biomarker being an &#x201c;independent variable&#x201d; in a predictive model.&#x00a0; Further, the difference of means and the associated p value metric, assume linearity and normal distributions. It turns out that none of these three assumptions are true in the datasets.&#x00a0; A central point of the paper is that biomarkers are interacting in the dynamic biology of the patient, the inflammatory disease state, and exogenous factors like lifestyle and treatments. This is borne out in our algorithmic models: &#x00a0;the interactions of the biomarkers carry far more predictive information than the levels of each biomarker in isolation. A minimum of four biomarkers are needed for an accurate, robust predictive model, and their measurements are demonstrably interacting mathematically in our model(s).&#x00a0; A difference of means metric can be blind to the relationships between the biomarkers because it cannot capture interactions, nonlinearity, or manifold distributions.&#x00a0; By contrast, our model does capture nonlinear interactions between the biomarkers, and does not depend on any consistent baseline differences in biomarker levels between responders and non-responders.</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>2. Were all 8 genes used in the final predictive model? If not, why not and how were some eliminated?</bold>
                </p>
                <p> </p>
                <p> 
                    <italic>None of the eight biomarkers were eliminated.&#x00a0; We discovered two distinct sets of four biomarkers, where each set contains the minimum number of biomarkers required for the best combination of accuracy and robustness: reproducibility across patient heterogeneity.&#x00a0; We discovered the first minimal set of four, whose algorithmic model is described in three different but equivalent representations in the paper.&#x00a0; We then set aside the first four, and repeated the analytic discovery process on the remaining thousands of biomarkers in the dataset.&#x00a0; That repeat analysis yielded another set of four biomarkers with similar accuracy and robustness.&#x00a0; We then validated all eight biomarkers, again in minimally required sets, across several validation datasets created from independent patient cohorts.</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>3.&#x00a0;I was a bit unclear on why placebo patients were being considered. I would find it helpful if the authors showed the 2x2 contingency table used to generate sensitivity and specificity.</bold>
                </p>
                <p> </p>
                <p> 
                    <italic>Placebo patients were considered because the discovery dataset was derived from a clinical trial with a treatment arm and a placebo arm, and our task was to predict response using the treatment/placebo variable plus biomarkers reflecting the baseline (pre-treatment) state of the patients.&#x00a0; A key question in drug development and clinical use is whether treatment response surpasses placebo response. The ability to accurately predict individual responses to both treatment and placebo would be extremely useful in both settings.</italic>&#x00a0;
                    <italic>The sensitivity and specificity report is contained in the paper as Table 2.&#x00a0; This includes the patient counts, in a slightly different format than a contingency table but with the same information content.&#x00a0; </italic>
                </p>
                <p> </p>
                <p> 
                    <bold>4.&#x00a0;The authors need to comment on the heterogeneity of the cohorts.</bold>
                    <italic>
                        <bold>&#x00a0;</bold>
                    </italic>
                </p>
                <p>
                    <italic> </italic>
                </p>
                <p>
                    <italic> All of the datasets were obtained from a publicly available repository.&#x00a0; The various datasets were produced by different researchers, and we have cited the papers associated with each of the datasets, so that our readers can review subject selection criteria and subject composition information described in the original papers.&#x00a0; Given the number of datasets we used, reproducing this information in our paper would be redundant and greatly increase the length of our paper without contributing to the key point we did include in the paper, which is that we used a diverse set of patient cohorts to discover and validate our predictive biomarkers. We state </italic>&#x201c;
                    <italic>These studies were done in different geographies, used different methodologies to process the samples and gene expression data, had different endpoints, and in some cases, used different anti-TNF therapies.&#x201d;</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>5.&#x00a0;Is a 14 week follow-up adequate?</bold>
                </p>
                <p> </p>
                <p> 
                    <italic>Follow-up time frames can vary according to clinical trial and research practices, as can response metrics (e.g. DAS28, ACR50, etc.).&#x00a0; We used datasets from seven studies described in peer-reviewed papers.&#x00a0; These papers indicated that each of the datasets was derived from a competently constructed study using broadly accepted outcomes measures and treatment follow-up time frames, even with some differences across studies. Each of these studies were performed to derive clinically useful predictors of treatment response and six of the seven studies had a 14 week primary end point. Despite some variety across datasets, we found that the biomarkers predicted the binary responder/non-responder outcome variable with high accuracy and consistency across datasets. &#x00a0;</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>6.&#x00a0;Is the work clearly and accurately presented and does it cite the current literature?</bold>Yes</p>
                <p> </p>
                <p> 
                    <bold>7.&#x00a0;Is the study design appropriate and is the work technically sound?&#x00a0;</bold>Yes</p>
                <p> </p>
                <p> 
                    <bold>8.&#x00a0;Are sufficient details of methods and analysis provided to allow replication by others?</bold>Partly</p>
                <p> </p>
                <p> 
                    <italic>All of the source data are available from a single public data source, as cited in our paper.&#x00a0; Further, we have provided the predictive algorithm from the discovery dataset, in three different representations, so that any party can apply the algorithm&#x2019;s calculations to the discovery dataset and verify the accuracy metrics we reported.</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>9.&#x00a0;If applicable, is the statistical analysis and its interpretation appropriate?</bold>I cannot comment. A qualified statistician is required.</p>
                <p> </p>
                <p> 
                    <italic>A central point of this paper is that biological systems are complex, emergent, and nonlinear. The availability of omic data with overwhelming information content presents a challenge to conventional statistical analytic approaches. The need to model potential interactions between thousands of variables rather than individual variables is particularly daunting. &#x00a0;While our methods and models reflect an approach that addresses this complexity, with an algorithm that can be verified, we have also presented the accuracy results in terms of the sensitivity and specificity metrics familiar to statisticians, and have also shown these metrics according to training, selection, and out-of-sample subsets of the dataset(s).</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>10.&#x00a0;Are all the source data underlying the results available to ensure full reproducibility?</bold>Partly</p>
                <p> </p>
                <p> 
                    <italic>All of the source data are available from a single public data source, as cited in our paper.&#x00a0; Further, we have provided the predictive algorithm from the discovery dataset, in three different representations, so that any party can apply the algorithm&#x2019;s calculations to the discovery dataset and verify the accuracy metrics we reported.</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>11.&#x00a0;Are the conclusions drawn adequately supported by the results?</bold>Partly</p>
                <p> </p>
                <p> 
                    <italic>It would be helpful to understand which conclusions are not perceived as adequately supported by the results, so that we can either elucidate or plan for additional studies.</italic>
                </p>
            </body>
        </sub-article>
    </sub-article>
</article>
