<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.14451.3</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Predicting lithium treatment response in bipolar patients using gender-specific gene expression biomarkers and machine learning</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 3; peer review: 1 approved, 2 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Eugene</surname>
                        <given-names>Andy R.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-2512-5454</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Masiak</surname>
                        <given-names>Jolanta</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Eugene</surname>
                        <given-names>Beata</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Independent Researcher, Kansas, USA</aff>
                <aff id="a2">
                    <label>2</label>Department of Pharmacogenomics, Bernard J. Dunn School of Pharmacy, Inova Center for Personalized Health, Shenandoah University, Fairfax, VA, 22031, USA</aff>
                <aff id="a3">
                    <label>3</label>Independent Neurophysiology Laboratory, Department of Psychiatry, Medical University of Lublin, Lublin, 20-439, Poland</aff>
                <aff id="a4">
                    <label>4</label>Marie-Curie Sklodowska University, Lublin, 20-400, Poland</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:andyeugene.md@gmail.com">andyeugene.md@gmail.com</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>7</day>
                <month>12</month>
                <year>2018</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2018</year>
            </pub-date>
            <volume>7</volume>
            <elocation-id>474</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>28</day>
                    <month>11</month>
                    <year>2018</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2018 Eugene AR et al.</copyright-statement>
                <copyright-year>2018</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/7-474/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> We sought to test the hypothesis that transcriptome-level gene signatures are differentially expressed between male and female bipolar patients, prior to lithium treatment, in a patient cohort who later were clinically classified as lithium treatment responders.</p>
                <p>
                    <bold>Methods:</bold> Gene expression study data was obtained from the Lithium Treatment-Moderate dose Use Study data accessed from the National Center for Biotechnology Information&#x2019;s Gene Expression Omnibus via accession number GSE4548. Differential gene expression analysis was conducted using the Linear Models for Microarray and RNA-Seq (limma) package and the Decision Tree and Random Forest machine learning algorithms in R.</p>
                <p>
                    <bold>Results:</bold> Using quantitative gene expression values reported from patient blood samples, the RBPMS2 and LILRA5 genes classify male lithium responders with an area under the receiver operator characteristic curve (AUROC) of 0.92 and the ABRACL, FHL3, and NBPF14 genes classify female lithium responders AUROC of 1. A Decision Tree rule for establishing male versus female samples, using gene expression values were found to be: if RPS4Y1 &#x2265; 9.643, patient is a male and if RPS4Y1 &lt; 9.643, patient is female with a probability=100%.</p>
                <p>
                    <bold>Conclusions:</bold> We developed a pre-treatment gender- and gene-expression-based predictive model selective for classifying male lithium responders with a sensitivity of 96% using 2-genes and female lithium responders with sensitivity=92% using 3-genes.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>lithium</kwd>
                <kwd>treatment response</kwd>
                <kwd>gene expression</kwd>
                <kwd>machine learning</kwd>
                <kwd>microarray</kwd>
                <kwd>transcriptome</kwd>
                <kwd>precision medicine</kwd>
                <kwd>pharmacogenomics</kwd>
                <kwd>psychiatry</kwd>
                <kwd>genomic medicine</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 2</title>
                <p>The major differences between this new version and the previously published version of the article are: 
                    <list list-type="order">
                        <list-item>
                            <p>We added a graphic illustration of the data analysis workflow to support text in the methods section of the manuscript (new figure 1; old figures have been re-numbered)</p>
                        </list-item>
                        <list-item>
                            <p>We added a three decision-trees detailing the machine learning classification steps using the gene expression data that classifies sample gender, male lithium responders, and female lithium responders (new figure 5).</p>
                        </list-item>
                        <list-item>
                            <p>We expanded the introduction to detail information on pharmacogenomics and therapeutic drug monitoring as well as, added text in various sections in the manuscript to better explain our findings and put them in context of advancing genomic medicine with increasing clinical pharmacology trained physicians in healthcare systems.</p>
                        </list-item>
                        <list-item>
                            <p>We provide an updated Supplementary File 1.</p>
                        </list-item>
                    </list> Also, author Andy R. Eugene is no longer at Shenandoah University, and is now listed as an Independent Researcher.</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>Lithium is the most well-established mood-stabilizer in the practice of psychiatry (
                <xref ref-type="bibr" rid="ref-10">Jermain 
                    <italic toggle="yes">et al</italic>., 1991</xref>; 
                <xref ref-type="bibr" rid="ref-12">Landersdorfer 
                    <italic toggle="yes">et al</italic>., 2017</xref>). A recent propensity-score adjusted and matched longitudinal cohort-study evaluating the effectiveness of the newer mood stabilizers: olanzapine (n=1477), quetiapine (n=1376), and valproate (n=1670), in comparison to lithium (n=2148), found that patients treated with lithium experienced reduced rates of both unintentional injury and self-harm (
                <xref ref-type="bibr" rid="ref-7">Hayes 
                    <italic toggle="yes">et al</italic>., 2016</xref>). However, due to lithium&#x2019;s narrow index of 0.5&#x2013;1.2 mEq/mL, Therapeutic Drug Monitoring (TDM) is the standard-of-care to ensure patient safety using pharmacokinetic principles in medical practice (
                <xref ref-type="bibr" rid="ref-8">Hiemke 
                    <italic toggle="yes">et al</italic>., 2011</xref>). Actually, if TDM is applied broadly among medical specialties, pharmacogenomic reports that focus on pharmacokinetic-based gene-drug interactions (e.g. CYP2D6-Paroxetine or CYP2C19-Clopidogrel) may not be necessary in all cases and insurance reimbursement would not be a rate-limiting step in advancing genomic medicine. Although, this approach alone would not account for the hypersensitivity-type pharmacogenomic reactions; however, a TDM pharmacogenomic-hypersensitivity reaction hybrid approach may be an option when concerns about the electronic medical record costs, genotyping and/or sequencing machine costs, and data server infrastructure costs are prohibitive factors causing hospital systems and primary care clinics not to implement pharmacogenomic testing.</p>
            <p>A limitation of TDM-only approach, rather than a gene-drug testing, is that one would need to administer the drug and measure a blood concentration after the drug is administered, which may not be an option in life-threatening cases (e.g. stent thrombosis and Clopidogrel). Contrastingly, a profound area of concern for pharmacogenomic testing reports are that hospitals are not implementing actionable pharmacogenomic alerts in the patient medical records if the patient did not have the pharmacogenomic testing at their hospital laboratory due concerns of being a certified genomics laboratory and concerns of litigation when knowingly prescribing a drug that the patient cannot metabolize and scanned into the medical record.</p>
            <p>It is important to note that pharmacogenomic reports do not necessarily account for drug-drug-gene interactions &#x2013; which are often the case &#x2013; when patients are prescribed three or more medications. In such cases, hospital systems should embed clinical pharmacologist physicians, as is done by leading hospitals globally (e.g. Karolinska Institute in Stockholm Sweden awarding the Nobel Prize, the Mayo Clinic, and more) that aim to maintain high rates of patient drug safety and hospital quality outcome measures (
                <xref ref-type="bibr" rid="ref-24">Eichelbaum 
                    <italic toggle="yes">et al</italic>., 2018</xref>; 
                <xref ref-type="bibr" rid="ref-23">Eugene &amp; Eugene, 2018</xref>). However, even after accounting for drug doses and drug selection to avoid adverse drug reactions, divergent clinical response rates, among genders, are well-known and reported in psychiatric patients treated with lithium (
                <xref ref-type="bibr" rid="ref-20">Viguera 
                    <italic toggle="yes">et al</italic>., 2000</xref>).</p>
            <p>In a 1986, Zetin and colleagues published the results of a study that evaluated four methods for predicting lithium daily dosages, and the final equation resulted in a 147.8mg/day increased dosage-adjustment for male patients (
                <xref ref-type="bibr" rid="ref-22">Zetin 
                    <italic toggle="yes">et al</italic>., 1986</xref>). Similarly, a later study by Lobeck and colleagues corroborated the 147.8 mg/day male increase dose requirement for the lithium maintenance dose in bipolar patients (
                <xref ref-type="bibr" rid="ref-13">Lobeck 
                    <italic toggle="yes">et al</italic>., 1987</xref>). However, neither do the current dosing guidelines recommend a gender-based dose adjustment using pharmacometrics methods, to avoid toxicity, nor are gender-specific gene expression screening panels available to predict lithium efficacy currently available and implemented.</p>
            <p>A recent large-scale meta-analysis of human body-tissue gene expression reported that the body organ with the most abundant gender-biased gene expression is the anterior cingulate cortex within the frontal cortex of the brain (
                <xref ref-type="bibr" rid="ref-14">Mayne 
                    <italic toggle="yes">et al</italic>., 2016</xref>). Thus, these findings suggest that therapeutic drug response may be influenced not only via drug absorption, distribution, metabolism, and elimination, but also within the underlying gene signatures across the human transcriptome and mechanisms of gene-gene interactions that regulate physiology. Beech and colleagues conducted a study to identify gene expression differences from the peripheral blood in patients classified as lithium responders and non-responders (
                <xref ref-type="bibr" rid="ref-1">Beech 
                    <italic toggle="yes">et al</italic>., 2014</xref>). However, the study reported that no significant gender-biased gene expression differences were found (p-value=0.941) in patients who were randomized to optimal therapy (control), defined as one FDA-approved mood stabilizer, versus patients treated with lithium plus optimal therapy (
                <xref ref-type="bibr" rid="ref-1">Beech 
                    <italic toggle="yes">et al</italic>., 2014</xref>). Despite these initially reported findings, a recent study by Labont&#x00e9; and colleagues, which used RNA-Seq to evaluate the transcriptome in patients diagnosed with major depressive disorder (MDD), concluded that gender dimorphism exists at the transcriptome-level in MDD patients and that gender-specific treatments should be investigated (
                <xref ref-type="bibr" rid="ref-11">Labont&#x00e9; 
                    <italic toggle="yes">et al</italic>., 2017</xref>).</p>
            <p>Therefore, there is a clinical need to investigate if indeed a gender dimorphism exists in lithium treatment by applying a combination of statistics and data science/engineering methods to advance precision and genomic medicine in psychiatry. These findings may improve prediction of clinical drug response of lithium prior to initiating drug therapy in patients with bipolar or schizoaffective disorders, who often cannot risk drug inefficacy for obvious safety reasons. Therefore, the overall aim for our study is to define gender-specific transcriptional-level regulators of lithium treatment response that may influence treatment of bipolar or schizoaffective disorders. We will test the hypothesis that biologically plausible gene expression differences exist, prior to lithium treatment, in patients diagnosed with bipolar disorder in the following three patient subgroups: (1) male and female patients who were later clinically classified as lithium treatment responders; (2) male-responders versus male-non-responders; (3) female-responders versus female-non-responders.</p>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <sec>
                <title>Data</title>
                <p>DNA microarray data analyzed in this study are originally referenced from the Lithium Treatment-Moderate dose Use Study placed in the National Center for Biotechnology Information (NCBI) Gene Expression Omnibus (GEO) via accession number 
                    <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE45484">GSE45484</ext-link> with the Illumina HumanHT12 V4.0 expression Beadchip GPL10558 platform file to associate gene names and descriptions. The original multisite clinical study recruited patients from Case Western Reserve University, Massachusetts General Hospital, Stanford University, Yale University, and the Universities of: Pittsburgh, Texas Health Science Center at San Antonio, and Pennsylvania (
                    <xref ref-type="bibr" rid="ref-1">Beech 
                        <italic toggle="yes">et al</italic>., 2014</xref>). From the original 120 peripheral blood samples used to generate probe and gene expression profiles, from patients diagnosed with bipolar disorder, the clinical phenotype of being either a treatment- responder or non-responder was assessed using the Clinical Global Impression Scale for Bipolar Disorder-Severity (CGI-BP-S) (
                    <xref ref-type="bibr" rid="ref-17">Spearing 
                        <italic toggle="yes">et al</italic>., 1997</xref>).</p>
            </sec>
            <sec>
                <title>Study design</title>
                <p>To assess for gender-specific differential gene signatures, in our first analysis we grouped patients based on gender alone and not on any other variables (i.e. optimal treatment versus lithium, or responder versus non-responder status). Then, we rationalized that from the results of the gender-specific transcriptome signatures from our first analysis, we will set the top two-hundred and fifty genes as controls in an effort to identify pharmacologic treatment-response transcriptome biomarkers that are not directly linked to the X or Y chromosome. Therefore, we 
                    <italic toggle="yes">overlaid</italic> the top two-hundred and fifty genes from all results that were reported in subsequent analyses to identify genes with lithium-specific transcriptional differences between genders associated with response to Lithium treatment. In our second analysis, we only selected patients who were classified as lithium treatment-responders, at baseline, and the results from the gene expression differences are reported excluding the sex-specific control genes identified in the first experiment. In our third and fourth analyses, we compared: male-responders vs. male non-responders, and female-responders vs. female non-responders, respectively.</p>
            </sec>
            <sec>
                <title>Machine learning</title>
                <p>A graphical depiction of the data analysis methods are shown in 
                    <xref ref-type="fig" rid="f1">Figure 1</xref>. The 
                    <italic toggle="yes">Decision Tree</italic> and 
                    <italic toggle="yes">Random Forest</italic> machine learning algorithms were used for classification following identification of statistically significant DNA microarray genes. This method sets the stage for subsequent analyses aiming to identify gender-specific responder genes with small sample size of three male-responders and six-female responders from the total of sixty patients. Thus, to reiterate, we first utilized the significant results obtained from the gene expression package implemented in the 
                    <italic toggle="yes">limma</italic> package in R and then applied the 
                    <italic toggle="yes">Decision Tree</italic> and 
                    <italic toggle="yes">Random Forest</italic> algorithms for classification and determined this to be novel.</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>Data analysis workflow used to accurately classify and label sample-gender and gender-specific lithium treatment responders.</title>
                        <p>Heatmaps were created following identification of the top differentially expressed genes and Variable Importance plots were produced following identification of gender-specific lithium treatment responders. </p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/18909/86c15bb8-8dda-4d0e-84a7-4a54653d1226_figure1.gif"/>
                </fig>
                <p>To identify if patients were either male or female, we divided the dataset of 120 samples, pre-treatment and post-treatment, from sixty patients into three sub-datasets: (1) training dataset (60% of total sample), (2) validation dataset (20% of total sample), and the (3) test dataset (20% of total sample). However, due to having small lithium treatment responder sample-sizes, when identifying gender-specific responders versus &#x2018;All Other Patients&#x2019;, we simply used a training dataset (70% of total) and a test dataset (30% of total sample). We then reported the classification performance of the models using the following diagnostic parameters: sensitivity, specificity (not calculated for gender-specific lithium responders due sample size), and an area under the receiver operator characteristic curve (AUROC). We selected the traditional Decision Tree algorithm to classify male versus female samples using the following parameters: complexity of 0.01, a max depth of 3, minimum bucket of 7, and a minimum split of 20 observations. Further, for classifying male-responders and female-responders, we selected the 
                    <italic toggle="yes">Random Forest</italic> algorithm and set the number of Trees to build at 500 with 7 variables at any time for dataset partitioning. Finally, we reported variable importance plots of genes throughout the paper that was used to explain which genes were most important for classifying patients into different reportable subgroups. Final results of the 
                    <italic toggle="yes">Random Forest</italic> processes for male- and female-responders are located in 
                    <xref ref-type="other" rid="SF1">Supplementary File 1</xref>.</p>
            </sec>
            <sec>
                <title>Gene expression analysis</title>
                <p>Differential gene expression analysis of the DNA microarray data was conducted using the Empirical Bayes method implemented within the 
                    <italic toggle="yes">limma</italic> package (version 3.34.5) and utilizes the Biobase package (version 2.38.0) which both run within the R for Statistical Programming environment (version 3.4.3; R Foundation for Statistical Computing, Vienna, Austria) (
                    <xref ref-type="bibr" rid="ref-16">Ritchie 
                        <italic toggle="yes">et al</italic>., 2015</xref>; 
                    <xref ref-type="bibr" rid="ref-19">Team, 2013</xref>). Due to multiple testing of the peripheral blood transcriptome, the False-Discovery Rate was adjusted using the Benjamini-Hochberg method. A p-value of less 0.05 was considered to be statistically significant and a differential gene expression threshold of 0.5 was used and reported during the machine learning process.</p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>
                <xref ref-type="table" rid="T1">Table 1</xref> provides the patient age and sample sizes used during subgroup analyses. In our first analysis, which aimed to group patients based on gender alone and not based on clinical variables detailed in the original study, data-driven gene analytics identified four female-labeled patient samples with gene expression levels similar to that found in male patients for the following Y-chromosome genes: 
                <italic toggle="yes">RPS4Y1, EIF1AY, KDM5D, RPS4Y2</italic>; and the 
                <italic toggle="yes">XIST</italic> gene located on the X-chromosome. Therefore, all subsequent hypothesis-testing were analyzed with the updated male-gender classification for the following NCBI GEO patient samples: GSM1105526 (baseline lithium-non-responder), GSM1105528 (1-month lithium-non-responder), GSM1105546 (baseline lithium-non-responder), and GSM1105548 (1-month lithium-non-responder). 
                <xref ref-type="fig" rid="f2">Figure 2</xref> illustrates the gene expression findings resulting in re-classification for the aforementioned patient samples. The Decision Tree rule states: if 
                <italic toggle="yes">RPS4Y1</italic> &lt; 9.643 then the patient is a female with a probability of 100%. Whereas, if the 
                <italic toggle="yes">RPS4Y1</italic> &#x2265; 9.643 then the patient is a male with a probability of 9%. After proceeding with the machine learning analysis of both the &#x2018;training&#x2019; and &#x2018;validation&#x2019; datasets, the final &#x2018;test&#x2019; dataset resulted in the following diagnostic test evaluation parameters: Sensitivity=100% (95% C.I. 66.37%-100.00%), Specificity=100% (95% C.I. 78.20%-100.00%), and an AUROC of 1. 
                <xref ref-type="fig" rid="f3">Figure 3</xref> illustrates the variable importance plots used in the machine learning process for classifying patients as being a male-lithium-responder or female-lithium-responder relative to the full patient population. The results show, in descending order of predictive power, the genes selective for male lithium-responders versus the full patient population being RBPMS2, CDH23, and SIDT2. Similarly, in descending order of predictive power, for female lithium-responders versus the entire patient population, the FHL3, ABRACL, RPL10A, and RPS23 genes are most selective.</p>
            <table-wrap id="T1" orientation="portrait" position="anchor">
                <label>Table 1. </label>
                <caption>
                    <title>Patient age and sample sizes used during subgroup analyses.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="center" colspan="4" rowspan="1">Lithium treated patient population</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Baseline</th>
                            <th align="center" colspan="1" rowspan="1">Mean age</th>
                            <th align="center" colspan="1" rowspan="1">S.D.</th>
                            <th align="center" colspan="1" rowspan="1">Sample size (n)</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Male-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">36</td>
                            <td align="center" colspan="1" rowspan="1">8.1</td>
                            <td align="center" colspan="1" rowspan="1">3</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Female-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">31</td>
                            <td align="center" colspan="1" rowspan="1">11.8</td>
                            <td align="center" colspan="1" rowspan="1">6</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Male-non-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">40</td>
                            <td align="center" colspan="1" rowspan="1">10</td>
                            <td align="center" colspan="1" rowspan="1">7</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Female-non-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">44</td>
                            <td align="center" colspan="1" rowspan="1">9.2</td>
                            <td align="center" colspan="1" rowspan="1">12</td>
                        </tr>
                        <tr>
                            <th align="center" colspan="4" rowspan="1">
                                <xref ref-type="other" rid="FN1">*</xref>General mood stabilizers patient population</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Baseline</th>
                            <th align="center" colspan="1" rowspan="1">Mean age</th>
                            <th align="center" colspan="1" rowspan="1">S.D.</th>
                            <th align="center" colspan="1" rowspan="1">Sample size (n)</th>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Male-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">51</td>
                            <td align="center" colspan="1" rowspan="1">--</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Female-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">49</td>
                            <td align="center" colspan="1" rowspan="1">10.5</td>
                            <td align="center" colspan="1" rowspan="1">3</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Male-non-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">43</td>
                            <td align="center" colspan="1" rowspan="1">12.5</td>
                            <td align="center" colspan="1" rowspan="1">9</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Female-non-responder</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">37</td>
                            <td align="center" colspan="1" rowspan="1">14.5</td>
                            <td align="center" colspan="1" rowspan="1">19</td>
                        </tr>
                        <tr>
                            <th align="center" colspan="4" rowspan="1">Total patient population</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gender</th>
                            <th align="center" colspan="1" rowspan="1">Mean age</th>
                            <th align="center" colspan="1" rowspan="1">S.D.</th>
                            <th align="center" colspan="1" rowspan="1">Sample size (n)</th>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Male</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">41</td>
                            <td align="center" colspan="1" rowspan="1">10.8</td>
                            <td align="center" colspan="1" rowspan="1">20</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Female</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">39</td>
                            <td align="center" colspan="1" rowspan="1">13.1</td>
                            <td align="center" colspan="1" rowspan="1">40</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1">
                                <bold>Study population</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">40</td>
                            <td align="center" colspan="1" rowspan="1">12.3</td>
                            <td align="center" colspan="1" rowspan="1">60</td>
                        </tr>
                    </tbody>
                </table>
                <table-wrap-foot>
                    <fn>
                        <p id="FN1">*
                            <bold>Note:</bold> United States Food and Drug Administration approved Mood Stabilizers.</p>
                    </fn>
                </table-wrap-foot>
            </table-wrap>
            <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                <label>Figure 2. </label>
                <caption>
                    <title>Gene expression levels for the Ribosomal protein S4, Y-linked 1 (RPS4Y1) gene illustrating 4 patient samples as labeled as female and were re-assigned to the male patient gender group.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/18909/86c15bb8-8dda-4d0e-84a7-4a54653d1226_figure2.gif"/>
            </fig>
            <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                <label>Figure 3. </label>
                <caption>
                    <title>Variable importance ratings of genes selective (above) of male lithium responders versus the entire population of treated and untreated patient men and women; and (below) female lithium responders versus the entire population of treated and untreated men and women.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/18909/86c15bb8-8dda-4d0e-84a7-4a54653d1226_figure3.gif"/>
            </fig>
            <p>
                <xref ref-type="table" rid="T2">Table 2</xref> provides the results for the gender-specific differentially expressed genes from the entire study population using a fold-change (FC) threshold of 0.5. A total of five genes met the 
                <italic toggle="yes">a priori</italic> FC requirements and were found to be 
                <italic toggle="yes">RPS4Y1, EIF1AY, KDM5D, RPS4Y2</italic>, and 
                <italic toggle="yes">EIF1AY</italic>. These five down-regulated male-biased genes were all found on the Y-chromosome. Contrastingly, a total of 10 upregulated female-biased genes were found to be: 
                <italic toggle="yes">XIST, S100P, IFIT3, TNFAIP6, IFITM3, IFIT2, CHURC1, ANXA3, ADM</italic>, and 
                <italic toggle="yes">PROK2</italic>. The 
                <italic toggle="yes">RPS4Y1</italic> gene in males (FC= -4.9807, p=7.36E-47) and the 
                <italic toggle="yes">XIST</italic> gene (FC=1.7615, p=2.98E-36), found on the X-chromosome, in females resulted in the greatest expression changes between genders. The male-favored genes resulted in a larger expression change than compared to the females.</p>
            <table-wrap id="T2" orientation="portrait" position="anchor">
                <label>Table 2. </label>
                <caption>
                    <title>Differentially expressed genes between genders across all study participants with a log fold-change threshold of 0.5.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Male-associated genes</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Location</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>RPS4Y1</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">7.36E-47</td>
                            <td align="center" colspan="1" rowspan="1">2.81E-51</td>
                            <td align="center" colspan="1" rowspan="1">-4.9807</td>
                            <td align="left" colspan="1" rowspan="1">Ribosomal Protein S4, Y-linked 1</td>
                            <td align="center" colspan="1" rowspan="1">Yp11.3</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>EIF1AY</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1.02E-41</td>
                            <td align="center" colspan="1" rowspan="1">8.61E-46</td>
                            <td align="center" colspan="1" rowspan="1">-2.5861</td>
                            <td align="left" colspan="1" rowspan="1">Eukaryotic Translation Initiation Factor 1A, Y-linked</td>
                            <td align="center" colspan="1" rowspan="1">Yq11.223</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>KDM5D</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">7.36E-47</td>
                            <td align="center" colspan="1" rowspan="1">4.67E-51</td>
                            <td align="center" colspan="1" rowspan="1">-1.6658</td>
                            <td align="left" colspan="1" rowspan="1">Lysine Demethylase 5D</td>
                            <td align="center" colspan="1" rowspan="1">Yq11</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>HLA-DRB1</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.016</td>
                            <td align="center" colspan="1" rowspan="1">0.0000362</td>
                            <td align="center" colspan="1" rowspan="1">-1.7072</td>
                            <td align="left" colspan="1" rowspan="1">Major Histocompatibility Complex, Class II, DR Beta 1</td>
                            <td colspan="1" rowspan="1"/>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>RPS4Y2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1.35E-40</td>
                            <td align="center" colspan="1" rowspan="1">1.43E-44</td>
                            <td align="center" colspan="1" rowspan="1">-1.5014</td>
                            <td align="left" colspan="1" rowspan="1">Ribosomal Protein S4, Y-linked 2</td>
                            <td align="center" colspan="1" rowspan="1">Yq11.223</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>EIF1AY</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">9.38E-31</td>
                            <td align="center" colspan="1" rowspan="1">1.98E-34</td>
                            <td align="center" colspan="1" rowspan="1">-0.9443</td>
                            <td align="left" colspan="1" rowspan="1">Eukaryotic Translation Initiation Factor 1A, Y-linked</td>
                            <td align="center" colspan="1" rowspan="1">Yq11.223</td>
                        </tr>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Female-associated genes</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Location</th>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>XIST</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">2.98E-36</td>
                            <td align="center" colspan="1" rowspan="1">5.03E-40</td>
                            <td align="center" colspan="1" rowspan="1">1.7615</td>
                            <td align="left" colspan="1" rowspan="1">X Inactive Specific Transcript (non-protein coding)</td>
                            <td align="center" colspan="1" rowspan="1">Xq13.2</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>S100P</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1.70E-02</td>
                            <td align="center" colspan="1" rowspan="1">3.31E-05</td>
                            <td align="center" colspan="1" rowspan="1">1.028</td>
                            <td align="left" colspan="1" rowspan="1">S100 Calcium Binding Protein P</td>
                            <td align="center" colspan="1" rowspan="1">4p16</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>IFIT3</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">5.00E-03</td>
                            <td align="center" colspan="1" rowspan="1">5.82E-06</td>
                            <td align="center" colspan="1" rowspan="1">0.8765</td>
                            <td align="left" colspan="1" rowspan="1">Interferon Induced Protein with Tetratricopeptide
                                <break/>Repeats 3</td>
                            <td align="center" colspan="1" rowspan="1">10q24</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>TNFAIP6</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">3.73E-04</td>
                            <td align="center" colspan="1" rowspan="1">2.52E-07</td>
                            <td align="center" colspan="1" rowspan="1">0.7304</td>
                            <td align="left" colspan="1" rowspan="1">TNF Alpha Induced Protein 6</td>
                            <td align="center" colspan="1" rowspan="1">2q23.3</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>IFITM3</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">4.51E-02</td>
                            <td align="center" colspan="1" rowspan="1">1.69E-04</td>
                            <td align="center" colspan="1" rowspan="1">0.7284</td>
                            <td align="left" colspan="1" rowspan="1">Interferon Induced Transmembrane Protein 3</td>
                            <td align="center" colspan="1" rowspan="1">11p15.5</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>IFIT2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">4.91E-02</td>
                            <td align="center" colspan="1" rowspan="1">1.95E-04</td>
                            <td align="center" colspan="1" rowspan="1">0.6739</td>
                            <td align="left" colspan="1" rowspan="1">Interferon Induced Protein with Tetratricopeptide
                                <break/>Repeats 2</td>
                            <td align="center" colspan="1" rowspan="1">10q23.31</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>CHURC1</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">6.30E-02</td>
                            <td align="center" colspan="1" rowspan="1">3.18E-04</td>
                            <td align="center" colspan="1" rowspan="1">0.6678</td>
                            <td align="left" colspan="1" rowspan="1">Churchill Domain Containing 1</td>
                            <td align="center" colspan="1" rowspan="1">14q23.3</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>ANXA3</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">2.33E-03</td>
                            <td align="center" colspan="1" rowspan="1">2.26E-06</td>
                            <td align="center" colspan="1" rowspan="1">0.6218</td>
                            <td align="left" colspan="1" rowspan="1">Annexin A3</td>
                            <td align="center" colspan="1" rowspan="1">4q21.21</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>ADM</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">8.69E-04</td>
                            <td align="center" colspan="1" rowspan="1">6.80E-07</td>
                            <td align="center" colspan="1" rowspan="1">0.5986</td>
                            <td align="left" colspan="1" rowspan="1">Adrenomedullin</td>
                            <td align="center" colspan="1" rowspan="1">11p15.4</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>PROK2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">2.16E-02</td>
                            <td align="center" colspan="1" rowspan="1">4.79E-05</td>
                            <td align="center" colspan="1" rowspan="1">0.5189</td>
                            <td align="left" colspan="1" rowspan="1">Prokineticin 2</td>
                            <td align="center" colspan="1" rowspan="1">3p13</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>
                <xref ref-type="table" rid="T3">Table 3</xref> provides the results for the differentially expressed genes that were found between male and female responders prior to initiation of lithium and optimal therapy, meeting the FC criteria of at least 0.5. In male lithium responders, we found 5 differentially expressed while the RNA binding protein with multiple splicing 2 (
                <italic toggle="yes">RBPMS2</italic>) gene ranked with the greatest FC of -1.351 (unadjusted p=0.00111). Whereas, 9 genes were associated with female lithium responders, with greatest expression change being the major histocompatibility complex class-1-H (HLA-H) at 1.602 (unadjusted p-value=0.00099). The neuroblastoma breakpoint family member-14 (
                <italic toggle="yes">NBPF14</italic>) gene met the Benjamani-Hochberg adjusted p-value criteria and resulted with an expression change of 0.586 (adjusted p=0.0462). 
                <xref ref-type="fig" rid="f4">Figure 4</xref> illustrates the heat-map and dendrogram overview of the two-way unsupervised hierarchical cluster analysis of the reported differentially expressed genes among male and female responders to lithium therapy at baseline that correspond to values reported in 
                <xref ref-type="table" rid="T3">Table 3</xref>.</p>
            <table-wrap id="T3" orientation="portrait" position="anchor">
                <label>Table 3. </label>
                <caption>
                    <title>Differentially expressed genes between male and female responders prior to Lithium pharmacotherapy with a log fold-change threshold of 0.5.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Genes associated with male lithium responders</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Highest gene tissue
                                <break/>expression</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>RBPMS2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00111</td>
                            <td align="center" colspan="1" rowspan="1">-1.351</td>
                            <td align="left" colspan="1" rowspan="1">RNA Binding Protein with Multiple Splicing 2</td>
                            <td align="center" colspan="1" rowspan="1">Heart, Urinary
                                <break/>Bladder</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>SIDT2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00932</td>
                            <td align="center" colspan="1" rowspan="1">-0.82</td>
                            <td align="left" colspan="1" rowspan="1">SID1 Transmembrane Family Member 2</td>
                            <td align="center" colspan="1" rowspan="1">Stomach, Prostate</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>CDH23</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00388</td>
                            <td align="center" colspan="1" rowspan="1">-0.674</td>
                            <td align="left" colspan="1" rowspan="1">Cadherin-Related 23</td>
                            <td align="center" colspan="1" rowspan="1">Ovary, Fat</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>LILRA5</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00359</td>
                            <td align="center" colspan="1" rowspan="1">-0.592</td>
                            <td align="left" colspan="1" rowspan="1">Leukocyte Immunoglobulin Like Receptor A5</td>
                            <td align="center" colspan="1" rowspan="1">Appendix, Bone
                                <break/>Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>KIR2DS5</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00431</td>
                            <td align="center" colspan="1" rowspan="1">-0.506</td>
                            <td align="left" colspan="1" rowspan="1">Killer Cell Immunoglobulin Like Receptor, Two
                                <break/>Ig Domains and Short Cytoplasmic Tail 5</td>
                            <td align="center" colspan="1" rowspan="1">--</td>
                        </tr>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Genes associated with female lithium responders</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Highest gene tissue
                                <break/>expression</th>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>HLA-H</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.000996</td>
                            <td align="center" colspan="1" rowspan="1">1.602</td>
                            <td align="left" colspan="1" rowspan="1">Major Histocompatibility Complex, Class I,
                                <break/>H (pseudogene)</td>
                            <td align="center" colspan="1" rowspan="1">Lymph Node, Bone
                                <break/>Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>RPS23</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00308</td>
                            <td align="center" colspan="1" rowspan="1">1.471</td>
                            <td align="left" colspan="1" rowspan="1">Ribosomal Protein S23</td>
                            <td align="center" colspan="1" rowspan="1">Ovary, Bone Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>FHL3</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.000751</td>
                            <td align="center" colspan="1" rowspan="1">0.893</td>
                            <td align="left" colspan="1" rowspan="1">Four and a Half LIM Domains 3</td>
                            <td align="center" colspan="1" rowspan="1">Esophagus,
                                <break/>Endometrium</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>RPL10A</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00299</td>
                            <td align="center" colspan="1" rowspan="1">0.628</td>
                            <td align="left" colspan="1" rowspan="1">Ribosomal Protein L10a</td>
                            <td align="center" colspan="1" rowspan="1">Ovary, Bone Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>
                                    <xref ref-type="other" rid="TF1">**</xref>NBPF14</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">
                                <xref ref-type="other" rid="TF1">**</xref>0.0462</td>
                            <td align="center" colspan="1" rowspan="1">0.00000782</td>
                            <td align="center" colspan="1" rowspan="1">0.586</td>
                            <td align="left" colspan="1" rowspan="1">Neuroblastoma Breakpoint Family Member 14</td>
                            <td align="center" colspan="1" rowspan="1">Skin, Ovary</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>PSTPIP2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.000473</td>
                            <td align="center" colspan="1" rowspan="1">0.569</td>
                            <td align="left" colspan="1" rowspan="1">Proline-Serine-Threonine Phosphatase
                                <break/>Interacting Protein 2</td>
                            <td align="center" colspan="1" rowspan="1">Bone Marrow, Spleen</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>FAM117B</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00949</td>
                            <td align="center" colspan="1" rowspan="1">0.556</td>
                            <td align="left" colspan="1" rowspan="1">Family with Sequence Similarity 117 Member B</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Adrenal</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>CHST7</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00812</td>
                            <td align="center" colspan="1" rowspan="1">0.529</td>
                            <td align="left" colspan="1" rowspan="1">Carbohydrate Sulfotransferase 7</td>
                            <td align="center" colspan="1" rowspan="1">Spleen, Fat</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>ABRACL</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00396</td>
                            <td align="center" colspan="1" rowspan="1">0.505</td>
                            <td align="left" colspan="1" rowspan="1">ABRA C-Terminal Like</td>
                            <td align="center" colspan="1" rowspan="1">Colon, Lymph Node</td>
                        </tr>
                    </tbody>
                </table>
                <table-wrap-foot>
                    <fn>
                        <p id="TF1">Notes: **The NBPF14 gene reached the Benjamani-Hochberg adjusted p-value.</p>
                    </fn>
                </table-wrap-foot>
            </table-wrap>
            <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                <label>Figure 4. </label>
                <caption>
                    <title>Heat-map and dendrogram overview of the two-way unsupervised hierarchical cluster analysis of differentially expressed genes in male (n=3) and female (n=6) lithium responders after overlaying the top 250 differentially expressed genes found gender biased genes.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/18909/86c15bb8-8dda-4d0e-84a7-4a54653d1226_figure4.gif"/>
            </fig>
            <p>Using the baseline blood sample microarray data, the predictive modeling results for identifying lithium-responders from the complete study population of male and female controls and treatment samples, resulted in a validation/test sample cohort for males of: Sensitivity=95.83% (95% C.I. 78.88%-99.89%), Specificity=not calculated due sample size of test dataset, and an AUROC = 0.92 using the 
                <italic toggle="yes">RBPMS2</italic> and 
                <italic toggle="yes">LILRA5</italic> genes. Likewise, in the test dataset for females: Sensitivity=91.67% (95% C.I. 61.52%-99.79%), Specificity= not calculated due sample size of test dataset, and an AUROC = 1 with the 
                <italic toggle="yes">ABRACL</italic>, FHL3, and the 
                <italic toggle="yes">NBPF14</italic> genes. Therefore, we developed a 2-gene predictive model for men and a 3-gene predictive model for women classifying lithium response in bipolar patients from a general population of bipolar patients using transcriptional signatures at baseline, prior to prescribing and treating a patient with lithium.</p>
            <p>
                <xref ref-type="table" rid="T4">Table 4</xref> provides the list of 10 differentially expressed genes found in male lithium responders (5-genes) and male lithium-non-responders (5-genes). The RNA binding protein with multiple splicing 2 (
                <italic toggle="yes">RBPMS2</italic>) gene (FC= -1.326, unadjusted p=0.001358) in male lithium responders and the Ribosomal protein S23 (
                <italic toggle="yes">RPS23</italic>) gene (FC=1.521, unadjusted p=0.013306) were found to result in the largest expression change differences between subgroups. However, in female responders and female non-responders, the Family with Sequence Similarity 117 Member B (
                <italic toggle="yes">FAM117B</italic>) gene (FC=0.5257, unadjusted p=0.0048554) and the Golgin B1 (
                <italic toggle="yes">GOLGB1</italic>) gene (FC= -0.6536, unadjusted p=0.0003716) were differentially expressed, respectively and shown in 
                <xref ref-type="table" rid="T5">Table 5</xref>.</p>
            <table-wrap id="T4" orientation="portrait" position="anchor">
                <label>Table 4. </label>
                <caption>
                    <title>Differentially expressed genes between Male Responders and Male Non-Responders at baseline with a log fold-change threshold of 0.3.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Genes associated with male lithium responders</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold
                                <break/>change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Highest gene tissue
                                <break/>expression</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>RBPMS2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.001358</td>
                            <td align="center" colspan="1" rowspan="1">-1.326</td>
                            <td align="left" colspan="1" rowspan="1">RNA Binding Protein with Multiple Splicing 2</td>
                            <td align="center" colspan="1" rowspan="1">Heart, Urinary Bladder</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>SVBP</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.01366</td>
                            <td align="center" colspan="1" rowspan="1">-0.76</td>
                            <td align="left" colspan="1" rowspan="1">Small Vasohibin Binding Protein</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Fat</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>LILRA5</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.011739</td>
                            <td align="center" colspan="1" rowspan="1">-0.714</td>
                            <td align="left" colspan="1" rowspan="1">Leukocyte Immunoglobulin Like Receptor A5</td>
                            <td align="center" colspan="1" rowspan="1">Appendix, Bone
                                <break/>Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>CPA3</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.008048</td>
                            <td align="center" colspan="1" rowspan="1">-0.592</td>
                            <td align="left" colspan="1" rowspan="1">Carboxypeptidase A3</td>
                            <td align="center" colspan="1" rowspan="1">Gall Bladder, Lung</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>SLC45A3</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.016508</td>
                            <td align="center" colspan="1" rowspan="1">-0.455</td>
                            <td align="left" colspan="1" rowspan="1">Solute Carrier Family 45 member 3</td>
                            <td align="center" colspan="1" rowspan="1">Prostate, Stomach</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>ZNF234</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.003254</td>
                            <td align="center" colspan="1" rowspan="1">-0.41</td>
                            <td align="left" colspan="1" rowspan="1">Zinc Finger Protein 234</td>
                            <td align="center" colspan="1" rowspan="1">Spleen, Thyroid</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>DIDO1</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.008232</td>
                            <td align="center" colspan="1" rowspan="1">-0.385</td>
                            <td align="left" colspan="1" rowspan="1">Death Inducer-Obliterator 1</td>
                            <td align="center" colspan="1" rowspan="1">Ovary, Spleen</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>TPP2</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.013053</td>
                            <td align="center" colspan="1" rowspan="1">-0.385</td>
                            <td align="left" colspan="1" rowspan="1">Tripeptidyl Peptidase 2</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Thyroid</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>KRT73</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.007333</td>
                            <td align="center" colspan="1" rowspan="1">-0.373</td>
                            <td align="left" colspan="1" rowspan="1">Keratin 73</td>
                            <td align="center" colspan="1" rowspan="1">Skin, Lymph Nodes</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>ZMYM3</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00363</td>
                            <td align="center" colspan="1" rowspan="1">-0.372</td>
                            <td align="left" colspan="1" rowspan="1">Zinc Finger MYM-type Containing 3</td>
                            <td align="center" colspan="1" rowspan="1">Ovary, Testis</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>NOTCH2 NL</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.009657</td>
                            <td align="center" colspan="1" rowspan="1">-0.348</td>
                            <td align="left" colspan="1" rowspan="1">Notch 2 N-terminal Like</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Skin</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>TIPRL</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.007794</td>
                            <td align="center" colspan="1" rowspan="1">-0.34</td>
                            <td align="left" colspan="1" rowspan="1">TOR Signaling Pathway Regulator</td>
                            <td align="center" colspan="1" rowspan="1">Endometrium, Brain</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>CAMK1D</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.005376</td>
                            <td align="center" colspan="1" rowspan="1">-0.333</td>
                            <td align="left" colspan="1" rowspan="1">Calcium/Calmodulin dependent Protein Kinase ID</td>
                            <td align="center" colspan="1" rowspan="1">Brain, Skin</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>EFNA1</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00632</td>
                            <td align="center" colspan="1" rowspan="1">-0.324</td>
                            <td align="left" colspan="1" rowspan="1">Ephrin A1</td>
                            <td align="center" colspan="1" rowspan="1">Placenta, Lung</td>
                        </tr>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Genes associated with male lithium non-responders</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold
                                <break/>change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Highest gene tissue
                                <break/>expression</th>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>RPS23</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.013306</td>
                            <td align="center" colspan="1" rowspan="1">1.521</td>
                            <td align="left" colspan="1" rowspan="1">Ribosomal Protein S23</td>
                            <td align="center" colspan="1" rowspan="1">Ovary, Bone Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>IRF2BPL</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.010952</td>
                            <td align="center" colspan="1" rowspan="1">1.005</td>
                            <td align="left" colspan="1" rowspan="1">Interferon Regulatory Factor 2 Binding Protein
                                <break/>Like</td>
                            <td align="center" colspan="1" rowspan="1">--</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>HLA-C</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.003461</td>
                            <td align="center" colspan="1" rowspan="1">0.997</td>
                            <td align="left" colspan="1" rowspan="1">Major Histocompatibility Complex, Class I, C</td>
                            <td align="center" colspan="1" rowspan="1">Lung, Bone Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>RGPD1</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.001745</td>
                            <td align="center" colspan="1" rowspan="1">0.76</td>
                            <td align="left" colspan="1" rowspan="1">RANBP2-like and GRIP Domain Containing 1</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Liver</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>ASGR2</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.019947</td>
                            <td align="center" colspan="1" rowspan="1">0.598</td>
                            <td align="left" colspan="1" rowspan="1">Asialoglycoprotein Receptor 2</td>
                            <td align="center" colspan="1" rowspan="1">Liver, Gall Bladder</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>LPAR1</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.01374</td>
                            <td align="center" colspan="1" rowspan="1">0.453</td>
                            <td align="left" colspan="1" rowspan="1">Lysophosphatidic Acid Receptor 1</td>
                            <td align="center" colspan="1" rowspan="1">Brain, Placenta</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>RRN3P1</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.017025</td>
                            <td align="center" colspan="1" rowspan="1">0.42</td>
                            <td align="left" colspan="1" rowspan="1">RRN3 homolog, RNA Polymerase I Transcription
                                <break/>Factor Pseudogene 1</td>
                            <td align="center" colspan="1" rowspan="1">Thyroid, Lymph Node</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>TOMM34</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.016655</td>
                            <td align="center" colspan="1" rowspan="1">0.416</td>
                            <td align="left" colspan="1" rowspan="1">Translocase of Outer Mitochondrial Membrane 34</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Adrenal</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>ACAD11</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.015882</td>
                            <td align="center" colspan="1" rowspan="1">0.405</td>
                            <td align="left" colspan="1" rowspan="1">Acyl-CoA Dehydrogenase Family Member 11</td>
                            <td align="center" colspan="1" rowspan="1">Kidney, Liver</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>CEBPE</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00269</td>
                            <td align="center" colspan="1" rowspan="1">0.404</td>
                            <td align="left" colspan="1" rowspan="1">CCAAT/enhancer Binding Protein Epsilon</td>
                            <td align="center" colspan="1" rowspan="1">Bone Marrow, Small
                                <break/>Intestine</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>CMIP</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.017203</td>
                            <td align="center" colspan="1" rowspan="1">0.394</td>
                            <td align="left" colspan="1" rowspan="1">C-Maf Inducing Protein</td>
                            <td align="center" colspan="1" rowspan="1">Brain, Small Intestine</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>IGSF6</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.011786</td>
                            <td align="center" colspan="1" rowspan="1">0.38</td>
                            <td align="left" colspan="1" rowspan="1">Immunoglobulin Superfamily Member 6</td>
                            <td align="center" colspan="1" rowspan="1">Spleen, Appendix</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>HDHD2</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.01764</td>
                            <td align="center" colspan="1" rowspan="1">0.361</td>
                            <td align="left" colspan="1" rowspan="1">Haloacid Dehalogenase Like Hydrolase Domain
                                <break/>Containing 2</td>
                            <td align="center" colspan="1" rowspan="1">Brain, Thyroid</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>LMO4</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.012872</td>
                            <td align="center" colspan="1" rowspan="1">0.359</td>
                            <td align="left" colspan="1" rowspan="1">LIM Domain Only 4</td>
                            <td align="center" colspan="1" rowspan="1">Brain, Stomach</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>BACE2</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.000711</td>
                            <td align="center" colspan="1" rowspan="1">0.353</td>
                            <td align="left" colspan="1" rowspan="1">Beta-site APP-Cleaving Enzyme 2</td>
                            <td align="center" colspan="1" rowspan="1">Stomach, Gall Bladder</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>TPP1</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.00061</td>
                            <td align="center" colspan="1" rowspan="1">0.341</td>
                            <td align="left" colspan="1" rowspan="1">Tripeptidyl Peptidase 1</td>
                            <td align="center" colspan="1" rowspan="1">Spleen, Appendix</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>GALNS</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.007613</td>
                            <td align="center" colspan="1" rowspan="1">0.341</td>
                            <td align="left" colspan="1" rowspan="1">Galactosamine (N-acetyl)-6-Sulfatase</td>
                            <td align="center" colspan="1" rowspan="1">Bone Marrow, Testis</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">

                                <bold>SYNM</bold>
</td>
                            <td align="center" colspan="1" rowspan="1">1</td>
                            <td align="center" colspan="1" rowspan="1">0.019042</td>
                            <td align="center" colspan="1" rowspan="1">0.322</td>
                            <td align="left" colspan="1" rowspan="1">Synemin</td>
                            <td align="center" colspan="1" rowspan="1">Esophagus, Prostate</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <table-wrap id="T5" orientation="portrait" position="anchor">
                <label>Table 5. </label>
                <caption>
                    <title>Differentially expressed genes between Female Responders and Female Non-Responders at baseline with a log fold-change threshold of 0.3.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Genes associated with female lithium responders</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Highest gene tissue
                                <break/>expression</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>FAM117B</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0048554</td>
                            <td align="center" colspan="1" rowspan="1">0.5257</td>
                            <td align="left" colspan="1" rowspan="1">Family with Sequence Similarity 117
                                <break/>Member B</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Adrenal</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>STAMBPL1</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0074433</td>
                            <td align="center" colspan="1" rowspan="1">0.39</td>
                            <td align="left" colspan="1" rowspan="1">STAM Binding Protein Like 1</td>
                            <td align="center" colspan="1" rowspan="1">Adrenal, Testis</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>CD248</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0038199</td>
                            <td align="center" colspan="1" rowspan="1">0.3626</td>
                            <td align="left" colspan="1" rowspan="1">CD248 Molecule</td>
                            <td align="center" colspan="1" rowspan="1">--</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>IFIH1</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0075822</td>
                            <td align="center" colspan="1" rowspan="1">0.3453</td>
                            <td align="left" colspan="1" rowspan="1">Interferon Induced with Helicase C
                                <break/>domain 1</td>
                            <td align="center" colspan="1" rowspan="1">Spleen, Appendix</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>GPR160</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0071723</td>
                            <td align="center" colspan="1" rowspan="1">0.3394</td>
                            <td align="left" colspan="1" rowspan="1">G Protein-coupled Receptor 160</td>
                            <td align="center" colspan="1" rowspan="1">Small Intestine,
                                <break/>Duodenum</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>STAP1</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0053096</td>
                            <td align="center" colspan="1" rowspan="1">0.3222</td>
                            <td align="left" colspan="1" rowspan="1">Signal Transducing Adaptor Family
                                <break/>Member 1</td>
                            <td align="center" colspan="1" rowspan="1">Lymph Node, Appendix</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>YEATS4</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0089003</td>
                            <td align="center" colspan="1" rowspan="1">0.3103</td>
                            <td align="left" colspan="1" rowspan="1">YEATS Domain Containing 4</td>
                            <td align="center" colspan="1" rowspan="1">Testis, Bone Marrow</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>CD83</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0004367</td>
                            <td align="center" colspan="1" rowspan="1">0.3014</td>
                            <td align="left" colspan="1" rowspan="1">CD83 Molecule</td>
                            <td align="center" colspan="1" rowspan="1">Bone Marrow, Lymph
                                <break/>Node</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>TMOD2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0081514</td>
                            <td align="center" colspan="1" rowspan="1">0.3012</td>
                            <td align="left" colspan="1" rowspan="1">Tropomodulin 2</td>
                            <td align="center" colspan="1" rowspan="1">Brain, Appendix</td>
                        </tr>
                        <tr>
                            <th align="center" colspan="6" rowspan="1">Genes associated with female lithium non-responders</th>
                        </tr>
                        <tr>
                            <th align="center" colspan="1" rowspan="1">Gene</th>
                            <th align="center" colspan="1" rowspan="1">Adjusted
                                <break/>P-value</th>
                            <th align="center" colspan="1" rowspan="1">P-value</th>
                            <th align="center" colspan="1" rowspan="1">Log fold change</th>
                            <th align="center" colspan="1" rowspan="1">Gene description</th>
                            <th align="center" colspan="1" rowspan="1">Highest gene tissue
                                <break/>expression</th>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>GOLGB1</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0003716</td>
                            <td align="center" colspan="1" rowspan="1">-0.6536</td>
                            <td align="left" colspan="1" rowspan="1">Golgin B1</td>
                            <td align="center" colspan="1" rowspan="1"/>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>RASA4CP</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0030349</td>
                            <td align="center" colspan="1" rowspan="1">-0.4554</td>
                            <td align="left" colspan="1" rowspan="1">RAS p21 Protein Activator 4C,
                                <break/>Pseudogene</td>
                            <td align="center" colspan="1" rowspan="1">Spleen, Endometrium</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>NACC2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0061286</td>
                            <td align="center" colspan="1" rowspan="1">-0.3803</td>
                            <td align="left" colspan="1" rowspan="1">NACC Family Member 2</td>
                            <td align="center" colspan="1" rowspan="1">Brain, Fat</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>EDARADD</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0021425</td>
                            <td align="center" colspan="1" rowspan="1">-0.3553</td>
                            <td align="left" colspan="1" rowspan="1">EDAR Associated Death Domain</td>
                            <td align="center" colspan="1" rowspan="1">Urinary Bladder, Kidney</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>ZNF573</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0058465</td>
                            <td align="center" colspan="1" rowspan="1">-0.3463</td>
                            <td align="left" colspan="1" rowspan="1">Zinc Finger Protein 573</td>
                            <td align="center" colspan="1" rowspan="1">Thyroid, Spleen</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>ALDH2</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0031872</td>
                            <td align="center" colspan="1" rowspan="1">-0.335</td>
                            <td align="left" colspan="1" rowspan="1">Aldehyde Dehydrogenase 2 Family
                                <break/>(mitochondrial)</td>
                            <td align="center" colspan="1" rowspan="1">Fat, Liver</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1">
                                <bold>TAPBPL</bold>
                            </td>
                            <td align="center" colspan="1" rowspan="1">0.998</td>
                            <td align="center" colspan="1" rowspan="1">0.0032596</td>
                            <td align="center" colspan="1" rowspan="1">-0.3206</td>
                            <td align="left" colspan="1" rowspan="1">TAP Binding Protein Like</td>
                            <td align="center" colspan="1" rowspan="1">Duodenum, Small
                                <break/>Intestine</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
        </sec>
        <sec sec-type="discussion">
            <title>Discussion</title>
            <p>The purpose of this investigation was to define gender-specific transcriptome-level regulators of lithium treatment response prior to the initiation of lithium treatment. We first established the gender-relevant transcriptional control genes across all study-participant blood samples and specifically to male- and female-responders using a differential gene expression threshold of 0.5. We found that in the downloaded data from the Gene Expression Omnibus, some patients were mislabeled as males and females. Therefore in our first quality control analysis that established the methodology for subsequent gender-specific lithium responders, the following Decision Tree rule for accurate classifying of gender: if RPS4Y1 &lt; 9.643, then patient is female with a probability of 100% and if RPS4Y1 &#x2265; 9.643, then the patient is a male with a lower probability. The differential gene expression threshold of 0.5 was found to be adequate and corroborated with similar studies that used a similar threshold for establishing gene transcription signatures (
                <xref ref-type="bibr" rid="ref-9">Jansen 
                    <italic toggle="yes">et al</italic>., 2014</xref>; 
                <xref ref-type="bibr" rid="ref-14">Mayne 
                    <italic toggle="yes">et al</italic>., 2016</xref>). However, when comparing the male-responders to male non-responders, as well as, the female responders to female non-responders, we set an inclusion fold-change threshold to 0.3. This approach is not unusual, since it is already established that both large and subtle expression changes produce to significant biological and physiological processes (
                <xref ref-type="bibr" rid="ref-21">Wurmbach 
                    <italic toggle="yes">et al</italic>., 2002</xref>). Our results are hypothesis-generating and establish a computational methodology that provides insight to the importance of subgroup analysis in genomic medicine, irrespective of patient small sample-sizes. The end-goal of such analyses serves as a testing methodology for establishing gene screening panels to improve precision medicine in vulnerable and high-risk patient populations. In these patient populations, it is often not feasible to wait for weeks to determine whether a prescribed medication will work and in some cases manic patients are neither able to fully comprehend and be objectively assessed using the CGI-BP-S (
                <xref ref-type="bibr" rid="ref-17">Spearing 
                    <italic toggle="yes">et al</italic>., 1997</xref>).</p>
            <p>When reviewing the heat-map and dendrogram hierarchical cluster analysis patterns, specifically the numerous non-responders clinically-labeled and illustrated in 
                <xref ref-type="fig" rid="f6">Figure 6</xref>, they suggest that the underlying etiology resulting in clinical symptoms (e.g. mania) that led to the diagnosis of bipolar disorder may need re-classification. Further, the subsequent treatments may need to be tailored in data-driven computational psychiatry approaches. In 
                <xref ref-type="fig" rid="f6">Figure 6</xref>, for the females, the samples in the center cluster illustrates that a group of patients are clear non-responders while the patients clustered in the far-right are partial-responders, from a molecular perspective. The natural questions that arise are: (1) How to best convert the non- and partial-responders to treatment-responders? (2) Is a behavioral intervention, in this select group of patients, for whom lithium is not effective, the best answer because the symptoms maybe of a different etiology? If indeed the symptoms are of a different etiology (e.g. inflammatory), from the lithium treatment-responders, then other diagnostic (e.g. electrophysiological neuroimaging) tools may be warranted and corresponding most efficacious treatments sought.</p>
            <p>When differentiating between male and female patients, we found that the Ribosomal Protein S4, Y-linked 1 (
                <italic toggle="yes">RPS4Y1</italic>, adjusted p-value=7.36E-47) male-linked gene and the X Inactive Specific Transcript (
                <italic toggle="yes">XIST</italic>, adjusted p-value=2.98E-36) female-linked gene were the most differentially expressed among genders, which is consistent with previously published studies (
                <xref ref-type="bibr" rid="ref-6">Guill&#x00e9;n 
                    <italic toggle="yes">et al</italic>., 2014</xref>; 
                <xref ref-type="bibr" rid="ref-9">Jansen 
                    <italic toggle="yes">et al</italic>., 2014</xref>; 
                <xref ref-type="bibr" rid="ref-14">Mayne 
                    <italic toggle="yes">et al</italic>., 2016</xref>). The genes that are specific to male lithium responders, relative to female lithium responders, are 
                <italic toggle="yes">RBPMS2, SIDT2, CDH23, LILRA5</italic>, and 
                <italic toggle="yes">KIR2DS5</italic>. Using the same methodology, genes identifying female lithium responders, relative to male lithium responders, are 
                <italic toggle="yes">HLA-H, RPS23, FHL3, RPL10A, NBPF14, PSTPIP2, FAM117B, CHST7</italic>, and 
                <italic toggle="yes">ABRACL</italic>. The Neuroblastoma Breakpoint Family Member 14 (
                <italic toggle="yes">NBPF14</italic>, adjusted p-value=0.0462, Fold-change=0.586) achieved the Benjamani-Hochberg adjusted p-value of 0.0462, and has been reported to be associated with cortical neurogenesis (
                <xref ref-type="bibr" rid="ref-18">Suzuki 
                    <italic toggle="yes">et al</italic>., 2017</xref>).</p>
            <p>Computational psychiatry methods that analyze objective clinical signals (e.g. electroencephalography) and various data-types (e.g. gene expression [RNA], single-nucleotide polymorphisms [DNA], plasma drug concentrations) to classify patients in psychiatry, as advocated by the National Institute of Mental Health&#x2019;s Research Domain Criteria (RDoC), are essential in psychiatry, especially in patients with developmental delay, language difficulty, and conditions of potentially different etiologies than traditionally taught (
                <xref ref-type="bibr" rid="ref-2">Clark 
                    <italic toggle="yes">et al</italic>., 2017</xref>; 
                <xref ref-type="bibr" rid="ref-4">Eugene &amp; Masiak, 2016</xref>). Ideally, in such cases, alternative FDA-approved mood stabilizers may be initially selected prior to any pharmacological intervention by simply using a blood test. Perhaps, a gene expression screening panel at baseline, prior to the initiation of lithium and/or other FDA-approved mood stabilizer, may be better in high-risk patient populations.</p>
            <p>These findings suggest that when implementing genomic medicine, clinical research teams should move beyond the single-gene approach when screening for treatment response biomarkers. This approach is currently the standard when screening for patient toxicity at standard doses in poor or ultra-rapid metabolizers using drug pharmacokinetics; however, as more transcription factors are discovered that regulate the cytochrome (CYP) P-450 system of genes, multi-gene pharmacokinetic panels are inevitable and may be included in future Clinical Pharmacogenetics Implementation Consortium (CPIC) guidelines. Next, medical management of patients with mania and psychosis either with pharmacotherapy and/or behavioral intervention should be tailored to biological gender due to known neuronal circuitry differences in age-matched patients with psychosis (
                <xref ref-type="bibr" rid="ref-5">Eugene 
                    <italic toggle="yes">et al</italic>., 2015</xref>). Further, as a result of lithium not being hepatically metabolized, but rather transported and renally excreted as well as, the known myriad drug-drug interactions, patient dose selection may benefit from pharmacometrics modeling by American Board of Clinical Pharmaology certified physicians in applied clinical pharmacology/clinical pharmacology (
                <xref ref-type="bibr" rid="ref-15">Perera 
                    <italic toggle="yes">et al</italic>., 2014</xref>; 
                <xref ref-type="bibr" rid="ref-22">Zetin 
                    <italic toggle="yes">et al</italic>., 1986</xref>).</p>
            <p>Further, clinical pharmacologist physicians are essential for advancing genomic medicine and providing consults in pharmacogenomics. These physicians would confirm the applicability of embedding machine learning results integrated within artificial intelligence applications in the electronic medical record. 
                <xref ref-type="fig" rid="f5">Figure 5</xref> shows the machine learning classification results of gene expression levels that determine (a) sample gender, (b) male lithium treatment responders, and (c) female lithium treatment responders. These very study results &#x2013; though with a small treatment responder population &#x2013; presents an approach for data science and engineering methods for use in genomics and medicine.</p>
            <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                <label>Figure 5. </label>
                <caption>
                    <p>Machine learning classification results of gene expression levels that determine (
                        <bold>a</bold>) gene expression sample gender using a 1-gene (RPS4Y1) model with a sensitivity of 100% and an area under the receiver operator curve (AUROC) of 1, (
                        <bold>b</bold>) male lithium treatment responders using a 2-gene (RBPMS2 and LILRA5) model with an AUROC of 0.92, and (
                        <bold>c</bold>) female lithium treatment responders using a 3-gene (ABRACL, NBPF14, and FHL3) model with an AUROC of 1.</p>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/18909/86c15bb8-8dda-4d0e-84a7-4a54653d1226_figure5.gif"/>
            </fig>
            <fig fig-type="figure" id="f6" orientation="portrait" position="float">
                <label>Figure 6. </label>
                <caption>
                    <title>Heat-map and dendrogram overview of the two-way unsupervised hierarchical cluster analysis of differentially expressed genes prior to lithium treatment in female lithium responders (n=6, RESP_Fem) and female non-responders (n=14, NR_Fem).</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/18909/86c15bb8-8dda-4d0e-84a7-4a54653d1226_figure6.gif"/>
            </fig>
            <p>The limitations of our analysis &#x2013; as in most pharmacogenomic clinical studies &#x2013; are understandably due to a small patient sample size and multiple-comparison p-value adjustments (
                <xref ref-type="bibr" rid="ref-3">Dudoit 
                    <italic toggle="yes">et al</italic>., 2003</xref>). The fundamental aims of our research questions were designed to answer biological questions of gender and clinical response to lithium and not meant to be driven exclusively by multiple comparisons adjusted p-values or limited by not having enough patients. This approach has led to various successes in pharmacogenomics, specifically, in genome-wide association studies; however, understandably, the limitations are thoroughly acknowledged. In reference to patient sample sizes, 9 out of the 28 patients who received lithium and optimal therapy were classified as lithium treatment responders. Further, 30% of men and 33% of women, who were treated with lithium, were found to be responders at the respective gender categories (
                <xref ref-type="bibr" rid="ref-1">Beech 
                    <italic toggle="yes">et al</italic>., 2014</xref>). However, the strengths of our findings are in the gender-gene screening capability for lithium treatment-responders in the general population of 60 patients at baseline, minus the tested responder group. Opportunities exist for any further clinical studies, prospective clinical trials, and application of the methods outlined in this work for other therapeutic agents across several medical specialties and other disciplines.</p>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusion</title>
            <p>We explored the Lithium Treatment-Moderate dose Use Study clinical trial gene expression data with the aim of identifying gender-specific transcriptome-level regulators of lithium treatment response. We found that male and female labeled patients were misclassified and used the following Decision Tree rule for accurate classifying of gender: if RPS4Y1 &lt; 9.643, then patient is female with a probability of 100%. Further, using machine learning, we successfully developed a pre-treatment gender- and gene-expression-specific predictive model selective for lithium responders with an AUROC of 0.92 for male lithium responders (sensitivity=96%) and an AUROC of 1 for female lithium responders (sensitivity=92%). Moreover, by using well-established Bayesian statistical methods, to identify differentially expressed genes and then machine learning, we discovered 2-genes (RBPMS2 and LILRA5) selective for male lithium responders and 3-genes (ABRACL, FHL3, and NBPF14) selective for female lithium responders that will inform physicians and the medical staff of whether the patient will respond to lithium prior to being prescribed the mood stabilizer. Further, due to the small number of patients classified as responders from the clinical trial, our results should be confirmed. Lastly, in an overall context, our results suggest that the methodology used in this analysis may be extended to other therapeutic drug classes and provides insight to the gender-based gene transcriptome differences influencing lithium pharmacodynamics.</p>
        </sec>
        <sec>
            <title>Data availability</title>
            <p>Data used in this study are available from 
                <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE45484">https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE45484</ext-link>
            </p>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgements</title>
            <p>The authors gratefully acknowledge the patients in the original clinical trial, the medical staff, and the NCBI GEO database accession GSE4548.</p>
        </ack>
        <sec id="SM" sec-type="supplementary-material">
            <title>Supplementary material</title>
            <p id="SF1">Supplementary File 1: Supplementary methods</p>
            <p>
                <ext-link ext-link-type="uri" xlink:href="https://f1000researchdata.s3.amazonaws.com/supplementary/14451/caf2ad95-c800-40fc-be2f-6c4d67dc41ac_updated_-_Supplementary_methods_for_Lithium_treatment_response_article.docx">Click here to access the data</ext-link>
            </p>
        </sec>
        <ref-list>
            <ref id="ref-1">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Beech</surname>
                            <given-names>RD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Leffert</surname>
                            <given-names>JJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lin</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Gene-expression differences in peripheral blood between lithium responders and non-responders in the Lithium Treatment-Moderate dose Use Study (LiTMUS).</article-title>
                    <source>

                        <italic toggle="yes">Pharmacogenomics J.</italic>
</source>
                    <year>2014</year>;<volume>14</volume>(<issue>2</issue>):<fpage>182</fpage>&#x2013;<lpage>91</lpage>.
                    <pub-id pub-id-type="pmid">23670706</pub-id>
                    <pub-id pub-id-type="doi">10.1038/tpj.2013.16</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Clark</surname>
                            <given-names>LA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cuthbert</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lewis-Fern&#x00e1;ndez</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Three Approaches to Understanding and Classifying Mental Disorder: 
                        <italic toggle="yes">ICD-11, DSM-5,</italic> and the National Institute of Mental Health&#x2019;s Research Domain Criteria (RDoC).</article-title>
                    <source>

                        <italic toggle="yes">Psychol Sci Public Interest.</italic>
</source>
                    <year>2017</year>;<volume>18</volume>(<issue>2</issue>):<fpage>72</fpage>&#x2013;<lpage>145</lpage>.
                    <pub-id pub-id-type="pmid">29211974</pub-id>
                    <pub-id pub-id-type="doi">10.1177/1529100617727266</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dudoit</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shaffer</surname>
                            <given-names>JP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Boldrick</surname>
                            <given-names>JC</given-names>
                        </name>
</person-group>:
                    <article-title>Multiple Hypothesis Testing in Microarray Experiments.</article-title>
                    <source>

                        <italic toggle="yes">Statist Sci.</italic>
</source>
                    <year>2003</year>;<volume>18</volume>(<issue>1</issue>):<fpage>71</fpage>&#x2013;<lpage>103</lpage>.
                    <pub-id pub-id-type="doi">10.1214/ss/1056397487</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-24">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eichelbaum</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dahl</surname>
                            <given-names>ML</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sj&#x00f6;qvist</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>Clinical pharmacology in Stockholm 50 years-report from the jubilee symposium.</article-title>
                    <source>

                        <italic toggle="yes">Eur J Clin Pharmacol.</italic>
</source>
                    <year>2018</year>;<volume>74</volume>(<issue>6</issue>):<fpage>843</fpage>&#x2013;<lpage>851</lpage>.
                    <pub-id pub-id-type="pmid">29487959</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s00228-018-2432-6</pub-id>
                    <pub-id pub-id-type="pmcid">5942344</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eugene</surname>
                            <given-names>AR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Masiak</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>Identifying Treatment Response of Sertraline in a Teenager with Selective Mutism using Electrophysiological Neuroimaging.</article-title>
                    <source>

                        <italic toggle="yes">Int J Clin Pharmacol Toxicol.</italic>
</source>
                    <year>2016</year>;<volume>5</volume>(<issue>4</issue>):<fpage>216</fpage>&#x2013;<lpage>19</lpage>.
                    <pub-id pub-id-type="pmid">27468379</pub-id>
                    <pub-id pub-id-type="doi">10.19070/2167-910X-1600036</pub-id>
                    <pub-id pub-id-type="pmcid">4959607</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eugene</surname>
                            <given-names>AR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Masiak</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kapica</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Electrophysiological Neuroimaging using sLORETA Comparing 22 Age Matched Male and Female Schizophrenia Patients.</article-title>
                    <source>

                        <italic toggle="yes">Hosp Chron.</italic>
</source>
                    <year>2015</year>;<volume>10</volume>(<issue>2</issue>):<fpage>91</fpage>&#x2013;<lpage>98</lpage>.
                    <pub-id pub-id-type="pmid">26617679</pub-id>
                    <pub-id pub-id-type="pmcid">4662405</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-23">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eugene</surname>
                            <given-names>AR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Eugene</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>An opportunity for clinical pharmacology trained physicians to improve patient drug safety: A retrospective analysis of adverse drug reactions in teenagers [version 2; referees: 2 approved].</article-title>
                    <source>

                        <italic toggle="yes">F1000Res.</italic>
</source>
                    <year>2018</year>; [cited 2018 Aug 23];<volume>7</volume>:<fpage>677</fpage>.
                    <pub-id pub-id-type="pmid">30271581</pub-id>
                    <pub-id pub-id-type="doi">10.12688/f1000research.14970.2</pub-id>
                    <pub-id pub-id-type="pmcid">6143933</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Guill&#x00e9;n</surname>
                            <given-names>IA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fern&#x00e1;ndez</surname>
                            <given-names>JR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Palenzuela</surname>
                            <given-names>DO</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Analysis of Gene Expression Profile for Gender in Human Blood Samples.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Innovation and Applied Studies.</italic>
</source>
                    <year>2014</year>;<volume>7</volume>(<issue>1</issue>):<fpage>329</fpage>&#x2013;<lpage>42</lpage>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.issr-journals.org/links/papers.php?journal=ijias&amp;application=pdf&amp;article=IJIAS-14-161-02">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hayes</surname>
                            <given-names>JF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pitman</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Marston</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Self-harm, Unintentional Injury, and Suicide in Bipolar Disorder During Maintenance Mood Stabilizer Treatment: A UK Population-Based Electronic Health Records Study.</article-title>
                    <source>

                        <italic toggle="yes">JAMA Psychiatry.</italic>
</source>
                    <year>2016</year>;<volume>73</volume>(<issue>6</issue>):<fpage>630</fpage>&#x2013;<lpage>7</lpage>.
                    <pub-id pub-id-type="pmid">27167638</pub-id>
                    <pub-id pub-id-type="doi">10.1001/jamapsychiatry.2016.0432</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hiemke</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baumann</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bergemann</surname>
                            <given-names>N</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>AGNP Consensus Guidelines for Therapeutic Drug Monitoring in Psychiatry: Update 2011.</article-title>
                    <source>

                        <italic toggle="yes">Pharmacopsychiatry.</italic>
</source>
                    <year>2011</year>;<volume>44</volume>(<issue>6</issue>):<fpage>195</fpage>&#x2013;<lpage>235</lpage>.
                    <pub-id pub-id-type="pmid">21969060</pub-id>
                    <pub-id pub-id-type="doi">10.1055/s-0031-1286287</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jansen</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Batista</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brooks</surname>
                            <given-names>AI</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Sex differences in the human peripheral blood transcriptome.</article-title>
                    <source>

                        <italic toggle="yes">BMC Genomics.</italic>
</source>
                    <year>2014</year>;<volume>15</volume>(<issue>1</issue>):<fpage>33</fpage>.
                    <pub-id pub-id-type="pmid">24438232</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1471-2164-15-33</pub-id>
                    <pub-id pub-id-type="pmcid">3904696</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jermain</surname>
                            <given-names>DM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Crismon</surname>
                            <given-names>ML</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Martin</surname>
                            <given-names>ES</given-names>
                            <suffix>3rd</suffix>
                        </name>
</person-group>:
                    <article-title>Population pharmacokinetics of lithium.</article-title>
                    <source>

                        <italic toggle="yes">Clin Pharm.</italic>
</source>
                    <year>1991</year>;<volume>10</volume>(<issue>5</issue>):<fpage>376</fpage>&#x2013;<lpage>81</lpage>.
                    <pub-id pub-id-type="pmid">2049899</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Labont&#x00e9;</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname> Engmann</surname>
                            <given-names>O</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Purushothaman</surname>
                            <given-names>I</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Sex-specific transcriptional signatures in human depression.</article-title>
                    <source>

                        <italic toggle="yes">Nat Med.</italic>
</source>
                    <year>2017</year>;<volume>23</volume>(<issue>9</issue>):<fpage>1102</fpage>&#x2013;<lpage>11</lpage>.
                    <pub-id pub-id-type="pmid">28825715</pub-id>
                    <pub-id pub-id-type="doi">10.1038/nm.4386</pub-id>
                    <pub-id pub-id-type="pmcid">5734943</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Landersdorfer</surname>
                            <given-names>CB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Findling</surname>
                            <given-names>RL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Frazier</surname>
                            <given-names>JA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Lithium in Paediatric Patients with Bipolar Disorder: Implications for Selection of Dosage Regimens via Population Pharmacokinetics/Pharmacodynamics.</article-title>
                    <source>

                        <italic toggle="yes">Clin Pharmacokinet.</italic>
</source>
                    <year>2017</year>;<volume>56</volume>(<issue>1</issue>):<fpage>77</fpage>&#x2013;<lpage>90</lpage>.
                    <pub-id pub-id-type="pmid">27393139</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s40262-016-0430-3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lobeck</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nelson</surname>
                            <given-names>MV</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Evans</surname>
                            <given-names>RL</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Evaluation of four methods for predicting lithium dosage.</article-title>
                    <source>

                        <italic toggle="yes">Clin Pharm.</italic>
</source>
                    <year>1987</year>;<volume>6</volume>(<issue>3</issue>):<fpage>230</fpage>&#x2013;<lpage>33</lpage>.
                    <pub-id pub-id-type="pmid">3665378</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mayne</surname>
                            <given-names>BT</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bianco-Miotto</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Buckberry</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Large Scale Gene Expression Meta-Analysis Reveals Tissue-Specific, Sex-Biased Gene Expression in Humans.</article-title>
                    <source>

                        <italic toggle="yes">Front Genet.</italic>
</source>
                    <year>2016</year>;<volume>7</volume>:<fpage>183</fpage>.
                    <pub-id pub-id-type="pmid">27790248</pub-id>
                    <pub-id pub-id-type="doi">10.3389/fgene.2016.00183</pub-id>
                    <pub-id pub-id-type="pmcid">5062749</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Perera</surname>
                            <given-names>V</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bies</surname>
                            <given-names>RR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mo</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Optimal sampling of antipsychotic medicines: a pharmacometric approach for clinical practice.</article-title>
                    <source>

                        <italic toggle="yes">Br J Clin Pharmacol.</italic>
</source>
                    <year>2014</year>;<volume>78</volume>(<issue>4</issue>):<fpage>800</fpage>&#x2013;<lpage>814</lpage>.
                    <pub-id pub-id-type="pmid">24773369</pub-id>
                    <pub-id pub-id-type="doi">10.1111/bcp.12410</pub-id>
                    <pub-id pub-id-type="pmcid">4239974</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ritchie</surname>
                            <given-names>ME</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Phipson</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wu</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>
                        <italic toggle="yes">limma</italic> powers differential expression analyses for RNA-sequencing and microarray studies.</article-title>
                    <source>

                        <italic toggle="yes">Nucleic Acids Res.</italic>
</source>
                    <year>2015</year>;<volume>43</volume>(<issue>7</issue>):<fpage>e47</fpage>.
                    <pub-id pub-id-type="pmid">25605792</pub-id>
                    <pub-id pub-id-type="doi">10.1093/nar/gkv007</pub-id>
                    <pub-id pub-id-type="pmcid">4402510</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-17">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Spearing</surname>
                            <given-names>MK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Post</surname>
                            <given-names>RM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Leverich</surname>
                            <given-names>GS</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Modification of the Clinical Global Impressions (CGI) Scale for use in bipolar illness (BP): the CGI-BP.</article-title>
                    <source>

                        <italic toggle="yes">Psychiatry Res.</italic>
</source>
                    <year>1997</year>;<volume>73</volume>(<issue>3</issue>):<fpage>159</fpage>&#x2013;<lpage>71</lpage>.
                    <pub-id pub-id-type="pmid">9481807</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S0165-1781(97)00123-6</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Suzuki</surname>
                            <given-names>IK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gacquer</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Van Heurck</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Hominin-Specific NOTCH2 Paralogs Expand Human Cortical Neurogenesis through Regulation of Delta/Notch Interactions.</article-title>
                    <source>

                        <italic toggle="yes">bioRxiv.</italic>
</source>Cold Spring Harbor Laboratory,<year>2017</year>; 221358.
                    <pub-id pub-id-type="doi">10.1101/221358</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <mixed-citation publication-type="journal">
                    <collab>Team R</collab>:
                    <article-title>R Development Core Team. R: A Language and Environment for Statistical Computing</article-title>.<year>2013</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.R-project.org">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Viguera</surname>
                            <given-names>AC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tondo</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baldessarini</surname>
                            <given-names>RJ</given-names>
                        </name>
</person-group>:
                    <article-title>Sex differences in response to lithium treatment.</article-title>
                    <source>

                        <italic toggle="yes">Am J Psychiatry.</italic>
</source>
                    <year>2000</year>;<volume>157</volume>(<issue>9</issue>):<fpage>1509</fpage>&#x2013;<lpage>11</lpage>.
                    <pub-id pub-id-type="pmid">10964872</pub-id>
                    <pub-id pub-id-type="doi">10.1176/appi.ajp.157.9.1509</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-21">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wurmbach</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gonz&#x00e1;lez-Maeso</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yuen</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Validated genomic approach to study differentially expressed genes in complex tissues.</article-title>
                    <source>

                        <italic toggle="yes">Neurochem Res.</italic>
</source>
                    <year>2002</year>;<volume>27</volume>(<issue>10</issue>):<fpage>1027</fpage>&#x2013;<lpage>33</lpage>.
                    <pub-id pub-id-type="pmid">12462402</pub-id>
                    <pub-id pub-id-type="doi">10.1023/A:1020900720328</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-22">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zetin</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Garber</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>De Antonio</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Prediction of lithium dose: a mathematical alternative to the test-dose method.</article-title>
                    <source>

                        <italic toggle="yes">J Clin Psychiatry.</italic>
</source>
                    <year>1986</year>;<volume>47</volume>(<issue>4</issue>):<fpage>175</fpage>&#x2013;<lpage>78</lpage>.
                    <pub-id pub-id-type="pmid">3082862</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report43262">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.18909.r43262</article-id>
            <title-group>
                <article-title>Reviewer response for version 3</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Liu</surname>
                        <given-names>Duan</given-names>
                    </name>
                    <xref ref-type="aff" rid="r43262a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1065-246X</uri>
                </contrib>
                <aff id="r43262a1">
                    <label>1</label>Division of Clinical Pharmacology, Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>18</day>
                <month>2</month>
                <year>2019</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2019 Liu D</copyright-statement>
                <copyright-year>2019</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport43262" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.14451.3"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Using a published data set, the authors built a model based on gender-specific gene expression to predict&#x00a0;lithium treatment response in bipolar disorder patients. Here are my questions and concerns: 
                <list list-type="order">
                    <list-item>
                        <p>The authors realized that the sample size is small and the results will need further confirm. Is there any other similar (lithium treatment response) clinical trial/data available to&#x00a0;test the predicting model?</p>
                    </list-item>
                    <list-item>
                        <p>After&#x00a0;the Step 1 analysis, why not exclude the four samples that their genders had been mis-classified? (Since the clinical data for those four patients may be also mis-labelled.) Data accuracy is critical for building models, especially when dealing&#x00a0;with small sample size.</p>
                    </list-item>
                    <list-item>
                        <p>Those three genes, the 
                            <italic>ABRACL</italic>, 
                            <italic>FHL3</italic>, and 
                            <italic>NBPF14</italic>, which classified female responders seem not differentially expressed&#x00a0;between female responders and female non-responders (Table 5). Please explain why this might be happened.</p>
                    </list-item>
                    <list-item>
                        <p>What is the known function of those 5 genes that chosen for classification of male and female responders? The authors might want to discuss the possible molecular mechanism of those gene function related to&#x00a0;lithium treatment response in bipolar disorders.</p>
                    </list-item>
                    <list-item>
                        <p>Since the authors re-analyzed data from a previously published study, a comparison of the findings from this study to the original one may be necessary. I understood that the original study looked at differences between responder and non-responders, regardless of genders. Is there any gene, of which its expression differentiates responder and non-responder, overlapped with what the authors found in this study? What will be found if apply a machine learning approach to this data set without classifying patients by genders?</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Pharmacogenomics</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report42767">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.18909.r42767</article-id>
            <title-group>
                <article-title>Reviewer response for version 3</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Kalmady</surname>
                        <given-names>Sunil V.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r42767a1">1</xref>
                    <xref ref-type="aff" rid="r42767a2">2</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-4876-9121</uri>
                </contrib>
                <aff id="r42767a1">
                    <label>1</label>Department of Psychiatry, University of Alberta, Alberta, Canada</aff>
                <aff id="r42767a2">
                    <label>2</label>Alberta Machine Intelligence Institute, Alberta, Canada</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>9</day>
                <month>1</month>
                <year>2019</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2019 Kalmady SV</copyright-statement>
                <copyright-year>2019</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport42767" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.14451.3"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Authors have made improvements to the manuscript in terms of clarity of methodology. Hence, now I can comment on their methods.</p>
            <p> Biostatistical methods are mostly sound.</p>
            <p> </p>
            <p> However, machine learning part of study seems have major issues: 
                <list list-type="order">
                    <list-item>
                        <p>Authors haven&#x2019;t specified number of responders in their test sets or whether split is class-balanced. But based on their description of 70 &#x2013; 30 train -test split, sample size is severely limiting for model evaluation, with mere one or two examples of positive class (responders) in test set (30% of 3 male ~ 1 ; 30% of 6 female ~ 2). As a fellow researcher, I completely respect the motivation and effort behind the efforts here, but we as scientific community should understand that the real danger of generalizing observations based on handful of cases is not so much of being underpowered to detect real effect, but of generating false positives results that add to prevailing burden of irreproducible results.</p>
                    </list-item>
                    <list-item>
                        <p>It seems that features (250 control gene selection, 2-gene model, 3-gene model etc..) were selected using analyses of both training and testing data partitions. This is called double-dipping and leads to invalid or over-optimistic estimates of model performance.</p>
                    </list-item>
                </list> While above two points are deal breakers, I will also mention following points for sake of completion. 
                <list list-type="order">
                    <list-item>
                        <p>Hyper-parameters should also be selected &#x2018;
                            <italic>in fold</italic>&#x2019; or their choice should be explained.</p>
                    </list-item>
                    <list-item>
                        <p>Baseline performance (chance level accuracy) is rather high due to class imbalance &#x2013; eg: 25/28 = 89% for male responders. Reporting the confusion matrix will be more useful than sensitivity, AUC etc&#x00a0;in such cases.</p>
                    </list-item>
                    <list-item>
                        <p>For small samples, consider simple linear models than complex non-linear ones such as random forest to avoid over-fitting. Also, consider leave-one-out or k-fold cross validation instead of single test-train split for better estimate of performance.</p>
                    </list-item>
                </list> Hence, in my humble opinion, the manuscript in its current form doesn&#x2019;t meet the necessary scientific rigor. That is at least without a major revision in machine learning methods, such as learning models to predict treatment response in larger undivided dataset of 60 subjects, appropriate use of feature selection etc.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>No</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report39873">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.16407.r39873</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Kalmady</surname>
                        <given-names>Sunil V.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r39873a1">1</xref>
                    <xref ref-type="aff" rid="r39873a2">2</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-4876-9121</uri>
                </contrib>
                <aff id="r39873a1">
                    <label>1</label>Department of Psychiatry, University of Alberta, Alberta, Canada</aff>
                <aff id="r39873a2">
                    <label>2</label>Alberta Machine Intelligence Institute, Alberta, Canada</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>12</day>
                <month>11</month>
                <year>2018</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2018 Kalmady SV</copyright-statement>
                <copyright-year>2018</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport39873" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.14451.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Eugene et al. tackles the hard question on the transcriptome predictors of clinical outcome in lithium treatment of Bipolar disorder. This research question is of clinical relevance and importance, however, there might be some issues with how the data was analyzed and presented in the manuscript.&#x00a0; 
                <list list-type="bullet">
                    <list-item>
                        <p>The study design and methods do not seem to be coherent to a single unifying goal. Whether the goal is to predict the responder using the 'gender' and 'transcriptome' data as features? If so, such a model can be learned using standard machine learning methods. On the other hand, whether the goal is to identify are genes with statistically significant group differences in their expression? If so, this can be achieved by biostatistical inference tests of association.&#x00a0;</p>
                    </list-item>
                </list> Please note that task of 'association' and 'prediction' are quite distinct in their formulation and desired objective. Authors have to be really careful about that they trying to test and claim while using both of approaches in conjunction.&#x00a0; 
                <list list-type="bullet">
                    <list-item>
                        <p>Study design is a bit unconventional, and hence needs to be motivated and explained better. For example: Performing successive sub-group analyses partitioned on factors like gender have less power, and should be generally restricted to post-hoc tests. Why not simply use standard biostatistical tools such as factorial ANOVA with 'sex' and 'response' as between-subjects factors of interest?</p>
                    </list-item>
                </list> I agree with Reviewer #1 that flowchart of analysis pipeline will help the understanding. Steps of sub-group selection and variable/feature selection can be indicated in this flowchart. Care should be taken to avoid the circularity that can arise from selection because statistical inference can be invalid whenever the results statistics are not inherently independent of the selection criteria under the null hypothesis.&#x00a0; 
                <list list-type="bullet">
                    <list-item>
                        <p>Authors might be asking too many questions with limited data in hand. Sample size might not enough to study individual effects of multiple factors - such as treatment-type, response and then, the gender. Cell-wise sample sizes resulting from this 8-way split is less than 10 for all but two cells (less than 5 for 3 cells). Suitability of applied statistical tests and generalizability of their claims are questionable here. Authors should also think about 1:2 skew in male:female ratio, which makes this issue worse. Study can greatly benefit from asking specific and limited hypothesized questions.&#x00a0;</p>
                    </list-item>
                </list> Also, since multiple objectives are stated, methods and results section can describe each objective separately for sake of better clarity.&#x00a0;&#x00a0;</p>
            <p> &#x00a0;&#x00a0; 
                <list list-type="bullet">
                    <list-item>
                        <p>Machine learning methods are not described. The methods used for learning of model and its evaluation process needs be specified. Example: How was training and test splits performed? How was feature selection performed? How were the hyper-parameters optimized? Whether the reported performance metrics are for training or testing sets? Whether the discovery dataset used for identifying '250 genes' disjoint from validation set? etc. Without these details, it is hard to comment on validity of a predictive study.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>No</p>
            <p>Reviewer Expertise:</p>
            <p>Psychiatric research, Biostatistics, Machine learning.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment4258-39873">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Eugene</surname>
                            <given-names>Andy</given-names>
                        </name>
                        <aff>Department of Pediatrics, Robert Wood Johnson Medical Schoo, Rutgers University, USA</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>None.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>27</day>
                    <month>11</month>
                    <year>2018</year>
                </pub-date>
            </front-stub>
            <body>
                <p>
                    <bold>Please see our responses in bold-face to the comments from Referee #2. We thank you for reviewing this article.</bold>
                </p>
                <p> </p>
                <p> Eugene et al. tackles the hard question on the transcriptome predictors of clinical outcome in lithium treatment of Bipolar disorder. This research question is of clinical relevance and importance, however, there might be some issues with how the data was analyzed and presented in the manuscript.&#x00a0; 
                    <list list-type="bullet">
                        <list-item>
                            <p>The study design and methods do not seem to be coherent to a single unifying goal. Whether the goal is to predict the responder using the 'gender' and 'transcriptome' data as features? If so, such a model can be learned using standard machine learning methods. On the other hand, whether the goal is to identify are genes with statistically significant group differences in their expression? If so, this can be achieved by biostatistical inference tests of association.&#x00a0;</p>
                        </list-item>
                        <list-item>
                            <p>
                                <underline>Response:</underline> 
                                <bold>First and foremost, I sincerely appreciate you taking time out to review this article and provide constructive feedback. In answering these points, this paper addressed questions that were not addressed in the original clinical study and attempted not to duplicate work previously published. Hence, is why the methods are creative and not employ standard biostatistical inference tests of association. For example, we aimed to test the hypothesis if gender influenced selecting transcriptome signatures associated with lithium efficacy. Therefore, in order to accomplish this task, we conducted a quality control test that identifies known gender-biased transcriptome signatures. This proved to be essential and is why we identified that several patients were misclassified as male/female. Results are shown, documented, and corroborated with other studies identifying the same genes as being gender-specific. Next, standard statistical tests were indeed used, however, we chose to use those adapted for Gene Expression analysis as has been developed using the &#x201c;limma&#x201d; package and for machine learning methods, we used the Random Forest algorithm. We then aimed to develop a predictive model to see if this may be a first-step for other medical research teams to validate with further clinical studies and for Clinical Pharmacology laboratories to pursue and develop novel experiments to determine lithium&#x2019;s effect in cells, tissues, laboratory animals, and later in humans. </bold>
                            </p>
                        </list-item>
                    </list> &#x00a0;</p>
                <p> Please note that task of 'association' and 'prediction' are quite distinct in their formulation and desired objective. Authors have to be really careful about that they trying to test and claim while using both of approaches in conjunction.&#x00a0;</p>
                <p> 
                    <underline>Response:</underline> 
                    <bold>Well said and this is duly noted. We first aimed to identify genes associated with responders and hoped to identify if using those genes would help in creating hypothesis-generating predictors treatment response, only to be later validated by other studies. Thank you for the comment.</bold> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Study design is a bit unconventional, and hence needs to be motivated and explained better. For example: Performing successive sub-group analyses partitioned on factors like gender have less power, and should be generally restricted to post-hoc tests. Why not simply use standard biostatistical tools such as factorial ANOVA with 'sex' and 'response' as between-subjects factors of interest?</p>
                        </list-item>
                        <list-item>
                            <p>
                                <underline>Response:</underline> 
                                <bold>While your point with &#x201c;gender&#x201d; should be restricted to post-hoc analysis, we are looking to make gender the primary point of our analysis in patients responding to lithium treatment and specifically not repeat the analysis from the original publication in Nature. This was attempted on the original article, however, we clearly identified that there was patient-gender misclassification in the original study. So, we sought another route of analysis to ensure that gender was a primary point of analysis and not side-lined to the post-hoc analyses. However, we do understand that this compromises statistical power and therefore, sought not to analyze the data with ANOVA, because we are addressing minor gene expression level changes that might have real-world clinical insight. This is a hypothesis-generating analysis, however, we do thank you as well for this comment.</bold>
                            </p>
                        </list-item>
                    </list> I agree with Reviewer #1 that flowchart of analysis pipeline will help the understanding. Steps of sub-group selection and variable/feature selection can be indicated in this flowchart. Care should be taken to avoid the circularity that can arise from selection because statistical inference can be invalid whenever the results statistics are not inherently independent of the selection criteria under the null hypothesis.&#x00a0;</p>
                <p> 
                    <underline>Response:</underline> 
                    <bold>We appreciate the request for having a graphical flowchart depicting the analysis pipeline and have included the figure in the updated version of the manuscript. We are confident that circularity is not an issue, given the specific aims of our analysis. These methods are determined to seeking to identify the influence of linked gender-drug-response to genes at baseline and not after treating with the mood stabilizer. The gender differences in clinical practice are a well-documented reality and we literally sought to identify any signal, on the gene expression level, to address the clinical question rather than entirely use traditional statistical methods which did not necessarily translate to clinical translation. With our results, we are expecting laboratories having strengths in gene knock-down/out and gene over-expression experiments to identify the mechanisms to lithium&#x2019;s efficacy. This is an old drug and until this day, most textbooks lack knowledge of the drug&#x2019;s mechanism. These mechanisms may be attributable to biological, biochemical, gene expression, hormonal, and proteomic differences that we are aiming to identify here in this article. Please see the new figure showing the data analysis pipeline used in this paper.</bold> 
                    <list list-type="bullet">
                        <list-item>
                            <p>Authors might be asking too many questions with limited data in hand. Sample size might not enough to study individual effects of multiple factors - such as treatment-type, response and then, the gender. Cell-wise sample sizes resulting from this 8-way split is less than 10 for all but two cells (less than 5 for 3 cells). Suitability of applied statistical tests and generalizability of their claims are questionable here. Authors should also think about 1:2 skew in male:female ratio, which makes this issue worse. Study can greatly benefit from asking specific and limited hypothesized questions.&#x00a0;</p>
                        </list-item>
                        <list-item>
                            <p>
                                <underline>Response:</underline> 
                                <bold>We do appreciate your robustness in identifying the obvious study limitations due to sample-size, however, we are limited to the feasibility, cost of research, patient population, and all of the work accomplished from the original study team stemming from Case Western Reserve University, Massachusetts General Hospital (Harvard University), Stanford University, Yale University, the University of Pittsburgh, Texas Health Science Center at San Antonio, and the University of Pennsylvania that uploaded this data into the Gene Expression Omnibus (GEO) database maintained by the National Institutes of Health. This was a massive undertaking in a multi-site trial. The sample-size limitations are classically used to not have results generalized, however, we ask you realize that this work not necessarily straight-forward to accomplish with in the real-world of medical care in mental health. Nevertheless, your points are well noted. </bold>
                            </p>
                        </list-item>
                        <list-item>
                            <p>
                                <underline>Response:</underline>
                                <bold> The 1:2 male:female skew you are referring to is exactly what is seen in clinical medicine. Females tend to respond more so than males and I clearly stated this in the introduction of the paper. We are working with the data that has been uploaded and have not found any other datasets in GEO. However, please understand that our efforts are indeed, as you clearly pointed in the beginning of this review, that this is a difficult clinical question to answer. Rather than saying we do not have enough samples, we aimed to do &#x2018;something&#x2019; rather than let the dataset sit in GEO while patients are in need and laboratories have the capability and funding to seek follow-up studies. We appreciate your clear expertise and concern. However, we are working to create hypothesis-generating results to be later confirmed, expanded-upon, and validated for sick patients. Therefore, the generalizability of our claims are clearly limited to the dataset we obtained from clinical study of the aforementioned university hospitals. Of the 60 (sixty) patients treated with Lithium, literally only 9 responded in follow-up my expert medical teams and high quality care. Hence the need to find &#x2018;some signal&#x2019; with the data at-hand in the form of expression patterns of lithium treatment responders. Thank you for the statement and again these are well-noted points you stated here.</bold>
                            </p>
                        </list-item>
                    </list> &#x00a0;</p>
                <p> Also, since multiple objectives are stated, methods and results section can describe each objective separately for sake of better clarity.&#x00a0;&#x00a0;</p>
                <p> &#x00a0;&#x00a0; 
                    <list list-type="bullet">
                        <list-item>
                            <p>Machine learning methods are not described. The methods used for learning of model and its evaluation process needs be specified. Example: How was training and test splits performed? How was feature selection performed? How were the hyper-parameters optimized? Whether the reported performance metrics are for training or testing sets? Whether the discovery dataset used for identifying '250 genes' disjoint from validation set? etc. Without these details, it is hard to comment on validity of a predictive study.</p>
                        </list-item>
                        <list-item>
                            <p>
                                <underline>Response:</underline> 
                                <bold>Thank you for these questions and comments. We have updated the methods to better explain the approach used in the study. The new graphical analysis pipeline will help in explaining the approach. We also added the final Decision Tree diagrams to identify male- and female-treatment responders. Thank you for the review and we have made considerable updates to this version of the paper to address these concerns and improve this research manuscript.</bold>
                            </p>
                        </list-item>
                    </list>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report34437">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.16407.r34437</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Ho</surname>
                        <given-names>Ming-Fen</given-names>
                    </name>
                    <xref ref-type="aff" rid="r34437a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r34437a1">
                    <label>1</label>Division of Clinical Pharmacology, Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>27</day>
                <month>6</month>
                <year>2018</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2018 Ho MF</copyright-statement>
                <copyright-year>2018</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport34437" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.14451.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Partly</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report33941">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.15730.r33941</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Ho</surname>
                        <given-names>Ming-Fen</given-names>
                    </name>
                    <xref ref-type="aff" rid="r33941a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r33941a1">
                    <label>1</label>Division of Clinical Pharmacology, Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>21</day>
                <month>5</month>
                <year>2018</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2018 Ho MF</copyright-statement>
                <copyright-year>2018</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport33941" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.14451.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The authors demonstrated that sex-differences gene expression might contribute to lithium treatment response using microarray expression data.</p>
            <p> </p>
            <p> Major comments: 
                <list list-type="order">
                    <list-item>
                        <p>A samples size of 60 might be too small to determine the sex effects. Can the sample size n=60 provide adequate power for data interpretation, especially separated men and women for study sex-effect on gene expression?</p>
                    </list-item>
                    <list-item>
                        <p>The authors stated that their predictive model for lithium responders with an ROC AUC 0.92 for men, and 1 for women.&#x00a0; If the prediction accuracy is so significant, what are the potential biological mechanisms beyond these genes? More discussion regarding the biology of those genes should be included in the paper. Once again, if the prediction accuracy is so significant, it is needed a replication study using different data sets? In summary, the authors claimed the prediction model with very high accuracy; it should be included either functional validation of those genes or a replication study population.</p>
                    </list-item>
                </list> &#x00a0;</p>
            <p> Specific comments: 
                <list list-type="order">
                    <list-item>
                        <p>Methods - study design, it might be better to use a flow chart to demonstrate the study design.</p>
                    </list-item>
                    <list-item>
                        <p>Methods - study design, please clarify the rationale of filtering out &#x201c;250&#x201d; genes.</p>
                    </list-item>
                    <list-item>
                        <p>Table 1 shows total study population n=60, but figure 1 legend shows male: n=41, female: n=39?&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>Figure 2:&#x00a0; please elaborate the data presented in Figure 2. The key results for each of the four panels should be summarized in Results.</p>
                    </list-item>
                    <list-item>
                        <p>Table 2 and Table 4, the log FC threshold of 0.5 or 0.3 might be too low. The changes in gene expression are very subtle in Table 4.</p>
                    </list-item>
                    <list-item>
                        <p>Table 2, are there any gene up-regulated in males? /downregulated in females?</p>
                    </list-item>
                    <list-item>
                        <p>Limitations of the study should be addressed in Discussion.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Partly</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment3661-33941">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Eugene</surname>
                            <given-names>Andy</given-names>
                        </name>
                        <aff>Department of Pediatrics, Robert Wood Johnson Medical Schoo, Rutgers University, USA</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>21</day>
                    <month>5</month>
                    <year>2018</year>
                </pub-date>
            </front-stub>
            <body>
                <p>
                    <bold>Major Comment Responses:</bold>
                </p>
                <p>
                    <bold>Response 1:&#x00a0;</bold>
                </p>
                <p>This point is well noted; however, it is important to realize that our gender-effects of gene expression is consistent with other studies noted within the paper and shown below:</p>
                <p>Jansen, Rick, et al. "Sex differences in the human peripheral blood transcriptome." 
                    <italic>BMC genomics</italic> 15.1 (2014): 33.</p>
                <p>Mayne, Benjamin T., et al. "Large scale gene expression meta-analysis reveals tissue-specific, sex-biased gene expression in humans." 
                    <italic>Frontiers in genetics</italic> 7 (2016): 183.</p>
                <p>Further, our gender-specific results met the Benjamini-Hochberg multiple comparisons criteria adjustment due to multiple comparisons.</p>
                <p>
                    <bold>Comment Response 2:&#x00a0;</bold>
                </p>
                <p>We welcome and thank the reviewer&#x2019;s comments on the biological mechanisms beyond these genes. Clearly, it is well noted and cited in the paper that in clinical practice there is a wide inter-individual variability in the treatment and response to treatments of biplolar disorder. Moreover, these patients were not treated with lithium monotherapy, alone, and therefore further insight into the biological mechanisms were left out due to these patients were treated with an &#x201c;Optimal Therapy&#x201d; that includes a variety of other FDA-approved mood stabilizers.</p>
                <p>In reference to the comment regarding the prediction accuracy, we agree that the study may warrant functional validation in a laboratory; however, it is beyond the scope of our computational psychiatry study and we will leave the functional genomics characterization of the genes to investigators seeking to pursue the findings from our results.</p>
            </body>
        </sub-article>
        <sub-article article-type="response" id="comment3665-33941">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Eugene</surname>
                            <given-names>Andy</given-names>
                        </name>
                        <aff>Department of Pediatrics, Robert Wood Johnson Medical Schoo, Rutgers University, USA</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>21</day>
                    <month>5</month>
                    <year>2018</year>
                </pub-date>
            </front-stub>
            <body>
                <p>
                    <bold>Specific Comment Responses:</bold>
                </p>
                <p> We thank you for your specific comments and have addressed several of the pertinent points in your review. For all differentially expressed results reported throughout tables within the manuscript, we changed the wording from genes up-regulated or down-regulated in males or females to a clearer description statement that of genes-associated with males or females. However, we thought not necessary to include an extra figure, but rather encourage the reader to (1) review the study design section within the methods to better understand the computational approach used in our analysis and (2) read the systematic tabular reporting of the results in the manuscript text as well to understand that study approach.</p>
                <p> </p>
                <p> For the caption in Figure 1, we thank you for the comment and have updated the sample sizes for males and female patients. The updated Figure 1 text reads: Males (n=20; with 40 pre- and post-treatment samples) and Females (n=40; with 80 pre- and post-treatment samples).</p>
                <p> </p>
                <p> The comments regarding: (1) the fold-change of 0.5 and 0.3 being subtle and (2) the study limitations, are already specifically addressed within the original version of the manuscript. Again, it is well established and referenced within the text that small changes in gene expression have already been reported to result in major functional outcomes in human physiology.</p>
                <p> </p>
                <p> We will update the variable importance illustration shown in Figure 2 and that will be added to the updated version of the manuscript.</p>
                <p> </p>
            </body>
        </sub-article>
    </sub-article>
</article>
