<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.73420.2</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Software Tool Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>PDBrt: A free database of complexes with measured drug-target residence time</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 2; peer review: 1 approved, 1 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>&#x0141;ugowska</surname>
                        <given-names>Magdalena</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-0253-1054</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Pacholczyk</surname>
                        <given-names>Marcin</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-9741-2137</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Systems Biology and Engineering, Silesian University of Technology, Akademicka 16, Gliwice, 44-100, Poland</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:marcin.pacholczyk@polsl.pl">marcin.pacholczyk@polsl.pl</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>31</day>
                <month>10</month>
                <year>2022</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>10</volume>
            <elocation-id>Chem Inf Sci-1236</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>16</day>
                    <month>9</month>
                    <year>2022</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 &#x0141;ugowska M and Pacholczyk M</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/10-1236/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> Difficulties in translating the 
                    <italic toggle="yes">in vitro</italic> potency determined by cellular assays into 
                    <italic toggle="yes">in vivo</italic> efficacy in living organisms complicates the design and development of drugs. However,&#x00a0; the residence time of a drug in its molecular target is becoming a key parameter in the design and optimization of new drugs, as recent studies show that residence time can reliably predict drug efficacy 
                    <italic toggle="yes">in vivo.</italic> Experimental approaches to binding kinetics and target ligand complex solutions are currently available, but known bioinformatics databases do not usually report information about the ligand residence time in its molecular target.</p>
                <p>
                    <bold>Methods:</bold> To extend existing databases we developed the Protein Data Bank (PDB) residence time database (PDBrt) which reports drug residence time. The database is implemented as an open access web-based tool. The front end uses Bootstrap with Hypertext Markup Language (HTML), jQuery for the interface and 3Dmol.js to visualize the complexes. The server-side code uses Python web application framework, Django Rest Framework and backend database PostgreSQL.</p>
                <p>
                    <bold>Results:</bold> The PDBrt database is a free, non-commercial repository for 3D protein-ligand complex data, including the measured ligand residence time inside the binding pocket of the specific biological macromolecules as deposited in The Protein Data Bank. The PDBrt database contains information about both the protein and the ligand separately, as well as the protein-ligand complex, binding kinetics, and time of the ligand residence inside the protein binding site.</p>
                <p>
                    <bold>Availability:</bold> 
                    <ext-link ext-link-type="uri" xlink:href="https://pdbrt.polsl.pl">https://pdbrt.polsl.pl</ext-link>
                </p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>protein-ligand binding</kwd>
                <kwd>residence time</kwd>
                <kwd>binding kinetics</kwd>
                <kwd>web services</kwd>
                <kwd>database</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/501100007835">
                    <funding-source>Silesian University of Technology</funding-source>
                    <award-id>02/040/BKM21/1019</award-id>
                </award-group>
                <award-group id="fund-2">
                    <funding-source>Polish National Science Centre</funding-source>
                    <award-id>DEC-2017/01/X/ST6/00636</award-id>
                </award-group>
                <award-group id="fund-3">
                    <funding-source>European Social Fund</funding-source>
                    <award-id>POWR.03.02.00-00-I029</award-id>
                </award-group>
                <funding-statement>This work was supported by the Polish National Science Centre [DEC-2017/01/X/ST6/00636] grant (awarded to MP), co-financed by the European Union through the European Social Fund [POWR.03.02.00-00-I029] and by grant No. 02/040/BKM21/1019 from Silesian University of Technology, Gliwice, Poland (awarded to M&#x0141;). </funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 1</title>
                <p>The changes made include the addition of new references for a more critical approach to the residence time model.</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>Introduction</title>
            <p>Current knowledge allowing for the determination of the effectiveness of small molecules 
                <italic toggle="yes">in vivo</italic> is limited. It is known that the leading reason for drug candidate failure is the lack of efficacy caused by a poor translation of 
                <italic toggle="yes">in vitro</italic> potency assays into 
                <italic toggle="yes">in vivo</italic> activity in humans (
                <xref ref-type="bibr" rid="ref1">Copeland, 2016a</xref>, 
                <xref ref-type="bibr" rid="ref2">2016b</xref>; 
                <xref ref-type="bibr" rid="ref3">Swinney, 2009</xref>). 
                <italic toggle="yes">In vitro</italic> experimentation refers to closed system conditions in which the drug molecule and its target are present at unchanging concentrations throughout the experiment (
                <xref ref-type="bibr" rid="ref4">Tummino &amp; Copeland, 2008</xref>). However, in living organisms, processes run under open, non-equilibrium conditions where the drug is constantly interacting with various molecules during many physiological processes in addition to its native target. To improve prediction of 
                <italic toggle="yes">in vivo</italic> drug efficacy measurements of drug-target complexes, the residence time, defined as the reciprocal of the dissociation rate constant (k
                <sub>off</sub>), should be considered. Drug-target residence time is crucial because pharmacological activity depends on the drug being bound to its molecular target. When the drug dissociates from the binding site, the target molecule is free to continue its pathophysiological function. Within 10 years of the development of the drug-target residence time concept, the parameter has become an extremely important factor in the process of optimizing lead structures in computer-aided drug design (
                <xref ref-type="bibr" rid="ref5">Copeland 
                    <italic toggle="yes">et al</italic>., 2006</xref>; 
                <xref ref-type="bibr" rid="ref1">Copeland, 2016a</xref>, 
                <xref ref-type="bibr" rid="ref2">2016b</xref>). Traditional computational approaches (such as molecular docking) take into account only the equilibrium affinity of the drug for its molecular target (e.g., K
                <sub>i</sub>); however, the concept of residence time also takes into account conformational dynamics of molecules, which can have a significant effect on the binding and dissociation of the drug (
                <xref ref-type="bibr" rid="ref5">Copeland 
                    <italic toggle="yes">et al.,</italic> 2006</xref>; 
                <xref ref-type="bibr" rid="ref4">Tummino &amp; Copeland, 2008</xref>; 
                <xref ref-type="bibr" rid="ref12">Copeland, 2021</xref>). Nevertheless, there is some criticism indicating that using the residence time as the only measure of drug efficacy provides a limited picture of binding and affinity kinetics and is a suboptimal way to guide drug discovery programs (
                <xref ref-type="bibr" rid="ref11">Folmer, 2018</xref>). Existing free and commercial software does not include a residence time model that is able to estimate this quantity, and thus the effects of ligand modification relevant to the design and optimization of drug candidates is not available.</p>
            <p>To enable further studies and the development of useful drug-target residence time models, we created a database of experimentally measured residence times for biomolecular complexes deposited in the 
                <ext-link ext-link-type="uri" xlink:href="https://www.rcsb.org/">Protein Data Bank</ext-link> (PDB). These data represent a link between structural and kinetic information of the complexes which may be helpful for various computational and machine learning studies on drug-like molecules in biological systems. The current version of our database, called PDBrt, contains 59 complexes with experimentally measured residence time including seven protein families, and 56 small molecules. Summary statistics are available in 
                <xref ref-type="fig" rid="f1">Figure 1</xref> and 
                <xref ref-type="table" rid="T1">Table 1</xref>.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>Distribution of protein families stored in PDBrt.</title>
                </caption>
                <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/138658/6c588ff4-8da7-4b54-b3bc-e1de80a9dea0_figure1.gif"/>
            </fig>
            <table-wrap id="T1" orientation="portrait" position="float">
                <label>Table 1. </label>
                <caption>
                    <title>A list of chemical compounds in pairs with a given protein family.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Protein name</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Ligand code</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Dipeptidyl peptidase 4 (DPP4)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">BJM, LF7</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Epidermal growth factor receptor (EGFR)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">FMM</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Enoyl-acyl carrier protein reductase (ENR)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">TCL</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">HIV-1 protease (HIV-1 PR)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">AB1, 1UN, 017</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Heat shock protein 90 (HSP90)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">C4T, 72K, 72Y, 73J, 73Y, 73Z, 9EK, 2EQ, 9R8, H0T, 74E, C4N, C3Z,C4K, B5Q, PU1, P4A, BAW, BA8, 9RZ, 70M, 70O, 70K, GDM, BSM, 2GG, 2GJ, YKI, YKJ, 70Z, C8W, 6GC, 6GW, 6G7, 6DL, 6FF, 6FJ</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Enoyl-acyl carrier protein reductase (InhA)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">TCU, 53K, XT3, XTV, XTW, XT5, XT0, JUS, 1TN, 1US, 2TK</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Muscarinic acetylcholine receptor M3, Lysozyme (M3R)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0HK</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
        </sec>
        <sec id="sec2" sec-type="methods">
            <title>Methods</title>
            <sec id="sec3">
                <title>Implementation</title>
                <p>
                    <bold>
                        <italic toggle="yes">PDBrt database design and structure</italic>
                    </bold>
                </p>
                <p>The PDBrt database has been designed as an interactive web interface where the user can browse and extract information about the ligand residence time in its molecular target. The RESTful application programming interface (API) with the 
                    <ext-link ext-link-type="uri" xlink:href="https://www.django-rest-framework.org/">Django Rest Framework</ext-link> (v2.2.20) and a backend 
                    <ext-link ext-link-type="uri" xlink:href="https://www.postgresql.org/">PostgreSQL</ext-link> (v12) database running on a 
                    <ext-link ext-link-type="uri" xlink:href="https://www.nginx.com/">Nginx</ext-link> (v1.21.3) web server has been developed to represent the output of a query as a user-friendly web page generated in 
                    <ext-link ext-link-type="uri" xlink:href="https://getbootstrap.com/">Bootstrap</ext-link> (v3.3.7) with Hypertext Markup Language (HTML), Cascading Style Sheets (CSS) and 
                    <ext-link ext-link-type="uri" xlink:href="https://jquery.com/">jQuery</ext-link> (v3.5.1) to report the results. Search, query, and data extraction and visualization systems were developed for searching ligand residence time and binding kinetics coefficients. The PDBrt database facilitates access to information about the ligand residence time in its molecular target.</p>
                <p>
                    <bold>
                        <italic toggle="yes">PDBrt database management system</italic>
                    </bold>
                </p>
                <p>The Database Management System (DBMS) allows users and programmers to manipulate the data in a systematic way. The DBMS serves as an interface between the database and end users, ensuring consistent data organization and easy accessibility. The PDBrt database is a type of relational DBMS using Structured Query Language (SQL) as the standard programming language for data manipulation.</p>
                <p>Development of the PDBrt database was a multi-step process consisting of a systematic literature search, abstract and report screening, and article review. Several sequential steps involved in data management ensure that the processed data is accessible, reliable, and current for its users (
                    <xref ref-type="fig" rid="f2">Figure 2</xref>).</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>PDBrt database management steps.</title>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/138658/6c588ff4-8da7-4b54-b3bc-e1de80a9dea0_figure2.gif"/>
                </fig>
                <p>
                    <bold>
                        <italic toggle="yes">Binding kinetics data acquisition and extraction</italic>
                    </bold>
                </p>
                <p>Data acquisition starts with collection of protein-ligand binding kinetics data from available literature by reviewing the primary reference of each 
                    <italic toggle="yes">pdb</italic> file in the Research Collaboratory for Structural Bioinformatics (RCSB) 
                    <ext-link ext-link-type="uri" xlink:href="https://www.rcsb.org/">Protein Data Bank</ext-link> (PDB) to retrieve the experimentally measured ligand-target residence time or dissociation rate (k
                    <sub>off</sub>). The references were downloaded and carefully studied to manually extract the data. Only complexes with known ligand-target residence time or dissociation rate were added into the final dataset. Additionally, major binding kinetics coefficients were collected (if available): inhibition constant (K
                    <sub>i</sub>) and association rate (k
                    <sub>on</sub>). Currently the PDBrt database includes 59 protein-ligand complexes with known ligand-target residence time. Structures will be added on a regular basis as respective data becomes available.</p>
                <p>
                    <bold>
                        <italic toggle="yes">Structural data acquisition</italic>
                    </bold>
                </p>
                <p>Complexes with particular PDB identifiers are downloaded from the RCSB PDB database into the internal PDBrt database core. The protein molecule along with other components such as water molecules and metal ions were saved in the 
                    <italic toggle="yes">pdb</italic> format, while the ligand (drug) in Structure Data Format (
                    <italic toggle="yes">sdf</italic>). Neither the protein nor the ligand was subjected to any structural optimization or modification after being downloaded from the RCSB PDB.</p>
                <p>
                    <bold>
                        <italic toggle="yes">PDBrt data content</italic>
                    </bold>
                </p>
                <p>PDBrt database data contain, in addition to the coordinates and general information required for all deposited structures in the RCSB PDB database, target residence time and other binding kinetics coefficients, structure files mentioned above, basic ligand properties like simplified molecular-input line-entry system (SMILES) or International Chemical Identifier (InChI) string, as well as links to external databases: RCSB PDB, 
                    <ext-link ext-link-type="uri" xlink:href="https://pdbj.org/">PDBj</ext-link>, 
                    <ext-link ext-link-type="uri" xlink:href="https://www.ebi.ac.uk/pdbe/node/1">PDBe</ext-link>, 
                    <ext-link ext-link-type="uri" xlink:href="http://www.ebi.ac.uk/thornton-srv/databases/cgi-bin/pdbsum/GetPage.pl?pdbcode=index.html">PDBsum</ext-link>, and the reference literature in 
                    <ext-link ext-link-type="uri" xlink:href="https://pubmed.ncbi.nlm.nih.gov/">PubMed</ext-link>. The database includes citations to the original sources (publications) that contain information about the experimentally measured residence time or dissociation rate. For each complex, a web-based three-dimensional rendering is provided using the free, openly available object-oriented JavaScript library 
                    <ext-link ext-link-type="uri" xlink:href="https://3dmol.csb.pitt.edu/">3Dmol.js</ext-link>, which is used for visualizing molecular data.</p>
                <p>
                    <bold>
                        <italic toggle="yes">PDBrt database availability and updates</italic>
                    </bold>
                </p>
                <p>PDBrt is available to the community through its web-based interface. Since the PDB database is growing rapidly and drug&#x2013;target residence time is a parameter of great interest for drug design and optimization, the PDBrt will be updated on a regular basis with major versions issued annually. New data can be added by the authors (database administrators) either by uploading an 
                    <italic toggle="yes">xlsx</italic> (MS Excel) file or manually.</p>
                <p>
                    <bold>
                        <italic toggle="yes">PDBrt database architecture</italic>
                    </bold>
                </p>
                <p>PDBrt is a three-tier architecture:
                    <list list-type="order">
                        <list-item>
                            <label>1.</label>
                            <p>Data tier comprises database and data access layer.</p>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>Application tier controls application functionality by performing detailed processing.</p>
                        </list-item>
                        <list-item>
                            <label>3.</label>
                            <p>Presentation tier is accessible for end-users and displays information on the website.</p>
                        </list-item>
                    </list>
                </p>
                <p>Core relational database managed by PostgreSQL server provides information storage for the deposited data. Back end (data access layer) was implemented in 
                    <ext-link ext-link-type="uri" xlink:href="https://www.python.org/">Python</ext-link> (v3.6) and the front end of the database (presentation layer) in HTML/CSS.</p>
                <p>
                    <bold>
                        <italic toggle="yes">PDBrt database model</italic>
                    </bold>
                </p>
                <p>In PDBrt data is presented as a collection of relations - tables. Each column (also called attribute or field) in the table has a distinct name and a specific data type assigned to it. All the information related to a particular type is stored in a row (also called record) of that table. PDBrt database has three main columns (&#x2018;Complex&#x2019;, &#x2018;Protein&#x2019;, &#x2018;Ligand&#x2019;) and 59 records with one-to-one type of relationship. This means that one protein or ligand could only belong to one complex and one complex consists of only one specific protein and ligand molecule (
                    <xref ref-type="fig" rid="f3">Figure 3</xref>).</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>PDBrt database model - table of data relations and types.</title>
                    </caption>
                    <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/138658/6c588ff4-8da7-4b54-b3bc-e1de80a9dea0_figure3.gif"/>
                </fig>
            </sec>
            <sec id="sec4">
                <title>Operation</title>
                <p>PDBrt is available to the community through its web-based interface and is freely available to non-commercial users. The PDBrt database runs on all modern web browsers. See 
                    <italic toggle="yes">Software availability</italic> (
                    <xref ref-type="bibr" rid="ref10">&#x0141;ugowska &amp; Pacholczyk, 2021</xref>) for access to the database and code.</p>
                <p>
                    <bold>
                        <italic toggle="yes">Use case</italic>
                    </bold>
                </p>
                <p>To show the usage of the PDBrt database, the Unified Modelling Language (UML) use case diagram was adopted. 
                    <xref ref-type="fig" rid="f4">Figure 4</xref> shows five use cases of PDBrt as well as three actors: system administrator, end user and the database. The database is an actor for all use cases, system administrator for two and end user for three of these. The database actor is involved in all five use cases because it stores the data and enables operations by which advanced data handling functions are created. In the &#x2018;complex management&#x2019; use case the system administrator can perform basic Create, Read, Update and Delete (CRUD) actions on the &#x2018;Complex&#x2019; table: add, delete, update as well as upload new data as Microsoft Excel (
                    <italic toggle="yes">xlsx</italic>) file format. In the &#x2018;user management&#x2019; use case the system administrator can add, edit, and delete a regular user. In the &#x2018;view&#x2019;, &#x2018;search&#x2019; and &#x2018;download&#x2019; use case a user actor is involved. In the &#x2018;view&#x2019; use case a list of complexes is displayed to the user who can choose a single complex and view its details as well as its 3D visualization. In the &#x2018;search&#x2019; use case the user can filter from the whole database by PDB code, residence time, and protein or ligand name. The &#x2018;download&#x2019; use case allows users to either download the data stored in the database as plain text file or 
                    <italic toggle="yes">pdb/sdf</italic> file formats.</p>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>Figure 4. </label>
                    <caption>
                        <title>A use case diagram for the PDBrt database.</title>
                        <p>Diagram shows a subset of functions available to the regular user and website administrator.</p>
                        <p>&#x2018;Rectangle&#x2019; represents a user, &#x2018;rounded rectangle&#x2019; represents a use case and &#x2018;arrow&#x2019; represents a relationship.</p>
                    </caption>
                    <graphic id="gr4" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/138658/6c588ff4-8da7-4b54-b3bc-e1de80a9dea0_figure4.gif"/>
                </fig>
                <p>Query interface has been implemented for the query of data within PDBrt. 
                    <xref ref-type="fig" rid="f5">Figure 5</xref> shows how the query options are organized. The search engine provides one form field for keyword search and allows retrieval by PDB code, protein name and residence time.</p>
                <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                    <label>Figure 5. </label>
                    <caption>
                        <title>Current query capabilities of the PDBrt diagram.</title>
                        <p>Diagram presents the structure of the PDBrt website. Each symbol (shape or arrow) presents PDBrt web page (single web view), page content, group of related content on a single page, relationship between web pages and group of similar web pages as described in the legend.</p>
                    </caption>
                    <graphic id="gr5" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/138658/6c588ff4-8da7-4b54-b3bc-e1de80a9dea0_figure5.gif"/>
                </fig>
                <p>Two user interfaces provide extensive information for result sets obtained for particular search query. The &#x2018;homepage&#x2019; interface allows access to some general information in tabular format and offers the possibility to download whole sets of data files for result sets consisting of multiple PDBrt entries. The &#x2018;complex detail&#x2019; interface provides information about individual structures as well as cross-links to many external resources for macromolecular structure data.</p>
            </sec>
        </sec>
        <sec id="sec5" sec-type="discussion">
            <title>Discussion</title>
            <p>Drug-target residence time has been shown to play an important role in the prediction of 
                <italic toggle="yes">in vivo</italic> efficacy of the drug. Since the parameter is independent of drug and enzyme concentration, it is important in the drug design process and should be considered at an early stage. The availability of information about drug-target complexes with known (measured) residence times is becoming more and more significant. Several databases containing information about protein &#x2013; ligand complexes are available, for example PDB-bind (
                <xref ref-type="bibr" rid="ref6">Liu 
                    <italic toggle="yes">et al</italic>., 2015</xref>), BindingDB (
                <xref ref-type="bibr" rid="ref7">Gilson 
                    <italic toggle="yes">et al</italic>., 2016</xref>), and Binding MOAD (
                <xref ref-type="bibr" rid="ref8">Smith 
                    <italic toggle="yes">et al</italic>., 2019</xref>). However, these databases (except for BindingDB) do not store detailed information about binding rates, and none of these contain direct information about ligand (drug) residence time in its target macromolecule. The PDBrt database is dedicated to reporting the structure of protein - small molecule complexes, along with their target residence time and additional binding parameters (K
                <sub>i</sub>, k
                <sub>on</sub>, k
                <sub>off</sub>). Currently a total of 59 protein&#x2013;ligand complexes are deposited in the web &#x2013; based PDBrt database and this data will be updated frequently as more data is made available. The information associated with the existing 59 protein&#x2013;ligand complexes is available in 
                <italic toggle="yes">Underlying data</italic> (
                <xref ref-type="bibr" rid="ref9">&#x0141;ugowska, 2021</xref>).</p>
        </sec>
        <sec id="sec6">
            <title>Data availability</title>
            <sec id="sec7">
                <title>Underlying data</title>
                <p>Zenodo: Drug-target residence time data. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.5647983">https://doi.org/10.5281/zenodo.5647983</ext-link> (
                    <xref ref-type="bibr" rid="ref9">&#x0141;ugowska, 2021</xref>).</p>
                <p>This project contains the following underlying data:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2010;</label>
                            <p>residence_time_data.xlsx (information about target residence time and other binding kinetics coefficients, basic ligand properties like simplified molecular-input line-entry system (SMILES) or International Chemical Identifier (InChI) string, as well as the reference literature in PubMed).</p>
                        </list-item>
                        <list-item>
                            <label>&#x2010;</label>
                            <p>structures.zip (the protein molecule along with other components such as water molecules and metal ions in the 
                                <italic toggle="yes">pdb</italic> format, the protein-ligand structure in the 
                                <italic toggle="yes">pdb</italic> format, and the ligand (drug) in both 
                                <italic toggle="yes">pdb</italic> and Structure Data Format (
                                <italic toggle="yes">sdf</italic>)).</p>
                        </list-item>
                    </list>
                </p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            </sec>
        </sec>
        <sec id="sec8">
            <title>Software availability</title>
            <p>Database available from: 
                <ext-link ext-link-type="uri" xlink:href="https://pdbrt.polsl.pl/">https://pdbrt.polsl.pl/</ext-link>
            </p>
            <p>Source code available from: 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/mlugowska/residence_time">https://github.com/mlugowska/residence_time</ext-link>
            </p>
            <p>Archived source code at time of publication: 
                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.5583543">https://doi.org/10.5281/zenodo.5583543</ext-link> (
                <xref ref-type="bibr" rid="ref10">&#x0141;ugowska &amp; Pacholczyk, 2021</xref>)</p>
            <p>License: 
                <ext-link ext-link-type="uri" xlink:href="https://opensource.org/licenses/MIT">MIT</ext-link>
            </p>
        </sec>
    </body>
    <back>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Copeland</surname>
                            <given-names>RA</given-names>
                        </name>
</person-group>:
                    <article-title>Drug-target interaction kinetics: underutilized in drug optimization?</article-title>
                    <source>

                        <italic toggle="yes">Future Med. Chem.</italic>
</source>
                    <year>2016a</year>;<volume>8</volume>(<issue>18</issue>):<fpage>2173</fpage>&#x2013;<lpage>2175</lpage>.
                    <pub-id pub-id-type="pmid">27845591</pub-id>
                    <pub-id pub-id-type="doi">10.4155/fmc-2016-0183</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Copeland</surname>
                            <given-names>RA</given-names>
                        </name>
</person-group>:
                    <article-title>The drug-target residence time model: A 10-year retrospective.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Rev. Drug Discov.</italic>
</source>
                    <year>2016b</year>;<volume>15</volume>(<issue>2</issue>):<fpage>87</fpage>&#x2013;<lpage>95</lpage>.
                    <pub-id pub-id-type="pmid">26678621</pub-id>
                    <pub-id pub-id-type="doi">10.1038/nrd.2015.18</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Copeland</surname>
                            <given-names>RA</given-names>
                        </name>
</person-group>:
                    <article-title>Evolution of the drug-target residence time model.</article-title>
                    <source>

                        <italic toggle="yes">Expert Opin. Drug. Discov.</italic>
</source>
                    <year>2021</year>;<volume>16 </volume>(<issue>12</issue>):<fpage>1441</fpage>&#x2013;<lpage>1451</lpage>.
                    <pub-id pub-id-type="pmid">34210223</pub-id>
                    <pub-id pub-id-type="doi">10.1080/17460441.2021.1948997</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Copeland</surname>
                            <given-names>RA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pompliano</surname>
                            <given-names>DL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Meek</surname>
                            <given-names>TD</given-names>
                        </name>
</person-group>:
                    <article-title>Drug-target residence time and its implications for lead optimization.</article-title>
                    <source>

                        <italic toggle="yes">Nat. Rev. Drug Discov.</italic>
</source>
                    <year>2006</year>;<volume>5</volume>(<issue>2</issue>):<fpage>730</fpage>&#x2013;<lpage>739</lpage>.
                    <pub-id pub-id-type="pmid">16888652</pub-id>
                    <pub-id pub-id-type="doi">10.1038/nrd2082</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Folmer</surname>
                            <given-names>RHA</given-names>
                        </name>
</person-group>:
                    <article-title>Drug target residence time: a misleading concept.</article-title>
                    <source>

                        <italic toggle="yes">Drug. Discov. Today.</italic>
</source>
                    <year>2018</year>;<volume>23 </volume>(<issue>1</issue>):<fpage>12</fpage>&#x2013;<lpage>16</lpage>.
                    <pub-id pub-id-type="pmid">28782685</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.drudis.2017.07.016</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gilson</surname>
                            <given-names>MK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Baitaluk</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>BindingDB in 2015: A public database for medicinal chemistry, computational chemistry and systems pharmacology.</article-title>
                    <source>

                        <italic toggle="yes">Nucleic Acids Res.</italic>
</source>
                    <year>2016</year>;<volume>44</volume>:<fpage>D1045</fpage>&#x2013;<lpage>D1053</lpage>.
                    <pub-id pub-id-type="pmid">26481362</pub-id>
                    <pub-id pub-id-type="doi">10.1093/nar/gkv1072</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Li</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Han</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>PDB-wide collection of binding data: current status of the PDBbind database.</article-title>
                    <source>

                        <italic toggle="yes">Bioinformatics.</italic>
</source>
                    <year>2015</year>;<volume>31</volume>(<issue>3</issue>):<fpage>405</fpage>&#x2013;<lpage>412</lpage>.
                    <pub-id pub-id-type="pmid">25301850</pub-id>
                    <pub-id pub-id-type="doi">10.1093/bioinformatics/btu626</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>&#x0141;ugowska</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Drug-target residence time data [Data set].</article-title>
                    <source>

                        <italic toggle="yes">Zenodo.</italic>
</source>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.5281/zenodo.5647983</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>&#x0141;ugowska</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pacholczyk</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>PDBrt: a free database of complexes with measured drug - target residence time.</article-title>
                    <source>

                        <italic toggle="yes">Zenodo.</italic>
</source>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.5281/zenodo.5583543</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Smith</surname>
                            <given-names>RD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Clark</surname>
                            <given-names>JJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ahmed</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Updates to Binding MOAD (Mother of All Databases): Polypharmacology Tools and Their Utility in Drug Repurposing.</article-title>
                    <source>

                        <italic toggle="yes">J. Mol. Biol.</italic>
</source>
                    <year>2019</year>;<volume>431</volume>:<fpage>2423</fpage>&#x2013;<lpage>2433</lpage>.
                    <pub-id pub-id-type="pmid">31125569</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.jmb.2019.05.024</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Swinney</surname>
                            <given-names>DC</given-names>
                        </name>
</person-group>:
                    <article-title>The role of binding kinetics in therapeutically useful drug action.</article-title>
                    <source>

                        <italic toggle="yes">Curr. Opin. Drug Discov. Devel.</italic>
</source>
                    <year>2009</year>;<volume>12</volume>(<issue>1</issue>):<fpage>31</fpage>&#x2013;<lpage>39</lpage>.
                    <pub-id pub-id-type="pmid">19152211</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tummino</surname>
                            <given-names>PJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Copeland</surname>
                            <given-names>RA</given-names>
                        </name>
</person-group>:
                    <article-title>Residence time of receptor&#x2013;ligand complexes and its effect on biological function.</article-title>
                    <source>

                        <italic toggle="yes">Biochemistry.</italic>
</source>
                    <year>2008</year>;<volume>47</volume>:<fpage>5481</fpage>&#x2013;<lpage>5492</lpage>.
                    <pub-id pub-id-type="pmid">18412369</pub-id>
                    <pub-id pub-id-type="doi">10.1021/bi8002023</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report157889">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.138658.r157889</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Novotny</surname>
                        <given-names>Marian</given-names>
                    </name>
                    <xref ref-type="aff" rid="r157889a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-8788-3202</uri>
                </contrib>
                <aff id="r157889a1">
                    <label>1</label>Department of Cell Biology, Faculty of Science, Charles University, Prague, Czech Republic</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>22</day>
                <month>12</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Novotny M</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport157889" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73420.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The authors present a database that collects important data about protein-drug interactions and presents them on a single place. It is therefore, in my opinion, a useful source of information for many academic as well as industrial scientists -&#x00a0; I therefore see this database as a very good idea.</p>
            <p> </p>
            <p> I tried to use the database and I appreciate the work the authors did since the first submission as I did not have any problems using the database - everything worked seamlessly.</p>
            <p> </p>
            <p> I do however have certain concerns and suggestions to the database and the manuscript.</p>
            <p> </p>
            <p> My main concern is about completeness of the database - I realize that this is a very difficult topic, but also the one that will greatly influence how many people will use the database. I was trying to check how much experimental data is available on drug.target residence time and whether they are often paired with structural data and I discovered this paper from Tonge lab (10.1016/j.cbpa.2018.06.002
                <sup>
                    <xref ref-type="bibr" rid="rep-ref-157889-1">1</xref>
                </sup>
                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016%2Fj.cbpa.2018.06.002">)</ext-link>&#x00a0;that describes mechanisms that modulate residence times and they mention a number of proteins not included in PDBrt (thermolysin, kinases etc) - I am therefore wondering why are these proteins not included in the current version of database.</p>
            <p> </p>
            <p> I would consequently appreciate if the authors briefly describe a pipeline to gather the data for updates in the future - it will be time-consuming job, but worthwhile to keep the database useful in the future.</p>
            <p> </p>
            <p> Primary reference sometimes leads to a review and not to an original paper (Copeland review from 2008
                <sup>
                    <xref ref-type="bibr" rid="rep-ref-157889-2">2</xref>
                </sup>) and it is therefore not simple to get the information about the experimental measurement - i would also suggest to include the information about the method used to measure the kinetics&#x00a0; on the page and make it a parameter that can be used for filtering. I would also appreciate if it was possible to compare different ligand for the protein by e.g. drug residence time - which of the hsp90 protein has the shortest or longest residence time (get an ordered list). I also think that it should be able to describe proteins more specifically than just protein name - Hsp90 appears in many organisms and the identifier shall be unique - something like uniprot id shall work better.</p>
            <p>Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?</p>
            <p>Partly</p>
            <p>Is the rationale for developing the new software tool clearly explained?</p>
            <p>Yes</p>
            <p>Is the description of the software tool technically sound?</p>
            <p>Yes</p>
            <p>Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?</p>
            <p>Partly</p>
            <p>Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>I am structural bioinformatician, but do not have much experience with kinetic measurements</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-157889-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Structure-kinetic relationships that control the residence time of drug-target complexes: insights from molecular structure and dynamics.</article-title>
                        <source>
                            <italic>Curr Opin Chem Biol</italic>
                        </source>.<year>2018</year>;<volume>44</volume>:
                        <elocation-id>10.1016/j.cbpa.2018.06.002</elocation-id>
                        <fpage>101</fpage>-<lpage>109</lpage>
                        <pub-id pub-id-type="pmid">29986213</pub-id>
                        <pub-id pub-id-type="doi">10.1016/j.cbpa.2018.06.002</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-157889-2">
                    <label>2</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Residence time of receptor-ligand complexes and its effect on biological function.</article-title>
                        <source>
                            <italic>Biochemistry</italic>
                        </source>.<year>2008</year>;<volume>47</volume>(<issue>20</issue>) :
                        <elocation-id>10.1021/bi8002023</elocation-id>
                        <fpage>5481</fpage>-<lpage>92</lpage>
                        <pub-id pub-id-type="pmid">18412369</pub-id>
                        <pub-id pub-id-type="doi">10.1021/bi8002023</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report154546">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.138658.r154546</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Nowak</surname>
                        <given-names>Wies&#x0142;aw</given-names>
                    </name>
                    <xref ref-type="aff" rid="r154546a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-2584-1327</uri>
                </contrib>
                <aff id="r154546a1">
                    <label>1</label>Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University, Torun, Poland</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>23</day>
                <month>11</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Nowak W</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport154546" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73420.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>I have read the revised version and tested the database online. In my opinion, the version 2 of the paper should receive "approved" status.</p>
            <p> </p>
            <p> I have no critical comments at this moment. The idea is sound, the presentation is ok, and in my opinion the database may be useful for scientists working on enzymes and drug design.</p>
            <p>Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?</p>
            <p>Yes</p>
            <p>Is the rationale for developing the new software tool clearly explained?</p>
            <p>Yes</p>
            <p>Is the description of the software tool technically sound?</p>
            <p>Partly</p>
            <p>Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?</p>
            <p>Yes</p>
            <p>Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>biophysics, bioinformatics, computer modeling of proteins, single molecule nanomechanics, atomic and molecular physics</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report102208">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.77069.r102208</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Nowak</surname>
                        <given-names>Wies&#x0142;aw</given-names>
                    </name>
                    <xref ref-type="aff" rid="r102208a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-2584-1327</uri>
                </contrib>
                <aff id="r102208a1">
                    <label>1</label>Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University, Torun, Poland</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>20</day>
                <month>1</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Nowak W</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport102208" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73420.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Mankind needs new, effective medicines, and science should provide them.&#x00a0;</p>
            <p> </p>
            <p> For many years expectations with respect to molecular modeling were high: medicinal chemists looked for substantial help from the computer modeling community, and computational chemists provided hundreds of methods, including high-throughput virtual docking, aimed at selecting best drug leads. There are some success stories of such approach (&#x015a;led&#x017a; &amp; Caflish, 2018) but, given the human effort and money, the outcome measured by a number of new effective drugs is, in my opinion, at most "moderate", and some other more critical medical specialist may say "mediocre". The problem of rational, structure based drug design is too complex that it may be solved by, for example, a simple ligand-protein docking. Fortunately, there is a hope in this field. My optimism is based on a recent success of AlphaFold2 computer method that won CASP14 competition in protein folding (Jumper at al, 2021). The Artificial Intelligence (AI) based algorithm outperformed all the best research groups in a series of tasks that seemed to be too complex to be solved in reasonable time: how to predict a true 3D protein structures from the known 1-D sequences. So, one may expect that AI/Machine Learning (ML) based methods will be developed to a similar level of efficacy in drug-design field as well. However, ML needs good quality training data, and for that a ligand residence time seems to be very serious factor in estimation of biological effect of a tested molecule on a metabolic pathway of interest.</p>
            <p> </p>
            <p> The manuscript "PDBrt: A free database of complexes with measured drug-target residence time " by M &#x0141;ugowska and M. Pacholczyk addresses an important drawback in the computational drug design: lack of a database collecting in one place measured drugs&#x2019; residence times. The authors prepared the first version of a database containing some 50 ligand-protein complexes with known kinetic characteristics. This is a highly desirable tool that may contribute to improving rational computational pharmacology.</p>
            <p> </p>
            <p> The idea of creating such database is in my opinion very good and just in time.</p>
            <p> </p>
            <p> Presentation of the software project is correct and contains the majority of required information. The depositories indicated by the authors are active and apparently contain relevant data. The information content of the database may be always better, for example, I would appreciate having in it pictures (just in jpg format) showing structural 2D formulas of the scrutinized ligands. Biological essays to get residence time numerical data are very different, perhaps a separate field with comments on that and adequate error bars extracted from the original papers could also contribute to more critical usage of the data. So, the effort is ranked high, but, for the current version of the manuscript, I have two main objections/postulates: 
                <list list-type="order">
                    <list-item>
                        <p>The web version of the PDBrt did not work for me, neither from Windows, Firefox, nor Ipad Safari. Authors do not precise in the manuscript how actually the user can work with the on-line version of the PDBrt. In the main www page there is no Help or Readme button. I do not know: shall I register to use it or not? From that main page an unexperienced user simply does not know how to get records with the sought ligand residence time for a particular protein (keyword search works only if a perfect match is indicated). One can reasonably expect that the residence time should be presented in some time units (seconds/minutes/hours) or, if it is not the case (depending on a definition adopted), an explanation should be somewhere given (at least in the manuscript).</p>
                    </list-item>
                    <list-item>
                        <p>GitHub depository contains a source code of the database, but again, for me it was not so clear what do I need to install all software locally (what are hardware requirements, under what system?) to make full use of it.</p>
                    </list-item>
                </list> </p>
            <p> A minor point: In the literature there is some criticism against residence time concept, and this should be mentioned in the paper, see for example: (Folmer 2018). R.A. Copeland, the main author of the idea of drug residency time, published recently an interesting review and update of this topic, it should be referenced in the corrected manuscript as well (Copeland 2018).</p>
            <p> </p>
            <p> After adding more instructions to less experienced potential users of the database the manuscript should be promoted to "abstracted" status and certainly will attract some users. Sure enough, the number of records should grow and real users will customize the created software to their local needs.</p>
            <p>Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?</p>
            <p>Yes</p>
            <p>Is the rationale for developing the new software tool clearly explained?</p>
            <p>Yes</p>
            <p>Is the description of the software tool technically sound?</p>
            <p>Partly</p>
            <p>Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?</p>
            <p>Yes</p>
            <p>Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>biophysics, bioinformatics, computer modeling of proteins, single molecule nanomechanics, atomic and molecular physics</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-102208-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Protein structure-based drug design: from docking to molecular dynamics.</article-title>
                        <source>
                            <italic>Curr Opin Struct Biol</italic>
                        </source>.<volume>48</volume>:
                        <elocation-id>10.1016/j.sbi.2017.10.010</elocation-id>
                        <fpage>93</fpage>-<lpage>102</lpage>
                        <pub-id pub-id-type="pmid">29149726</pub-id>
                        <pub-id pub-id-type="doi">10.1016/j.sbi.2017.10.010</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-102208-2">
                    <label>2</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Highly accurate protein structure prediction with AlphaFold.</article-title>
                        <source>
                            <italic>Nature</italic>
                        </source>.<volume>596</volume>(<issue>7873</issue>) :
                        <elocation-id>10.1038/s41586-021-03819-2</elocation-id>
                        <fpage>583</fpage>-<lpage>589</lpage>
                        <pub-id pub-id-type="pmid">34265844</pub-id>
                        <pub-id pub-id-type="doi">10.1038/s41586-021-03819-2</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-102208-3">
                    <label>3</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Drug target residence time: a misleading concept.</article-title>
                        <source>
                            <italic>Drug Discov Today</italic>
                        </source>.<volume>23</volume>(<issue>1</issue>) :
                        <elocation-id>10.1016/j.drudis.2017.07.016</elocation-id>
                        <fpage>12</fpage>-<lpage>16</lpage>
                        <pub-id pub-id-type="pmid">28782685</pub-id>
                        <pub-id pub-id-type="doi">10.1016/j.drudis.2017.07.016</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-102208-4">
                    <label>4</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Evolution of the drug-target residence time model.</article-title>
                        <source>
                            <italic>Expert Opin Drug Discov</italic>
                        </source>.<year>2021</year>;<volume>16</volume>(<issue>12</issue>) :
                        <elocation-id>10.1080/17460441.2021.1948997</elocation-id>
                        <fpage>1441</fpage>-<lpage>1451</lpage>
                        <pub-id pub-id-type="pmid">34210223</pub-id>
                        <pub-id pub-id-type="doi">10.1080/17460441.2021.1948997</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
        <sub-article article-type="response" id="comment8790-102208">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>&#x0141;ugowska</surname>
                            <given-names>Magdalena</given-names>
                        </name>
                        <aff>Silesian University of Technology, Poland</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>15</day>
                    <month>9</month>
                    <year>2022</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Thank you very much for taking the time to review our software tool article. We are happy to address your comments.</p>
                <p> </p>
                <p> 
                    <italic>
                        <bold>The information content of the database may be always better, for example, I would appreciate having in it pictures (just in jpg format) showing structural 2D formulas of the scrutinized ligands. Biological essays to get residence time numerical data are very different, perhaps a separate field with comments on that and adequate error bars extracted from the original papers could also contribute to more critical usage of the data.</bold>
                    </italic>
                </p>
                <p> </p>
                <p> The PDBrt was created for its practical use by users, so every comment on the presentation, as well as the type of data, is extremely important to us. It is possible that in the next update of the database we will introduce the proposed solutions.</p>
                <p> </p>
                <p> 
                    <bold>
                        <italic>The web version of the PDBrt did not work for me, neither from Windows, Firefox, nor Ipad Safari. Authors do not precise in the manuscript how actually the user can work with the on-line version of the PDBrt. In the main www page there is no Help or Readme button. I do not know: shall I register to use it or not?&#x00a0;</italic>
                    </bold>
                </p>
                <p> </p>
                <p> The PDBrt is available for all users through its web-based interface only (
                    <ext-link ext-link-type="uri" xlink:href="https://pdbrt.polsl.pl">https://pdbrt.polsl.pl</ext-link>). The manuscript includes use case descriptions as well as a diagram showing the possibilities offered by the database&#x2019;s interface (Figure 4, 5). Indeed, that can be insufficient and it is right to note the lack of clear information about how the user can work with the on-line version of the PDBrt. &#x201c;Help&#x201d; button was added to the PDBrt interface where the user can find the following information: 
                    <list list-type="bullet">
                        <list-item>
                            <p>&#x201c;Getting started&#x201d; with a general description of the PDBrt.</p>
                        </list-item>
                        <list-item>
                            <p>"How to search?&#x201d; with a description of search options and query results (how the user can obtain desired information about drug-target residence time or other parameters).</p>
                        </list-item>
                        <list-item>
                            <p>&#x201c;Explore PDBrt entry&#x201d; with a description of a single protein-ligand details and how the user can work with it.</p>
                        </list-item>
                    </list> </p>
                <p> 
                    <bold>
                        <italic>From that main page an inexperienced user simply does not know how to get records with the sought ligand residence time for a particular protein (keyword search works only if a perfect match is indicated).&#x00a0;</italic>
                    </bold>
                </p>
                <p> </p>
                <p> To search the database, please enter one of the following in the field: PDB ID, protein or ligand name, residence time. Unfortunately, the current version does not allow advanced search, including combining individual features of the searched complex.</p>
                <p> </p>
                <p> 
                    <italic>
                        <bold>One can reasonably expect that the residence time should be presented in some time units (seconds/minutes/hours) or, if it is not the case (depending on a definition adopted), an explanation should be somewhere given (at least in the manuscript).</bold>
                    </italic>
                </p>
                <p> </p>
                <p> Information about the unit of time in which the residence time is presented has been added to the main table on the homepage. Such information can also be found in the table with detailed information about a single complex on the Structure Detail Page.</p>
                <p> </p>
                <p> 
                    <italic>
                        <bold>GitHub depository contains a source code of the database, but again, for me it was not so clear what do I need to install all software locally (what are hardware requirements, under what system?) to make full use of it.</bold>
                    </italic>
                </p>
                <p> </p>
                <p> The README file was added to the Github repository with basic description how to work with the PDBrt locally.</p>
                <p> </p>
                <p> 
                    <italic>
                        <bold>In the literature there is some criticism against residence time concept, and this should be mentioned in the paper, see for example: (Folmer 2018). R.A. Copeland, the main author of the idea of drug residency time, recently published an interesting review and update of this topic; it should be referenced in the corrected manuscript as well (Copeland 2018).</bold>
                    </italic>
                </p>
                <p> </p>
                <p> Thank you for bringing these 2 references to our attention. These have, of course, been included in the revised manuscript.</p>
            </body>
        </sub-article>
    </sub-article>
</article>
