<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.5753.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Software Tool Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                    <subj-group>
                        <subject>Bioinformatics</subject>
                    </subj-group>
                    <subj-group>
                        <subject>Genomics</subject>
                    </subj-group>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Selecting relevant nodes and structures in biological networks. BiNAT: a new plugin for Cytoscape</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved, 1 approved with reservations, 1 not approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Cumbo</surname>
                        <given-names>Fabio</given-names>
                    </name>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Felici</surname>
                        <given-names>Giovanni</given-names>
                    </name>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Bertolazzi</surname>
                        <given-names>Paola</given-names>
                    </name>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Institute for Systems Analysis and Computer Science &#x201d;Antonio Ruberti&#x201d;, Italian National Research Council - CNR, Rome, 00185, Italy</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:fabio.cumbo@hotmail.it">fabio.cumbo@hotmail.it</email>
                </corresp>
                <fn fn-type="con">
                    <p>PB conceived research. FC developed software. FC, PB and GF analyzed data and results. All authors wrote the paper.</p>
                </fn>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>21</day>
                <month>11</month>
                <year>2014</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2014</year>
            </pub-date>
            <volume>3</volume>
            <elocation-id>287</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>21</day>
                    <month>11</month>
                    <year>2014</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Cumbo F et al.</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/3-287/pdf"/>
            <abstract>
                <sec>
                    <label/>
                    <p>
                        <bold>Summary:</bold> In order to understand a network function, it&#x2019;s necessary the understanding of its topology, since the topology is designed to better undertake the function, and the efficiency of network function is influenced by its topology. For this reason, topological analysis of complex networks has been an intensely researched area in the last decade.</p>
                    <p>
                        <bold>Results:</bold> Here we propose BiNAT, a Cytoscape
                        <sup>
                            <xref ref-type="bibr" rid="ref-1">1</xref>
                        </sup> plugin able to perform network analysis, providing a full set of useful tools to discover the most significant nodes and structures in a network.</p>
                    <p>
                        <bold>Conclusions:</bold> The plugin has been approved on the official Cytoscape plugins repository and it is downloadable directly from this site: 
                        <ext-link ext-link-type="uri" xlink:href="http://dmb.iasi.cnr.it/binat.php">http://dmb.iasi.cnr.it/binat.php</ext-link> where a full guide is also available.</p>
                </sec>
                <sec>
                    <label/>
                    <p>
                        <bold>Availability and Requirements</bold>
                    </p>
                    <p>
                        <bold>Project name:</bold> BiNAT: Biological Network Analysis Tool</p>
                    <p>
                        <bold>Project home page:</bold> 
                        <ext-link ext-link-type="uri" xlink:href="http://dmb.iasi.cnr.it/binat.php">http://dmb.iasi.cnr.it/binat.php</ext-link>
                    </p>
                    <p>
                        <bold>Operating system(s):</bold> Platform independent</p>
                    <p>
                        <bold>Programming language:</bold> Java</p>
                    <p>
                        <bold>Other requirements:</bold> Java Runtime Environment 1.7 or higher</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>graph theory; biological networks; network analysis; cytoscape plugin</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>FC thanks the National Research Council of Italy (CNR) for the financial support.</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec>
            <title>Background</title>
            <p>In this section we briefly introduce the fundamental concepts that are needed to understand the principles of the software described in this article. We introduce the main theoretical concepts used to describe and analyze networks, most of which come from graph theory that is a large field containing many results and we describe only a small fraction of those here, focusing on the ones that are relevant to the study of real-world networks.</p>
            <sec>
                <title>Graphs and their representation</title>
                <p>To represent a graph there are many different ways in literature. A graph is usually represented as an 
                    <italic toggle="yes">adjacency matrix</italic>. The adjacency matrix 
                    <italic toggle="yes">A</italic> of a simple graph is the matrix with elements 
                    <italic toggle="yes">a
                        <sub>ij</sub>
                    </italic>, where 
                    <italic toggle="yes">a
                        <sub>ij</sub>
                    </italic> = 1 
                    <italic toggle="yes">if an edge between vertices i and j is present</italic>, and 0 otherwise. We note that a) for a graph with no self-edges the elements in the matrix diagonal are all zero, b) the adjacency matrix is symmetric (if there is an edge between 
                    <italic toggle="yes">i</italic> and 
                    <italic toggle="yes">j</italic> then there is an edge between 
                    <italic toggle="yes">j</italic> and 
                    <italic toggle="yes">i</italic>). In some situations it is useful to associate a weight to the edges; such 
                    <italic toggle="yes">weighted</italic> (or 
                    <italic toggle="yes">valued</italic>) 
                    <italic toggle="yes">graphs</italic> can be represented by giving the elements values of the adjacency matrix equal to the weights of the corresponding connections.</p>
            </sec>
            <sec>
                <title>Centrality definition</title>
                <p>Network centrality measures allow categorizing nodes for their relevance in the network structure. The literature on biological networks are typically interested in the global properties of the network; in the case of centrality it is often considered from a global point of view, as for example analyzing degree or centralities distribution
                    <sup>
                        <xref ref-type="bibr" rid="ref-2">2</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref-6">6</xref>
                    </sup>. In BiNAT were implemented the most used network centrality measures i.e. Degree, Betweenness, Eccentricity, Closeness and Stress centrality.</p>
            </sec>
        </sec>
        <sec>
            <title>Software overview</title>
            <p>The increasing availability of large network datasets, along with the progress in experimental high-throughput technologies, have promoted the need for tools that allow an easy integration of experimental data with data derived from network computational analysis. In order to enrich experimental data with network topological parameters, it has been developed the Cytoscape plugin BiNAT (Biological Network Analysis Tool).</p>
            <p>The plugin computes several network centrality parameters, and allows the user to analyze these computational results in textual and graphical format. BiNAT identifies the nodes that are relevant from the experimental and the topological viewpoint. BiNAT is one of the few Cytoscape plugins that computes several centrality indices at once. In BiNAT the centrality measures can be easily correlated with each other, in order to identify the most significant nodes according to topological properties. Functional to this capability is the scatter plot options, which allows an easy correlation of node centralities.</p>
            <p>Equally to other Cytoscape plugins, BiNAT (and its dependencies) must reside in the 
                <italic toggle="yes">plugin</italic> directory in the Cytoscape root folder. BiNAT needs to be executed with administrative privileges to working proper. After first running, BiNAT creates three folders (
                <italic toggle="yes">binatData</italic>, 
                <italic toggle="yes">binatLog</italic> and 
                <italic toggle="yes">binatTemp</italic>) in the Cytoscape root directory:</p>
            <list list-type="bullet">
                <list-item>
                    <p>in 
                        <italic toggle="yes">binatLog</italic> folder application log files reside in two formats (.html and .txt), both useful to monitor the proper running of all software operations.</p>
                </list-item>
                <list-item>
                    <p>in 
                        <italic toggle="yes">binatData</italic> folder generated application data reside such as: a) 
                        <italic toggle="yes">stats.xlsx</italic> file that contains network information (centrality measures for every nodes, network diameter, network density, node average degree, network maximal clique degree, etc). b) 
                        <italic toggle="yes">complexesIntersectionMatrix.xlsx</italic> file that represents the complexes adjacency matrix computed according to the number of shared nodes between complexes. c) 
                        <italic toggle="yes">complexesShortestPathsMatrix.xlsx</italic> file that represents the complexes adjacency matrix computed according to the shortest path among all shortest paths between two nodes that are members of the same complex. d) 
                        <italic toggle="yes">shortestPaths.txt</italic> file that contains all pairs shortest paths in the network, useful to accelerate many other plugin features.</p>
                </list-item>
                <list-item>
                    <p>in 
                        <italic toggle="yes">binatTemp</italic> some plugin temporary files reside such as: a) 
                        <italic toggle="yes">sp_</italic>*
                        <italic toggle="yes">.txt</italic> files that contain all pairs shortest paths in the network. The maximal size of every 
                        <italic toggle="yes">sp_</italic>*
                        <italic toggle="yes">.txt</italic> file is 50MB and their creation may take a long time depending on the network size. b) 
                        <italic toggle="yes">toResume.txt</italic> file that contains two indexes necessary to resume the process of calculating shortest paths if it has been stopped.</p>
                </list-item>
            </list>
        </sec>
        <sec>
            <title>Implementation</title>
            <p>The idea behind the developed interface consists of a clear separation from the visualization of results and the Java classes that contain the processing logic. The structure is comparable to the MVC (Model - View - Controller) design pattern that is based on the separation of roles between the software components that interpret three major roles:</p>
            <list list-type="bullet">
                <list-item>
                    <p>
                        <bold>Model:</bold> application data and rules.</p>
                </list-item>
                <list-item>
                    <p>
                        <bold>View:</bold> it can be any output representation of data, such as a chart or a diagram.</p>
                </list-item>
                <list-item>
                    <p>
                        <bold>Controller:</bold> it mediates input, converting it to commands for the model or view.</p>
                </list-item>
            </list>
            <p>The 
                <italic toggle="yes">Controller</italic> is the key class that guides the input information flow (commands and parameters) towards the right actions to be performed.</p>
        </sec>
        <sec>
            <title>Implemented algorithms</title>
            <p>In this section the algorithms implemented in BiNAT are introduced through a pseudocode and a comprehensive description for each algorithms. The following algorithms have been implemented: Dijkstra algorithm, Betweenness centrality, Closeness centrality, Degree centrality, Eccentricity centrality, Stress centrality and Clique Finder (Bron-Kerbosch) algorithm.</p>
            <sec>
                <title>Dijkstra algorithm</title>
                <p>Dijkstra&#x2019;s algorithm
                    <sup>
                        <xref ref-type="bibr" rid="ref-7">7</xref>
                    </sup> solves the single-source shortest path problem when all edges have non-negative weights. It is a greedy algorithm, similar to Prim&#x2019;s algorithm, but the two solve different types of problems and the properties are computed in different ways. Algorithm starts at the source vertex 
                    <italic toggle="yes">s</italic> and grows a tree 
                    <italic toggle="yes">T</italic> that ultimately spans all vertices reachable from 
                    <italic toggle="yes">s</italic>. Vertices are added to 
                    <italic toggle="yes">T</italic> in order of distance i.e., first 
                    <italic toggle="yes">s</italic>, then the vertex closest to 
                    <italic toggle="yes">s</italic>, then the next closest, and so on. The following implementation (see 
                    <xref ref-type="other" rid="l1">Listing 1</xref>) assumes that the graph 
                    <italic toggle="yes">G</italic> is represented by adjacency lists. As already mentioned, all centrality measures available in BiNAT, excluded the Degree centrality, depend on the Dijkstra&#x2019;s shortest path algorithm.</p>
                <p id="l1">
                    <bold>
                        <styled-content style="#CA6538" style-type="color">Listing 1.</styled-content> Pseudocode of the Dijkstra&#x2019;s shortest path algorithm.</bold>
                </p>
                <p>
                    <preformat orientation="portrait" position="float" preformat-type="computer code" xml:space="preserve">
                        <styled-content style="color:#BF0040;">dijkstra</styled-content> (G, w, s)
1. 
                        <styled-content style="color:#BF0040;">initialize_single_source</styled-content> (G, s)
2. S &lt;- { } 
                        <styled-content style="color:#009900;">// S will ultimately contains
&#x00a0;&#x00a0;&#x00a0;&#x00a0;vertices of final shortest-path weights
&#x00a0;&#x00a0;&#x00a0;&#x00a0;from s</styled-content>
3. 
                        <styled-content style="color:#BF0040;">initialize_property_queue</styled-content> Q
4. Q &lt;-V[G]
5. 
                        <styled-content style="color:#0000FF">while</styled-content> Q is not empty 
                        <styled-content style="color:#0000FF">do</styled-content>
6. &#x00a0;&#x00a0;u &lt;- 
                        <styled-content style="color:#BF0040;">extract_min</styled-content>(Q) 
                        <styled-content style="color:#009900;">// pull out new</styled-content>
&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                        <styled-content style="color:#009900;">vertex</styled-content>
7. &#x00a0;&#x00a0;s &lt;- S E&#x2019; {u} 
                        <styled-content style="color:#009900;">// perform relaxation for
&#x00a0;&#x00a0;&#x00a0;&#x00a0;each vertex v adjacent to u</styled-content>
8. &#x00a0;&#x00a0;
                        <styled-content style="color:#0000FF">foreach</styled-content> v 
                        <styled-content style="color:#0000FF">in</styled-content> Adj[u] 
                        <styled-content style="color:#0000FF">do</styled-content>
9. &#x00a0;&#x00a0;&#x00a0;&#x00a0;
                        <styled-content style="color:#BF0040;">relax</styled-content>(u, v, w)</preformat>
                </p>
            </sec>
            <sec>
                <title>Clique Finder (Bron-Kerbosch) algorithm</title>
                <p>The Clique Finder algorithm that we use was developed by Bron &amp; Kerbosch (1973)
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup>. This algorithm combines a recursive backtracking procedure with a branch and bound technique to eliminate searches that cannot lead to a clique. The recursive procedure is self-referential: finding a clique of length 
                    <italic toggle="yes">n</italic> is accomplished by finding a clique of length 
                    <italic toggle="yes">n-1</italic> and another node that is connected to all the nodes in that clique. The branch and bound technique makes use of rules that allow us to determine in advance certain cases for which possible combinations of nodes and edges will never lead to a clique. There are three sets that are essential for this algorithm:</p>
                <list list-type="bullet">
                    <list-item>
                        <p>&#x201c;
                            <italic toggle="yes">potential-clique</italic>&#x201d;
                            <italic toggle="yes">:</italic> this is a set of nodes where every node is connected to every other node. Each recursive call will either extend this set by one node or reduce it by one node.</p>
                    </list-item>
                    <list-item>
                        <p>&#x201c;
                            <italic toggle="yes">candidates</italic>&#x201d;
                            <italic toggle="yes">:</italic> this is the set of nodes that are eligible for addition to the &#x201c;
                            <italic toggle="yes">potential-clique</italic>&#x201d; set.</p>
                    </list-item>
                    <list-item>
                        <p>&#x201c;
                            <italic toggle="yes">already-found</italic>&#x201d;
                            <italic toggle="yes">:</italic> this is the set of nodes that have already served as an extension to the present configuration of &#x201c;
                            <italic toggle="yes">potential-clique</italic>&#x201d; and are now explicitly excluded. That is, all possible extensions of &#x201c;
                            <italic toggle="yes">potential-clique</italic>&#x201d; containing any point in this set have already been generated.</p>
                    </list-item>
                </list>
                <p>The algorithm operates recursively on each of the sets by generating all extensions of a given configuration of &#x201c;
                    <italic toggle="yes">potential-clique</italic>&#x201d; that use given set of &#x201c;
                    <italic toggle="yes">candidates</italic>&#x201d; and that do not contain any of the nodes in &#x201c;
                    <italic toggle="yes">already-found</italic>&#x201d;, as described in the simplified pseudocode represented in 
                    <xref ref-type="other" rid="l2">Listing 2</xref>. Initially, the set &#x201c;
                    <italic toggle="yes">candidates</italic>&#x201d; contains all the nodes in the graph and the set of &#x201c;
                    <italic toggle="yes">potential-clique</italic>&#x201d; and &#x201c;
                    <italic toggle="yes">already-found</italic>&#x201d; are empty. Bron &amp; Kerbosch adopt a clever strategy to select the nodes: to choose nodes with the largest number of edges, in order to reach the branch and bound condition as soon as possible. This leads to the larger cliques being found first and sequentially generates cliques having a large common intersection. More details of this algorithm, including a more detailed pseudocode, implementation are given by
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup>.</p>
                <p id="l2">
                    <bold>
                        <styled-content style="#CA6538" style-type="color">Listing 2.</styled-content> Pseudocode of the Bron-Kerbosch algorithm.</bold>
                </p>
                <p>
                    <preformat orientation="portrait" position="float" preformat-type="computer code" xml:space="preserve">
                        <styled-content style="color:#BF0040;">bron_kerbosch_clique_finder</styled-content> (potential-clique,
&#x00a0;&#x00a0;&#x00a0;&#x00a0;candidate, already-found)
1. 
                        <styled-content style="color:#0000FF;">if</styled-content> a node 
                        <styled-content style="color:#0000FF;">in</styled-content> already-found is connected to
&#x00a0;&#x00a0;&#x00a0;&#x00a0;all nodes 
                        <styled-content style="color:#0000FF;">in</styled-content> candidates 
                        <styled-content style="color:#0000FF;">then</styled-content>
2. &#x00a0;&#x00a0;no clique can ever be found (branch and
&#x00a0;&#x00a0;&#x00a0;&#x00a0;bound step)
3. 
                        <styled-content style="color:#0000FF;">else</styled-content>
4. &#x00a0;&#x00a0;
                        <styled-content style="color:#0000FF;">foreach</styled-content> candidate-node 
                        <styled-content style="color:#0000FF;">in</styled-content> candidates 
                        <styled-content style="color:#0000FF;">do</styled-content>
5. &#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;move candidate-node to
&#x00a0;&#x00a0;&#x00a0;&#x00a0;potential-clique
6. &#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;create new-candidates by removing
&#x00a0;&#x00a0;&#x00a0;&#x00a0;nodes 
                        <styled-content style="color:#0000FF;">in</styled-content> candidates not connected to
&#x00a0;&#x00a0;&#x00a0;&#x00a0;candidate-node
7. &#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;create new-already-found by removing
&#x00a0;&#x00a0;&#x00a0;&#x00a0;nodes 
                        <styled-content style="color:#0000FF;">in</styled-content> already-found not connected to
&#x00a0;&#x00a0;&#x00a0;&#x00a0;candidate-node
8. &#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                        <styled-content style="color:#0000FF;">if</styled-content> new-candidate and
&#x00a0;&#x00a0;&#x00a0;&#x00a0;new-already-found are empty
9. &#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;potential-clique is a maximal-clique
10. &#x00a0;&#x00a0;&#x00a0;&#x00a0;
                        <styled-content style="color:#0000FF;">else</styled-content>
11. &#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;&#x00a0;
                        <styled-content style="color:#BF0040;">bron_kerbosch_clique_finder</styled-content>
&#x00a0;&#x00a0;&#x00a0;&#x00a0;(potential-clique, new-candidates,
&#x00a0;&#x00a0;&#x00a0;&#x00a0;new-already-found)
12. &#x00a0;&#x00a0;&#x00a0;&#x00a0;
                        <styled-content style="color:#0000FF;">endif</styled-content>
13. &#x00a0;&#x00a0;&#x00a0;&#x00a0;move candidate-node from
&#x00a0;&#x00a0;&#x00a0;&#x00a0;potential-clique to already-found
14. &#x00a0;
                        <styled-content style="color:#0000FF;">endfor</styled-content>
15. 
                        <styled-content style="color:#0000FF;">endif</styled-content>
                    </preformat>
                </p>
            </sec>
        </sec>
        <sec>
            <title>Supported features</title>
            <p>One of the most important commands in BiNAT is the one for the creation of the principal output file (in MS Excel or CSV format), in which all network nodes with all their own centrality measures defined before are listed: the 
                <bold>ranking</bold> measure has been introduced to find a correlation between centrality measures that are in conflict with each other; it is a value ranging from 0 to 10, where highest value are received by nodes that are candidates to be considered hubs. This file creation step passes through almost all stages of operational calculus which constitute the heart of the software. The first step consists is the input of a network. The network must be in TXT format according to the TAB2 standard. The format supported until now is that adopted by BioGRID. To compute all nodes and network centrality measures, it is needed to type the &#x201c;makestatistics&#x201d; command in the plugin text field (please see the software manual on the official site for more information about available commands). BiNAT will then performs the following steps:</p>
            <list list-type="bullet">
                <list-item>
                    <p>First of all BiNAT computes all pairs shortest paths in the network using Dijkstra algorithm
                        <sup>
                            <xref ref-type="bibr" rid="ref-7">7</xref>
                        </sup> (it is needed to compute almost all centrality measures);</p>
                </list-item>
                <list-item>
                    <p>Once obtained all shortest paths, BiNAT computes all supported centrality measures for each node in the network.</p>
                </list-item>
                <list-item>
                    <p>Then BiNAT assigns a ranking value to each node; such ranking is obtained calculated as the arithmetic average value of all centrality measure for each node. Once completed, all centrality measures for all nodes in the network, BiNAT computes other global measures such as the network density, the network diamenter, the maximal clique degree and much more.</p>
                </list-item>
            </list>
            <p>Data is ready to be returned in output now. BiNAT creates the output file in the folder specified at the beginning of the operation. To create XLSX files, BiNAT uses the Apache POI libraries: Java API for Microsoft Documents. The aim of the Java POI is to manipulate various file format based upon the Office Open XML standards (OOXML) and Microsoft&#x2019;s OLE 2 Compound Document format (OLE2). In short, the programmer is able to read and write MS Excel, MS Word and MS PowerPoint files using Java.</p>
            <p>For a list of all supported command line options, please take a look at the User Manual on the plugin official site. BiNAT also provides a 
                <italic toggle="yes">server mode</italic> that allows the user to fully remotely control the plugin. When the 
                <italic toggle="yes">server mode</italic> is enabled, user can send commands remotely using 
                <italic toggle="yes">BiNAT client</italic> available as desktop and mobile application (for Android devices only).</p>
        </sec>
        <sec>
            <title>BiNAT at work</title>
            <p>We tested BiNAT on 
                <italic toggle="yes">Saccharomyces Cerevisiae</italic> (
                <xref ref-type="fig" rid="f1">Figure 1</xref>) protein-protein interaction network. PPI network was extracted from BioGRID database and consist of 6,096 nodes and 214,235 interactions.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>
                        <italic toggle="yes">S. Cerevisiae</italic> represented in Cytoscape with biological layout.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/6152/0baaf497-a5a5-4325-87ef-e2bf59336ccd_figure1.gif"/>
            </fig>
            <p>It was analyzed with information about yeast complexes provided by the Wodak Lab (Molecular Structure &amp; Function program, Hospital for Sick Children, Toronto, ON, Canada). We first used BiNAT to compute all the centrality measures. A first overview of the global topological properties comes from the values of all centralities along with the diameter and the nodes average degree (
                <xref ref-type="fig" rid="f2">Figure 2</xref>).</p>
            <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                <label>Figure 2. </label>
                <caption>
                    <title>Overview of the global topological properties for 
                        <italic toggle="yes">S. Cerevisiae</italic> PPI network.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/6152/0baaf497-a5a5-4325-87ef-e2bf59336ccd_figure2.gif"/>
            </fig>
            <p>With this data and with the help of a graphical layout, we can deduce a highly connected network. The computation of network centrality measures allow us a first ranking of this network. Further analysis bases on a Gene Ontology database search, or by adding functional annotation data, may allow a deeper functional exploration of the network. The combination of BiNAT with other bioinformatics tools, such as 
                <italic toggle="yes">CentiScaPe</italic> or 
                <italic toggle="yes">Network Analyzer</italic> or 
                <italic toggle="yes">MCODE</italic>, may help to analyze high-throughput genomic and or proteomic experimental data and facilitate the analysis process. It&#x2019;s recommended to see the plugin User Manual for a step-by-step guide on how to use BiNAT and all its features.</p>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusions</title>
            <p>The Cytoscape plugin BiNAT was designed to provide the user a powerful tool for an accurate analysis of networks centrality. The plugin interface is simple as a shell; a practical user manual can be downloaded from the official web site 
                <ext-link ext-link-type="uri" xlink:href="http://dmb.iasi.cnr.it/binat.php">http://dmb.iasi.cnr.it/binat.php</ext-link>.</p>
            <p>BiNAT plugin has been accepted by the Cytoscape community and is actually available for the download on the official plugins repository for the 2.8.3 version of Cytoscape.</p>
        </sec>
        <sec>
            <title>Software availability</title>
            <sec>
                <title>Software Access</title>
                <p>Software available from Cytoscape Plugins repository: 
                    <ext-link ext-link-type="uri" xlink:href="http://chianti.ucsd.edu/cyto_web/plugins/">http://chianti.ucsd.edu/cyto_web/plugins/</ext-link> and search for 
                    <italic toggle="yes">binat</italic>
                </p>
            </sec>
            <sec>
                <title>Latest source code</title>
                <p>
                    <ext-link ext-link-type="uri" xlink:href="http://dmb.iasi.cnr.it/binat.php">http://dmb.iasi.cnr.it/binat.php</ext-link>
                </p>
            </sec>
            <sec>
                <title>Archived source code as at the time of publication</title>
                <p>
                    <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5072/zenodo.12771">http://dx.doi.org/10.5072/zenodo.12771</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-9">9</xref>
                    </sup>
                </p>
            </sec>
            <sec>
                <title>License</title>
                <p>GNU General Public License v2.0</p>
            </sec>
        </sec>
    </body>
    <back>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Shannon</surname>
                            <given-names>P</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Markiel</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Ozier</surname>
                            <given-names>O</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Cytoscape: a software environment for integrated models of biomolecular interaction networks.</article-title>
                    <source>
						
                        <italic toggle="yes">Genome Res.</italic>
					</source>
                    <year>2003</year>;<volume>13</volume>(<issue>11</issue>):<fpage>2498</fpage>&#x2013;<lpage>2504</lpage>.
                    <pub-id pub-id-type="pmid">14597658</pub-id>
                    <pub-id pub-id-type="doi">10.1101/gr.1239303</pub-id>
                    <pub-id pub-id-type="pmcid">403769</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Jeong</surname>
                            <given-names>H</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Tombor</surname>
                            <given-names>B</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Albert</surname>
                            <given-names>R</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>The large-scale organization of metabolic networks.</article-title>
                    <source>
						
                        <italic toggle="yes">Nature.</italic>
					</source>
                    <year>2000</year>;<volume>407</volume>(<issue>6804</issue>):<fpage>651</fpage>&#x2013;<lpage>654</lpage>.
                    <pub-id pub-id-type="pmid">11034217</pub-id>
                    <pub-id pub-id-type="doi">10.1038/35036627</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Joy</surname>
                            <given-names>MP</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Brock</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Ingber</surname>
                            <given-names>DE</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>High-betweenness proteins in the yeast protein interaction network.</article-title>
                    <source>
						
                        <italic toggle="yes">J Biomed Biotechnol.</italic>
					</source>
                    <year>2005</year>;<volume>2005</volume>(<issue>2</issue>):<fpage>96</fpage>&#x2013;<lpage>103</lpage>.
                    <pub-id pub-id-type="pmid">16046814</pub-id>
                    <pub-id pub-id-type="doi">10.1155/JBB.2005.96</pub-id>
                    <pub-id pub-id-type="pmcid">1184047</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Wagner</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Fell</surname>
                            <given-names>DA</given-names>
                        </name>
					</person-group>:
                    <article-title>The small world inside large metabolic networks.</article-title>
                    <source>
						
                        <italic toggle="yes">Proc Biol Sci.</italic>
					</source>
                    <year>2001</year>;<volume>268</volume>(<issue>1478</issue>):<fpage>1803</fpage>&#x2013;<lpage>1810</lpage>.
                    <pub-id pub-id-type="pmid">11522199</pub-id>
                    <pub-id pub-id-type="doi">10.1098/rspb.2001.1711</pub-id>
                    <pub-id pub-id-type="pmcid">1088812</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Wuchty</surname>
                            <given-names>S</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Stadler</surname>
                            <given-names>PF</given-names>
                        </name>
					</person-group>:
                    <article-title>Centers of complex networks.</article-title>
                    <source>
						
                        <italic toggle="yes">J Theor Biol</italic>
					</source>
                    <year>2003</year>;<volume>223</volume>(<issue>1</issue>):<fpage>45</fpage>&#x2013;<lpage>53</lpage>.
                    <pub-id pub-id-type="pmid">12782116</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S0022-5193(03)00071-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Yamada</surname>
                            <given-names>T</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Bork</surname>
                            <given-names>P</given-names>
                        </name>
					</person-group>:
                    <article-title>Evolution of biomolecular networks: lessons from metabolic and protein interactions.</article-title>
                    <source>
						
                        <italic toggle="yes">Nat Rev Mol Cell Biol.</italic>
					</source>
                    <year>2009</year>;<volume>10</volume>(<issue>11</issue>):<fpage>791</fpage>&#x2013;<lpage>803</lpage>.
                    <pub-id pub-id-type="pmid">19851337</pub-id>
                    <pub-id pub-id-type="doi">10.1038/nrm2787</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Dijkstra</surname>
                            <given-names>EW</given-names>
                        </name>
					</person-group>:
                    <article-title>A note on two problems in connexion with graphs.</article-title>
                    <source>
						
                        <italic toggle="yes">Numerische Mathematik.</italic>
					</source>
                    <year>1959</year>;<volume>1</volume>(<issue>1</issue>):<fpage>269</fpage>&#x2013;<lpage>271</lpage>.
                    <pub-id pub-id-type="doi">10.1007/BF01386390</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Bron</surname>
                            <given-names>C</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Kerbosch</surname>
                            <given-names>J</given-names>
                        </name>
					</person-group>:
                    <article-title>Algorithm 457: finding all cliques of an undirected graph.</article-title>
                    <source>
						
                        <italic toggle="yes">Commun ACM.</italic>
					</source>
                    <year>1973</year>;<volume>16</volume>(<issue>9</issue>):<fpage>575</fpage>&#x2013;<lpage>577</lpage>.
                    <pub-id pub-id-type="doi">10.1145/362342.362367</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="data">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Cumbo</surname>
                            <given-names>F</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Felici</surname>
                            <given-names>G</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Bertolazzi</surname>
                            <given-names>P</given-names>
                        </name>
					</person-group>:
                    <article-title>BiNAT: new plugin for Cytoscape.</article-title>
                    <source>
						
                        <italic toggle="yes">Zenodo.</italic>
					</source>
                    <year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5072/zenodo.12771">Data Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report7588">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.6152.r7588</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Anantharaman</surname>
                        <given-names>Vivek</given-names>
                    </name>
                    <xref ref-type="aff" rid="r7588a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r7588a1">
                    <label>1</label>National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health, Bethesda, MD, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>18</day>
                <month>2</month>
                <year>2015</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2015 Anantharaman V</copyright-statement>
                <copyright-year>2015</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport7588" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.5753.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>reject</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>I reviewed this plugin as an end-user and as a biologist. I have created and analyzed many networks using Cytoscape. I installed the BiNat plugin, but unfortunately was not able to test its functionality because of a flaw I encountered in the initial step. I was unable to load my networks on to the plugin.
                <list list-type="order">
                    <list-item>
                        <p>The author gives two formats that are compatible. My main problem with this is that I am already&#x00a0;using cytoscape and I have uploaded a network on Cytoscape. I should be able to use the network I have already uploaded and working with, rather than loading it a second time on to the plugin. At the least it should take the same formats that I was able to load onto Cytoscape (which did not work) or the *.cys format that cytoscape saves. The "import network from table" feature of cytoscape takes tab delimited files. The plugin was unable to take the very same files. This is a major drawback and a fatal flaw in my opinion.</p>
                    </list-item>
                    <list-item>
                        <p>The second issue is the English in the paper and the manual. It needs extensive correction and reworking to be legible.</p>
                    </list-item>
                </list>This may very well be a useful and effective plugin. But I was unable to test its functionality because of&#x00a0; a) poor instructions in the paper/manual , b) inability in using existing cytoscape networks and formats&#x00a0;(This is a major drawback, and the utility of&#x00a0; a plugin which cannot act on a network loaded in the main cytoscape window or at least makes use of the same format is very limited).</p>
            <p>I recommend that the author rework these issues and make the plugin more robust.</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report7310">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.6152.r7310</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Blankenburg</surname>
                        <given-names>Hagen</given-names>
                    </name>
                    <xref ref-type="aff" rid="r7310a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r7310a1">
                    <label>1</label>Center for Biomedicine, European Academy Bozen/Bolzano (EURAC), Bolzano, Italy</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>21</day>
                <month>1</month>
                <year>2015</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2015 Blankenburg H</copyright-statement>
                <copyright-year>2015</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport7310" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.5753.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The manuscript presents BiNAT, a Cytoscape plugin for computing a number of network centrality parameters. In the last years, topological network analyses have yielded interesting insights, thus this is an important area of research. However, I see a number of major issues with both the software and the accompanying manuscript that should be addressed.</p>
            <p>
                <bold>- Similar plugins:</bold>
            </p>
            <p>As the authors state, 
                <italic>&#x201c;BiNAT is one of the few Cytoscape plugins that computes several centrality indices at once.&#x201d;</italic> The other tools should not just be named at the end of the manuscript but should be properly cited and described in the introduction. 
                <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=18006545">NetworkAnalyzer</ext-link> is included as a core plugin in every Cytoscape installation; 
                <ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/?term=19729372">CentiScaPe</ext-link> is available via the Cytoscape App store and has been published in 
                <italic>
                    <ext-link ext-link-type="uri" xlink:href="http://f1000research.com/articles/3-139/v1">F1000Research</ext-link> </italic>as part of the 
                <ext-link ext-link-type="uri" xlink:href="http://f1000research.com/article-collections/cytoscapeapps">Cytoscape App collection</ext-link>. Although novelty is not a criterion for publication in 
                <italic>F1000Research</italic>, without a thorough comparison to these tools it is hard to tell what BiNAT can do that these tools cannot (e.g. if there are particular centrality measures that only BiNAT can compute).</p>
            <p>
                <bold>- Cytoscape 2/3 installation procedure:</bold>
            </p>
            <p>I had some difficulties trying to install BiNAT. CentiScaPe can be installed with a single click in the Cytoscape App store; why is this elegant option not available for BiNAT? I could only test BiNAT with the outdated Cytoscape 2.8, as in Cytoscape 3.2 for MacOS I could not find a &#x201c;plugin&#x201d; folder (and creating the folder with the BiNAT files inside did not have an effect). This made me wonder if BiNAT is only compatible with Cytoscape 2 and not with the recent Cytoscape 3 (the compatibility entry in the 
                <ext-link ext-link-type="uri" xlink:href="http://chianti.ucsd.edu/cyto_web/plugins/">plugin directory</ext-link> and the missing entry in the 
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/all">App store </ext-link>suggest this)? While of course I would like to see compatibility with Cytoscape 3, it should at least be clearly stated if this is not the case in order to prevent confusion.</p>
            <p>
                <bold>- Usability / user interface:</bold>
            </p>
            <p>While the authors state that 
                <italic>"[t]he plugin interface is simple as a shell"</italic>, a user that is familiar with the intuitive, few click interfaces of NetworkAnalyzer and CentiScaPe might find BiNAT&#x2019;s command line interface quite challenging and unintuitive. If there is a clear benefit of this command line over a graphical and clickable interface this should be described with good examples (e.g. does it allow to script and save a complex analysis?). As a minimum example, the commands required to compute the Yeast network mentioned in the manuscript could be provided. However, for the user that does not feel overly comfortable typing commands into a shell (and I assume that Cytoscape is used by quite a few of those), a graphical, clickable, and intuitive interface to BiNAT seems to be essential.&#x00a0;</p>
            <p>
                <bold>- File formats:</bold>
            </p>
            <p>Why does BiNAT actually need the ability to read network files? Input file handling and network creation should be completely handled by Cytoscape, which has a general table import function that can handle any kind of plain text file, not just BioGRID Tab 2.0; plugins like BiNAT should work on the final networks and not replicated core functionality.</p>
            <p>
                <bold>- Manuscript:</bold>
            </p>
            <p>In its current form the manuscript contains too many technical descriptions. Implementation details like the model-view-controller design pattern, the description of BiNAT&#x2019;s internal directory structure and file organization, or what Apache module is used for writing Microsoft Excel files might be interesting for a developer but are irrelevant for the reader that is a potential user. All this text could be moved to the author&#x2019;s website, freeing plenty of space for a comparison to the other available network analysis tools and for practical use-cases and examples. In a final step, a language check should be performed to make sure the text is fully comprehensible.</p>
            <p>
                <bold>- Figures:</bold>
            </p>
            <p>Figure 1 does currently not contain much relevant information and should be replace with a figure that is somehow connected to BiNAT. A classic approach would be to use the computed centrality parameters in Cytoscape&#x2019;s VizMapper to change the color/size of important nodes, ideally focusing on a subnetwork of the Yeast interactome. The 
                <ext-link ext-link-type="uri" xlink:href="http://cytoscape-publications.tumblr.com/">Cytoscape Tumblr</ext-link> might work as a great source of inspiration for useful and aesthetically pleasing Cytoscape representations. In addition, Figure 2 should probably be Table 1 instead, as it only contains tabular text.</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report6765">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.6152.r6765</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Capriotti</surname>
                        <given-names>Emidio</given-names>
                    </name>
                    <xref ref-type="aff" rid="r6765a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r6765a1">
                    <label>1</label>Division of Informatics, Department of Pathology, University of Alabama at Birmingham, Birmingham, AL, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>4</day>
                <month>12</month>
                <year>2014</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Capriotti E</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport6765" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.5753.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The paper briefly describes BINAT, a new Cytoscape plugin to calculate several network features. The plugin provides an interface to export the results of the calculation in an excel file.</p>
            <p>The authors should have better described the advantages of using their plugin showing, for example, the computing time required to perform calculation on networks with different size.</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
</article>
