<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.4524.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Software Tool Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                    <subj-group>
                        <subject>Bioinformatics</subject>
                    </subj-group>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>KEGGscape: a Cytoscape app for pathway data integration</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved, 2 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Nishida</surname>
                        <given-names>Kozo</given-names>
                    </name>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Ono</surname>
                        <given-names>Keiichiro</given-names>
                    </name>
                    <xref ref-type="corresp" rid="c2">b</xref>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Kanaya</surname>
                        <given-names>Shigehiko</given-names>
                    </name>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Takahashi</surname>
                        <given-names>Koichi</given-names>
                    </name>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Laboratory for Biochemical Simulation, RIKEN Quantitative Biology Center, Osaka, 565-0874, Japan</aff>
                <aff id="a2">
                    <label>2</label>JST, National Bioscience Database Center (NBDC), Tokyo, 102-0081, Japan</aff>
                <aff id="a3">
                    <label>3</label>Department of Medicine, University of California San Diego, La Jolla, CA 92093, USA</aff>
                <aff id="a4">
                    <label>4</label>Graduate School of Information Science, Nara Institute of Science and Technology, Nara, 630-0101, Japan</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:knishida@riken.jp">knishida@riken.jp</email>
                </corresp>
                <corresp id="c2">
                    <label>b</label>
                    <email xlink:href="mailto:kono@ucsd.edu">kono@ucsd.edu</email>
                </corresp>
                <fn fn-type="con">
                    <p>SK guided the GeneChip data preparation and the statistical tests, KT guided the total system design of the project. KN designed and implemented the software under KO&#x2019;s supervision and performed sample analysis and visualization. KO contributed to the writing of this article.</p>
                </fn>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>1</day>
                <month>7</month>
                <year>2014</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2014</year>
            </pub-date>
            <volume>3</volume>
            <elocation-id>144</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>26</day>
                    <month>6</month>
                    <year>2014</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Nishida K et al.</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/3-144/pdf"/>
            <abstract>
                <p>In this paper, we present KEGGscape a pathway data integration and visualization app for Cytoscape (
                    <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/keggscape">http://apps.cytoscape.org/apps/keggscape</ext-link>). KEGG is a comprehensive public biological database that contains large collection of human curated pathways. KEGGscape utilizes the database to reproduce the corresponding hand-drawn pathway diagrams with as much detail as possible in Cytoscape. Further, it allows users to import pathway data sets to visualize biologist-friendly diagrams using the Cytoscape core visualization function (Visual Style) and the ability to perform pathway analysis with a variety of Cytoscape apps. From the analyzed data, users can create complex and interactive visualizations which cannot be done in the KEGG PATHWAY web application. Experimental data with Affymetrix E. coli chips are used as an example to demonstrate how users can integrate pathways, annotations, and experimental data sets to create complex visualizations that clarify biological systems using KEGGscape and other Cytoscape apps.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>.bioinformatics</kwd>
                <kwd>cytoscape</kwd>
                <kwd>keggscape</kwd>
                <kwd>data integration</kwd>
                <kwd>pathway data</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/501100002241">
                    <funding-source>Japan Science and Technology Agency</funding-source>
                </award-group>
                <funding-statement>This work was supported by National Bioscience Database Center (NBDC) of the Japan Science and Technology Agency (JST).</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>Kyoto Encyclopedia of Genes and Genomes (KEGG, 
                <ext-link ext-link-type="uri" xlink:href="http://www.genome.jp/kegg">http://www.genome.jp/kegg</ext-link>)
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup> is a widely used biological database of high-level biological functions. It contains pathway data sets that have comprehensive annotations and high quality human-curated, hand-drawn diagrams. Most biological pathway databases store data as machine-readable graph topologies, which leave much of the details about how the diagrams were drawn excluded from the data files. This is a problem when third-party developers want to reproduce the pathway diagrams in their applications. In contrast, the KEGG PATHWAY database stores graphics information in machine-readable KEGG Markup Language (KGML, 
                <ext-link ext-link-type="uri" xlink:href="http://www.kegg.jp/kegg/xml">http://www.kegg.jp/kegg/xml</ext-link>) format. Thus, in these pathway diagrams, biological entities, such as enzymes or compounds, are manually laid-out and the diagrams are easy to understand for biologists.</p>
            <p>The KEGG PATHWAY database is deployed as a web application using static bitmap images for pathway diagrams, and user-provided date is integrated with KEGG Mapper (
                <ext-link ext-link-type="uri" xlink:href="http://www.genome.jp/kegg/mapper.html">http://www.genome.jp/kegg/mapper.html</ext-link>). Furthermore, KEGG Atlas (
                <ext-link ext-link-type="uri" xlink:href="http://www.genome.jp/kegg/atlas.html">http://www.genome.jp/kegg/atlas.html</ext-link>)	provides a comprehensive network view of global metabolic pathways. Recent improvements to KEGG Atlas, such as Pathway Projector
                <sup>
                    <xref ref-type="bibr" rid="ref-2">2</xref>
                </sup> and iPath2
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>
                </sup>, have made it possible to perform basic data integration and visualization like mapping the expression values to node graphics.	However, despite these features, it is difficult to integrate external data sets and create custom visualization.	Furthermore, they are limited to those on existing desktop pathway analysis applications. To ameliorate these problems, several projects for integrating a user&#x2019;s own models onto the KEGG pathways have therefore been developed (CytoSEED Cytoscape app
                <sup>
                    <xref ref-type="bibr" rid="ref-4">4</xref>
                </sup>, KEGGtranslator
                <sup>
                    <xref ref-type="bibr" rid="ref-5">5</xref>
                </sup>).</p>
            <p>Cytoscape
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>,
                    <xref ref-type="bibr" rid="ref-7">7</xref>
                </sup> is a de-facto standard software platform for biological network analysis and visualization. One of its advantages is its large collection of apps for a variety of biological problem domains, such as Gene Ontology term enrichment analysis (BiNGO
                <sup>
                    <xref ref-type="bibr" rid="ref-8">8</xref>
                </sup>) and statistical network analysis (CentiScaPe
                <sup>
                    <xref ref-type="bibr" rid="ref-9">9</xref>
                </sup>), which are also mostly open source software. Additionally, Cytoscape has a flexible network visualization function and is optimized for large-scale network analysis. There are several applications dedicated to biological pathway analysis (Vanted
                <sup>
                    <xref ref-type="bibr" rid="ref-10">10</xref>
                </sup>, VisANT
                <sup>
                    <xref ref-type="bibr" rid="ref-11">11</xref>
                </sup>) that support KGML by default. Although Cytoscape does not have a built-in function to load biological pathways, if this task is done with a separate app, users can take advantage of its large-scale network analysis features, variety of analysis apps, and data visualization of biologists-friendly human curated pathways.</p>
            <p>The goal of our new Cytoscape app, KEGGscape, is to bridge the flexibility of fully-featured network analysis platforms with the high-quality pathway diagrams available in the KEGG PATHWAY web application. KEGGscape, a successor of KGMLReader (
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/kgmlreader">http://apps.cytoscape.org/apps/kgmlreader</ext-link>) for Cytoscape 2 series, is an app that imports KEGG pathway diagrams from KGML files and provides a new way to use KEGG pathway diagrams as data integration blueprints in cooperation with Cytoscape core features and an existing variety of apps. KEGGscape is completely re-designed for the new Cytoscape 3 API and supports signaling pathways in addition to metabolic pathways, including the global metabolic pathways used in KEGG Atlas (
                <xref ref-type="fig" rid="f1">Figure 1</xref>). In this paper, we present a basic design and implementation of KEGGscape and an example workflow utilizing KGML files, and experimental data to create information-rich pathway visualizations for clarifying omics-scale data sets. KGMLReader is the first open-source Cytoscape app that reads the graphics details of KGML files, and KEGGscape was designed to use standard Cytoscape features only. These feature enable users to use KEGG pathways with other data sets easily.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>A KEGG Global Metabolic Pathway generated with the KEGGscape app.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4838/3151f06f-ccf4-46bd-baf4-f58bd5f3353d_figure1.gif"/>
            </fig>
        </sec>
        <sec>
            <title>Implementation</title>
            <p>KEGGscape is a Cytoscape 3 app written in Java programming language and is designed to load pathway data files in KGML format. KGML is an XML file format designed by the KEGG project and contains the topology of pathways and visual representations of all elements in the diagram. KGML has formal specification as a DTD (Document Type Definition) file, which enables the use of unmarshaller (
                <ext-link ext-link-type="uri" xlink:href="https://jaxb.java.net">https://jaxb.java.net</ext-link>) for converting XML elements directly into Java objects. This conversion creates two types of data: pathway topology and its graphical representations. Pathway topology and its properties are converted into CyNetwork and CyTable objects, which are the standard data model in Cytoscape 3. In KGML, all graphical information, such as the color of enzymes or shape of compounds is stored under &lt;graphics&gt; tag. Instead of setting the graphics details of nodes and edges directly from this information, Cytoscape generates Visual Style, which is a collection of default visual properties and visual mapping function, for each pathway based on the information under this tag. KEGGscape follows a standard CyNetworkReader design guideline, which enables Cytoscape to detect KGML files automatically.</p>
            <sec>
                <title>Workflow</title>
                <p>
					
                    <xref ref-type="fig" rid="f2">Figure 2</xref> shows an example of a pathway analysis workflow with KEGGscape. To take advantage of the flexible visualization and analysis features in Cytoscape, users need to import as much information as possible for the pathways they want to analyze. Although Cytoscape is a powerful tool for biological data integration, it is not the best platform for data preparation or cleansing. Users can instead prepare annotations and experimental data sets for the pathway using tools of their choice, such as R (Bioconductor
                    <sup>
                        <xref ref-type="bibr" rid="ref-12">12</xref>
                    </sup>), Python, or Excel. Once the data files are ready, Cytoscape can read them into an on-memory session and visualize the data on the KEGG pathways. Imported data sets only use standard Cytoscape data objects, and users can then access all of the standard Cytoscape features to create custom pathway visualizations. An actual workflow will be presented in a later section.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Basic pathway analysis workflow with KEGGscape.</title>
                        <p>Cytoscape with KEGGscape can be used as a part of larger workflows to publish integrated pathway visualizations as vector graphics, bitmap images, or JSON for web-based visualization using Cytoscape.js (
                            <ext-link ext-link-type="uri" xlink:href="http://cytoscape.github.io/cytoscape.js/">http://cytoscape.github.io/cytoscape.js/</ext-link>).</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4838/3151f06f-ccf4-46bd-baf4-f58bd5f3353d_figure2.gif"/>
                </fig>
            </sec>
            <sec>
                <title>Limitations</title>
                <p>Although KEGGscape can read all information of the pathways saved in KGML files, some of the pathway visualizations in Cytoscape look slightly different from the original hand-drawn diagrams available on the KEGG website. The cause of this issue is missing graphics information in the KGML files. 
                    <xref ref-type="fig" rid="f3">Figure 3</xref> is a side-by-side comparison of the same pathway visualization (human MAPK signaling pathway; KEGG ID: hsa04010). The original diagram (left) contains several background visual annotations that are not visible in the visualization created by Cytoscape (right). The hand-drawn compartmental annotations are not encoded in KGML files, which means they cannot be reproduced by KEGGscape.</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Comparison of the original diagram and Cytoscape visualization for the human MAPK signaling pathway (KEGG hsa04010).</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4838/3151f06f-ccf4-46bd-baf4-f58bd5f3353d_figure3.gif"/>
                </fig>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>As an example workflow, we integrated and visualized a KEGG pathway and gene expression profile using KEGGscape and external tools. In this example, the differentially expressed genes between two groups, mutants and controls, in a global expression profile are mapped on the KEGG pathway, as too are the t-test results.</p>
            <sec>
                <title>Data preparation</title>
                <p>To perform this pathway analysis in Cytoscape, we used Bioconductor (
                    <ext-link ext-link-type="uri" xlink:href="http://www.bioconductor.org/">http://www.bioconductor.org/</ext-link>) to prepare the gene expression matrix data. We normalized Affymetrix GeneChip data by the robust multi-array average (RMA) method with the Bioconductor packages ecoliLeucine
                    <sup>
                        <xref ref-type="bibr" rid="ref-13">13</xref>
                    </sup> and affy
                    <sup>
                        <xref ref-type="bibr" rid="ref-14">14</xref>
                    </sup>. The leucine regulatory protein (Lrp) is a DNA binding protein and known as a leucine responsive global regulator
                    <sup>
                        <xref ref-type="bibr" rid="ref-15">15</xref>
                    </sup>. The p-value for each probeset between four lrp mutant strains and four control chips was calculated by rowttest method in genefilter package
                    <sup>
                        <xref ref-type="bibr" rid="ref-16">16</xref>
                    </sup>. From this calculation, we obtained a list of genes that are differentially expressed (p-value &lt; 0.05). We sent these probeset identifiers to KEGG Mapper and picked the highest hit, which was the glycine, serine and thereonine metabolic pathway (KEGG ID: eco00260) for visualization.</p>
            </sec>
            <sec>
                <title>Visualization</title>
                <p>To create a visualization using all the data sets, we imported the KGML file of eco00260 and the p-value matrix file prepared in the previous data preparation to Cytoscape 3, and merged the matrices with a custom Python script (
                    <xref ref-type="fig" rid="f4">Figure 4</xref>). Because Cytoscape does not support fuzzy key matching, we used our Python script to append a key column to the p-value matrix to utilize the Cytoscape table merge tool.</p>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>Figure 4. </label>
                    <caption>
                        <title>KEGG pathway visualization integrated with gene expression data for the glycine, serine and threonine metabolism pathway of Escherichia coli K-12 MG1655 (KEGG eco00260).</title>
                        <p>Green border nodes are KO (KEGG Orthology) annotated nodes. Red colored nodes include differentially expressed genes (p-value &lt; 0.05).</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4838/3151f06f-ccf4-46bd-baf4-f58bd5f3353d_figure4.gif"/>
                </fig>
                <p>The node table in Cytoscape for the imported KGML had KEGG gene annotations. The gene IDs for each enzyme node were used as keys for merging the KGML node table and p-value matrix. In this 
                    <xref ref-type="fig" rid="f4">Figure 4</xref>, node colors in the original KEGG pathway were mapped to node border colors and p-values were mapped to node color gradient (red to white) to visualize the significantly expressed genes.</p>
            </sec>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusions</title>
            <p>In this paper, we presented the design and implementation of KEGGscape and an example analysis workflow integrating global gene expression profiles and KEGG pathways using KEGGscape and two external tools, Bioconductor and Python. The workflow demonstrates how users can integrate omics data in an interactive pathway diagram.</p>
            <sec>
                <title>Future plan</title>
                <p>Current workflow can map arbitrary omics data onto interactive KEGG pathway diagrams, but it requires some manual editing to create informative visualizations. To minimize the manual process in the workflow, we plan to implement a collection of utility Python scripts to manipulate networks and Visual Styles via RESTful API, which will be published as a part of the Cytoscape 3.2.0 release. This set of Python scripts works to merge pathway related table metadata (omics profiles, non-KEGG pathway metadata) from external platforms like R and Cytoscape to automate common tasks in the visualization process.</p>
            </sec>
        </sec>
        <sec>
            <title>Software availability</title>
            <p>The app website: 
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/keggscape">http://apps.cytoscape.org/apps/keggscape</ext-link>
			</p>
            <p>Latest source code: 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/idekerlab/KEGGscape">https://github.com/idekerlab/KEGGscape</ext-link>
			</p>
            <p>Source code as at the time of publication: 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/F1000Research/KEGGscape/releases/tag/V1.0">https://github.com/F1000Research/KEGGscape/releases/tag/V1.0</ext-link>
			</p>
            <p>Archived source code as at the time of publication: 
                <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5281/zenodo.10560">http://dx.doi.org/10.5281/zenodo.10560</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-17">17</xref>
                </sup>
			</p>
            <p>License: Apache License Version 2.0</p>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgements</title>
            <p>The authors would like to thank the Google Summer of Code program and Biohackathon attendees for helpful suggestions at the early stage of KEGGscape development, and Peter Karagiannis for reading this article and for useful comments.</p>
        </ack>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Kanehisa</surname>
                            <given-names>M</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Goto</surname>
                            <given-names>S</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Sato</surname>
                            <given-names>Y</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Data, information, knowledge and principle: back to metabolism in KEGG.</article-title>
                    <source>
						
                        <italic toggle="yes">Nucleic Acids Res.</italic>
					</source>
                    <year>2014</year>;<volume>42</volume>(<issue>Database issue</issue>):<fpage>D199</fpage>&#x2013;<lpage>D205</lpage>.
                    <pub-id pub-id-type="pmid">24214961</pub-id>
                    <pub-id pub-id-type="doi">10.1093/nar/gkt1076</pub-id>
                    <pub-id pub-id-type="pmcid">3965122</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Kono</surname>
                            <given-names>N</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Arakawa</surname>
                            <given-names>K</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>R</surname>
                            <given-names>Ogawa</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Pathway projector: web-based zoomable pathway browser using KEGG atlas and Google Maps API.</article-title>
                    <source>
						
                        <italic toggle="yes">PLoS One.</italic>
					</source>
                    <year>2009</year>;<volume>4</volume>(<issue>11</issue>):<fpage>e7710</fpage>.
                    <pub-id pub-id-type="pmid">19907644</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0007710</pub-id>
                    <pub-id pub-id-type="pmcid">2770834</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Yamada</surname>
                            <given-names>T</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Letunic</surname>
                            <given-names>I</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Okuda</surname>
                            <given-names>S</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>ipath2.0: interactive pathway explorer.</article-title>
                    <source>
						
                        <italic toggle="yes">Nucleic Acids Res.</italic>
					</source>
                    <year>2011</year>;<volume>39</volume>(<issue>Web Server issue</issue>):<fpage>W412</fpage>&#x2013;<lpage>W415</lpage>.
                    <pub-id pub-id-type="pmid">21546551</pub-id>
                    <pub-id pub-id-type="doi">10.1093/nar/gkr313</pub-id>
                    <pub-id pub-id-type="pmcid">3125749</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>DeJongh</surname>
                            <given-names>M</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Bockstege</surname>
                            <given-names>B</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Frybarger</surname>
                            <given-names>P</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>CytoSEED: a Cytoscape plugin for viewing, manipulating and analyzing metabolic models created by the model SEED.</article-title>
                    <source>
						
                        <italic toggle="yes">Bioinformatics.</italic>
					</source>
                    <year>2012</year>;<volume>28</volume>(<issue>6</issue>):<fpage>891</fpage>&#x2013;<lpage>892</lpage>.
                    <pub-id pub-id-type="pmid">22210867</pub-id>
                    <pub-id pub-id-type="doi">10.1093/bioinformatics/btr719</pub-id>
                    <pub-id pub-id-type="pmcid">3307106</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Wrzodek</surname>
                            <given-names>C</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Dr&#x00e4;ger</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Zell</surname>
                            <given-names>A</given-names>
                        </name>
					</person-group>:
                    <article-title>KEGGtranslator: visualizing and converting the KEGG PATHWAY database to various formats.</article-title>
                    <source>
						
                        <italic toggle="yes">Bioinformatics.</italic>
					</source>
                    <year>2011</year>;<volume>27</volume>(<issue>16</issue>):<fpage>2314</fpage>&#x2013;<lpage>2315</lpage>.
                    <pub-id pub-id-type="pmid">21700675</pub-id>
                    <pub-id pub-id-type="doi">10.1093/bioinformatics/btr377</pub-id>
                    <pub-id pub-id-type="pmcid">3150042</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Shannon</surname>
                            <given-names>P</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Markiel</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Ozier</surname>
                            <given-names>O</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Cytoscape: a software environment for integrated models of biomolecular interaction networks.</article-title>
                    <source>
						
                        <italic toggle="yes">Genome Res.</italic>
					</source>
                    <year>2003</year>;<volume>13</volume>(<issue>11</issue>):<fpage>2498</fpage>&#x2013;<lpage>2504</lpage>.
                    <pub-id pub-id-type="pmid">14597658</pub-id>
                    <pub-id pub-id-type="doi">10.1101/gr.1239303</pub-id>
                    <pub-id pub-id-type="pmcid">403769</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Smoot</surname>
                            <given-names>ME</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Ono</surname>
                            <given-names>K</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Ruscheinski</surname>
                            <given-names>J</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Cytoscape 2.8: new features for data integration and network visualization.</article-title>
                    <source>
						
                        <italic toggle="yes">Bioinformatics.</italic>
					</source>
                    <year>2011</year>;<volume>27</volume>(<issue>3</issue>):<fpage>431</fpage>&#x2013;<lpage>432</lpage>.
                    <pub-id pub-id-type="pmid">21149340</pub-id>
                    <pub-id pub-id-type="doi">10.1093/bioinformatics/btq675</pub-id>
                    <pub-id pub-id-type="pmcid">3031041</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Maere</surname>
                            <given-names>S</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Heymans</surname>
                            <given-names>K</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Kuiper</surname>
                            <given-names>M</given-names>
                        </name>
					</person-group>:
                    <article-title>BiNGO: a Cytoscape plugin to assess overrepresentation of gene ontology categories in biological networks.</article-title>
                    <source>
						
                        <italic toggle="yes">Bioinformatics.</italic>
					</source>
                    <year>2005</year>;<volume>21</volume>(<issue>16</issue>):<fpage>3448</fpage>&#x2013;<lpage>3449</lpage>.
                    <pub-id pub-id-type="pmid">15972284</pub-id>
                    <pub-id pub-id-type="doi">10.1093/bioinformatics/bti551</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Scardoni</surname>
                            <given-names>G</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Petterlini</surname>
                            <given-names>M</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Laudanna</surname>
                            <given-names>C</given-names>
                        </name>
					</person-group>:
                    <article-title>Analyzing biological network parameters with CentiScaPe.</article-title>
                    <source>
						
                        <italic toggle="yes">Bioinformatics.</italic>
					</source>
                    <year>2009</year>;<volume>25</volume>(<issue>21</issue>):<fpage>2857</fpage>&#x2013;<lpage>2859</lpage>.
                    <pub-id pub-id-type="pmid">19729372</pub-id>
                    <pub-id pub-id-type="doi">10.1093/bioinformatics/btp517</pub-id>
                    <pub-id pub-id-type="pmcid">2781755</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Rohn</surname>
                            <given-names>H</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Junker</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Hartmann</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>VANTED v2: a framework for systems biology applications.</article-title>
                    <source>
						
                        <italic toggle="yes">BMC Syst Biol.</italic>
					</source>
                    <year>2012</year>;<volume>6</volume>(<issue>1</issue>):<fpage>139</fpage>.
                    <pub-id pub-id-type="pmid">23140568</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1752-0509-6-139</pub-id>
                    <pub-id pub-id-type="pmcid">3610154</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Hu</surname>
                            <given-names>Z</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Chang</surname>
                            <given-names>YC</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>Y</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>VisANT 4.0: Integrative network platform to connect genes, drugs, diseases and therapies.</article-title>
                    <source>
						
                        <italic toggle="yes">Nucleic Acids Res.</italic>
					</source>
                    <year>2013</year>;<volume>41</volume>(<issue>Web Server issue</issue>):<fpage>W225</fpage>&#x2013;<lpage>W231</lpage>.
                    <pub-id pub-id-type="pmid">23716640</pub-id>
                    <pub-id pub-id-type="doi">10.1093/nar/gkt401</pub-id>
                    <pub-id pub-id-type="pmcid">3692070</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Gentleman</surname>
                            <given-names>RC</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Carey</surname>
                            <given-names>VJ</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Bates</surname>
                            <given-names>DM</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Bioconductor: open software development for computational biology and bioinformatics.</article-title>
                    <source>
						
                        <italic toggle="yes">Genome Biol.</italic>
					</source>
                    <year>2004</year>;<volume>5</volume>(<issue>10</issue>):<fpage>R80</fpage>.
                    <pub-id pub-id-type="pmid">15461798</pub-id>
                    <pub-id pub-id-type="doi">10.1186/gb-2004-5-10-r80</pub-id>
                    <pub-id pub-id-type="pmcid">545600</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <label>13</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Gautier</surname>
                            <given-names>L</given-names>
                        </name>
					</person-group>:
                    <article-title>ecoliLeucine</article-title>: Experimental data with Affymetrix E. coli chips, 2007. R package version 1.5.0.
                    <ext-link ext-link-type="uri" xlink:href="http://master.bioconductor.org/packages/devel/data/experiment/manuals/ecoliLeucine/man/ecoliLeucine.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Gautier</surname>
                            <given-names>L</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Cope</surname>
                            <given-names>L</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Bolstad</surname>
                            <given-names>BM</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>affy--analysis of Affymetrix GeneChip data at the probe level.</article-title>
                    <source>
						
                        <italic toggle="yes">Bioinformatics.</italic>
					</source>
                    <year>2004</year>;<volume>20</volume>(<issue>3</issue>):<fpage>307</fpage>&#x2013;<lpage>315</lpage>.
                    <pub-id pub-id-type="pmid">14960456</pub-id>
                    <pub-id pub-id-type="doi">10.1093/bioinformatics/btg405</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Hung</surname>
                            <given-names>SP</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Baldi</surname>
                            <given-names>P</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Hatfield</surname>
                            <given-names>GW</given-names>
                        </name>
					</person-group>:
                    <article-title>Global gene expression profiling in Escherichia coli K12. The effects of Leucine-responsive regulatory protein.</article-title>
                    <source>
						
                        <italic toggle="yes">J Biol Chem.</italic>
					</source>
                    <year>2002</year>;<volume>277</volume>(<issue>43</issue>):<fpage>40309</fpage>&#x2013;<lpage>40323</lpage>.
                    <pub-id pub-id-type="pmid">12130640</pub-id>
                    <pub-id pub-id-type="doi">10.1074/jbc.M204044200</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <label>16</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Gentleman</surname>
                            <given-names>R</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Carey</surname>
                            <given-names>V</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Huber</surname>
                            <given-names>W</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>genefilter: methods for filtering genes from high-throughput experiments</article-title>. R package version 1.47.5.
                    <ext-link ext-link-type="uri" xlink:href="http://www.bioconductor.org/packages/devel/bioc/html/genefilter.html">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Nishida</surname>
                            <given-names>K</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Ono</surname>
                            <given-names>K</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Kanaya</surname>
                            <given-names>S</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>F1000Research/KEGGscape.</article-title>
                    <source>
						
                        <italic toggle="yes">ZENODO.</italic>
					</source>
                    <year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5281/zenodo.10560">Data Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report5318">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.4838.r5318</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Cline</surname>
                        <given-names>Melissa</given-names>
                    </name>
                    <xref ref-type="aff" rid="r5318a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r5318a1">
                    <label>1</label>Center for Biomolecular Science &amp; Engineering, University of California, Santa Cruz, Santa Cruz, CA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>6</day>
                <month>8</month>
                <year>2014</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Cline M</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport5318" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.4524.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>KEGG is one of the foremost sources of metabolic pathway data. Cytoscape is the 
                <italic>de facto</italic> standard pathway visualization platform. Cytoscape-based visualization of KEGG pathways has always been cumbersome and limited. KEGGscape gets over many of these limitations by streamlining the process, and improving the translation of the graphical elements of KEGG pathways. This makes KEGGscape a very useful resource for the scientific community.</p>
            <p>The manuscript is clear and informative. There are only two changes I would ask for:
                <list list-type="bullet">
                    <list-item>
                        <p>First, the authors should mention that KGML files are currently freely available on the KEGG website.&#x00a0;This will be news to some readers of this paper, since KEGG has gone through various distribution and licensing models.</p>
                    </list-item>
                    <list-item>
                        <p>Second, the authors should expand their discussion of merging gene expression data with KGML diagrams. The power of network visualization is in pathway data integration.&#x00a0;If there are special challenges in integrating with KEGG pathways, these should be brought forth. The mention of custom python scripts and fuzzy ID matching suggests that this integration task can involve special challenges.</p>
                    </list-item>
                </list>
            </p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report5317">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.4838.r5317</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Willighagen</surname>
                        <given-names>Egon</given-names>
                    </name>
                    <xref ref-type="aff" rid="r5317a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-7542-0286</uri>
                </contrib>
                <aff id="r5317a1">
                    <label>1</label>Department of Bioinformatics - BiGCaT, Maastricht University, Maastricht, The Netherlands</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>I am contributing to the open source WikiPathways, BridgeDb, and PathVisio projects. I have no competing financial interest.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>22</day>
                <month>7</month>
                <year>2014</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Willighagen E</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport5317" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.4524.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The paper describes an interesting and relevant Cytoscape plugin; it is well written (there are a few typos), but I think it can be improved in places. An important reservation is that I cannot determine at this moment how common or serious the data loss in KGML reading is (see below). That is it should be clarified whether this paper is a first report, a work in progress or a finished project..</p>
            <p>
                <bold>Title and Abstract</bold>
            </p>
            <p>I find the title appropriate, but it may be promising more than what the app actually does. As far as I can tell, the app is not a general solution, but one specific for KEGG. The abstract is short on setting the state of the domain and, like the Introduction, does not refer to existing research in fields beyond their own. In this way, the abstract is less than clear what unsolved problem was resolved.</p>
            <p>
                <bold>Introduction</bold>
            </p>
            <p>The Introduction sufficiently explains the setting of the plugin. One thing that strikes me is the lack of references to related work. For example, it mentions "
                <italic>most biological pathway databases</italic>" without citing or even naming them, which I find suboptimal as they critique those databases and to which the authors contrast their solution. Unlike the Introduction currently seems to suggest, KGML is not the only pathway format that tracks graphical information (e.g. GPML used by PathVisio). The first paragraph currently suggests it solves a problem that others have been tackling too. (P.S. under what license is the KGML specification available?).</p>
            <p>The Introduction focuses on technical issues of the integration. It could also say a bit about identifier mapping and the role of licensing in data integration. That is, given &#x00a0;the enormous impact of KEGG it can be wondered why this kind of integration with KEGG has not been done yet, because people have done this for other data sets for years (both open source and proprietary). Or, if it has, it should be cited.</p>
            <p>Minor comments:
                <list list-type="bullet">
                    <list-item>
                        <p>Check the hyphenation of KEGGtranslator&#x00a0;(KEGG-translator versus KEG-Gtranslator).</p>
                    </list-item>
                    <list-item>
                        <p>The comment that Cytoscape does not have a built-in function to load biological pathways probably refers to formats, not the pathways themselves.</p>
                    </list-item>
                    <list-item>
                        <p>Since the app focuses on KGML support, some reference to apps supporting other formats (BioPax, SGML) seems appropriate.</p>
                    </list-item>
                </list>
                <bold>Figures</bold>
            </p>
            <p>The figures are too hard to read, both in print (where it is impossible) but also in the PDF. This should really be addressed.</p>
            <p>
                <bold>Implementation</bold>
            </p>
            <p>The Implementation sections can be improved: the section is short on details on the KEGGscape source code, the design of the app and the KGML reader in particular, build instructions, development model, testing (tests seem absent in the code repository).</p>
            <p>I also note issues with the KGML readers. For example, connections clear on the KEGG website are missing and misplaced when read into Cytoscape (e.g. between glycine and sarcosine, and the link between Purine metabolism, see Fig. 4) and labels are often misleadingly placed and often unconnected (a limitation of KEGG), though accurately copied from the KGML, it seems. The first data-loss clearly indicates a problem with the reader. These things must be discussed in the Limitations subsection, in my opinion (and/or returned to in the Future Plan at the end).</p>
            <p>Minor comments:
                <list list-type="bullet">
                    <list-item>
                        <p>on-memory -&gt; in-memory?</p>
                    </list-item>
                    <list-item>
                        <p>&lt;graphics&gt; tag -&gt; &lt;graphics&gt; element (a tag does not really have something under it in XML, attributes at best; an element does).</p>
                    </list-item>
                    <list-item>
                        <p>What is "Visual Style"?</p>
                    </list-item>
                    <list-item>
                        <p>Under what license is the DTD available?</p>
                    </list-item>
                </list>
                <bold>Results</bold>
            </p>
            <p>The Results section seems to accurately describe what they did, but not how they did this. I think something like a methods section (or an Open Notebook) that explains how the steps are performed (in more detail) would be helpful. However, in the end I was able to figure out how to import a KGML file (which is not under Import).</p>
            <p>Another example is reference to a custom Python script without description. In fact, thinking about this again, for an app that does data integration, I would actually expect the app to take care of data processing as much as possible. While I understand that general preparation starting from raw data is best done in other tools, this Python script does not seem to do more than format handling of some kind. Is that correct? If so, why is this not done by the app? Fortunately, this observation was made by the authors too, and they return to it in the Future plan subsection.</p>
            <p>Minor comments:
                <list list-type="bullet">
                    <list-item>
                        <p>probeset -&gt; probe set</p>
                    </list-item>
                    <list-item>
                        <p>thereonine -&gt; threonine</p>
                    </list-item>
                </list>
                <bold>Conclusion</bold>
            </p>
            <p>The Conclusion section does not sufficiently summarize the paper: it should reiterate what the problem is that is solved and what makes KEGGscape unique. Although I do not want to imply that I think this paper is not relevant (it is)!</p>
            <p>Also the limitations should be returned to here (those already listed in the paper, and those missing), particularly in relation to the "Future plan". The authors&#x2019; focus should really be on getting the KGML reading performing well: data loss, and data corruption are serious issues. A decent testing toolkit as 
                <ext-link ext-link-type="uri" xlink:href="http://maven.apache.org/">Maven</ext-link> supports, may be a good start here, but is currently missing from the source code repository.</p>
            <p>Minor comments:
                <list list-type="bullet">
                    <list-item>
                        <p>check the hyphenation of KEGGscape (KEGG-scape versus KEG-Gscape)</p>
                    </list-item>
                </list>
            </p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report5316">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.4838.r5316</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>DeJongh</surname>
                        <given-names>Matthew</given-names>
                    </name>
                    <xref ref-type="aff" rid="r5316a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r5316a1">
                    <label>1</label>Department of Computer Science, Hope College, Holland, MI, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>8</day>
                <month>7</month>
                <year>2014</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 DeJongh M</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport5316" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.4524.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>KEGGscape is valuable Cytoscape app that enables flexible visualization and manipulation of KEGG pathway maps. The capability for visualizing data sets (e.g., gene expression levels) on pathways in Cytoscape is particularly appealing. However, the example presented in the paper does not contain sufficient information to enable a reader to duplicate the process. First, the authors do not cite the origin of the gene expression dataset they use in their example. Second, as far as I can tell, there is no tutorial provided with KEGGscape. At a minimum, the authors should provide instructions for opening a KGML file and loading a dataset.</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
</article>
