<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.4254.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Software Tool Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                    <subj-group>
                        <subject>Bioinformatics</subject>
                    </subj-group>
                    <subj-group>
                        <subject>Theory &amp; Simulation</subject>
                    </subj-group>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>WikiPathways App for Cytoscape: Making biological pathways amenable to network analysis and visualization</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes" equal-contrib="yes">
                    <name>
                        <surname>Kutmon</surname>
                        <given-names>Martina</given-names>
                    </name>
                    <uri content-type="orcid">https://orcid.org/0000-0002-7699-8191</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes" equal-contrib="yes">
                    <name>
                        <surname>Lotia</surname>
                        <given-names>Samad</given-names>
                    </name>
                    <xref ref-type="corresp" rid="c2">b</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Evelo</surname>
                        <given-names>Chris T.</given-names>
                    </name>
                    <uri content-type="orcid">https://orcid.org/0000-0002-5301-3142</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Pico</surname>
                        <given-names>Alexander R</given-names>
                    </name>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5706-2163</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Bioinformatics - BiGCaT, Maastricht University, Maastricht, 6229 ER, The Netherlands</aff>
                <aff id="a2">
                    <label>2</label>Gladstone Institutes, San Francisco, CA 94158-2261, USA</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:martina.kutmon@maastrichtuniversity.nl">martina.kutmon@maastrichtuniversity.nl</email>
                </corresp>
                <corresp id="c2">
                    <label>b</label>
                    <email xlink:href="mailto:samad.lotia@gladstone.ucsf.edu">samad.lotia@gladstone.ucsf.edu</email>
                </corresp>
                <fn id="fn1">
                    <p>*These authors contributed equally to this work.</p>
                </fn>
                <fn fn-type="con">
                    <p>MK, SL and ARP participated in the design of the described software. SL and MK implemented the WikiPathways app. MK, SL, CTE and ARP contributed to the development and writing of this article.</p>
                </fn>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>1</day>
                <month>7</month>
                <year>2014</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2014</year>
            </pub-date>
            <volume>3</volume>
            <elocation-id>152</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>3</day>
                    <month>6</month>
                    <year>2014</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Kutmon M et al.</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/3-152/pdf"/>
            <abstract>
                <p>In this paper we present the open-source WikiPathways app for Cytoscape (
                    <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/wikipathways">http://apps.cytoscape.org/apps/wikipathways</ext-link>) that can be used to import biological pathways for data visualization and network analysis. WikiPathways is an open, collaborative biological pathway database that provides fully annotated pathway diagrams for manual download or through web services. The WikiPathways app allows users to load pathways in two different views: as an annotated pathway ideal for data visualization and as a simple network to perform computational analysis. An example pathway and dataset are used to demonstrate the functionality of the WikiPathways app and how they can be combined and used together with other apps. More than 2000 downloads between its first release in August 2013 and the submission of the paper in May 2014 highlight the importance and adoption of the app in the network biology field.</p>
            </abstract>
            <funding-group>
                <funding-statement>We would like to acknowledge funding from NIGMS R01-GM100039 and NIDA U54-DA036134 (ARP, SL). This work was (co)financed by the Netherlands Consortium for Systems Biology (NCSB) which is part of the Netherlands Genomics Initiative/Netherlands Organisation for Scientific Research (MK, CTE).</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>Pathways are commonly used as models for understanding biological processes. WikiPathways
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup> is an open, collaborative, wiki-based website for the curation of biological pathways that are more than just images. WikiPathways provides easy-to-use drawing and annotation tools to capture identities, relationships, comments and literature references for each pathway element and interaction. Contributed pathways are displayed like articles at WikiPathways and can be downloaded manually or programmatically through web services. This opens the possibility for pathway information to be accessed by other software tools for data visualization, computational analysis and the interpretation of large-scale experimental data.</p>
            <p>Utilizing WikiPathways web services, we developed an app for Cytoscape
                <sup>
                    <xref ref-type="bibr" rid="ref-2">2</xref>
                </sup>, a network visualization and analysis software platform. The app queries and imports pathways from WikiPathways within the Cytoscape environment. Cytoscape&#x2019;s core concepts are networks (nodes and edges), tables (rows and columns) and styles, which map table values to the visual properties of networks. Cytoscape leverages a rich ecosystem of apps to provide additional domain-specific semantics and data types, as well as custom visualization and analysis capabilities. With the WikiPathways app, we implemented two ways to represent a pathway as a Cytoscape network. In the first way, pathways are loaded with the complete visual appearance of the original at WikiPathways, including graphical annotations and labels. Once in Cytoscape, experimental data can be loaded as tables and visually mapped onto these pathway-style networks to provide biological context. In the second way, pathways are loaded as simplified networks, focusing on the biological entities and their interactions without any of the graphical elements of the original pathway diagram. The basic network style is ideal for topological analyses, network merging and automatic layout.</p>
            <p>In this paper we present the implementation and usage of the WikiPathways app for Cytoscape. By bringing pathways into Cytoscape using the WikiPathways app, it is possible to make full use of pathway models with custom visualizations and computational analyses.</p>
        </sec>
        <sec>
            <title>Implementation</title>
            <p>The WikiPathways app was developed for Cytoscape 3, which introduced a completely new software architecture. The new architecture is built on top of Open Service Gateway Initiative (OSGi)
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>
                </sup>, a software framework of pluggable modules and services. To be able to take advantage of the new architecture (Cytoscape API version 3.0.0), the predecessor to the WikiPathways app, the GPML Plugin, had to be rewritten.</p>
            <sec>
                <title>Pathway import</title>
                <p>The WikiPathways app employs the new architecture of Cytoscape in two ways. First, the app exports a user interface that can query and import pathways from the WikiPathways web service. Thanks to the service architecture in Cytoscape, this interface is seamlessly incorporated into Cytoscape&#x2019;s &#x201c;Import from Public Databases&#x201d; dialog. Second, the app provides an API for programmatic access to the WikiPathways web services and the GPML file importer. Other apps can use the API to make queries to the WikiPathways web services and import GPML files without having to bundle the WikiPathways app. When the WikiPathways app is loaded in Cytoscape, the app registers the implementation of its API with the OSGi module system. Other apps can then request the API implementation through OSGi.</p>
            </sec>
            <sec>
                <title>Visualization</title>
                <p>The new architecture also posed new challenges that required us to innovate with respect to visual styles. The new architecture includes a revamped model to represent networks. This model decouples the network topology and table data from its visual style. Visual styles constitute Cytoscape&#x2019;s view model. When a node or edge is created in the network model, its view object is only created after a triggering of an event. Cytoscape does this to avoid redrawing of the network canvas while an app is still in process of building the network. Indeed, as the WikiPathways app reads a GPML file, it creates a series of nodes and edges in a network to represent the pathway. During this process, the app needs to assign visual styles to the nodes and edges it creates. However, as new nodes and edges are being added to the network, their view objects do not exist yet, making it impossible to assign their visual styles. To address this issue, we created a class called 
                    <bold>DelayedVizProp</bold> that stores our desired visual styles for nodes and edges. Once the network has been fully built, the app tells Cytoscape to create the view objects for the new nodes and edges. After that, the app looks through the 
                    <bold>DelayedVizProp</bold> instances and assigns nodes and edges their desired visual style.</p>
            </sec>
            <sec>
                <title>Dependencies</title>
                <p>The app relies on the PathVisio core library
                    <sup>
                        <xref ref-type="bibr" rid="ref-4">4</xref>
                    </sup> to read GPML files. The PathVisio library is included in the app. In previous versions of Cytoscape, apps that included libraries often conflicted with each other. Users had to painstakingly uninstall conflicting apps for Cytoscape to become usable again. OSGi solves this problem by insulating Cytoscape modules and apps from each other. Due to OSGi&#x2019;s architecture in Cytoscape 3, the integrated PathVisio library is hidden from other apps and modules in Cytoscape and cannot conflict with them.</p>
                <p>The app also uses the Apache HTTP Client library to make HTTP requests to the WikiPathways REST server. We avoided the Java built-in HTTP client class (
                    <bold>java.net.HttpURLConnection</bold>), which is used frequently in Cytoscape and other apps. This class does not support cancellation. Proper cancellation is important for a responsive user interface. Users behind an interrupted internet connection should be able to back out of a WikiPathways request and return to Cytoscape. Each HTTP request is wrapped in a task, a unit of work in Cytoscape. When the user clicks cancel during the task execution, the app terminates the underlying HTTP request by calling the abort method in the Apache HTTP Client library.</p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>The WikiPathways app in Cytoscape provides convenient access to the community-curated collection of biological pathways at WikiPathways. The functionality of the app is demonstrated here using the human Cardiac Hypertrophic Response pathway from WikiPathways (
                <ext-link ext-link-type="uri" xlink:href="http://wikipathways.org/instance/WP2795">http://wikipathways.org/instance/WP2795</ext-link>) combined with an unpublished RNA-seq dataset that reflects gene expression levels during differentiation of cardiac stem cells (see 
                <xref ref-type="other" rid="B1">Dataset 1</xref>). The logFC from 
                <italic toggle="yes">timepoint 6 hrs vs control</italic> is visualized on the pathway. The human Cardiac Hypertrophic Response pathway contains gene products and metabolites involved in the intracellular signal-transduction pathways that coordinate Cardiac Hypertrophic Response. As described above, the WikiPathways app allows users to load pathways in two different views, as an annotated pathway and as a simple network (see 
                <xref ref-type="fig" rid="f1">Figure 1</xref> and 
                <xref ref-type="fig" rid="f2">Figure 2</xref>). The example dataset and pathway will be used to explain how both views can be used in Cytoscape.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>The Cardiac Hypertrophic Response pathway loaded as a pathway.</title>
                    <p>LogFC values are visualized as node fill color with a color gradient from blue over white to red. Significant measurements (adjusted p-value &lt; 0.05) are highlighted with a green border color. Elements in the pathway without a measurement are colored grey.</p>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4555/c004f370-e4ea-41ea-890c-4060a81e1570_figure1.gif"/>
            </fig>
            <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                <label>Figure 2. </label>
                <caption>
                    <title>The Cardiac Hypertrophic Response pathway loaded as a network.</title>
                    <p>(
                        <bold>A</bold>) The simple network does not contain graphical annotations of the pathway. (
                        <bold>B</bold>) NetworkAnalyzer was used to visualize node degree and betweenness of the nodes in the network to identify important hub nodes. (
                        <bold>C</bold>) The logFC of the example dataset is visualized as node fill color with a gradient (blue over white to red) and the adjusted p-value &lt; 0.05 is highlighted with a green border color. (
                        <bold>D</bold>) jActiveModules finds active subnetworks (highlighted in purple) that are affected by varying gene expression.</p>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4555/c004f370-e4ea-41ea-890c-4060a81e1570_figure2.gif"/>
            </fig>
            <p>When loaded as a pathway, the precise layout of elements is identical to its representation at WikiPathways. The graphical elements, like labels and shapes, are included in the model in Cytoscape. As a pathway diagram, the full representation of biological information is visually preserved, which is ideal for providing a meaningful context for data visualization. 
                <xref ref-type="fig" rid="f1">Figure 1</xref> shows the Cardiac Hypertrophic Response pathway loaded as an annotated pathway in Cytoscape. The Entrez Gene identifiers in the pathway were mapped to Ensembl using another app called BridgeDb (
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/bridgedb">http://apps.cytoscape.org/apps/bridgedb</ext-link>) to match the identifiers used in the example dataset. The cardiac stem cell tissue development expression data can then be loaded, integrated and visualized on the pathway nodes (c.f. Introduction to Cytoscape tutorial, 
                <ext-link ext-link-type="uri" xlink:href="http://opentutorials.cgl.ucsf.edu/index.php/Tutorial:Introduction\_to\_Cytoscape\_3.1-part2">http://opentutorials.cgl.ucsf.edu/index.php/Tutorial:Introduction\_to\_Cytoscape\_3.1-part2</ext-link>).</p>
            <p>When loaded as a network, all graphical annotations are removed and redundant nodes in the pathway are merged into one unique node in the network. Groups and complex interactions are visualized as very small nodes and a forced directed layout is applied. As an abstracted network graph, the same molecular relationships in the pathways can be made available for network analysis and augmentation. 
                <xref ref-type="fig" rid="f2">Figure 2A</xref> shows the Cardiac Hypertrophic Response pathway loaded as a network in Cytoscape. This simple network structure enables researchers to use other Cytoscape features and apps to merge two pathways, apply different layouts to the network or extend the pathway, for example, with regulatory interactions (CyTargetLinker
                <sup>
                    <xref ref-type="bibr" rid="ref-5">5</xref>
                </sup>, 
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/cytargetlinker">http://apps.cytoscape.org/apps/cytargetlinker</ext-link>). It also enables users to investigate the topology of the network, like calculating degree and betweenness of the nodes with Cytoscape&#x2019;s built-in NetworkAnalyzer tool to identify important hub nodes, see 
                <xref ref-type="fig" rid="f2">Figure 2B</xref>. Cytoscape also allows the visualization of experimental data in the network, as in 
                <xref ref-type="fig" rid="f2">Figure 2C</xref> which shows the cardiac stem cell tissue development expression data. There are several apps available for Cytoscape that provide methods that use experimental data to cluster nodes in the network (clusterMaker2, 
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/clustermaker2">http://apps.cytoscape.org/apps/clustermaker2</ext-link>) or find subregions in the network affected by varying gene expression (jActiveModules, 
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/jactivemodules">http://apps.cytoscape.org/apps/jactivemodules</ext-link>) as highlighted in 
                <xref ref-type="fig" rid="f2">Figure 2D</xref>.</p>
            <p id="B1">
                <supplementary-material id="DS0" orientation="portrait" position="float" xlink:href="https://f1000researchdata.s3.amazonaws.com/datasets/4254/0aaa85d9-d594-48a0-b366-84d217dcbc80_dataset.xlsx">
                    <label>Dataset studying differentiation of cardiac stem cells</label>
                    <caption>
                        <p>This is a subset of an unpublished RNA-seq dataset containing measurements for all genes in the selected Cardiac Hypertrophy Response pathway comparing &#x201c;time point 6 hrs vs. control&#x201d;. The dataset contains logFC, p-value and adjusted p-value measurements for every gene in the pathway.</p>
                    </caption>
                </supplementary-material>
            </p>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusions</title>
            <p>In this paper we presented the WikiPathways app for Cytoscape, which allows the import of biological pathways as curated diagrams or as basic node-and-edge networks into Cytoscape. As shown in some examples, the app enables users to make full use of the pathway models by performing computational analyses and custom visualizations based on experimental data and network topology.</p>
        </sec>
        <sec>
            <title>Software availability</title>
            <p>Software available from the Cytoscape App Store: 
                <ext-link ext-link-type="uri" xlink:href="http://apps.cytoscape.org/apps/wikipathways">http://apps.cytoscape.org/apps/wikipathways</ext-link>
            </p>
            <p>Latest source code: 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/wikipathways/cytoscape-wikipathways-app">https://github.com/wikipathways/cytoscape-wikipathways-app</ext-link>
            </p>
            <p>Source code as at the time of publication: 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/F1000Research/cytoscape-wikipathways-app">https://github.com/F1000Research/cytoscape-wikipathways-app</ext-link>
            </p>
            <p>Archived source code as at the time of publication: 
                <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5281/zenodo.10204">http://dx.doi.org/10.5281/zenodo.10204</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-7">7</xref>
                </sup>
            </p>
            <p>License: Lesser GNU Public License 3.0: 
                <ext-link ext-link-type="uri" xlink:href="https://www.gnu.org/licenses/lgpl.html">https://www.gnu.org/licenses/lgpl.html</ext-link>
            </p>
        </sec>
        <sec>
            <title>Data availability</title>
            <p>The data referenced by this article are under copyright with the following copyright statement: Copyright: &#x00ef;&#x00bf;&#x00bd; 2014 Kutmon M et al.</p>
            <p>Data associated with the article are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).
                <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/"/>
            </p>
            <p>F1000Research: Dataset 1. Dataset studying differentiation of cardiac stem cells, 
                <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5256/f1000research.4254.d28415">10.5256/f1000research.4254.d28415</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup>
            </p>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgments</title>
            <p>We would like to thank Thomas Kelder for his work on the predecessor GPML plugin. Unpublished cardiac stem cell RNA-seq dataset courtesy of Dr. Bruce Conklin at the Gladstone Institutes.</p>
        </ack>
        <sec id="sm" sec-type="supplementary-material">
            <title>Supplementary materials</title>
            <fig fig-type="figure" id="sf1" orientation="portrait" position="float">
                <label>Supplementary Figure 1. </label>
                <caption>
                    <title>Human Cardiac Hypertrophic Response pathway from WikiPathways used in the manuscript: 
                        <ext-link ext-link-type="uri" xlink:href="http://wikipathways.org/instance/WP2795_r74825">http://wikipathways.org/instance/WP2795_r74825</ext-link>.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4555/c004f370-e4ea-41ea-890c-4060a81e1570_suppl_figure1.gif"/>
            </fig>
            <fig fig-type="figure" id="sf2" orientation="portrait" position="float">
                <label>Supplementary Figure 2. </label>
                <caption>
                    <title>
						
                        <xref ref-type="fig" rid="f2">Figure 2A</xref> in the WikiPathways App paper including all graphical details, e.g. Labels.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4555/c004f370-e4ea-41ea-890c-4060a81e1570_suppl_figure2.gif"/>
            </fig>
            <fig fig-type="figure" id="sf3" orientation="portrait" position="float">
                <label>Supplementary Figure 3. </label>
                <caption>
                    <title>
						
                        <xref ref-type="fig" rid="f2">Figure 2B</xref> in the WikiPathways App paper including all graphical details, e.g. Labels.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4555/c004f370-e4ea-41ea-890c-4060a81e1570_suppl_figure3.gif"/>
            </fig>
            <fig fig-type="figure" id="sf4" orientation="portrait" position="float">
                <label>Supplementary Figure 4. </label>
                <caption>
                    <title>
						
                        <xref ref-type="fig" rid="f2">Figure 2C</xref> in the WikiPathways App paper including all graphical details, e.g. Labels.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4555/c004f370-e4ea-41ea-890c-4060a81e1570_suppl_figure4.gif"/>
            </fig>
            <fig fig-type="figure" id="sf5" orientation="portrait" position="float">
                <label>Supplementary Figure 5. </label>
                <caption>
                    <title>
						
                        <xref ref-type="fig" rid="f2">Figure 2D</xref> in the WikiPathways App paper including all graphical details, e.g. Labels.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/4555/c004f370-e4ea-41ea-890c-4060a81e1570_suppl_figure5.gif"/>
            </fig>
        </sec>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Kelder</surname>
                            <given-names>T</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>van Iersel</surname>
                            <given-names>MP</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Hanspers</surname>
                            <given-names>K</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>WikiPathways: building research communities on biological pathways.</article-title>
                    <source>
						
                        <italic toggle="yes">Nucleic Acids Res.</italic>
					</source>
                    <year>2012</year>;<volume>40</volume>(<issue>Database issue</issue>):<fpage>D1301</fpage>&#x2013;<lpage>D1307</lpage>.
                    <pub-id pub-id-type="pmid">22096230</pub-id>
                    <pub-id pub-id-type="doi">10.1093/nar/gkr1074</pub-id>
                    <pub-id pub-id-type="pmcid">3245032</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Shannon</surname>
                            <given-names>P</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Markiel</surname>
                            <given-names>A</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Ozier</surname>
                            <given-names>O</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Cytoscape: a software environment for integrated models of biomolecular interaction networks.</article-title>
                    <source>
						
                        <italic toggle="yes">Genome Res.</italic>
					</source>
                    <year>2003</year>;<volume>13</volume>(<issue>11</issue>):<fpage>2498</fpage>&#x2013;<lpage>2504</lpage>.
                    <pub-id pub-id-type="pmid">14597658</pub-id>
                    <pub-id pub-id-type="doi">10.1101/gr.1239303</pub-id>
                    <pub-id pub-id-type="pmcid">403769</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="book">
                    <collab>OSGi Alliance</collab>.
                    <article-title>Osgi service platform, release 3</article-title>. IOS Press, Inc.,<year>2003</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.iospress.nl/book/osgi-service-platform-release-3/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>van Iersel</surname>
                            <given-names>MP</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Kelder</surname>
                            <given-names>T</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Pico</surname>
                            <given-names>AR</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Presenting and exploring biological pathways with PathVisio.</article-title>
                    <source>
						
                        <italic toggle="yes">BMC Bioinformatics.</italic>
					</source>
                    <year>2008</year>;<volume>9</volume>(<issue>1</issue>):<fpage>399</fpage>.
                    <pub-id pub-id-type="pmid">18817533</pub-id>
                    <pub-id pub-id-type="doi">10.1186/1471-2105-9-399</pub-id>
                    <pub-id pub-id-type="pmcid">2569944</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Kutmon</surname>
                            <given-names>M</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Kelder</surname>
                            <given-names>T</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Mandaviya</surname>
                            <given-names>P</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>CyTargetLinker: a cytoscape app to integrate regulatory interactions in network analysis.</article-title>
                    <source>
						
                        <italic toggle="yes">PLoS One.</italic>
					</source>
                    <year>2013</year>;<volume>8</volume>(<issue>12</issue>):<fpage>e82160</fpage>.
                    <pub-id pub-id-type="pmid">24340000</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pone.0082160</pub-id>
                    <pub-id pub-id-type="pmcid">3855388</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Kutmon</surname>
                            <given-names>M</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Lotia</surname>
                            <given-names>S</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Evelo</surname>
                            <given-names>CT</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>Dataset studying differentiation of cardiac stem cells.</article-title>
                    <source>
						
                        <italic toggle="yes">F1000Research.</italic>
					</source>
                    <year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5256/f1000research.4254.d28415">Data Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">
						
                        <name name-style="western">
                            <surname>Kutmon</surname>
                            <given-names>M</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Lotia</surname>
                            <given-names>S</given-names>
                        </name>
						
                        <name name-style="western">
                            <surname>Evelo</surname>
                            <given-names>CT</given-names>
                        </name>
						
                        <etal/>
					</person-group>:
                    <article-title>F1000Research/cytoscape-wikipathways-app.</article-title>
                    <source>
						
                        <italic toggle="yes">ZENODO.</italic>
					</source>
                    <year>2014</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5281/zenodo.10204">Data Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report5523">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.4555.r5523</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Goldstein</surname>
                        <given-names>Ted</given-names>
                    </name>
                    <xref ref-type="aff" rid="r5523a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r5523a1">
                    <label>1</label>Department of Biomolecular Engineering, University of California Santa Cruz, Santa Cruz, CA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>4</day>
                <month>8</month>
                <year>2014</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Goldstein T</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport5523" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.4254.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>You don't really make the point in the conclusions of the key findings of this excellent work which are:
                <list list-type="order">
                    <list-item>
                        <p>It is now possible to do something quickly that before was tedious and therefore would not be done by anyone, except the most determined and experienced Cytoscape user.</p>
                    </list-item>
                    <list-item>
                        <p>It is now possible to do something that could not be done before because you needed to add new functionality.</p>
                    </list-item>
                </list>I think it would be clearer that these are the main results if you add the following to the results section:</p>
            <p>I suggest that you make a before and after video. The before video is the experience of using Cytoscape, manually downloading the data from Wikipathways, &#x00a0;failing to see the the nodes because it does not have the DelayedVizProp class etc.</p>
            <p>Then the after video shows the full experience.</p>
            <p>The elapsed time of the before video is something like 10 minute while the after video is something like 1 or 2 minutes. This will clearly demonstrate the improvement in the user experience. &#x00a0;Please report these time numbers in the text in the results section and possibly summarize the numbers in the abstract.&#x00a0;</p>
            <p>Of course, also post these videos to both 
                <italic>F1000Research </italic>and Youtube as they represent the primary data of your study.</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment936-5523">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Pico</surname>
                            <given-names>Alexander</given-names>
                        </name>
                        <aff>Institute of Data Science and Biotechnology, Gladstone Institutes, San Francisco, CA, USA</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>7</day>
                    <month>8</month>
                    <year>2014</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Dr. Goldstein,</p>
                <p>Thank you for the enthusiastic review and suggestions. We have drafted a new conclusions paragraph to&#x00a0;include&#x00a0;in the next revision to the article, which should be posted very soon. Coincidentally, we were gearing&#x00a0;up to prepare a series of introductory videos for WikiPathways, each under 10&#x00a0;minutes&#x00a0;long. We will certainly have one covering the use of the WikiPathways app for Cytoscape and will link/post it here as well. Given limited time and resources, we might not get around to producing the "before" video, but we will describe the process for contrast. &#x00a0;In fact, the "before" approach is not so clear. There are many routes to transforming an&#x00a0;arbitrary&#x00a0;XML like GPML into a input file for Cytoscape,&#x00a0;ranging from the most basic SIF to the full xGMML formats. And for each format, one must make judgement calls and compromises, and ideally rely on someone with detailed knowledge of the source format. So, that approach could take anywhere from a day to a week of&#x00a0;scripting depending on&#x00a0;the desired accuracy and purpose. And, of&#x00a0;course, it takes months of planning and programming (like we did) to get the general-purpose app result we arrived at.</p>
                <p>Thanks again for highlighting these points and for your suggestions!</p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report5286">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.4555.r5286</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Grove</surname>
                        <given-names>Christian A</given-names>
                    </name>
                    <xref ref-type="aff" rid="r5286a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r5286a1">
                    <label>1</label>Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>2</day>
                <month>7</month>
                <year>2014</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2014 Grove CA</copyright-statement>
                <copyright-year>2014</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport5286" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.4254.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This paper is well written, clear and to-the-point. The title is appropriate and the abstract provides sufficient clarity and detail. The descriptions of the development, usage, and purpose of the WikiPathways App for Cytoscape are sufficiently detailed and informative for a bioinformatician such as myself. I cannot speak to the sufficiency of the detail of code and programming descriptions, although it seems reasonably complete. I've tested the App as the authors have described and found it to be easy to install and use with the set of descriptions and instructions provided on the source website and in this paper. All datasets and source code are easily obtainable with the links provided by the authors.</p>
            <p>I have found one small typo in the network/pathway which I have manually changed at the WikiPathways.org site: the original network referred to the node of a gene product as "PCL", which according to the cited reference and the position in the network is surely meant to represent "Phospholipase C" which has the canonical abbreviation of "PLC", in the citation for the network and in numerous previous studies. Unless I have made this observation in error, I would recommend changing this in the network and associated figures.</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
</article>
