<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="methods-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.73397.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Method Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Improved retinal vessel segmentation using the enhanced pre-processing method for high resolution fundus images</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 not approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Ali</surname>
                        <given-names>Aziah</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1597-5065</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Hussain</surname>
                        <given-names>Aini</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Wan Zaki</surname>
                        <given-names>Wan Mimi Diyana</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5808-4348</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Wan Abdul Halim</surname>
                        <given-names>Wan Haslina</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-9140-4040</uri>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Mohd Isa</surname>
                        <given-names>Wan Noorshahida</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Hashim</surname>
                        <given-names>Noramiza</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-9838-2892</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Faculty of Computing &amp; Informatics, Multimedia University, Cyberjaya, Selangor, 63100, Malaysia</aff>
                <aff id="a2">
                    <label>2</label>Faculty of Engineering &amp; Built Environment, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia</aff>
                <aff id="a3">
                    <label>3</label>Department of Ophthalmology, Universiti Kebangsaan Malaysia Medical Center, Cheras, Kuala Lumpur, 56000, Malaysia</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:aziah.ali@mmu.edu.my">aziah.ali@mmu.edu.my</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>1</day>
                <month>12</month>
                <year>2021</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>10</volume>
            <elocation-id>1222</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>26</day>
                    <month>10</month>
                    <year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Ali A et al.</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/10-1222/pdf"/>
            <abstract>
                <p>
                    <bold>Background</bold>: By diagnosing using fundus images, ophthalmologists can possibly detect symptoms of retinal diseases such as diabetic retinopathy, age-related macular degeneration, and retinal detachment. A number of studies have also found some links between fundus image analysis data and other underlying systemic diseases such as cardiovascular diseases, including hypertension and kidney dysfunction. Now that imaging technology is advancing further, more fundus cameras are currently equipped with the capability to produce high resolution fundus images. One of the public databases for high-resolution fundus images called High-Resolution Fundus (HRF) is consistently used for validating vessel segmentation algorithms. However, it is noticed that the segmentation outputs from the HRF database normally include noisy pixels near the upper and lower edges of the image. In this study, we propose an enhanced method of pre-processing the images so that these noisy pixels can be eliminated, and thus the overall segmentation performance can be increased. Without eliminating the noisy pixels, the visual segmentation output shows a large number of false positive pixels near the top and bottom edges.</p>
                <p>
                    <bold>Methods:</bold> The proposed method involves adding additional padding to the image before the segmentation procedure is applied. In this study, the Bar-Combination Of Shifted FIlter REsponses (B-COSFIRE) filter is used for retinal vessel segmentation.</p>
                <p>
                    <bold>Results:</bold> Qualitative assessment of the segmentation results when using the proposed method showed improvement in terms of noisy pixel removal from near the edges. Quantitatively, the additional padding step improves all considered metrics for vessel segmentation, namely Sensitivity (73.76%), Specificity (97.53%), and Matthew&#x2019;s Correlation Coefficient (MCC) value (71.57%) for the HRF database.</p>
                <p>
                    <bold>Conclusions:</bold> Findings from this study indicate improvement in the overall segmentation performance when using the proposed double-padding method of pre-processing the fundus image prior to segmentation. In the future, more databases with various resolutions and modalities can be included for further validation.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Pre-processing</kwd>
                <kwd>retinal vessel segmentation</kwd>
                <kwd>fundus image</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/501100003093">
                    <funding-source>Ministry of Higher Education, Malaysia</funding-source>
                    <award-id>FRGS/1/2020/TK0/MMU/03/15</award-id>
                </award-group>
                <funding-statement>This work was supported in part by a research grant from the Ministry of Higher Education, Malaysia under grant no. FRGS/1/2020/TK0/MMU/03/15.</funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>Introduction</title>
            <p>Retinal images play a very important role in ensuring the early detection of symptoms relating to ocular diseases. Early detection will in turn enable timely treatment of eye diseases, which in most cases may significantly decrease the patients&#x2019; risk of total vision loss.
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> With the global prevalence of eye diseases being gradually on the rise annually, the World Health Organization has encouraged nations to have routine retinal screening in place.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup> This is intended to diagnose diseases such as diabetic retinopathy (DR), glaucoma and age-related macular degeneration (AMD) early enough so treatment can be administered before worse disease progression.
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup> Most hospitals are equipped with fundus cameras that can be used to generate fundus images by imaging a patient&#x2019;s retina, samples of which are shown in 
                <xref ref-type="fig" rid="f1">Figure 1</xref>.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>Samples of fundus images from a) Digital Retinal Images for Vessel Extraction (DRIVE) database and b) High-Resolution Fundus (HRF) database.</title>
                </caption>
                <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/77045/73f18680-9748-4216-88ab-5dd9e51945d2_figure1.gif"/>
            </fig>
            <p>To assist ophthalmologists in performing efficient and accurate fundus image diagnosis, many studies have been conducted to automatically extract important parameters from a fundus image,
                <sup>
                    <xref ref-type="bibr" rid="ref4">4</xref>
                </sup>
                <sup>&#x2013;</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref9">9</xref>
                </sup> mainly focusing on automatic retinal blood vessel segmentation and then estimating vessel parameters from the segmentation output.
                <sup>
                    <xref ref-type="bibr" rid="ref10">10</xref>
                </sup>
                <sup>&#x2013;</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref12">12</xref>
                </sup> 
                <xref ref-type="fig" rid="f2">Figure 2</xref> shows a typical flow of blood vessel segmentation procedure.</p>
            <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                <label>Figure 2. </label>
                <caption>
                    <title>Processes involved in segmentation of retinal blood vessels from a fundus image (GCI = Green Channel Image, ROI = Region of Interest).</title>
                    <p>The blue-shaded box indicates the pre-processing steps focused in this study.</p>
                </caption>
                <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/77045/73f18680-9748-4216-88ab-5dd9e51945d2_figure2.gif"/>
            </fig>
            <p>For validation of the blood vessel segmentation methods, most researches apply their methods to data from two popular benchmark databases, namely Digital Retinal Images for Vessel Extraction (DRIVE)
                <sup>
                    <xref ref-type="bibr" rid="ref13">13</xref>
                </sup> and Structured Analysis of the Retina (STARE).
                <sup>
                    <xref ref-type="bibr" rid="ref14">14</xref>
                </sup> However, it should be noted that these databases consist of images which are at a much lower resolution when compared to the fundus images produced by current modern fundus cameras. The images in the DRIVE database have resolution of 565 by 584 pixels while images in STARE have resolution of 700 by 605 pixels. This is because the databases date back to the early 2000s, and the fundus cameras of the time did not have the capability to produce high resolution images.</p>
            <p>More recent studies have started to include databases with higher resolution fundus images, such as the High-Resolution Fundus (HRF) database.
                <sup>
                    <xref ref-type="bibr" rid="ref15">15</xref>
                </sup> The images in the HRF database have resolution of 3504 by 2336 pixels, markedly higher than images in the DRIVE and STARE databases. 
                <xref ref-type="fig" rid="f1">Figure 1b</xref> shows a sample image from the HRF database.</p>
            <p>From 
                <xref ref-type="fig" rid="f1">Figure 1</xref>, it can be seen that the region of interest (ROI) in the DRIVE image is surrounded by dark pixels. However, this is not the case with the image from the HRF database, 
                <xref ref-type="fig" rid="f1">Figure 1b</xref>. The top and bottom edges of the image are not surrounded by the dark area as in 
                <xref ref-type="fig" rid="f1">Figure 1a</xref>. This may result in noisy vessel segmentation output with false positive vessel pixels near the top and bottom images. To the best of our knowledge, this specific problem has not been addressed in the literature.</p>
            <p>In this study, we investigated a simple and efficient way to eliminate the noisy pixels in segmentation output for fundus images whose ROIs are not fully surrounded by dark pixels, such as the case with images in HRF database. The proposed method is to be applied in the pre-processing step of retinal blood vessel segmentation workflow, illustrated as the shaded blue box in 
                <xref ref-type="fig" rid="f2">Figure 2</xref>. In order to validate the effectiveness of the proposed pre-processing step, vessel segmentation procedure based on an adapted Bar-Combination Of Shifted FIlter REsponses (B-COSFIRE) filter that we previously published
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>
                </sup> is performed on the pre-processed output.</p>
        </sec>
        <sec id="sec2" sec-type="methods">
            <title>Methods</title>
            <p>Pre-processing is one of the key steps in retinal blood vessel segmentation techniques, which helps to ensure that the initial fundus image is optimised for the subsequent vessel detection phase. The original red green blue (RGB) format of digital fundus images is not the optimal form for the accurate detection of retinal blood vessels from an image processing point of view due to the natural colours in fundus images that poorly contrast with the retinal background vessels. Issues such as inconsistent illumination across the image, lesser contrast between retinal blood vessels and the retinal background as well as noisy images are other concerns that need to be addressed during the pre-processing step, so that the input image for the vessel segmentation step will be of better clarity in terms of retinal blood vessel structures.</p>
            <p>In this study, the pre-processing method employed by Soares
                <sup>
                    <xref ref-type="bibr" rid="ref17">17</xref>
                </sup> is used as the basis since it is considered the established method for this purpose.
                <sup>
                    <xref ref-type="bibr" rid="ref18">18</xref>
                </sup> 
                <xref ref-type="fig" rid="f3">Figure 3</xref> illustrates the overview of the pre-processing steps where the first step is to extract the green channel image (GCI) from the color fundus image. The GCI displays a noticeably better vessel appearance, while the red channel image shows low vessel-to-background contrast and the blue channel image displays low dynamic range making the vessels appear almost invisible. This decision to use only GCI is supported by most previously established methods used for segmenting retinal blood vessels from fundus images.
                <sup>
                    <xref ref-type="bibr" rid="ref18">18</xref>
                </sup>
                <sup>&#x2013;</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref21">21</xref>
                </sup> The original code for pre-processing and vessel segmentation using B-COSFIRE can be obtained 
                <ext-link ext-link-type="uri" xlink:href="https://www.mathworks.com/matlabcentral/fileexchange/49172-trainable-cosfire-filters-for-curvilinear-structure-delineation-in-images?s_tid=srchtitle">here</ext-link>.</p>
            <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                <label>Figure 3. </label>
                <caption>
                    <title>Workflow of pre-processing steps applied to a fundus image prior to retinal blood vessel segmentation procedure (GCI = Green Channel Image, ROI = Region of Interest).</title>
                </caption>
                <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/77045/73f18680-9748-4216-88ab-5dd9e51945d2_figure3.gif"/>
            </fig>
            <sec id="sec3">
                <title>ROI border padding</title>
                <p>As discussed earlier, the ROI for a fundus image is the colored region inside the circular region on the image. The ROI refers to the non-dark area in the middle of the fundus image, which shows the retina. There is a strong contrast between the ROI and the dark area surrounding the ROI from the extracted GCI. Thus, there is a high probability of detecting false vessel pixels for areas just outside the ROI. To minimise this effect on the segmentation output, Soares suggested that the ROI needs to be identified and expanded by padding it with additional interpolated pixels.
                    <sup>
                        <xref ref-type="bibr" rid="ref17">17</xref>
                    </sup>
                </p>
                <p>The procedure starts with converting the fundus image from RGB to the CIELab color scheme. CIELab is a way to represent colours using three numerical values, namely L*, a*, and b*.
                    <sup>
                        <xref ref-type="bibr" rid="ref22">22</xref>
                    </sup> For this ROI identification step, only the L* component or the luminosity component is used as it shows good contrast between the ROI and the black background. An optimum value for a threshold is then estimated using Otsu&#x2019;s method to transform the L* image into a mask image, as illustrated in 
                    <xref ref-type="fig" rid="f3">Figure 3</xref>. The white pixels (pixel value 1) are all the pixels in the ROI, while the black pixels are all the pixels outside the ROI (pixel value 0).</p>
                <p>The mask image is then used to locate the pixels that are located at one pixel distance from the outer border of the ROI in GCI using four-neighbourhood connectivity to define the neighbour pixels. After the set of neighbouring pixels is identified, the ROI is eroded by several pixels to minimise the contrast between the ROI and the artificial ROI region (padding) that is added in the next step. Then, the mean value for each of the pixels in the padding obtained earlier is calculated by considering eight-neighbourhood connectivity. Next, each original neighbouring pixel value is then replaced with the mean pixel value calculated in the previous step. This set of altered pixels is then included as part of the ROI, thus effectively enlarging the ROI by one pixel over the original border. These steps are repeated for a few iterations, where each iteration adds a one-pixel border to the ROI. In this study, the erosion size used is 5 pixels while the number of iteration used is 20 iterations, as applied by Azzopardi 
                    <italic toggle="yes">et al.</italic>
                    <sup>
                        <xref ref-type="bibr" rid="ref23">23</xref>
                    </sup> in their B-COSFIRE implementation.</p>
                <p>Using this method as proposed by Soares does not add any new pixels to the image, which means the original size is maintained and the top and bottom edges are still not surrounded by the dark pixels. It only converts the grayscale values of pixels surrounding the ROIs with values interpolated from the pixels just inside the ROI border. What we are proposing in this study is the addition of new pixel areas surrounding the original image, thus effectively adding to the resolution of the original image.</p>
            </sec>
            <sec id="sec4">
                <title>Double padding</title>
                <p>In our proposed method, prior to changing the values of the pixels just outside the ROI as in Soares&#x2019;s method, both the GCI and the mask image are padded with an additional 50 layers of zero-valued (black) pixels on all four borders, referred to as double padding. Using the information from these padded images as the input to the Soares&#x2019;s padding method, a double-padded image is then produced with the resolution increased by 100 pixels in both height and width. This image is then used to produce a contrast-adjusted image in the next step to highlight the vessel structures. This is the only difference from the original Soares method, which we will refer to as single padding.</p>
            </sec>
            <sec id="sec5">
                <title>Contrast adjustment</title>
                <p>After the border of the ROI is padded on the fundus image, the next step is to perform image enhancement on the padded fundus image, so that the vessel structures are enhanced in their appearance. A commonly used pre-processing method for fundus image analysis called contrast limited adaptive histogram equalisation or CLAHE
                    <sup>
                        <xref ref-type="bibr" rid="ref24">24</xref>
                    </sup> is employed in this study. CLAHE is a variation of the histogram equalisation (HE) method, which is a technique used to transform pixels on an image based on its histogram.</p>
                <p>This enhanced pre-processing step is performed on all 45 images in the HRF database before they are processed for segmenting the retinal blood vessels. To ensure validity and reliability, the standard performance metrics for vessel segmentation assessment are adopted to quantify the difference in segmentation performance with and without the proposed enhancement method.</p>
            </sec>
        </sec>
        <sec id="sec6" sec-type="results|discussion">
            <title>Results &amp; discussion</title>
            <p>As described in the introduction section, the modified B-COSFIRE
                <sup>
                    <xref ref-type="bibr" rid="ref16">16</xref>
                </sup> filter is used to extract the vessel features from the pre-processed output images. Sample outputs of the pre-processed images with their corresponding vessel feature images using the single padding and double padding pre-processing methods are displayed in 
                <xref ref-type="table" rid="T1">Table 1</xref>. By observing the HRF feature image produced using single padding in 
                <xref ref-type="table" rid="T1">Table 1</xref>, dark lines can be seen on both the top and bottom borders of the vessel feature image. These dark lines will be highly likely to be segmented as false vessel pixels when processed for segmentation. However, the vessel feature image produced using the double padding method does not have these dark lines, thus decreasing the possibility of having a large number of false positive vessel pixels.</p>
            <table-wrap id="T1" orientation="portrait" position="float">
                <label>Table 1. </label>
                <caption>
                    <title>Sample outputs of pre-processing steps applied to High-Resolution Fundus (HRF) images and the corresponding vessel feature images obtained using the Bar- Combination Of Shifted FIlter REsponses (B-COSFIRE) filter.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <tbody>
                        <tr>
                            <td colspan="1" rowspan="1">
                                <inline-graphic xlink:href="graphic1.gif"/>
                            </td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>Another visible improvement is in terms of the brightness level of vessel pixels in the double-padded vessel feature image as opposed to single-padded. To confirm that double padding is better than single padding for the purpose of vessel segmentation, another comparison is performed on segmentation results using the different padding methods.</p>
            <p>
                <xref ref-type="table" rid="T2">Table 2</xref> shows segmentation outputs using the different padding methods, together with their zoomed-in versions. Apart from the apparent improvement in much reduced noisy pixels on top and lower border of the ROI, subtle improvements in vessel appearance are also observed. In general, double padding helps in further enhancing the vessel features, with most vessels appearing brighter compared to single padding outputs, including the smaller vessels. It is found that using double padding in pro-processing results in the successful removal of false positive pixels near the top and bottom image borders of all 45 segmentation output images in the HRF database. In order to quantify the improvement of the segmentation performance when using the proposed method, 
                <xref ref-type="table" rid="T3">Table 3</xref> summarises the performance metrics for segmentation using the different padding methods. Following the metric selection in our previous study, four metrics are included, namely Sensitivity (Sn), Specificity (Sp), Balanced Accuracy (B-Acc) and Matthew&#x2019;s Correlation Coefficient (MCC).</p>
            <table-wrap id="T2" orientation="portrait" position="float">
                <label>Table 2. </label>
                <caption>
                    <title>Comparison of quantitative segmentation results using single and double padding for pre-processing.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <tbody>
                        <tr>
                            <td colspan="1" rowspan="1">
                                <inline-graphic xlink:href="graphic2.gif"/>
                            </td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <table-wrap id="T3" orientation="portrait" position="float">
                <label>Table 3. </label>
                <caption>
                    <title>Comparison of quantitative segmentation results using single and double padding for pre-processing (Sn = Sensitivity, Sp=Specificity, B-Acc = Balanced Accuracy, MCC = Matthew&#x2019;s Correlation Coefficient).</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="2" valign="top">Padding method</th>
                            <th align="left" colspan="4" rowspan="1" valign="top">Metric</th>
                        </tr>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Sn</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Sp</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">B-Acc</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">MCC</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Single</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.6461</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.9721</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.8091</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.6377</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Double</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.7376</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.9753</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.8564</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">0.7157</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>As expected, the application of double padding results in improved segmentation performance where performance values are increased across all the four considered metrics. This is attributed to the successful removal of the noisy pixels near the top and bottom borders of all images in HRF database, thus decreasing the number of false positive pixels and improving the overall segmentation performance.</p>
        </sec>
        <sec id="sec7" sec-type="conclusion">
            <title>Conclusion</title>
            <p>In this study, we proposed a simple but effective method to improve blood vessel segmentation performance for images with the ROI reaching the image borders. The simple method of adding additional layer of dark pixels around the image proves to be effective in removing the noisy pixels at the image borders. Quantitatively, the additional padding step also managed to improve all the four considered metrics for vessel segmentation, namely Sensitivity (73.76%), Specificity (97.53%), Balanced-Accuracy (85.64%) and MCC value (71.57%) for the HRF database. This method has only been validated on a single high-resolution fundus image database for now, so in the future more databases should be included for validation to attest the robustness of the proposed methods on multiple databases. The proposed improvement method, while simplistic in nature, could prove to be very effective in increasing overall vessel segmentation performance, particularly for images that are not fully surrounded by dark pixels such as HRF database images.</p>
        </sec>
        <sec id="sec8">
            <title>Data availability</title>
            <sec id="sec9">
                <title>Source data</title>
                <p>The HRF database can be accessed at 
                    <ext-link ext-link-type="uri" xlink:href="https://www5.cs.fau.de/research/data/fundus-images/">https://www5.cs.fau.de/research/data/fundus-images/</ext-link>.</p>
            </sec>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgments</title>
            <p>We would like to thank our collaborator from Department of Ophthalmology, Universiti Kebangsaan Malaysia Medical Center, especially Dr Wan Haslina and her team for their valuable inputs for this study.</p>
        </ack>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Flaxman</surname>
                            <given-names>SR</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Global causes of blindness and distance vision impairment 1990&#x2013;2020: a systematic review and meta-analysis.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Glob. Health.</italic>
</source>
                    <year>Dec. 2017</year>;<volume>5</volume>(<issue>12</issue>):<fpage>e1221</fpage>&#x2013;<lpage>e1234</lpage>.
                    <pub-id pub-id-type="pmid">29032195</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S2214-109X(17)30393-5</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yau</surname>
                            <given-names>JWY</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Global prevalence and major risk factors of diabetic retinopathy.</article-title>
                    <source>

                        <italic toggle="yes">Diabetes Care.</italic>
</source>
                    <year>2012</year>;<volume>35</volume>:<fpage>556</fpage>&#x2013;<lpage>564</lpage>.
                    <pub-id pub-id-type="pmid">22301125</pub-id>
                    <pub-id pub-id-type="doi">10.2337/dc11-1909</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3322721</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bernardes</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Serranho</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lobo</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>Digital Ocular Fundus Imaging: A Review.</article-title>
                    <source>

                        <italic toggle="yes">Ophthalmologica.</italic>
</source>
                    <year>Oct. 2011</year>;<volume>226</volume>(<issue>4</issue>):<fpage>161</fpage>&#x2013;<lpage>181</lpage>.
                    <pub-id pub-id-type="pmid">21952522</pub-id>
                    <pub-id pub-id-type="doi">10.1159/000329597</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Subramanya Jois</surname>
                            <given-names>SP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Harsha</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Harish Kumar</surname>
                            <given-names>JR</given-names>
                        </name>
</person-group>:
                    <article-title>Automatic Optic Disc Localization Using Particle Swarm Optimization Technique.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Region 10 Annual International Conference, Proceedings/TENCON.</italic>
</source>
                    <year>2019</year>; vol.<volume>2018-Octob</volume>: pp.<fpage>1718</fpage>&#x2013;<lpage>1722</lpage>.</mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fu</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Huang</surname>
                            <given-names>Z</given-names>
                        </name>
</person-group>:
                    <article-title>A review of retinal vessel segmentation and artery/vein classification.</article-title>
                    <source>

                        <italic toggle="yes">Lecture Notes in Electrical Engineering.</italic>
</source>
                    <year>2018</year>;<volume>459</volume>:<fpage>727</fpage>&#x2013;<lpage>737</lpage>.
                    <pub-id pub-id-type="doi">10.1007/978-981-10-6496-8_66</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Noor</surname>
                            <given-names>NM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Khalid</surname>
                            <given-names>NEA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ariff</surname>
                            <given-names>NM</given-names>
                        </name>
</person-group>:
                    <article-title>Optic cup and disc color channel multi-thresholding segmentation.</article-title>
                    <source>

                        <italic toggle="yes">Proceedings - 2013 IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2013.</italic>
</source>
                    <year>2013</year>; pp.<fpage>530</fpage>&#x2013;<lpage>534</lpage>.</mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Khan</surname>
                            <given-names>MAU</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Carmichael</surname>
                            <given-names>JN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sarirete</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Thin Vessel Detection and Thick Vessel Edge Enhancement to Boost Performance of Retinal Vessel Extraction Methods.</article-title>
                    <source>

                        <italic toggle="yes">Procedia Computer Science.</italic>
</source>
                    <year>2019</year>;<volume>163</volume>:<fpage>618</fpage>&#x2013;<lpage>638</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.procs.2019.12.144</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Abramoff</surname>
                            <given-names>MD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Garvin</surname>
                            <given-names>MK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sonka</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Retinal imaging and image analysis.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Rev. Biomed. Eng.</italic>
</source>
                    <year>2010</year>;<volume>3</volume>:<fpage>169</fpage>&#x2013;<lpage>208</lpage>.
                    <pub-id pub-id-type="pmid">22275207</pub-id>
                    <pub-id pub-id-type="doi">10.1109/RBME.2010.2084567</pub-id>
                    <pub-id pub-id-type="pmcid">PMC3131209</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nunley</surname>
                            <given-names>KA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Long-term changes in retinal vascular diameter and cognitive impairment in type 1 diabetes.</article-title>
                    <source>

                        <italic toggle="yes">Diab. Vasc. Dis. Res.</italic>
</source>
                    <year>May 2018</year>;<volume>15</volume>(<issue>3</issue>):<fpage>223</fpage>&#x2013;<lpage>232</lpage>.
                    <pub-id pub-id-type="pmid">29488397</pub-id>
                    <pub-id pub-id-type="doi">10.1177/1479164118758581</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chalakkal</surname>
                            <given-names>RJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Abdulla</surname>
                            <given-names>WH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hong</surname>
                            <given-names>SC</given-names>
                        </name>
</person-group>:
                    <chapter-title>Fundus retinal image analyses for screening and diagnosing diabetic retinopathy, macular edema, and glaucoma disorders.</chapter-title>
                    <source>

                        <italic toggle="yes">Diabetes and Fundus OCT.</italic>
</source>
                    <publisher-name>Elsevier</publisher-name>;<year>2020</year>; pp.<fpage>59</fpage>&#x2013;<lpage>111</lpage>.</mixed-citation>
            </ref>
            <ref id="ref11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mittal</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rajam</surname>
                            <given-names>VMA</given-names>
                        </name>
</person-group>:
                    <article-title>Computerized retinal image analysis - a survey.</article-title>
                    <source>

                        <italic toggle="yes">Multimed. Tools Appl.</italic>
</source>
                    <year>Aug. 2020</year>;<volume>79</volume>(<issue>31&#x2013;32</issue>):<fpage>22389</fpage>&#x2013;<lpage>22421</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s11042-020-09041-y</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Garg</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gupta</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Retinal blood vessel segmentation algorithms: A comparative survey.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Bio-Science Bio-Technology.</italic>
</source>
                    <year>2016</year>;<volume>8</volume>:<fpage>63</fpage>&#x2013;<lpage>76</lpage>.
                    <pub-id pub-id-type="doi">10.14257/ijbsbt.2016.8.3.07</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Staal</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Abr&#x00e0;moff</surname>
                            <given-names>MD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Niemeijer</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Ridge-based vessel segmentation in color images of the retina.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Trans. Med. Imaging.</italic>
</source>
                    <year>2004</year>;<volume>23</volume>(<issue>4</issue>):<fpage>501</fpage>&#x2013;<lpage>509</lpage>.
                    <pub-id pub-id-type="pmid">15084075</pub-id>
                    <pub-id pub-id-type="doi">10.1109/TMI.2004.825627</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hoover</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Trans. Med. Imaging.</italic>
</source>
                    <year>2000</year>;<volume>19</volume>(<issue>3</issue>):<fpage>203</fpage>&#x2013;<lpage>210</lpage>.
                    <pub-id pub-id-type="pmid">10875704</pub-id>
                    <pub-id pub-id-type="doi">10.1109/42.845178</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Budai</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bock</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Maier</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Robust Vessel Segmentation in Fundus Images.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Biomed. Imaging.</italic>
</source>
                    <year>Dec. 2013</year>;<volume>2013</volume>:<fpage>1</fpage>&#x2013;<lpage>11</lpage>.
                    <pub-id pub-id-type="doi">10.1155/2013/154860</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ali</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zaki</surname>
                            <given-names>WMDW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hussain</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Retinal blood vessel segmentation from retinal image using B-COSFIRE and adaptive thresholding.</article-title>
                    <source>

                        <italic toggle="yes">Indones. J. Electr. Eng. Comput. Sci.</italic>
</source>
                    <year>Mar. 2019</year>;<volume>13</volume>(<issue>3</issue>):<fpage>1199</fpage>&#x2013;<lpage>1207</lpage>.
                    <pub-id pub-id-type="doi">10.11591/ijeecs.v13.i3.pp1199-1207</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Soares</surname>
                            <given-names>JVB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Leandro</surname>
                            <given-names>JJG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cesar</surname>
                            <given-names>RM</given-names>
                            <suffix>Jr</suffix>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification.</article-title>
                    <source>

                        <italic toggle="yes">Medical Imaging.</italic>
</source>
                    <year>2006</year>;<volume>25</volume>(<issue>9</issue>):<fpage>1214</fpage>&#x2013;<lpage>1222</lpage>.
                    <pub-id pub-id-type="pmid">16967806</pub-id>
                    <pub-id pub-id-type="doi">10.1109/TMI.2006.879967</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Moccia</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>De Momi</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>El Hadji</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Blood vessel segmentation algorithms &#x2014; Review of methods, datasets and evaluation metrics.</article-title>
                    <source>

                        <italic toggle="yes">Comput. Methods Prog. Biomed.</italic>
</source>
                    <year>May 2018</year>;<volume>158</volume>:<fpage>71</fpage>&#x2013;<lpage>91</lpage>.
                    <pub-id pub-id-type="pmid">29544791</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.cmpb.2018.02.001</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fraz</surname>
                            <given-names>MM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Blood vessel segmentation methodologies in retinal images &#x2013; A survey.</article-title>
                    <source>

                        <italic toggle="yes">Comput. Methods Prog. Biomed.</italic>
</source>
                    <year>2012</year>;<volume>108</volume>(<issue>1</issue>):<fpage>407</fpage>&#x2013;<lpage>433</lpage>.
                    <pub-id pub-id-type="pmid">22525589</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.cmpb.2012.03.009</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Roseline</surname>
                            <given-names>RH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Priyadarsini</surname>
                            <given-names>RJ</given-names>
                        </name>
</person-group>:
                    <article-title>Survey on Ocular Blood Vessel Segmentation.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Adv. Res. Comput. Sci. Softw. Eng.</italic>
</source>
                    <year>2017</year>;<volume>7</volume>:<fpage>318</fpage>.
                    <pub-id pub-id-type="doi">10.23956/ijarcsse/V7I7/0114</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Badar</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Haris</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fatima</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Application of deep learning for retinal image analysis: A review.</article-title>
                    <source>

                        <italic toggle="yes">Computer Science Review.</italic>
</source>
                    <year>01-Feb-2020</year>; vol.<volume>35</volume>: p.<fpage>100203</fpage>.
Elsevier Ireland Ltd.
                    <pub-id pub-id-type="doi">10.1016/j.cosrev.2019.100203</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zhang</surname>
                            <given-names>X</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wandell</surname>
                            <given-names>BA</given-names>
                        </name>
</person-group>:
                    <article-title>A spatial extension of CIELAB for digital color-image reproduction.</article-title>
                    <source>

                        <italic toggle="yes">J. Soc. Inf. Disp.</italic>
</source>
                    <year>1997</year>;<volume>5</volume>:<fpage>61</fpage>.
                    <pub-id pub-id-type="doi">10.1889/1.1985127</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Azzopardi</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Strisciuglio</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vento</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Trainable COSFIRE filters for vessel delineation with application to retinal images.</article-title>
                    <source>

                        <italic toggle="yes">Med. Image Anal.</italic>
</source>
                    <year>2015</year>;<volume>19</volume>(<issue>1</issue>):<fpage>46</fpage>&#x2013;<lpage>57</lpage>.
                    <pub-id pub-id-type="pmid">25240643</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.media.2014.08.002</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pizer</surname>
                            <given-names>SM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Adaptive Histogram Equalization and its Variations.</article-title>
                    <source>

                        <italic toggle="yes">Comput. Vision, Graph. Image Process.</italic>
</source>
                    <year>Sep. 1987</year>;<volume>39</volume>(<issue>3</issue>):<fpage>355</fpage>&#x2013;<lpage>368</lpage>.
                    <pub-id pub-id-type="doi">10.1016/S0734-189X(87)80186-X</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report148528">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.77045.r148528</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Ibrahim</surname>
                        <given-names>Haidi</given-names>
                    </name>
                    <xref ref-type="aff" rid="r148528a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r148528a1">
                    <label>1</label>School of Electrical and Electronic Engineering, Universiti Sains Malaysia, Kubang Kerian, Malaysia</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>1</day>
                <month>12</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Ibrahim H</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport148528" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73397.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>reject</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This paper describes a simple modification towards a pre-processing method, originally proposed by Soares et al.,ref 17, to improve the edge detection outputs for retinal fundus images. The improvement is by adding zero-padding of size 50 pixels at each border of the image (thus, the image's height and width are increased by 100 pixels). However, there are some comments about this paper: 
                <list list-type="order">
                    <list-item>
                        <p>Is this method only applicable for high resolution fundus images (as stated in the title)? Or it can also be used for DRIVE and STARE datasets?</p>
                    </list-item>
                    <list-item>
                        <p>A brief description on the edge detection method used, B-COSFIRE, should be given.</p>
                    </list-item>
                    <list-item>
                        <p>Last sentence, before Section "Methods". "In order to validate the effectiveness of the proposed pre-processing step, vessel segmentation procedur ebased on an adapted Bar-Combination Of Shifted FIlter REsponses (B-COSFIRE) filter that we previously published [16] is performed on the pre-processed output." This sentence indicates that B-COSFIRE was proposed by the authors. Yet, the source code's link provided in the line before "ROI border padding", shows that the filter was proposed by other researchers, i.e., Azzopardi et al. [23]. (As in the source code page, the paper should also cite one more paper: [2] "N. Strisciuglio, G. Azzopardi, M. Vento, and N. Petkov" - Supervised vessel delineation in retinal fundus images with the automatic selection of B-cosfire filters. Machine Vision and Applications.&#x00a0; doi:10.1007/s00138-016-0781-7
                            <sup>
                                <xref ref-type="bibr" rid="rep-ref-148528-1">1</xref>
                            </sup>). Thus, the sentence should be rephrased.</p>
                    </list-item>
                    <list-item>
                        <p>Double padding is the main contribution of the paper. Thus, Section "Double Padding" should be elaborated more. For example, why the authors chose 50 layers, and not other number? Besides, better to explain why double padding can change the segmentation outcome, theoretically. Is the padding size related to the image size?</p>
                    </list-item>
                    <list-item>
                        <p>In Table 1, the main differences are the edges on the top and bottom part of the image. How crucial the blood vessels at the borders for the diagnosis? If they are not crucial, can we just remove the edges, by masking?&#x00a0;</p>
                    </list-item>
                    <list-item>
                        <p>In Table 2, the Zoomed-in versions are actually not from the same region. They are slightly different. Please check carefully.</p>
                    </list-item>
                    <list-item>
                        <p>In Table 2, why the edges are different? Would be nice if the authors could explain on how the double padding can modify the segmentation outcome.</p>
                    </list-item>
                    <list-item>
                        <p>Better to provide equations for Sn, Sp, B-Acc, and MCC.</p>
                    </list-item>
                    <list-item>
                        <p>In the Acknowledgement, the authors (which also include Dr Wan Haslina), acknowledge Dr Wan Haslina. Seems like an author to thank herself. If the contributions by Dr Wan Haslina is not adequate as a co-author, please remove from the list of authors. On the other hand, if Dr Wan Haslina contributes to the writing of this paper, please remove the acknowledgement.</p>
                    </list-item>
                    <list-item>
                        <p>From 24 references, only 6 (i.e., 25%) are from year 2019 and above. There are no papers from year 2021 and 2022. Please add more recent journal publications.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the rationale for developing the new method (or application) clearly explained?</p>
            <p>Yes</p>
            <p>Is the description of the method technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions about the method and its performance adequately supported by the findings presented in the article?</p>
            <p>Yes</p>
            <p>If any results are presented, are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Are sufficient details provided to allow replication of the method development and its use by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Digital image processing</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-148528-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Supervised vessel delineation in retinal fundus images with the automatic selection of B-COSFIRE filters</article-title>.
                        <source>
                            <italic>Machine Vision and Applications</italic>
                        </source>.<year>2016</year>;<volume>27</volume>(<issue>8</issue>) :
                        <elocation-id>10.1007/s00138-016-0781-7</elocation-id>
                        <fpage>1137</fpage>-<lpage>1149</lpage>
                        <pub-id pub-id-type="doi">10.1007/s00138-016-0781-7</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report155703">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.77045.r155703</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Yong San Lim</surname>
                        <given-names>Gilbert</given-names>
                    </name>
                    <xref ref-type="aff" rid="r155703a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-5381-9250</uri>
                </contrib>
                <aff id="r155703a1">
                    <label>1</label>Singapore Eye Research Institute, Singapore, Singapore</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>1</day>
                <month>12</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Yong San Lim G</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport155703" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73397.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>reject</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This paper introduces a double-padding enhancement to the commonly-known Soares pre-processing pipeline (referred to as single-padding), which is applied to retinal images before vessel segmentation. Experiments with the B-COSFIRE filter before and after these two padding methods are claimed to produce a significant improvement in vessel segmentation performance (Table 3). However, there are a number of concerns: 
                <list list-type="order">
                    <list-item>
                        <p>In the Introduction section, both DRIVE and HRF images are shown, and STARE is also discussed. However, the actual experiments appear to only take place for HRF images. As such, it might be considered to use actual HRD data in the figures (e.g. Figure 2), and to describe the actual number of images and training/validation/test splits used for the HRF data in producing the results (Table 3).</p>
                    </list-item>
                    <list-item>
                        <p>In the ROI border padding section, it is stated that the proposal in the study is the addition of new pixel areas surrounding the original image, thus effectively adding to the resolution of the original image. This might be explained in greater detail, perhaps using a figure.</p>
                    </list-item>
                    <list-item>
                        <p>On Table 2, other than the difference at the top edge, double padding appears to predict an additional blob, just slightly below the centre of the zoomed-in image. It might be explained as to how this happened, since double-padding would appear to differ at the edges only.</p>
                    </list-item>
                    <list-item>
                        <p>Table 3 claims a large improvement in sensitivity for double vs. single padding (0.7376 vs. 0.6461), with next to no change in specificity. However, as understood, double-padding should reduce the number of pixels predicted as part of the vessels, due to reducing noise, which is also observed in Table 2 where the double padded image has much less noise at the top edge. This would seem to improve specificity instead of sensitivity.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the rationale for developing the new method (or application) clearly explained?</p>
            <p>Yes</p>
            <p>Is the description of the method technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions about the method and its performance adequately supported by the findings presented in the article?</p>
            <p>Partly</p>
            <p>If any results are presented, are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Are sufficient details provided to allow replication of the method development and its use by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Computer vision, machine learning</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.</p>
        </body>
    </sub-article>
</article>
