ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article

Sickle cell segmentation and classification for thalassemia aid diagnosis

[version 1; peer review: 1 approved, 1 approved with reservations]
PUBLISHED 23 Nov 2021
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Research Synergy Foundation gateway.

This article is included in the Sickle Cell Disease collection.

Abstract

Background: Thalassemia is a hereditary blood disease in which abnormal red blood cells (RBCs) carry insufficient oxygen throughout the body. Conventional methods of thalassemia detection through a complete blood count (CBC) test and peripheral blood smear image still possess a lot of weaknesses.
Methods: This paper proposes a hybrid segmentation method to segment the RBCs. It incorporates adaptive thresholding and canny edge method to segment the RBCs. Morphological operations are performed to clean the leftovers. Shape and texture features are extracted using the segmented masks and the gray level co-occurrence matrix. Data imbalance treatment is used for solving the imbalance cell type class in distribution. In the data resampling layer, the synthetic minority oversampling technique (SMOTE), adaptive synthetic sampling (ADASYN), and random over sampling (ROS) are performed and evaluated using the decision tree and logistic regression. In the classification layer, the decision tree, random forest classifier and support vector machine (SVM) are assessed and compared for the best performance in classification.
Results:The proposed method outperforms the other methods in the image segmentation layer with the structural similarity index measure (SSIM) of 89.88%. In the data resampling layer, ADASYN is employed as it is more accurate than the SMOTE and ROS. The random forest classifier is chosen at the classification layer as it is more accurate than the decision tree and support vector machine (SVM).
Conclusions:The proposed method is tested on the latest dataset of erythrocyteIDB3 and it solves the issues of imbalanced data due to the insufficient cell classes.

Keywords

Red Blood Cell, Thalassemia, Image processing, Image Segmentation, Morphological Operations, Feature Extraction, Data Resampling, Machine Learning

Introduction

Sickle cell disease is a hereditary disease that disrupts the efficiency of RBCs to carry sufficient oxygen to the body. Traditional methods to detect this disease relied on hematologists manually counting RBCs and classifying them based on their topologies. This has motivated us to explore and develop an automated process to detect the presence of the disease. However, this field poses a lot of challenges such as insufficient medical data, poor extraction methods, and the tedious pipeline-related issues.

This paper aims to solve some of the aforementioned problems. Firstly, a hybrid segmentation method is presented to accurately segment the RBCs. Next, the data imbalance treatment is used to solve the imbalance cell type class in a distribution manner. The pipeline of the paper includes the comparison between the conventional methods in the image segmentation layer, data resampling layer and the classification layer. The proposed method involves the image acquisition, image pre-processing, image segmentation, morphological operations, image cropping and manual classification, feature extraction, data resampling, and classification. The aim is to create a workflow that is able to detect the presence of thalassemia by recognizing the types of RBCs.

Related work

In image pre-processing, Rashid et al.1 and Das et al.2 employed a mixture of global contrast techniques, median blurring and color space conversion to increase the contrast. Color channel conversion is used to filter the unwanted cells in the image.

In image segmentation layer, an inter-combination of the thresholding, edge-based, region-based, clustering-based and artificial neural network (ANN) is used to perform the segmentation. Sharma et al.3 compared different techniques of thresholding; their findings showed that Otsu’s thresholding performed the best among other thresholding methods. This concurred with the observation done by Das et al.2 Marked water controlled segmentation was used to solve the segmentation of cells in.2,4 Tyagi et al.5 indicated that the Canny Edge technique was better at filtering noise presented in the image. Achargee et al.6 used Hough transformation (HT) to detect cells with varying diameter, while Seth and Palodhi7 proposed a modified version of the HT to detect white blood cells (WBC).

Feature extraction in cell morphology are classified into boundary and region descriptors. Some of the features may overlap, but generally, boundary descriptors deal with the morphology of the RBCs and region descriptors extract the geometric and texture properties. Lotfi et al.4 used Fourier descriptors to represent cell morphology. Tyagi et al.5 used shape features such as area, perimeter solidity, eccentricity to describe the cells. Other features involved extracting the moment invariant such as invariant to scaling, translation and rotation were proposed by Lofti et al.4 Since the introduction of deep learning, many skipped this layer due to the models can automatically extract the features. Fadhel et al.8 proposed extracting features from the last fully connected layers and subsequently fed the features into the support vector machine (SVM) classifier. Purwar et al.9 proposed a hybrid method of features extracted from the convolutional neural network (CNN) models15-17 and hand clinical features extracted from a CBC test.

Hortinela et al.10 and Safca et al.11 used SVM to classify cells based on features extracted from different layers. In multiclass classification, Lotfi et al.4 compared the K-nearest neighbors and SVM method using the one versus all approach and found that SVM performed better. In a seperate study, Dalvi et al.12 showed that an ANN with ten hidden nodes and five output nodes performed better than decision tree. Tyas et al.13 used ANN with momentum backpropagation and produced the best results among the classifiers.

Methods

Ethical approval number: EA1542021

Ethical approval body: Research Ethic Committee 2021, Multimedia University

Image acquisition

The dataset used in this project was obtained from the erythrocytesIDB by Pedro et al.14 It is selected because of the image clarity and optimal cell size. Each subdirectory contains the raw image, ground truth labels, and binary segmented masks. Figure 1 shows the raw blood smear images and its ground truth label for two images.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure1.gif

Figure 1. Raw image and ground truth label.

Image pre-processing

As many of the images are extracted using different extraction techniques, to increase the quality of the images while standardizing all of the images, firstly, the images are contrastly increased by using the contrast limited adaptive histogram equalization (CLAHE) method. The image is primarily converted to L.A.B. color space. The L, which refers to the luminance channel is operated by CLAHE and is then merged back with the other two channels.

Next, median filtering is applied to remove noise in the image. An unsharped mask operation is applied to sharpen the edges of the cells which are previously lost during the median filtering process. Image subtraction is then constructed from the original image to obtain the details and the edges. Figure 2 depicts the result after the pre-processed layer of the two images.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure2.gif

Figure 2. Image before and after pre-processing.

Image segmentation

A hybrid technique is proposed by merging the adaptive thresholding and the canny edge detection method. Gaussian adaptive thresholding is employed to segment the color images with varying intensities. However, this method unable to capture the edges of the cells. An additional of the canny edge detection method with the parameter of μ to be set to a lower value is applied. This allows the cell edges to be captured precisely and subsequently to be added to the threshold binary image later.

Lastly, the leftover edges that are protruding out are removed to show a clean finish. Figure 3 shows the result of the segmentation layer compared to the ground truth given from the dataset. The evaluation of this layer is performed by calculating the SSIM index of the binary segmented image with the ground truth binary given in the dataset.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure3.gif

Figure 3. Segmented image to be compared with the ground truth mask.

Morphological operations

Morphological operations are performed on binary images to clean up the leftover noises from the previous layers. A hole-filling operation is performed to close up the holes that are created using the canny edge detection method. Next, binary opening is used to remove the small particles that are presented in the image. Finally, cells that are located at the border are removed because they do not accurately provide the full feature description of the cell. Figure 4 depicts the result of the morphological operations.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure4.gif

Figure 4. Image after morphological operations to be compared with the ground truth mask.

Image cropping and classification

Each of the cells in the microscopic blood sample images are cropped using the masks that are segmented from the previous layers. Figure 5 shows the individual cells that are being cropped, while Figure 6 depicts the sub-category of one particular cell. Each of the cropped cells has their own directory which is named based on their origin and cell number as depicted in Figure 7. The cells are manually classified into their own class which is based on the classification given by Pedro et al.14

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure5.gif

Figure 5. Cells that are being cropped.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure6.gif

Figure 6. Sub-directory of one cell.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure7.gif

Figure 7. Directory of the circular cells.

Feature extraction

Two types of features are extracted: shape features and texture features.

The shape features are extracted from the individually cropped masks and then to be combined into a data frame. The features extracted include the area, perimeter, major axis length, minor axis length, eccentricity, and the seven moment invariants immune to the scaling, translation, and rotation. Additional shape features which are circulatory factor and elliptical factor are calculated.

Next, texture features are extracted using the gray level co-occurrence matrix (GLCM). The features extracted from the textures are the contrast, dissimilarity, homogeneity, ASM, energy and correlation.

Finally, the two features are merged into a data frame with its correct label of either one of the three classes: circular, elongated, or other cells.

Data resampling

The number of circulars, elongated and other types of cells total up to 316, 53 and 59 respectively. This dataset is imbalanced and may result the classifier to be overfit or bias to certain category of data.

The synthetic minority oversampling technique (SMOTE), adaptive synthetic sampling (ADASYN) and random over sampling (ROS) are evaluated by using two classifiers, which are logistic regression and decision tree. Figure 8 shows the number of classes prior and after the resampling process. The bottom graph of Figure 8 demonstrations the best result for solving the imbalanced problem using ADASYN resampling technique.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure8.gif

Figure 8. ADASYN data resampling.

Classification

In classification, a total of three classifiers are trained and compared. The chosen classifiers are the decision tree, random forest and the support vector machine.

The models are evaluated using the classification report which contains the information of accuracy, precision, recall f1-score and support.

For each classifier, the receiver operating characteristic (ROC) curve is plotted to observe the results. The images that are excluded before the sampling process are tested individually for their accuracy and reliability of the model chosen.

Results and discussion

Image segmentation layer

The ground truth masks are provided in the dataset. The evaluation are calculated based on the structural similarity index (SSIM) between the ground truth masks and the segmentation of the proposed method.

The average of the computed SSIM index from each image is 89.88%. However, it is worth noting that the value only estimates how well the segmentation is. In Figure 9, observing the ground truth mask, some cells are not presented in the ground truth mask (middle image), while it is presented in the proposed segmented image (right most image).

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure9.gif

Figure 9. Cells missing in ground truth mask.

Data resampling layer

Figure 10 shows the comparison of the resampling techniques between the SMOTE, ADASYN and ROS. Based on the result, logistic regression handles the unbalanced data-sets well as compared with the decision tree. ADASYN outperforms the rest at 84.49% of its accuracy through the logistic regression classifier. Also worth noting is that, even with the unbalanced dataset, its accuracy sits highly at 82.17%, which indicates that the features extracted optimally best describe the types of cells (Figure 11).

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure10.gif

Figure 10. Comparison of different sampling techniques.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure11.gif

Figure 11. Resampling techniques evaluation bar plot.

Classification

The classification layer is evaluated based on the accuracy of the classification report and the ROC curve of each classifier. Figures 12 to 14 depict the model evaluation summary for each of the classifiers.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure12.gif

Figure 12. Decision tree model evaluation.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure13.gif

Figure 13. Random forest model evaluation.

cea941d8-9a9b-4770-9f4e-b0d50ee02c53_figure14.gif

Figure 14. SVM model evaluation.

From the results, the random forest classifier performs the best with the accuracy of 90% while the others are below 90%.

The ROC curve for the SVM dips below the threshold where the number of incorrectly classified classes are more than the correctly classified classes, which indicates a bad classifier.

Comparing the area under curve (AUC) of the ROC curve, the random forest classifier covers the most area for all the three cell classes of the circular, elongated and other types of cell, which demonstrates a superior classifier.

Conclusion

We performed several comparisons and the implementation between different techniques in the segmentation layer, data resampling layer and the classification layer. These provide a good working pipeline for a complete aiding diagnosis for the sickle cell disease detection. The whole pipeline provides a precise classification for each of the cells in microscopic blood smeared images with a 90–95% of accuracy on average.

In addition, we present a strong baseline in the segmentation layer, which is able to detect some of the missing cells that were not presented in the previous work. At the same time, the data resampling layers are added to observe the effect of an unbalanced medical dataset. The combination of different models exhibits the performance of the best classification model.

Author contributions

Leow YS, Ng KW, Yoong YJ and Ng SB conceived the presented idea. Leow YS carried out the experiment and wrote the manuscript. Ng KW, Yoong YJ and Ng SB supervised the project and provided feedback.

Data availability

Underlying data

Data were obtained by permission from http://erythrocytesidb.uib.es/.

Data samples were obtained from volunteer patients. This dataset was not generated nor is it owned by the authors of this article; the listed owners are Universidad de Oriente, Cuba, and Universitat de les Illes Balears, Spain. Therefore, neither the authors nor F1000Research are responsible for the content of this dataset and cannot provide information about data collection.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 23 Nov 2021
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Leow YS, Ng KW, Yoong YJ and Ng SB. Sickle cell segmentation and classification for thalassemia aid diagnosis [version 1; peer review: 1 approved, 1 approved with reservations]. F1000Research 2021, 10:1185 (https://doi.org/10.12688/f1000research.73314.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 23 Nov 2021
Views
2
Cite
Reviewer Report 17 Feb 2025
Frederik Christensen, Aalborg University, Aalborg, Denmark 
Approved with Reservations
VIEWS 2
The authors clearly states the objectives of the study and introduces a comparative analysis of different data preprocessing techniques, resampling methods and classification methods for segmenting Red Blood Cells. The final hybrid model shows great and promising results. 

... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Christensen F. Reviewer Report For: Sickle cell segmentation and classification for thalassemia aid diagnosis [version 1; peer review: 1 approved, 1 approved with reservations]. F1000Research 2021, 10:1185 (https://doi.org/10.5256/f1000research.76957.r362042)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
7
Cite
Reviewer Report 09 Feb 2022
Naresh Babu Muppalaneni, National Institute of Technology Silchar, Silchar, Assam, India 
Approved
VIEWS 7
The authors have done extensive and novel work to bring this scientific work. 

For Sickle cell, the circulatory feature is important, which is considered by authors in the feature set. The authors have extracted features based on ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Muppalaneni NB. Reviewer Report For: Sickle cell segmentation and classification for thalassemia aid diagnosis [version 1; peer review: 1 approved, 1 approved with reservations]. F1000Research 2021, 10:1185 (https://doi.org/10.5256/f1000research.76957.r100976)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 23 Nov 2021
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.