ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article
Revised

Age, neutrophil lymphocyte ratio, and radiographic assessment of the quantity of lung edema (RALE) score to predict in-hospital mortality in COVID-19 patients: a retrospective study

[version 2; peer review: 2 approved]
PUBLISHED 06 Jan 2021
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Emerging Diseases and Outbreaks gateway.

This article is included in the Coronavirus (COVID-19) collection.

Abstract

Background: Available data suggest that case fatality rate of COVID-19 patients in Surabaya is higher than global cases. Thus, it is important to identify risk factors to prevent the mortality. This study aimed to assess the factors associated with hospital mortality of COVID-19 patients, and develop a prediction score based on these findings.
Methods: We analyzed 111 patients, who were diagnosed with COVID-19 based on reverse-transcriptase polymerase chain reaction. The following patient characteristics were obtained from records: age, gender, type of symptoms, onset of symptoms, neutrophil lymphocyte ratio (NLR), absolute lymphocyte count, chest x-ray abnormalities, lung involvement, type of lesion, radiographic assessment of the quantity of lung edema (RALE) score, and mortality. Data were analyzed using SPSS 25.0.
Results Multivariate analysis showed that age >50 years (p=0.043), NLR score >5.8 (p=0.016) and RALE score >2 (p=0.002) can predict the mortality of COVID-19 patients in the hospital. ROC curve analysis of the score ability to predict mortality showed an area under the curve of 0.794. The cut-off point is 4.5, with a sensitivity of 96.7% and specificity of 49.4% to predict the mortality of COVID-19 patient in the hospital.
Conclusions Age, NLR score and RALE score were associated with mortality of COVID-19 patients in the hospital and might be used as a predictor for mortality of COVID-19 patients in health care centre where radiologists are available. The prediction score may be useful for frontline physicians to effectively manage patients with a higher score to prevent mortality.

Keywords

COVID-19 mortality, NLR, RALE Score

Revised Amendments from Version 1

Abstract: we have added the sentence “might be used as a predictor for mortality of COVID-19 patients in health care centre where radiologists are available” on the conclusions section.
Introduction: we have added the sentences “Several factors may associate with the higher CFR such as low testing, low contact tracing and poor COVID-19 register (Sorci et al., 2020). However, finding characteristics and risk factors to predict mortality is of utmost importance in order to prevent the mortality. It is also important to develop a prediction score to assess patients during early stages, when patients receive treatment at tertiary hospitals” on the second paragraph and “to assess the demographical characteristic, laboratory and radiological findings associated with COVID-19 mortality in hospital patients” on the last paragraph.
Discussion: we have added the sentences “Another study in Indonesia found a similar result where the average age of COVID-19 patients who died is 58.2 years old (Rozaliyani et al., 2020)” and “This study also showed that the mortality risk is three times higher in people age ≥50 years. This finding is similar to a study in the United States, which found that the mortality risk of COVID-19 was 8.1 times higher among those ≥55 years compared with individuals ages <54 years (Yanez et al., 2020).” On the second paragraph. We also added term “RALE score” on the sixth paragraph.
Conclusions: we have added the sentence “It may be used as a predictor for mortality of COVID-19 patients in the health care centre where radiologists are available”.

See the authors' detailed response to the review by Wiwien Heru Wiyono

Introduction

Cases of pneumonia of unknown etiology were first reported in the city of Wuhan, China, at the end of December 2019. After identification, the etiology of these cases was a new type of coronavirus (Wang et al., 2020). The World Health Organization officially called this coronavirus disease 2019 (COVID-19) (WHO, 2020). COVID-19 is caused by severe acute respiratory syndrome coronavirus-2 (SARS-Co-V2) virus (Gorbalenya et al., 2020).

Since December 2019, more than 20 million people have been diagnosed with COVID-19, and more than 700,000 have died (Worldometers, 2020). In Indonesia, 128,776 people have been diagnosed with COVID-19, and 83,710 have died since March 2020 (Gugus Tugas Percepatan Penanganan COVID-19, 2020). The global case fatality rate (CFR) of COVID-19 in August was 3.7%. In Indonesia, the CFR is slightly higher (4.5%). Meanwhile, the CFR in Surabaya (the second biggest city in Indonesia) is almost twice that of Indonesia for the same period (8.9%). Several factors may associate with the higher CFR such as low testing, low contact tracing and poor COVID-19 register (Sorci et al., 2020). However, finding characteristics and risk factors to predict mortality is of utmost importance in order to prevent the mortality. It is also important to develop a prediction score to assess patients during early stages, when patients receive treatment at tertiary hospitals.

Several studies have found risk factors related to COVID-19 mortality (Galloway et al., 2020; Gupta et al., 2020; Jalili et al., 2020; Lippi & Plebani, 2020; Zhao et al., 2020). However, currently, there is no study that analyzes risk factors for COVID-19 mortality in hospitals for the Indonesian population. Existing prediction scores also based on complex laboratory findings, which are less feasible to be used in low resource health centers. Therefore, the purpose of this study was to assess the demographical characteristic, laboratory and radiological findings associated with COVID-19 mortality in hospital patients and develop a prediction score based on these findings.

Methods

Study design and setting

This was a retrospective study that was conducted in the Emergency Department of Airlangga University Teaching Hospital. We included all the patients who fulfilled the inclusion and exclusion criteria, who were admitted for COVID-19 from March 13, 2020 to May 15, 2020. A total of 111 patients met the criteria and included in this study.

We collected data regarding clinical symptoms and the date of onset of symptoms from emergency department medical records.

Patients

The inclusion criteria for this retrospective study were: (1) patients with a chief complaint of one COVID-19-related symptom, including: fever, dry cough, tiredness, aches and pains, nasal congestion, headache, conjunctivitis, sore throat, diarrhea, loss of taste or smell, a rash on skin, or discoloration of fingers or toes (WHO, 2020); (2) confirmed SARS-CoV-2 infection by reverse-transcriptase polymerase chain reaction (RT PCR) using nasopharyngeal and oropharyngeal specimens; (3) patients who underwent chest x-ray (CXR) on the day of admission to the hospital.

The following patients were excluded: (1) asymptomatic patients; (2) those with negative results for SARS-CoV-2 infection by RT-PCR.

All patients underwent CXR and laboratory examination on the day of admission to the emergency department.

Subgrouping of patients

Patients were divided into two groups based on the outcome of the patient: group I (discharged with negative results for SARS-CoV-2 infection by RT-PCR test); and group II (died).

Data collection

The following patient characteristics were obtained from the medical records: age, gender, type of symptoms, onset of symptoms, neutrophil lymphocyte ratio (NLR), absolute lymphocyte count (ALC), CRX abnormalities, lung involvement, type of lesion, radiographic assessment of the quantity of lung edema (RALE) score, and mortality.

Image acquisition and evaluation. Radiology data was collected from the radiology department. All the patients underwent an anteroposterior projection chest radiography at full inspiration where possible. The results were reviewed by two radiologists (A.D.S, a radiologist with 25 years of experience and E.S, a radiologist with four years of experience) based on consensus.

CXRs were evaluated for the presence of pulmonary alterations, type of pulmonary alterations, and their distribution. CXR alterations that were found specifically in COVID-19 patients were defined according to the Fleischner Society’s nomenclature, available in the Glossary of Terms for Thoracic Imaging (Hansell et al., 2008), as follows:

-     Reticular alteration: a reticular pattern is a collection of innumerable small linear opacities that, by summation, produce an appearance resembling a net

-     Consolidation: as a homogeneous increase in pulmonary parenchymal attenuation that obscures the margins of vessels and airway walls

-     Ground-glass opacity (GGO): an area of hazy increased lung opacity, usually extensive, within which margins of pulmonary vessels may be indistinct

The distribution of pulmonary alterations was classified as lung involvement unilateral (right/left) or bilateral. Other features, such as pleural effusion, were also recorded.

Radiograph scoring. A severity score was calculated to quantify the extent of the infection by adapting and simplifying the RALE score proposed by Warren et al. (2018). A score of 0-4 was assigned to each lung depending on the extent of involvement by consolidation or GGO (0 = no involvement; 1 = <25%; 2 = 25-50%; 3 = 50-75%; 4 = >75% involvement). The scores for each lung were summed to produce the final RALE score.

Statistical analysis

Statistical analysis was performed using IBM SPSS Statistics Version 25.0. Continuous variables were expressed as mean ± standard deviation values. The frequency of symptoms, laboratory findings and CXR findings was shown as the number of incidence and percentage per cluster of groups. The correlation between the patient characteristic, symptoms, laboratory findings and CXR findings with the outcome was analyzed by logistic regression. We also conducted the Hosmer-Lemeshow test to evaluate the goodness of fit of the scoring model and conducted receiver operating characteristic (ROC) analysis to evaluate the sensitivity and specificity of the model.

Ethical considerations

This study received ethical approval from the Ethical Committee of Airlangga University Teaching Hospital (approval number 147/KEP/2020). Consent from the participants was waived by the committee.

Results

Patient characteristics

A total of 111 COVID-19 patients were evaluated. In total, 72.9% (n=81) of patients were discharged from the hospital, while 27.1% (30) patients died during their hospitalization. There were 45 men (48.6%) and 47 women (51.4%). Average patient age was 51±14.2 years old. The mean age for the patients who died was higher (55±12.8 years) compared to the patients who were discharged (48±14.8 years). Fever (32.6%) and shortness of breath (26%) were the most frequent symptoms for all patients. However, among the patients who died, shortness of breath was the most frequent symptom (40.7%). The mean NLLR score is higher on the patient who died (10.1 ±10.5) compared to patients who were discharged (5.3 ±5.4). In contrast, the mean ALC score was lower in patients who died (1130±252) compared to patients who were discharged (1349±702). Most of the patients showed GGO on their CXR (67.6%). Mean RALE score was higher in patients who died (5.3±2.5) compared to patients who were discharged (2.7±2.7) (Table 1).

Table 1. Patient characteristics.

VariablesAll patients
(n=111)
Discharged
(n=81)
Died
(n=30)
n%n%n%
Mean age ±SD50 ±14.648 ±14.855 ±12.8
Gender
  Men5448.63948.11550.0
  Women5751.44251.91550.0
Clinical symptoms
  Fever3632.43037.0620.0
  Cough2219.82024.726.7
  Fatigue119.989.9310.0
  Shortness of breath2926.11619.81343.3
  Headache32.700.0310.0
  Abdominal pain32.722.513.3
  Chest pain21.811.213.3
  Vomiting10.911.200.0
  Hemoptysis10.911.200.0
  Nausea21.822.500.0
  Unconscious10.900.013.3
Laboratory findings
  Mean NLR ±SD6.6 ±7.25.3 ±5.410.1±10.5
  Mean ALC ±SD1290 ±6641349 ±7021130± 252
Type of lesion
    GGO7567.65365.42273.3
    Reticular alteration109.067.4413.3
    Fibrotic10.900.013.3
    Pleural effusion65.444.926.7
Mean RALE score
±SD
3.4 ±2.82.7 ± 2.75.3 ± 2.5

Risk factors of mortality

From Table 2, no significant relationship was observed between the outcome of the patients based on gender, type of symptoms, onset of symptoms, ALC score, x-ray abnormalities, and type of lesion. This suggested that those variables have no predictive value for mortality outcome for COVID-19 patients. There is a significant relationship between age, NLR score, lung involvement and RALE score towards the outcome of the patients (p-value <0.05). All of these variables were analyzed using logistic regression, which revealed there are three variables with p<0.05: age, NLR score and RALE score (Table 3).

Table 2. Risk factors of COVID-19 hospital mortality.

VariablesDischarged
(n=81)
Died
(n=30)
p-Value
n%n%
Age0.009
  50 years4758.0930.0
  >50 years3442.02170.0
Gender0.862
  Male3948.11550.0
  Female4251.91550.0
Type of symptoms0.548
  Respiratory4353.11446.7
  Non-respiratory3644.41653.3
Onset of the symptoms0.473
  ≤ 3 days3745.71653.3
  >3 days4454.31446.7
Laboratory findings
  NLR Score0.002
  ≤5.86074.11240.0
  >5.82125.91860.0
  ALC Score0.093
  ≤10002429.61446.7
  >10005770.41653.3
CXR abnormalities0.055
  Negative chest radiography2227.2310.0
  Positive chest radiography5972.82790.0
Lung involvement0.007
  Unilateral2429.6413.3
  Bilateral3543.22376.7
Type of lesion0.430
  GGO5365.42273.3
  Non-GGO2834.6826.7
RALE Score0.001
  ≤24555.6413.3
  >23644.42686.7

Table 3. Logistic regression.

p-ValueOR95% CI
Age0.0432.7871.032-7.531
NLR Score0.0163.2461.241-8.487
Lung involvement0.9651.0240.356-2.946
RALE Score0.0026.8262.076-22.444

Based on the odds ratio (OR) value of each variable, the mortality risk for patients who were of an older age is 2.787 times higher than patients who were of a younger age. A higher NLR score has a 3.246 times higher mortality risk than patients who have lower NLR score. Mortality risk for patients who have a higher RALE score is 6.826 times higher than patients who have lower RALE score. It should be noted that three patients died while showing no abnormalities on their CXR.

Prediction of mortality

We form a scoring model based on the OR of each variable, which can be seen in Table 4. If the variable were present, we gave the value of “1”, and if absent we gave the value of “0”. We also performed the Hosmer-Lemeshow test and concluded that the model is fit (p=0.802). Based on our scoring model, each score from 111 patients was calculated. The percentage of mortality was then calculated for each score. Table 5 shows that high mortality (>60%) was seen for a total score of 13, while low mortality (<10%) was seen for a total score ≤3.

Table 4. Scoring model to predict the mortality of the patient.

Age >50 years3
NLR Score >5.83
RALE Score >27

Table 5. Probability of mortality based on the total score.

Total
Score
Probability
of mortality
00%
36.7%
637.5%
726.7%
1038.7%
1362.5%

The total score was then analyzed with ROC analysis to predict the sensitivity and specificity for the probability of mortality of COVID-19 patients in the hospital. Figure 1 shows that based on the ROC curve, the area under the curve (AUC) of the score is 0.794. The score has a cut off point of 4.5, with a sensitivity of 96.7% and specificity of 49.4%, to predict the mortality of COVID-19 patients in the hospital.

7d9c713a-fe50-4027-b580-8c49995941fe_figure1.gif

Figure 1. ROC curve analysis for the scoring model to predict the mortality in COVID-19 patients.

Discussion

This is the first study to analyze the radiologic and laboratory findings of COVID-19 patients in Indonesia. The main result of our study was that age, NLR score and RALE score have a strong relationship for mortality risk of COVID-19 patients in the hospital.

This study found that the average age of COVID-19 patients who died is 55 ±12.8 years. Another study in Indonesia found a similar result where the average age of COVID-19 patients who died is 58.2 years old (Rozaliyani et al., 2020). This finding is younger than a study in Iraq, who found that the average age of COVID-19 patients who died in hospital is 67.49 ± 15.28 years (Jalili et al., 2020). The younger average age of the patients who died might be due to the co-morbidities that also develop in the relatively younger age of the Indonesian population, especially for type 2 diabetes (Arifin et al., 2019). This study also showed that the mortality risk is three times higher in people age ≥50 years. This finding is similar to a study in the United States, which found that the mortality risk of COVID-19 was 8.1 times higher among those ≥55 years old compared with individuals ages <54 years (Yanez et al., 2020).

Based on our findings, there is no correlation between gender and patient mortality. The result is different from studies in the United States and Iran, which conclude that men has a higher risk of death than women (Gupta et al., 2020; Jalili et al., 2020). This could be due to the characteristic of the co-morbidities of the Indonesian population, which affect both men and women at an almost similar number (Kemenkes, 2019). We also found that there is no correlation between type and onset of symptoms to the outcome of the patients.

There is a correlation between NLR score and the patient outcome. Previously, it was concluded that higher NLR score related to the severe illness of the patients and could be an early identification for patient assessment in the early stage for intensive care unit (Liu et al., 2020; Yang et al., 2020). Our study showed that the higher NLR score (>5.8) would increase the risk of mortality by three times. In contrast, we found no correlation between ALC score and patient mortality in the hospital. However, various other research shows that low ALC score is related to disease severity for patients admitted to the hospital for COVID-19 (Wagner et al., 2020) and a higher risk of mortality (Lippi & Plebani, 2020).

This study showed that there is no correlation for CXR abnormalities, lung involvement and type of lesion to COVID-19 mortality in the hospital. Interestingly, we also found that three patients (10%) who died showed normal CXR. This could be due to the lower sensitivity of CXR to detect lung lesions compare to CT scan. However, it also shows that COVID-19 could become severe rapidly even though patients have normal CXR on the day of the admission.

Interestingly, we found that RALE score is correlated with patient mortality, and a higher score (>2) will increase mortality risk by seven times. This finding is consistent with another study in the United Kingdom with a larger sample size, which showed that higher radiological severity score (>3) increased the incidence of critical admission or death (Galloway et al., 2020). RALE score in CXR could become a key predictor of mortality because of the simplicity of modality and is broadly available across health care provider.

The prediction score developed in this study demonstrated good accuracy (AUC of 79.4) to predict the discharged probability of COVID-19 patients in the hospital with only three simple parameters. Another score showed good accuracy (AUC of 83) with more complicated parameters, such as health failure, procalcitonin, lactate dehydrogenase, chronic obstructive pulmonary disease, pulse oxygen saturation, heart rate, and age (Zhao et al., 2020). This suggests that our score can be used in a broader setting such as locations with low resource of health care service.

Limitations

This study only analyzes patient characteristics, and laboratory and radiology findings related to COVID-19 mortality in the hospital. We do not evaluate the co-morbidities of the patient and the hospital setting, such as the location of the treatment where the patient died (emergency room, intensive care, low care), or the resource (facilities, human resource, intervention).

Conclusions

Age, NLR score and RALE score were associated with mortality of COVID-19 patients in our hospital setting in an Indonesian population. It may be used as a predictor for mortality of COVID-19 patients in the health care centre where radiologists are available. The prediction score may be useful for physicians to determine the mortality risk of a patient with COVID-19.

Data availability

Underlying data

Figshare: datasheet f1000research 2909.xlsx, https://doi.org/10.6084/m9.figshare.13017899.v1 (Sensusiati, 2020).

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 30 Oct 2020
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Sensusiati AD, Amin M, Nasronudin N et al. Age, neutrophil lymphocyte ratio, and radiographic assessment of the quantity of lung edema (RALE) score to predict in-hospital mortality in COVID-19 patients: a retrospective study [version 2; peer review: 2 approved]. F1000Research 2021, 9:1286 (https://doi.org/10.12688/f1000research.26723.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 06 Jan 2021
Revised
Views
13
Cite
Reviewer Report 25 Jan 2021
Wiwien Heru Wiyono, Department of Pulmonology and Respiratory Medicine, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia 
Approved
VIEWS 13
I have read the revised version and I ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Wiyono WH. Reviewer Report For: Age, neutrophil lymphocyte ratio, and radiographic assessment of the quantity of lung edema (RALE) score to predict in-hospital mortality in COVID-19 patients: a retrospective study [version 2; peer review: 2 approved]. F1000Research 2021, 9:1286 (https://doi.org/10.5256/f1000research.33024.r76665)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Version 1
VERSION 1
PUBLISHED 30 Oct 2020
Views
25
Cite
Reviewer Report 20 Nov 2020
Wiwien Heru Wiyono, Department of Pulmonology and Respiratory Medicine, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia 
Approved with Reservations
VIEWS 25
There are some statements in this paper that are not so accurate.

Introduction:

My comment:
To reduce the mortality rate in some hospitals in Surabaya is not by finding characteristics and risk factors ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Wiyono WH. Reviewer Report For: Age, neutrophil lymphocyte ratio, and radiographic assessment of the quantity of lung edema (RALE) score to predict in-hospital mortality in COVID-19 patients: a retrospective study [version 2; peer review: 2 approved]. F1000Research 2021, 9:1286 (https://doi.org/10.5256/f1000research.29506.r74043)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 06 Jan 2021
    Anggraini Dwi Sensusiati, Department of Radiology, Airlangga University Teaching Hospital, Surabaya, 60115, Indonesia
    06 Jan 2021
    Author Response
    The authors thank the Honorable Reviewer 2 for the excellent review of the paper and in-depth suggestions made to improve the quality of the paper. Followings are the responses to ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 06 Jan 2021
    Anggraini Dwi Sensusiati, Department of Radiology, Airlangga University Teaching Hospital, Surabaya, 60115, Indonesia
    06 Jan 2021
    Author Response
    The authors thank the Honorable Reviewer 2 for the excellent review of the paper and in-depth suggestions made to improve the quality of the paper. Followings are the responses to ... Continue reading
Views
10
Cite
Reviewer Report 20 Nov 2020
Hamzaini Abdul Hamid, Department of Radiology, Faculty of Medicine, Universiti Kebangsaan Malaysia Medical Centre (UKMMC), Kuala Lumpur, Malaysia 
Approved
VIEWS 10
Congratulation and I think the paper has been presented very well. The statistical analysis and tools were done appropriately. 

This paper definitely will contribute to the management of COVID 19 patients i.e. in predicting which patient may ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Hamid HA. Reviewer Report For: Age, neutrophil lymphocyte ratio, and radiographic assessment of the quantity of lung edema (RALE) score to predict in-hospital mortality in COVID-19 patients: a retrospective study [version 2; peer review: 2 approved]. F1000Research 2021, 9:1286 (https://doi.org/10.5256/f1000research.29506.r74045)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 30 Oct 2020
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.