ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article

A comparative evaluation of different scores in predicting severity and outcome in acute pancreatitis

[version 1; peer review: 1 not approved]
PUBLISHED 13 Jul 2023
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Datta Meghe Institute of Higher Education and Research collection.

Abstract

Background: Acute pancreatitis (AP) is an inflammatory condition usually caused by alcohol or gallstones. Our goal was to prospectively compare the diagnostic efficacy of the Acute Physiology & Chronic Health Evaluation (APACHE) II, the Bedside Index of Severity in Acute Pancreatitis (BISAP), the Ranson's score & the Modified Glasgow Score (MGS) in determining the severity & outcome of Acute pancreatitis in a tertiary care facility in central India.
Methods: Between December 2020 & December 2022, this prospective observational study was done in rural area of Wardha district. 110 subjects were included, and the diagnosis of acute pancreatitis was done using Atlanta criteria. APACHE II, MGS, Ranson score on admission, Ranson score 48 hours after admission & BISAP were used to evaluate each subject. The reciever operating curve was used to measure the specificity, sensitivity, NPV, PPV, diagnostic accuracy, area under the curve (AUC) & these scoring methods were then prospectively compared.
Results: When a cut-off based on the literature was used, the APACHE II score could accurately diagnose severe cases of AP (n=110) in 69 patients, BISAP in 68 patients, MGS in 49, Ranson score on admission in 48 patients & after 48 hours in 48 patients. This study showed that Ranson score 48 hours after admission had a AUC (0.991), Ranson score at admission (AUC 0.989) & Modified Glasgow Scale (AUC 0.6486) had fair accuracy as compared to APACHE II (AUC 0.974) & BISAP (AUC 0.896) for determining the level of severity among AP patients based on ROC curves.
Conclusion: To predict the severity of AP, the Ranson score after 48 hours showed the highest NPV, PPV, sensitivity, specificity, and diagnostic accuracy of all the scoring methods tested. The BISAP score had the highest specificity, sensitivity, PPV& NPV for determining the outcome of AP.

Keywords

Acute Pancreatitis, APACHE II, BISAP, Ranson’s score, MGS

Introduction

The pancreas is a unique endocrine & exocrine organ. The exocrine glands discharges enzymes into the digestive system, while the endocrine glands secrete hormones into the circulatory system.1 According to Claude Bernard's theory from 1856, acute pancreatitis was brought on by bile reflux into the common pancreatic duct. However, the controversy did not begin to be settled until 1901, when Eugene Opie proposed that gallstone immigration into the common bile duct was the major cause of acute pancreatitis.2 When intracellular defences that stop trypsinogen activation or lessen trypsin activity are overpowered, AP results. Pancreatic enzyme activation causes the gland to digest itself & causes localised inflammation.3 Necrotizing pancreatitis & interstitial oedematous pancreatitis are two types of acute pancreatitis. Inflammation & edema are present in the peripancreatic tissues and pancreatic parenchyma in interstitial edematous pancreatitis. Necrotizing pancreatitis appears when this condition deteriorates to the point of peripancreatic or pancreatic tissue death.4 Most patients have localised inflammation, but about one-fifth of them go on to develop multiple organ dysfunction syndrome (MODS), which is linked to a significant increase in mortality. A diagnosis of acute pancreatitis requires abdominal pain, high pancreatic amylase and/or lipase values that are at least three times above normal, & imaging studies that show anomalies unique to acute pancreatitis. The Atlanta Classification has been used to gauge the severity of acute pancreatitis ever since its establishment in 1992.5 The original classification's boundaries given by Atlanta, notably the definition of severity is unclear. In 2012, the Atlanta classification was revised to include chronic organ failure.6 Early diagnosis of acute pancreatitis is crucial for lowering morbidity & mortality caused by the condition. To determine the severity of AP, many biochemical, radiological & clinical scores had been devised in the past. Ranson's score, the CT-severity index (CTSI), the bedside index of severity in acute pancreatitis (BISAP), the Modified Glasgow Score, & APACHE-II are some of them.7 Acute pancreatitis severity can now be determined with the use of these forecasting methods. Though complex & difficult to use in clinical settings, it has been shown that these multi-factorial scoring systems work with a high negative predictive value but a meagre overall sensitivity.8 In this study, we aim to determine which scoring method best predicted acute pancreatitis severity. Its secondary aim was to determine which scoring method best predicted the outcome of AP.

Methods

This observational and prospective research work was conducted for two years at a tertiary care centre in the rural area of Wardha district. Patients with significant abdominal pain, elevated serum amylase and serum lipase levels more than three times the upper limit of the normal range and abdominal ultrasonography findings suggestive of acute pancreatitis were included in the study. 110 subjects were studied. The Atlanta Criteria was used for the diagnosis of acute pancreatitis. The study was approved by Institutional Ethical Committee, Datta Meghe Institute of Medical Science (Deemed to be University) with Ref.No. DMIMS (DU)/IEC/2020-21/9284.

The enrolment of the subjects was started after approval from the ethics committee. The study included subjects over the age of 18 who provided written consent. The study excluded all subjects with chronic pancreatitis and those who received outside treatment prior to coming to the emergency room.

All subjects admitted for acute pancreatitis had their prospectively gathered demographic, clinical, biochemical, & radiological data. One can determine if they have acute pancreatitis if they meet two out of the following three criteria: (i) AP-specific abdominal pain, (ii) Serum amylase and serum lipase levels that are at least three times above normal (iii) Radiological abnormalities on abdominal ultrasonography and/or computerized tomography (CT) scan characteristic of acute pancreatitis. Patients with features of chronic pancreatitis, such as dilated pancreatic ducts, pancreatic calcifications, pseudocysts & areas of atrophy, discovered during radiological examinations performed while they were hospitalised or who had chronic pancreatitis based on their prior hospital records were excluded from the research.

After a thorough history & physical examination, several clinical & biochemical factors were assessed. All subjects underwent abdominal ultrasonography at the time of admission. Subjects with mild AP did not experience any local consequences or organ failure, however those with severity did. The local sequelae included pseudocyst, pancreatic necrosis, walled off necrosis, & acute fluid collections. MGS, BISAP, APACHE II score, Ranson score on admission & 48 hrs after were the grading systems used for assessment of all the subjects. Subjects were followed until they were discharged or died.

Statistical analysis

IBM's SPSS version 23.0 in Chicago, United States, was used to do the analysis. We used the ROC curve to establish a cut-off for the APACHE II score, the BISAP score, the Modified Glasgow score, the Ranson score at admission & after 48 hours, all of which predict outcome and severity. The diagnostic accuracy, sensitivity, and specificity of the four scores were evaluated for their ability to foretell the likelihood of severe outcomes or death.

Results

According to the classification given by Atlanta, 110 subjects displayed symptoms of acute pancreatitis. Out of them, 60 (54.54%) had mild and 50 (45.46%) had severe acute pancreatitis. nine (0.08%) of them died while being treated in the hospital (Tables 1 and 2; Figures 1 and 2; Table 3).

Table 1. Baseline characteristics in the study group.

CharacteristicsCategoryN (%)
110 (100%)
Age18-30 years24 (21.8%)
31-40 years38 (34.5%)
41-50 years24 (21.8%)
51-60 years16 (14.5%)
61-70 years7 (6.4%)
71-80 years1 (0.9%)
SexMale100 (90.9%)
Female10 (9.1%)
Severity of Acute PancreatitisMild60 (54.54%)
Severe50 (45.46%)
APACHE II<841 (37.3%)
≥869 (62.7%)
BISAP<242 (38.2%)
≥268 (61.8%)
Ranson Score at admission<362 (56.4%)
≥348 (43.6%)
Ranson Score 48 hours after admission<562 (56.4%)
≥548 (43.6%)
Modified Glasgow Score<361 (55.5%)
≥349 (44.5%)
OutcomeDischarged101 (99.92%)
Death9 (0.08%)

Table 2. Comparison of the diagnostic performance of various scoring methods in predicting severity in AP.

PredictorAUROC95% CIPSnSpPPVNPVDA
APACHE II Score0.8120.726-0.899<0.00175%72%68%78%73%
BISAP Score0.7510.657-0.846<0.00173%67%71%83%70%
Ranson Score At Admission0.8850.823-0.947<0.00185%75%73%86%80%
Ranson Score After 48 Hours0.9000.841-0.960<0.00187%86%84%89%87%
Modified Glasgow Score0.8120.729-0.895<0.00177%72%70%80%74%
461305fb-1286-4a87-9b9f-180f8420ac4a_figure1.gif

Figure 1. ROC curve representing diagnostic performance of various scoring systems in predicting severity in AP.

461305fb-1286-4a87-9b9f-180f8420ac4a_figure2.gif

Figure 2. ROC curve analysis showing diagnostic performance of scoring methods in predicting outcome in AP.

Table 3. Analyzing the diagnostic accuracy of scoring methods for outcome prediction in AP.

PredictorAUROC95% CIPSnSpPPVNPVDA
APACHE II Score0.8120.696-0.927<0.00175%60%34%89%63%
BISAP Score0.8410.724-0.958<0.00183%94%80%95%91%
Ranson Score At Admission0.8240.748-0.900<0.00170%73%42%90%72%
Ranson Score After 48 Hours0.7360.613-0.8600.00170%80%50%90%78%
Modified Glasgow Score0.8190.738-0.899<0.00166%75%43%89%73%

Discussion

Acute pancreatitis is pancreatic inflammation which can range from mild to severe. The majority of patients suffer with mild condition with low morbidity, while the others have severe acute pancreatitis, which has a mortality rate of 10% to 20%.9 In present study mean age of the subjects was 40.49±12.12 years and maximum i.e. 38 (34.5%) of the participants were in the age group of 31-40 years. 72 individuals, evaluated by Ajay K. Khanna et al., had mean age of 40.5 years, similar to our study.9 Similarly, in a study by Anubhav Kumar et al., 50 patients with acute pancreatitis had the mean age of 48.42 years.10 In our study there were 100 (90.9%) males and 10 (9.1%) of the subjects were females. Similar findings were reported by Lankisch PG et al., as they found, out of 274 patients 172 were males and 102 were females.11 We found that the mean value of Serum Amylase was 399.82±104.82 U/L and 680.06±157.54 U/L in Mild and Severe acute pancreatitis groups, respectively. Kiat et al, also found in their study that the mean serum amylase was 1151.1±753.5 U/L and 1484.6±736.5 U/L in Mild and Severe acute pancreatitis groups, respectively.12 In the present study, out of 110 subjects, 41 (37.3%) had APACHE II Score of <8 and 69 (62.7%) had APACHE II Score of ≥8. In their analysis of 161 Acute Pancreatitis patients, Cho J H et al., also observed that 52 (32.2%) of Severe Acute Pancreatitis patients had APACHE II score of <8 and 109 (67.8%) of Severe Acute Pancreatitis had APACHE II score of ≥8.13 In our study, 42 (38.2%) subjects had BISAP Score of <2 and 68 (61.8%) subjects had BISAP Score of ≥2. Cho et al., studied 161 subjects and found that 109 (67.70%) participants had BISAP Score of <2 and 52 (32.30%) participants had BISAP Score ≥2, which was in contrast to our study.13 In the present study, 62 (56.4%) subjects had Ranson score of <3 at admission and 48 (43.6%) subjects had Ranson score of ≥3 at admission. Similarly, Khanna et al. in their study of 72 participants showed that 37 (51.4%) participants had Ranson score of <3 and 35 (48.6%) participants had Ranson of ≥ 3.9 In our study, 61 (55.5%) subjects had Modified Glasgow Score of <3 and 49 (44.5%) subjects had Modified Glasgow Score of ≥3. Similar results were reported by by Kiat TT et al. in their study of 669 participants which showed that 425 (63.52%) participants had Modified Glasgow Score of <3 and 244 (36.48%) participants had Modified Glasgow Score ≥3.12

Comparison of different scores in predicting the severity of acute pancreatitis patients

In present study, we found that Ranson score 48 hours after admission (AUROC=0.900) was better than Ranson score at admission, Modified Glasgow Score, APACHE II score and BISAP score in predicting severity of acute pancreatitis. According to Kiat TT et al., Ranson score had higher sentivity, negative predictive value and area under ROC curve (AUROC=0.848) for predicting severity in acute pancreatitis than Modified glasgow score, similar to our study.12 According to Arif A et al., Ranson score predicted Severe Acute Pancreatitis more correctly than BISAP score similar to our study.14 According to Wei Gao et al., Severe Acute Pancreatitis was predicted more correctly by Ranson's score than by BISAP score with area under ROC curve (AUROC) 0.83, sensitivity 66% and specificity 78%. This was consistent with our study.15 Similarly, Zhang J et al., revealed that the AUC for predicting severity by BISAP was 0.793, APACHE II was 0.836 and by Ranson score was 0.903.16

Comparison of different scores in predicting the outcome of acute pancreatitis patients

In our study, we found that BISAP score was best in predicting outcome of acute pancreatitis followed by APACHE II score then Modified Glasgow Score then Ranson score at admission and Ranson score 48 hours after admission. Wei Gao et al., reported that Ranson score had the area under ROC curve (AUROC) 0.92, sensitivity and specificity were 93% and 69% respectively. BISAP score had the area under ROC curve (AUROC) 0.82, sensitivity and specificity were 81% and 70% respectively. Compared with the Ranson criteria, BISAP score outperformed in specificity, but having a suboptimal sensitivity for mortality in Acute Pancreatitis. This was consistent with our study.15 Eachempati SR et al., found that Ranson score was a good predictor of outcomes in patients with Severe Acute Pancreatitis. Ranson score after 48 hours predicted outcomes in patients more accurately than Ranson score at admission with Severe Acute Pancreatitis.17 In 2013, Chen L. et al., reported that to accurately predict death in Severe Acute Pancreatitis patients, the BISAP score performed comparably to other scoring systems with area under ROC curve (AUROC) of 0.808, sensitivity of 83.3% and specificity of 67.4%.18 Zhang J et al., revealed that the AUC for mortality predicted by BISAP was 0.791, APACHE II was 0.812 and by Ranson score was 0.904. BISAP score was found as valuable source for prognostic prediction in Chinese patients with Acute Pancreatitis.16

Conclusion

We conclude that the best scoring system for predicting the severity of Acute Pancreatitis is Ranson Score after 48 Hours with area under the curve, 0.900 (0.841 – 0.960), at 95% CI with p value <0.001 which was found to have the highest sensitivity and specificity of 87% and 86%, respectively. That was followed by Ranson score at admission with area under the curve 0.885, sensitivity of 85%, specificity of 75%. Then Modified glasgow scale with area under the curve 0.812, sensitivity of 77%, specificity of 72% then APACHE II score with area under the curve 0.812, sensitivity of 75%, specificity of 72% and lastly BISAP score with area under the curve 0.751, sensitivity of 73%, specificity of 67%.

We also conclude that BISAP Score was best with area under the curve, 0.841 (0.724 – 0.958) at 95% CI, with p<0.001 was found to have the highest sensitivity and specificity of 83% and 94%, respectively for predicting the outcome of Acute Pancreatitis as compared to Ranson score at admission with area under the curve 0.824, sensitivity of 70%, specificity of 73%, Modified glasgow scale with area under the curve 0.819, sensitivity of 66%, specificity of 75%, APACHE II with area under the curve 0.812, sensitivity of 75%, specificity of 60% and Ranson score after 48 hours with area under the curve 0.736, sensitivity of 70%, specificity of 80%.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 13 Jul 2023
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Mahajan O, Mahajan S, Acharya S et al. A comparative evaluation of different scores in predicting severity and outcome in acute pancreatitis [version 1; peer review: 1 not approved]. F1000Research 2023, 12:824 (https://doi.org/10.12688/f1000research.133278.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 13 Jul 2023
Views
11
Cite
Reviewer Report 20 Oct 2023
Wenjian Mao, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, China 
Not Approved
VIEWS 11
  1. In the Abstract and the results section, cut-off value of each scoring system should be given.
     
  2. At present, the revised Atlanta Criteria was widely used to define or classify acute pancreatitis (AP) over
... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Mao W. Reviewer Report For: A comparative evaluation of different scores in predicting severity and outcome in acute pancreatitis [version 1; peer review: 1 not approved]. F1000Research 2023, 12:824 (https://doi.org/10.5256/f1000research.146257.r209095)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 13 Jul 2023
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.