http://orcid.org/0000-0002-9252-0323
Figures
Abstract
Background
Splenic abscess is rare but has mortality rates as high as 14% even with recent improvements in management. Early and appropriate intervention may improve patient outcomes, yet at present there is no identified method that can predict mortality risk rapidly and accurately for emergency physicians, surgeons, and intensivists to decide on the ideal course of action.
Objective
This study aims to evaluate the performance of Mortality in Emergency Department Sepsis Score (MEDS), Modified Early Warning Score (MEWS), Rapid Emergency Medicine Score (REMS) and Rapid Acute Physiology Score (RAPS) for predicting the mortality risk of adult splenic abscess patients. This will expedite decision making in the emergency department (ED) to increase survival rates and help avoid unnecessary splenectomies.
Methods
Data of 114 adult patients admitted to the EDs of 4 research and training hospitals who had undergone an abdominal contrast CT scan and diagnosed with splenic abscess between Jan 2000 and April 2015 were analyzed. The MEDS, MEWS, REMS, and RAPS and their corresponding mortality risks were calculated, with their abilities to predict patient mortality assessed through receiver operating characteristic curve analysis and calibration analysis.
Results
MEDS was found to be the best performing scoring system across all indicators, with sensitivity, specificity, and accuracy of 92.86%, 88.00%, and 88.60% respectively; its area under curve for AUROC analysis was 0.92. With a cutoff value of 8, negative predictive value of MEDS was 98.88%.
Conclusion
Our series is the largest multicenter study in adult ED patients with splenic abscess. The results from the present study show that MEDS is superior to MEWS, REMS and RAPS in predicting mortality, thus allowing earlier detection of critically ill adult ED splenic abscess patients. Therefore, we recommend that MEDS be used for predicting severity of illness and risk stratification in these patients.
Citation: Hung S-K, Ng C-J, Kuo C-F, Goh ZNL, Huang L-H, Li C-H, et al. (2017) Comparison of the Mortality in Emergency Department Sepsis Score, Modified Early Warning Score, Rapid Emergency Medicine Score and Rapid Acute Physiology Score for predicting the outcomes of adult splenic abscess patients in the emergency department. PLoS ONE 12(11): e0187495. https://doi.org/10.1371/journal.pone.0187495
Editor: Chiara Lazzeri, Azienda Ospedaliero Universitaria Careggi, ITALY
Received: February 13, 2017; Accepted: October 21, 2017; Published: November 1, 2017
Copyright: © 2017 Hung et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The current study was supported by Chang Gung Memorial Hospital in Taiwan (CORPG3F0931). The authors also wish to acknowledge the support of the Maintenance Project for Center for Big Data Analytics and Statistics (Grant CLRPG3D0043) from Chang Gung Memorial Hospital for Statistical Analysis. Both funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Splenic abscess is a rare but potentially life-threatening disease with an incidence of 0.14% to 0.7% [1–3]. In the past, the mortality rate of patients with splenic abscess was near 100% due to its non-specific presentation and delayed diagnosis [3]. Management of splenic abscess has evolved to now include the improved use of imaging modalities, advanced antibiotic therapy, and timely surgical intervention; even then, the mortality rate still hovers around 14%. The current treatment of choice is intravenous antibiotic therapy with splenectomy, though it exposes patients to the risk of overwhelming post-splenectomy infections. Percutaneous CT-guided drainage is another option, but its superiority over splenectomy has yet to be studied adequately [4]. Because early appropriate intervention may improve the survival outcome of such patients, prompt initiation of the right therapy in the emergency department (ED) after accurate assessment of disease severity and mortality risk is crucial. However, there is still no defined evaluation method that can be promptly and easily used by emergency physicians, surgeons, and intensivists to determine the ideal course of action which effectively utilises medical resources, avoids unnecessary splenectomy, and decreases mortality of these patients.
APACHE II has shown to be a reliable tool to determine the prognosis of patients with splenic abscess [5]. However, given its complexity requiring 14 parameters [6], it does not meet the needs of a rapid risk stratification tool in a regular ED setting. Several ED physiologic scoring systems have been demonstrated as appropriate predictors of the mortality of patients admitted to EDs under different circumstances [7]. Among these, four of them are more commonly used—Rapid Acute Physiology Score (RAPS) [8], Rapid Emergency Medicine Score (REMS) [9–10], Modified Early Warning Score (MEWS) [11], and Mortality in Emergency Department Sepsis Score (MEDS) [12]. These systems share the characteristic of being comprised of simple, rapid, obtainable-by-the-bed parameters that can be calculated immediately, thus allowing for the quick clinical determination of critically-ill patients requiring urgent intervention. To our knowledge, there is yet to be a study to assess the performance of RAPS, REMS, MEWS, and MEDS in the prediction of mortality of ED patients with splenic abscess; hence, this present study was conducted with this purpose.
Materials and methods
Study design
This study was a retrospective analysis conducted at the EDs of four training and research hospitals, Linkou Chang Gung Memorial Hospital (3406 beds with approximately 17000 ED visits monthly in 2017), Kaohsiung Chang Gung Memorial Hospital (2686 beds with approximately 12000 ED visits monthly in 2017), Chiayi Chang Gung Memorial Hospital (1375 beds with 5800 ED visits monthly in 2017), and Keelung Chang Gung Memorial Hospital (1089 beds with 5700 ED visits monthly in 2017). The Chang Gung Memorial Hospital Institutional Review Board approved this study (IRB: 201601231B0C501), waiving the need for consent from study participants. Data was accessed anonymously.
Settings and subjects
We included all adult patients older than 18 years admitted to the EDs of the four hospitals who had undergone an abdominal contrast CT scan in the ED with the final diagnosis of splenic abscess from January 2000 to April 2015.
Criteria of splenic abscess
Splenic abscess was diagnosed upon meeting any of the following criteria: (1) positive operative findings of splenic abscess during exploratory laparotomy; (2) histologic study of splenic tissue revealed presence of abscess; and if surgery was not performed, (3) presence of clinical manifestations and imaging findings consistent with the diagnosis.
Measurement of variables
Relevant data was retrieved from the identified patients’ ED medical records, and the physiologic scoring systems (Tables 1–4) were calculated accordingly. Septic shock was defined in line with the Second International Consensus Definitions for Sepsis and Septic Shock criteria (2001) [13]. The study endpoint was mortality or survival at the end of hospital stay.
Statistical analysis
Descriptive statistics were presented as median and inter-quartiles for numerical variables and frequencies with their corresponding percentages (%) for categorical variables. Univariate analyses were performed to examine the association between predictors and mortality. Numerical and categorical and variables were analyzed using Mann-Whitney U tests and Fisher’s exact tests respectively, due to small sizes of the non-survivor groups. A logistic regression analysis was performed to develop predictive models between scoring systems and mortality. The probability of death was calculated based on the predictive models using the logit formula:
(β0: Intercept;β1: Parameter estimate of score; X1: Score)
Mann-Whitney U tests were also applied to compare the differences in death probabilities between survivors and non-survivors. AUROC analysis was used to compare the predictability of mortality among scoring systems. In addition, the sensitivity, specificity, and accuracy rates were calculated based on the optimal cut-off point derived from the AUROC analysis.
Results
A total of 114 patients aged 22 years to 84 years (mean 56.33±16.12) were identified in the four hospitals over a span of 15 years and 3 months. The statistically significant results (p < 0.05) are as follows. The pulse rate was 121 versus 106 beats per minute in non-survivors and survivors respectively. Respiratory rate was 22 versus 20 breaths per minute, while mean arterial pressure was 72.5 mmHg versus 94 mmHg in non-survivors and survivors respectively. There was a higher percentage of patients with a poorer Glasgow Coma Scale of <12 in the group of non-survivors at presentation to ED (28.58%) as compared to the group of survivors (2.0%), while platelet count was 162.5 x 109/L versus 221 x 109/L in non-survivors and survivors respectively. The frequency of patients having septic shock was higher in the non-survivor group (42.84%) compared to the survivor group (4.00%) (Table 5).
Based on the predictive model with the scoring systems using logistic regression analysis, the probability of death was calculated and compared between non-survivors and survivors. The mean probability of death in MEDS was found to be 0.29 in non-survivors and 0.07 in survivors (p < 0.001), while that using MEWS was 0.21 in non-survivors and 0.07 in survivors (p = 0.002). Using RAPS, it was 0.17 in non-survivors and 0.09 in survivors (p = 0.028), and using REMS, it was 0.16 in non-survivors and 0.10 in survivors (p = 0.038) (Table 6).
The AUROC analysis demonstrated the predictability, in descending order, of MEDS, MEWS, RAPS, and REMS as 0.92, 0.76, 0.68, and 0.67 respectively (Fig 1). MEDS was found to be the most accurate predictive tool, with an accuracy of 88.60%, followed by MEWS at 82.46%. RAPS and REMS ranked the lowest with an accuracy of 71.05%. MEDS was also shown to have the highest sensitivity and specificity amongst the four systems, at 92.86% and 88.00% respectively. With the cutoff value of 8, the negative predictive value of MEDS was found to be 98.88% (Table 7).
Discussion
This multi-center study is the largest one to date studying ED patients with the diagnosis of splenic abscess. It is also the first, to our knowledge, that used ED scoring systems for risk assessment and stratification of such patients. In this study, we compared the four scoring systems and found MEDS to be the best performing tool in predicting mortality rates of splenic abscess patients.
MEDS is a prospectively derived and validated clinical prediction rule created by Shapiro et al consisting of 9 parameters, namely age > 65 years, nursing home resident, rapid terminal comorbid illness, lower respiratory tract infection, bands >5% on a WBC differential, tachypnea or hypoxemia, septic shock, platelet count < 150 x 109/L, and altered mental status; the higher the score, the higher the mortality rate. It was designed with the purpose of risk stratification in ED patients with suspected infection according to mortality risk [12]. This is in contrast to the other scoring systems, whose purviews of predicting mortality are not confined solely to patients with infections. This difference in target population might account for the advantage of MEDS over the other 3 systems, as the most common cause of mortality in splenic abscess patients is sepsis and subsequent septic shock. MEDS has also been shown to be a good prognostic indicator in patients with other intra-abdominal infections [14–15]; it has even been found to discriminate better than APACHE II and quick Sepsis-related Organ Failure Assessment in mortality prediction of severe sepsis ED patients [16–18]. Furthermore, in addition to clinical presentation, the MEDS scoring system places emphasis on patient characteristics too– 4 out of 9 criteria (terminal illness, age, nursing home resident, altered mental status) are based on the patient’s medical history, information which can be obtained easily during preliminary history taking in the ED.
Univariate analysis in our study found that pulse rate, respiratory rate, mean arterial pressure, Glasgow Coma Scale, leukocyte count, and presence of septic shock were significant in determining the prognosis of a patient with splenic abscess. Further analysis revealed that thrombocytopenia, commonly found in septic patients [19], was another determinant in our study population. As mentioned earlier, the strong link between septic shock and its predictability of mortality rates is likely to arise from its original designed intentions. The rest of the important parameters are then clinical signs of sepsis: tachycardia, tachypnea, hypotension, altered mental status, and thrombocytopenia. This supports why MEDS score is such a powerful discriminator in determining prognosis of patients with splenic abscess. The high negative predictive value of 98.88% enables emergency physicians, surgeons, and intensivists to quickly screen splenic abscess patients to exclude those with a MEDS score less than 8 from the high mortality risk group; further consideration of the etiology of splenic abscess in our study population showed the same result. These patients may then be conservatively managed without undergoing splenectomy. This holds true even when taking into account that antibiotic therapy and intensive care protocols have evolved dramatically since 2010, as our further analysis revealed that mortality rates did not differ significantly with respect to the patients’ year of hospital admission. While we found etiology of splenic abscess to be a significant determinant of patient mortality upon additional review, it is a major challenge to ascertain this accurately and rapidly in the ED prior to decision making, and therefore is less clinically useful than MEDS in the ED setting.
The AUROC value of MEDS exceeds 0.9, illustrating that it is an excellent tool for predicting splenic abscess mortality. Its sensitivity of 92.86% also allows emergency physicians, surgeons, and intensivists to quickly narrow in with accuracy on the patient requiring urgent intervention. Although MEDS incorporates more parameters as compared to the other 3 scoring systems, the extra information needed are obtainable through history taking and complete blood count investigation commonly done in the evaluation of a patient presenting to the ED.
Despite this study being the largest of its kind, it still has the limitations of being a small study; a larger sample size is required for further confirmation of these findings. Furthermore, this is a retrospective study; future studies can be done prospectively using MEDS score to determine its clinical impact. Due to the fact that this is a study into the most appropriate physiologic scoring system applicable to the ED, we refrained from delving into the specifics of CT imaging interpretation of splenic abscess and its characteristics in deciding treatment; future studies can perhaps address this limitation.
Conclusion
MEDS score is the best physiologic screening score amongst the four studied scores in predicting mortality of patients with splenic abscess. We recommend using it for rapid risk stratification in the ED, to quickly identify patients requiring urgent intervention, thus ensuring the timeliness of treatment and improving patient outcomes.
Acknowledgments
This study was supported by Chang Gung Memorial Hospital in Taiwan (CORPG3F0931), and the Maintenance Project for Center for Big Data Analytics and Statistics (Grant CLRPG3D0043) from Chang Gung Memorial Hospital for Statistical Analysis. Both funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. We would like to thank Hsiao-Jung Tseng for her assistance in analyzing part of the data.
References
- 1. Chun CH, Raff MJ, Contreras L, Varghese R, Waterman N, Daffner R, et al. Splenic abscess. Medicine (Baltimore). 1980 Jan;59(1):50–65
- 2. Nelken N, Ignatius J, Skinner M, Christensen N. Changing clinical spectrum of splenic abscess. A multicenter study and review of the literature. Am J Surg. 1987 Jul;154(1):27–34 pmid:3300398
- 3. Ooi LL, Leong SS. Splenic abscesses from 1987 to 1995. Am J Surg. 1997 Jul;174(1):87–93 pmid:9240961
- 4. Liu YH, Liu CP, Lee CM. Splenic abscesses at a tertiary medical center in Northern Taiwan. J Microbiol Immunol Infect. 2014 Apr;47(2):104–8 pmid:23218406
- 5. Chang KC, Chuah SK, Changchien CS, Tsai TL, Lu SN, Chiu YC, et al. Clinical characteristics and prognostic factors of splenic abscess: A review of 67 cases in a single medical center of Taiwan. World J Gastroenterol. 2006 Jan;12(3):460–4 pmid:16489650
- 6. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985 Oct; 13(10):818–29 pmid:3928249
- 7. Hargrove J, Nguyen HB. Bench-to-bedside review: Outcome predictions for critically ill patients in the emergency department. Crit Care. 2005 August;9(4):376–83 pmid:16137387
- 8. Goodacre S, Turner J, Nicholl J. Prediction of mortality among emergency medical admissions. Emerg Med J. 2006 May;23(5):372–5 pmid:16627839
- 9. Olsson T, Terent A, Lind L. Rapid Emergency Medicine score: a new prognostic tool for in-hospital mortality in nonsurgical emergency department patients. J Intern Med. 2004 May;255(5):579–87 pmid:15078500
- 10. Olsson T, Lind L. Comparison of the rapid emergency medicine score and APACHE II in nonsurgical emergency department patients. Acad Emerg Med. 2003 Oct;10(10):1040–8 pmid:14525735
- 11. Bulut M, Cebicci H, Sigirli D, Sak A, Durmus O, Top AA, et al. The comparison of modified early warning score with rapid emergency medicine score: a prospective multicentre observational cohort study on medical and surgical patients presenting to emergency department. Emerg Med J. 2014 Jun;31(6):476–81 pmid:23562988
- 12. Shapiro NI, Wolfe RE, Moore RB, Smith E, Burdick E, Bates DW. Mortality in Emergency Department Sepsis (MEDS) score: a prospectively derived and validated clinical prediction rule. Crit Care Med. 2003 Mar;31(3):670–5 pmid:12626967
- 13. Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med. 2003 Apr;31(4):1250–6 pmid:12682500
- 14. Kuo SH, Lee YT, Li CR, Tseng CJ, Chao WN, Wang PH, et al. Mortality in Emergency Department Sepsis score as a prognostic indicator in patients with pyogenic liver abscess. Am J Emerg Med. 2013 Jun;31(6):916–21 pmid:23623237
- 15. Lee CC, Chen SY, Tsai CL, Wu SC, Chiang WC, Wang JL, et al. Prognostic value of mortality in emergency department sepsis score, procalcitonin, and C-reactive protein in patients with sepsis at the emergency department. Shock. 2008 Mar;29(3):322–7 pmid:17724429
- 16. Chen CC, Chong CF, Liu YL, Chen KC, Wang TL. Risk stratification of severe sepsis patients in the emergency department. Emerg Med J. 2006 July;23(1):281–5
- 17. Williams JM, Greenslade JH, Chu K, Brown AF, Lipman J. Severity Scores in Emergency Department Patients with Presumed Infection: A Prospective Validation Study. Crit Care Med. 2016 Mar;44(3):539–47 pmid:26901543
- 18. Wang JY, Chen YX, Guo SB, Mei X, Yang P. Predictive performance of quick Sepsis-related Organ Failure Assessment for mortality and ICU admission in patients with infection at the ED. Am J Emerg Med. 2016 Sep;34(9):1788–93 pmid:27321936
- 19. Vanderschueren S, De Weerdt A, Malbrain M, Vankersschaever D, Frans E, Wilmer A, et al. Thrombocytopenia and prognosis in intensive care. Crit Care Med. 2000 Jun;28(6):1871–6 pmid:10890635