Next Article in Journal
The Innovative and Sustainable Use of Dental Panoramic Radiographs for the Detection of Osteoporosis
Next Article in Special Issue
The Development of a Screening Tool for Chinese Disordered Gamers: The Chinese Internet Gaming Disorder Checklist (C-IGDC)
Previous Article in Journal
The Effect of a Mindfulness-Based Intervention on Attention, Self-Control, and Aggressiveness in Primary School Pupils
Previous Article in Special Issue
Interventions to Reduce the Risk of Cardiovascular Disease among Workers: A Systematic Review and Meta-Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison of Elixhauser and Charlson Methods for Discriminative Performance in Mortality Risk in Patients with Schizophrenic Disorders

1
Department of Community Psychiatry, Kaohsiung Municipal Kai-Syuan Psychiatric Hospital, Kaohsiung 80276, Taiwan
2
Department of Child and Adolescent Psychiatry, Kaohsiung Municipal Kai-Syuan Psychiatric Hospital, Kaohsiung 80276, Taiwan
3
Graduate Institute of Medicine, College of Medicine, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
4
Department of Anesthesiology, Kaohsiung Veterans General Hospital, Kaohsiung 81362, Taiwan
5
Kaohsiung Municipal Kai-Syuan Psychiatric Hospital, Kaohsiung 80276, Taiwan
6
Department of Physical Therapy, Shu-Zen Junior College of Medicine and Management, Kaohsiung 82144, Taiwan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(7), 2450; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072450
Submission received: 29 February 2020 / Revised: 31 March 2020 / Accepted: 1 April 2020 / Published: 3 April 2020
(This article belongs to the Special Issue Feature Papers in Public Health Statistics and Risk Assessment)

Abstract

:
Although Charlson Comorbidity Index scores (CCIS) and Elixhauser comorbidity index scores (ECIS) have been used to assess comorbidity in patients with schizophrenia, only CCIS, not ECIS, have been used to predict mortality in this population. This nationwide retrospective study investigated discriminative performance of mortality of these two scales in patients with schizophrenia. Exploiting Taiwan’s National Health Insurance Research Database (NHRID), we identified patients diagnosed with schizophrenia discharged from hospitals between Jan 1, 1996 and Dec 31, 2007. They were followed up for subsequent death. Comorbidities presented one year prior to hospital admissions were identified and adapted to the CCIS and ECIS. Discriminatory ability was evaluated using the adjusted hazard ratio and Akaike information criterion (AIC) and Harrell’s C-statistic. We identified 58,771 discharged patients with schizophrenic disorders and followed them for a mean of 10.4 years, 16.6% of whom had died. Both ECIS and CCIS were significantly associated with mortality, but ECIS had superior discriminatory ability by a lower AIC and higher Harrell’s C-statistic (201231 vs. 201400; 0.856 vs. 0.854, respectively). ECIS had better discriminative performance in mortality risk than CCIS in patients with schizophrenic disorders. Its use may be encouraged for risk adjustment in this population.

1. Introduction

The Charlson Comorbidity Index Score (CCIS), calculated based on 19 comorbid conditions, was developed by Charlson et al. in 1987 by reviewing hospital charts and assessing their relevance to one-year mortality [1]. The weight assigned to each comorbid condition ranged from one to six and the individual score for each of these conditions contributed to the final score. The CCIS has been used extensively to evaluate the impact of comorbid conditions in a variety of conditions [2,3,4]. CCIS has been modified in several ways including by a reduction in the number of conditions considered from 19 to 17 [5] and the use of coding by specific International Classification of Diseases, Clinical Modifications (ICD-CM) diagnosis codes [6]. CCIS has been used previously to assess medical comorbidity in the schizophrenic population [7].
The Elixhauser Comorbidity Index Score (ECIS) is another popular comorbidity assessment method introduced by Elixhauser et al. in 1988. It incorporates thirty comorbid conditions and has been validated in acute-care inpatient hospital settings using administrative data [8]. A growing number of studies have suggested that the Elixhauser method is a better comorbidity risk-adjustment model than CCIS [4,9].
More than half of patients with schizophrenia have one or more medical comorbidities [10]. Their medical comorbidities may be related to several factors such as the cognitive and behavioral impairments associated with schizophrenia itself or the adverse effects of the antipsychotics prescribed to them [11,12]. Patients with schizophrenia have high rates of diabetic mellitus [13,14], hyperlipidemia, obesity [15], chronic obstructive pulmonary disease, and hypertension [16]. Furthermore, patients with schizophrenia have shorter lifespans than the general population [17,18,19]. In a meta-analysis, increased overall mortality rates were noted in patients with schizophrenia and other nonaffective psychotic disorders (standardized mortality ratio (SMR) = 3.09, 95% CI 2.9–3.3) [20]. Increased mortality rates for suicide were 12 to more than 20 times more expected and the increased standardized mortality ratio from natural causes was at least two times more expected in patients with schizophrenia [21]. Therefore, schizophrenia, itself, has been associated with a substantial chronic medical burden for multiple comorbidities impacting mortality. Moreover, older age, female gender, depression, and cognitive impairment have also been associated with increases in physical comorbidities in this population [22].
CCIS has been validated in its prediction of mortality in patients with schizophrenia [23]. However, it is not known if ESIC can be used to predict mortality in this population because it has only been used to access morbidity in them [24]. Both CCIS and ESIC have been used to access comorbidity in individual patients in health services research [25]. However, no previous study has compared the two tool’s ability to predict mortality in patients with schizophrenia. In this retrospective cohort study, we tapped Taiwan’s National Health Insurance Research Database (NHIRD) to identify incidences of comorbid conditions and evaluate their impact on the mortality of patients with schizophrenic disorders. We then used these data to compare the discriminative performance of CCIS and ECIS in mortality risk in this population.

2. Materials and Methods

2.1. Study Design and Data Sources

All data, including schizophrenic disorders, numerous comorbidity conditions, and death were collected from the National Health Insurance Research Database (NHIRD). Taiwan’s National Health Insurance program is a compulsory health insurance program established in 1995. It covers the outpatient, inpatient, emergency, and dental care of approximately 99% of Taiwan’s 23 million residents. Taiwan’s National Health Research Institute maintains a large representative population-based claims database with data provided from the Taiwan’s Bureau of National Health Insurance. This database is known as the National Health Insurance Research Database (NHIRD). This database contains comprehensive information on enrollees in the program; diagnoses listed using the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM); medical services rendered; and medications prescribed. Its data is released for research purposes and confidentiality of the enrollees is maintained as directed by the National Health Insurance Bureau. The data used in this study came from a subset of the NHIRD known as the Longitudinal Health Insurance Database, which consists of systematically collected and randomly sampled data obtained from the NHIRD during the period from 1996 to 2012. There are no significant differences in distribution of gender, age, or income level between the patients in this longitudinal Health Insurance Database and patients in the NHIRD.

2.2. Ethical Statement

This study was approved by the Institutional Review Board of Kaohsiung Veterans General Hospital, Taiwan (Ethical code: VGHKS15-CT12-01). Review board requirements for written informed consent were waived because all personal identifying information had been removed from the dataset prior to the analysis.

2.3. Study Population

In this retrospective cohort study, we identified all patients who were newly discharged with schizophrenia in the Longitudinal Health Insurance Database between January 1, 1996 and December 31, 2007. Patients with schizophrenic disorders, including schizophrenia and schizoaffective disorders were identified by the ICD-9-CM code 295 listed on their claims submissions. We excluded patients who were younger than 18 years old, patients who had not been discharged yet, or those who had some data missing. After exclusion, we were left with of 58,771 discharged patients with schizophrenia between 1996 and 2007 to include in our analyses. If a patient had more than one admission during this period, only the first admission data were entered in our analyses. All patients were followed until death or December 31, 2012—the end of the study period.
We also collected data on parameters such as age, gender, geographic region, socioeconomic status (SES), and designated level of the medical facility. The recoding of SES in the insurance database is based on average income associated with four different job categories: EC 1 (civil servants, full-time, or regularly paid personnel with a government affiliation); EC 2 (employees of privately owned institutions); EC 3 (self-employed individuals, other employees, and members of the farmers’ or fishermen’s association); and EC 4 (veterans, members of low-income families, and substitute service draftees). We used these EC categories to classify patients into three SES subgroups: High SES (EC 1 and EC 2), Moderate SES (EC 3), and Low SES (EC 4).

2.4. Comorbidity Identification

Tapping administrative and ambulatory claims records, we were able to identify and record comorbidities present one year prior to the admission for schizophrenia. We used diagnoses codes (ICD-9-CM codes) from administrative and ambulatory claims records to calculate the Charlson and Elixhauser index by using Cheng et al.’s (2016) version [9]. CCIS has 17 disease categories and ECIS has 30 categories. We adjusted for these differences following the previous suggestions [9]. We calculated the weighted Charlson comorbidity score and Elixhauser comorbidity score as previously described [1,26].

2.5. Statistical Analysis

Cohort entry time started on January 1, 1996 and end-of-study was December 31, 2012. Seventeen-year overall mortality was calculated. Death was recorded as an event, and defined by suspension from the National Health Insurance. The prevalence of comorbidities was calculated and the outcome was measured by post-discharge mortality. Patient characteristics were analyzed descriptively and group differences were tested using independent t-tests and Chi-squared tests. Cox proportional hazards regression was used to identify the risk factors associated with death in the whole sample. The Akaike information criterion (AIC) and Harrell C (C-statistic) were used to assess predictive performance and evaluate discrimination against base model parameters (age, gender, SES, geographic area, and teaching level of hospital). The AIC was calculated as AIC = 2k − 2 ln(L), where k is the estimated parameter in the model and L is the maximum likelihood [27]. The smaller the AIC, the better the predictive ability of the model. The Harrell C-statistic measures how well the model can discriminate between observations, with possible values of 0.5 (no predictive ability), 0.7 to 0.8 (acceptable), 0.8 to 0.9 (excellent), 0.9 to 1.0 (outstanding), and 1 (perfect discrimination) [28].
SAS statistical software for Windows, Version 9.3 (SAS Institute, Cary, NC, USA) was used for data extraction, computation, linkage, processing, and sampling. All other statistical operations were performed using SPSS statistical software for Windows, Version 17 (IBM, Armonk, NY, USA). A p-value < 0.05 was considered significant.

3. Results

In total, we identified 58,771 discharged patients with schizophrenic disorders in NHRID from 1996 to 2007. Mean follow-up time was 10.4 years, and 9728 of the patients (16.6%) died. As can been seen in Table 1, the mean age of these patients was 37 years old, they were predominately male, and 43.7% were living in northern Taiwan. Almost half (49%) were classified into a low socioeconomic status, and almost fifty-two percent (51.9%) were discharged from regional hospitals. The most likely patients to die were those who were male, those who were older, those living in eastern Taiwan, those belonging to low SES, or those discharged from district hospitals. In addition, we found a significant association between higher CCIS and ECIS and increased risk of mortality (HR = 1.51, 95% CI = 1.49–1.54 and HR = 1.09, 95% CI = 1.09–1.10, respectively).
Table 2 and Table 3 show the distribution of comorbidities and mortality rates for the patients across Charlson and Elixhauser comorbidity scores. We could not calculate the comorbidity rate and mortality rate of acquired immunodeficiency syndrome (AIDS) or human immunodeficiency viruses (HIV) because there was no code for them in the NHIRD. A total of 8287 patients (14.1%) had comorbidities included in the CCIS. The most common CCIS-listed morbidities in all patients were peptic ulcer disease (4.2%), followed by diabetes mellitus without end-organ damage (3.3%), chronic pulmonary disease (3.2%), and mild liver disease (2.3%). However, in those that died, the most common CCIS-listed morbidities were, metastatic solid tumor (74.2%), followed by moderate liver disease (72.0%), myocardial infarction (64.6%), and congestive heart failure (62.6%). A total of 13,589 patients (23.1%) had ECIS non-psychosis (non-schizophrenia) comorbidities. In all patients, the most common ECIS-listed morbidities were depression (6.0%), followed by hypertension (4.9%), diabetes, uncomplicated (2.9%), and liver disease (2.6%). In those that died, the most common ESIC-listed morbidities were metastatic cancer (76.7%), followed by pulmonary circulation disorders (70%), congestive heart failure (63.6%), and renal failure (63.0%).
Table 4 and Table 5 summarize the results of our Cox proportional hazards regression analysis conducted to calculate the hazards ratio (HR) for mortality by CCIS and ECIC. In the univariate hazard ratio (aHR) analysis of CCIS-listed comorbidities, all items were distinguished as risk factors for mortality (HR = 1.47–10.08, p < 0.001) (Table 4). After adjustment for the patient’s age, gender, SES, geographic region, and teaching level of hospital, all the comorbidities remained associated with significant increases in mortality risk (adjusted HR = 1.21–6.31, p < 0.001). We found no factor to significantly lower the risk of death. In our univariate analysis of the association of ECIS-listed comorbidities and mortality, we found six items (hypothyroidism, lymphoma, obesity, blood loss anemia, drug abuse, and depression) that had no significant association with mortality (Table 5). In our multivariable aHR analysis of ECIS-listed comorbidities and mortality, however, almost every comorbidity was a risk factor except peripheral vascular disorders (aHR 1.19, 95% confidence interval (CI) 0.78–1.79), hypothyroidism (aHR 1.08, 95% CI 0.73–1.58), peptic ulcer excluding bleeding (aHR 1.24, 95% CI 0.96–1.59), lymphoma (aHR 1.21, 95% CI 0.39–3.75), rheumatoid arthritis/collagen vascular diseases (aHR 1.10, 95% CI 0.83–1.47), obesity (aHR 1.44, 95% CI 0.82–2.54), and blood loss anemia (aHR 1.51, 95% CI 0.89–2.55). No ESIC-listed comorbidity protected the subjects against mortality (Table 5).
As can be seen in Table 6, the results of our analysis on the impact of comorbidity measures on improving the fit of the regression model, ECIS had better model discrimination than CCIS. It had a lower AIC and a higher Harrell’s C-statistic (201231 vs. 201400; 0.856 vs. 0.854, respectively).

4. Discussion

This population-based cohort study used both individual comorbidities and overall index scores to analyze the discriminative performance of mortality risk in patients with schizophrenia. The Elixhauser Comorbidity Index Score (ECIS) was found to provide better risk-adjustment than CCIS.
This study found 14.1% of our patients to have one or more comorbidities used by the Charlson Comorbidity Index. One population-based study of hospitalized schizophrenia patients in Spain by Bouza et al., that also used the Charlson Comorbidity Index, found that 20% of the patients had a physical comorbidity [23]. Because of changes in the de-institutionalization process instituted in the 1980s, most people with schizophrenia were living in community in Spain at the time of their study [29]. In Taiwan, many patients with schizophrenia, including those without physical illnesses, remain institutionalized in hospitals. Thus, the lower incidence of comorbidities in Taiwan may be related to long-term antipsychotic prescribing in Taiwan which was compatible with the previous Finland study [30].
In the United States, it has been found that patients with schizophrenia have a higher mortality rate than the general population not only due to unnatural deaths such as suicide, homicide, and accidents but also due to natural deaths [31]. In Taiwan, it has been found that these patients are more likely to die from physical illnesses such as myocardial infarction [32], strokes [33], diabetic mellitus [34], renal disease [35], and cancer [36]. Patients with schizophrenia in Taiwan have shorter lives than the general population when they have comorbid physical illnesses [31,37]. Although the Charlson Comorbidity Index was developed in a cohort of 559 medical patients [1] and not a population of patients with schizophrenia, we found that all the items of Charlson comorbidities were statistically associated with the mortality in our schizophrenic population, even after adjustment for demographic data and hospital level. In other words, although the items of the Charlson Comorbidity Index were not developed specifically for patients with schizophrenic disorders, it still has a good discriminative performance on mortality for this population. We found that a diagnosis of any Charlson-listed comorbidity increased the risk of death.
Most of the Elixhauser-listed comorbidities also predicted mortality among our population of patients with schizophrenic disorders. A diagnosis of certain cardiovascular risk factors such as myocardial infarction, congestive heart failure, and peripheral vascular disease in CCIS and congestive heart failure, cardiac arrhythmia, valvular disease, and hypertension but not peripheral vascular disorders in ECIS were associated with a significant increase in the risk of mortality. This finding is consistent with one previous study reporting that adults who have schizophrenia have a greater risk of mortality from cardiovascular and respiratory diseases with modifiable cardiovascular risk factors, including tobacco use, compared to those who do not have schizophrenia [31]. Metastatic cancer has a poor prognosis in all populations and put our patients at great risk of mortality, as other studies have shown [1,38,39]. A probable explanation for this was late or missed diagnosis of the primary cancer. One study in Canada found paralysis, lymphoma, and heart, liver, and renal failure to contribute importantly to increased mortality [39]. With the exception of lymphoma, our findings were similar. With regard to comorbid mental illness, we found six percent of our subjects with schizophrenic disorders had comorbid depression, 14.8% of them dying after hospital discharge. This mortality rate was lower than the total mortality rate (16.6%). Depression is more prevalent in patients with schizophrenia than the general population [40]. In the current study, depression was the most common in all patients but not in those who died. Nevertheless, it remained a predictive factor of mortality in our multivariate analysis. Some physical disorders were reported to be associated with increased suicidal ideation and played a role in the relationship between depression and suicidal ideation among primary care patients [41].
One study of patients admitted to the hospital for any reason found associations between six ECIS-listed comorbid conditions (valvular disease, blood loss anemia, deficiency anemia, obesity, drug abuse, and depression) and decreased mortality [36]. Other studies, too, have reported associations between several morbidities (valvular disease, blood loss, anemia, obesity, depression, hypertension, complicated diabetes, and drug abuse) and a decreased risk of hospital mortality [8,42]. However, our study found no association between any CCIS- or ECIS-listed comorbidities and a reduced risk of mortality. Our study also did not find significant associations between seven ECIS-listed comorbidities (peripheral vascular disorders, hypothyroidism, peptic ulcer disease, lymphoma, rheumatoid arthritis/collagen vascular diseases, obesity, and blood loss anemia) and mortality. There was not enough statistical power with such low numbers of people with peripheral vascular disorders (n = 68) and lymphoma (n = 11). We also found no statistical significance in the association between obesity and mortality. The prevalence of obesity in our study was 0.1%, which was much lower than a previous study of patients with schizophrenia in Taiwan [43]. The difference may be related to study populations. Our data was obtained from the NHIRD. Most doctors in Taiwan did not record obesity diagnosis on insurance claims forms because there was no extra pay for obesity diagnosis. However, obesity was correlated with several diseases including metabolic syndrome, cardiovascular disease which may impact the CCIS or ECIS, and then mortality [44]
Our study showed that, regardless of whether the CCIS or ECIS was used, comorbidity index scores can be used to evaluate mortality risk in patients with schizophrenic disorders after adjustment. Although several ECIS-listed comorbidities did not significantly predict mortality, this index outperformed CCIS in its prediction of mortality.
The strengths of this study included its population-based database, its access to both outpatient and inpatient data and its collection of 17 years of longitudinal data. In addition, our subjects, patients with schizophrenic disorders, were of all ages and died of any cause. However, this study has some limitations. One limitation is that AIDS/HIV is not recorded in NHRID, so we could not evaluate its effect on mortality. Second, the diagnosis of comorbid conditions was based on ICD-9 CM codes. Another limitation is that there is a possibility of misdiagnosis when using claims databases. However, the National Health Insurance Bureau of Taiwan randomly reviews the charts of 1 per 100 ambulatory patients and 1 per 20 inpatients and interviews them to verify the accuracy of the diagnosis and have found it to be reliable. Another limitation is that the severity of comorbidities was not assessed in our study. We identified patients who were newly discharged with schizophrenic disorders in this study, so we did not include those who had never been admitted. The development of CCIS and ECIS were based on one-year all-cause mortality in medical patients. The mortality rate of hospitalized psychiatric patients was lower than medical patients. Therefore, we used 17-year-long follow-up time by CCIS or ECIS to evaluate the mortality risk. We only calculated the ECIS and CCIS during the baseline period and assumed it to be fixed without changes over time. However, a patient will be older and accompanied with more diseases over time, especially in a 17-year-long follow up time. The time-varying issue could attrite the effects of comorbid diseases in mortality risk and introduce the bias. We didn’t separate men from women in calculating CCIS or ECIS, and there was a gender bias toward schizoaffective disorders. Finally, our definition of death was suspension from the National Health Insurance and there was no recording of unnatural causes of death such as accidents or suicide.

5. Conclusions

We concluded that the Elixhauser comorbidity index has better discriminative performance than the Charlson method in its mortality risk of patients with schizophrenic disorders. Psychiatrists should not only treat the mental illness but also physical illness in patients with schizophrenic disorders to reduce mortality. Furthermore, physicians are encouraged to promote the health of patients with schizophrenic disorders by suggesting more exercise and early detection of physical illnesses.

Author Contributions

Conceptualization, K.-Y.T., K.-Y.H., S.-Y.O., F.H.-C.C., and Y.-M.C.; methodology, Y.-M.C.; software, S.-Y.O. and F.H.-C.C.; formal analysis, S.-Y.O. and F.-H.C.; writing—original draft preparation, K.-Y.T. and K.-Y.H.; writing—review and editing, K.-Y.T., K.-Y.H., and S.-Y.O.; supervision F.H.-C.C. and Y.-M.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

We are grateful to the Kaohsiung Veterans General Hospital and other collaborating partners participating in the project.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Charlson, M.E.; Pompei, P.; Ales, K.L.; MacKenzie, C.R. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J. Chronic Dis. 1987, 40, 373–383. [Google Scholar] [CrossRef]
  2. Nuttall, M.; van der Meulen, J.; Emberton, M. Charlson scores based on ICD-10 administrative data were valid in assessing comorbidity in patients undergoing urological cancer surgery. J. Clin. Epidemiol. 2006, 59, 265–273. [Google Scholar] [CrossRef] [PubMed]
  3. Quan, H.; Li, B.; Couris, C.M. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am. J. Epidemiol. 2011, 173, 676–682. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Wu, X.; Huang, Z.; Han, H. The comparison of glucose and lipid metabolism parameters in drug-naive, antipsychotic-treated, and antipsychotic discontinuation patients with schizophrenia. Neuropsychiatr. Dis. Treat. 2014, 10, 1361–1368. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Deyo, R.A.; Cherkin, D.C.; Ciol, M.A. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J. Clin. Epidemiol. 1992, 45, 613–619. [Google Scholar] [CrossRef]
  6. Romano, P.S.; Roos, L.L.; Jollis, J.G. Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: Differing perspectives. J. Clin. Epidemiol. 1993, 46, 1075–1079. [Google Scholar] [CrossRef]
  7. Batki, S.L.; Meszaros, Z.S.; Strutynski, K. Medical comorbidity in patients with schizophrenia and alcohol dependence. Schizophr. Res. 2009, 107, 139–146. [Google Scholar] [CrossRef] [Green Version]
  8. Elixhauser, A.; Steiner, C.; Harris, D.R.; Coffey, R.M. Comorbidity measures for use with administrative data. Med. Care 1998, 36, 8–27. [Google Scholar] [CrossRef]
  9. Chang, H.J.; Chen, P.C.; Yang, C.C.; Su, Y.C.; Lee, C.C. Comparison of Elixhauser and Charlson methods for predicting oral cancer survival. Medicine 2016, 95, e2861. [Google Scholar] [CrossRef]
  10. Mitchell, A.J.; Malone, D. Physical health and schizophrenia. Curr. Opin. Psychiatry 2006, 19, 432–437. [Google Scholar] [CrossRef] [Green Version]
  11. Goldman, L.S. Medical illness in patients with schizophrenia. J. Clin. Psychiatry 1999, 60, 10–15. [Google Scholar] [PubMed]
  12. Sokal, J.; Messias, E.; Dickerson, F.B. Comorbidity of medical illnesses among adults with serious mental illness who are receiving community psychiatric services. J. Nerv. Ment. Dis. 2004, 192, 421–427. [Google Scholar] [CrossRef] [PubMed]
  13. Dixon, L.; Postrado, L.; Delahanty, J.; Fischer, P.J.; Lehman, A. The association of medical comorbidity in schizophrenia with poor physical and mental health. J. Nerv. Ment. Dis. 1999, 187, 496–502. [Google Scholar] [CrossRef] [PubMed]
  14. Muir-Cochrane, E. Medical co-morbidity risk factors and barriers to care for people with schizophrenia. Ment. Health Nurs. 2006, 13, 447–452. [Google Scholar] [CrossRef]
  15. Goff, D.C.; Cather, C.; Evins, A.E. Medical morbidity and mortality in schizophrenia: Guidelines for psychiatrists. J. Clin. Psychiatry 2005, 66, 183–194. [Google Scholar] [CrossRef]
  16. McCreadie, R.G. Diet, smoking and cardiovascular risk in people with schizophrenia: Descriptive study. Br. J. Psychiatry 2003, 183, 534–539. [Google Scholar] [CrossRef] [Green Version]
  17. M, D.E.H.; Correll, C.U.; Bobes, J. Physical illness in patients with severe mental disorders. I. Prevalence, impact of medications and disparities in health care. World Psychiatry 2011, 10, 52–77. [Google Scholar] [CrossRef] [Green Version]
  18. Trangle, M.; Gary, M.; Paul, G.; Christensen, R. Minnesota 10 by 10. Reducing morbidity and mortality in people with serious mental illnesses. Minn. Med. 2010, 93, 38–41. [Google Scholar]
  19. Jones, R.; Major, B.; Fear, C. Schizophrenia in a primary care setting. Curr. Psychiatry Rep. 2015, 17, 84. [Google Scholar] [CrossRef]
  20. Oakley, P.; Kisely, S.; Baxter, A.; Harris, M.; Desoe, J.; Dziouba, A.; Siskind, D. Increased mortality among people with schizophrenia and other non-affective psychotic disorders in the community: A systematic review and meta-analysis. J. Psychiatr. Res. 2018, 102, 245–253. [Google Scholar] [CrossRef]
  21. Casey, D.E.; Hansen, T.E.; Meyer, J.; Nasrallah, H. Excessive Mortality and Morbidity Associated with Schizophrenia, 2nd ed.; American Psychiatric Association Publishing: Washington, DC, USA, 2009; pp. 17–23. [Google Scholar]
  22. Chwastiak, L.A.; Rosenheck, R.A.; McEvoy, J.P.; Keefe, R.S.; Swartz, M.S.; Lieberman, J.A. Interrelationships of psychiatric symptom severity, medical comorbidity, and functioning in schizophrenia. Psychiatr. Serv. 2006, 57, 1102–1109. [Google Scholar] [CrossRef] [PubMed]
  23. Bouza, C.; Lopez-Cuadrado, T.; Amate, J.M. Physical disease in schizophrenia: A population-based analysis in Spain. BMC Public Health 2010, 10, 745. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Carney, C.P.; Jones, L.; Woolson, R.F. Medical comorbidity in women and men with schizophrenia: A population-based controlled study. J. Gen. Intern. Med. 2006, 21, 1133–1137. [Google Scholar] [CrossRef]
  25. Austin, S.R.; Wong, Y.N.; Uzzo, R.G.; Beck, J.R.; Egleston, B.L. Why summary comorbidity measures such as the Charlson comorbidity index and Elixhauser score work. Med. Care 2015, 53, e65–e72. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Lieffers, J.R.; Baracos, V.E.; Winget, M.; Fassbender, K. A comparison of Charlson and Elixhauser comorbidity measures to predict colorectal cancer survival using administrative health data. Cancer 2011, 117, 1957–1965. [Google Scholar] [CrossRef]
  27. Akaike, H. A new look at the statistical model identification. IEEE Trans. Autom. Control 1974, 19, 716–723. [Google Scholar] [CrossRef]
  28. DWLS, H. Applied Logistic Regression, 2nd ed.; John Wiley & Sons, Inc.: New York, NY, USA, 2000. [Google Scholar]
  29. Salvador-Carulla, L.; Tibaldi, G.; Johnson, S. Patterns of mental health service utilisation in Italy and Spain—An investigation using the European Service Mapping Schedule. Soc. Psychiatry Psychiatr. Epidemiol. 2005, 40, 149–159. [Google Scholar] [CrossRef]
  30. Tiihonen, J.; Lönnqvist, J.; Wahlbeck, K.; Klaukka, T.; Niskanen, L.; Tanskanen, A.; Haukka, J. 11-year follow-up of mortality in patients with schizophrenia: A population-based cohort study (FIN11 study). Lancet 2009, 374, 620–627. [Google Scholar] [CrossRef]
  31. Olfson, M.; Gerhard, T.; Huang, C.; Crystal, S.; Stroup, T.S. Premature mortality among adults with schizophrenia in the united states. JAMA Psychiatry 2015, 72, 1172–1181. [Google Scholar] [CrossRef] [Green Version]
  32. Wu, S.I.; Chen, S.C.; Juang, J.J. Diagnostic procedures, revascularization, and inpatient mortality after acute myocardial infarction in patients with schizophrenia and bipolar disorder. Psychosom. Med. 2013, 75, 52–59. [Google Scholar] [CrossRef]
  33. Tsai, K.Y.; Lee, C.C.; Chou, Y.M.; Su, C.Y.; Chou, F.H. The incidence and relative risk of stroke in patients with schizophrenia: A five-year follow-up study. Schizophr. Res. 2012, 138, 41–47. [Google Scholar] [CrossRef] [PubMed]
  34. Wu, C.S.; Lai, M.S.; Gau, S.S. Complications and mortality in patients with schizophrenia and diabetes: Population-based cohort study. Br. J. Psychiatry 2015, 207, 450–457. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Hsu, Y.H.; Cheng, J.S.; Ouyang, W.C.; Lin, C.L.; Huang, C.T.; Hsu, C.C. Lower incidence of end-stage renal disease but suboptimal pre-dialysis renal care in schizophrenia: A 14-year nationwide cohort study. PLoS ONE 2015, 10, e0140510. [Google Scholar] [CrossRef] [PubMed]
  36. Chou, F.H.; Tsai, K.Y.; Su, C.Y.; Lee, C.C. The incidence and relative risk factors for developing cancer among patients with schizophrenia: A nine-year follow-up study. Schizophr. Res. 2011, 129, 97–103. [Google Scholar] [CrossRef] [PubMed]
  37. Chou, F.H.; Tsai, K.Y.; Wu, H.C.; Shen, S.P. Cancer in patients with schizophrenia: What is the next step? Psychiatry Clin. Neurosci. 2016, 70, 473–488. [Google Scholar] [CrossRef] [Green Version]
  38. Escobar, G.J.; Greene, J.D.; Scheirer, P.; Gardner, M.N.; Draper, D.; Kipnis, P. Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med. Care 2008, 46, 232–239. [Google Scholar] [CrossRef]
  39. van Walraven, C.; Austin, P.C.; Jennings, A.; Quan, H.; Forster, A.J. A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data. Med. Care 2009, 47, 626–633. [Google Scholar] [CrossRef]
  40. Schoepf, D.; Uppal, H.; Potluri, R.; Heun, R. Physical comorbidity and its relevance on mortality in schizophrenia: A naturalistic 12-year follow-up in general hospital admissions. Clin. Neurosci. 2014, 264, 3–28. [Google Scholar] [CrossRef]
  41. Goodwin, R.D.; Kroenke, K.; Hoven, C.W.; Spitzer, R.L. Major depression, physical illness, and suicidal ideation in primary care. Psychosom. Med. 2003, 65, 501–505. [Google Scholar] [CrossRef]
  42. Johnston, J.A.; Wagner, D.P.; Timmons, S.; Welsh, D.; Tsevat, J.; Render, M.L. Impact of different measures of comorbid disease on predicted mortality of intensive care unit patients. Med. Care 2002, 40, 929–940. [Google Scholar] [CrossRef]
  43. Chen, P.Y.; Lu, M.L.; Huang, M.C.; Huang, M.C.; Kao, C.F.; Kuo, P.H.; Chiu, C.C.; Lin, S.K.; Chen, C.H. The relationships of obesity-related genetic variants with metabolic profiles and response to metformin in clozapine-treated patients with schizophrenia. J. Clin. Psychopharmacol. 2015, 35, 574–578. [Google Scholar] [CrossRef] [PubMed]
  44. Huang, K.C. Obesity and its related diseases in Taiwan. Obes. Rev. 2008, 9, 32–34. [Google Scholar] [CrossRef] [PubMed]
Table 1. Demographic Characteristics and the Hazard Ratio of Mortality.
Table 1. Demographic Characteristics and the Hazard Ratio of Mortality.
CharacteristicsTotal Patients n = 58,771Mortality n = 9728
N (Mean)% (SD)HR95%CI
Age(37.05)(12.44)1.051.05–1.05 ***
Gender
 Female26,14245.51
 Male32,62955.51.201.15–1.25 ***
Geographic region
 Eastern27134.61
 Southern15,67228.20.540.50–0.59 ***
 Central13,80723.50.490.45–0.53 ***
 Northern25,67943.70.480.45–0.52 ***
Socioeconomic status (Enrollee category)
 Low 28,81049.01
 Moderate 13,76923.40.880.84–0.93 ***
 High 16,19227.60.670.63–0.70 ***
Teaching level
 District 15,16125.81
 Regional 30,47951.90.740.71–0.78 ***
 Medical center13,13122.30.610.58–0.65 ***
Elixhauser Comorbidity Index Score(0.35)(2.72)1.091.09–1.10 ***
Charlson Comorbidity Index Score(0.21)(0.64)1.511.49–1.54 ***
*** p < 0.001; SD = standard deviation, HR = hazard ration, CI = confidence interval.
Table 2. Distribution of Charlson Comorbidities and Mortality in Patient Cohort (n = 58,771).
Table 2. Distribution of Charlson Comorbidities and Mortality in Patient Cohort (n = 58,771).
Charlson ComorbiditiesComorbidityMortality
n%n%
Myocardial infarction480.13164.6
Congestive heart failure1870.311762.6
Peripheral vascular disease760.13343.4
Cerebrovascular disease8321.436844.2
Dementia5400.928452.6
Chronic pulmonary disease18653.257430.8
Rheumatic disease7731.320526.5
Peptic ulcer disease24434.261625.2
Mild liver disease13792.340729.5
Diabetes mellitus without end-organ damage19563.374438.0
Diabetes mellitus with end-organ damage2280.411550.4
Hemiplegia840.13642.9
Renal disease3390.615746.3
Any malignancy, including lymphoma and leukemia, except malignant neoplasm of skin2770.512946.6
Moderate liver disease750.15472.0
Metastatic solid tumor310.12374.2
HIV/AIDS----
AIDS = acquired immunodeficiency syndrome, HIV = human immunodeficiency virus.
Table 3. Distribution of Elixhauser Comorbidities in Patient Cohort (n = 58,771).
Table 3. Distribution of Elixhauser Comorbidities in Patient Cohort (n = 58,771).
Elixhauser ComorbiditiesComorbidityMortality
n%n%
Congestive heart failure2360.415063.6
Cardiac arrhythmias4460.813730.7
Valvular disease3100.57925.5
Pulmonary circulation disorders2001470.0
Peripheral vascular disorders680.12333.8
Hypertension28964.9101134.9
Paralysis1580.35736.1
Neurodegenerative disorders12012.032927.4
Chronic pulmonary disease14042.445232.2
Diabetes, uncomplicated17142.962836.6
Diabetes, complicated7181.232244.8
Hypothyroidism1380.22618.8
Renal failure1190.27563.0
Liver disease15142.645229.9
Peptic ulcer disease excluding bleeding2580.46224.0
AIDS/HIV----
Lymphoma11<0.1327.3
Metastatic cancer300.12376.7
Solid tumor without metastasis2450.411848.2
Rheumatoid arthritis/collagen vascular diseases2420.44719.4
Coagulopathy530.12037.7
Obesity770.11215.6
Weight loss2890.58730.1
Fluid and electrolyte disorders6711.125037.3
Blood loss anemia610.11423.0
Deficiency anemia9791.728128.7
Alcohol abuse13592.341530.5
Drug abuse9751.718018.5
Psychoses58,771100972816.6
Depression35206.052214.8
AIDS = acquired immunodeficiency syndrome, HIV = human immunodeficiency virus.
Table 4. Adjusted Hazard Rations of Mortality among Patients with Schizophrenic Disorders Based on the Charlson Comorbidities.
Table 4. Adjusted Hazard Rations of Mortality among Patients with Schizophrenic Disorders Based on the Charlson Comorbidities.
Charlson ComorbiditiesUnivariate AnalysisMultivariate Analysis #
HR95%CIaHR95%CI
Myocardial infarction6.834.80–9.72 ***2.361.66–3.36 ***
Congestive heart failure7.045.86–8.45 ***2.742.27–3.29 ***
Peripheral vascular disease3.522.50–4.95 ***2.051.46–2.89 ***
Cerebrovascular disease3.533.18–3.91 ***1.851.67–2.06 ***
Dementia4.393.90–4.95 ***1.781.58–2.01 ***
Chronic pulmonary disease2.161.99–2.35 ***1.491.37–1.62 ***
Rheumatic disease1.471.28–1.69 ***1.211.05–1.39 ***
Peptic ulcer disease1.681.55–1.82 ***1.361.25–1.47 ***
Mild liver disease2.051.86–2.27 ***1.811.64–2.00 ***
Diabetes mellitus without end-organ damage3.142.91–3.39 ***1.861.73–2.01 ***
Diabetes mellitus with end-organ damage4.663.88–5.60 ***2.532.10–3.04 ***
Hemiplegia3.332.40–4.62 ***2.171.56–3.01 ***
Renal disease3.753.20–4.39 ***2.532.15–2.96 ***
Any malignancy, including lymphoma and leukemia, except malignant neoplasm of skin3.973.34–4.73 ***3.132.63–3.72 ***
Moderate liver disease7.825.98–10.21 ***5.594.27–7.31 ***
Metastatic solid tumor10.086.69–15.17 ***6.314.19–9.50 ***
HIV/AIDS----
*** p < 0.001; CI = confidence interval, HR = hazard ratio, aHR = adjusted hazard ratio, AIDS = acquired immunodeficiency syndrome, HIV = human immunodeficiency virus. # Adjusted for the patient’s age, gender, socioeconomic status, geographic regions, and teaching level of hospital.
Table 5. Adjusted Hazard Ratios of Mortality Among Patients with Schizophrenic Disorders Based on the Elixhauser Comorbidities.
Table 5. Adjusted Hazard Ratios of Mortality Among Patients with Schizophrenic Disorders Based on the Elixhauser Comorbidities.
Elixhauser ComorbiditiesUnivariate AnalysisMultivariate Analysis #
HR95%CIaHR95%CI
Congestive heart failure7.386.28–8.67 ***2.822.40–3.32 ***
Cardiac arrhythmias2.402.03–2.84 ***1.751.48–2.07 ***
Valvular disease1.861.49–2.31 ***1.851.48–2.30 ***
Pulmonary circulation disorders8.094.79–13.67 ***5.663.35–9.56 ***
Peripheral vascular disorders2.751.82–4.13 ***1.190.78–1.79
Hypertension3.022.83–3.23 ***1.481.38–1.59 ***
Paralysis2.702.08–3.51 ***2.121.63–2.75 ***
Neurodegenerative disorders1.981.77–2.21 ***1.561.40–1.74 ***
Chronic pulmonary disease2.532.30–2.78 ***1.591.44–1.75 ***
Diabetes, uncomplicated3.112.87–3.38 ***1.851.70–2.01 ***
Diabetes, complicated3.773.37–4.21 ***2.181.95–2.44 ***
Hypothyroidism1.230.84–1.811.080.73–1.58
Renal failure7.135.68–8.94 ***3.893.10–4.88 ***
Liver disease2.262.05–2.48 ***1.881.71–2.07 ***
Peptic ulcer disease excluding bleeding1.761.37–2.26 ***1.240.96–1.59
AIDS/HIV----
Lymphoma1.640.53–5.081.210.39–3.75
Metastatic cancer11.337.52–17.06 ***6.494.31–9.78 ***
Solid tumor without metastasis4.393.66–5.26 ***3.292.74–3.94 ***
Rheumatoid arthritis/collagen vascular diseases1.351.02–1.80 *1.100.83–1.47
Coagulopathy2.921.89–4.53 ***2.651.71–4.11 ***
Obesity1.210.69–2.141.440.82–2.54
Weight loss2.171.76–2.68 ***1.631.32–2.01 ***
Fluid and electrolyte disorders3.142.77–3.56 ***2.041.80–2.31 ***
Blood loss anemia1.650.98–2.791.510.89–2.55
Deficiency anemia2.151.91–2.42 ***1.661.47–1.87 ***
Alcohol abuse2.232.02–2.46 ***2.051.86–2.27 ***
Drug abuse1.150.99–1.331.671.44–1.93 ***
Psychoses----
Depression1.060.97x1.151.171.07–1.28 **
* p < 0.05, ** p < 0.01, *** p < 0.001; CI = confidence interval, HR = hazard ratio, aHR = adjusted hazard ratio, AIDS = acquired immunodeficiency syndrome, HIV = human immunodeficiency virus. # Adjusted for the patient’s age, gender, socioeconomic status, geographic regions, and teaching level of hospital.
Table 6. The 17-year Survival Comparison of Charlson and Elixhauser Comorbidities in Patients with Schizophrenia.
Table 6. The 17-year Survival Comparison of Charlson and Elixhauser Comorbidities in Patients with Schizophrenia.
VariableAICHarrell’s c-Statistics
Base model *2021180.846
Base model + CCIS (items)2014000.854
Base model + Elixhauser (items)2012310.856
AIC = Akaike information criterion. * Base model included age, gender, socioeconomic status, geographic area, and teaching level of hospital.

Share and Cite

MDPI and ACS Style

Tsai, K.-Y.; Hsieh, K.-Y.; Ou, S.-Y.; Chou, F.H.-C.; Chou, Y.-M. Comparison of Elixhauser and Charlson Methods for Discriminative Performance in Mortality Risk in Patients with Schizophrenic Disorders. Int. J. Environ. Res. Public Health 2020, 17, 2450. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072450

AMA Style

Tsai K-Y, Hsieh K-Y, Ou S-Y, Chou FH-C, Chou Y-M. Comparison of Elixhauser and Charlson Methods for Discriminative Performance in Mortality Risk in Patients with Schizophrenic Disorders. International Journal of Environmental Research and Public Health. 2020; 17(7):2450. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072450

Chicago/Turabian Style

Tsai, Kuan-Yi, Kuan-Ying Hsieh, Shu-Yu Ou, Frank Huang-Chih Chou, and Yu-Mei Chou. 2020. "Comparison of Elixhauser and Charlson Methods for Discriminative Performance in Mortality Risk in Patients with Schizophrenic Disorders" International Journal of Environmental Research and Public Health 17, no. 7: 2450. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17072450

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop