http://orcid.org/0000-0001-8184-1546
Figures
Abstract
Background and aims
The Veterans Health Administration (VA) cares for over 80,000 Veterans with cirrhosis annually. Given the importance of understanding patient reported outcomes in this complex population, we aimed to assess the associations between attitudes towards care, disease knowledge, and health related quality of life (HRQoL) in a national sample.
Methods
In this cross-sectional study, we mailed paper surveys to a random sample of Veterans with cirrhosis, oversampling those with decompensated disease. Surveys included the Veterans RAND 12-Item Health Survey (measuring HRQoL) and questions about demographics, characteristics of care, satisfaction with care (“attitudes towards care”), and symptoms of cirrhosis. Those who reported being “unsure” about whether they had decompensation events were defined as “unsure about cirrhosis symptoms” (“disease knowledge”). We used multivariable regression models to assess the factors associated with HRQoL.
Results
Of 1374 surveys, 551 (40%) completed surveys were included for analysis. Most Veterans (63%) were “satisfied” or “very satisfied” with VA liver care. Patients often self-reported being unsure about whether they had experienced hepatic decompensation events (34%). Overall average physical (PCS) and mental (MCS) component scores of HRQoL were 30±11 and 41±12. In multivariable regression models, hepatic decompensation (PCS:β = -3.8, MCS:β = -2.2), medical comorbidities (β = −-2.0, β = -1.7), and being unsure about cirrhosis symptoms (β = -1.9, β = -3.3) were associated with worse HRQoL, while age (β = 0.1, β = 0.2) and satisfaction with care (β = 0.6; β = 1.6) were associated with significantly better HRQoL.
Citation: Rogal SS, Yakovchenko V, Gonzalez R, Park A, Lamorte C, Gibson SP, et al. (2020) Characterizing patient-reported outcomes in veterans with cirrhosis. PLoS ONE 15(9): e0238712. https://doi.org/10.1371/journal.pone.0238712
Editor: Hans Tillmann, East Carolina University Brody School of Medicine, UNITED STATES
Received: May 14, 2020; Accepted: August 21, 2020; Published: September 11, 2020
This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Data Availability: This study was approved by the VA Pittsburgh Healthcare System's Institutional Review Board as quality improvement, with the stipulation that data would be presented in aggregate, given the sensitive information included in the dataset. However, interested parties can contact the Center for Health Equity Research and Promotion in the VA Pittsburgh Healthcare System (contact via mary.walsh@va.gov or shari.rogal@va.gov) for further inquiries or data requests.
Funding: This work was supported by Agency for Healthcare Research and Quality Award (K12 - HS019461) and by funding from the VA HIV, Hepatitis, and Related Conditions Programs in the Office of Specialty Care Services. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: HRQoL, health related quality of life; PRO, patient reported outcome; VA, Department of Veterans Affairs; HHRC, HIV, Hepatitis and Related Conditions Programs; HIT, Hepatic Innovation Team; SCQ, Self-Administered Comorbidity Questionnaire; VR-12, Veterans Rand 12-Item Health Survey; PCS, Physical Component Summary; MCS, Mental Component Summary
Introduction
Quality of life and quality of care have been increasingly linked to health outcomes. Health related quality of life (HRQoL) is broadly defined as the way in which medical illness impacts physical, emotional, and social function [1, 2]. While QOL has been assessed in cirrhosis using a variety of cirrhosis-specific and generic QOL instruments, the value of understanding other key Patient Reported Outcomes (PROs), such as satisfaction with care, has only more recently been recognized in the field of hepatology [3]. PRO is an umbrella term that includes HRQoL, but also patient satisfaction, symptoms of disease, functional status, and treatment compliance [3, 4].
The American Association for the Study of Liver Disease (AASLD) recently recognized the importance of measuring PROs in patients with cirrhosis [3]. AASLD now recommends assessing PROs in patients with cirrhosis across seven domains: physical symptoms, physical function, mental health, general function, cognition, social life, and satisfaction with care. PROs have the potential to reveal important aspects of living with cirrhosis that are often not the primary focus of research or are not accurately perceived by clinicians [2]. Specifically, HRQoL, health distress, sleep disturbance and perceived stigma have been associated with poor health outcomes for patients with cirrhosis [5]. PROs thus add to our understanding of the otherwise unmeasured aspects of disease burden in cirrhosis and their impact on clinical and health services outcomes.
To continuously improve liver care in the Department of Veterans Affairs (VA), VA’s HIV, Hepatitis and Related Conditions Program Office (HHRC), in collaboration with the Office of Healthcare Transformation, developed the Hepatic Innovation Team (HIT) Collaborative [6, 7]. This learning collaborative consists of regional teams of providers who are conducting quality improvement projects to improve liver care in VA. A key component of these efforts is assessing and addressing PROs. To further these efforts, we developed and deployed a national survey for Veterans with cirrhosis. We aimed to 1) assess PROs in a national sample of Veterans with cirrhosis, including satisfaction with care, symptoms, awareness of cirrhosis symptoms, and HRQoL and 2) understand the factors associated with HRQoL in this cohort. We hypothesized that awareness of cirrhosis symptoms, lower satisfaction with care, and more severe disease would be associated with reduced HRQoL.
Methods
Sampling
The VA Pittsburgh Healthcare System IRB reviewed this project and considered this work to quality improvement. As such, the need for written informed consent was waived. However, the survey was entirely voluntary. A national VA database was used to identify all Veterans with ICD-9 and -10 codes for cirrhosis or its complications (S1 Appendix) seen at a VA facility in the prior 18 months. Fourteen patients with cirrhosis were randomly selected from each VA site. ICD-9 and ICD-10 codes were used to identify Veterans with hepatic decompensation, with the goal of oversampling this group. In September 2018, surveys were mailed to patients with self-addressed stamped return envelopes. A second round of mailings was sent to Veterans who did not respond to the initial mailing between February and April 2019. Respondents were excluded from further analysis if they indicated that they had undergone transplant, if they returned the survey saying that it did not apply to them, or if they died in the interim.
Survey development and content
The mailing contained a cover letter that explained the purpose and the voluntary nature of the survey. The survey and cover letter were reviewed by a team of health services and hepatology subject matter experts for readability and content.
Demographics.
Patients were asked to self-report demographics (age, gender, race, and ethnicity). Region of primary VA site was defined using standard VA geographical areas: Northeast, West, Midwest, and South.
Awareness/Knowledge.
To assess cirrhosis symptom awareness or knowledge, respondents reported on their symptoms of liver disease, including ascites, gastrointestinal bleeding, and encephalopathy, in patient-centered language (e.g., “Have you ever had fluid buildup in your belly, called ascites, that you were told is related to liver disease?”). Response options included yes, no, or “unsure.” When they reported being “unsure” about any of these decompensation events, they were defined as “unsure about cirrhosis symptoms” for the purposes of these analyses. The self-reported decompensation events were reported individually and as a sum of “self-reported decompensation symptoms,” from 0 to 3.
Liver health and comorbidities.
Patients were asked to report on the degree to which liver disease contributed to their overall disease burden. They self-reported on 12 comorbidities from the Self-Administered Comorbidity Questionnaire (SCQ), which is designed to be completed by patients and is based on the Charlson Comorbidity Score [8]. We created a summary score using 11 comorbidities for further analyses, excluding liver disease from the score (since it was the disease of interest) [9].
Attitudes towards and experiences with care.
Respondents reported on their level of satisfaction with VA liver disease care on a 6-point Likert Scale. Veterans also reported how they most frequently receive liver care (in-person vs. by phone vs. telehealth vs. home care vs. unsure).
Quality of life.
Permission was obtained to use the Veterans RAND 12-Item Health Survey (VR-12). This brief, generic HRQoL instrument is derived from the SF-36. The Veterans SF-36 is considered to be the primary measure of HRQoL within VA [10]. VR-12 assesses 8 key physical and mental health domains: general health, perceptions, physical functioning, role limitations due to physical and emotional problems, bodily pain, energy-fatigue, social functioning and mental health [10]. Summary scores of the Physical Component Summary (PCS) and Mental Component Summary (MCS) scores are standardized, with a range of 0–100, with a mean score of 50 and standard deviation of 10 in a healthy Veteran population. Higher scores signify better physical and mental health [11]. The VR-12 was chosen given its history of validation and its wide use throughout the VA and Centers for Medicare & Medicaid Services (CMS) [10–12].
Statistical analysis
Descriptive statistics were used to summarize the survey results, using means and standard deviations or medians and interquartile ranges (IQR) for continuous variables and frequencies for categorical variables. PCS and MCS totals were tabulated using standard weights and conversions. The associations between PCS/MCS and covariates were assessed using Spearman’s correlation for continuous covariates and Wilcoxon Rank Sum and Kruskal-Wallace tests for categorical variables. Linear regression models were used to first assess univariate associations between each covariate and PCS/MCS, followed by full models including all variables. Finally, backwards elimination was used to create final models of the factors independently associated with PCS and MCS. The primary analyses included decompensation as a binary (yes/no) variable. In secondary analyses, the number of self-reported decompensation symptoms, ranging from 0 to 3, was substituted for this decompensation variable in the multivariable models. For these analyses, satisfaction was recoded as a numerical variable, using a continuous Likert Scale. Analyses were performed using the R statistical computing environment.
Results
Population
Of 1806 mailed surveys, 432 respondents were subsequently excluded due to interval transplant, death, or non-working address (Fig 1). Of the remaining 1374 surveys, 551 (40%) completed surveys were received from patients with cirrhosis. The respondents were predominantly white (77%) and male (96%) (Table 1). The majority completed the survey independently (89%). Respondents represented from Veterans all VA medical centers and each of four larger geographic “regions” (Fig 2).
Liver health and comorbidities
Respondents had a median of 3 (IQR 2–5) non-liver medical problems, most commonly including back pain, hypertension, and depression (Table 1). Most respondents reported that their health was “fair” or “good” and that liver disease contributed at least “somewhat” to their overall health (Table 2).
Awareness of cirrhosis symptoms
Approximately half of the patients had ICD codes for decompensation. However, patients often self-reported being “unsure” about whether they had experienced hepatic decompensation events (34%) (Table 2). Being unsure about cirrhosis symptoms occurred across all patients, unrelated to whether they had had codes for decompensation (33% among those who had decompensation vs. 34% among those who had not had decompensation).
Attitudes towards and experiences with care
Patients reported high overall satisfaction with liver disease care (Table 2). The most frequent location of care was face-to-face (85%).
Quality of life
The average quality of life for respondents was a PCS of 30±11 and MCS of 41±12, with higher scores on the VR-12 signifying better QOL. Both components of HRQoL were significantly lower for patients with decompensated vs. compensated disease (PCS = 26 vs. 31, p<0.001 and MCS = 40 vs. 42, p = 0.02), defined by ICD codes for decompensation (Table 3). Being unsure about decompensation was associated with even larger decreases in PCS (25 vs. 30, p<0.001) and MCS (37 vs. 43, p<0.001) than actual decompensation.
Self-reporting decompensation symptoms and reporting being unsure about decompensation were significantly associated with reduced PCS and MCS, regardless of type of decompensation (Table 4). The median difference in scores between those who reported “yes” vs. “no” to decompensation ranged from -6 to -11 for MCS and -6 to -10 for PCS. The median difference in scores between respondents who were “unsure” and those who reported “no” decompensation ranged from -7 to -12 for MCS and -6 to -9 for PCS.
In multivariable regression models (Table 5), hepatic decompensation (PCS:β = -3.8, MCS:β = -2.2), medical comorbidities (β = −-2.1, β = -1.7), and disease knowledge, or being unsure about cirrhosis symptoms (β = -1.9, β = -3.3) were significantly associated with worse HRQoL, while age (β = 0.1, β = 0.2) and greater satisfaction with care (β = 0.6; β = 1.6) were significantly associated with significantly improved QOL. There were no significant associations between PCS and demographic characteristics. However, region and race were associated with MCS in the final model (β = 4.7 for Northeast vs. Midwest and β = -4.6 for other race vs. white race).
In secondary analyses, the number of self-reported decompensation symptoms was substituted for decompensation (yes/no) in the multivariable models. Each additional reported symptom was associated with a reduction of 2.75 points in PCS (p<0.001) and 2.08 points in MCS (p<0.001) in these models, controlling for covariates.
Discussion
Through this national survey of Veterans of cirrhosis, we found that the strongest predictors of worse HRQoL were younger age, comorbidities, hepatic decompensation, lower satisfaction with care, and being unsure about cirrhosis symptoms. These novel connections between HRQoL and disease knowledge (being unsure about cirrhosis symptoms) and care satisfaction may provide new targets for intervention.
Using a generic HRQoL instrument allows us to compare Veterans with cirrhosis to other disease populations. Persons with no chronic conditions have average physical and mental component scores of 50 and 56, and healthcare-seeking patients have average scores of PCS = 40 and MCS = 50 [12]. Thus, Veterans with cirrhosis had reduced QOL (PCS = 30 and MCS = 41). These findings are consistent with estimates that patients with cirrhosis have score changes of -6 in PCS and -4 in MCS [13]. This cohort had mental component scores as low as patients with depression and physical component scores equivalent to patients with diabetes [12].
While the high burden of physical symptoms in a cohort of patients with cirrhosis was somewhat expected, the high burden of mental health symptoms reinforces how commonplace depression and anxiety symptoms are in patients with cirrhosis [14–16]. In this cross-sectional group of Veterans with cirrhosis, we found that 39% had self-identified depression. Previous studies have identified depression or depressive symptoms in 18–57% of patients with cirrhosis [14, 17–19]. Both depression and anxiety have been associated with HRQoL across disease states (e.g., emphysema and congestive heart failure) [20]. However, while mental health symptoms are clearly associated with the mental component of HRQoL, their association with physical component scores is more nuanced. For example, among 60 patients with cirrhosis, alexithymia, depression, and state- and trait-anxiety were all significantly associated with the mental component of HRQoL, but only trait-anxiety was significantly associated with the physical component [18]. There are several potential mechanisms that may underlie the connection between mental health symptoms and physical component scores. One direct, causal path may be mediated by the association between depression and anxiety and a pro-inflammatory or immunosuppressed state, which may negatively impact other health conditions, such as cirrhosis [19, 21, 22]. Alternatively, depression and anxiety can be associated with negative cognitions that can influence survey responses. These findings again illustrate the importance of screening for and treating mental health symptoms in this population.
Assessing PROs other than HRQoL are important for providing patient-centered care. Satisfaction with health care has recently been described by several prominent guidelines as a critical PRO to measure in patients with cirrhosis [3, 4]. We found that most Veterans were satisfied or highly satisfied with their cirrhosis care and that satisfaction and HRQoL scores are significantly associated. While it is difficult to infer directionality in a cross-sectional study, other longitudinal studies have found an association between satisfaction with care and subsequent HRQoL [23–25]. Patients who are less satisfied with their healthcare care may be less satisfied because their care does not address their physical and mental health symptoms, and this dissatisfaction with suboptimal care then is reflected in lower QOL scores. Conversely, mental health symptoms could theoretically lead to negative cognitive biases that reflect in negative ratings of care. However, regardless of directionality of these associations, addressing patient-reported symptoms not only can improve patients’ satisfaction with care but also can likely positively impact HRQoL.
One unexpected finding was that many patients reported that they were “unsure about cirrhosis symptoms,” including whether they had variceal bleeding, ascites, or encephalopathy symptoms. Being unsure about these decompensation events occurred equally among patients who had and had not had actual decompensation. Low health literacy and disease knowledge among patients with cirrhosis has been previously reported [26–29] and may reflect gaps in health education or literacy. Clinicians often provide inadequate education to patients [27, 30] and overestimate their communication skills around providing health education [31]. This is problematic because health literacy is considered to be “the greatest individual factor affecting a person’s health status” [26, 32]. For patients with cirrhosis, being uncertain about their disease severity or prior complications could have catastrophic consequences, such as not seeking timely care for a variceal bleed.
There are several approaches that may improve HRQoL in patients with cirrhosis. Uncertainty about symptoms of cirrhosis was associated with HRQoL, beyond the decompensation itself. Addressing patients’ health literacy and knowledge around cirrhosis may be one target for addressing uncertainty about decompensation and improving HRQoL. Education interventions (e.g., videos and booklets) [28] can improve knowledge [29, 33] and clinical outcomes [34–36]. Tailored disease self-management programs also show promise in improving care and HRQoL for patients with cirrhosis [36, 37]. VA’s newer “Annie” automated texting program can provide education, facilitate disease self-management, and serve as a platform to collect PROs from patients with liver disease [38]. Multidisciplinary or collaborative care approaches to care also may help address HRQoL in cirrhosis, particularly those programs with a focus on mental health or medication safety [35, 39–41]. However, more research is needed to assess how to optimize disease self-management and HRQoL for patients with cirrhosis.
There are several limitations of the current study, some of which suggest potential areas for future inquiry. First, he cross-sectional design of this study precluded causal inferences or assessments of directionality. Similarly, despite including Veterans from across the country, this study was underpowered to assess clinic-level performance or control for clinic-level care in this study given the small number of Veterans from each site. Moreover, while the 40% response rate is similar to the range of 19–46% reported in other large, national, mailed surveys [42–44], it is unclear whether this biased the findings, either via a “healthy participant bias” or, conversely, due to receiving more responses from dissatisfied or symptomatic patients. Another limitation of the study was the inability to assess health-behaviors, such as adherence, which may mediate other associations and could be of interest in future studies. We selected patients from a VA dashboard that identified patients with cirrhosis using validated ICD-9 and ICD-10 codes. While ICD codes are generally imperfect, the specificity of diagnostic codes in this case is improved since providers at each VA facility can review and remove inappropriate patients from the dashboard. Another potential limitation of the study was the use of self-reported comorbidities. However, self-reported depression in this sample was similar to prior prospective studies [14]. Additionally, the study population included predominantly white males and patients who engaged in face-to-face care, so future work should assess other populations of patients with cirrhosis. Given the unique and unexpected finding that patients who were unsure about their cirrhosis symptoms had lower HRQoL, future work should also directly measure disease knowledge and other potential mediators of this association.
In conclusion, we measured PROs in a national sample of Veterans with cirrhosis from across all VA sites using a validated, generic HRQoL instrument supplemented with questions related to satisfaction with care and medical co-morbidities, symptoms, and certainty about liver-related symptoms. We found that patients with cirrhosis have reduced HRQoL, which was related to not only hepatic decompensation, but also to uncertainty about decompensation events and care satisfaction.
Acknowledgments
The contents of this paper are solely from the authors and do not represent the views of the US Department of Veterans Affairs or the US Government.
References
- 1. Calvert M, Brundage M, Jacobsen PB, Schunemann HJ, Efficace F. The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health Qual Life Outcomes. 2013;11:184.
- 2. Wilson IB, Cleary PD. Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. JAMA. 1995;273(1):59–65.
- 3. Tapper EB, Kanwal F, Asrani SK, Ho C, Ovchinsky N, Poterucha J, et al. Patient-reported outcomes in cirrhosis: A scoping review of the literature. Hepatology. 2018;67(6):2375–83.
- 4. Kanwal F, Tapper EB, Ho C, Asrani SK, Ovchinsky N, Poterucha J, et al. Development of Quality Measures in Cirrhosis by the Practice Metrics Committee of the American Association for the Study of Liver Diseases. Hepatology. 2019;69(4):1787–97.
- 5. Kanwal F, Gralnek IM, Hays RD, Zeringue A, Durazo F, Han SB, et al. Health-related quality of life predicts mortality in patients with advanced chronic liver disease. Clin Gastroenterol Hepatol. 2009;7(7):793–9.
- 6. Belperio PS, Chartier M, Ross DB, Alaigh P, Shulkin D. Curing Hepatitis C Virus Infection: Best Practices From the U.S. Department of Veterans Affairs. Ann Intern Med. 2017;167(7):499–504.
- 7. Park A, Gonzalez R, Chartier M, Rogal S, Yakovchenko V, Ross D, et al. Screening and Treating Hepatitis C in the VA: Achieving Excellence Using Lean and System Redesign. Fed Pract. 2018;35(7):24–9.
- 8. Sangha O, Stucki G, Liang MH, Fossel AH, Katz JN. The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis Rheum. 2003;49(2):156–63.
- 9. Jepsen P. Comorbidity in cirrhosis. World J Gastroenterol. 2014;20(23):7223–30.
- 10. Kazis LE, Miller DR, Skinner KM, Lee A, Ren XS, Clark JA, et al. Applications of methodologies of the Veterans Health Study in the VA healthcare system: conclusions and summary. J Ambul Care Manage. 2006;29(2):182–8.
- 11. Kazis LE, Ren XS, Lee A, Skinner K, Rogers W, Clark J, et al. Health status in VA patients: results from the Veterans Health Study. Am J Med Qual. 1999;14(1):28–38.
- 12. Selim AJ, Rogers W, Fleishman JA, Qian SX, Fincke BG, Rothendler JA, et al. Updated U.S. population standard for the Veterans RAND 12-item Health Survey (VR-12). Qual Life Res. 2009;18(1):43–52.
- 13. Peng JK, Hepgul N, Higginson IJ, Gao W. Symptom prevalence and quality of life of patients with end-stage liver disease: A systematic review and meta-analysis. Palliat Med. 2019;33(1):24–36.
- 14. Rogal SS, Mankaney G, Udawatta V, Chinman M, Good CB, Zickmund S, et al. Pre-Transplant Depression Is Associated with Length of Hospitalization, Discharge Disposition, and Survival after Liver Transplantation. PLoS One. 2016;11(11):e0165517.
- 15. Rogal SS, Winger D, Bielefeldt K, Szigethy E. Pain and opioid use in chronic liver disease. Dig Dis Sci. 2013;58(10):2976–85.
- 16. Rogal SS, Bielefeldt K, Wasan AD, Szigethy E, Lotrich F, DiMartini AF. Fibromyalgia symptoms and cirrhosis. Dig Dis Sci. 2015;60(5):1482–9.
- 17. Buganza-Torio E, Mitchell N, Abraldes JG, Thomas L, Ma M, Bailey RJ, et al. Depression in cirrhosis—a prospective evaluation of the prevalence, predictors and development of a screening nomogram. Aliment Pharmacol Ther. 2019;49(2):194–201.
- 18. Nardelli S, Pentassuglio I, Pasquale C, Ridola L, Moscucci F, Merli M, et al. Depression, anxiety and alexithymia symptoms are major determinants of health related quality of life (HRQoL) in cirrhotic patients. Metab Brain Dis. 2013;28(2):239–43.
- 19. Rogal SS, Bielefeldt K, Wasan AD, Lotrich FE, Zickmund S, Szigethy E, et al. Inflammation, psychiatric symptoms, and opioid use are associated with pain and disability in patients with cirrhosis. Clin Gastroenterol Hepatol. 2015;13(5):1009–16.
- 20. Yohannes AM, Willgoss TG, Baldwin RC, Connolly MJ. Depression and anxiety in chronic heart failure and chronic obstructive pulmonary disease: prevalence, relevance, clinical implications and management principles. Int J Geriatr Psychiatry. 2010;25(12):1209–21.
- 21. Abelaira HM, Reus GZ, Petronilho F, Barichello T, Quevedo J. Neuroimmunomodulation in depression: a review of inflammatory cytokines involved in this process. Neurochemical research. 2014;39(9):1634–9.
- 22. Hou R, Garner M, Holmes C, Osmond C, Teeling J, Lau L, et al. Peripheral inflammatory cytokines and immune balance in Generalised Anxiety Disorder: Case-controlled study. Brain, behavior, and immunity. 2017;62:212–8.
- 23. Adnanes M, Kalseth J, Ose SO, Ruud T, Rugkasa J, Puntis S. Quality of life and service satisfaction in outpatients with severe or non-severe mental illness diagnoses. Qual Life Res. 2019;28(3):713–24.
- 24. Cramm JM, Strating MM, Sonneveld HM, Nieboer AP. The Longitudinal Relationship Between Satisfaction with Transitional Care and Social and Emotional Quality of Life Among Chronically Ill Adolescents. Appl Res Qual Life. 2013;8:481–91.
- 25. Frojd C, Lampic C, Larsson G, von Essen L. Is satisfaction with doctors' care related to health-related quality of life, anxiety and depression among patients with carcinoid tumours? A longitudinal report. Scand J Caring Sci. 2009;23(1):107–16.
- 26. Freundlich Grydgaard M, Bager P. Health literacy levels in outpatients with liver cirrhosis. Scand J Gastroenterol. 2018;53(12):1584–9.
- 27. Pinderup T, Bager P. Health literacy and liver cirrhosis: testing three screening tools for face validity. Br J Nurs. 2019;28(7):441–5.
- 28. Goldsworthy MA, Fateen W, Thygesen H, Aldersley MA, Rowe IA, Jones RL. Patient understanding of liver cirrhosis and improvement using multimedia education. Frontline Gastroenterol. 2017;8(3):214–9.
- 29. Volk ML, Fisher N, Fontana RJ. Patient knowledge about disease self-management in cirrhosis. Am J Gastroenterol. 2013;108(3):302–5.
- 30. Gulati R, Nawaz M, Pyrsopoulos NT. Health literacy and liver disease. Clin Liver Dis (Hoboken). 2018;11(2):48–51.
- 31. Chaudhary N, Lucero C, Villanueva G, Poles M, Gillespie C, Zabar S, et al. Assessment of Abilities of Gastroenterology Fellows to Provide Information to Patients With Liver Disease. Clin Gastroenterol Hepatol. 2017;15(7):1095–123 e3.
- 32. Scotten M. Parental health literacy and its impact on patient care. Prim Care. 2015;42(1):1–16.
- 33. Beg S, Curtis S, Shariff M. Patient education and its effect on self-management in cirrhosis: a pilot study. Eur J Gastroenterol Hepatol. 2016;28(5):582–7.
- 34. Alavinejad P, Hajiani E, Danyaee B, Morvaridi M. The effect of nutritional education and continuous monitoring on clinical symptoms, knowledge, and quality of life in patients with cirrhosis. Gastroenterol Hepatol Bed Bench. 2019;12(1):17–24.
- 35. Hayward KL, Patel PJ, Valery PC, Horsfall LU, Li CY, Wright PL, et al. Medication-Related Problems in Outpatients With Decompensated Cirrhosis: Opportunities for Harm Prevention. Hepatol Commun. 2019;3(5):620–31.
- 36. Sharif F, Mohebbi S, Tabatabaee HR, Saberi-Firoozi M, Gholamzadeh S. Effects of psycho-educational intervention on health-related quality of life (QOL) of patients with chronic liver disease referring to Shiraz University of Medical Sciences. Health Qual Life Outcomes. 2005;3:81.
- 37. Zandi M, Adib-Hajbagheri M, Memarian R, Nejhad AK, Alavian SM. Effects of a self-care program on quality of life of cirrhotic patients referring to Tehran Hepatitis Center. Health Qual Life Outcomes. 2005;3:35.
- 38. Yakovchenko V, Hogan TP, Houston TK, Richardson L, Lipschitz J, Petrakis BA, et al. Automated Text Messaging With Patients in Department of Veterans Affairs Specialty Clinics: Cluster Randomized Trial. J Med Internet Res. 2019;21(8):e14750.
- 39. Patel K, Maguire E, Chartier M, Akpan I, Rogal S. Integrating Care for Patients With Chronic Liver Disease and Mental Health and Substance Use Disorders. Fed Pract. 2018;35(Suppl 2):S14–S23.
- 40. Thomson MJ, Lok AS, Tapper EB. Optimizing medication management for patients with cirrhosis: Evidence-based strategies and their outcomes. Liver Int. 2018;38(11):1882–90.
- 41. Hayward KL, Martin JH, Cottrell WN, Karmakar A, Horsfall LU, Patel PJ, et al. Patient-oriented education and medication management intervention for people with decompensated cirrhosis: study protocol for a randomized controlled trial. Trials. 2017;18(1):339.
- 42. Harrison RA, Cock D. Increasing response to a postal survey of sedentary patients—a randomised controlled trial [ISRCTN45665423]. BMC Health Serv Res. 2004;4(1):31.
- 43. Blake KD, Portnoy DB, Kaufman AR, Lin CJ, Lo SC, Backlund E, et al. Rationale, Procedures, and Response Rates for the 2015 Administration of NCI's Health Information National Trends Survey: HINTS-FDA 2015. J Health Commun. 2016;21(12):1269–75.
- 44. Price CM, A CdCW, Smith BH, Bottle A. Implementation of Patient-Reported Outcomes (PROMs) from specialist pain clinics in England and Wales: Experience from a nationwide study. Eur J Pain. 2019;23(7):1368–77.