Reliability and validity of a 12-item medication adherence scale for patients with chronic disease in Japan

Abstract

Background

To improve and support medication adherence among patients with chronic diseases, especially for long-term medication, it is important to consider both their relationship with healthcare providers and their lifestyle. We tested the reliability and validity of a modified 12-item Medication Adherence Scale.

Methods

We revised a 14-item measure of medication adherence, created in 2009, to a more concise and clear 12-item version, and we verified the reliability and validity of the 12-item scale. We included 328 patients with chronic diseases participating in the Chronic Disease Self-Management Program in Japan from 2011 to 2014. Confirmatory factor analysis was used to assess whether the four factors assessed were the same as the previous 14-item Medication Adherence Scale. Cronbach’s coefficient alpha was used to assess internal consistency reliability, and the relationships between patient demographic characteristics and medication adherence were compared with previous studies.

Results

The 12 items were categorized into the four factors “medication compliance”, “collaboration with healthcare providers”, “willingness to access and use information about medication”, and “acceptance to take medication and how taking medication fits patient’s lifestyle”. Confirmatory factor analysis showed χ²/df = 2.6, CFI = 0.94, and RMSEA = 0.069. Cronbach’s alpha for the 12-item scale was 0.78. Cronbach’s alpha for the four subscales was 0.74, 0.81, 0.67, and 0.45. Higher medication adherence was significantly associated with being a female patient, living with someone else, and age 40–49 years versus age 20–29 years. These relationships were the same as in previous studies.

Conclusions

We modified our original 14-item scale to a 12-item Medication Adherence Scale for patients with chronic diseases, which considers their relationship with healthcare providers and lifestyle. Refinement might be needed because of the relatively low reliability of subscales. However, the modified scale is expected to contribute to more effective self-management of medication and to improving medication adherence, particularly among patients with chronic diseases who require long-term medication not only in Japan but also in other countries.

Background

The number of patients with chronic diseases, such as diabetes and cardiovascular disease, is increasing in developed countries [1]. Increasing severity of chronic diseases causes greater medical expenses [2] and poorer quality of life [1]. Patients with long-term conditions also need support to prevent problems from developing and avoid having to manage complications [3].

Medication is very important for the treatment of chronic diseases. However, many patients have challenges with maintaining constant medication regimens according to instructions [4, 5], which results in low medication compliance rates [6,7,8]. The average level of medication adherence among patients with chronic diseases in developed countries is only 50% [7, 9, 10].

A report on patients with chronic diseases, such as diabetes and hypertension, showed that medication was only effective in one-third of patients because it was incorrectly administered [11, 12]. Other reasons why medication may be ineffective include unnecessary preventive medication [5, 13] and incorrect prescribing. For example, patients are given short-term treatment when in fact long-term medication is needed [5].

According to Morisky, correct ongoing use of medication requires patients to understand the necessity of their medication [6, 14] as well as the risks of their disease and why medication is important [5, 14]. According to Hulka and Svensson, good patient–healthcare provider relationships [15, 16] are important for medication adherence. Haynes stated improving medication adherence requires adequate social support [17]. The World Health Organization (WHO) highlights the need for patient consent to and participation in their treatment [5]; this is similar to Kamishima, who pointed out the importance of patient agreement with their treatment [18]. These reports suggest that it is crucial to clarify the various psychosocial factors related to self-management of medication in patients with chronic diseases. This is considered to be beneficial for supporting the ongoing use of medication by people living with chronic diseases [5, 6].

The WHO has suggested that discussion between patients and healthcare providers is an important psychosocial aspect of medication support and treatment decision-making [1]. The WHO guidelines note that promoting patient participation depends on valid and reliable measurement of the adherence construct. Patients’ participation in decisions about medication requires good patient–healthcare provider communication. Strong emphasis is placed on the need to differentiate adherence from compliance. The main difference is that adherence requires the patient’s agreement with recommendations. The adherence concept has adopted the definition of adherence to long-term therapy as “the extent to which a person’s behavior corresponds with agreed recommendations from a healthcare provider” [5].

In Japan, Kamishima defined medication adherence as “the extent to which patients understand their diseases and treatment thoroughly, participate positively, and accomplish their medication behavior in line with agreed recommendations”. This definition attempts to combine behavioral and psychological aspects [18]. Kamishima also stated that ideal medication use, based on her concept of adherence, is when patients continue to take their medication because they understand that it is necessary, in consultation and collaboration with their healthcare provider about managing their physical condition [18].

Medication self-management in daily life requires not only patient’s understanding of the need for medication but also good partnerships between the patient and health care provider, choice of the medication that fits into the patient’s lifestyle, and their willingness to take the medication. The presence of all these factors is part of the concept of adherence [19].

A recent systematic review of adherence scales covered 43 validated scales [20]. Some tools shed light on barriers to adherence such as patient–healthcare provider relationships, self-efficacy, patient’s lifestyle and commitment. The focus of these past scales was not only on compliance but also knowledge, and psychological factors that affected expectations and rejection of medication [6, 14, 21]. However, there are no validated tools to measure the comprehensive concept of medication adherence, including psychosocial factors related to medication behavior, and particularly patient–caregiver relationships and lifestyle factors together.

Therefore, existing scales are insufficient to capture psychosocial aspects including daily life situations and lifestyles, as well as the relationship with the medical provider, to foster effective and continuing support. Considering self-management of medication adherence in daily life by focusing on social aspects, like daily life situation and lifestyle in addition to the psychological side, measurement of the patient’s medication situation can be made from a more multifaceted viewpoint. We therefore developed a 14-item Medication Adherence Scale [19] (see Additional files 1 and 2), to include not only compliance but also psychosocial factors related to medication behavior, and particularly patient–caregiver collaboration and relationship as well as patient lifestyle. Data collection and a survey were performed in 2009, and the results were published in the Journal of Japan in 2014. This 14-item scale was recognized by various hospital officials and researchers as a measure of medication adherence in Japan. Positive feedback of this measure has been received on an informal basis. Based on the results of analysis when considering the reliability and validity of the 14-item scale, it was thought that some items required modification, to improve the clarity and convenience of the scale. From the results of testing, some items implied a double negative and were difficult for target patients to understand. The inclusion of such items lowered the subscale alpha coefficient. We realized there was a need to further clarify the wording. Because double loading was found in factor analysis, items that were similar to other items were deleted. In addition, some question assessed concepts of another subscale. Therefore, we revised the scale to improve ease of use and accuracy of measurement; we modified the 14-item scale to create the 12-item Medication Adherence Scale. This scale included “medication compliance” and added the two psychosocial factors related to medication behavior: patient–caregiver collaboration, and daily lifestyle. The 12 items were expected to fit into the original four categories, “medication compliance”, “collaboration with healthcare providers”, “willingness to access and use information about medication”, and “acceptance to take medication and how taking medication fits patient’s lifestyle”.

In this study, we modified our original 14-item scale to a 12-item Medication Adherence Scale, with some items more clearly worded, to more accurately measure medication adherence in patients with chronic diseases, and we examined the reliability and validity of the 12-item scale.

Methods

We followed a three-step process in this study.

Step 1. Development of the 14-item medication adherence scale and modification to the 12-item scale

Scale items were constructed based on a literature review and interviews with patients who had chronic diseases as well as prescribing physicians. We grouped the main chronic diseases into six groups: type 1 diabetes, type 2 diabetes, rheumatic diseases (including rheumatic disease and connective tissue disease), hypertension, dyslipidemia, and other (heart disease; and allergies including asthma, atopic dermatitis, and allergic rhinitis). A self-administered questionnaire including these scale items was administered to 888 patients recruited from hospital outpatients and groups of patients with chronic diseases. We analyzed 509 responses (response rate, 57.3%). In 2009, we developed a 14-item Medication Adherence Scale [19] (see Additional files 1 and 2). From the results of evaluation of the 14-item scale to verify its reliability and validity, we found it was necessary to modify some items to more accurately and conveniently measure adherence.

In 2010, we held several conferences joined by seven researchers, two patients with chronic diseases, and one employee at a pharmaceutical company to discuss the results of analysis of the 14-item Medication Adherence Scale [19]. We examined the scale’s content validity and how we could make the scale more accurate and convenient to use. We included the same four assessment factors as in the original 14-item version in a new, 12-item version of the Medication Adherence Scale: “collaboration with healthcare providers”, “willingness to access and use information about medication”, “acceptance to take medication and how taking medication fits patient’s lifestyle”, and “medication compliance”. We felt that the four core factors should not be changed.

From the 14 items, we reduced the five items on the subscale “willingness to access and use information about medication” to three items. The reason for deleting item 4) is that it was similar to item 1). In factor analysis, we found double loading of factor 1) of 0.427 factor loading and factor 2) of 0.513 factor loading. The reason for deleting item 7) is because the question assessed the patient’s ability to take measures rather than their ability to collect and use information.

We then modified any items on the 14-item scale that had double negatives. Item 14) was a double negative, and we felt that some target patients may not have properly understood the meaning of the question; it was modified to item 3) on the 12-item scale.

Next, we modified the scale to ensure that suitable answers were provided for all respondents. It may have been difficult for target patients who live alone or had few people around them, or for those who do not need support, to respond to item 11) on the 14-item scale. This was also subject to environmental factors. Inclusion of this item lowered the subscale α coefficient. Therefore, we revised the question to be appropriate for all respondents.

Finally, we modified the wording of the response options to make it easier for respondents to answer questions.

Step 2. Reliability and validity of the 12-item medication adherence scale

During the study period, from June 2011 to June 2014, a self-administered questionnaire was sent to a total 540 patients with chronic diseases, who were participating in the Chronic Disease Self-Management Program(CDSMP) in Japan. CDSMP is the program developed at Stanford University and participants took a Japanese version of the program. We included any patients aged over 20 years old, who had a chronic disease and was continuously taking long-term medication. We excluded any patients with over 10% missing information, and those who were not taking any medication or were hospitalized at the time of the study. The questionnaire included the 12-item Medication Adherence Scale, categorized according to the four assessment factors, each of which contained three items. Each item was rated on a five-point Likert-type scale, with answers ranging from 1 (never) to 5 (always). Scores for the items on each subscale were summed to give a subscale score and an overall medication adherence score was also calculated by adding all 12 items. Scores were reversed for items 3) and 12), such that higher scores indicated higher medication adherence.

Step 3. Statistical analysis

The mean and standard deviation were calculated for each item on the 12-item Medication Adherence Scale. Ceiling and floor effects were also investigated for each item on the 12-item scale. Confirmatory factor analysis was used to assess the scale and confirm that the theoretical four-factor model would achieve the best fit for patients with chronic diseases in Japan. Model fitness was assessed using the maximum likelihood method, with the comparative fit index (CFI) and root mean square error of approximation (RMSEA). The model was built using items from the four subscales as observed variables. Cronbach’s coefficient alpha was calculated to assess the internal consistency reliability of each subscale. The construct validity was examined for relationships by comparing patient demographic characteristics and medication adherence with previous studies. Differences between two groups according to sex, education level, marital status, and number of diagnoses were evaluated using a t-test. Ages were categorized into six 10-year intervals using one-way analysis of variance and Tukey’s multiple comparison test.

All analyses were conducted with SPSS version 21.0 (IBM SPSS Japan Inc., Tokyo, Japan), except for the confirmatory factor analysis, which was done using AMOS version 21.0 (IBM SPSS Japan Inc., Tokyo, Japan).

Results

A self-administered questionnaire was sent to a total of 540 patients with chronic diseases in the community, all of whom were participating in the Chronic Disease Self-Management Program in Japan. In total, 392 patients returned the questionnaire, and 328 of these were suitable for analysis (response rate of 60.7%).

Characteristics of respondents to the 12-item medication adherence scale

The sociodemographic and clinical characteristics of study participants are shown in Table 1. There were 72 male (22.0%) and 254 female participants (77.4%); two participants (0.6%) did not specify their sex. The mean age was 48.72 ± 13.8 years. Mean disease duration was 14.18 ± 13.0 years. Table 2 shows the means and standard deviations for each item of the scale. A ceiling effect was found for five of the 12 items on the scale: items 1), 2), 3), 6) and 11).

Table 1 Demographic and clinical characteristics of participants (n = 328)

Table 2 Scores for items on the 12-item Medication Adherence Scale (n = 328)

Confirmatory factor analysis

The results of confirmatory factor analysis are shown in Fig. 1. The model fit indices were CFI = 0.94 and RMSEA = 0.069. There was relatively good fit between the four-factor model and the observed data. The CFI value of 0.94 was higher than 0.90, indicating a relatively good fit. The RMSEA value of 0.069 was in the reasonable fit range of 0.05–0.08.

Fig. 1

Results of the confirmatory factor analysis

Internal consistency

The internal consistency of the 12-item scale was good: Cronbach’s coefficient alpha was 0.78. Cronbach’s alpha was 0.74 for the “medication compliance” subscale, 0.81 for “collaboration with healthcare providers”, 0.67 for “willingness to access and use information about medication”, and 0.45 for “acceptance to take medication and how taking medication fits patient’s lifestyle”.

Construct validity

The relationships between patient demographic characteristics and medication adherence were comparable with previous studies, suggesting good construct validity. Table 3 shows the patient demographic characteristics associated with each subscale of the 12-item scale. Significant differences were seen between male and female, with scores for female being significantly higher on the “medication compliance” (p = 0.035) and “willingness to access and use information about medication” (p = 0.007) subscales and the total score (p = 0.010). For the “willingness to access and use information about medication” subscale, scores for participants aged 20–29 years were significantly lower than for those aged 40–49 years (p = 0.027). There were no significant correlations with single or multiple diagnoses.

Table 3 Correlation coefficients between total score and four subscales of the 12-item Medication Adherence Scale (n = 328)

Discussion

In this study, we modified and validated a 12-item Medication Adherence Scale, to improve and support medication adherence among patients with chronic diseases, especially for long-term medication. It is important to consider both patients’ relationship with healthcare providers and their lifestyle. This 12-item Medication Adherence Scale is a modified version of our original 14-item scale, with four subscales or factors, including “medication compliance” and three new factors: “collaboration with healthcare providers”, “willingness to access and use information about medication”, and “acceptance to take medication and how taking medication fits patient’s lifestyle”. These factors are significant because they represent the range of difficulties in ensuring long-term patient medication adherence.

In assessing the reliability and internal consistency of the 12-item Medication Adherence Scale, the results for the subscales were adequate. Values ranged from 0.67 to 0.81, except for “acceptance to take medication and how taking medication fits patient’s lifestyle”, where Cronbach’s coefficient alpha was 0.45. By excluding item 12), “I sometimes get annoyed that I have to keep taking medicine every day”, the Cronbach’s alpha for this subscale was 0.53.

We excluded item 12) from the 12-item scale so that all participants would be able to respond; the previous item was not applicable to some respondents. It is possible for the Cronbach’s coefficient alpha to change for different participant populations, so we did not exclude item 12) in the new version. We do, however, suggest that it may be inadvisable to use this subscale on its own, even though it provides a helpful contribution to the overall Medication Adherence Scale.

The results of the confirmatory factor analysis indicated that the 12-item Medication Adherence Scale fit the four-factor model, modified from the model that considered three pairs of error correlations. The path coefficient for the subscale on “medication compliance” (0.25) was lower than the other three subscales. We suggest that this subscale is unique of the concept of overall medication adherence compared to the other three subscales. The path coefficient of the subscale “acceptance to take medication and how taking medication fits patient’s lifestyle” was 0.82, a high value despite the low Cronbach’s alpha, which indicated lower internal consistency. This suggests that this subscale is an essential component in the concept of medication adherence.

The relationships between patient demographic characteristics and medication adherence were comparable with previous studies, suggesting good construct validity. Significant differences were seen between male and female for the “medication compliance” and “willingness to access and use information about medication” subscales and total scores, with female scoring significantly higher than male. Participants aged 20–29 years had significantly lower scores than those aged 40–49 years. Previous studies also showed that female and older age showed higher medication adherence [22]. Younger patients with less severe conditions often found it more difficult to continue medication [23]. There were significant lifestyle differences between participants aged 20–29 and 40–49 years, which may affect willingness to access and use information about medication. Older patients may also have had their diseases longer and may therefore be more used to their medication [24, 25]. We also found that people who lived with someone else were more likely to have higher medication adherence, which is consistent with previous studies reporting that living with someone else or having family support were linked to higher medication adherence [5, 17].

The use of this scale is considered appropriate not only for Japan but also for international use. Patients may use this 12-item Medication Adherence Scale to self-check the fit between lifestyle and medication. For healthcare providers, the 12-item scale offers three advantages. The first advantage is it may be used to capture the items or subscales that may be difficult for patients when their living circumstances change, for example, if they are hospitalized or enter into a nursing home. This may help us better understanding patients’ medication adherence, and eventually will enable us to provide better support for them. Second, this scale allows healthcare providers to identify those factors that are particularly difficult for patients. This could help patients and healthcare providers more collaboratively work and share information about medication. Third, this scale enables comparisons of medication adherence at different points of treatments over time and it also makes assessment of intervention effects easier. Together, this new 12-item scale is expected to help those in Japan and overseas with chronic diseases more effectively self-management their medication as well as improve the quality of their life and long-term health outcomes. In the future, this scale is expected to be useful not only for research but also in practice as a convenient evaluation index for medication adherence in patients with a variety of chronic diseases.

There are some limitations to this study. First, the participants in this study were patients with chronic diseases participating in the Chronic Disease Self-Management Program in Japan. They may therefore have been more interested in their self-management than other patients in general with chronic diseases, although they may also have needed more treatment because their diseases were in more serious condition. There may have been selection bias in the recruitment stage. Participants with type 2 diabetes, hypertension, and dyslipidemia were not an average sample of patients with these diseases; our participants were more aware of and more likely to adhere to their medication regimes. The study participants had a range of disease severity. Some had multiple diagnoses, and their disease severity threatened their activities of daily life. Other participants had less severe disease that did not affect them in daily life. It was therefore impossible to compare between diseases in this study.

Second, this scale was implemented in a limited population of Japan. There is a need to consider replicating the study for international or future use. Third, we assessed the scale, including the ceiling effect, but focused on content validity. Further research is needed to select participants with more illnesses in common and with less variation, to improve comparisons. Fourth, the scale was not compared with other quantitative measures that have been validated elsewhere. Finally, this study was limited to examining validity and reliability. Further examination of test-retest reliability and external validity are needed.

Conclusions

This study has demonstrated the reliability and validity of the 12-item Medication Adherence Scale for patients with chronic disease in Japan. The scale was categorized into four factors: “medication compliance”, “collaboration with healthcare providers”, “willingness to access and use information about medication”, and “acceptance to take medication and how taking medication fits patient’s lifestyle”. These reflect not only compliance but also patients’ relationships with healthcare providers and their lifestyles. This scale may be used to support more effective medication self-management, as it provides a convenient way to assess the medication-taking behavior of patients with chronic diseases. The scale is therefore expected to contribute to improving patients’ quality of life and health care outcomes through better adherence to medication regimes.