Skip to main content

Clinical assessment of bipolar depression: validity, factor structure and psychometric properties of the Korean version of the Bipolar Depression Rating Scale (BDRS)

Abstract

Background

The Bipolar Depression Rating Scale (BDRS) is a scale for assessment of the clinical characteristics of bipolar depression. The primary aims of this study were to describe the development of the Korean version of the BDRS (K-BDRS) and to establish more firmly its psychometric properties in terms of reliability and validity.

Methods

The study included 141 patients (62 male and 79 female) who had been diagnosed with bipolar disorder, were currently experiencing symptoms of depression, and were interviewed using the K-BDRS. Other measures included the Montgomery and Asberg Depression Scale (MADRS), the 17-item Hamilton Depression Scale (HAMD), and the Young Mania Rating Scale (YMRS). Additionally, the internal consistency, concurrent validity, inter-rater reliability, and test-retest reliability of the K-BDRS were evaluated.

Results

The Cronbach’s α-coefficient for the K-BDRS was 0.866, the K-BDRS exhibited strong correlations with the HAMD (r = 0.788) and MADRS (r = 0.877), and the mixed symptoms score of the K-BDRS was significantly correlated with the YMRS (r = 0.611). An exploratory factor analysis revealed three factors that corresponded to psychological depressive symptoms, somatic depressive symptoms, and mixed symptoms.

Conclusions

The present findings suggest that the K-BDRS has good psychometric properties and is a valid and reliable tool for assessing depressive symptoms in patients with bipolar disorder.

Peer Review reports

Background

A majority of patients with bipolar disorder experience depressive symptoms throughout approximately half of their lives [1, 2], and as a result, are often misdiagnosed with unipolar depression (depressive disorder) [3]. The failure to correctly diagnose these patients may lead to inappropriate treatment that can worsen the course of the disease [4] and, thus, a diagnostic approach for the recognition of bipolar disorder is essential. Nevertheless, it is difficult to distinguish bipolar depression from unipolar depression in real clinical practice settings. Active inquiry regarding past mania or hypomania is essential to diagnosis, but there are often no distinct prior episodes of mania to be described by the patient.

Several studies have suggested that there is a broad range of symptomatic differences between patients with unipolar depression and those with bipolar depression. Melancholic symptoms (worthlessness, marked anhedonia, and pathological guilt) and atypical depressive features (hypersomnia, hyperphagia, mood reactivity, and leaden paralysis) are more common in bipolar depression than in unipolar depression [59]. It has also been found that mixed features such as irritability, mood lability, distractibility, and racing thoughts are more common in patients with bipolar depression [10, 11]. Yet, the widely used scales in clinical and research practice in bipolar depression are the Montgomery and Asberg Depression Scale (MADRS, [12]) and the 17-item Hamilton Depression Scale (HAMD, [13]), which were originally developed for use in unipolar depression. They do not capture many core symptoms of bipolar depression, including atypical and mixed features.

The Bipolar Depression Rating Scale (BDRS) is a semi-structured, observer-rated scale for clinical assessment of bipolar depression. It was developed by Berk et al. [14] based on previous phenomenological research and literature reviews that assessed differences between patients with bipolar depression and those with unipolar depression [7, 8, 15, 16]. The BDRS comprises items that evaluate the clinical features associated with the depressive phase of bipolar disorder, including atypical symptoms and mixed phenomenology [14]. This measure can be used to assess depressive symptomatology as well as to evaluate the effectiveness of therapeutic agents for the treatment of bipolar depression.

The objectives of this study were to develop a Korean version of the BDRS (K-BDRS) while maintaining its basic structure and to evaluate the reliability and validity of this measure in the Korean population.

Methods

Patients

This study included 141 patients (62 males and 79 females) who were diagnosed with bipolar disorder according to the criteria of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) [17] and who were currently experiencing symptoms of depression but did not necessarily fulfill the criteria for a major depressive episode. Bipolar disorder and comorbid psychiatric disorders were diagnosed using the Korean version of the Mini International Neuropsychiatric Interview (MINI) and the DSM-IV-TR [18, 19].

All patients were recruited from 11 university hospitals throughout the territories of the Republic of Korea between 1 September 2013 and 28 February 2015 and were between 18 and 65 years of age. Patients with comorbid psychiatric disorder (n = 21), were included if their diagnosis included bipolar disorder as the primary illness. Patients were excluded if there was any evidence of severe cognitive impairment. All patients were receiving standard medications for bipolar disorder, including mood stabilizers (lithium, valproate, carbamazepine, or lamotrigine), atypical antipsychotics (aripiprazole, olanzapine, quetiapine, or risperidone) and antidepressants.

All patients provided informed consent for their participation in this study after the procedure had been fully explained to them and the study protocol was approved by the Institutional Review Boards of the ethical committee of the Jeju National University Hospital at the Jeju University of Korea (JEJUNUH 2013-11-003-001).

Measurements and procedures

All participants were assessed using the K-BDRS and then interviewed with the Montgomery and Asberg Depression Scale (MADRS, [12]), the 17-item Hamilton Depression Scale (HAMD, [13]), and the Young Mania Rating Scale (YMRS, [20]). These measures were selected to assess the concurrent validity of the K-BDRS. All investigators and raters involved in this study were clinical psychiatrists with more than 10 years of clinical experience in bipolar disorder, and had received formal training in the use of all the rating scales.

The BDRS consists of 20 items that are rated from 0–3 on a Likert-type scale according to a manual that describes the characteristics of each individual item [14]. The BDRS total score ranges from 0–60, such that higher scores reflect more severe depressive symptoms. The original BDRS has good internal consistency (Cronbach’s α = 0.917) as well as strong correlations with other depression rating scales [14].

The original BDRS scale and its manual (freely available at http://www.barwonhealth.org.au/bdrs/) were translated into Korean by two psychiatrists (YEJ and MDK), and then back-translation was performed by a bilingual psychiatrist unaware of the original BDRS. A preliminary translated version was modified until the back-translated version was comparable with the original English version. Three authors of the study (YEJ, MDK, and WMB.) reviewed the results before producing the final version.

The 17-item HAMD is the most widely used instrument for clinical assessment of the severity of depressive symptoms and it is frequently used in studies as an anchor for comparison with novel measures [13]. The Korean version of the HAMD has good psychometric properties [21]. The MADRS is a 10-item rating measure specifically designed to assess treatment-induced changes in depressive symptoms [12]. The Korean version of the MADRS has been confirmed as valid and reliable [22]. The YMRS consists of 11 items and is the most widely used measure for assessment of the severity of manic symptoms [20]. The Korean version of the YMRS has been confirmed as valid and reliable [23].

A subgroup of 20 patients was interviewed by two raters to examine the inter-rater reliability of the K-BDRS. Additionally, to assess test-retest validity, 35 subjects were evaluated by the same investigator who performed the two testing sessions within 5 days.

Statistical analysis

The internal consistency of the K-BDRS was determined using Cronbach’s α-coefficients. The inter-rater and test-retest reliability values were computed using intraclass correlation coefficients (ICC) [24]. ICC values range from 0 to 1; values of 0.7 and over are considered to indicate ‘substantial agreement’ and values of 0.5–0.7 are considered to indicate ‘moderate agreement’ [25]. The concurrent validity was determined using Pearson’s correlation coefficients to compute the strength and direction of the relationships between scores on the K-BDRS and the other measures. Additionally, a factor analysis was conducted using the unweighted least squares method with oblique factor rotations. A p value < 0.05 was considered to indicate statistical significance.

Results

All relevant demographic and clinical characteristics are presented in Table 1. The internal consistency of the K-BDRS was assessed using Cronbach’s α-coefficient, which was calculated as 0.866. The internal consistency of the depressive subscale of the K-BDRS (Items 1–15) was 0.893 but the mixed subscale (Items 16–20) showed a lower Cronbach’s α-coefficient of 0.756. Table 2 shows the correlations of each item with the total K-BDRS score using a criterion of 0.30 as an acceptable corrected item-total correlation [26]; all but four of the items performed adequately. This lower correlation followed an expected trend for the mixed subscale symptoms such that they correlated less strongly with the total K-BDRS score.

Table 1 Demographic and clinical characteristics of the patients
Table 2 Internal consistency of the K-BDRS

The inter-rater reliability was analyzed in a subsample of patients (n = 20) who were interviewed by two different raters. The inter-rater reliability was high for both the total K-BDRS score (ICC = 0.954, 95 % confidence interval [CI] = 0.884–0.982, p < 0.001) and the individual items (ICC > 0.70). The test-retest reliability was also analyzed in a subsample of patients (n = 35) who had no clinical change between two testing sessions, and was high for both the total K-BDRS score (ICC = 0.950, 95 % CI = 0.901–0.975, p < 0.001) and the individual items as well (ICC > 0.70; Table 3).

Table 3 Inter-rater and test-retest reliability of the K-BDRS

The K-BDRS was factor analyzed using the data of all 141 patients to determine the optimal number of factors that described the scale. An unweighted least squares factor analysis was followed by oblique rotations of 2–4 factors. Prior to the rotation, the eigenvalues for the first four factors were 6.67, 3.36, 1.36, and 1.14 with corresponding percentages of variance accounted for of 33.37, 16.79, 6.79, and 5.70 %. The three-factor rotation was determined to provide the most useful description of the data and these three factors were labeled as psychological depressive symptoms (Factor 1), somatic depressive symptoms (Factor 2), and mixed symptoms (Factor 3). Table 4 shows the factor loadings and Table 5 shows the correlations among the total scores of the K-BDRS and the other factor scores.

Table 4 Factor loadings of the K-BDRS.
Table 5 Correlation coefficients among the K-BDRS scores and factor scores (n = 141)

To assess the concurrent validity of the K-BDRS, the total scores and factor scores on the K-BDRS were compared with those on the HAMD, MADRS, and YMRS. The K-BDRS total scores were strongly correlated with the HAMD scores (r = 0.788, p < 0.001) and the MADRS scores (r = 0.877, p <0.001), the depression subscale scores of the K-BDRS (Items 1–15) were strongly correlated with the HAMD scores (r = 0.888, p < 0.001) and the MADRS scores (r = 0.759, p < 0.001), and the mixed subscale scores (Item 16–20) were strongly correlated with the YMRS scores (r = 0.611, p < 0.001). The correlations between the K-BDRS factor scores and the total scores on the HAMD, MADRS and YMRS are presented in Table 6.

Table 6 Correlation coefficients for the total scores of the K-BDRS, HAMD, MADRS, YMRS, and factor scores

Discussion

The present findings suggest that the K-BDRS has good psychometric properties and may be a reliable and valid tool for measurement of the severity of depressive symptoms in Korean patients with bipolar disorder. Compared with the original BDRS (α = 0.917), the K-BDRS has a somewhat low internal consistency (α = 0.866), but the internal consistency is consistent with other translated versions from Iran (α = 0.81) [27], Turkey (α = 0.786) [28], and Spain (α = 0.870) [29].

In this study, the concurrent validity of the K-BDRS was demonstrated based on its correlations with the HAMD, MADRS, and YMRS. The strong correlation coefficients of the K-BDRS with the other scales indicate that the K-BDRS accurately assesses depressive symptoms. Additionally, the mixed subscale score of the K-BDRS (Item 16–20) exhibited a strong correlation with the YMRS which indicates that the K-BDRS accurately assesses the mixed symptoms that frequently present in patients with bipolar depression. This is an important aspect of the K-BDRS because the rating of mixed features in bipolar depression is an area of great clinical significance.

The factor analysis of the K-BDRS revealed a three-factor solution that provided the best account of the present data. Although the factor loadings are different, the three-factor solution observed in the present study resembled the three-factor structure originally reported by previous studies [14]. As expected, the depressive subscales of the K-BDRS loaded onto psychological depressive symptoms (e.g., suicidal ideation, guilt, worthlessness, and helplessness) and somatic depressive symptoms (e.g., reduced activity and concentration and appetite disturbance). However, several items in the present study differed from those of the original study by Berk et al. [14]. In that study, anhedonia and flattened affect loaded onto psychological depressive symptoms but the present study found that anhedonia and flattened affect loaded onto somatic depressive symptoms. Because these symptoms are strongly related to reduced motivation and energy, it may be rational to assume that these features can be grouped under the somatic depressive symptoms factor.

Both of the depressive symptoms factors were strongly correlated with each other but weakly correlated with the mixed symptoms factor. All of the mixed subscales of the K-BDRS loaded together under the mixed symptoms factor, with the exception of lability. Lability is common in bipolar depression [10, 11] and similarly loaded onto both the psychological depressive and mixed symptoms factors. Psychotic symptoms are also included in the mixed symptoms factors, as demonstrated by Berk et al. [14]. This indicates that psychotic symptoms have a greater association with mixed features than with depressive symptoms. Our findings that the internal structure of the K-BDRS appears to be sensitive to mixed symptoms of bipolar depression are consistent with the previous reports [30].

The development of a Korean version of the K-BDRS is significant in several respects. The results of the present study confirmed the psychometric properties of the K-BDRS, which will enable both clinicians and researchers to use this instrument in the field to assess the severity and treatment responses of depressive symptoms in patients with bipolar disorder. Most importantly, the K-BDRS includes items that rate the mixed and atypical features of bipolar disorder, which may be overlooked by conventional depressive scales such as the MADRS and HAMD. Previous reports comparing unipolar and bipolar depression with the BDRS and the MADRS showed MADRS scores were unable to distinguish unipolar from bipolar depression. However, BDRS scores were significantly marked for the mixed subscale, suggesting that presence of mixed features during a depressive episode is in favour of bipolar depression [31].

The limitations of the present study were that the numbers of patients in the subgroups for the inter-rater and test-retest reliability ratings may have been insufficient. Additionally, the present study was cross-sectional and, therefore, it is difficult to determine whether the K-BDRS would be useful for the detection of changes in illness severity following treatment.

Conclusions

The K-BDRS possesses good psychometric properties and is likely a valid and reliable tool for the assessment of depressive symptoms in patients with bipolar disorder. However, further studies are needed to evaluate the K-BDRS more fully. These studies should assess the applicability of the K-BDRS for various bipolar disorder subgroups as well as evaluate the scale’s utility for differentiating bipolar disorder from unipolar depression.

Abbreviations

BDRS, the Bipolar Depression Rating Scale; CI, confidence interval; DSM-IV-TR, the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision; HAND, the 17-item Hamilton Depression Scale; ICC, intraclass correlation coefficients; K-BDRS, Korean version of the BDRS; MADRS, the Montgomery and Asberg Depression Scale; MINI, the Mini International Neuropsychiatric Interview; YMRS, the Young Mania Rating Scale

References

  1. Judd LL, Akiskal HS, Schettler PJ, Endicott JN, Maser J, Solomon DA, et al. The long-term natural history of the weekly symptomatic status of bipolar I disorder. Arch Gen Psychiatry. 2002;59:530–7.

    Article  PubMed  Google Scholar 

  2. Judd LL, Akiskal HS, Schettler PJ, Coryell W, Endicott J, Maser JD, et al. A prospective investigation of the natural history of the long-term weekly symptomatic status of bipolar II disorder. Arch Gen Psychiatry. 2003;60:261–9.

    Article  PubMed  Google Scholar 

  3. Goldberg JF, Harrow M, Whiteside JE. Risk for bipolar illness in patients initially hospitalized for unipolar depression. Am J Psychiatry. 2001;158:1265–70.

    Article  CAS  PubMed  Google Scholar 

  4. Kamat SA, Rajagopalan K, Pethick N, Willey V, Bullano M, Hassan M. Prevalence and humanistic impact of potential misdiagnosis of bipolar disorder among patients with major depressive disorder in a commercially insured population. J Manag Care Pharm. 2008;14:631–42.

    PubMed  Google Scholar 

  5. Gan Z, Diao F, Wei Q, Wu X, Cheng M, Guan N, et al. A predictive model for diagnosing bipolar disorder based on the clinical characteristics of major depressive episodes in Chinese population. J Affect Disord. 2011;134:119–25.

    Article  PubMed  Google Scholar 

  6. Parker G, Roy K, Wilhelm K, Mitchell P, Hadzi-Pavlovic D. The nature of bipolar depression: implications for the definition of melancholia. J Affect Disord. 2000;59:217–24.

    Article  CAS  PubMed  Google Scholar 

  7. Cuellar AK, Johnson SL, Winters R. Distinctions between bipolar and unipolar depression. Clin Psychol Rev. 2005;25:307–39.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Mitchell PB, Wilhelm K, Parker G, Austin MP, Rutgers P, Malhi GS. The clinical features of bipolar depression: a comparison with matched major depressive disorder patients. J Clin Psychitry. 2001;62:212–6.

    Article  CAS  Google Scholar 

  9. Mitchell PB, Goodwin GM, Johnson GF, Hirschfeld RM. Diagnostic guidelines for bipolar depression: a probabilistic approach. Bipolar Disord. 2008;10:144–52.

    Article  PubMed  Google Scholar 

  10. Benazzi F. Depressive mixed state: a feature of the natural course of bipolar II (and major depressive) disorder? Psychopathology. 2004;37:207–12.

    Article  PubMed  Google Scholar 

  11. Goldberg JF, Perlis RH, Bowden CL, Thase ME, Miklowitz DJ, Marangell LB, et al. Manic symptoms during depressive episodes in 1,380 patients with bipolar disorder: findings from the STEP-BD. Am J Psychiatry. 2009;166:173–81.

    Article  PubMed  Google Scholar 

  12. Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979;134:382–9.

    Article  CAS  PubMed  Google Scholar 

  13. Hamilton MA. A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960;23:56–62.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Berk M, Malhi GS, Cahill C, Carman AC, Hadzi-Pavlovic D, Hawkins MT, et al. The Bipolar Depression Rating Scale (BDRS): its development, validation and utility. Bipolar Disord. 2007;9:571–9.

    Article  PubMed  Google Scholar 

  15. Berk M, Malhi GS, Mitchell PB, Cahill CM, Carman AC, Hadzi-Pavlovic D, et al. Scale matters: the need for a Bipolar Depression Rating Scale (BDRS). Acta Psychiatr Scand. 2004;422:39–45.

    Article  Google Scholar 

  16. Mitchell PB, Malhi GS. Bipolar depression: phenomenological overview and clinical characteristics. Bipolar Disord. 2004;6:530–9.

    Article  PubMed  Google Scholar 

  17. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision. Washington, D.C.: American Psychiatric Association; 2000.

    Book  Google Scholar 

  18. Sheehan DV, Lecruiber Y, Sheehan KH, Patricia JJ, Weiller E, Hergueta T, et al. The MINI international neuropsychiatric interview (MINI): the development and validation of a structured interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59:22–33.

    PubMed  Google Scholar 

  19. Yoo SW, Kim YS, Noh JS, Oh KS, Kim CH, Namgung K, et al. Validity of Korean version of the MINI international neuropsychiatric interview. Anxiety and Mood. 2006;2:50–5.

    Google Scholar 

  20. Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978;133:429–35.

    Article  CAS  PubMed  Google Scholar 

  21. Yi JS, Bae SO, Ahn YM, Park DB, Noh KS, Shin HK, et al. Validity and reliability of the Korean version of the Hamilton Depression Rating Scale (K-HDRS). J Korean Neuropsychiatr Assoc. 2005;44:456–65.

    Google Scholar 

  22. Ahn YM, Lee KY, Yi JS, Kang MH, Kim DH, Kim JL, et al. A validation study of the Korean-version of the Montgomery-Asberg Depression Rating Scale. J Korean Neuropsychiatr Assoc. 2005;44:466–76.

    Google Scholar 

  23. Jung HY, Cho HS, Joo YH, Shin HK, Yi JS, Hwang S, Kim YS. A validation study of the Korean version of the Young Mania Rating Scale. J Korean Neuropsychiatr Assoc. 2003;42:263–9.

    Google Scholar 

  24. Prieto L, Lamarca R, Casado A, Alonso J. The evaluation of agreement on continuous variables by the intraclass correlation coefficient. J Epidemiol Community Health. 1997;51:579–80.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Schene AH, Koeter M, Wijngaarden BV, Knudsen HC, Leese M, Ruggeri M, et al. Methodology of a multi-site reliability study. Br J Psychiatry. 2000;177 Suppl 39:S15–20.

    Article  Google Scholar 

  26. Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.

    Google Scholar 

  27. Shabani A, Akbari M, Dadashi M. Reliability and validity of the Bipolar Depression Rating Scale on an Iranian sample. Arch Iran Med. 2010;13:217–22.

    PubMed  Google Scholar 

  28. Batmaz S, Ozdel K, Kocbiyik S, Karadag H. The validity and reliability of the Turkish version of the bipolar depression rating scale. Compr Psychiatry. 2014;55:1448–54.

    Article  PubMed  Google Scholar 

  29. Sarró S, Madre M, Fernández-Corcuera P, Valentí M, Goikolea JM, Pomarol-Clotet E, et al. Transcultural adaption and validation of the Spanish version of the Bipolar Depression Rating Scale (BDRS-S). J Affect Disord. 2014;172:110–5.

    Article  PubMed  Google Scholar 

  30. Chang JS, Ahn YM, Yu HY, Park HJ, Lee KY, Kim SH, et al. Exploring clinical characteristics of bipolar depression: internal structure of the bipolar depression rating scale. Aust N Z J Psychiatry. 2009;43:830–7.

    Article  PubMed  Google Scholar 

  31. Galvão F, Sportiche S, Lambert J, Amiez M, Musa C, Nieto I, et al. Clinical differences between unipolar and bipolar depression: Interest of BDRS (Bipolar Depression Rating Scale). Compr Psychiatry. 2013;54:605–10.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

None.

Funding

No funding was obtained for this study.

Availability of data and materials

The data will not be shared because that includes confidential patient data.

Authors’ contributions

MDK and YEJ designed the study. WMB and MDK coordinated the running study and planed and supervised clinical estimate procedure. MDK and YEJ analyzed the date and wrote up the first draft of the paper. All authors collected data, and contributed to and have approved the final manuscript.

Competing interest

The authors declare that they have no competing interests.

Ethics approval and consent to participate

All patients provided informed consent for their participation in this study after the procedure had been fully explained to them and the study protocol was approved by the Institutional Review Boards of the ethical committee of the Jeju National University Hospital at the Jeju University of Korea (JEJUNUH 2013-11-003-001).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Moon-Doo Kim or Won-Myong Bahk.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jung, YE., Kim, MD., Bahk, WM. et al. Clinical assessment of bipolar depression: validity, factor structure and psychometric properties of the Korean version of the Bipolar Depression Rating Scale (BDRS). BMC Psychiatry 16, 239 (2016). https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-016-0958-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-016-0958-7

Keywords