Next Article in Journal
Is Medication-Related Osteonecrosis of the Jaws (MRONJ) Associated to Cyclin-Dependent Kinase (CDK) 4/6 Inhibitors? A Word of Cautiousness. Comment on Marcianò et al. Medication-Related Osteonecrosis of the Jaws and CDK4/6 Inhibitors: A Recent Association. Int. J. Environ. Res. Public Health 2020, 17, 9509
Next Article in Special Issue
Adherence to Oral Contraception in Young Women: Beliefs, Locus of Control, and Psychological Reactance
Previous Article in Journal
Sex, Sleep Duration, and the Association of Cognition: Findings from the China Health and Retirement Longitudinal Study
Previous Article in Special Issue
Adolescents’ Bipolar Experiences and Suicide Risk: Well-being and Mental Health Difficulties as Mediators
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Depression Anxiety Stress Scale 21: Development and Validation of the Depression Anxiety Stress Scale 8-Item in Psychiatric Patients and the General Public for Easier Mental Health Measurement in a Post COVID-19 World

by
Amira Mohammed Ali
1,2,*,
Abdulmajeed A. Alkhamees
3,
Hiroaki Hori
1,
Yoshiharu Kim
1 and
Hiroshi Kunugi
4,5
1
Department of Behavioral Medicine, National Institute of Mental Health, National Center of Neurology and Psychiatry, Tokyo 187-8553, Japan
2
Department of Psychiatric Nursing and Mental Health, Faculty of Nursing, Alexandria University, Alexandria 21527, Egypt
3
Department of Medicine, College of Medicine and Medical Sciences, Qassim University, Buraydah 52571, Al Qassim, Saudi Arabia
4
Department of Psychiatry, Teikyo University School of Medicine, Tokyo 173-8605, Japan
5
Department of Mental Disorder Research, National Institute of Neuroscience, National Center of Neurology and Psychiatry, Tokyo 187-8502, Japan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(19), 10142; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910142
Submission received: 26 August 2021 / Revised: 22 September 2021 / Accepted: 23 September 2021 / Published: 27 September 2021
(This article belongs to the Special Issue Prevention of Mental Health Disorders in Children and Adolescents)

Abstract

:
Despite extensive investigations of the Depression Anxiety Stress Scales-21 (DASS-21) since its development in 1995, its factor structure and other psychometric properties still need to be firmly established, with several calls for revising its item structure. Employing confirmatory factor analysis (CFA), this study examined the factor structure of the DASS-21 and five shortened versions of the DASS-21 among psychiatric patients (N = 168) and the general public (N = 992) during the COVID-19 confinement period in Saudi Arabia. Multigroup CFA, Mann Whitney W test, Spearman’s correlation, and coefficient alpha were used to examine the shortened versions of the DASS-21 (DASS-13, DASS-12, DASS-9 (two versions), and DASS-8) for invariance across age and gender groups, discriminant validity, predictive validity, item coverage, and internal consistency, respectively. Compared with the DASS-21, all three-factor structures of the shortened versions expressed good fit, with the DASS-8 demonstrating the best fit and highest item loadings on the corresponding factors in both samples (χ2(16, 15) = 16.5, 67.0; p = 0.420, 0.001; CFI = 1.000, 0.998; TLI = 0.999, 0.997; RMSEA = 0.013, 0.059, SRMR = 0.0186, 0.0203). The DASS-8 expressed configural, metric, and scalar invariance across age and gender groups. Its internal consistency was comparable to other versions (α = 0.94). Strong positive correlations of the DASS-8 and its subscales with the DASS-21 and its subscales (r = 0.97 to 0.81) suggest adequate item coverage and good predictive validity of this version. The DASS-8 and its subscales distinguished the clinical sample from the general public at the same level of significance expressed by the DASS-21 and other shortened versions, supporting its discriminant validity. Neither the DASS-21 nor the shortened versions distinguished patients diagnosed with depression and anxiety from each other or from other psychiatric conditions. The DASS-8 represents a valid short version of the DASS-21, which may be useful in research and clinical practice for quick identification of individuals with potential psychopathologies. Diagnosing depression/anxiety disorders may be further confirmed in a next step by clinician-facilitated examinations. Brevity of the DASS-21 would save time and effort used for filling the questionnaire and support comprehensive assessments by allowing the inclusion of more measures on test batteries.

1. Introduction

Depressive and anxiety disorders are widespread in the general population, especially during the current COVID-19 pandemic [1,2]. Their increased occurrence during the COVID-19 crisis is due to the emotional reactions associated with the widespread nature of the disease, the grave adverse effects of the disease, as well as the lockdown adopted to protect against COVID-19, which entails restricted social interactions and loneliness implied by increased internet use as a defective coping method [2,3]. The pandemic is also associated with developing unhealthy dietary patterns and decreased levels of physical activity due to increased time spent at home [4,5,6]. These factors are associated with the development of a systematic inflammatory reaction that may affect brain regions involved in emotional regulation, resulting in the development of affective dysfunctions [7,8]. Moreover, SARS-CoV-2, the causative virus of COVID-19, causes neurodegeneration via direct invasion of brain cells and the cytokine storm, resulting in accelerated rates of the development of depression and anxiety in COVID-19 survivors [9]. In addition to their high occurrence in a wide-range of patient populations [10,11,12,13], depressive and anxiety disorders are also highly co-morbid with one another [14,15,16]. Their comorbidity is associated with common risk factors (e.g., childhood trauma and age of onset), and it coincides with the worst functional, somatic, and psychiatric outcomes [14].
Aggregate data denote a widespread prevalence of depression, anxiety, and low self-esteem among youth [17]. An exponential increase in this prevalence (up to 44%) has been witnessed during COVID-19, especially in the later years of the pandemic [18,19]. Females exhibit the highest prevalence of youth psychopathologies—almost twice the rate of males [18,19,20,21]. Youth psychopathologies are strongly associated with parental depression/anxiety, indicating a considerable genetic influence [20,22]. Depression, anxiety, and binge drinking in adolescents are associated with polymorphisms in the serotonin transporter (5-HTT) S-allele, the monoamine oxidase A (MAOA) low-activity alleles, and the dopamine D2 receptor (DDR2) Taq A1 allele [23].
The developmental psychology approach is an ecological–transactional model of development, which emphasizes the ontogenic and dynamically interacting aspects of psychological development [24]. Research has established the fetal phase of life as a sensitive period of development. Prenatal maternal substance use and maternal malnutrition as well as maternal stress can exert significant negative effects on the behavioral, brain, and psychopathological outcomes in the developing offspring [25,26,27]. Although the exact pathways involved in the development of psychopathology due to in utero exposure to stress is unclear, findings from animals studies suggest that the physiological alterations associated with maternal adversities trigger dysfunctional adaptations in the fetal hypothalamic-pituitary-adrenal axis: (a) transplacental passage of maternal cortisol to the fetus; (b) increased production of placental corticotropin-releasing hormone, which may enter the fetal circulation; and (c) maternal stress-induced effects on the sympathetic nervous system may result in vasoconstriction and decreased uteroplacental blood flow [27]. Interestingly, infants’ temperament, anxiety, and depression develop as a result of prenatal maternal symptoms of depression and anxiety, which occur in up 27% of pregnancies and contribute to poor maternofetal attachment, lack of initiation or early termination of breast feeding, and high levels of postpartum parenting stress. These effects were less common in women with a previously established diagnosis of depression or anxiety, signifying the stressful nature of anxiety and depression that evolve during pregnancy [13].
Maternal mood dysfunction may also influence the development of psychopathologies during early childhood due to factors of innate dysfunctional neuroregulatory mechanisms that develop during pregnancy, heritability, child exposure to maternal negative affect, cognitions, and dysfunctional behaviors, which may create a stressful context of a child’s life [28]. Gene-environment interactions play a pivotal role in early-life psychopathology. Childhood stress, trauma, and chronic exposure to domestic violence act as environmental factors that interact with genes conducive to prolonged activation of the stress response, resulting in increased vulnerability to depression and anxiety psychopathology [21,29]. Dysfunctional parenting behaviors represent one of the key environmental factors that are associated with higher psychopathology among adolescents [20,30]. For children of mothers with depression/anxiety psychopathologies, father involvement in child care, pattern and course of maternal mood dysregulation, and child characteristics may act as moderators to the risk of child psychopathology [28]. In line, a longitudinal investigation revealed that maternal anxiety and depression act as predictors of anxiety and depression in their adolescent children, especially female children with low adrenocortical reactivity. On the other hand, depression in youth with high adrenocortical reactivity is reported to significantly predict maternal depression [31]. Thus, the complex nature of the intergenerational transmission of depression and anxiety psychopathologies highlights these conditions as lifelong burdensome conditions for youth, their families, and the global community.
Poor quality of life, impaired academic/work performance, disturbed social life, extreme hopelessness, the development of dysfunctional eating patterns, negative religious coping, turning to alcohol and drug use as defective coping, and suicide are commonly reported drawbacks of these conditions [2,25,32]. Accordingly, prompt identification and management of depression and anxiety among youth are necessary to prevent a wide range of grave morbidities. Below the age of 20 years, depression and anxiety as clinical diagnoses of emotional disorders are moderately co-morbid [33,34]. Among youths diagnosed with at least one emotional disorder, depression and anxiety as symptoms are more discriminable (i.e., by multiple factors) than among mental disease-free youth who express symptoms by a single factor [33].
The tripartite model has been proposed to discretely identify depression from anxiety and stress. The latter co-occurs in both conditions [35]. However, research indicates that depression and anxiety are more interrelated than previously thought. A meta-analysis involving 226 task-related functional imaging studies reports shared abnormalities (mainly hypoactivation) in task-related brain activation in regions primarily associated with inhibitory control and cognitive processing [16]. In fact, depression and anxiety are common prodromal symptoms in cognitive disorders associated with genetic tendencies such as Alzheimer’s disease [11]. Aggregate data pinpoint genetic and causal associations between major depression and anxiety disorders, suggesting that certain types of anxiety (e.g., post-traumatic stress) may represent subtypes of depressive disorders [36]. In fact, childhood anxiety seems to be influenced by a single genetic factor that does not contribute to genetic variance in depression symptoms. However, in adolescents and young adults, genetic influences are significantly shared between depression and all anxiety symptoms, along with a small significant genetic fear factor [34].
The Depression Anxiety Stress Scale (DASS) 42 and its short version (DASS-21) have been designed to match the tripartite model by differentiating the distinct features of depression, anxiety, and stress from each other [15]. However, subsequent tests show excessive variations in the structure of the DASS-21. While the three-factor structure of the DASS-21 is generally supported, a quadripartite structure involving three specific factors (depression, anxiety, and stress) and a general factor of emotional negativity or overall distress has been reported in several studies [37,38,39]. A tripartite model comprising anhedonia, physiological hyperarousal, and general negative affect had a better fit than other structures in the general public and a psychiatric sample in Turkey [40]. A two-factor structure involving depression and anxiety/stress factors expressed the best fit among Brazilian adolescents [41]. Many studies showed good fit of a one-factor structure of the DASS-21 [15,42,43,44,45,46].
Numerous studies investigated invariance of the DASS-21. Around half the items of the scale expressed differential item functioning (DIF) across gender and age groups among Egyptian drug users while only item 6 expressed DIF across gender groups among Iranian medical students [47]. In a sample of athletes, the bifactor structure of the DASS-21 was invariant across groups of gender, athletic expertise, sport type, and injury status [37]. On the contrary, in a multinational study, the bifactor structure of the DASS-21 was variant across different countries. Instead, the authors suggested the use of the scale as a unidimensional measure instead of being a measure of depression, anxiety, and stress [42]. Although the DASS-21 held invariance across respondents from the USA and the UK, it showed threshold invariance indicated by higher depression scores among Russian and Polish respondents. Compared with English-speaking respondents, Russian respondents exhibited the highest levels of anxiety symptoms while Polish respondents exhibited the highest stress levels [48]. Scalar variance between Pakistani and German university students was noted, with Pakistani students experiencing more symptoms of depression and anxiety [49].
Because the DASS-21 is not a clinical diagnostic measure, it is frequently used in research and practice in clinical and non-clinical samples in order to identify individuals with high distress who may be prone to develop psychopathologies. Its simplicity, brevity, and ability to capture symptoms of stress along with those of depression and anxiety make it more favorable than other specific measures of depression or anxiety [50,51]. The scale demonstrates good internal consistency and exhibits sensitivity to change following treatment (e.g., of depression). However, in addition to problems of non-invariance and structural variations, it persistently demonstrated a ceiling effect in three samples of depressed patients [52]. A ceiling effect is a key measurement error entailing scale attenuation effect that results from clustering of respondent scores around the highest possible score limit, which precludes variance estimation resulting in measurement inaccuracy [53]. Extending the response scale to include an additional option did not abolish the ceiling effect, suggesting a need for extensive revision of the scale [52].
Few studies revised the DASS-21 structure. Employing item response theory and confirmatory factor analysis (CFA), Osman and colleagues suggested that 13 or nine items may best reflect the three distinct structures of the DASS-21 in non-clinical samples [51]. Seventeen items were reported to better capture the distress component covered by the DASS-21 among Egyptian drug users [15]. A subsequent investigation reported usability of a 12-item DASS based on Osman’s model in Korean psychiatric patients and the general public [32]. However, none of these structures has been tested in other studies signifying the DASS-21 as the official short form of the DASS-42.
We have previously evaluated the structure of the DASS-21 among drug users, and the scale turned out to best describe overall distress instead of differentiating the constructs of depression, anxiety, and stress [15,44]. However, drug users represent a population that express problems with emotional regulation, which may affect the manner through which they can express different aspects of emotional negativity [54,55]. In the meantime, the DASS-21 has been widely used as a measure of mental health symptomology both in healthy and vulnerable groups during the COVID-19 crisis [56]. Therefore, it may be necessary to evaluate the structure of the Arabic DASS-21 in other clinical samples as well as in the general public who express varying levels of emotional negativity [32,57]. In addition, standard Arabic is not easy to understand in Egypt, especially among people with low levels of education. This is because the Arabic language in Egypt has been drastically altered over the long periods of occupation that Egypt has witnessed in its recent history (e.g., by Turkey, France, UK, and Israel). Therefore, the validated Arabic version of the DASS-21, which is available in the local Egyptian accent may not be easy to understand in other Arab countries where the local accent is closer to standard Arabic—the most collective and comprehendible form [58,59]. The present research aims to fill this gap by examining the internal consistency, factor structure, invariance, and discriminant validity of a standard Arabic version of the DASS-21 among psychiatric patients and the general public. It also tests the psychometric properties of different shortened versions of the DASS-21.

2. Materials and Methods

2.1. Study Design, Participants, and Procedure

This cross-sectional study is a secondary analysis of data based on two convenient samples. The first sample [60], herein referred to as the quarantine sample, comprised 214 Saudi citizens or residents of Saudi Arabia who were quarantined for 14 days in seven quarantine facilities in the cities of Riyadh and Qassim. People undergoing quarantine were travelers returning to Saudi Arabia during the lockdown period as well as suspected or confirmed COVID-19 cases with mild disease. Participants were included in the study if they were 18 years or older, could speak Arabic, and agreed to participate in the study. Data were collected via an online survey during the period between 29 April and 19 May 2020, since direct contact was strongly prohibited by the Saudi authorities.
The second sample was obtained via an anonymous online survey distributed via Twitter and WhatsApp groups in Saudi Arabia during April 2020—the beginning of the formal confinement period in the country. Respondents testifying that their age was above 18 years who signed a digitized informed consent form were directed to the online questionnaire. Among 1160 respondents, 168 reported having a preexisting mental disorder which was diagnosed by a psychiatrist. Accordingly, respondents were classified based on the criteria of having or not having a psychiatric diagnosis into two samples: a psychiatric patient sample (sample 1) and a community sample (sample 2).

2.2. Study Instruments

Our respondents were presented a structured online questionnaire that comprised several sections (described in detail elsewhere). In brief, the first section involved assessment of sociodemographic, clinical, and COVID-19-related data, e.g., age, education, health status, having a physical disease or a psychiatric disorder, and views on COVID-19. The second section comprised the standard Arabic version of the Depression Anxiety Stress Scale-21 (DASS-21), which was obtained from the official website of the DASS [http://www2.psy.unsw.edu.au/DASS/Arabic/Arabic%20DASS-21.pdf (access on 25 January 2020)], with less information available on its psychometric properties. The DASS-21 contains 21 items in three subscales, which assess symptoms of depression (items 3, 5, 10, 13, 16, 17, 21), anxiety (items 2, 4, 7, 9, 15, 19, 20), and stress (items 1, 6, 8, 11, 12, 14, 18) [15]. The degree to which respondents endorsed the symptoms over the course of the last week is rated on a scale that ranges from 0 (did not apply to me at all) to 3 (applied to me very much or most of the time). Higher scores reflect higher levels of symptom endorsement [44]. Reliability of the DASS-21, as evaluated in the quarantine sample, sample 1, and sample 2, is excellent (α = 0.95, 0.96, and 0.94, respectively).

2.3. Ethical Considerations

The Institutional Review Board of Al Qassim University approved the study protocol (No. 19-08-01). Potential respondents were introduced to a digital consent form emphasizing that participation was voluntary, and that data were anonymously collected, confidential, and would only be used for scientific purposes.

2.4. Statistical Analysis

In the quarantine sample, exploratory factor analysis (EFA) involving maximum-likelihood extraction and varimax rotation with the Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy and Bartlett’s test of sphericity was used to let items of the DASS-21 freely load on the corresponding factors without enforcing any constraints. In a next step involving sample 1 and sample 2, CFA, with maximum likelihood and bootstrapping involving 2000 random samples, was used to check data-fit to various models. In this study, we tested 13 competing models: Model 1, a one-factor structure; Model 2, a two-factor structure comprising depression and anxiety/stress factors; Model 3, Lovibond’s original three-factor structure; Model 4, a bifactor structure (a general factor and three specific factors); Model 5, the previously reported 17-item one-factor structure; Model 6 and Model 7, a one-factor and a three-factor structure based on the Korean 12-item DASS [32]; Model 8 and Model 9 as well as Model 10 and Model 11, a one-factor and a three-factor structure based on a 13-item and a 9-item DASS suggested by Osman and colleagues [51]; Model 12 and Model 13, a three-factor structure of a modified 9-item DASS and an 8-item DASS based on eliminating items with lower loadings and item-total correlations.
Global model fit was flagged by a non-significant chi square (χ2) index [61]. However, χ2 is sample size-dependent [62]. Therefore, good and acceptable fit were decided based on absolute fit indices: Comparative Fit Index (CFI) and Tucker–Lewis Index (TLI) equal to or above 0.95 and 0.90, respectively, along with root mean square error of approximation (RMSEA) and standardized root-mean-square residual (SRMR) less than 0.06 and 0.08, respectively [15,63]. For all models, modification indices were consulted, and improvements in model fit following correlating suggested error residuals were recorded.
To examine measurement invariance of the shortened versions of the DASS-21 across groups of gender and age (30 years old and below; above 30 years), multigroup CFA was used. The analysis comprised four models. The first model was unconstrained, and it tested the overall fit (same number of factors) of the shortened versions across groups, known as configural invariance. The second model constrained factor loadings to equality between groups and evaluated metric invariance as a function of the difference between the unconstrained and constrained model. The third model assessed scalar invariance (scale mean differences) by constraining the intercepts of the items to be equal between groups. The fourth model tested strict invariance by constraining the residuals to be equal between groups [3,63]. Although χ2 may reflect changes in model fit across groups, it is sample-size dependent to a great extent—unlike absolute model fit indicators such as CFI and RMSEA. Therefore, we depicted invariance across subgroups by significant changes in CFI and RMSEA—for invariance, ΔCFI and ΔRMSEA should not exceed 0.02 and 0.015, respectively [62].
Normality of the DASS-21 and its shortened versions was tested by Shapiro–Wilks’ W test. Internal consistency of the DASS-21, its subscales, as well as the shortened versions and their subscales was assessed by coefficient alpha, alpha-if-item deleted, and item-total correlations. Correlations between the shortened versions and their subscales with the DASS-21 and its subscales was used to signify item coverage and predictive validity of the best fitting shortened version of the DASS-21. Because of the non-normal distribution of the DASS-21 and all its shortened versions, the Mann Whitney U test was used to examine discriminant validity of the best fitting shortened version of the DASS-21 by comparing the mean of the scale, as well as of the depression, anxiety, and stress subscales in the samples. To identify if the depression and anxiety subscales on the DASS-21 and its shortened versions can differentiate people with depression and anxiety from those with other disorders, the Mann Whitney U test was used to compare the mean of depression and anxiety among patients with and without depression and with and without anxiety, respectively. All analyses were conducted in SPSS and Amos, and significance was considered at a probability level less than 0.05, two-tailed.

3. Results

3.1. Participants’ Characteristics

For the quarantine sample, males were a majority (59.8%), 49.5% of the participants were married while 49.1% were single, most participants were in the age groups 18–30 years (56.1%) and 31–40 years (30.4%), most participants had a bachelor degree (41.1%) or a masters degree (23.8%), and being a student was the most common employment form (45.3%), while 39.3% had other forms of employment. The reported family income ranged from less than 5000 Saudi Rial (SAR, 16.4%) to more than 25,000 SAR (15.9%). However; the family income of 47.2% of the participants ranged between 5000 and 15,000 SAR. SAR equals 0.27 US dollar.
The clinical sample (sample 1) comprised patients with psychiatric disorders (N = 168). Key reported diagnoses were depression (40.5%), generalized anxiety disorder (41.7%), sleep disorders (23.8%), and obsessive compulsive disorders (OCD, 15.5%). Comorbidity was common, especially of sleep disorders and OCD among patients with anxiety and depression. In addition, 36.3% of the participants reported other disorders such as eating disorders, post-traumatic stress disorder, personality disorders, bipolar disorder, and psychotic disorders. The community sample (sample 2) comprised 992 respondents with no reported psychiatric diseases. For sample 1 and sample 2, in order, most participants were females (70.8% and 62.7%), were aged 31 years and above (48.2% and 54.8%) while 51.8% and 45.2% were in the age category 18-30 years. As for the educational level, 62.5% and 61.0% of the participants had a university degree while 19.0% and 15.2% had high school. Those employed, unemployed, retired, and students represented 29.2%, 26.8%, 6.0%, and 38.1% of the participants in sample 1 and 41.1%, 22.1%, 10.4%, and 27.4% of the participants in sample 2. The reported family income ranged from less than 5000 SAR (11.0% and 7.2%) to more than 25,000 SAR (16.7% and 17.1%). However; the family income of 44.6% and 44.0% of the participants ranged between 5000 and 15,000 SAR. See Supplementary Materials for further details of the sociodemographic characteristics of all the samples.

3.2. Results of Exploratory Factor Analysis

EFA revealed that the DASS-21 in the quarantine sample covers four factors with eigen values >1, which explained 48.3%, 7.0%, 5.8%, and 4.9% of the variance. The sample size and participant-to-item ratio were appropriate for EFA: KMO values = 0.924, Bartlett’s test was significant (χ2(210) = 2887.78, p < 0.001). As shown in Table 1, several items loaded on two factors with loadings greater than 4. Item communalities, scree plots, and reproduced correlations are presented in Supplementary Materials.

3.3. Results of Confirmatory Factor Analysis

Examination of different structures of the DASS-21 (unidimensional, two-factor, and three-factor) revealed poor fit in crude models. Acceptable fit was achieved by correlating a few item residuals in sample 1 and several item residuals in sample 2 (Table 2). The bifactor structure of the DASS-21 expressed acceptable fit, with all items loading significantly on the common factor, but none of the item loadings on the anxiety factor were significant. SRMR was not calculated in the bootstrapped model, signifying a problem with the fit of this model, and when the iteration limit was increased, the model failed to converge. As for the shorter versions of the DASS-21, the 17-item structure previously tested among Egyptian drug users [15] expressed poor fit in both samples. Acceptable fit of this structure was produced by correlating item 19 with item 4 and item 20 with item 15 in sample 1 and numerous items [(1 with 3 and 12), (17 with 8 and 10), and (4 with 19)] in sample 2. The crude one-factor structures of Osman’s DASS-13, the Korean DASS-12, and Osman’s DASS-9 expressed acceptable fit mostly in sample 1, and correlating few items improved the fit in sample 2. The three-factor structure of the DASS-13, DASS-12, and Osman’s DASS-9 had excellent fit in both samples—correlating few items in sample 2 was necessary to improve the fit in most models (Figure 1). Noticeably, our crude DASS-9/DASS-8 models expressed superior fit in sample 1 while correlating few error terms considerably improved model fit in sample 2. Nonetheless, the fit of the DASS-8 with correlated residuals expressed a perfect fit in both samples (Table 2). As shown in Figure 1, the item loadings on the corresponding factors in the DASS-8 were greater than in all other shortened versions, implying that the DASS-8 describes the best fit of the data in both samples.

3.4. Results of Invariance Analysis

Multigroup analysis revealed invariance of all shortened versions of the DASS across gender groups (Supplementary Table S1). The same goes for age groups; however, the DASS-9 based on Osman’s analysis expressed significant variance at the scalar level across age groups in sample 2 (χ2(56) = 208.3, p < 0.001, Δχ2 = 91.1, p(Δχ2) = 0.001, ΔCFI = 0.032, ΔTLI = 0.38, ΔRMSEA = −0.015). All shortened versions of the DASS-21 expressed variance at the strict level across age groups (Supplementary Table S2).

3.5. Normality of the DASS-21 and Its Shortened Versions

Values of the Shapiro–Wilks’ W suggest that the normality of our DASS-9, the DASS-8, and their subscales is comparable with that of the DASS-21 and its subscales in both samples, Table 3. It was also comparable with other shortened versions of the DASS-21 (Supplementary Materials).

3.6. Internal Consistency, Item Coverage, and Predictive Validity of Shortened Versions of the DASS-21

The DASS-21 and all other shortened versions expressed good internal consistency in the samples. The reliability of our DASS-9/DASS-8 was higher than the previously tested Korean 12-item DASS and Osman’s 13- and 9-item DASS. As shown in Table 4, the DASS-9/DASS-8 expressed the highest item-total correlations in both samples compared with all other versions. In sample 1, the correlations between the DASS-9/DASS-8 and the DASS-21 were high comparable with the DASS-12 (α = 0.97). In sample 2, the correlations between the DASS-9/DASS-8 and the DASS-21 were a bit lower than that of the DASS-12; however, they were still high (α = 0.95 and 0.93).
As shown in Table 5, internal consistency of subscales of the DASS-8 were comparable with all other shortened versions. The anxiety subscale on the modified DASS-9/DASS-8 had even higher reliability than the anxiety original subscale. Its correlation with the DASS-21 and the original anxiety subscale was higher than the correlations expressed by all the anxiety subscales of other shortened versions. Meanwhile, the correlation of the depression subscale with the DASS-21 and its depression subscale was comparable with those of the Korean DASS-12. Although it comprises half the number of items on the stress subscale of the Korean DASS-12, the stress subscale on the DASS-9/DASS-8 expressed strong significant correlations with the DASS-21 and its stress subscale. Altogether, the high cross-scale correlations between the DASS-9/DASS-8 and their subscales with the DASS-21 and its subscales suggest an acceptable coverage and an almost similar predictive validity of the DASS-9/DASS-8 to the DASS-21.

3.7. Discriminant Validity of the DASS-21 and Its Shortened Versions

The Mann Whitney U test revealed that the DASS-21 and all shortened versions as well as their subscales (Table 4 and Table 6) could differentiate the clinical sample from the general public (all p values < 0.001). However, the depression and anxiety subscales on the DASS-21 and on all the shortened versions could not differentiate patients diagnosed with depression or anxiety from patients having other psychiatric diagnoses (all p values > 0.05, Supplementary Materials).

4. Discussion

This study examined the psychometric properties of a standard Arabic version of the DASS-21 as well as five shortened versions of the DASS-21 in a quarantined sample because of COVID-19, a clinical sample, and in the general public through various robust testing techniques. The unidimensional, tripartite, and quadripartite structures of the DASS-21 involving correlated errors expressed acceptable fit in both samples denoting usability of the overall score of the scale as well as its subscales. Among different shortened versions of the DASS-21, the DASS-8 expressed the best fit and the highest item loadings on the corresponding factors, along with invariance across age and gender groups.
EPA revealed a four-factor structure of the DASS-21 in the quarantine sample. Two factors and three factors with eigen values >1 were also produced in sample 1 and sample 2, respectively (Supplementary Materials). In the all the samples, a large number of items had significant cross-loadings on several items (Table 1 and Supplementary Materials). This finding indicates that the supposed causal contribution of indicators (i.e., factor loadings) to the underlying factors are not correctly specified, which is consistent with former studies calling for revising the item structure of the DASS-21 [51,52]. Developing a valid shortened form of a scale should be guided by both statistical and content approaches [63]. For reducing the DASS-21 in this study, we employed two samples to build three models based on previous studies that revised the item structure of the DASS-21 [32,51]. In addition, we have stepwise removed items with relatively low loadings and low item-total correlations within the DASS-21 and its subscales. However, to decide on items to be retained among many items with adequate loadings/item-total correlations, we examined the descriptive statistics of all items of the DASS-21, highlighting those with the lowest means and highest SDs in both samples. We then referred to reports in the literature on the frequency of reported items.
Regarding the depression subscale, examinations of corrected item total correlations of Osman’s DASS-9 in both samples revealed lower values for items reflecting on worthlessness and hopelessness “item 17, I felt I wasn’t worth much as a person” and “item 21, I felt that life was meaningless” than those for items reflecting on depressed mood and lack of motivation/psychological fatigue “item 13, I felt down-hearted and blue” and “item 16, I was unable to become enthusiastic about anything”, respectively. It may be intuitive that the general public are less likely to experience worthlessness and hopelessness symptoms, which may be more evident in individuals with manifest and severe depression. Feeling worthless and hopeless are key symptoms that can mostly differentiate depressed from nondepressed patients [64]. These symptoms also strongly correlate with suicide ideation [65]. However, investigations reporting on the frequency of depressive symptoms in different conditions (e.g., traumatic brain injury, the general public, nursing students) report higher prevalence of symptoms of fatigue, anhedonia, insomnia, and severe feelings of sadness or depressed mood [64,65,66]. In an investigation involving 117 patients with partially or fully remitted major depressive disorder, fatigue was highly associated with feeling “blue”. Both symptoms, along with lack of interest were associated with symptoms of inability to focus, alertness, and difficulty concentrating. Cognitive deficit was not associated with symptoms of self-blame, feeling worthless, feeling hopeless, suicidal thoughts, sleep difficulty, and lack of appetite [67]. Therefore, we have restructured the depression subscale on our DASS-9 by replacing item 17 and item 21 with item 13 and item 16. This change has increased the reliability of the depression subscale as well as overall reliability of the DASS-9 in both samples. Noting that the loading of item 3 was comparatively lower than other items, we have removed it, with no subsequent reduction in the reliability of our resulting DASS-8. The discriminant validity of this three-item depression subscale was not altered, as noted below.
As for the anxiety subscale on Osman’s DASS-9, item 2 and item 4 had the lowest item-total correlations (0.500 and 0.522 among patients; 310 and 333 among the general public). On the anxiety subscale of the DASS-21, those two items had lower item total correlations than other items. The frequency of their occurrence along with physical symptoms of anxiety (e.g., trembling hands and dry mouth) was low. Dry mouth is reported in only 20% of patients with GAD. GAD patients demonstrate high peripheral catecholamine levels when in a resting state as well as a blunted sympathetic response to acute stress secondary to psychopathological responsiveness of the sympathetic adrenal medulla system [68]. The same physiological alteration has been reported in first-episode, drug-naïve patients with panic disorder [69]. Circulating catecholamines are not associated with the acute increase in heart rate during panic attacks [70]. These reports might justify why participants in both samples reported item 19 “less aware of the action of my heart” at a frequency lower than that of item 9 “worried about situations in which I might panic”, 15 “felt I was close to panic” and 20 “felt I was scared without a good reason”, which are all relevant to the hypervigilant experience of panicking. Accordingly, we have replaced item 2, 4, and 19 with item 9, 15, and 20. As shown in Figure 1, these items had considerably higher loadings on the anxiety factor in models representing our DASS-9/DASS-8. In addition, the reliability of this three-item anxiety subscale in both samples was higher than all other anxiety subscales, including that of the original DASS-21—its reliability in the general public sample was similar to that of the anxiety subscale of the DASS-21. Its correlation with the DASS-21 and the original anxiety subscale was the highest relative to all the shortened anxiety subscales (Table 5), granting it the highest predictive validity.
Because the loading of item 1 on the stress subscale of Osman’s DASS-9 was lower than that of item 8 “I was using a lot of my nervous energy” on Osman’s DASS-13, we retained item 8 on the DASS-9/DASS-8 instead of item 1, ending with a subscale that comprises items 8 and 12 only. The response to life stresses frequently involves an intrusive state represented by symptoms of unbidden ideas and feeling [71,72]. Encountering these symptoms can deplete the psychic energy resulting in a state of mental exhaustion [72]. Difficulty relaxing “item 12” is commonly reported in people undergoing stress e.g., musicians with hearing difficulties [73]. The reliability of the two-item stress subscale of the DASS-9/DASS-8 was comparable with that of the four-item stress subscale of the Korean DASS-12 (0.835 versus 0.852). Its correlation with the DASS-21 and its stress subscale was also comparably strong (Table 4), denoting adequate predictive validity of this shortened subscale.
Although the DASS-8 comprises only two thirds the number of items on the previously tested Korean DASS-12, it expressed higher internal consistency, higher item total correlations, and similarly strong correlations with the original DASS-21 in both samples (Table 3, Table 4 and Table 5). Its correlation with the DASS-21 in sample 2 was strong but a bit lower than the Korean version. Reducing items on a symptom scale that comprises multiple replicate items may decrease its reliability, sensitivity or specificity if it involves items with optimal or close to optimal sensitivity and specificity. On the other hand, dropping heterogeneous items would increase the reliability of the scale [74]. Thus, the results suggest that items on the DASS-8 and its subscales, as discussed above, possess optimal sensitivity and specificity, implying adequate item coverage and relatively good predictive validity of the DASS-8 than other shortened versions of the DASS-21.
The Mann Whitney W test revealed that the DASS-8 could differentiate psychiatric patients from the general public at the same level of significance of all the shortened versions of the DASS-21 (Table 3). On the other hand, the depression subscale on the DASS-21 and all the shortened versions of the DASS-21 could not differentiate patients with depression from those with other psychiatric disorders. The same goes for the anxiety subscale. In previous studies, the DASS-21 [12,40,75] and the DASS-12 [32] could only distinguish healthy participants from those with psychopathologies that include both symptoms of depression and anxiety. However, the DASS-21 could not differentiate people with depressive disorder from those with anxiety disorder [12,40]. Because the DASS-21 is not a clinical diagnostic tool [50], it may be beneficial for screening large groups for the possibility of encompassing psychopathologies, which may be confirmed by further investigations. In this respect, the DASS-8 may be an ideal short form of the DASS-21 for initial identification of distressed individuals. Its configural, metric, and scalar invariance across age and gender groups in the clinical sample and in the general public support its usability as a valid measure of symptoms of distress in various groups. Further investigations of the DASS-8 in different populations are needed.
This study enjoys the merit of being the first to extensively reduce the DASS-21 to a valid and reliable 8-item version that expresses an adequate ability to measure symptoms of distress objectively across ages and sexes as well as to differentiate individuals with psychopathology from healthy individuals. It also tested a standard Arabic version of the DASS-21, which can be generally used in all Arab countries. Several limitations to the generalizability of our results should be also acknowledged. Collecting data through a self-administered questionnaire and an online survey method entails risks for social desirability bias and selection bias. The cross-sectional design precluded test-retest reliability analysis. The clinical sample was established based on participants’ subjective reports of receiving a psychiatric disorder diagnosis by a psychiatrist instead of being screened for psychopathology according to a known disease classification system (e.g., DSM-IV-R). In the meantime, lack of screening of respondents in the community sample for mental disorders entails that some of those respondents may not be free of mental illness. This may cast doubt on the soundness of the comparisons of the psychometrics of measures, particularly discriminant validity, of the DASS-21 and its shortened versions between the two samples. In addition, the numerical imbalance between the two samples is another considerable limitation. Moreover, the samples came from a single Arab country, while the DASS-21 is reported to express invariance at the configural [42] and scalar [48,49] levels across countries. Therefore, examining the psychometric properties of the DASS-8 in other countries/languages is necessary for effective usability of the scale in clinical practice and research.

5. Conclusions

The scores of the DASS-21 and its subscales may be used to reflect on symptoms of distress. However, compared with four other shortened versions of the DASS-21, an 8-item version (DASS-8) demonstrated perfect fit, measurement invariance across age and gender groups, adequate item coverage, good predictive validity, and excellent internal consistency. The DASS-8 differentiated patients with psychiatric disorders from the general public at the same level of significance exhibited by the DASS-21 and shortened versions that comprised more items. Thus, the DASS-8 is a brief tool that can be used in clinical practice and research to facilitate the detection of psychopathologies and monitor response to treatments at the symptom level. Further evaluations of the DASS-8 in diverse populations are necessary for optimal usage of the scale.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph181910142/s1, Supplementary Table S1: Invariance of factor structures of the shortened versions of the Depression Anxiety Stress Scale 21 across gender groups; Supplementary Table S2: Invariance of factor structures of the shortened versions of the Depression Anxiety Stress Scale 21 across age groups; Supplementary Excel S1: Descriptive statistics and Mann Witney Test Patient group.

Author Contributions

Conceptualization, A.M.A. and H.K.; Data curation, A.M.A.; Formal analysis, A.M.A. and H.H.; Funding acquisition, H.H. and Y.K.; Investigation, A.A.A.; Methodology, A.M.A. and A.A.A.; Project administration, H.H., Y.K. and H.K.; Software, A.A.A. and H.H.; Supervision, Y.K. and H.K.; Validation, Y.K.; Writing—original draft, A.M.A. and H.H.; Writing—review & editing, Y.K. and H.K. All authors have read and agreed to the published version of the manuscript.

Funding

This study was partially supported by the National Center Cohort Collaborative for Advancing Population Health funded by the Japan Health Research Promotion Bureau (JH) Research Fund (Project Number 2019-(1)-1).

Institutional Review Board Statement

The study protocol has been approved by the Institutional Review Board of Al Qassim University (No. 19-08-01).

Informed Consent Statement

All participants signed a digital informed consent before participation.

Data Availability Statement

The dataset used to produce the current article [76] is publicly available at: https://data.mendeley.com/datasets/8k3vmfxpd3/draft?a=67415321-61f7-4920-bd2a-749b365ff6fb (access on 22 September 2021).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kan, F.P.; Raoofi, S.; Rafiei, S.; Khani, S.; Hosseinifard, H.; Tajik, F.; Raoofi, N.; Ahmadi, S.; Aghalou, S.; Torabi, F.; et al. A systematic review of the prevalence of anxiety among the general population during the COVID-19 pandemic. J. Affect. Disord. 2021, 293, 391–398. [Google Scholar] [CrossRef]
  2. Lee, S.A. Coronavirus Anxiety Scale: A brief mental health screener for COVID-19 related anxiety. Death Stud. 2020, 44, 393–401. [Google Scholar] [CrossRef]
  3. Ali, A.M.; Hendawy, A.O.; Kunugi, H. The Internet Addiction Test: Its factor structure, measurement invariance, and psychometric properties of a six-item version among Spanish women with eating disorders. Res. Sq. 2021, 1. [Google Scholar] [CrossRef]
  4. Ali, A.M.; Kunugi, H. Corona Virus Disease 2019 (COVID-19): A pandemic that threatens physical and mental health by promoting physical inactivity. Sports Med. Health Sci. 2020, 2, 221–223. [Google Scholar] [CrossRef]
  5. Ali, A.M.; Kunugi, H. Apitherapy for age-related skeletal muscle dysfunction (sarcopenia): A review on the effects of royal jelly, propolis, and bee pollen. Foods 2020, 9, 1362. [Google Scholar] [CrossRef]
  6. Ali, A.M.; Kunugi, H. Approaches to nutritional screening in patients with Coronavirus Disease 2019 (COVID-19). Int. J. Environ. Res. Public Health 2021, 18, 2772. [Google Scholar] [CrossRef]
  7. Ali, A.M.; Ali, E.M.; Mousa, A.A.; Ahmed, M.E.; Hendawy, A.O. Bee honey and exercise for improving physical performance, reducing fatigue, and promoting an active lifestyle during COVID-19. Sports Med. Health Sci. 2021, 3, 177–180. [Google Scholar] [CrossRef] [PubMed]
  8. Ali, A.M.; Kunugi, H. The effects of royal jelly acid, 10-hydroxy-trans-2-decenoic acid, on neuroinflammation and oxidative stress in astrocytes stimulated with lipopolysaccharide and hydrogen peroxide. Immuno 2021, 1, 13. [Google Scholar] [CrossRef]
  9. Ali, A.M.; Kunugi, H.; Abdelmageed, H.A.; Mandour, A.S.; Ahmed, M.E.; Ahmad, S.; Hendawy, A.O. Vitamin K in COVID-19—potential anti-covid-19 properties of fermented milk fortified with bee honey as a natural source of vitamin K and probiotics. Fermentation 2021, 7, 202. [Google Scholar]
  10. Ali, A.M.; Kunugi, H. Apitherapy for Parkinson’s disease: A focus on the effects of propolis and royal jelly. Oxid Med. Cell Longev. 2020, 2020, 1727142. [Google Scholar] [CrossRef]
  11. Ali, A.M.; Kunugi, H. Royal jelly as an intelligent anti-aging—a focus on cognitive aging and Alzheimer’s disease: A review. Antioxidants 2020, 9, 937. [Google Scholar] [CrossRef] [PubMed]
  12. Tran, T.D.; Tran, T.; Fisher, J. Validation of the depression anxiety stress scales (DASS) 21 as a screening instrument for depression and anxiety in a rural community-based cohort of northern Vietnamese women. BMC Psychiatry 2013, 13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Ali, A.M.; Kunugi, H. Intermittent fasting, dietary modifications, and exercise for the control of gestational diabetes and maternal mood dysregulation: A review and a case report. Int. J. Environ. Res. Public Health 2020, 17, 9379. [Google Scholar] [CrossRef] [PubMed]
  14. Ter Meulen, W.G.; Draisma, S.; van Hemert, A.M.; Schoevers, R.A.; Kupka, R.W.; Beekman, A.T.F.; Penninx, B.W.J.H. Depressive and anxiety disorders in concert–A synthesis of findings on comorbidity in the NESDA study. J. Affect. Disord. 2021, 284, 85–97. [Google Scholar] [CrossRef]
  15. Ali, A.M.; Green, J. Factor structure of the depression anxiety stress Scale-21 (DASS-21): Unidimensionality of the Arabic version among Egyptian drug users. Subst. Abus. Treat. Prev. Policy 2019, 14, 40. [Google Scholar] [CrossRef]
  16. Janiri, D.; Moser, D.A.; Doucet, G.E.; Luber, M.J.; Rasgon, A.; Lee, W.H.; Murrough, J.W.; Sani, G.; Eickhoff, S.B.; Frangou, S. Shared Neural Phenotypes for Mood and Anxiety Disorders: A Meta-analysis of 226 Task-Related Functional Imaging Studies. JAMA Psychiatry 2020, 77, 172–179. [Google Scholar] [CrossRef] [Green Version]
  17. Dale, L.P.; Vanderloo, L.; Moore, S.; Faulkner, G. Physical activity and depression, anxiety, and self-esteem in children and youth: An umbrella systematic review. Mental. Health Physical. Act. 2019, 16, 66–79. [Google Scholar] [CrossRef]
  18. Racine, N.; McArthur, B.A.; Cooke, J.E.; Eirich, R.; Zhu, J.; Madigan, S. Global Prevalence of Depressive and Anxiety Symptoms in Children and Adolescents During COVID-19: A Meta-analysis. JAMA Pediatr. 2021. [Google Scholar] [CrossRef]
  19. Ma, L.; Mazidi, M.; Li, K.; Li, Y.; Chen, S.; Kirwan, R.; Zhou, H.; Yan, N.; Rahman, A.; Wang, W.; et al. Prevalence of mental health problems among children and adolescents during the COVID-19 pandemic: A systematic review and meta-analysis. J. Affect. Disord. 2021, 293, 78–89. [Google Scholar] [CrossRef]
  20. Narmandakh, A.; Roest, A.M.; de Jonge, P.; Oldehinkel, A.J. Psychosocial and biological risk factors of anxiety disorders in adolescents: A TRAILS report. Eur. Child. Adolesc. Psychiatry 2020. [Google Scholar] [CrossRef] [PubMed]
  21. Womersley, J.S.; Martin, L.; van der Merwe, L.; Seedat, S.; Hemmings, S.M.J. Genetic variation in neuropeptide Y interacts with childhood trauma to influence anxiety sensitivity. Anxiety Stress Coping 2021, 34, 450–464. [Google Scholar] [CrossRef]
  22. Wickersham, A.; Leightley, D.; Archer, M.; Fear, N.T. The association between paternal psychopathology and adolescent depression and anxiety: A systematic review. J. Adolesc. 2020, 79, 232–246. [Google Scholar] [CrossRef]
  23. Saraceno, L.; Munafó, M.; Heron, J.; Craddock, N.; van den Bree, M.B. Genetic and non-genetic influences on the development of co-occurring alcohol problem use and internalizing symptomatology in adolescence: A review. Addiction 2009, 104, 1100–1121. [Google Scholar] [CrossRef]
  24. Glynn, L.M.; Howland, M.A.; Fox, M. Maternal programming: Application of a developmental psychopathology perspective. Dev. Psychopathol. 2018, 30, 905–919. [Google Scholar] [CrossRef]
  25. Ali, A.M.; Hori, H.; Kim, Y.; Kunugi, H. Predictors of nutritional status, depression, internet addiction, Facebook addiction, and tobacco smoking among women with eating disorders in Spain. Front. Psychiatry 2021. under review. [Google Scholar]
  26. Weissman, M.M.; Warner, V.; Wickramaratne, P.J.; Kandel, D.B. Maternal smoking during pregnancy and psychopathology in offspring followed to adulthood. J. Am. Acad. Child. Adolesc. Psychiatry 1999, 38, 892–899. [Google Scholar] [CrossRef]
  27. Huizink, A.C.; de Rooij, S.R. Prenatal stress and models explaining risk for psychopathology revisited: Generic vulnerability and divergent pathways. Dev. Psychopathol. 2018, 30, 1041–1062. [Google Scholar] [CrossRef] [PubMed]
  28. Goodman, S.H.; Gotlib, I.H. Risk for psychopathology in the children of depressed mothers: A developmental model for understanding mechanisms of transmission. Psychol. Rev. 1999, 106, 458–490. [Google Scholar] [CrossRef] [PubMed]
  29. Nelson, C.A.; Scott, R.D.; Bhutta, Z.A.; Harris, N.B.; Danese, A.; Samara, M. Adversity in childhood is linked to mental and physical health throughout life. BMJ 2020, 371, m3048. [Google Scholar] [CrossRef] [PubMed]
  30. Rasing, S.P.A.; Braam, M.W.G.; Brunwasser, S.M.; Janssens, J.; Creemers, D.H.M.; Scholte, R.H.J. Depression and Anxiety Symptoms in Female Adolescents: Relations with Parental Psychopathology and Parenting Behavior. J. Res. Adolesc. 2020, 30, 298–313. [Google Scholar] [CrossRef]
  31. Hastings, P.D.; Ugarte, E.; Mashash, M.; Marceau, K.; Natsuaki, M.N.; Shirtcliff, E.A.; Zahn-Waxler, C.; Klimes-Dougan, B. The codevelopment of adolescents’ and parents’ anxiety and depression: Moderating influences of youth gender and psychophysiology. Depress. Anxiety 2021. [Google Scholar] [CrossRef]
  32. Lee, E.H.; Moon, S.H.; Cho, M.S.; Park, E.S.; Kim, S.Y.; Han, J.S.; Cheio, J.H. The 21-Item and 12-Item Versions of the Depression Anxiety Stress Scales: Psychometric Evaluation in a Korean Population. Asian. Nurs. Res. 2019, 13, 30–37. [Google Scholar] [CrossRef] [Green Version]
  33. Gurley, D.; Cohen, P.; Pine, D.S.; Brook, J. Discriminating depression and anxiety in youth: A role for diagnostic criteria. J. Affect. Disord. 1996, 39, 191–200. [Google Scholar] [CrossRef]
  34. Waszczuk, M.A.; Zavos, H.M.; Gregory, A.M.; Eley, T.C. The phenotypic and genetic structure of depression and anxiety disorder symptoms in childhood, adolescence, and young adulthood. JAMA Psychiatry 2014, 71, 905–916. [Google Scholar] [CrossRef]
  35. Watson, D.; Clark, L.A.; Weber, K.; Assenheimer, J.S.; Strauss, M.E.; McCormick, R.A. Testing a Tripartite Model: II. Exploring the Symptom Structure of Anxiety and Depression in Student, Adult, and Patient Sample. J. Abnorm. Psychol. 1995, 104, 15–25. [Google Scholar] [CrossRef]
  36. Zhang, F.; Rao, S.; Cao, H.; Zhang, X.; Wang, Q.; Xu, Y.; Sun, J.; Wang, C.; Chen, J.; Xu, X.; et al. Genetic evidence suggests posttraumatic stress disorder as a subtype of major depressive disorder. J. Clin. Investig. 2021. [Google Scholar] [CrossRef]
  37. Vaughan, R.S.; Edwards, E.J.; MacIntyre, T.E. Mental Health Measurement in a Post Covid-19 World: Psychometric Properties and Invariance of the DASS-21 in Athletes and Non-athletes. Front. Psychol. 2020, 11, 590559. [Google Scholar] [CrossRef]
  38. Bottesi, G.; Ghisi, M.; Altoè, G.; Conforti, E.; Melli, G.; Sica, C. The Italian version of the Depression Anxiety Stress Scales-21: Factor structure and psychometric properties on community and clinical samples. Compr. Psychiatry 2015, 60, 170–181. [Google Scholar] [CrossRef] [PubMed]
  39. Henry, J.D.; Crawford, J.R. The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. Br. J. Clin. Psychol. 2005, 44, 227–239. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Yıldırım, A.; Boysan, M.; Kefeli, M.C. Psychometric properties of the Turkish version of the Depression Anxiety Stress Scale-21 (DASS-21). Br. J. Guid. Couns. 2018, 46, 1–14. [Google Scholar] [CrossRef]
  41. Silva, H.A.; Passos, M.H.; Oliveira, V.M.; Palmeira, A.C.; Pitangui, A.C.; Araújo, R.C. Short version of the Depression Anxiety Stress Scale-21: Is it valid for Brazilian adolescents? Einstein 2016, 14, 486–493. [Google Scholar] [CrossRef] [Green Version]
  42. Zanon, C.; Brenner, R.E.; Baptista, M.N.; Vogel, D.L.; Rubin, M.; Al-Darmaki, F.R.; Gonçalves, M.; Heath, P.J.; Liao, H.Y.; Mackenzie, C.S.; et al. Examining the Dimensionality, Reliability, and Invariance of the Depression, Anxiety, and Stress Scale-21 (DASS-21) Across Eight Countries. Assessment 2020, 28, 1531–1544. [Google Scholar] [CrossRef] [PubMed]
  43. Camacho, Á.; Cordero, E.D.; Perkins, T. Psychometric Properties of the DASS-21 Among Latina/o College Students by the US-Mexico Border. J. Immigr. Minor Health 2016, 18, 1017–1023. [Google Scholar] [CrossRef] [PubMed]
  44. Ali, A.M.; Ahmed, A.; Sharaf, A.; Kawakami, N.; Abdeldayem, S.M.; Green, J. The Arabic Version of The Depression Anxiety Stress Scale-21: Cumulative scaling and discriminant-validation testing. Asian J. Psychiatr. 2017, 30, 56–58. [Google Scholar] [CrossRef] [PubMed]
  45. Teo, Y.C.; Hj Yusuf, A.; Alice Lim, W.P.; Ghazali, N.B.; Abd Rahman, H.; Lin, N.; Koh, D. Validation of DASS-21 among nursing and midwifery students in Brunei. J. Public Health 2019, 27, 387–391. [Google Scholar] [CrossRef]
  46. Patrick, J.; Dyck, M.; Bramston, P. Depression anxiety stress scale (DASS): Is it valid for children and adolescents? J. Clin. Psychol. 2010, 66, 996–1007. [Google Scholar] [CrossRef] [Green Version]
  47. Jafari, P.; Nozari, F.; Ahrari, F.; Bagheri, Z. Measurement invariance of the Depression Anxiety Stress Scales-21 across medical student genders. Int. J. Med. Educ. 2017, 8, 116–122. [Google Scholar] [CrossRef] [Green Version]
  48. Scholten, S.; Velten, J.; Bieda, A.; Zhang, X.C.; Margraf, J. Testing measurement invariance of the Depression, Anxiety, and Stress Scales (DASS-21) across four countries. Psychol. Assess. 2017, 29, 1376–1390. [Google Scholar] [CrossRef]
  49. Bibi, A.; Lin, M.; Zhang, X.C.; Margraf, J. Psychometric properties and measurement invariance of Depression, Anxiety and Stress Scales (DASS-21) across cultures. Int. J. Psychol. 2020, 55, 916–925. [Google Scholar] [CrossRef]
  50. Caetano, A.C.; Oliveira, D.; Gomes, Z.; Mesquita, E.; Rolanda, C. Psychometry and Pescatori projective test in coloproctological patients. Ann. Gastroenterol. 2017, 30, 433–437. [Google Scholar] [CrossRef]
  51. Osman, A.; Wong, J.L.; Bagge, C.L.; Freedenthal, S.; Gutierrez, P.M.; Lozano, G. The Depression Anxiety Stress Scales-21 (DASS-21): Further examination of dimensions, scale reliability, and correlates. J. Clin. Psychol. 2012, 68, 1322–1338. [Google Scholar] [CrossRef]
  52. Page, A.C.; Hooke, G.R.; Morrison, D.L. Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. Br. J. Clin. Psychol. 2007, 46, 283–297. [Google Scholar] [CrossRef] [PubMed]
  53. Garin, O. Ceiling Effect. In Encyclopedia of Quality of Life and Well-Being Research; Michalos, A.C., Ed.; Springer: Dordrecht, The Netherlands, 2014; pp. 631–633. [Google Scholar]
  54. Obeid, S.; Akel, M.; Haddad, C.; Fares, K.; Sacre, H.; Salameh, P.; Hallit, S. Factors associated with alcohol use disorder: The role of depression, anxiety, stress, alexithymia and work fatigue- a population study in Lebanon. BMC Public Health 2020, 20, 245. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Ali, A.M. The relationship between emotional intelligence, distress disclosure and psychological distress among egyptian illicit substance users. J. Addict Recovery 2018, 1, 1–5. [Google Scholar]
  56. Cooke, J.E.; Eirich, R.; Racine, N.; Madigan, S. Prevalence of posttraumatic and general psychological stress during COVID-19: A rapid review and meta-analysis. Psychiatry Res. 2020, 292, 113347. [Google Scholar] [CrossRef] [PubMed]
  57. Briere, J.; Gil, E. Self-mutilation in clinical and general population samples: Prevalence, correlates, and functions. Am. J. Orthopsychiatry 1998, 68, 609–620. [Google Scholar] [CrossRef] [Green Version]
  58. Ibrahim, Z.M.A. Egyptian and Lebanese Written Modern Standard Arabic: Are They One and the Same? Doctorate Thesis, Georgetown University, Washington, DC, USA, 1997. [Google Scholar]
  59. Al-Kabi, M.; Al-Ayyoub, M.; Alsmadi, I.; Wahsheh, H. A Prototype for a Standard Arabic Sentiment Analysis Corpus. Int. Arab. J. Inf. Technol. 2016, 13, 163–170. [Google Scholar]
  60. Alkhamees, A.A.; Aljohani, M.S.; Alghesen, M.A.; Alhabib, A.T. Psychological Distress in Quarantine Designated Facility During COVID-19 Pandemic in Saudi Arabia. Risk Manag. Healthc Policy 2020, 13, 3103–3120. [Google Scholar] [CrossRef]
  61. Ali, A.M.; Ahmed, A.H.; Smail, L. Psychological Climacteric Symptoms and Attitudes toward Menopause among Emirati Women. Int. J. Environ. Res. Public Health 2020, 17, 5028. [Google Scholar] [CrossRef]
  62. Ali, A.M.; Hendawy, A.O.; Ahmad, O.; Sabbah, H.A.; Smail, L.; Kunugi, H. The Arabic version of the Cohen perceived stress scale: Factorial validity and measurement invariance. Brain Sci. 2021, 11, 419. [Google Scholar] [CrossRef]
  63. Goetz, C.; Coste, J.; Lemetayer, F.; Rat, A.C.; Montel, S.; Recchia, S.; Debouverie, M.; Pouchot, J.; Spitz, E.; Guillemin, F. Item reduction based on rigorous methodological guidelines is necessary to maintain validity when shortening composite measurement scales. J. Clin. Epidemiol. 2013, 66, 710–718. [Google Scholar] [CrossRef]
  64. Seel, R.T.; Kreutzer, J.S.; Rosenthal, M.; Hammond, F.M.; Corrigan, J.D.; Black, K. Depression after traumatic brain injury: A National Institute on Disability and Rehabilitation Research Model Systems multicenter investigation. Arch. Phys. Med. Rehabil. 2003, 84, 177–184. [Google Scholar] [CrossRef]
  65. Ren, L.; Wang, Y.; Wu, L.; Wei, Z.; Cui, L.-B.; Wei, X.; Hu, X.; Peng, J.; Jin, Y.; Li, F.; et al. Network structure of depression and anxiety symptoms in Chinese female nursing students. BMC Psychiatry 2021, 21, 279. [Google Scholar] [CrossRef]
  66. Ohayon, M.M. Specific characteristics of the pain/depression association in the general population. J. Clin. Psychiatry 2004, 65, 5–9. [Google Scholar] [PubMed]
  67. Pedrelli, P.; Baer, L.; Iosifescu, D.V.; Fava, M. Relationship Between Residual Symptoms of Depression and Self-reported Cognitive Impairment. CNS Spectr. 2014, 15, 46–51. [Google Scholar] [CrossRef]
  68. Liu, Y.; Yin, H.; Ma, H.; Yu, X.; Liu, G.; Guo, L.; Geng, Q. The salivary-α-amylase level after stroop test in anxious patients can predict the severity of anxiety. Neurosci. Lett. 2020, 715, 134613. [Google Scholar] [CrossRef] [PubMed]
  69. Altamura, M.; Iuso, S.; Balzotti, A.; Francavilla, G.; Dimitri, A.; Cibelli, G.; Bellomo, A.; Petito, A. Salivary alpha-amylase and cortisol responsiveness to stress in first episode, drug-naïve patients with panic disorder. Neurosci. Res. 2018, 137, 49–56. [Google Scholar] [CrossRef] [PubMed]
  70. Gorman, J.M.; Sloan, R.P. Heart rate variability in depressive and anxiety disorders. Am. Heart J. 2000, 140, S77–S83. [Google Scholar] [CrossRef] [PubMed]
  71. Horowitz, M.J. Stress-Response Syndromes. In International Handbook of Traumatic Stress Syndromes. The Plenum Series on Stress and Coping; Wilson, J.P., Raphael, B., Eds.; Springer: Boston, MA, USA, 1993. [Google Scholar]
  72. Peirce, A.G. From Intrusive to Oscillating Thoughts. Arch. Psychiatr. Nurs. 2007, 21, 278–286. [Google Scholar] [CrossRef]
  73. Kähäri, K.; Zachau, G.; Eklöf, M.; Möller, C. The influence of music and stress on musicians’ hearing. J. Sound Vib. 2004, 277, 627–631. [Google Scholar] [CrossRef]
  74. Shrout, P.E.; Yager, T.J. Reliability and validity of screening scales: Effect of reducing scale length. J. Clin. Epidemiol. 1989, 42, 69–78. [Google Scholar] [CrossRef]
  75. Sariçam, H. The Psychometric Properties of Turkish Version of Depression Anxiety Stress Scale-21 (DASS-21) in Health Control and Clinical Samples. JCBPR 2018, 7, 19–30. [Google Scholar] [CrossRef]
  76. Ali, A.M.; Alkhamees, A.A.; Hendawy, A. The psychological impact of COVID-19 among psychiatric patients. Mendeley Data 2021, V1. [Google Scholar] [CrossRef]
Figure 1. Three-factor structures of shortened versions of the Depression Anxiety stress scale 21 (DASS-21) in patients with psychiatric disorders and in the general public, in order: the DASS-12 (a,b), the DASS-13 (c,d), Osman’s DASS-9 (e,f), a modified DASS-9 (g,h), and DASS-8 (i,j).
Figure 1. Three-factor structures of shortened versions of the Depression Anxiety stress scale 21 (DASS-21) in patients with psychiatric disorders and in the general public, in order: the DASS-12 (a,b), the DASS-13 (c,d), Osman’s DASS-9 (e,f), a modified DASS-9 (g,h), and DASS-8 (i,j).
Ijerph 18 10142 g001aIjerph 18 10142 g001b
Table 1. Item loadings on corresponding factors as revealed by exploratory factor analysis of the Depression Anxiety Stress Scale 21 (DASS-21) in the quarantine sample.
Table 1. Item loadings on corresponding factors as revealed by exploratory factor analysis of the Depression Anxiety Stress Scale 21 (DASS-21) in the quarantine sample.
ItemsExtracted Factors
Factor 1Factor 2Factor 3Factor 4
1I found it hard to wind down0.2420.1780.2060.616
2I was aware of dryness of my mouth0.5730.1820.1490.136
3I couldn’t seem to experience any positive feeling at all0.2650.2780.3650.284
4I experienced breathing difficulty (e.g., excessively rapid breathing, breathlessness in the absence of physical exertion)0.4510.1620.2850.078
5I found it difficult to work up the initiative to do things0.2460.2060.4740.022
6I tended to over-react to situations0.2510.5870.1940.141
7I experienced trembling (e.g., in the hands)0.5840.3200.1210.225
8I felt that I was using a lot of nervous energy0.2570.6590.2700.439
9I was worried about situations in which I might panic and make a fool of myself0.3450.6950.1600.179
10I felt that I had nothing to look forward to0.1240.2440.6040.205
11I found myself getting agitated0.3480.5520.3900.427
12I found it difficult to relax0.2500.3640.2580.800
13I felt down-hearted and blue0.2930.5310.5310.194
14I was intolerant of anything that kept me from getting on with what I was doing0.1000.4960.4650.315
15I felt I was close to panic0.7450.3310.1810.292
16I was unable to become enthusiastic about anything0.3420.1660.7010.267
17I felt I wasn’t worth much as a person0.3640.1560.5550.257
18I felt that I was rather touchy0.2980.5620.3890.151
19I was aware of the action of my heart in the absence of physical exertion (e.g., sense of heart rate increase, heart missing a beat)0.6240.0920.3120.092
20I felt scared without any good reason0.6990.2960.2340.223
21I felt that life was meaningless0.5480.2570.4610.160
Values in boldface represent significant loadings.
Table 2. Goodness-of-fit indices for different models of the Depression Anxiety Stress Scale 21 (DASS-21) and its shortened versions evaluated by confirmatory factor analysis.
Table 2. Goodness-of-fit indices for different models of the Depression Anxiety Stress Scale 21 (DASS-21) and its shortened versions evaluated by confirmatory factor analysis.
ModelsSamplesχ2PDfCFITLIRMSEARMSEA 90% CISRMR
Model 1
1F DASS-21
Sample 1 (C)433.2590.0001890.9020.8910.0880.077 to 0.0990.0504
Sample 2 (C)1399.5430.0001890.8890.8770.0800.076 to 0.0840.0464
Sample 1 (E)351.5180.0001860.9340.9250.0730.061 to 0.0850.0460
Sample 2 (E)964.3400.0001830.9290.9180.0660.062 to 0.0700.0412
Model 2
2F DASS-21
Sample 1 (C)410.4090.0001880.9110.9010.0840.073 to 0.0950.0498
Sample 2 (C)1305.5730.0001880.8980.8860.0770.074 to 0.0810.0447
Sample 1 (E)328.7180.0001850.9420.9350.0680.056 to 0.0800.0452
Sample 2 (E)819.6840.0001790.9410.9310.0600.056 to 0.0640.0373
Model 3
3F DASS-21
Sample 1 (C)396.0400.0001860.9160.9050.0820.071 to 0.0930.0489
Sample 2 (C)1205.0220.0001860.9070.8950.0740.070 to 0.0780.0427
Sample 1 (E)360.7270.0001840.9290.9190.0760.064 to 0.0870.0460
Sample 2 (E)818.3660.0001790.9420.9310.0600.056 to 0.0640.0366
Model 4
Bifactor DASS-21
Sample 1 (C)838.8980.0001840.9380.9290.0710.059 to 0.083--
Sample 2 (C)1207.7980.0001840.9060.8930.0750.071 to 0.079--
Model 5
1F DASS-17 item
Sample 1 (C)311.1840.0001190.9050.8980.0980.085 to 0.1120.0510
Sample 2 (C)1957.6720.0001190.8920.8770.0890.084 to 0.0940.0477
Sample 1 (E)249.9320.0001170.9340.9240.0820.068 to 0.0970.0458
Sample 2 (E)329.8960.000600.9480.9320.0670.060 to 0.075
Model 6
1F Korean DASS-12
Sample 1 (C)161.0310.000650.9240.9080.0940.076 to 0.1120.0561
Sample 2 (C)598.9060.000650.9030.8840.0910.084 to 0.0980.0529
Sample 1 (E)139.0240.000640.9400.9270.0840.065 to 0.1030.0522
Sample 2 (E)399.3490.000620.9390.9230.0740.067 to 0.0810.0465
Model 7
3F Korean DASS-12
Sample 1 (C)81.9660.004510.9710.9620.0600.034 to 0.0840.0388
Sample 2 (C)375.5490.000510.9300.9100.0800.073 to 0.0880.0423
Sample 2 (E)214.1400.000490.9650.9520.0580.050 to 0.0660.0348
Model 8
1F Osman’s DASS-13
Sample 1 (C)154.1170.000650.9270.9120.0910.072 to 0.1090.0560
Sample 2 (C)585.6670.000650.8990.8790.0900.083 to 0.0970.0535
Sample 1 (E)133.0260.000640.9430.9310.0800.061 to 0.1000.0525
Sample 2 (E)329.8960.000600.9480.9320.0670.060 to 0.0750.0442
Model 9
3F Osman’s DASS-13
Sample 1 (C)95.8690.004620.9720.9650.0570.033 to 0.0790.0413
Sample 2 (C)297.2510.000620.9540.9430.0620.055 to 0.0690.0380
Sample 2 (E)251.9890.000610.9630.9530.0560.049 to 0.0640.0347
Model 10
Osman’s DASS-9
Sample 1 (C)80.4040.000270.9170.8890.1060.082 to 0.1370.0585
Sample 2 (C)366.4210.000270.8750.8330.1130.103 to 0.1230.0586
Sample 1 (E)64.2910.000260.9400.9170.0940.065 to 0.1230.0535
Sample 2 (E)162.0730.000250.9380.9110.0820.072 to 0.0930.0505
Model 11
Osman’s DASS-9
Sample 1 (C)53.5900.000270.9540.9310.0860.055 to 0.1170.0468
Sample 2 (C)366.4210.000270.8750.8330.1130.103 to 0.1230.0586
Sample 1 (E)41.3390.011230.9710.9550.0690.033 to 0.1020.0419
Sample 2 (E)72.4780.000220.9810.9690.0480.036 to 0.0610.0283
Model 12
A modified 3F DASS-9
Sample 1 (C)38.6530.030240.9870.9800.0600.019 t0 0.0940.0302
Sample 2 (C)225.8600.000240.9550.9330.0920.081 to 0.1030.0323
Sample 1 (E)24.8350.359230.9980.9970.0220.000 to 0.0690.0219
Sample 2 (E)134.1010.000230.9760.9620.0700.059 to 0.0810.0265
Model 13
3F DASS-8
Sample 1 (C)30.0030.026170.9870.9790.0680.023 to 0.1070.0275
Sample 2 (C)217.9900.000170.9530.9230.1090.097 to 0.1220.0351
Sample 1 (E)16.4830.420161.0000.9990.0130.000 to 0.0730.0186
Sample 2 (E)67.0470.000150.9880.9770.0590.045 to 0.0740.0203
χ2: chi-square; df: degrees of freedom; CFI: comparative fit index; TLI: Tucker–Lewis index; RMSEA: root mean square error of approximation; CI: confidence interval; SRMR: standardized root mean residual; F: factor; (C): crude model; (E): the model involves correlating residuals. Values in bold denote good fit.
Table 3. Comparison of the normality of the Depression Anxiety Stress Scale 21 (DASS-21) and its subscales with that of the DASS-9/DASS-8 and their subscales.
Table 3. Comparison of the normality of the Depression Anxiety Stress Scale 21 (DASS-21) and its subscales with that of the DASS-9/DASS-8 and their subscales.
SamplesDASS-21DASS-21 DepressionDASS-21 AnxietyDASS-21 StressDASS-9DASS-9 DepressionDASS-9 Anxiety ▲DASS-9 Stress ▲DASS-8DASS-8 Depression
Shapiro–Wilks’ WSample 10.930.930.900.940.920.920.850.880.910.90
Sample 20.830.830.720.840.820.860.670.750.800.82
: Both the anxiety depression subscales are the same on the DASS-9 and the DASS-8, all p values < 0.001.
Table 4. Descriptive statistics, internal consistency, predictive validity, and discriminant validity of the Depression Anxiety Stress Scale 21 and its shortened versions.
Table 4. Descriptive statistics, internal consistency, predictive validity, and discriminant validity of the Depression Anxiety Stress Scale 21 and its shortened versions.
DASS versionsSamplesMDQ1–Q3Coefficient AlphaAlpha-If-Item-DeletedItem-Total CorrelationsCorrelation with the DASS-21UWz
DASS-21Sample 1216–39.80.9590.956–0.9590.364–0.784--51,198.5542,734.5−8.098
Sample 272–170.9390.933–0.9400.172–0.696--
Korean DASS-12Sample 1125–210.9200.906–0.9190.503–0.8170.97750,933.5542,469.5−8.178
Sample 251–100.8790.856–0.8810.366–0.7650.970
Osman’s DASS-13Sample 1124.3–240.928 0.918–0.9270.512–0.7940.98450,478.5542,014.5−8.290
Sample 251–100.8900.872–0.8930.331–0.7660.971
Osman’s DASS-9Sample 193–160.8860.868–0.8840.491–0.7080.96750,506.0542,042.0−8.314
Sample 231–70.8290.789–0.8310.335–0.7080.921
Modified DASS-9Sample 1103–190.9390.928–0.9360.683–0.8300.97751,697.0543,233.0−8.009
Sample 231–80.9010.883–0.9050.471–0.7570.949
DASS-8Sample 192–170.9360.924–0.9340.688–0.8260.97250,965.0542,501.0−8.229
Sample 220–70.9050.888–0.9000.625–0.7560.929
MD: median, Q1: first quartile, Q2: third quartile, U: Mann Whitney U test, W: Wilcoxon test, all p values < 0.001. Bolded numbers represents wll-fitting models in this big table for a better readibility.
Table 5. Internal consistency of subscales of the Depression Anxiety Stress Scale 21 and shortened versions in the samples.
Table 5. Internal consistency of subscales of the Depression Anxiety Stress Scale 21 and shortened versions in the samples.
CriteriaSamplesDASS-21Korean DASS-12DASS-13Osman’s DASS-9DASS-9DASS-8
DepressionAnxietyStressDepressionAnxiety ▲StressDepressionStressDepressionAnxietyStressDepressionAnxiety △Stress △Depression
Coefficient alphaSample 10.9020.8720.9080.8500.7720.8520.8980.8240.8330.7310.6950.8690.8880.8350.854
Sample 20.8540.7950.8910.7420.6260.8280.8460.8140.7530.5540.7660.7770.7890.8010.793
Range of corrected item-total correlationsSample 10.607–0.7970.496–0.7480.577–0.8200.653–0.7410.497–0.6410.579–0.7660.665–0.7930.599–0.7800.604–0.7080.484–0.6110.533-0.667–0.7650.720–0.829All 0.7170.706–0.740
Sample 20.468–0.7070.349–0.6670.574–0.7880.416–0.6060.350–0.4590.561–0.7680.443–0.7070.614–0.7440.404–0.6310.319–0.4000.6230.443–0.6590.580–0.696All 0.6680.595–0.673
Range of alpha if-item-deleted Sample 10.877–0.8980.840–0.8730.884–0.9100.788–0.8260.680–0.7550.779–0.8560.869–0.8890.695–0.8350.770–0.8150.580–0.722--0.820–0.8450.801–0.895-0.782–0.814
Sample 20.820–0.8560.740–0.8010.862–0.8890.641–0.7510.516–0.6020.734–0.8270.805–0.8570.667–0.8010.650–0.7780.409–0.528--0.682–0.7930.647–0.780-0.676–0.759
Correlation with the corresponding scale on the DASS-21Sample 1------0.9700.8970.9690.9910.9430.9630.8660.8840.9670.9240.9210.949
Sample 2------0.9470.8280.9550.9790.8990.9060.7990.8320.9580.8370.8630.899
Correlation with the DASS-21Sample 10.9520.9350.9580.9180.7960.9260.9430.8950.9110.7690.8300.9180.9020.8810.904
Sample 20.9140.8230.9390.8660.6130.9000.8980.8280.8050.5870.7660.8810.7700.8080.854
: Items on the anxiety subscale on the DASS-12 and the DASS-13 are the same, : items on the anxiety and stress subscales on the modified DASS-9 and the DASS-8 are the same, all correlations are significant at the 0.01 level.
Table 6. Descriptive statistics and discriminant validity of subscales of shortened versions of the Depression Anxiety Stress Scale 21.
Table 6. Descriptive statistics and discriminant validity of subscales of shortened versions of the Depression Anxiety Stress Scale 21.
DASS SubscalesSamplesKorean DASS-12DASS-13Osman’s DASS-9Modified DASS-9
MDQ1–Q3UWzMDQ1–Q3UWzMDQ1–Q3UWzMDQ1–Q3UWz
DepressionSample 152–953,363.0544,899.0−7.65972–1351,796.0543,332.0−8.01441–853,045.0544,581.0−7.82652–954,378.5545,914.5−7.384
Sample 220–430–510–320–4
AnxietySample 120–555,078.5546,614.5−7.72420–555,078.5546,614.5−7.72420–455,800.0547,336.0−7.60930–654,555.0546,091.0−7.940
Sample 200–200–200–100–2
StressSample 152–854,327.5545,863.5−7.42441–656,008.5547,544.5−7.09631–457,678.5549,214.5−6.78020–456,053.5547,586.5−7.316
Sample 220–510–310–300–2
MD: median, Q1: first quartile, Q2: third quartile, U: Mann Whitney U test, W: Wilcoxon test, all p values < 0.001. For the depression subscale on the DASS-8, MD (Q1–Q2) = 4 (1–7, sample 1) and 1 (0–3, sample 2), U = 50,965.0, W = 542,501.0, z = −8.229.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ali, A.M.; Alkhamees, A.A.; Hori, H.; Kim, Y.; Kunugi, H. The Depression Anxiety Stress Scale 21: Development and Validation of the Depression Anxiety Stress Scale 8-Item in Psychiatric Patients and the General Public for Easier Mental Health Measurement in a Post COVID-19 World. Int. J. Environ. Res. Public Health 2021, 18, 10142. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910142

AMA Style

Ali AM, Alkhamees AA, Hori H, Kim Y, Kunugi H. The Depression Anxiety Stress Scale 21: Development and Validation of the Depression Anxiety Stress Scale 8-Item in Psychiatric Patients and the General Public for Easier Mental Health Measurement in a Post COVID-19 World. International Journal of Environmental Research and Public Health. 2021; 18(19):10142. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910142

Chicago/Turabian Style

Ali, Amira Mohammed, Abdulmajeed A. Alkhamees, Hiroaki Hori, Yoshiharu Kim, and Hiroshi Kunugi. 2021. "The Depression Anxiety Stress Scale 21: Development and Validation of the Depression Anxiety Stress Scale 8-Item in Psychiatric Patients and the General Public for Easier Mental Health Measurement in a Post COVID-19 World" International Journal of Environmental Research and Public Health 18, no. 19: 10142. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910142

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop