Skip to main content
Multistudy Report

The Scale of Positive and Negative Experience (SPANE)

Evaluation of Measurement Invariance and Convergent and Discriminant Validity

Published Online:https://doi.org/10.1027/1015-5759/a000540

Abstract. The Scale of Positive and Negative Experience (SPANE) is a self-report questionnaire designed to assess positive and negative emotions. In Study 1 (N = 4,250, 61.95% females, Mage = 28.56 years), we evaluated measurement invariance of the SPANE across gender and age using moderated factor analysis. In Study 2 (N = 200, 52.5% females, Mage = 21.82 years), we investigated the convergent and discriminant validity of the SPANE by examining its associations with measures of well-being and religiosity. In Study 3 (N = 160, 87.5% females, Mage = 20.38 years), we used a prospective design to examine associations of the SPANE with the Big Five personality traits. The results provided general support for the measurement invariance of the SPANE across age and gender, but some non-invariant items were detected as well. The analyses of latent mean differences across gender revealed that women reported higher levels of both positive and negative emotions than men, but the effect size for positive emotions was very small. Older participants reported lower levels of positive emotions and higher levels of negative emotions than younger participants. Both convergent and discriminant validity of the SPANE were supported.

References

  • Batz, C., & Tay, L. (2018). Gender differences in subjective well-being. In E. DienerS. OishiL. TayEds., Handbook of well-being. Salt Lake City, UT: DEF. First citation in articleGoogle Scholar

  • Bauer, D. J. (2017). A more general model for testing measurement invariance and differential item functioning. Psychological Methods, 22, 507–526. https://doi.org/10.1037/met0000077 First citation in articleCrossrefGoogle Scholar

  • Bauer, D. J., & Hussong, A. M. (2009). Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models. Psychological Methods, 14, 101–125. https://doi.org/10.1037/a0015583 First citation in articleCrossrefGoogle Scholar

  • Bjalkebring, P., Västfjäll, D., & Johansson, B. E. A. (2015). Happiness and arousal: Framing happiness as arousing results in lower happiness ratings for older adults. Frontiers in Psychology, 6, 706. https://doi.org/10.3389/fpsyg.2015.00706 First citation in articleCrossrefGoogle Scholar

  • Boyraz, G., Lightsey, O. R., & Can, A. (2013). The Turkish version of the meaning in life questionnaire: Assessing the measurement invariance across Turkish and American adult samples. Journal of Personality Assessment, 95, 423–431. https://doi.org/10.1080/00223891.2013.765882 First citation in articleCrossrefGoogle Scholar

  • Chaplin, T. M. (2015). Gender and emotion expression: A developmental contextual perspective. Emotion Review, 7, 14–21. https://doi.org/10.1177/1754073914544408 First citation in articleCrossrefGoogle Scholar

  • Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43, 245–265. https://doi.org/10.1348/0144665031752934 First citation in articleCrossrefGoogle Scholar

  • Čolović, P., Smederevac, S., & Mitrović, D. (2014). Velikih pet plus dva: Validacija skraćene verzije [Big Five Plus Two: Validation of a short version]. Primenjena Psihologija, 7, 227–254. First citation in articleCrossrefGoogle Scholar

  • Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71–75. https://doi.org/10.1207/s15327752jpa4901_13 First citation in articleCrossrefGoogle Scholar

  • Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125, 276–302. https://doi.org/10.1037/0033-2909.125.2.276 First citation in articleCrossrefGoogle Scholar

  • Diener, E., Tay, L., & Myers, D. G. (2011). The religion paradox: If religion makes people happy, why are so many dropping out? Journal of Personality and Social Psychology, 101, 1278–1290. https://doi.org/10.1037/a0024402 First citation in articleCrossrefGoogle Scholar

  • Diener, E., Wirtz, D., Biswas-Diener, R., Tov, W., Kim-Prieto, C., Choi, D.-W., & Oishi, S. (2009). New measures of well-being. Social Indicators Research: Assessing Well-Being, 39, 247–266. https://doi.org/10.1007/978-90-481-2354-4_12 First citation in articleCrossrefGoogle Scholar

  • Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D.-W., Oishi, S., … Biswas-Diener, R. (2010). New well-being measures: Short scales to assess flourishing and positive and negative feelings. Social Indicators Research, 97, 143–156. https://doi.org/10.1007/s11205-009-9493-y First citation in articleCrossrefGoogle Scholar

  • Du Plessis, G. A., & Guse, T. (2017). Validation of the Scale of Positive and Negative Experience in a South African student sample. South African Journal of Psychology, 47, 184–197. https://doi.org/10.1177/0081246316654328 First citation in articleCrossrefGoogle Scholar

  • Fredrickson, B. L. (1998). What good are positive emotions? Review of General Psychology, 2, 300–319. https://doi.org/10.1037/1089-2680.2.3.300 First citation in articleCrossrefGoogle Scholar

  • Gignac, G. E., & Szodorai, E. T. (2016). Effect size guidelines for individual differences researchers. Personality and Individual Differences, 102, 74–78. https://doi.org/10.1016/j.paid.2016.06.069 First citation in articleCrossrefGoogle Scholar

  • Giuntoli, L., Ceccarini, F., Sica, C., & Caudek, C. (2017). Validation of the Italian versions of the Flourishing Scale and of the Scale of Positive and Negative Experience. SAGE Open, 7, 1–12. https://doi.org/10.1177/2158244016682293 First citation in articleCrossrefGoogle Scholar

  • Harmon-Jones, C., Bastian, B., & Harmon-Jones, E. (2016). The Discrete Emotions Questionnaire: A new tool for measuring state self-reported emotions. PLoS ONE, 11, e0159915. https://doi.org/10.1371/journal.pone.0159915 First citation in articleCrossrefGoogle Scholar

  • Henry, J. D., & Crawford, J. R. (2005). The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44, 227–239. https://doi.org/10.1348/014466505X29657 First citation in articleCrossrefGoogle Scholar

  • Howell, A. J., & Buro, K. (2015). Measuring and predicting student well-being: Further evidence in support of the Flourishing Scale and the Scale of Positive and Negative Experiences. Social Indicators Research, 121, 903–915. https://doi.org/10.1007/s11205-014-0663-1 First citation in articleCrossrefGoogle Scholar

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118 First citation in articleCrossrefGoogle Scholar

  • Isaacowitz, D. M., & Smith, J. (2003). Positive and negative affect in very old age. Journals of Gerontology: Psychological Sciences and Social Sciences, 58, 143–152. https://doi.org/10.1093/geronb/58.3.P143 First citation in articleCrossrefGoogle Scholar

  • John, O. P., & Srivastava, S. (1999). The Big 5 trait taxonomy: History, measurement, and theoretical perspectives. In L. A. PervinO. P. JohnEds., Handbook of personality: Theory and research (2nd ed., pp. 102–138). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Jovanović, V. (2019). Measurement invariance of the Serbian version of the Satisfaction with Life Scale across age, gender, and time. European Journal of Psychological Assessment, 4, 555–563. https://doi.org/10.1027/1015-5759/a000410 First citation in articleLinkGoogle Scholar

  • Jovanović, V. (2015). Beyond the PANAS: Incremental validity of the Scale of Positive and Negative Experience (SPANE) in relation to well-being. Personality and Individual Differences, 86, 487–491. https://doi.org/10.1016/j.paid.2015.07.015 First citation in articleCrossrefGoogle Scholar

  • Jovanović, V., & Gavrilov-Jerković, V. (2016). The structure of adolescent affective well-being: The case of the PANAS among Serbian adolescents. Journal of Happiness Studies, 17, 2097–2117. https://doi.org/10.1007/s10902-015-9687-8 First citation in articleCrossrefGoogle Scholar

  • Jovanović, V., Gavrilov-Jerković, V., Žuljević, D., & Brdarić, D. (2014). Psihometrijska evaluacija Skale depresivnosti, anksioznosti i stresa-21 (DASS-21) na uzorku studenata u Srbiji [Psychometric evaluation of the Depression Anxiety Stress Scales-21 (DASS-21) in a Serbian student sample]. Psihologija, 47, 93–112. https://doi.org/10.2298/PSI1401093J First citation in articleCrossrefGoogle Scholar

  • Kuppens, P., Realo, A., & Diener, E. (2008). The role of positive and negative emotions in life satisfaction judgments across nations. Journal of Personality and Social Psychology, 95, 66–75. https://doi.org/10.1037/0022-3514.95.1.66 First citation in articleCrossrefGoogle Scholar

  • Li, F., Bai, X., & Wang, Y. (2013). The scale of positive and negative experience (SPANE): Psychometric properties and normative data in a large Chinese sample. PLoS ONE, 8, e61137. https://doi.org/10.1371/journal.pone.0061137 First citation in articleCrossrefGoogle Scholar

  • Lim, N. (2016). Cultural differences in emotion: Differences in emotional arousal level between the East and the West. Integrative Medicine Research, 5, 105–109. https://doi.org/10.1016/j.imr.2016.03.004 First citation in articleCrossrefGoogle Scholar

  • Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd ed.). Sydney, Australia: Psychology Foundation. First citation in articleGoogle Scholar

  • Lucas, R. E., & Gohm, C. L. (2000). Age and sex differences in subjective well-being across cultures. In E. DienerE. M. SuhEds., Culture and subjective well-being (pp. 291–317). Cambridge, MA: MIT Press. First citation in articleGoogle Scholar

  • Masumoto, K., Taishi, N., & Shiozaki, M. (2016). Age and gender differences in relationships among emotion regulation, mood, and mental health. Gerontology and Geriatric Medicine, 2, 1–8. https://doi.org/10.1177/2333721416637022 First citation in articleCrossrefGoogle Scholar

  • Molenaar, D., Dolan, C. V., Wicherts, J. M., & van der Maas, H. L. J. (2010). Modeling differentiation of cognitive abilities within the higher-order factor model using moderated factor analysis. Intelligence, 38, 611–624. https://doi.org/10.1016/j.intell.2010.09.002 First citation in articleCrossrefGoogle Scholar

  • Muthén, L. K., & Muthén, B. O. (2015). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • Park, N., Park, M., & Peterson, C. (2010). When is the search for meaning related to life satisfaction? Applied Psychology: Health and Wellbeing, 2, 1–13. https://doi.org/10.1111/j.1758-0854.2009.01024.x First citation in articleCrossrefGoogle Scholar

  • Rahm, T., Heise, E., & Schuldt, M. (2017). Measuring the frequency of emotions-validation of the Scale of Positive and Negative Experience (SPANE) in Germany. PLoS ONE, 12, e0171288. https://doi.org/10.1371/journal.pone.0171288 First citation in articleCrossrefGoogle Scholar

  • Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354–373. https://doi.org/10.1037/a0029315 First citation in articleCrossrefGoogle Scholar

  • Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. https://doi.org/10.18637/jss.v048.i02 First citation in articleCrossrefGoogle Scholar

  • Rush, J., & Hofer, S. M. (2014). Differences in within- and between-person factor structure of positive and negative affect: Analysis of two intensive measurement studies using multilevel structural equation modeling. Psychological Assessment, 26, 462–473. https://doi.org/10.1037/a0035666 First citation in articleCrossrefGoogle Scholar

  • Sass, D. A. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29, 347–363. https://doi.org/10.1177/0734282911406661 First citation in articleCrossrefGoogle Scholar

  • Saucier, G., Thalmayer, A. G., & Bel-Bahar, T. S. (2014). Human attribute concepts: Relative ubiquity across twelve mutually isolated languages. Journal of Personality and Social Psychology, 107, 199–216. https://doi.org/10.1037/a00364921037/a0036492 First citation in articleCrossrefGoogle Scholar

  • Silva, A. J., & Caetano, A. (2013). Validation of the flourishing scale and scale of positive and negative experience in Portugal. Social Indicators Research, 110, 469–478. https://doi.org/10.1007/s11205-011-9938-y First citation in articleCrossrefGoogle Scholar

  • Soto, C. J. (2015). Is happiness good for your personality? Concurrent and prospective relations of the Big Five with subjective well-being. Journal of Personality, 83, 45–55. https://doi.org/10.1111/jopy.12081jopy.12081 First citation in articleCrossrefGoogle Scholar

  • Steel, P., Schmidt, J., & Shultz, J. (2008). Refining the relationship between personality and subjective well-being. Psychological Bulletin, 134, 138–161. https://doi.org/10.1037/0033-2909.134.1.138 First citation in articleCrossrefGoogle Scholar

  • Steger, M. F., Frazier, P., Oishi, S., & Kaler, M. (2006). The meaning in life questionnaire: Assessing the presence of and search for meaning in life. Journal of Counseling Psychology, 53, 80–93. https://doi.org/10.1037/0022-0167.53.1.80 First citation in articleCrossrefGoogle Scholar

  • Steptoe, A., Deaton, A., & Stone, A. A. (2015). Psychological wellbeing, health and ageing. The Lancet, 385, 640–648. https://doi.org/10.1016/S0140-6736(13)61489-0 First citation in articleCrossrefGoogle Scholar

  • Sumi, K. (2014). Reliability and validity of Japanese versions of the Flourishing Scale and the Scale of Positive and Negative Experience. Social Indicators Research, 118, 601–615. https://doi.org/10.1007/s11205-013-0432-6013-0432-6 First citation in articleCrossrefGoogle Scholar

  • Thompson, E. R. (2007). Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38, 227–242. https://doi.org/10.1177/0022022106297301 First citation in articleCrossrefGoogle Scholar

  • Tran, T. V. (2009). Developing cross-cultural measurement. Oxford, UK: Oxford University Press. First citation in articleCrossrefGoogle Scholar

  • Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70. https://doi.org/10.1177/109442810031002 First citation in articleCrossrefGoogle Scholar

  • Vasić, A., Šarčević, D., & Trogrlić, A. (2011). Zadovoljstvo životom u Srbiji [Satisfaction with life in Serbia]. Primenjena Psihologija, 2, 151–177. First citation in articleCrossrefGoogle Scholar

  • Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS Scales. Journal of Personality and Social Psychology, 54, 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063 First citation in articleCrossrefGoogle Scholar