Next Article in Journal
Impact of Wind Speed on Response of Diffusion-Type Radon-Thoron Detectors to Thoron
Previous Article in Journal
Using an Accelerometer-Based Step Counter in Post-Stroke Patients: Validation of a Low-Cost Tool
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 17
Issue 9
10.3390/ijerph17093179
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of the Copenhagen Psychosocial Questionnaire Version III and Establishment of Benchmarks for Psychosocial Risk Management in Sweden

by
Hanne Berthelsen
1,*,
Hugo Westerlund
2,
Gunnar Bergström
3,4 and
Hermann Burr
5
1
Centre for Work Life and Evaluation Studies (CTA) & the Faculty of Odontology, Malmö University, 205 06 Malmö, Sweden
2
Department of Psychology, Stress Research Institute, Stockholm University, 106 91 Stockholm, Sweden
3
Department of Occupational Health Sciences and Psychology, Centre for Musculoskeletal Research, University of Gävle, 801 76 Gävle, Sweden
4
Institute of Environmental Medicine, Unit of Intervention and Implementation Research for Worker Health, Karolinska Institute, 171 77 Stockholm, Sweden
5
Division 3 Work and Health, Federal Institute of Occupational Safety and Health (BAuA), 10317 Berlin, Germany
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(9), 3179; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17093179
Submission received: 14 April 2020 / Revised: 27 April 2020 / Accepted: 29 April 2020 / Published: 2 May 2020
(This article belongs to the Section Occupational Safety and Health)
Browse Figure
Review Reports Versions Notes

Abstract

:
This study presents the Swedish standard version of the Copenhagen Psychosocial Questionnaire, COPSOQ III, and investigates its reliability and validity at individual and workplace levels with the aim of establishing benchmarks for the psychosocial work environment. Cross-sectional data from (1) a random sample of employees in Sweden aged 25–65 years (N = 2847) and (2) a convenience sample of non-managerial employees at 51 workplaces (N = 1818) were analysed. Internal consistency reliability was evaluated as well as the effects of sex, work sector and blue/white-collar work. Population benchmarks and mean scores for major occupational groups were computed based on weighted data. ICC(1) and ICC(2) estimates were computed to evaluate aggregation to the workplace level and Pearson inter-correlations to evaluate construct validity at individual and aggregated levels. The reliability and scale characteristics were satisfactory, with few exceptions, at both individual and workplace levels. The strength and direction of correlations supported the construct validity of the dimensions and the amount of variance explained by workplace justified aggregation to the workplace level. The present study thus supports the use of COPSOQ III for measurement at the workplace level and presents benchmarks for risk management as well as for research purposes.

1. Introduction

Measuring the psychosocial work environment in a valid and reliable way is increasingly seen as a necessary part of systematic occupational safety and health management [1,2,3,4]. A widely used research-based non-commercial tool for psychosocial workplace surveys is the Copenhagen Psychosocial Questionnaire (COPSOQ). Originally developed in 2000 for use in research and at workplaces in Denmark, it has today been validated in 18 countries, and results from research from even more language versions have been reported in hundreds of peer-reviewed articles [5]. COPSOQ is intended for both workplace measurement, usually comparing work groups, departments or companies, and for research, e.g., investigating effects of work environment on health or labour market attainment. The International COPSOQ Network recently released a revised third version, COPSOQ III [5], which is an update of the two previous versions of the instrument [6,7]. The changes are primarily based on experiences from practical use of previous versions for workplace assessments and research but have also taken labour market changes and theoretical developments into consideration [5]. Importantly, the new version is designed to allow flexible adaptation to national and industry-specific contexts without compromising the potential for international comparisons and for comparisons over time. Items labelled as “core”, “middle” and “long” compose the international COPSOQ III structure. While inclusion of core items is mandatory for national versions, it is important to underline that they do not constitute a short version of the instrument. National versions can be established by the national COPSOQ teams of each country based on all “core” items supplemented with enough items labelled as “middle” or “long” to form a reliable and relevant measurement in the given context. Therefore, all future national versions will include the same mandatory core items, while the total number of items in scales and number of scales are allowed to differ [5].
The new Swedish standard version of COPSOQ III is based on preceding development, adaptation and testing of COPSOQ II for use at workplaces and research in the Swedish context [8,9,10] also taking the new COPSOQ III into account [5]. Several studies have corroborated different aspects of reliability and validity of the Swedish version of COPSOQ II. An iterative process including translation-back-translation procedures and cognitive interviewing methods supported the face and content validity, as well as the cross-cultural equivalency of COPSOQ II and COPSOQ III test items [8,9,10]. The nomological validity has been corroborated by operationalization of an extended JD-R model by the instrument with aspects of workability as outcome [11] as well as need for recovery [12] and also in relation to the newly introduced dimensions in the COPSOQ III of Work Engagement, Quality of Work [13] and Cyber Bullying [14]. Studies across different occupations have corroborated the internal consistency reliability and construct validity of the scales [11,12,13,15,16,17,18,19]. The ability to distinguish different groups (organizations with similar missions, work teams or occupational groups) has been demonstrated [20,21,22], as also the relevance of multilevel analyses and for intervention and organizational change studies [23,24,25,26,27,28,29].
As part of a research and development project for use in Swedish workplaces, several workplace surveys have been conducted in close collaboration with stakeholders from different organizations. The data and experiences from this process have contributed to the international development of COPSOQ III, e.g., selection of items, changes in wording and inclusion of new dimensions [5].
Now the Swedish standard version of COPSOQ III has been developed. As it is adapted to the Swedish context, it differs from the international version of COPSOQ III, which showed satisfactory basic psychometric properties in findings from 6 countries (including data collected at Swedish workplaces) [5,30]. The factor structure of the mandatory “core” items defined for COPSOQ III has been validated in Canada [31] and the COPSOQ III domain for Social Capital has been validated by qualitative and quantitative methods in Sweden [10,32].
Aggregated group means for organizations or departments are of high relevance for the assessment, implementation and evaluation of organizational interventions [33]. Although this approach is widely applied when applying COPSOQ for psychosocial risk management in workplaces, the emphasis of validation studies has so far been on the individual level. Nevertheless, a validation study is needed for the presentation and evaluation of the adapted Swedish national standard version of COPSOQ III, to establish population-based benchmarks for Sweden, and especially the aggregation to workplace group means has yet to be validated.

A Need for Benchmarks for Use at Workplaces

Benchmarks can provide various kinds of relevant information for use at workplaces. Population-based benchmarks/reference values are the key to interpreting COPSOQ survey results from a risk management perspective [34]. For COPSOQ II, such population-based reference values are established, for example, for the working populations in Denmark, Spain, Canada, and France. For Sweden, the opportunities for comparisons have so far included mean scores from a convenience sample of workplace surveys (www.copsoq.se). Such comparisons can give an idea about the level for each scale for specific occupations but are not representative for the average level in the population. This forces occupational safety and health companies, organizational consultants, HR departments, policy-makers and researchers to interpret results from Swedish surveys with Danish reference values in order to assess psychosocial risks. This is not an ideal situation for several reasons: The data used for establishing the Danish reference values was collected 15 years ago [7]; the Danish labour market and legislation differs from the Swedish; the Danish benchmarks have not been validated for use in the Swedish context or with a Swedish language version; and finally the values relate to COPSOQ II. Introducing COPSOQ III accentuates the need for updated reference values based on the Swedish labour market of today.
The purpose of this study is to present and evaluate aspects of reliability and construct validity at both individual and workplace levels for the Swedish standard version of COPSOQ III, with the aim of establishing benchmarks for the organizational and social work environment for the adult working population in Sweden.

2. Materials and Methods

The present validation study builds on data from a cross-sectional national survey for the establishment of reference values and for psychometric evaluation of scale characteristics at the individual level. Nested data from a convenience sample of 51 workplace surveys is used for evaluation of the appropriateness of aggregating individual-level COPSOQ dimensions to the organizational level.

2.1. Random Sample

A cross-sectional survey was conducted by Statistics Sweden (SCB) at the request of the research group. Data collection took place from September to November 2018 by post, including an information letter, a paper version together with a stamped return envelope, and a personal link to a web questionnaire. Non-respondents received up to two reminders, the last of these included new paper questionnaires and return envelopes.
From the Swedish employment directory, SCB drew a random sample of 11,556 persons from all 4,525,274 inhabitants in Sweden aged 20–65 years and registered as gainfully employed. In total, 3642 responded (30.9%). Of these, 53 declined participation, 374 were not currently in work, and 33 were excluded based on an ID-check comparing register data with self-reported data. Due to a response rate as low as 6% for those aged 20–24 years and the fact that many in this age group were still in education, we decided to exclude this age group (74 cases) from the analyses for this paper. In addition, 185 business owners and 76 respondents stating that they had neither a superior nor colleagues were excluded from all main analyses. For an overview of the sampling process, see Figure 1.
In general, women, the oldest age group, and those with tertiary education were the most likely to respond. This was also reflected in the differences seen across major occupational groups based on the International Standard Classification of Occupations, ISCO-08. People born in Scandinavia were more likely to respond than those born elsewhere, and those with the highest income responded to a larger extent than others.
The study population is presented in Table 1. Out of the 2847 respondents in the analytic sample, 56% were women, the most frequent major occupational group was Professionals (group 2, 35%), and less than half of the respondents worked in the private sector (47%). Two out of three were in a non-managerial position (67%) and most respondents (81%) reported having direct contact with patients, customers, clients, pupils, etc., at work. More details regarding the study population stratified by major occupational groups (ISCO-08 1-digit) are presented in Table A1 (Appendix A).

2.2. Workplace Sample

Cross-sectional data was collected from 2016 to 2019 as part of a validation and development project for the use of COPSOQ at workplaces (Grant: AFA Insurance 130301). All staff members in a convenience sample of 51 workplaces (organizations with max. 200 employees each; 26 public and 25 private) received an email with a link to an online questionnaire and an introduction and information about the research project. Each survey was open for 3–4 weeks and included two reminders. The overall response rate for the workplaces was 77% (ranging from 50% to 100%) and analyses included data from 1818 non-managerial employees. The average number of respondents at the workplaces was 28 (SD 18, range 8–138). For this convenience sample, 28% of the employees were under 35 years of age, 22% were 35–44, 27% were 45–54, and 21% were aged 55 or older and 51% were women. The corresponding distribution for the target population 2017 was according to SCB statistics: 26% below age 35, 26% were 35–44 years old, 28% were 45–54 and 21% were 55 or older and 48% were women. Most employees were Professionals (36% ISCO group 2), Technicians and Associate Professionals (24% ISCO group 3), Clerical Support Workers (11% ISCO group 4) or Services and Support Workers (12% ISCO group 5).

2.3. Variables

The questionnaire for the national study comprised 132 items in total and a free text field for comments. We included 12 background factors regarding work situation and personal characteristics in addition to register data obtained from Statistics Sweden. From COPSOQ III, 85 items were included in the questionnaire to cover 33 dimensions. Furthermore, 35 items were included for other research purposes. The questionnaire applied to employees at workplaces was regarding COPSOQ III items similar to the questionnaire used for the national survey.

2.4. The National Swedish Standard Version of COPSOQ III

In the present study, we evaluate the national Swedish standard version of COPSOQ III. It includes 76 items (according to the international COPSOQ III structure: 32 mandatory “core” items, 15 additional “middle” items and 29 additional “long” items) to cover 33 work environment dimensions (24 multi-item scales, nine single item measures (incl. five items on conflicts and offensive behaviours). Table A2 from Appendix B gives an overview of the Swedish standard version of COPSOQ III and its correspondence with the international middle version of COPSOQ III and with the Swedish middle version of COPSOQ II. A detailed overview, including formulations in Swedish, is available as an online Supplementary Materials. In relation to the previous Swedish version, the present third version includes five new dimensions and six dimensions have changed name, one dimension has changed response options, 16 dimensions have a reduced number of items, two items are replaced and five have changes in wording. Decisions regarding the selection of dimensions were guided by the perceived relevance to the Swedish context, cognitive interviews, pilot tests and dialogue with stakeholders, taking the item level in the international COPSOQ III and item-level ICC(1) values into consideration for not jeopardizing the ability to differentiate workplaces, as recently suggested by Bliese and colleagues [35].

2.5. Analyses

Scales were computed as means of items with range 0–100, where the scale score was set to missing if respondents had replied to less than half of the items included in the scale [5]. Each scale was scored in the direction indicated by its name [5].
To draw correct inferences about the target population, two sets of weights were calculated for the national representative sample; one based on sex, age, income and educational level for calculating benchmarks for the general population of 25–65-year-old employees in Sweden; and another set of weights based on sex and age for the purpose of calculating representative mean scores for each of the ISCO major occupational groups. The benchmarks for the Swedish standard version of COPSOQ III were computed as mean scores with standard deviations for scales, and frequencies of conflicts and offensive behaviours such as bullying, harassment and violence based on weighted data to match the target population of 25–65-year-old employees working in Sweden. Mean scale scores, standard deviation and frequency of conflicts and offensive behaviours were also computed for each major occupational group, weighted within each group to match the target population (ISCO 1-digit, 25–65 years). Internal consistency reliability was analysed with Cronbach’s alpha for scales with three or more items and Spearman-Brown Coefficient for two-item scales [36]. The proportion of respondents selecting the lowest (floor) and highest (ceiling) response options for all items in a scale were determined for all scales, as well as the proportion of respondents having replied to less than half of the items in each scale (scale missing). More than 15% of the respondents choosing the lowest or highest response options was considered evidence of a floor or ceiling effect, respectively [37]. Mean scores and frequency of conflicts and offensive behaviours were calculated according to sex (men/women), work sector (private/public) and white/blue-collar work (ISCO groups 1–2–3 versus 6–7–8–9). Differences within each group were tested with t-tests and Chi-square tests, and Cohen’s d was calculated for evaluation of the effect of sex, sector, and kind of work. A Cohen’s d value of 0.2 indicates a small effect, 0.5 a medium effect and 0.8 a large effect [38] and a 5–10 point mean score difference is considered a minimum important difference [39].
ICC(1) and ICC(2) were calculated for each dimension based on aggregation of individual level data to ISCO major occupational group (national sample) and to workplace (workplace sample). ICC(1) represents the amount of variance in the employees’ responses that can be explained by their membership of a group (occupation or workplace) [35,40,41,42]. ICC(1) values of 0.05 can be considered as a small to medium effect and higher values indicate stronger effects [42], ICC(2) is an estimate of reliability of the aggregated group means [35,40,41]. Values <0.5 indicate poor reliability, 0.5–0.75 moderate and >0.75 indicate good reliability of group-level means [43]. Finally, for the sample of workplaces, we calculated the aggregated level mean, standard deviation, minimum, maximum, range and comparison of mean scores with the Benchmark for each scale.
Bivariate Pearson correlations between scales were calculated for the national sample of 25–65-year-old employees (individual level) and for the convenience sample of workplaces (individual and workplace level) for evaluation of construct validity (distinctiveness of dimensions and concurrent validity).

2.6. Ethics

Informed consent was obtained from all individual participants included in the study. All procedures performed were in accordance with the ethical standards of the national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. The Regional Ethical Review Board of Sweden approved the study (Dnr 2015-476; 2018–392; 2019-05904).

3. Results

Benchmarks for the Swedish standard version of COPSOQ III are presented in Table 2 in addition to scale psychometric characteristics.
The internal consistency reliability was above 0.70 for all scales, except for the two-item scale for Quality in Work (0.69). Most dimensions had low floor and ceiling effects. High floor effect and low mean scores were seen for Job Insecurity (34.8%) and Insecurity over Working Conditions (28.1%). A strong ceiling effect and high mean values were seen for the single item Meaning of Work (40.6%) and for Social Support from Supervisor (30.3%) and Social Support from Colleagues (32.5%). Internal non-response for dimensions was between 0.4% and 1.6%.
The mean scores differed statistically significantly for most scales by sex, work sector and white/blue-collar work (Table 3).
Moderate to large differences in mean scores were found between white- and blue-collar workers, in particular. White-collar workers had higher mean scores for Quantitative Demands, Emotional Demands, Influence, Possibilities for Development, Variation and Meaning of Work, while lower for Job Insecurity compared to blue-collar workers. Emotional Demands was the only dimension showing large differences for sex, work sector and kind of work. Women workers, employees working in the public sector and white-collar workers reported the highest levels of Emotional Demands (scale means 15–19 points higher than for their respective counterparts). We found a corresponding pattern with the same groups most exposed to conflicts and offensive behaviours. An additional comparison revealed that business owners scored statistical significantly higher for the outcome dimensions Work Engagement (77) and Job Satisfaction (72), and lower for Stress (31) and Burnout (31) than the study sample did (results not shown in table).
Table 4 displays psychometric characteristics for major occupational groups based on the ISCO-08 classification. Of the 24 relevant scales, 16 revealed satisfactory reliability values for all major occupational groups. Reliability coefficients below 0.70 were mainly seen among Managers and Elementary Occupations (e.g., Work pace, Recognition, Role conflicts and Quality in work), and only in one case did a reliability coefficient reach below 0.60 (Work Pace/Elementary Occupations). Managers reported the most beneficial scores across occupations (14 out 28 scales) and the group having the most problematic weighted mean scores was Plant and Machine Operators and Assemblers (13 out of 28 scales). Services and Support Workers was the group most exposed to Threats of Violence, Physical Violence and Sexual Harassment. Clerical Support Workers reported bullying most frequently, while Managers were the group most exposed to Cyber Bullying. The widest range for mean scores across ISCO major occupational groups was found for Emotional Demands, Variation, Quantitative Demands and Influence.
The bivariate intercorrelations between dimensions for the total national sample (individual level data) are presented in Table 5 and for the workplace sample (both individual and organizational level) in Table 6. Too strong intercorrelations may indicate that the scales do not measure distinct constructs. For individual level data, only 6 out of the 378 correlations in the national sample and 9 correlations in the workplace sample were above 0.70. The strongest correlations at the individual level were largely those between scales that were most strongly correlated also at the workplace level, for example, the correlation between Stress and Burnout ranged from 0.79 to 0.83. The correlations were in general stronger between scales aggregated to the organizational level than the corresponding correlations at the individual level. Nevertheless, for the scales Role Clarity and Quantitative Demands, most of the correlations with other dimensions were strongest at individual level. We found differences in the pattern of correlations between individual and workplace level data in relation to a few dimensions, in particularly Role Clarity and Job Insecurity. For example, a moderate negative correlation was seen between Job Insecurity and Quantitative Demands (−0.53) at an organizational level, while the corresponding correlation was non-significant at an individual level. Conversely, a moderate positive correlation between Role Clarity and Social Community at Work was significant at an individual level (0.37/0.34) but insignificant at a workplace level.
Table 7 displays measures relating to aggregation of data to major occupational groups and to organizational level. The ICC(2) scores indicate a moderate to good reliability of group mean scores for major occupational groups as well as for workplaces. Only aggregation of the individual characteristic Self-Rated Health to workplace level showed poor reliability. A small to medium effect of respondents’ major occupational group was seen for Quantitative Demands, Emotional Demands, Influence, Possibilities for Development, Variation, Meaning of Work, and in addition for Job Insecurity (ICC(1)). In relation to the effect of workplace, the largest explained variance was seen for scales reflecting job demands and aspects of leadership, while small to medium effect sizes were found for all other exposures. The aggregated workplace mean scores ranged from 23 to 54 points.

4. Discussion

In the present study, we have evaluated the reliability and construct validity of a Swedish standard version of COPSOQ III at both individual and organizational level and established national benchmarks for workplace surveys. A trade-off exists between the obvious need for a questionnaire of high relevance for the national context and the need to keep a high degree of correspondence with other national versions for facilitation of valid comparisons. Experiences from previous versions of the instrument have shown that practitioners and researchers to a high extent share a wish for shorter questionnaires. We have chosen to reduce the number of items in many dimensions in order to be able to make room for new dimensions covering Work Engagement, Quality of Work, Job Insecurity, Insecurity over Working Conditions and Cyber Bullying. Scales including only a few items potentially reduce the reliability and validity of the measurement. Nevertheless, our overall findings indicate that the Swedish national standard version of COPSOQ III has good psychometric properties for its intended uses.

4.1. Reliability and Scale Characteristics at Individual Level Based on the National Survey

The internal consistency reliability of the scales was satisfactory for the study population as a whole. This corresponds with findings from the international COPSOQ III validation study (Burr et al. 2019). An unacceptably low value for Work Pace was seen for respondents with an Elementary Occupation, and the reliability was questionable for Work Pace, Role Conflicts and Quality of Work for Managers, Craft and Related Trade Workers, and Elementary Occupations. This calls for caution when interpreting results for these specific combinations of scales and major occupational groups. In the future, adding more items to these scales should be considered in the Swedish context.
Compared to findings from the Danish COPSOQ II study [7] and the international COPSOQ III study [5], the internal non-response was low for all scales, and especially regarding Social Support from Supervisor and Vertical Trust. Scales referring to managers and work climate can in some cases be difficult to reply to, for example in complex organizations or among the self-employed [10]. The noticeable lower internal non-response for these scales might be due to stricter inclusion criteria in the present study in combination with the thorough adaptation of formulations based on cognitive interviewing techniques [8,9,10].
Floor and ceiling effects were minor for most scales, indicating the good ability of the instrument to distinguish over the full spectrum of the scales. However, for the new dimensions, Job Insecurity and Insecurity over Working Conditions, we found a high floor effect. This finding was not a surprise based on the previous findings from the international validation study [5] and from the Sixth European Working Conditions Survey [44]. In contrast, we found large ceiling effects for Meaning of Work, Social Support from supervisor and from colleagues. The finding regarding Meaning of Work is also in accordance with previous findings [5,11]. Sweden is globally among those countries with the highest proportion of workers employed in service work (2019: 80% [45]), which is typically perceived as more meaningful than manufacturing work. The high levels of reported social support contrast with the levels reported for COPSOQ II for specific occupational contexts in Sweden [11,16]. This could be a consequence of the COPSOQ III standard version including two rather than three items in each of these scales. The level is also higher than the reported international results reported for COPSOQ III [5]. This difference can probably be understood in the light of the Swedish workplace culture characterized by shared decision making, avoidance of conflicts and aiming at consensus [46].

4.2. Reliability and Validity of COPSOQ III for Use at Workplaces and for Multilevel Research Design

COPSOQ is a generic instrument intended for research purposes as well as risk management of the psychosocial work environment at workplaces [5,7,47]. Accordingly, the ability of scales to distinguish exposures for different occupational groups and across workplaces is of great importance.
Despite being an instrument, which collects responses from individual employees, the main intention is to capture workplace and organizational conditions, not individual perceptions. It is thus very important that the aggregated workplace scores refer to something that is shared by the employees in a certain work unit/organization and not just to a mean of largely unrelated individual responses. Our findings corroborated the reliability of such group mean scores regarding psychosocial exposures based on aggregation to occupation and workplace level.
The traditional criterion is a minimum of 5% explained variance for the relevance of taking the aggregated level into account [41,42]. The amount of variance explained by workplace fulfilled the criteria for all dimensions except Self-Rated Health, which is an individual outcome mainly influenced by non-work-related factors. This underlines the importance of considering the workplace level for research on the psychosocial environment and justifies the relevance of aggregating individual scores to group mean scores when reporting survey results back to workplaces. Our findings corroborate previous research on the COPSOQ II showing that job exposure matrices are of little relevance for psychosocial risk assessment of, e.g., relational factors in workplaces [48,49]. However, the low amount of variance attributed to the major occupational groups does not imply that occupation is of no relevance, as the ISCO-digit-1 grouping comprises many different occupations working in different sectors, etc., within each major group. In a specific context such as public dental services, psychosocial work environment factors have been reported to differ considerably for dentists working in different organizations, while this is not the case for dental nurses and hygienists [22]. Additionally, the traditional criterion has been questioned as even ICC(1) values as low as 0.01 in some cases are relevant to take into account in multilevel analyses [50].
We found a similar overall pattern of inter-correlations at the individual level across the two samples of the present study and those reported from the international validation study [5] (Burr et al. 2019). In general, the strength and direction of correlations supported the concurrent validity of the scales. However, the strength of the inter-correlation between Stress and Burnout and the similarity of correlation for these two scales to other dimensions calls for further clarification of whether they actually represent two separate constructs as measured here.
As one might expect, however, we found differences in the strength of correlations at the individual level when comparing the Swedish with the international findings. In particular, the two new dimensions regarding insecurity showed considerably stronger correlations with other dimensions in the Swedish sample compared to the international average correlations across national samples. A high degree of employment security on the labour market combined with a high flexibility decreases the detrimental health effect of individual employees’ perceptions of job insecurity [51]. The Swedish labour market is, however, characterized by high employment security for people in fixed positions, but little flexibility in hiring and firing of workers; this combination may result in especially strong adverse reaction to individual level experienced job insecurity [51].
In accordance with what is typically reported [52], the correlations at the aggregated workplace level were in general stronger than for the individual level. We found some interesting differences in the general pattern of correlations between individual and workplace level. This may be due to conceptual differences between aggregated and individual level dimensions [33]. Stronger correlations at the individual level could also indicate individual bias, such as negative affectivity or generalized effects of health, for instance depressive symptoms [53]. Stronger correlations at the organizational level, on the other hand, could indicate generalized effects of managerial practices or financial constraints at the organizational level. For example, the Psychosocial Safety Climate (PSC) of organizations has been shown to act as a precursor to and moderator of job demands and resources in the workplace [54,55,56]. This underlines the importance of careful theoretical considerations and the relevance of multilevel study design in work environment research in order to avoid the ecological or the atomistic fallacy.

4.3. Strengths and Limitations

The findings of our study should be seen in the light of some advantages and limitations.
A trade-off exists between the need to optimize the relevance of a generic questionnaire to the local context and the prospects for comparison over time and context. We found it to be possible to reduce the number of items, to maintain a broad coverage and even include new dimensions of high relevance to Swedish regulations (e.g., Work Engagement and Quality of Work). Another advantage is that the Swedish national version of COPSOQ III builds on experiences from COPSOQ II and a careful adaptation process including translation-back-translation, use of cognitive interviews and perceptions from stakeholders of different kinds.
The study design allowed for analyses including individual level data and nested data from workplaces. This adds to the knowledge about the reliability and validity of the instrument for use at workplaces and for integration in multilevel analyses.
The response rate for the workplace sample was a satisfactory 77%, clearly indicating the relevance of the instrument for use in this context. For the national survey the response rate was a less satisfying 31% and for two of the major ISCO 1-digit groups the number of respondents was too low to allow for valid calculation of scale mean scores. However, the strength of this dataset is that it was based on a random sample of wage earners in Sweden and the opportunity of calculating weights for adjustment based on complementary demographic register data. A comparison of weighted and unweighted benchmarks and mean scores (not reported) showed only minor differences in estimates. While the low response rate still is a limitation of the study, we find no indication that selection bias is a major problem for the reported population-based benchmarks and mean values for the major occupational groups, which can thereby be considered representative of the underlying population.
In future studies, it will be relevant to employ a longitudinal multilevel design with integration of self-reported data and register data (e.g., absence, staff turnover and measures of performance). In particularly, it will be relevant to evaluate test-retest reliability, responsiveness and predictive criterion validity. Bliese and Jex pointed out that simple analyses of means for people working together often may be appropriate for implementation and evaluation of organizational interventions and are also important to consider in stress research projects [33]. This makes further validation of the multilevel structure of the instrument and evaluation of measurement invariance across different groups and language versions highly relevant.

5. Conclusions

The present study supports the reliability and construct validity of the Swedish standard version of COPSOQ III and establishes benchmarks for workplace risk management as well as for research purposes.

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/1660-4601/17/9/3179/s1, Changes in items and dimensions from the Swedish version of COPSOQ II to COPSOQ III.

Author Contributions

Conceptualization, H.B. (Hanne Berthelsen) and H.W.; Data curation, H.B. (Hanne Berthelsen); Formal analysis, H.B. (Hanne Berthelsen); Funding acquisition, H.B. (Hanne Berthelsen), H.W. and G.B.; Investigation, H.B. (Hanne Berthelsen); Methodology, H.B. (Hanne Berthelsen), H.W. and G.B.; Project administration, H.B. (Hanne Berthelsen); Writing—original draft, H.B. (Hanne Berthelsen); Writing—review & editing, H.B. (Hanne Berthelsen), H.W., G.B. and H.B. (Hermann Burr). All authors have read and agreed to the published version of the manuscript.

Funding

The project was financed by AFA Försäkring [AFA Insurance], Grant no. 170262 and by Forskningsrådet om Hälsa, Arbetsliv och Välfärd (The Swedish Research Council for Health, Working Life and Welfare), FORTE Grant no. 2016-07220.

Acknowledgments

The authors wish to thank Josefin Björk for her outstanding work with the data collection and in building the Swedish COPSOQ website as well as her valuable suggestions during the development of the Swedish version of the questionnaire.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A

Table
Table A1. Characteristics of the study population based on ISCO-08 Major occupational groups (random sample).
Table A1. Characteristics of the study population based on ISCO-08 Major occupational groups (random sample).
ISCO-08
Major Occupational Groups		NWomenPrivate SectorPublic SectorFixed EmploymentAge (Years)Income Level
(Swedish Kronor Per Year before Income Tax)		Relational WorkNon-Managerial Position
%%%%MeanSDMeanSD%%
0. Armed Forces Occupations5
1. Managers22245.553.940.198.650.08.3677,430315,16781.011.7
2. Professionals98765.233.062.995.847.110.7457,505191,21684.667.7
3. Technicians and Associate Professionals42143.560.732.298.146.610.6442,773160,00883.069.8
4. Clerical Support Workers22070.956.933.594.047.710.5334,546104,18670.878.5
5. Services and Support Workers48277.234.661.186.948.711.8292,79589,34596.077.8
6. Skilled Agricultural, Forestry and Fishery Workers2045.055.030.075.047.712.5265,31582,34045.075.0
7. Craft and Related Trades Workers1687.786.611.097.047.110.7387,394102,62372.775.6
8. Plant and Machine Operators and Assemblers15217.886.38.293.849.810.4373,195111,11850.378.9
9. Elementary Occupations8864.844.042.987.449.311.0262,93877,09578.477.3
Not classified82

Appendix B

Table
Table A2. Overview of dimensions included in the Swedish standard version of COPSOQ III and its correspondence with the International COPSOQ III and with the existing Swedish middle version of COPSOQ II.
Table A2. Overview of dimensions included in the Swedish standard version of COPSOQ III and its correspondence with the International COPSOQ III and with the existing Swedish middle version of COPSOQ II.
The Swedish Standard COPSOQ III.No. of ItemsCorrespondence with the International COPSOQ IIICorrespondence with the Existing Swedish COPSOQ II
Quantitative demands3Equal to MIDDLE1 item shorter
Work pace2Equal to MIDDLE1 item shorter
Emotional demands3Equal to MIDDLE1 item shorter, 1 item changed wording
Influence41 MIDDLE item replaced by 1 LONG itemNo changes
Possibilities for development3Equal to MIDDLE1 item shorter
Variation of work11 out of 2 LONG itemsNo changes
Meaning of work1Equal to CORE2 items shorter
Predictability2Equal to MIDDLENo changes
Recognition21 CORE item supplemented by 1 LONG item1 item shorter, dimension name changed
Role clarity3Equal to MIDDLEDimension name changed
Role conflicts32 CORE items supplemented by 1 MIDDLE item on illegitimate tasks1 item shorter
Quality of leadership3Equal to MIDDLE1 item shorter, dimension name changed
Social support from supervisor2Equal to MIDDLE1 item shorter
Social support from colleagues2Equal to MIDDLE1 item shorter
Sense of community at work3Equal to LONGNo changes
Commitment to the workplace33 out of 5 LONG items1 item replaced; dimension name changed
Work engagement3Equal to LONGNew dimension
Job insecurity3Equal to LONGNew dimension
Insecurity over working conditions21 CORE item supplemented by 1 LONG itemNew dimension
Quality of work2Equal to LONGNew dimension
Job satisfaction44 out of 5 LONG items (1 MIDDLE item excluded)No changes
Work life conflict32 CORE items supplemented by 1 LONG item1 item shorter, 1 item replaced, response options changed
Horizontal trust1Equal to MIDDLE2 items shorter, dimension name changed
Vertical trust3Equal to MIDDLE1 item shorter, 2 items changed wording, dimension name changed
Organizational justice32 CORE items supplemented by 1 LONG item1 item shorter, 2 items changed wording, dimension name changed
Self-rated health1Equal to CORENo changes
Stress3Equal to LONG1 item shorter
Burnout SE33 out of 4 LONG version items1 item shorter
Threats of violence1 (2)Equal to LONGNo changes
Physical violence1 (2)Equal to LONGNo changes
Bullying1 (2)Equal to LONGNo changes
Sexual harassment1 (2)Equal to LONGNo changes
Cyber Bullying1 (2)Equal to LONGNew dimension

References

  1. Dollard, M.; Skinner, N.; Tuckey, M.R.; Bailey, T. National surveillance of psychosocial risk factors in the workplace: An international overview. Work Stress 2007, 21, 1–29. [Google Scholar] [CrossRef]
  2. Leka, S.; Cox, T. Psychosocial risk management at the workplace level. In Occupational Health Psychology; Leka, S., Houdmont, J., Eds.; Wiley–Blackwell: West Sussex, UK, 2010; pp. 124–156. [Google Scholar]
  3. Leka, S.; van Wassenhove, W.; Jain, A. Is psychosocial risk prevention possible? Deconstructing common presumptions. Saf. Sci. 2015, 71, 61–67. [Google Scholar] [CrossRef]
  4. Weiler, A. Working Conditions Surveys—A Comparative Analysis; European Foundation for the Improvement of Living and Working Conditions: Dublin, Ireland, 2007. [Google Scholar]
  5. Burr, H.; Berthelsen, H.; Moncada, S.; Nübling, M.; Dupret, E.; Demiral, Y.; Oudyk, J.; Kristensen, T.S.; Llorens, C.; Navarro, A.; et al. The third version of the Copenhagen Psychosocial Questionnaire. Saf. Health Work 2019, 10, 482–503. [Google Scholar] [CrossRef] [PubMed]
  6. Kristensen, T.S.; Hannerz, H.; Høgh, A.; Borg, V. The Copenhagen Psychosocial Questionnaire—A tool for the assessment and improvement of the psychosocial work environment. Scand. J. Work Environ. Health 2005, 31, 438–449. [Google Scholar] [CrossRef] [Green Version]
  7. Pejtersen, J.H.; Kristensen, T.S.; Borg, V.; Bjorner, J. The second version of the Copenhagen Psychosocial Questionnaire. Scand. J. Pub. Health 2010, 38, 8–24. [Google Scholar] [CrossRef]
  8. Berthelsen, H.; Westerlund, H.; Kristensen, T.S. COPSOQ II—En Uppdatering och Språklig Validering av den Svenska Versionen av en Enkät för Kartläggning av den Psykosociala Arbetsmiljön på Arbetsplatser (COPSOQ II—An Update and Linguistic Validation of the Swedish Version of a Survey for the Monitoring of the Psychosocial Work Environment at Workplaces); Report No. 326; Stress Research Institute, Stockholm University: Stockholm, Sweden, 2014; Available online: https://www.stressforskning.su.se/polopoly_fs/1.233343.1429705740!/menu/standard/file/rapport%20326.pdf (accessed on 27 April 2020).
  9. Berthelsen, H.; Lönnblad, A.; Hakanen, J.; Kristensen, T.S.; Axtelius, B.; Bjørner, J.B.; Westerlund, H. Cognitive interviewing used in the development and validation of Copenhagen Psychosocial Questionnaire in Sweden. In Conference Paper Presented at the Nordic Work Life Conference Threats and Possibilities Facing Nordic Working Life—Stream 26 Methodological Challenges for Working Life and Labour Market Studies; Gothenburg University: Gothenburg, Sweden, 2014; pp. 232–233. Available online: https://mau.diva-portal.org/smash/get/diva2:1420205/FULLTEXT01.pdf (accessed on 27 April 2020).
  10. Berthelsen, H.; Hakanen, J.; Kristensen, T.; Lönnblad, A.; Westerlund, H. A qualitative study on the content validity of the social capital scales in the Copenhagen Psychosocial Questionnaire (COPSOQ II). Scand. J. Work Org. Psychol. 2016, 1, 5. [Google Scholar] [CrossRef] [Green Version]
  11. Berthelsen, H.; Hakanen, J.J.; Westerlund, H. Copenhagen Psychosocial Questionnaire—A validation study using the job demand-resources model. PLoS ONE 2018, 13, e0196450. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Wentz, K.; Gyllensten, K.; Sluiter, J.K.; Hagberg, M. Need for recovery in relation to effort from work and health in four occupations. Int. Arch. Occup. Environ. Health 2019, 92, 243–259. [Google Scholar] [CrossRef] [Green Version]
  13. Geisler, M.; Berthelsen, H.; Muhonen, T. Retaining social workers: The role of quality of work and psychosocial safety climate for work engagement, job satisfaction, and organizational commitment. Hum. Serv. Organ. Manag. Leadersh. Gov. 2019, 43, 1–15. [Google Scholar] [CrossRef] [Green Version]
  14. Muhonen, T.; Jönsson, S.; Bäckström, M. Consequences of cyberbullying behaviour in Working Life: The mediating roles of social support and social organisational climate. Int. J. Workplace Health Manag. 2017, 10, 376–390. [Google Scholar] [CrossRef] [Green Version]
  15. Anskär, E.; Lindberg, M.; Falk, M.; Andersson, A. Legitimacy of work tasks, psychosocial work environment, and time utilization among primary care staff in Sweden. Scand. J. Prim. Health Care 2019, 37, 476–483. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Berthelsen, H.; Muhonen, T.; Toivanen, S. What happens to the physical and psychosocial work environment when activity-based offices are introduced into academia? J. Corp. Real Estate 2018, 20, 230–243. [Google Scholar] [CrossRef]
  17. Geisler, M.; Berthelsen, H.; Hakanen, J.J. No job demand is an Island-Interaction effects between emotional demands and other types of job demands. Front. Psychol. 2019, 10, 873. [Google Scholar] [CrossRef] [PubMed]
  18. Holm, K.; Torkelson, E.; Bäckström, M. Models of workplace incivility: The relationships to instigated incivility and negative outcomes. Bioed. Res. Int. 2015, 2015, 920239. [Google Scholar] [CrossRef] [Green Version]
  19. Melin, M.; Lager, E.; Lindfors, P. High-Flying Risks—Variations in Working Conditions, Health, and Safety Behaviors Among Commercial Airline PILOTS in Relation to Safety Climate; Arbete och Hälsa; Scientific Serial No. 2018,52; Unit for Occupational and Environmental Medicine, University of Gothenburg: Gothernburg, Sweden, 2018; Available online: https://gupea.ub.gu.se/bitstream/2077/55085/4/gupea_2077_55085_4.pdf (accessed on 27 April 2020).
  20. Anskär, E.; Lindberg, M.; Falk, M.; Andersson, A. Time utilization and perceived psychosocial work environment among staff in Swedish primary care settings. BMC Health Serv. Res. 2018, 18, 166. [Google Scholar] [CrossRef]
  21. Nyqvist, E.; Arnrup, K.; Berthelsen, H. Belastningssymtom och sviktande arbetsförmåga—En utmaning för tandvården (Strain symptoms and work ability—A challenge for the public dental health service). Tandläkartidningen 2016, 14, 54–61. [Google Scholar]
  22. Berthelsen, H.; Westerlund, H.; Hakanen, J.J.; Kristensen, T.S. It is not just about occupation, but also about where you work. Commun. Dent. Oral Epidemiol. 2017, 45, 372–379. [Google Scholar] [CrossRef] [Green Version]
  23. Berthelsen, H.; Conway, P.M.; Clausen, T. Is organizational justice climate at the workplace associated with individual-level quality of care and organizational affective commitment? A multi-level, cross-sectional study on dentistry in Sweden. Int. Arch. Occup. Environ. Health 2018, 91, 237–245. [Google Scholar] [CrossRef] [Green Version]
  24. Björk, L.; Glise, K.; Pousette, A.; Bertilsson, M.; Holmgren, K. Involving the employer to enhance return to work among patients with stress-related mental disorders—Study protocol of a cluster randomized controlled trial in Swedish primary health care. BMC Pub. Health 2018, 18, 838. [Google Scholar] [CrossRef] [Green Version]
  25. Brämberg, E.B.; Holmgren, K.; Bültmann, U.; Gyllensten, H.; Hagberg, J.; Sandman, L.; Bergström, G. Increasing return-to-work among people on sick leave due to common mental disorders: Design of a cluster-randomized controlled trial of a problem-solving intervention versus care-as-usual conducted in the Swedish primary health care system (PROSA). BMC Pub. Health 2018, 18, 889. [Google Scholar] [CrossRef]
  26. Haapakangas, A.; Hallman, D.M.; Mathiassen, S.E.; Jahncke, H. The effects of moving into an activity-based office on communication, social relations and work demands–A controlled intervention with repeated follow-up. J. Environ. Psychol. 2019, 66, 101341. [Google Scholar] [CrossRef]
  27. Kaltenbrunner, M.; Bengtsson, L.; Mathiassen, S.E.; Högberg, H.; Engström, M. Staff perception of Lean, care-giving, thriving and exhaustion: A longitudinal study in primary care. BMC Health Serv. Res. 2019, 19, 652. [Google Scholar] [CrossRef] [PubMed]
  28. Richter, A.; von Thiele Schwarz, U.; Lornudd, C.; Lundmark, R.; Mosson, R.; Hasson, H. iLead—A transformational leadership intervention to train healthcare managers’ implementation leadership. Implement. Sci. 2015, 11, 108. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Boström, M.; Björklund, C.; Bergström, G.; Nybergh, L.; Schäfer Elinder, L.; Stigmar, K.; Wåhlin, C.; Jensen, I.; Kwak, L. Health and work environment among female and male Swedish elementary school teachers—A cross-sectional study. Int. J. Environ. Health Res. 2020, 17, 227. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Şahan, C.; Baydur, H.; Demiral, Y. A novel version of Copenhagen Psychosocial Questionnaire-3: Turkish validation study. Arch. Environ. Occ. Health 2018, 74, 297–309. [Google Scholar] [CrossRef] [PubMed]
  31. Ramkissoon, A.; Smith, P.; Oudyk, J. Dissecting the effect of workplace exposures on workers’ rating of psychological health and safety. Am. J. Ind. Med. 2019, 62, 412–421. [Google Scholar] [CrossRef] [PubMed]
  32. Berthelsen, H.; Westerlund, H.; Pejtersen, J.H.; Hadzibajramovic, E. Construct validity of a global scale for workplace social capital based on COPSOQ III. PLoS ONE 2019, 14, e0221893. [Google Scholar] [CrossRef] [Green Version]
  33. Bliese, P.D.; Jex, S.M. Incorporating multiple levels of analysis into occupational stress research. Work Stress 1999, 13, 1–6. [Google Scholar] [CrossRef]
  34. Moncada, S.; Utzet, M.; Molinero, E.; Llorens, C.; Moreno, N.; Galtes, A.; Navarro, A. The Copenhagen Psychosocial Questionnaire II (COPSOQ II) in Spain—A tool for psychosocial risk assessment at the workplace. Am. J. Ind. Med. 2014, 57, 97–107. [Google Scholar] [CrossRef]
  35. Bliese, P.D.; Maltarich, M.A.; Hendricks, J.L.; Hofmann, D.A.; Adler, A.B. Improving the measurement of group-level constructs by optimizing between-group differentiation. J. Appl. Psychol. 2019, 104, 293–302. [Google Scholar] [CrossRef]
  36. Eisinga, R.; Te Grotenhuis, M.; Pelzer, B. The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? Int. J. Pub. Health 2013, 58, 637–642. [Google Scholar] [CrossRef] [PubMed]
  37. Terwee, C.B.; Bot, S.D.; de Boer, M.R.; van der Windt, D.A.; Knol, D.L.; Dekker, J.; Bouter, L.M.; de Vet, H.C. Quality criteria were proposed for measurement properties of health status questionnaires. J. Clin. Epidemiol. 2007, 60, 34–42. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Routledge: Hillsdale, NJ, USA, 1988. [Google Scholar]
  39. Pejtersen, J.H.; Bjorner, J.B.; Hasle, P. Determining minimally important score differences in scales of the Copenhagen Psychosocial Questionnaire. Scand. J. Pub. Health 2010, 38, 33–41. [Google Scholar] [CrossRef] [PubMed]
  40. Bliese, P.D. Group size, ICC values, and group-level correlations: A simulation. Organ. Res. Methods 1998, 1, 355–373. [Google Scholar] [CrossRef]
  41. Bliese, P.D. Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In Multilevel Theory, Research, and Methods in Organizations; Klein, K.J., Kozlowski, S.W., Eds.; Jossey-Bass: San Francisco, CA, USA, 2000; pp. 349–381. [Google Scholar]
  42. LeBreton, J.M.; Senter, J.L. Answers to 20 questions about interrater reliability and interrater agreement. Org. Res. Met. 2008, 11, 815–852. [Google Scholar] [CrossRef]
  43. Koo, T.K.; Li, M.Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Eurofound. Sixth European Working Conditions Survey—Overview Report; Publications Office of the European Union: Luxembourg, 2017; Available online: https://www.eurofound.europa.eu/publications/report/2016/working-conditions/sixth-european-working-conditions-survey-overview-report (accessed on 27 April 2020).
  45. World Bank. Employment in services (% of Total Employment) (Modeled ILO Estimate); World Bank: Washington, DC, USA, 2019; Available online: https://data.worldbank.org/indicator/SL.SRV.EMPL.ZS (accessed on 18 December 2019).
  46. Lämsä, T. Leadership styles and decision-making in Finnish and Swedish organizations. Rev. Int. Comp. Manag. 2010, 11, 139–149. [Google Scholar]
  47. Kristensen, T.S. A questionnaire is more than a questionnaire. Scand. J. Pub. Health 2010, 38, 149–155. [Google Scholar] [CrossRef] [Green Version]
  48. Nübling, M.; Vomstein, M.; Haug, A.; Lincke, H. Können psychosoziale Arbeitsbelastungen in einer job-exposure-matrix abgeschätzt werden? Das Gesundheitswesen 2017, 79, V231. [Google Scholar]
  49. Nübling, M.; Vomstein, M.; Haug, A.; Lincke, H.-J. Sind referenzdaten der COPSOQ-datenbank für eine JEM zu psychosozialen Arbeitsfaktoren geeignet? Zentralblatt für Arbeitsmedizin Arbeitsschutz und Ergonomie 2017, 67, 151–154. [Google Scholar] [CrossRef] [Green Version]
  50. Huang, F.L. Multilevel modeling myths. Sch. Psychol. Q. 2018, 33, 492. [Google Scholar] [CrossRef] [PubMed]
  51. Probst, T.M.; Jiang, L. European flexicurity policies: Multilevel effects on employee psychosocial reactions to job insecurity. Saf. Sci. 2017, 100, 83–90. [Google Scholar] [CrossRef]
  52. Ostroff, C. Comparing correlations based on individual-level and aggregated data. J. Appl. Psychol. 1993, 78, 569. [Google Scholar] [CrossRef]
  53. Judge, T.A.; Erez, A.; Thoresen, C.J. Why negative affectivity (and self-deception) should be included in job stress research: Bathing the baby with the bath water. J. Org. Behav. 2000, 21, 101–111. [Google Scholar] [CrossRef]
  54. Dollard, M.; Dorman, C.; Idris, M. Psychosocial Safety Climate: A New Work Stress Theory; Springer: Amsterdam, The Netherlands, 2019. [Google Scholar]
  55. Dollard, M.F.; Bakker, A.B. Psychosocial Safety Climate as a precursor to conducive work environments, psychological health problems, and employee engagement. J. Occ. Org. Psychol. 2010, 83, 579–599. [Google Scholar] [CrossRef] [Green Version]
  56. Potter, R.; O’Keeffe, V.; Leka, S.; Webber, M.; Dollard, M. Analytical review of the Australian policy context for work-related psychological health and psychosocial risks. Saf. Sci. 2019, 111, 37–48. [Google Scholar] [CrossRef]
Ijerph 17 03179 g001 550
Figure 1. The selection process for the national random sample study. Inclusion criteria were 25–65-year-old workers living in Sweden, gainfully employed during the last 3 months before the survey and having a superior/colleagues.
Figure 1. The selection process for the national random sample study. Inclusion criteria were 25–65-year-old workers living in Sweden, gainfully employed during the last 3 months before the survey and having a superior/colleagues.
Ijerph 17 03179 g001
Table
Table 1. Description of respondents based on a random sample of inhabitants in Sweden aged 25–65 years, gainfully employed (N = 2847).
Table 1. Description of respondents based on a random sample of inhabitants in Sweden aged 25–65 years, gainfully employed (N = 2847).
DimensionGroup% of Sample
SexMen43.9
Women56.1
Age, mean (SD) 47.7 (10.8) years
Age distribution25–39 years25.1
40–54 years42.9
55–65 years32.0
Occupational group0. Armed Forces Occupations0.20
1. Managers7.80
2. Professionals34.7
3. Technicians and Associate Professionals14.8
4. Clerical Support Workers7.70
5. Services and Support Workers16.9
6. Skilled Agricultural. Forestry and Fishery Workers0.70
7. Craft and Related Trades Workers5.90
8. Plant and Machine Operators and Assemblers5.30
9. Elementary Occupations3.10
Not classified2.90
Educational levelPrimary education5.10
Secondary education45.5
Tertiary education49.5
Income levelUp to 300,000 Sek25.9
300,001–400,000 Sek31.6
More than 400,000 Sek 42.5
Region of birthA Scandinavian country90.8
Other countries9.20
SectorPrivate47.1
Public44.7
Other5.60
Not stated2.60
Weekly work hours <213.90
21–305.40
31–4055.1
41–5030.7
>502.80
not stated2.10
Work situationHave direct contact with patients. customers, clients, pupils etc. at work81.1
Non-managerial position66.8
Normal work timeDay hours between 6–18 o’clock 78.5
Size of local workplace (span of nearest leader)<5 people14.3
5–10 people22.4
11–20 people25.1
21–40 people22.5
41–60 people6.90
>60 people5.20
Do not know/not stated3.60
Table
Table 2. For the Swedish standard version of COPSOQ III for 25–65-year-old workers in Sweden: Benchmarks with standard deviations (SD) and frequency of conflicts and offensive behaviours (based on weighted data) and scale characteristics (number of items, reliability coefficient, floor, ceiling and scale missing percentages, based on raw data).
Table 2. For the Swedish standard version of COPSOQ III for 25–65-year-old workers in Sweden: Benchmarks with standard deviations (SD) and frequency of conflicts and offensive behaviours (based on weighted data) and scale characteristics (number of items, reliability coefficient, floor, ceiling and scale missing percentages, based on raw data).
Population BenchmarksScale Characteristics
Dimension and AbbreviationMeanSDNo. of ItemsReliability Coefficient 1Floor %Ceiling %Scale Missing %
Quantitative Demands QD40.922.130.854.91.11.2
Work PaceWP59.920.520.700.64.90.9
Emotional DemandsED46.825.530.863.91.51.1
InfluenceIN50.220.140.750.90.61.1
Possibilities for DevelopmentPD70.420.030.750.410.10.4
Variation of Work VA68.022.51 1.916.71.1
Meaning of WorkMW78.322.41 0.940.61.6
PredictabilityPR60.221.320.731.55.31.1
RecognitionRE65.623.320.742.011.21.1
Role ClarityCL78.116.730.780.016.10.2
Role Conflicts CO42.219.630.712.00.50.6
(incl. illegitimate tasks)
Quality of Leadership QL54.124.830.874.64.80.9
Social Support from Supervisor SS75.324.520.881.830.30.4
Social Support from Colleagues SC80.219.620.810.432.50.4
Sense of Community at WorkSW79.915.030.780.117.70.4
Commitment to the WorkplaceCW64.724.530.831.19.81.2
Work Engagement WE69.419.230.840.45.40.9
Job InsecurityJI20.220.930.7534.80.41.1
Insecurity over Working ConditionsIW24.923.220.7728.11.41.1
Quality of WorkQW68.218.620.690.66.60.4
Job SatisfactionJS64.420.240.840.75.20.8
Work Life Conflict WF39.725.730.909.53.60.6
Horizontal TrustTE71.320.11 1.217.61.4
Vertical TrustTM69.319.030.770.47.00.9
Organizational JusticeJU59.720.230.780.83.50.9
Self-Rated HealthGH61.323.91 2.612.81.0
StressST36.024.230.8611.21.31.2
BurnoutBO36.224.730.8810.21.41.0
Threats of ViolenceTV10.5% 1 1.1
Physical ViolencePV5.3% 1 1.4
BullyingBU10.3% 1 1.4
Sexual HarassmentSH6.0% 1 1.2
Cyber BullyingHSM2.7% 1 1.2
1 Cronbach’s alpha for scales with 3 or more items and Spearman-Brown Coefficient for two-item scales.
Table
Table 3. Scale mean scores and frequency of conflicts and offensive behaviours according to sex, work sector and white/blue-collar work for the Swedish standard version of COPSOQ III for 25–65-year-old workers in Sweden. Differences between groups tested with t-tests, Chi2 tests 1 and Cohen’s d.
Table 3. Scale mean scores and frequency of conflicts and offensive behaviours according to sex, work sector and white/blue-collar work for the Swedish standard version of COPSOQ III for 25–65-year-old workers in Sweden. Differences between groups tested with t-tests, Chi2 tests 1 and Cohen’s d.
Dimension 2SexWork SectorKind of Work
Men
(n = 1250)		Women
(n = 1597)		pCohen’s dPrivate Sector
(n = 1341)		Public Sector
(n = 1271)		pCohen’s dWhite Collar
(n = 1630)		Blue Collar
(n = 428)		pCohen’s d
QD 41.243.2*0.140.644.3**0.247.733.0**0.7
WP 57.860.9**0.259.759.6 0.060.158.0 0.1
ED 39.454.1**0.638.557.1**0.849.933.2**0.7
IN53.948.6**0.352.449.2**0.254.646.1**0.5
PD70.271.7*0.170.072.5**0.175.462.6**0.7
VA67.771.3**0.267.971.8**0.274.159.6**0.7
MW76.082.2**0.374.584.9**0.581.870.5**0.6
PR 60.360.9 0.060.461.2 0.061.658.0*0.2
RE 66.964.9*0.166.665.0 0.167.862.5**0.2
CL76.878.9**0.177.778.7 0.176.579.6**0.2
CO 42.541.3 0.140.143.9**0.243.039.8*0.2
QL 54.054.1 0.054.353.8 0.054.951.6*0.1
SS 75.275.0 0.076.673.3**0.175.872.1*0.2
SC 79.281.3*0.179.981.0 0.181.477.0**0.2
SW 80.180.0 0.081.179.1**0.180.679.1 0.1
CW 65.665.2 0.065.865.0 0.066.962.4**0.2
WE68.371.9**0.269.071.5**0.171.865.0**0.4
JI 20.317.8**0.121.714.9**0.315.226.3**0.6
IW23.924.5 0.023.824.7 0.022.626.2*0.2
QW68.567.4 0.169.466.2**0.267.669.9*0.1
JS65.364.8 0.065.864.5 0.167.261.6**0.3
WF37.541.7**0.238.241.6**0.142.035.9**0.2
TE 72.570.7*0.172.370.5*0.173.568.3**0.3
TM 68.570.2*0.169.969.3 0.070.666.5**0.2
JU 60.658.5*0.161.057.8**0.260.657.9*0.1
GH63.260.6*0.163.360.2**0.163.958.2**0.2
ST32.637.7**0.233.936.9*0.136.831.7**0.2
BO31.238.1**0.332.937.4**0.234.433.9 0.0
TV 8.1%12.5%** 5.3%16.4%** 9.6%6.9%
PV2.7%7.5%** 1.7%9.4%** 4.2%1.4%*
BU8.4%11.8%* 9.1%11.4%* 9.0%10.1%
SH2.4%6.8%** 4.5%5.1% 4.2%4.0%
HSM2.8%2.8% 1.7%3.8%** 3.3%1.4%*
1 * p < 0.05 level, ** p < 0.001 level. 2 Abbreviations of dimensions explained in Table 2.
Table
Table 4. Mean scale scores and standard deviation and frequency of conflicts and offensive behaviours according to occupational groups for the Swedish Standard version of COPSOQ III (aged 25–65 years, weighted within ISCO major occupational groups). Reliability Coefficients 2(RC) based on unweighted data.
Table 4. Mean scale scores and standard deviation and frequency of conflicts and offensive behaviours according to occupational groups for the Swedish Standard version of COPSOQ III (aged 25–65 years, weighted within ISCO major occupational groups). Reliability Coefficients 2(RC) based on unweighted data.
Dimension 1ISCO 1
Managers		ISCO 2
Professionals		ISCO 3
Technicians and Associate Professionals		ISCO 4
Clerical Support Workers		ISCO 5
Services and Support Workers		ISCO 7
Craft and Related Trades Workers		ISCO 8
Plant and Machine Operators and Assemblers		ISCO 9
Elementary Occupations
MeanSDRCMeanSDRCMeanSDRCMeanSDRCMeanSDRCMeanSDRCMeanSDRCMeanSDRC
QD51.519.80.8648.520.00.8243.820.40.8439.721.60.8334.522.10.8536.020.30.8332.019.60.8227.820.20.80
WP63.318.00.6860.518.70.7057.618.70.7157.120.30.7260.021.90.7658.118.40.6259.021.50.7458.623.20.46
ED53.720.60.8253.125.50.8740.323.10.8237.424.20.8559.522.80.8231.418.40.7834.721.00.7734.422.50.72
IN62.117.00.7453.817.50.7352.817.60.7143.720.20.7745.220.10.7349.518.80.7241.022.40.8345.821.60.75
PD79.315.70.7276.317.10.7371.118.10.7462.821.90.7767.419.10.7266.219.20.6958.522.40.7461.421.50.72
VA79.415.3 74.818.0 69.918.6-62.323.3-67.022.8-66.720.9-53.927.5-54.727.3-
MW83.316.0 83.618.9 76.919.7-72.725.1-83.520.2-71.223.5-67.724.7-72.725.0-
PR68.419.10.6660.819.80.7260.020.00.7058.420.40.6961.321.20.7656.220.40.7557.124.00.8162.123.80.73
RE73.219.20.6866.921.60.7066.922.10.7362.123.80.7963.324.40.7762.922.40.6960.625.50.7863.124.70.66
CL78.715.20.7776.017.00.7976.417.30.8177.416.10.7482.814.30.7677.316.60.7980.714.30.6481.917.30.77
CO41.916.20.6143.919.10.7141.319.10.7237.418.50.6542.120.00.7040.717.50.6540.622.90.8237.721.20.64
QL57.722.10.8454.322.90.8455.025.20.8752.426.10.8854.025.90.9048.724.30.8650.425.70.8758.124.90.88
SS77.720.90.8175.223.50.8876.024.60.8976.723.50.8575.124.90.8971.425.50.8270.327.70.8973.327.00.95
SC79.69.9.20.7681.818.30.8281.618.00.7978.419.50.7980.819.10.8379.518.20.8174.523.30.8375.922.90.81
SW82.312.80.7680.114.00.7681.114.50.7978.316.00.8079.715.20.8080.313.00.7476.317.80.8381.216.40.77
CW73.322.10.8565.722.90.8266.523.80.8362.825.70.8463.725.40.8362.821.80.7660.824.70.8262.225.40.81
WE75.216.60.8671.816.80.8269.918.00.8567.020.10.8271.418.70.8464.319.70.8564.121.70.8566.521.40.87
JI17.218.60.7912.716.70.7320.019.70.7127.321.50.7320.822.40.7321.020.00.7129.324.00.7631.524.40.74
IW19.821.50.8522.621.50.7524.022.90.8025.522.60.7827.524.10.7122.421.40.8129.826.30.8229.726.60.81
QW70.114.90.6466.617.50.6868.518.40.7266.619.50.7467.219.30.6969.016.60.7469.518.90.6471.619.30.63
JS72.718.00.8466.618.90.8165.619.00.8462.020.20.8561.820.60.8662.917.10.8360.421.20.9160.421.10.88
WF44.524.70.9243.724.90.9036.723.80.9036.524.60.9038.327.40.9135.323.70.8839.727.00.9032.025.70.89
TE72.318.0-73.317.7-74.418.9-67.020.9-69.220.4-68.919.2-67.024.5-70.120.7-
TM74.814.70.7470.218.00.7769.419.00.8167.518.50.7769.018.50.7263.918.80.7465.820.60.7970.519.10.64
JU67.515.30.7459.317.80.7460.119.10.7955.121.10.7958.521.40.7955.820.00.7857.722.90.8460.222.60.78
GH67.422.1-62.322.9-65.723.0-59.524.4-57.524.6-59.523.0-56.425.1-59.825.5-
ST36.820.90.8138.324.00.8733.224.40.8735.023.70.8634.825.40.8731.422.60.8432.024.30.8733.324.60.81
BO29.520.30.8337.023.40.8730.723.70.8735.125.00.8939.126.20.9031.622.40.8534.925.90.9136.926.00.88
TV8.2% 10.5% 8.2% 8.2% 18.9% 2.4% 11.3% 8.1%
PV2.3% 5.0% 3.4% 2.3% 15.2% 0.0% 2.0% 3.6%
BU5.0% 9.6% 9.6% 14.2% 12.5% 9.6% 8.8% 14.5%
SH1.4% 4.6% 4.8% 2.3% 9.3% 3.0% 3.3% 8.2%
HSM6.4% 3.5% 1.2% 4.1% 2.1% 1.2% 1.3% 2.4%
1 Abbreviations of dimensions explained in Table 2. 2 Cronbach’s alpha for scales with 3 or more items and Spearman-Brown Coefficient for two-item scales.
Table
Table 5. Pearson correlations between scales for the Swedish Standard version of COPSOQ III (national sample of 25–65-year-old employees).
Table 5. Pearson correlations between scales for the Swedish Standard version of COPSOQ III (national sample of 25–65-year-old employees).
Dimension 1QDWPEDINPDVAMWPRRECLCOQLSSSCSWCWWEJIIWQWJSWFTETMJUGHSTBO
QD1.00
WP0.401.00
ED0.290.321.00
IN−0.03−0.11−0.091.00
PD0.060.020.050.511.00
VA0.130.020.120.370.501.00
MW−0.020.030.210.270.500.361.00
PR−0.21−0.15−0.130.390.430.200.341.00
RE−0.19−0.15−0.160.480.490.270.350.671.00
CL-0.260.04−0.010.180.320.100.410.460.381.00
CO0.410.300.36−0.22−0.20−0.10−0.22−0.44−0.41−0.321.00
QL−0.18−0.12−0.120.350.420.200.290.620.640.35−0.381.00
SS−0.19−0.15−0.170.380.410.200.250.550.620.35−0.360.671.00
SC−0.15−0.15−0.100.320.390.230.290.400.430.31−0.290.380.581.00
SW−0.18−0.09−0.160.360.390.220.280.450.510.37−0.330.420.480.621.00
CW−0.24−0.19−0.170.460.540.320.470.650.720.41−0.500.620.560.460.541.00
WE−0.050.070.100.360.540.350.550.430.440.39−0.270.390.310.280.370.581.00
JI−0.010.03−0.09−0.18−0.32−0.26−0.28−0.20−0.26−0.170.12−0.15−0.17−0.23−0.22−0.27−0.211.00
IW0.170.120.15−0.28−0.31−0.21−0.24−0.38−0.42−0.270.33−0.29−0.31−0.26−0.31−0.41−0.260.551.00
QW−0.34−0.20−0.230.360.410.190.350.580.570.45−0.490.540.490.410.490.670.43−0.16−0.331.00
JS−0.16−0.14−0.130.480.630.370.450.570.630.38−0.430.550.490.430.480.730.56−0.30−0.410.591.00
WF0.490.420.36−0.21−0.15−0.05−0.14−0.37−0.39−0.270.45−0.32−0.34−0.32−0.34−0.48−0.220.170.36−0.43−0.381.00
TE−0.13−0.13−0.150.250.270.170.230.320.410.24−0.280.340.330.450.510.410.22−0.20−0.250.420.35−0.261.00
TM−0.18−0.15−0.150.380.430.240.350.610.650.40−0.440.600.570.460.520.640.40−0.24−0.390.610.58−0.350.531.00
JU−0.22−0.18−0.180.450.460.230.320.650.740.38−0.420.710.600.450.510.680.41−0.18−0.360.640.62−0.380.480.761.00
GH−0.13−0.11−0.150.220.250.150.170.260.290.17−0.200.230.210.230.290.320.30−0.18−0.250.270.35−0.350.230.240.271.00
ST0.400.340.33−0.22−0.18−0.10−0.16−0.35−0.38−0.260.43−0.32−0.31−0.31−0.35−0.48−0.270.170.32−0.41−0.380.66−0.26−0.33−0.37−0.411.00
BO0.340.300.34−0.29−0.26−0.17−0.20−0.39−0.42−0.250.44−0.34−0.33−0.31−0.35−0.51−0.340.210.37−0.42−0.460.66−0.26−0.35−0.40−0.500.791.00
≥0.04 are statistically significant, p < 0.05; ≥0.05 are statistically significant, p < 0.01; ≥0.06 are statistically significant, p < 0.001. 1 Abbreviations of dimensions explained in Table 2.
Table
Table 6. Pearson bivariate intercorrelations between scales in the Swedish Standard version of COPSOQ III based on data from 51 organizations. Correlations at the organizational level are presented in the lower left part of the table and correlations at the individual level in the upper right part.
Table 6. Pearson bivariate intercorrelations between scales in the Swedish Standard version of COPSOQ III based on data from 51 organizations. Correlations at the organizational level are presented in the lower left part of the table and correlations at the individual level in the upper right part.
Dimension 1QDWPEDINPDVAMWPRRECLCOQLSSSCSWCWWEJIIWQWJSWFTETMJUGHSTBO
QD 0.480.37−0.12−0.100.01−0.09−0.28−0.21−0.270.40−0.23−0.23−0.19−0.18−0.28−0.120.010.21−0.31−0.280.43−0.10−0.22−0.27−0.240.410.39
WP0.53 0.34−0.21−0.12−0.06−0.09−0.26−0.23−0.110.38−0.20−0.21−0.15−0.12−0.29−0.01−0.030.17−0.22−0.250.38−0.09−0.25−0.27−0.130.370.34
ED0.460.30 −0.04−0.010.090.02−0.20−0.16−0.150.34−0.19−0.16−0.14−0.16−0.23−0.01−0.050.19−0.20−0.200.37−0.13−0.20−0.24−0.220.370.37
IN0.08−0.370.04 0.600.490.450.460.540.23−0.330.480.440.400.390.540.38−0.22−0.340.340.53−0.270.300.480.530.26−0.29−0.32
PD0.31−0.110.250.78 0.550.610.500.580.30−0.350.520.460.440.440.600.53−0.26−0.350.420.68−0.280.380.520.540.28−0.33−0.34
VA0.37−0.190.390.700.73 0.480.240.350.11−0.210.290.270.270.300.390.40−0.20−0.200.260.41−0.110.260.320.310.19−0.21−0.23
MW0.15−0.210.490.640.740.75 0.380.460.37−0.350.380.350.370.360.490.59−0.24−0.240.390.55−0.240.290.410.400.26−0.30−0.31
PR−0.17−0.42−0.220.560.490.220.40 0.710.48−0.510.660.590.370.400.650.35−0.17−0.410.520.62−0.380.320.690.700.27−0.40−0.40
RE−0.08−0.35−0.030.790.690.480.600.80 0.41−0.450.670.650.480.480.720.44−0.26−0.440.510.67−0.370.410.730.780.33−0.41−0.42
CL−0.40−0.060.04−0.06−0.12−0.170.140.430.23 −0.350.410.370.310.340.380.31−0.16−0.310.440.43−0.300.190.370.410.20−0.30−0.27
CO0.390.570.35−0.54−0.44−0.27−0.38−0.75−0.64−0.23 −0.45−0.42−0.29−0.31−0.52−0.340.120.35−0.44−0.520.46−0.25−0.49−0.49−0.270.440.43
QL−0.12−0.33−0.100.580.600.290.380.790.720.23−0.64 0.790.410.390.630.36−0.13−0.380.480.60−0.300.350.650.710.28−0.35−0.37
SS−0.19−0.38−0.080.550.540.240.480.860.760.37−0.720.86 0.450.410.590.35−0.13−0.370.450.57−0.310.330.630.660.28−0.35−0.36
SC0.13−0.130.070.680.550.460.450.400.600.10−0.290.430.45 0.660.460.36−0.20−0.270.390.45−0.300.500.380.460.27−0.32−0.29
SW0.01−0.18−0.070.600.440.480.330.300.49−0.06−0.260.420.370.75 0.510.36−0.25−0.280.440.48−0.260.520.400.470.29−0.36−0.33
CW−0.09−0.36−0.130.750.680.520.510.820.850.26−0.690.810.770.580.59 0.50−0.21−0.410.540.76−0.430.400.690.710.34−0.49−0.51
WE0.10−0.110.360.520.610.640.830.300.490.18−0.330.350.420.490.390.46 −0.11−0.210.340.55−0.320.240.390.380.34−0.37−0.41
JI−0.53−0.44−0.34−0.38−0.48−0.48−0.38−0.01−0.310.03−0.200.040.08−0.43−0.34−0.24−0.31 0.55−0.14−0.230.16−0.23−0.22−0.19−0.250.200.22
IW0.010.010.29−0.52−0.42−0.21−0.17−0.49−0.56−0.260.41−0.33−0.33−0.46−0.36−0.61−0.100.56 −0.32−0.440.31−0.26−0.46−0.43−0.270.390.38
QW−0.17−0.29−0.080.640.540.420.490.730.790.44−0.700.640.710.670.550.790.44−0.28−0.60 0.56−0.350.380.550.550.31−0.40−0.38
JS−0.13−0.37−0.110.640.640.490.550.810.740.30−0.760.680.770.410.440.870.42−0.14−0.600.75 −0.480.390.650.660.41−0.52−0.53
WF0.310.410.51−0.42−0.21−0.03−0.14−0.50−0.49−0.030.59−0.33−0.55−0.34−0.32−0.46−0.240.000.44−0.48−0.65 −0.20−0.37−0.40−0.430.660.63
TE0.22−0.120.000.650.590.520.350.260.53−0.17−0.240.340.310.720.780.580.23−0.48−0.460.550.45−0.23 0.430.490.25−0.27−0.27
TM−0.17−0.37−0.160.660.600.350.490.890.900.33−0.740.760.830.440.360.850.35−0.19−0.600.750.85−0.570.42 0.810.30−0.40−0.41
JU−0.15−0.36−0.170.790.650.410.490.810.940.26−0.690.790.780.660.540.900.44−0.27−0.620.840.76−0.520.560.89 0.33−0.43−0.44
GH−0.170.04−0.290.240.190.110.210.320.380.23−0.330.240.340.240.320.410.48−0.25−0.560.390.47−0.540.170.450.39 −0.52−0.57
ST0.300.410.40−0.36−0.28−0.24−0.28−0.56−0.58−0.100.62−0.46−0.57−0.31−0.48−0.62−0.08−0.060.45−0.55−0.670.77−0.36−0.64−0.58−0.54 0.81
BO0.210.390.41−0.51−0.40−0.37−0.30−0.57−0.63−0.030.62−0.56−0.53−0.29−0.46−0.72−0.280.060.55−0.50−0.690.61−0.37−0.70−0.64−0.600.83
Individual level correlations ≥ 0.05 are statistically significant, p < 0.05; ≥0.07 are statistically significant, p < 0.01; ≥0.10 are statistically significant, p < 0.001. Organizational level correlations ≥ 0.29 are statistically significant, p < 0.05; ≥0.38 are statistically significant, p < 0.01; ≥0.44 are statistically significant, p < 0.001. 1 Abbreviations of dimensions explained in Table 2.
Table
Table 7. Intraclass correlation coefficients (ICC(1) and ICC(2) *) for aggregation to occupational major group and for aggregation to organizational level (51 workplace surveys). For the workplace sample scale score: Mean and standard deviation, minimum, maximum, range and difference between the mean in the Workplace Survey compared to the weighted mean in the National Survey.
Table 7. Intraclass correlation coefficients (ICC(1) and ICC(2) *) for aggregation to occupational major group and for aggregation to organizational level (51 workplace surveys). For the workplace sample scale score: Mean and standard deviation, minimum, maximum, range and difference between the mean in the Workplace Survey compared to the weighted mean in the National Survey.
Dimension 1Aggregation to ISCO-Major Occupational GroupAggregation to Workplace Level
National SurveyWorkplace Surveys
ICC(1) 2ICC(2) 3ICC(1) 2ICC(2) 3MeanSDMinMaxRangeDifference to Benchmark 4
QD0.110.980.110.8243.39.319.660.741.22.4
WP0.000.620.130.8558.69.037.578.140.6−1.3
ED0.150.980.280.9345.714.022.080.258.2−1.1
IN0.090.970.120.8247.07.330.660.930.3−3.2
PD0.110.980.120.8363.19.139.578.138.6−7.3
VA0.110.980.160.8867.911.531.685.253.6−0.1
MW0.070.960.140.8578.68.852.490.638.30.3
PR0.020.850.140.8555.29.335.268.833.5−5.0
RE0.020.860.090.7960.18.641.377.436.2−5.5
CL0.030.900.060.6970.67.039.685.846.3−7.5
CO0.010.750.100.8040.77.729.260.231.1−1.5
QL0.010.660.130.8357.011.032.679.446.82.9
SS0.000.510.100.8076.89.957.493.836.41.5
SC0.010.760.050.6377.47.256.389.233.0−2.8
SW0.010.670.070.7377.56.756.788.632.0−2.4
CW0.010.820.170.8661.012.433.987.553.6−3.7
WE0.030.900.050.6370.76.558.381.723.31.3
JI0.080.970.120.8219.98.53.840.136.3−0.3
IW0.010.820.060.7025.58.310.645.034.40.6
QW0.000.560.090.7866.79.837.587.550.0−1.5
JS0.030.910.100.8164.67.443.377.634.40.2
WF0.020.900.060.6936.19.017.650.633.0−3.6
TE0.020.860.150.8668.110.537.587.550.0−3.2
TM0.020.850.250.9266.611.343.188.145.0−2.7
JU0.020.880.190.8956.010.732.575.242.7−3.7
GH0.020.870.020.3957.15.945.268.022.8−4.2
ST0.010.740.050.6533.07.715.851.535.7−3.0
BO0.020.860.050.6634.6 16.749.032.3−1.6
1 Abbreviations of dimensions explained in Table 2. 2 ICC(1) represents the amount of variance in the employees’ responses that can be explained by their membership of a group (occupational/workplace. 3 ICC(2) is an estimate of reliability of the aggregated group means. 4 Benchmark presented in Table 2.

Share and Cite

MDPI and ACS Style

Berthelsen, H.; Westerlund, H.; Bergström, G.; Burr, H. Validation of the Copenhagen Psychosocial Questionnaire Version III and Establishment of Benchmarks for Psychosocial Risk Management in Sweden. Int. J. Environ. Res. Public Health 2020, 17, 3179. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17093179

AMA Style

Berthelsen H, Westerlund H, Bergström G, Burr H. Validation of the Copenhagen Psychosocial Questionnaire Version III and Establishment of Benchmarks for Psychosocial Risk Management in Sweden. International Journal of Environmental Research and Public Health. 2020; 17(9):3179. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17093179

Chicago/Turabian Style

Berthelsen, Hanne, Hugo Westerlund, Gunnar Bergström, and Hermann Burr. 2020. "Validation of the Copenhagen Psychosocial Questionnaire Version III and Establishment of Benchmarks for Psychosocial Risk Management in Sweden" International Journal of Environmental Research and Public Health 17, no. 9: 3179. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17093179

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop