http://orcid.org/0000-0002-4573-4548
Figures
Abstract
Background and aim
Workplace Social Capital has been suggested as a useful concept when addressing organizational and social factors of the work environment. The overall aim of the present study is to establish and evaluate the construct validity of a measure of Workplace Social Capital based on the operationalization suggested in the third version of the Copenhagen Psychosocial questionnaire.
Methods
The present study is based on data collected as part of a validation and development project for the use of the Swedish version of COPSOQ at workplaces and includes responses from 1316 human service workers answering a workplace survey. Six items from scales for organizational justice, vertical trust and horizontal trust in COPSOQ III were included in the analyses. Rasch Analysis was used for scale validation.
Results
The analyses showed that the psychometric properties of the suggested COPSOQ scale for Workplace Social Capital were satisfactory after accommodation for local dependency. Each individual item worked as intended, the scale was unidimensional and functioned invariantly for women and men, and for younger and older employees. The scale was furthermore found to be valid for use for distinguishing groups, not individuals.
Citation: Berthelsen H, Westerlund H, Pejtersen JH, Hadzibajramovic E (2019) Construct validity of a global scale for Workplace Social Capital based on COPSOQ III. PLoS ONE 14(8): e0221893. https://doi.org/10.1371/journal.pone.0221893
Editor: Karl Bang Christensen, University of Copenhagen, DENMARK
Received: March 28, 2019; Accepted: August 16, 2019; Published: August 29, 2019
Copyright: © 2019 Berthelsen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This work was supported by the AFA-insurance,. Grant Dnr. 130301 and 170262 to HB, HW and the FORTE Swedish Research Council for Helath, Working Life and Welfare Grant:STYA-2016/0009 to HB. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
In this study we use modern test theory to evaluate the construct validity of a global scale for Workplace Social Capital, based on the operationalization introduced in the third version of the Copenhagen Psychosocial Questionnaire, COPSOQ III [1].
The Nordic labor markets are characterized by a high degree of unionization density and a tradition of employer and union collaboration on work environment issues [2]. Typically, workplaces in the Nordic countries employ participatory approaches and managerial support for a healthy work environment rather than a conflict culture [3] Work-related stress and health complaints remain an internationally unresolved issue [4]. This applies also to the Nordic context, even though stress is problematic from the perspective of both the individual and the organizations. In the National Swedish Work Environment Survey from 2015 half of the employees reported too high a work load and four out of ten found their work situation mentally distressing; these problems were most pronounced among human service workers [5]. In 2016, new provisions were introduced in Sweden in order to improve the handling of occupational safety and health at workplaces by means of a more holistic and comprehensive approach addressing the organizational and social work environment [6]. Another initiative was the establishment of the governmental “Trust Delegation” [7] with an overall aim of promoting trust-based organizational development in municipalities and projects, including the total governance process. This Swedish re-orientation is in line with the growing attention paid to addressing upstream factors of work life and including perspectives from positive occupational psychology in the Nordic countries in general [8]. However, according to Saksvik et al. there is a strong need for organizational-level social relations to be defined and measured as workplace norms [9]. In sum, this makes social capital an important concept to measure as a workplace characteristic rather than an individual characteristic.
Social capital was introduced in the social sciences in the mid-eighties, (see e.g. [10–12]). In his seminal work “Bowling alone” [13], Putnam reflects on American society and notes an erosion of social capital, understood as “features of social organization such as networks, norms, and social trust that facilitate coordination and cooperation for mutual benefit”. Putnam describes trends of declining social connectedness, civic engagement and civic trust in social life and wonders whether there is an equilibrium of social capital where it develops in other domains of everyday life, such as at workplaces. A decade later, at the beginning of the new millennium, Nordic work life researchers picked up the thread and introduced social capital as a useful concept in a workplace context (see for example [14–18]). Questionnaire items covering Workplace Social Capital were developed and in 2004–05 they were integrated in the Danish national work environment survey that led to establishment of the second version of the Copenhagen Psychosocial Questionnaire, COPSOQ II [19]. The items regarding Workplace Social Capital covered aspects of trust and justice and were inspired by researchers in the field, including colleagues from Finland [19–22]. The latest Danish Psychosocial Questionnaire has likewise included social capital [23]
Operationalization of Workplace Social Capital by the COPSOQ instrument
Workplace Social Capital has been operationalized based on COPSOQ II in a number of studies. In order to gain an overview we conducted a literature search, and identified 13 articles–published in international peer-reviewed journals–which have all operationalized social capital by COPSOQ II for analytical purposes. The search was conducted on June 1, 2018, using the string: “COPSOQ AND “social capital”” in Google Scholar. The search was replicated in PubMed and Scopus without yielding additional hits.
The overview presented in Table 1 reveals that the core of the measurement across studies is based on combinations of trust and justice items. The items belonging to the trust and justice scales were specifically designed to catch a broader perspective than the individuals’ own perspective [19]. The validity of measurement of Workplace Social Capital as a group construct was further corroborated by cognitive interview results [24]. One research group has chosen to replace the entire justice dimension with a scale for Rewards, which basically asks about the respondents’ individual perception of being recognized, respected and treated fairly at work rather than addressing work climate [9]. In addition to trust and justice, the scale for Community at work is frequently included, in particular the item SW2 addressing whether there is good cooperation between colleagues at work (Table 1). Additionally, three of the research groups have chosen to further include items from other scales or instruments. The majority of the articles (10 out of 13) were published during 2016–18, which can be seen as a further indication of a growing interest in including the construct in work life research. The third version of the COPSOQ instrument presents a domain for Workplace Social Capital, which includes the scales for Vertical Trust, Horizontal Trust and Organizational Justice [1]. The domain is in accordance with the core of previous operationalizations as presented here.
Workplace Social Capital is a latent construct meaning that it is not directly observable and therefore cannot be measured directly. A latent construct is measured through indicators (items) that represent the underlying construct. Consequently, it is more complicated to measure in a reliable and valid way than directly observable variables. Operationalization of latent constructs relies on theories and multi-item questionnaires are often used to capture the underlying construct which is considered to be the cause of the item responses.
Before it was launched, the COPSOQ II instrument was validated in a number of ways and presented in a theme issue of Scandinavian Journal of Public Health, 2010. In addition to classical test theory methods, modern test theory such as differential item functioning was also used, although not for the social capital scales [37]. In a note from 2011 Pejtersen, Björner and Hasle from the National Research Centre for the Working Environment, Denmark, reported results on psychometrics of measures of Workplace Social Capital based on the scales for Vertical Trust, Horizontal Trust, Justice and Respect and items regarding Organizational Citizenship Behaviour [38]. However, this work was not further developed for international publication. Consequently, the only validation study published on Workplace Social Capital operationalized by the COPSOQ instrument so far is the qualitative study corroborating the content validity of the items on trust and justice [24].
Usually, in multi-item questionnaires each item has a set of several mutually exclusive response options that can be classified as ordinal variables. Ordinal variables are numerically coded showing frequency, magnitude etc. so that responses can be ordered from lowest to highest. However, the distances between the response categories are unknown, thus these values do not have the mathematical properties needed for arithmetic calculations. Interval scales, on the other hand, ascribe hierarchy and denote numerical differences that reflect the differences between the objects. The intervals between each value on an interval scale are equal.
Once a questionnaire is constructed, the soundness of data the collected by means of questionnaires is judged by the measurement properties, i.e. validity and reliability. Validity refers to the ability of an instrument to measure what it is intended to measure, while reliability can be understood as accuracy or the extent to which repeated measurements lead to similar results.
A standard procedure for handling data from questionnaires is to construct a global score based on the item responses to represent a latent construct. Unidimensionality is a prerequisite for combining the items into a single global score. Calculating the mean values of the item responses is a very common procedure. However, due to the non-metric properties of ordinal data, this procedure should not be taken for granted. An important aspect of validation is the adequacy of the scaling of scores which can be done by modern psychometric techniques such as Rasch Analysis [39].
The aim of the present paper is to use Rasch Analysis to examine the internal construct validity of a global scale for Workplace Social Capital based on COPSOQ III items.
Material and methods
Study design and population
The present paper is based on cross-sectional data collected during the period from November 2016 to October 2017 as part of a validation and development project for the use of the COPSOQ instrument at workplaces. Workplaces were offered a free anonymous work environment survey through the Swedish COPSOQ webpage, based at Malmö University. All staff members at the workplaces received a link to an online questionnaire, in an email with an introduction from the workplace itself and information about the research project. Each survey was open 3–4 weeks and included two reminders. The overall response rate for the convenient sample of workplaces included in the present study was 83.4% (ranging from 63.5% to 95.0%).
For the purpose of the present study we considered data from 1426 employees from 10 public and private human service organizations. Inclusion criteria were non-managerial employees stating that they have direct contact with patients, clients, pupils etc. as part of their job and with a job title indicating human service work (e.g. social workers, dentists, physicians, nurses, psychologists, physiotherapists, teachers). Only employees with complete data on all variables included in the present study were considered for the analyses, which resulted in 1316 employees being available (211 men and 1105 women).
For evaluation of differential item functioning (DIF) in a Rasch Analysis (explained under data analyses), the groups compared should be of approximately equal size [40]. The rationale behind this recommendation is to ensure that if there is DIF, one group does not dominate in the estimates of parameters. Consequently, to achieve a balanced data set in terms of age, age was dichotomized into two groups: up to 44 years and 45 years or more. To obtain a balanced data set with respect to gender, all 211 men were included and 211 women were randomly sampled out of a total 1105 women with complete data.
Thus, in the present study 422 individuals were included. This sample size is large enough to give a high degree of precision, i.e. item location estimates within 0.3 logits with 99% confidence for the Rasch Analysis [41].
For the sample, 54% (229) of the employees were up to 44 years old and 46% (193) were 45 or older, and the vast majority of employees were professionals (based on the International Standard Classification of Occupations (ISCO) group 2).
Measures
Workplace Social Capital was measured by items from the scales for Vertical Trust, Horizontal Trust and Organizational Justice based on the international middle long version of the COPSOQ III (Table 2) [1]. All six items had the following response options: To a very small extent, To a small extent, Somewhat, To a large extent, To a very large extent. For analytical purposes each item was coded 0–25–50–75–100, following the standard COPSOQ scoring [1].
The items are based on three sub-scales, of which two deal with trust in work relations and one with organizational justice. Our a priori expectation was that this could be reflected in the dimensionality and in the mutual hierarchy of items. According to Holtz [42] and Colquitt and Rodell [43], the tradition in management research has been to regard trust as an outcome of justice, drawing on, for example, social exchange theory [44] or fairness heuristics theory [45]. However, such a simple causal order can be questioned, as argued by Shapiro and Kirkman, who introduced the principle of anticipatory justice [46]. Recent organizational and psychological experimental studies corroborate that trust can shape the expectations of justice [47, 48]. Based on this line of research our a priori expectation was that the item on mutual trust among employees (TE3) would be endorsed most easily, followed by the items regarding vertical trust (TM) and that the organizational justice items (JU) would be the highest ordered in the mutual hierarchy. This follows a reasoning that people can have a sense of whether relationships are characterized by trust independently of concrete experiences, while the COPSOQ III items regarding organizational justice ask more directly about the handling of potentially problematic situations.
The Rasch model and data analysis
We tested whether the data fitted the Rasch measuring model [39]. The model is applied in the development and evaluation of measurement properties of multi-item questionnaires. The purpose is to provide a global score that is a sufficient statistic for the latent construct that is being measured by the questionnaire. According to Rasch, latent constructs measured by the questionnaire (e.g. Workplace Social Capital) should have properties analogous with physical measurements, with positive real numbers defined as regularly as the measurement of height, and not through some arbitrary grading scale. In this way fundamental or objective measurement can be achieved. An important property of fundamental measurement is that it allows for arithmetic operations such as addition and subtraction. The Rasch model operationalizes the axioms of additive conjoint measurements, which are the requirements for the fundamental measurement construction [49–52]. The process of a Rasch Analysis is concerned with whether or not the data meets the model expectations. The adequacy of the fit is evaluated by means of multiple tests of summary fit statistics (overall fit to the model), individual item and person statistics, as well as graphical examinations of fit.
In the present study, the data were fitted to the Rasch measurement model using the unrestricted or partial credit model for polytomous cases, which allows the distances between thresholds to vary across the items [53, 54]. A threshold is the point between any two adjacent categories in which the probability of either response is equally likely. Data were fitted to the Rasch model using the RUMM2030 software [55]. Assumptions of unidimensionality, monotonicity, local dependence and differential item functioning (DIF) were tested, briefly explained below [56].
The overall fit to the model was evaluated by the item-trait interaction (χ2 statistic), and mean person and item fit residuals. The item-trait interaction statistic tests the property of invariance across the latent trait and a significant value indicates that the hierarchical ordering of the items varies across the latent continuum. The mean person and item fit residuals are expected to be close to zero with a standard deviation (SD) of one. A non-significant value of the χ2 statistic reflects the property of invariance across the trait. The invariance criterion implies that the items need to work in the same way (invariantly) across the whole continuum of the latent construct for all individuals. Given the same level of the latent trait (e.g. Workplace Social Capital), the scale should also function in the same way for all comparable groups (e.g. gender or age). This is commonly known as no differential item functioning (DIF). Monotonicity implies that the item responses are positively related to the latent variable. The response structure required by the Rasch model is a stochastically consistent item order, i.e. a probabilistic Guttman pattern [57]. This means that persons who experience higher levels of Workplace Social Capital are expected to get higher scores, whereas persons with lower levels of Workplace Social Capital are expected to get lower scores. The intended increasing level of Workplace Social Capital across the response categories for each item needs to be reflected in the observed data. The reliability of the scale is reported as a Person Separation Index (PSI), i.e. the proportion of true variance to true and error variance. Values of 0.7 and 0.9 are indicative of sufficient reliability for group and individual use respectively [58].
Local dependency (response and trait dependency) was investigated by residual correlations [59]. The trait dependency violated the assumption of unidimensionality, which was tested by Smith’s test of unidimensionality [60]. For this test, first principal component analysis (PCA) on residuals was performed. Then items loading positively and negatively on the first principal component of the residuals are used to make independent person estimates. Next, independent t-tests for the differences in these estimates for each persons were performed [60]. Less than 5% of such tests outside the range of –1.96 to 1.96 supports the unidimensionality of the scale. A 95% binomial confidence interval of proportions [61] was used to show that the lower limit of the observed proportion was below the 5% level [60]. Possible local dependency can be accounted for by combining correlated items into testlets where the items are added together and then comparing the model fit with that provided by the initial analysis [62].
Besides overall fit, individual item fit was evaluated by item’s χ2 statistic, the item’s ability to discriminate (item fit residuals expected to be within the range ±2.5), the appropriateness of the response categories (threshold ordering), response dependency relative to other items (residual correlations 0.2 above the average correlation) [63]) and the absence of DIF for gender and age. DIF was tested by conducting ANOVA of standardized residuals. The disordering of the thresholds was examined graphically by plotting category probability curves. Disordering of the thresholds was tested by the hybrid approach proposed by Salzberger [64].
Evaluation of the targeting, i.e. the distribution on a logit scale, of the items and persons in the sample was examined graphically by a person item threshold distribution graph. For a well-targeted instrument, the mean location for persons would be around the value of zero. In the event of good fit, Rasch person estimates, which are logits, can be transformed into a convenient range (henceforth referred to as metric score) [65].
Data is available from Appendices 1–2.
Results
The frequency distribution for each item is presented in Table 3. For all items, the majority of the responses were concentrated in the categories Somewhat and To a large extent, while the lowest response category (To a very small extent) was rarely used.
Initially, the Rasch Analysis was performed on all six Workplace Social Capital items. The summary fit statistics of the initial analysis are shown in Table 4, analysis 1. The fit to the model was good according to non-significant χ2 statistic. The PSI value was 0.83, which is above the predefined criterion of 0.7 valid for group comparisons. Item and person fit residual values were somewhat higher than the ideal values shown at the bottom of the table.
With respect to individual item fit, all items besides TM4 had item fit residual values within the predefined optimal range of ±2.5 and a non-significant chi-square statistic (Table 5). The fit residual value for item TM4 was –3.23, although this was not statistically significant (χ2 = 7.69, p = 0.26). In addition, item locations in hierarchical order are shown in Table 5.
No items showed DIF for gender or age. High residual correlations were not observed for any pair of the items.
Two items (TM4 and JU1) had disordered thresholds, i.e. indicating that it may be difficult for respondents to distinguish between response categories. As seen in Fig 1, showing category probability curves for item TM4, disordering was observed for the first two thresholds. The same pattern was observed for JU1. Disordering of the thresholds was not significant according to Salzberger’s hybrid approach. To rule out the possibility of disordering due to the few observations in the lowest response categories, an additional sensitivity analysis was performed by rerunning the analysis on the original sample of 1316 participants. In that analysis, TM4 and JU1 had ordered thresholds (results not shown).
Category probability curves for item TM4 with response options: To a very small extent, to a small extent, somewhat, to a large extent, to a very large extent.
The PCA conducted on item residuals revealed that the three TM items loaded positively on the first principal component, while the reverse was true for the items TE3, JU1 and JU4. These two groups of items were then used to perform Smith’s test of unidimensionality, which revealed problems with local dependency as the lower CI was 6.4% (Table 4, analysis 1). An attempt to resolve this issue was done by performing an additional analysis by combining the positively and negatively loaded items into two testlets (Table 4, analysis 2). As seen by the summary fit statistics, fit to the Rasch model was achieved. Accounting for local dependency by testlets resulted in a decreased PSI value (0.78 compared to 0.83). Additional sensitivity analysis was done by performing the Rasch Analysis on the entire sample (n = 1316) and the results were similar. The summary fit table for this analysis is found in Appendix 3.
The distribution of the items and persons along the common logit scale (higher values indicate higher Workplace Social Capital) is shown in Fig 2, indicating satisfactory targeting, although the mean of the persons (1.2) was higher than the mean of the items (constrained to zero).
Higher values indicate higher Workplace Social Capital within the Workplace Social Capital scale of the COPSOQ III.
Ordinal-to-interval conversion table
Given the fit to the Rasch model, ordinal scores (mean values of the six items) are transformed into interval-level scores. Interval-level scores from the Rasch model are on the logit scale, which can take both negative and positive values, with higher scores indicating higher levels of Workplace Social Capital. These logits scores are then transformed into a 0–100 interval, which is a more familiar range for COPSOQ users (henceforth referred to as a metric score). Table 6 provides interval scores in both logit unit and in a 0–100 range that allows users of the Workplace Social Capital scale to convert ordinal mean score into interval-level (metric) scores ranging 0–100.
Conversion table with interval scale in logit and metric (linearly transformed logit into 0–100 range) on the COPSOQ III Workplace Social Capital scale and their corresponding ordinal scale (mean) equivalents based on Rasch analysis with two testlets, n = 1316.
Researchers and practitioners who have already used the Workplace Social Capital scale of COPSOQ III to collect data or are planning to use the scale can apply the results of this study as follows. First calculate the raw mean score of the six items coded 0–25–50–75–100 (based on complete datasets). Next, use Table 6 to convert these scores into the corresponding metric scores.
An interval-level scale is equidistant, meaning that the increase of e.g. 5 points on a scale implies the same magnitude of increase in Workplace Social Capital on the entire range of the scale. As seen in Fig 3, where mean scores (Y-axis) are plotted against metric score (X-axis), this assumption does not hold for the ordinal-level scale. Clearly, the curve is not a straight line. The increase of e.g. one unit on a mean scale is much larger at the top than in the middle of the scale. Using the conversion table (Table 6) allows for increased precision of the Workplace Social Capital scale.
Discussion
We found that the psychometric properties of the suggested scale for Workplace Social Capital were satisfactory after having accommodated for local dependency. Each individual item worked as intended, the scale was unidimensional and functions invariantly for women and men, and for younger and older employees. The scale for Workplace Social Capital is valid for use at group level, understood as valid for distinguishing groups, not individuals.
The psychometric properties of the Workplace Social Capital scale from COPSOQ III were good, having accommodated for local dependency, through the use of testlets and all items worked properly. The ordering of the response categories worked properly for all six items, meaning that the expected increasing level of the latent construct (i.e. Workplace Social Capital), across the response categories for each item, are reflected in the observed data. The results suggest that the scale fulfills the criteria required by the Rasch model in order to quantify a latent variable. The total score reflects the scoring structure indicated by developers of the scale. In other words, the Rasch model provides evidence that the items form a reasonably unidimensional and essentially valid scale. An essential feature of measurement implies equal intervals across the entire continuum of the construct being measured.
The initial analysis showed some problems with local dependency. Based on the PCA of residuals, the three TM items clustered in one group while the two JU items and TE3 clustered in another group. Although this is not optimal from a measurement point of view, the results are not surprising from a theoretical point of view, since these items constitute different subdimensions of social capital. While the three TM items are intended to measure the perception of trust in the relationship between management and employees, the TE3 and JU1, JU4 items address mutual trust among employees and justice as group-level characteristics, as reflected in quotations from qualitative interviews [24]. This might be especially true in the context of human services, where employees typically have high discretion in tasks related to clients or patients, including handling of conflicts and distribution of tasks [66]. The measurement problem was solved by combining the items into two testlets, which is a recommended procedure for this kind of issue [62].
Equal spacing between the scale categories is an underlying assumption for the mean scores to be meaningful. We have shown that the mean scores of Workplace Social Capital scale are not linear and do not have equal intervals along the whole continuum. An increase of one unit on a mean score scale does not imply the same amount or magnitude of Workplace Social Capital across the entire continuum. The problem might not be that serious in the middle of the scale but is more pronounced towards the ends of the scale. This is not in any way unique for the Workplace Social Capital scale but is true for many ordinal scales. Although it is tempting and very common to use the numerical coding of ordinal variables as real numbers in statistical analysis, the numerals assigned to the response categories are arbitrary and can be changed as long as their ordering is preserved [67, 68]. A discussion about how to treat ordinal data in statistical analysis has been going on for a long time [69] and classical test theory and modern test theory offer different solutions. However, that discussion is beyond the scope of this article.
The ordinal mean score has been transformed to an interval scale latent estimate. We recommend the use of the proposed metric score instead of the mean score. The logit score is transformed to the 0–100 interval (called metric score), which is a familiar range for COPSOQ users and where higher scores indicate higher Workplace Social Capital. A task for future studies will be to determine cut-off scores indicating high and low values of Workplace Social Capital as well as relevant reference values for workplaces.
The results of this study showed that the scale is valid on a group level but not for individual use, e.g. to follow an individual over time. This is also in line with the theoretical basis of Workplace Social Capital, which deals with relationships at work ([16, 17, 19, 70]). In a review of the literature and guidance on measurement of Social Capital in general, Lochner, Kawachi and Kennedy point out that ‘an almost universal agreement is that community characteristics [such as social capital] ought to be distinguished from individual characteristics, and measured at the community level’ [71]. Measurement at the workplace level can be done in different ways, for example by observational studies, document analyses or by questionnaire studies. In accordance with the recommendation from Lochner and colleagues [71], the COPSOQ measurement of Workplace Social Capital can be seen as an ecologic characteristic of the group to which individual responses are aggregated rather than an attribute of the individual [24].
As part of the present work we realized that Workplace Social Capital has been defined and operationalized by the use of COPSOQ items and in numerous ways across different research projects (Table 1). However, in the vast majority of the studies presented in Table 1 we find only very sparse information on validity and reliability, often only Cronbach’s alpha values or a reference to the fact that COPSOQ in general or specific scales are well validated. A basis for all research is the use of reliable and valid instruments, and it is therefore our hope that this article can be a step towards the establishment of consensus regarding measurement of COPSOQ III Workplace Social Capital. Future studies will contribute to further validation of the instrument.
A main advantage of our study is that Rasch Analysis has been used, which belongs to the item response theory and does not require any assumptions about the distribution of the construct being measured. The Rasch model operationalizes the axioms of additive conjoint measurements, which are the requirements for the fundamental measurement construction [49–52]. The adequacy of the fit was evaluated by means of residuals, i.e. the observed item responses were compared to the expected ones. This is an appropriate method given the ordinal character of questionnaire data. Given that the data fit the Rasch model, a valid measurement is obtained and the sufficient statistic for the Workplace Social Capital items is obtained on a logit scale and transformed into the 0–100 range for reasons of convenience. Some limitations should be mentioned. The proposed logit (and metric) scores are valid only for similar populations of human service workers or similar occupations having daily contact with patients, clients etc. The Workplace Social Capital scale fit the model after the items were combined into two testlets. This implies that the proposed metric values are valid provided that there are no missing values on any of the items.
Further research is needed to address construct validity in relation to other important constructs, and for a better understanding of the construct when used in different contexts. According to modern test theory, validation is an ongoing process, and modified versions of the questionnaire at hand, or applied in new settings, call for new evaluations [72]. In the present study we have used a convenience sample of human service workers. Our findings showed that the scale worked satisfactorily and showed an ability to distinguish between groups even in a high-trust context, such as human services. While human service work shares many characteristics across countries, the core of the work differs substantially from, say, industrial work [66]. Therefore, we suggest replication of the study in a broader international sample to assess higher generalizability.
Conclusions
In conclusion, we have established a scale based on the domain for Workplace Social Capital in COPSOQ III for use at group level in human service organizations. The scale holds good construct validity as it satisfies the measurement criteria defined by the Rasch model.
Supporting information
S1 File. Appendix 1.
Scientific data related to the analyses, full sample of 1316 participants.
https://doi.org/10.1371/journal.pone.0221893.s001
(XLSX)
S2 File. Appendix 2.
Scientific data related to the analyses, selected sample of 422 participants.
https://doi.org/10.1371/journal.pone.0221893.s002
(XLSX)
S3 File. Appendix 3.
Fit to the Rasch model, summary fit statistics for the full sample, n = 1316.
https://doi.org/10.1371/journal.pone.0221893.s003
(PDF)
References
- 1.
COPSOQ International Network [internet]. Scales and Items of COPSOQ III questionnaire. [Cited 21-03-2019]. Available from: https://www.copsoq-network.org/guidelines/
- 2.
Sørensen OH, Hasle P, Hesselholt RR, Herbøl K. Nordiske forskningsperspektiver på arbejdsmiljø: Mening, indflydelse og samarbejde: Nordisk ministerråd; 2012. Available from http://www.diva-portal.org/smash/record.jsf?pid=diva2%3A701201&dswid=8517
- 3. Janetzke H, Ertel M. Psychosocial risk management in more and less favourable workplace conditions. Int J Workplace Health Manag. 2017;10(4):300–317. https://doi.org/10.1108/ijwhm-09-2016-0063
- 4.
International Labour Organization. Workplace stress: A collective challenge. Bilbao 2016. Available from https://www.ilo.org/safework/events/safeday/WCMS_473267/lang—en/index.htm
- 5.
The Swedish Work Environment Authority. Arbetsmiljön 2015. Arbetsmiljöstatistik Rapport 2016:2 [The Work Environment 2015. Work Environment statistics report 2016:2]. Stockholm: The Swedish Work Environment Authority, 2016. Available from https://www.av.se/globalassets/filer/statistik/arbetsmiljon-2015/arbetsmiljostatistik-arbetsmiljon-2015-rapport-2016-2.pdf
- 6.
The Swedish Work Environment Authority. The Work Environment Act and its regulation with comments January 1, 2015 (Arbetsmiljölagen och dess förordning med kommentarer 1 januari 2015). Stockholm: The Swedish Work Environment Authority (Arbetsmiljöverket); 2015. Available from http://www.av.se/publikationer/bocker/h008.aspx
- 7.
Tillitsdelegationen. Tillitsdelegationen 2016. Available from: http://tillitsdelegationen.se
- 8.
Christensen M, Saksvik PØ, Karanika-Murray M. The Positive Side of Occupational Health Psychology: Springer; 2017. https://doi.org/10.1007/978-3-319-66781-2
- 9. Saksvik PØ, Hammer TH, Nytrø K. Social Relations at the Collective Level: The Meaning and Measurement of Collective Control in Research on the Psychosocial Work Environment. Nordic Journal of Working Life Studies. 2013;3(3):31. Available from https://tidsskrift.dk/njwls/article/view/26744/23516
- 10. Bourdieu P. The forms of capital. 1986.
- 11. Coleman JS. Social Capital in the Creation of Human Capital. Am J Sociol 1988; 94: 95–120. https://doi.org/10.1086/228943
- 12.
Putnam RD, Leonardi R, Nanetti RY. Making democracy work: Civic traditions in modern Italy: Princeton University Press; 1994. https://doi.org/10.2307/j.ctt7s8r7
- 13.
Putnam RD. Bowling alone: America’s declining social capital. Culture and politics: Springer; 2000. p. 223–234.
- 14. Liukkonen V, Virtanen P, Kivimäki M, Pentti J, Vahtera J. Social capital in working life and the health of employees. Soc Sci Med. 2004;59(12):2447–58. pmid:15474200
- 15. Hasle P, Møller N. Fra konfliktkultur til udvikling i fællesskab-social kapital i danske slagterier. Tidsskrift for Arbejdsliv. 2005;7:71–86. https://doi.org/10.7146/tfa.v7i3.108489
- 16. Hasle P, Møller N. From conflict to shared development: social capital in a tayloristic environment. Economic and Industrial Democracy. 2007;28(3):401–29. https://doi.org/10.1177/0143831x07079355
- 17.
Olesen KG, Thoft E, Hasle P, Kristensen TS. Virksomhedens sociale kapital–en hvidbog. [White paper on organizations’ social capital]. København: Arbejdsmiljørådet. 2008.
- 18. Oksanen T, Kouvonen A, Kivimäki M, Pentti J, Virtanen M, Linna A, et al. Social capital at work as a predictor of employee health: multilevel evidence from work units in Finland. Soc Sci Med. 2008;66(3):637–649. pmid:18006128
- 19. Pejtersen J, Kristensen T, Borg V, Bjorner J. The second version of the Copenhagen Psychosocial Questionnaire. Scand J Pub Health. 2010;38(3 Suppl):8–24. https://doi.org/10.1177/1403494809349858
- 20. Elovainio M, Kivimäki M, Steen N, Vahtera J. Job decision latitude, organizational justice and health: multilevel covariance structure analysis. Soc Sci Med 2004;58(9):1659–69). pmid:14990368
- 21. Cook J, Wall T. New work attitude measures of trust, organizational commitment and personal need non-fulfilment. J Occup Psychol. 1980;(53):39–52. https://doi.org/10.1111/j.2044-8325.1980.tb00005.x
- 22. Carless S, De Paola C. The measurement of cohesion in work teams. Small Group Res 2000;(31):71–88. https://doi.org/10.1177/104649640003100104
- 23. Clausen T, Madsen IE, Christensen KB, Bjorner JB, Poulsen OM, Maltesen T, et al. The Danish Psychosocial Work Environment Questionnaire (DPQ): Development, content, reliability and validity. Scand J Work Environ Health 2019;45(4):356–369. pmid:30592500
- 24. Berthelsen H, Hakanen J, Kristensen T, Lönnblad A, Westerlund H. A Qualitative Study on the Content Validity of the Social Capital Scales in the Copenhagen Psychosocial Questionnaire (COPSOQ II). Scand J Work Org Psychol. 2016;1(1). https://doi.org/10.16993/sjwop.5
- 25. Hakanen J, Perhoniemi R, Rodríguez Sánchez AM. Too good to be true? Similarities and differences between engagement and workaholism among Finnish judges. Demasiado bueno para ser cierto: similitudes y diferencias entre el engagement y la adicción al trabajo en jueces finlandeses. Cienc Trab,. 2012;14(esp):72–80. Available from http://repositori.uji.es/xmlui/bitstream/handle/10234/63410/55687.pdf?sequence=1&isAllowed=y
- 26. Lundstrøm SL, Edwards K, Knudsen TB, Larsen PV, Reventlow S, Søndergaard J. Relational coordination and organisational social capital association with characteristics of general practice. Int J Family Med. 2014;2014:1–7. https://doi.org/10.1155/2014/618435
- 27. Kiss P, De Meester M, Kristensen TS, Braeckman L. Relationships of organizational social capital with the presence of “gossip and slander,” “quarrels and conflicts,” sick leave, and poor work ability in nursing homes. International archives of occupational and environmental health. 2014; 1;87(8):929–936. 10.1007/s00420-014-0937-6. pmid:24577806
- 28. Strömgren M. Intention to leave among health care professionals: The importance of working conditions and social capital. J Hosp Adm. 2017;6(3):58. https://doi.org/10.5430/jha.v6n3p58
- 29. Strömgren M, Eriksson A, Ahlstrom L, Bergman DK, Dellve L. Leadership quality: a factor important for social capital in healthcare organizations. J Health Organ Manag. 2017;31(2):175–91. pmid:28482768
- 30. Strömgren M, Eriksson A, Bergman D, Dellve L. Social capital among healthcare professionals: A prospective study of its importance for job satisfaction, work engagement and engagement in clinical improvements. Int J Nurs Stud. 2016;53:116–25. pmid:26315780
- 31. Løkke A-K. Social capital and health and job related outcomes: the case of a large municipality. International Journal of Workplace Health Management. 2016;9(1):17–31.
- 32. Rugulies R, Hasle P, Pejtersen JH, Aust B, Bjorner JB. Workplace social capital and risk of long-term sickness absence. Are associations modified by occupational grade? The Eur J Public Health. 2016:ckv244. https://doi.org/10.1093/eurpub/ckv244
- 33. Hansen A-SK, Madsen IE, Thorsen SV, Melkevik O, Bjørner JB, Andersen I, et al. Does workplace social capital protect against long-term sickness absence? Linking workplace aggregated social capital to sickness absence registry data. Scand J Pub Health. 2017:1403494817721672. https://doi.org/10.1177/1403494817721672
- 34. Mauss D, Li J, Angerer P. Psychometric Properties of the Work Well Index: A Short Questionnaire for Work‐Related Stress. Stress Health. 2016 24;33(1):80–5 pmid:26916080
- 35. Török E, Clark AJ, Jensen JH, Lange T, Bonde JP, Bjorner JB, et al. Work-unit social capital and long-term sickness absence: a prospective cohort study of 32 053 hospital employees. Occup Environ Med. 2018 6;75(9):623–9. pmid:29875292
- 36. Jensen JH, Flachs EM, Skakon J, Rod NH, Bonde JP. Longitudinal associations between organizational change, work-unit social capital, and employee exit from the work unit among public healthcare workers: a mediation analysis. Scand J Work Environ Health. 2018 21;45(1):53–62. pmid:30129653
- 37. Bjorner JB, Pejtersen JH. Evaluating construct validity of the second version of the Copenhagen Psychosocial Questionnaire through analysis of differential item functioning and differential item effect. Scand J Pub Health. 2010;38(3 Suppl):90–105. https://doi.org/10.1177/1403494809352533
- 38. Pejtersen JH; Bjørner JB; Hasle P. [internet] Måling af virksomhedens sociale kapital–udarbejdning af et selvevalueringsværktøj. A note dated January 28, 2011, from The National Research Centre for the Working Environment [cited March 21, 2019] Available from https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=2ahUKEwjk3e_cxZLhAhURhuYKHTp_CvIQFjAAegQIABAC&url=http%3A%2F%2Fwww.socialkapital.org%2Fwp-content%2Fuploads%2F2011%2F11%2FNotat-fra-NFA-om-m%25C3%25A5ling-af-virks-sociale-kapital.pdf&usg=AOvVaw2NtSq8cfGqi3T5w66lqQ1x
- 39.
Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press; 1960.
- 40. Andrich D, Hagquist C. Real and artificial Differential Item Functioning in Polymous Items. Educ Psychol Meas. 2015;75(2):185–207. pmid:29795818
- 41. Linacre JM. Sample size and item calibration stability. Rasch Meas Trans. 1994;7(4):328.
- 42. Holtz BC. Trust primacy: A model of the reciprocal relations between trust and perceived justice. J Man. 2013;39(7):1891–923. https://doi.org/10.1177/0149206312471392
- 43. Colquitt JA, Rodell JB. Justice, trust, and trustworthiness: A longitudinal analysis integrating three theoretical perspectives. AMJ 2011;54(6):1183–1206. https://doi.org/10.5465/amj.2007.0572
- 44.
Blau P. Exchange and power in social life. NY: John Wiley & Sons. 1964. https://doi.org/10.2307/2574842
- 45.
Lind EA. Fairness Heuristic Theory: Justice Judgments as Pivotal Cognitions in Organizational Relations. In: Greenberg J. and Cropanzano R., Eds., Advances in Organizational Justice. Stanford University Press, Stanford; 2001.
- 46.
Shapiro DL, & Kirkman BL. Anticipatory injustice: The consequences of expecting injustice in the workplace. In Greenberg J. & Cropanzano R. (Eds.), Advances in organization justice. Stanford University Press, Stanford 2001.
- 47. Holtz BC. From first impression to fairness perception: Investigating the impact of initial trustworthiness beliefs. J Pers Psychol. 2015;68(3):499–546. https://doi.org/10.1111/peps.12092
- 48. Holtz BC, Harold CM. Fair today, fair tomorrow? A longitudinal investigation of overall justice perceptions. J Appl Psychol. 2009;94(5):1185. pmid:19702364
- 49. Luce RD, Tukey JW. Simultaneous conjoint measurement: A new type of fundamental measurement. J Math Psychol 1964;1:1–27. https://doi.org/10.1016/0022-2496(64)90015-x
- 50. Van Newby A, Conner GR, Bunderson CV. The Rasch model and additive conjoint measurement. J Appl Meas 2009;10:348–54. pmid:19934524
- 51. Perline R, Wright BD, Wainer H. The Rasch model as additive conjoint measurement. Appl Psychol Meas. 1979;3:237–55. https://doi.org/10.1177/014662167900300213
- 52. Karabatos G. The Rasch model, additive conjoint measurement, and new models of probabilistic measurement theory. J Appl Meas 2001;2:389–423. pmid:12011506
- 53. Masters G. A Rasch model for partial credit scoring. Psychometrika. 1982;47:149–74.
- 54. Andrich D. Rating formulation for ordered response categories. Psychometrika. 1978;(43):561–73. https://doi.org/10.1007/bf02293814
- 55.
Andrich D, Sheridan B, Luo G. RUMM2030: A Windows interactive program for analysing data with Rasch Unidimensional Models for Measurement. Perth: RUMM Laboratory; 2014.
- 56. Pallant JF, Tennant A. An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). Br J Clin Psychol. 2007;46(1):1–18. https://doi.org/10.1348/014466506X96931
- 57.
Guttman L. The basis for Scalogram analysis. In Studies in Social Psychology in World War II: Vol. 4. Measurement and Prediction. Stouffer S, Guttman L, Suchman F, Lazarsfeld P, Star S, Clausen J, editors. Princeton: Princeton University Press; 1950.
- 58. Bland JM, Altman DG. Statistics notes: Cronbach’s alpha. BMJ 1997;314:572 pmid:9055718
- 59. Marais I, Andrich D. Formalizing Dimension and Response Violations of Local Independence in the Unidimensional Rasch Model. J Appl Meas. 2008;9(3):200–215. pmid:18753691
- 60. Smith EV Jr. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3(2):205–31. pmid:12011501
- 61. Agresti A, Coull BA. Approximate Is Better than “Exact” for Interval Estimation of Binomial Proportions. The American Statistician. 1998;52(2):119–26. https://doi.org/10.2307/2685469.
- 62. Hagquist C, Bruce M, Gustavsson JP. Using the Rasch model in nursing research: an introduction and illustrative example. Int J Nurs Stud. 2009;46(3):380–93. pmid:19059593
- 63. Christensen KB, Makransky G, Horton M. Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations. Appl Psychol Meas. 2017;41(3):178–94. pmid:29881087
- 64. Salzberger T. The validity of polytomous items in the Rasch model–The role of statistical evidence of the threshold order. Psychological Test and Assessment Modeling. 2015;57(3):377–95.
- 65. Smith EV Jr. Metric development and score reporting in Rasch measurement. J Appl Meas. 2000;1(3):303–26. pmid:12029173
- 66.
Hasenfeld Y. Human services as complex organizations: Sage Publications; 2009.
- 67. Stevens SS. On the Theory of Scales of Measurement. Science. 1946;103(2684):677–80.
- 68. Stevens SS. On the averaging of data. Science. 1955;121(3135):113–6. pmid:13225751
- 69. Kampen J, Swyngedouw M. The Ordinal Controversy Revisited. Quality & Quantity. 2000;34(1):87–102. https://doi.org/10.1023/A:1004785723554
- 70. Kristensen TS. A questionnaire is more than a questionnaire. Scandinavian Journal of Public Health. 2010;38(3 suppl):149–55. https://doi.org/10.1177/1403494809354437
- 71. Lochner K, Kawachi I, Kennedy BP. Social capital: a guide to its measurement. Health & Place. 1999;5(4):259–70.
- 72.
American Educational Research Association APA, & National Council on Measurement in Education Standards for Educational and Psychological Testing. 2014.