Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Gain +1 or Avoid −1: Validation of the German Regulatory Focus Questionnaire (RFQ)

BMC Psychology volume 5, Article number: 40 (2017) Cite this article

Abstract

Background

The Regulatory Focus Questionnaire (RFQ) assesses regulatory promotion and prevention focus, which represent orientations towards gains or losses. The main objective of this study was to examine the psychometric properties of the newly translated German version.

Methods

A sample of 1024 participants answered the questionnaire and several related instruments. We used an online survey tool to collect this data. Data analysis was conducted using methods of exploratory and confirmatory factor analysis in SPSS and AMOS.

Results

The RFQ displayed acceptable reliability, while its correlations with other, related psychological constructs indicated good validity. Factor analysis showed good fit for a two-dimensional model. Tests of measurement invariance revealed clear evidence for metric invariance while scalar invariance remained uncertain. Differences in regulatory focus based on sociodemographic characteristics are reported and discussed.

Conclusions

Overall, the RFQ can be recommended for application in fields dealing with motivation and goal attainment in a broad sense.

Peer Review reports

Background

Regulatory focus theory (RFT) is a goal pursuit theory that categorizes individuals’ thoughts and behaviors in terms of an orientation towards gains and losses [1,2,3,4]. The promotion system focuses on the attainment of a desired state whereas the prevention system centers on the avoidance of undesirable states. Accordingly, promotion-oriented individuals seek to make gains, seize opportunities, and take risks in order to advance in their pursuits towards ideals. In contrast, prevention-oriented individuals aim to minimize risks, maintain a given status quo, and remain vigilant against potential threats to oughts. These tendencies influence the processing and usage of information and decision making on many levels, and therefore play an important role in several fields of psychological research such as motivation, attitude, persuasion, and leadership, among others [5,6,7,8,9,10]. Furthermore, considering that specific regulatory focus states can be easily primed, applications of this theory are abundant and diverse [11]. The regulatory focus systems are rooted in specific neural components, as indicated by neural correlates that have been identified, including an activation of the amygdala, the anterior cingulate cortex, and the extrastriate cortex [12]. Additionally, promotion focus relates to an activation of the right prefrontal cortex while prevention focus correlates with an activation of the left prefrontal cortex [13].

Molden, Lee, and Higgins [14] argued that the regulatory focus system is orthogonal to the approach-avoidance system. Proposing a 2 × 2 model, they demonstrated how in approaching a positive end state, individuals can either approach gains (promotion) or approach non-losses (prevention). Similarly, in avoiding a negative end state, individuals can either avoid non-gains (promotion) or avoid losses (prevention). For example, one can strive for (or approaching) a positive end state of health by either exercising regularly to reap the benefits (gains, i.e. promotion) or by not smoking or drinking in order to not lose the health status one already possesses (non-losses, i.e. prevention). On the other hand, one can strive to avoid the negative end state of sickness with the exact same behavior, in a reframed setting: One exercises to avoid missing out on the positive results (non-gains, i.e. promotion) and avoids smoking and drinking in order not to experience the negative effects associated with those behaviors (losses, i.e. prevention). Although the regulatory focus system is theoretically orthogonal to the approach-avoidance system, studies comparing regulatory focus measures with approach-avoidance measures have shown that these two constructs are in fact moderately correlated [15]. As noted by Haws, Dholakia, and Bearden [16], the two regulatory focus measures that are being used most frequently in psychological research are the Regulatory Focus Questionnaire (RFQ) by Higgins and colleagues [17] and the General Regulatory Focus Measure (GRFM) by Lockwood, Jordan, and Kunda [9]. Summerville and Roese [15] found stronger associations with Behavioral Inhibition/Approach Scales (BIS/BAS; Carver & White, 1994) for the GRFM than they did for the RFQ and stronger correlations for promotion than for prevention focus.

There have been a number of attempts at establishing a German measure of regulatory focus: Several translations of the RFQ have been employed by researchers in the past (e.g., [18,19,20,21]). However, none of the conducted studies reported detailed psychometric properties – especially the factor structure was never discussed. As this is a very central step in investigating the validity and therefore the theoretical soundness as well as the practical applicability of a scale, it should not be skipped. The GRFM has also been translated and applied before [22], but there is again no discussion of factorial structure. Finally, Fellner, Holler, Kirchler, and Schabmann [23] created a new scale that seeks to address the short-comings of the RFQ and the GRFM, but does only achieve mediocre factorial validity.

Aims of the study

The present study seeks to validate the newly translated German version of the RFQ. Specifically, it aims to a) investigate psychometric properties including item characteristics and reliability, b) confirm the two-factorial structure proposed by Higgins and colleagues [17], c) examine validity towards related psychological constructs, and d) analyze measurement invariance as well as differences in promotion and prevention focus based on sociodemographic variables.

Considering the moderate correlations found between promotion focus and behavioral approach, and between prevention focus and behavioral inhibition, similar correlations are expected in the present study. Furthermore, regulatory focus (mostly promotion focus) plays an important role in predicting work-related outcomes [24]. Two other constructs that significantly predict work-related outcomes are core self-evaluations and the Big Five, and therefore, the relationships between the RFQ and the subscales of the Core Self-Evaluation Scale (CSES; [25]) and the Big Five Inventory-10 (BFI-10; [26]) were examined. Correlations of regulatory focus and the Big Five have been shown by previous research, such as openness [27, 28]. Individuals with high promotion focus look for opportunities and seek to maximize gains, this implies a necessity for openness to new experiences. In this line of argument, we also expect a moderate association of promotion focus with extraversion. In contrast, individuals with prevention focus, want to maintain vigilance and avoid losses, therefore a positive association with conscientiousness and neuroticism is expected.

As regulatory focus relates to self-regulation high correlations with the CSES, which contains among others self-efficacy and self-esteem, are also expected. Hazlett, Molden, and Sackett (2011) have shown that promotion-oriented individuals tend to be optimistic, whereas prevention-oriented individuals favor pessimism. For this reason, the revised Life-Orientation-Test (LOT-R; [29]) was utilized in the present study. Lastly, based on the relationship between regulatory focus and optimism/pessimism, corresponding associations with health outcomes are expected as well [30, 31]. Furthermore, regulatory focus orientation has been shown to be an important regulator of responses to health messages [32].

Methods

Participants and procedures

The study sample was acquired between December 2015 and February 2016 utilizing the online survey tool SoSciSurvey [33],after the design was met with approval by the ethics commission of the University of Applied Sciences Magdeburg-Stendal (AZ-3973-51). Participants were recruited for the study by means of social networks and bulletin boards. After receiving an introduction with regard to the general purpose of the study, participants gave their informed consent.

The total number of participants who started the survey by giving consent was N = 1173, of which n = 282 (24%) aborted the survey before answering all questions. Participants, who aborted the survey after providing their socio-demographic information but before completing any of the presented questionnaires (n = 149 [13%]) differed significantly from those who completed additional questionnaires in two of the six sociodemographic variables. Participants that aborted the survey were more likely to report a male gender (χ2(2) = 12.39, p = .002) and lower education (χ2(6) = 14.58, p = .024). Age (U = 68,923.00, p = .740), employment status (χ2(5) = 3.59, p = .610), family status (χ2(5) = 0.70, p = .983), and monthly net household income (χ2(8) = 6.23, p = .622) did not differ between participants who continued with the survey and those who did not. Due to the design of the online survey, either participants answered all items of a given scale or none at all; there was no missing data. Individuals who were too young to take part in the study (under the age of 18 years) were excluded. Thus, the used sample consisted of n = 1024. Participants who were included in the analysis had a mean age of around 30 years (M = 29.38; SD = 10.79) with a range from 18 to 70 years. Detailed sample characteristics are presented in Table 1.

Table 1 Sociodemographic characteristics of the study sample as well as means and standard deviations for the RFQ subscales, presented as M(SD)
Full size table

Measures

Regulatory focus questionnaire (RFQ)

The Regulatory Focus Questionnaire [17] comprises eleven items assessing the regulatory focus orientation of an individual. It includes six items for promotion focus and five items for prevention focus. Options for answering the items range from 1 – “never or seldom”/“never true”/“certainly false” to 5 – “very often”/“very often true”/“certainly true”. Seven of the items (1, 2, 4, 6, 8, 9, 11) need to be reverse-scored before calculating the respective mean scale scores. Higgins and colleagues [17] reported internal consistency as α = .73 for the promotion subscale and as α = .80 for the prevention subscale, and their intercorrelation was r = .21. It should be noted that values lower than α = .70 have been found before for the promotion subscale [34]. For the present study, two professional translators converted the original English version items into German independent of one another. After reaching a consensus on a single translation the items were translated back into English by two native speakers and compared with the original. Both language versions are displayed in Table 3. Scale characteristics for the German version are reported in the results section.

Behavioral inhibition/approach system scale (BIS/BAS)

The German BIS/BAS [35] was used to measure approach and avoidance motivation. It consists of 20 items, which are split among four subscales (BIS, BAS-Drive, BAS-Fun Seeking, BAS-Reward Responsiveness), and four filler items. Scale values are calculated by averaging item scores after reverse-scoring two of them. Strobel and colleagues [35] reported the internal consistency of the BIS scale as α = .78, and the BAS scale as α = .81.

Core self-evaluations scale (CSES)

The CSES ([36]) includes facets of self-esteem, locus of control, neuroticism, and self-efficacy in a 12 item scale. For the German version, evidence by Zenger and colleagues [25] suggested a two-factor interpretation. The, two scale scores are obtained by averaging the positively- and the negatively worded items, respectively. Internal consistency was reported as between α = .81 and .86.

Big five Inventory-10 (BFI-10)

The Big Five personality dimensions (Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism) were measured using the BFI-10 [26]. Every subscale consists of two items, one of which has to be reverse-scored before calculating the mean. Rammstedt and John [26] reported test-retest-reliability as r tt  = .78 for Openness, r tt  = .83 for Conscientiousness, r tt  = .66 for Agreeableness, r tt  = .87 for Extraversion, and r tt  = .71 for Neuroticism.

Life orientation test – Revised (LOT-R)

The LOT-R [29] uses ten items to measure optimism and pessimism, four of which are filler items. A two-factor interpretation has been found to be preferable for the German version [37]. Scale scores for the two subscales are computed by adding individual item scores. Cronbach’s α was reported as α = .70 for the optimism scale and as α = .74 for the pessimism scale in the German general population [38].

Patient health Questionnaire-4 (PHQ-4)

The PHQ-4 [39] is an ultra-short screening instrument for symptoms of depression and anxiety using four items. Participants indicate to what extent they suffered from specific symptoms during the last two weeks. Summing up the items yields a scale score, measuring psychological distress. Löwe and colleagues [39] reported an internal consistency of α = .82 for the scale.

Somatic symptom Scale-8 (SSS-8)

The SSS-8 measures experienced somatic stress using eight items [40]. Adding all items provides a total score. The internal consistency of the scale was reported as α = .81 by Gierk and colleagues [40].

Subjective health status

From the EuroQol-5D [41], the visual analogue scale (VAS) was utilized to measure participants’ current subjective health status. It ranges from (0) “worst imaginable health status” to (100) “best imaginable health status”.

Statistical analyses

Statistical operations were conducted using IBM SPSS Statistics 23 and AMOS 23. Pearson product-moment correlation coefficients were employed for reporting correlations. An α level of .05 was used for tests of significance unless otherwise noted. Properties of scales and items, such as means, standard deviations, item-difficulty indices as well as item-total correlations, were determined for the RFQ. Additionally, item and scale distributions were tested for normality by calculating skewness and kurtosis. The assumptions of sphericity and sampling adequacy were examined.

For the exploratory (EFA) and the confirmatory factor analyses (CFA), two randomly split subsamples of roughly the same size were used (nEFA = 510; nCFA = 514). The subsamples did not differ significantly in terms of age, gender, and RFQ item scores. For the EFA, principal component analysis (PCA), the minimum average partial (MAP; [42]) test, and parallel analysis (PA; [43]) were used. In the MAP test, the average squared partial correlations serve as indicators to determine the ideal number of factors. In PA, eigenvalues of randomly generated correlation matrices based on the original raw data (same number of variables and cases) are tested for significant differences from the empirically found ones. O’Connor [44] supplies SPSS syntaxes for these operations. Covariance matrices and the maximum likelihood method were used for the CFA.

The following model fit indices were used for the CFA with commonly agreed upon cut-off values [45,46,47,48]. The χ2-statistic and the minimum discrepancy divided by degrees of freedom (CMIN/DF) were used. Ideally, the former should be non-significant, although that rarely happens with larger sample sizes [49],while the CMIN/DF should be lower than five. The comparative fit index (CFI) and the Tucker-Lewis index (TLI) should be greater than .95, while a CFI/TLI that is greater than .90 can still be acceptable. The standardized root mean square residual (SRMR) should be lower than .08, although ideally lower than .06. Similar values are used for the root mean square error of approximation (RMSEA) and its 90% confidence interval. The Bayesian Information Criterion (BIC) is a comparative measure of fit and is utilized for comparisons between several models which do not necessarily have to be nested [50, 51]. Smaller BIC values indicate better fit. Raftery [51] reported guidelines for interpreting differences in BIC between models, suggesting that a margin of 10 between model BICs is the equivalent of a significant difference at the p = .001 level, given a sample size of at least 30. We use the BIC to compare between the two alternative models reported in the present study.

A multiple-group factor analysis was used to test for measurement invariance in a two-step process. Firstly, the unconstrained, configural model was compared with the metric model, which constrains unstandardized item loadings to be equal across groups. Secondly, the metric model and the scalar model, which constrains both, unstandardized item loadings and item intercepts, across groups, were compared. As per previous research, the differences in CFI and gamma hat (GH; [52]) were used as indicators for invariance along with the differences in the χ2 -statistic [53, 54]. A deviation of more than .01 in CFI or GH should be considered a sign of violations of measurement invariance.

Finally, differences in promotion and prevention focus across sociodemographic groups were tested for significance, for groups with at least 20 members. Normal distribution and equality of variances could be confirmed. In order to avoid an accumulation of α error probability, a significance level of .01 was utilized for the ANOVAs. Furthermore, Tukey’s HSD was used to compare individual groups for significant differences. Reported effect sizes are interpreted using Cohen’s d and η2, including 95% and 90% confidence intervals, respectively [55].

Results

Item characteristics and reliability

Item and scale characteristics are reported in Table 2. Skewness and kurtosis are well within the norms of having an absolute value of less than 1 for skewness and less than 3 for kurtosis [56]. Thus, a normal distribution can be assumed for all items and scales. Means and item-difficulty indices suggested that participants tended to answer items in the direction of the trait in question. Corrected item-total correlations ranged from .24 to .65. Usually, a value of .3 is considered a cut-off point for this coefficient [57]. The internal consistency of the subscales was ω = .78, 95%-CI = [.76; .80] for prevention focus, which is a good, and ω = .61, 95%-CI = [.58; .65] for promotion focus, which is mediocre and questionable [58]. After removing Item 3 the reliability of the promotion subscale did not worsen significantly, remaining at ω = .61, 95%-CI = [.57; .65]. This in conjunction with the poor item characteristics for Item 3 suggest its exclusion from the scale.

Table 2 Characteristics of the RFQ items and scales
Full size table

Factor structure

The PCA of the first subsample (n = 510) using a Varimax rotation reduced the eleven items of the RFQ to two components: A prevention factor with an eigenvalue of 2.75 (explaining 25% of total variance) as well as a promotion factor with an eigenvalue of 2.18 (explaining an additional 20% of total variance). Similarly, the scree plot also indicated a distinct decline of explained variance after two factors. The intercorrelation of the extracted factors was r = .13. As reported in Table 3, factor loadings showed strong associations between all items and their respective factor. With the exception of Item 3, which loaded on its factor with .46, all items exhibited loadings of .60 and higher. The MAP test showed that the lowest average partial correlations between items could be found when assuming two factors. Likewise, the PA indicated that eigenvalues of factors one and two were larger than what could be expected with random data sets of the same number of variables and cases with a 95% margin of error. Thus, all methods of EFA suggested a two-factor solution (Table 4).

Table 3 Factor loadings of all RFQ items in the EFA
Full size table
Table 4 Results of the minimum average partial test and parallel analysis
Full size table

The EFA clearly suggested a two-factor model. This model was subsequently tested in the CFA using the second subsample (n = 514). Model fit indices for models including and excluding Item 3 are reported in Table 5. The fit for the model including Item 3 was barely acceptable in terms of CFI and TLI, while showing good fit via SRMR and RMSEA. The exclusion of Item 3 led to sizable improvements across all fit indices. Furthermore, BIC clearly indicated that the model excluding Item 3 fit the data better than the original model. Loadings ranged between .54 and .74 for the prevention factor and between .41 and .52 for the promotion factor, except for Item 3, which loaded very weakly on its factor with .29. After removal of Item 3, the promotion factor loadings improved slightly to between .42 and .54. The correlation of the latent factors was r = .12 with and r = .15 without Item 3.

Table 5 Model fit indices of the calculated two factor models
Full size table

The analysis of measurement invariance revealed clear evidence for metric invariance across males and females as well as across age groups, as neither the χ2-statistic nor the CFI or the GH indicated statistically significant differences (or just barely significant differences in the case of the χ2-test for age groups). Scalar invariance however could not be confirmed unequivocally. The differences in the GH index for both comparisons were not larger than .01, however both the CFI and the χ2-test indicated significant differences between models (Table 6).

Table 6 Fit indices for the multigroup analysis
Full size table

Validity

The RFQ Promotion and the RFQ Prevention scales were correlated with the conceptually related scales mentioned in the Introduction in order to examine the construct validity of the RFQ. These scales include: a behavioral-motivational scale (BIS/BAS), a core self-evaluation questionnaire (CSES), a personality scale (BFI-10), an instrument measuring optimism and pessimism (LOT), as well as three short questionnaires assessing somatic and mental health-related constructs (PHQ-4, SSS-8, Health VAS). Correlation coefficients are presented in Table 7.

Table 7 Correlations between the RFQ scales and further psychological measures
Full size table

Differences based on socio-demographic variables

Means and standard deviations of all compared groups are presented in Table 1. Women were found to be significantly more prevention-oriented than men, t(1015) = 3.63, p < .001, d = 0.29, 95% CI [0.13; 0.46]. However there was no difference with regard to promotion focus, t(1015) = −.104, p = .917, d = 0.02, 95% CI [−0.18; 0.15].

Age groups did not differ significantly in terms of promotion focus, F(3,1020) = 3.17, p = .024, η2 = .01, 90% CI [< 0.01; 0.02], and prevention focus F(3,1020) = 2.94, p = .032, η2 = .01, 90% CI [< 0.01; 0.02]. None of the post-hoc comparisons were significant.

There were no significant differences across groups of family status for either promotion, F(3,1000) = 3.52, p = .015, η2 = .01, 90% CI [< 0.01; 0.02], or prevention focus, F(3,1000) = 1.76, p = .154, η2 = .01, 90% CI [< 0.01; 0.01]. None of the post-hoc comparisons were significant.

Groups of various levels of net household income differed significantly with regard to their prevention focus, F(3,1020) = 8.90, p < .001, η2 = .03, 90% CI [0.01; 0.04], but not in terms of their promotion focus, F(3,1020) = 2.42, p = .065, η2 = .01, 90% CI [< 0.01; 0.02]. Post-hoc tests revealed that the low income group scored higher on the prevention scale than the moderate income groups, p = .008, d = 0.27, 95% CI [0.11; 0.43], and also higher than the high income groups, p < .001, d = 0.39, 95% CI [−0.24; 0.54].

Finally, there were significant differences in both promotion focus, F(5,1018) = 4.24, p = .001, η2 = .02, 90% CI [0.01; 0.03], and prevention focus, F(5,1018) = 5.49, p < .001, η2 = .03, 90% CI [0.01; 0.04], across groups of employment status. Post-hoc tests showed the differences in promotion focus to be between unemployed participants and those working full time, p < .001, d = 0.77, 95% CI [0.45; 1.10] between unemployed participants and those working part time, p = .004, d = 0.63, 95% CI [0.28; 0.98], as well as between unemployed participants and those in training/education, p < .001, d = 0.78, 95% CI [0.46; 1.10]. Unemployed participants showed the lower scores in all of these comparisons. Differences in prevention focus were found between those working full time and those in training/education, p < .001, d = 0.32, 95% CI [0.18; 0.46], with those in full time employment displaying lower prevention focus.

Discussion

The aim of the present study was to translate the RFQ into German, to test its psychometric properties, and examine aspects of validation. All items showed good psychometric properties with the exception of Item 3, which displayed a poor correlation with the total scale score. Additionally, factor loadings in EFA as well as in CFA were good for all items except Item 3. Higgins and colleagues [17] had found a similarly small factor loading of .37 for Item 3 on the promotion factor. Therefore, despite the original intention of making the German version of the scale as comparable as possible to the English version, Item 3 had to be excluded from the scale. Reliability coefficients were good for the prevention scale and questionable for the promotion scale, even with the exclusion of Item 3. Previous research suggests that the application of translated questionnaires in different countries or cultures can lead to a decline in reliability, especially when reverse-scored items are used [59, 60]. This could explain the present findings with regard to the promotion scale and Item 3. To put these findings in perspective, it is important to note that even with a reliability as low as .60, strong correlations of up to r = .77 towards other constructs are possible, as evidenced by the high correlations of the promotion scale with the CSES and the LOT.

Fit indices for the two-factor model including Item 3 indicated acceptable fit. However, there was a decided improvement of the fit between data and model, when Item 3 was removed from the promotion scale. Weak factorial (or metric) measurement invariance could be shown for gender as well as age groups. Although strong factorial (or scalar) measurement invariance was indicated for both groups by the acceptable deviation in GH, this evidence is ambiguous because of the larger than .01 difference in CFI between models. Measurement invariance would suggest that participants across groups respond to the given items in a comparable manner with regard to the latent construct. Thus, it is important to unambiguously confirm or reject scalar invariance of the measure in a more representative sample of the general population. We suspect this potential deviation from invariance to be founded in the wording of the original English items, for which there was never an analysis of measurement invariance.

Largely, we could find the expected pattern of correlations for the promotion subscale, but only in part for the prevention subscale. Overall, the promotion scale had moderate to strong associations with most of the employed questionnaires, suggesting good convergent validity. Correlations for the prevention scale were however much lower than they were for the promotion scale. This is in line with previous research consistently showing higher correlations for promotion than for prevention focus [61, 62]. We suspect that these low associations might be due to the prevention focus scale’s focus on a person’s childhood experiences as opposed to current personality traits. This is also a crucial limitation to not just the German version of the scale but the RFQ in general. As predicted, promotion focus correlated positively with behavioral activation and negatively with behavioral inhibition, while prevention focus correlated negatively with behavioral activation and positively with behavioral inhibition. This replicates the findings of Summerville and Roese [15], who found very similar correlations. Promotion focus was shown to be a very good predictor for evaluations of self-esteem and capabilities, as evidenced by the correlation with the CSES. Furthermore, promotion focus displayed relations with all dimensions of the BFI – not just openness and extraversion -, while prevention focus was only moderately associated with Conscientiousness, Extraversion, and Agreeableness. In keeping with Hazlett and colleagues [34], promotion focus correlated negatively with pessimism and positively with optimism, while prevention focus did not show the expected associations. Finally, promotion as well as prevention focus were associated with health-related outcomes, although the (weak negative) correlation of prevention focus was not expected.

Several differences in regulatory focus based on sociodemographic variables became apparent. Firstly, females were found to be significantly more prevention focused then men. Secondly, individuals with a lower monthly net household income exhibited higher prevention focus than those with higher incomes. Finally, unemployment was related to lower promotion focus, while students/apprentices showed higher prevention focus than those working full time. The differences in regulatory focus across employment status groups correspond to a moderately large effect. This is a very interesting finding and may warrant further investigation. Regulatory focus could therefore play a role in developments leading to unemployment or unemployment could lead to a decline of promotion focus.

Regulatory focus is an important construct in personality and social psychology and is highly relevant towards important domains such as work-related outcomes. Therefore, the RFQ can be recommended for application in all fields dealing with motivation and goal attainment processes.

Limitations

When comparing the sample with population averages obtained from the Federal Statistical Office of Germany [63], it became clear that representativeness can not be assumed. The present study sample was relatively young. In addition, women are over- and men under-represented. Furthermore, the sample was more educated than expected in the general population, with more than 80 % reporting a university entrance qualification, compared to roughly 30 % in the general population. Household net income was reported as lower than the population average, which could also be because of the high number of singles and young people in the sample. Lastly, study participants were more likely to be students or apprentices, and less likely to be working, unemployed, staying at home, or retired. Therefore, the RFQ should be examined with a more representative sample in further studies in order to establish norm values.

Strong measurement invariance could not be shown unambiguously. There is clear evidence for metric invariance for gender and age groups but full scalar invariance could not be demonstrated beyond a doubt. Therefore, the comparisons between sociodemographic groups should be interpreted with caution. Further analysis in representative samples is recommended.

In terms of convergent validity, it became clear that especially the prevention focus subscale warrants further investigation, as it showed weak to moderate correlations across the board, despite good psychometric properties, such as high reliability – especially when taken in context of the high correlations the promotion subscale achieved in spite of its low reliability.

Finally, the present study is entirely based on cross-sectional self-reports. Therefore, we can not make any predictions with regard to behavior apart from the association with other personality measures.

Conclusion

Overall, the RFQ is a measure of regulatory focus that shows acceptable reliability and good validity towards related psychological constructs. Factor structure and fit between data and theoretical model were very good. Therefore, the German RFQ can recommended for use in research of regulatory focus and practical applications.

References

  1. Förster J, Grant H, Idson LC, Higgins ET. Success/failure feedback, expectancies, and approach/avoidance motivation: how regulatory focus moderates classic relations. J Exp Soc Psychol. 2001;37(3):253–60.

    Article  Google Scholar 

  2. Higgins ET. Beyond pleasure and pain. Am Psychol. 1997;52(12):1280–300.

    Article  PubMed  Google Scholar 

  3. Higgins ET. Promotion and prevention: regulatory focus as a motivational principle. In: Zanna MP, editor. Advances in experimental social psychology volume 30, edn. New York: Academic Press; 1998. p. 1–46.

    Google Scholar 

  4. Liberman N, Idson LC, Camacho CJ, Higgins ET. Promotion and prevention choices between stability and change. J Pers Soc Psychol. 1999;77(6):1135.

    Article  PubMed  Google Scholar 

  5. Brockner J, Higgins ET. Regulatory focus theory: implications for the study of emotions at work. Organ Behav Hum Decis Process. 2001;86(1):35–66.

    Article  Google Scholar 

  6. Brockner J, Higgins ET, Low MB. Regulatory focus theory and the entrepreneurial process. J Bus Ventur. 2004;19(2):203–20.

    Article  Google Scholar 

  7. Higgins ET, Shah J, Friedman R. Emotional responses to goal attainment: strength of regulatory focus as moderator. J Pers Soc Psychol. 1997;72(3):515.

    Article  PubMed  Google Scholar 

  8. Kark R, Van Dijk D. Motivation to lead, motivation to follow: the role of the self-regulatory focus in leadership processes. Acad Manag Rev. 2007;32(2):500–28.

    Article  Google Scholar 

  9. Lockwood P, Jordan CH, Kunda Z. Motivation by positive or negative role models: regulatory focus determines who will best inspire us. J Pers Soc Psychol. 2002;83(4):854.

    Article  PubMed  Google Scholar 

  10. Pham MT, Avnet T. Ideals and Oughts and the reliance on affect versus substance in persuasion. J Consum Res. 2004;30:503–18.

    Article  Google Scholar 

  11. Friedman RS, Förster J. The effects of promotion and prevention cues on creativity. J Pers Soc Psychol. 2001;81(6):1001.

    Article  PubMed  Google Scholar 

  12. Cunningham WA, Raye CL, Johnson MK. Neural correlates of evaluation associated with promotion and prevention regulatory focus. Cogn Affect Behav Neurosci. 2005;5(2):202–11.

    Article  PubMed  Google Scholar 

  13. Amodio DM, Shah JY, Sigelman J, Brazy PC, Harmon-Jones E. Implicit regulatory focus associated with asymmetrical frontal cortical activity. J Exp Soc Psychol. 2004;40(2):225–32.

    Article  Google Scholar 

  14. Molden DC, Lee AY, Higgins ET. Motivations for promotion and prevention. In: Shah JY, Gardner WL, editors. Handbook of motivation science. New York: Guilford Press; 2008. p. 169-87.

  15. Summerville AR, N. J. Self-report measures of individual differences in regulatory focus: a cautionary note. J Res Pers. 2008;42(1):247–54. 10.1016/j.jrp.2007.05.005.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Haws KL, Dholakia UM, Bearden WO. An Assessment of Chronic Regulatory Focus Measures. J Mark Res. 2010;47(5):967–82. 10.1509/jmkr.47.5.967.

    Article  Google Scholar 

  17. Higgins ET, Friedman RS, Harlow RE, Idson LC, Ayduk ON, Taylor A. Achievement orientations from subjective histories of success: promotion pride versus prevention pride. Eur J Soc Psychol. 2001;31(1):3–23.

    Article  Google Scholar 

  18. Hamstra MR, Van Yperen NW, Wisse B, Sassenberg K. Transformational-transactional leadership styles and followers’ regulatory focus. J Pers Psychol 2011. doi: 10.1027/1866-5888/a000043.

  19. Sassenberg K, Ellemers N, Scheepers D. The attraction of social power: the influence of construing power as opportunity versus responsibility. J Exp Soc Psychol. 2012;48(2):550–5.

    Article  Google Scholar 

  20. Sassenberg K, Hansen N. The impact of regulatory focus on affective responses to social discrimination. Eur J Soc Psychol. 2007;37(3):421–44.

    Article  Google Scholar 

  21. Sassenberg K, Jonas KJ, Shah JY, Brazy PC. Why some groups just feel better: the regulatory fit of group power. J Pers Soc Psychol. 2007;92(2):249.

    Article  PubMed  Google Scholar 

  22. Keller J, Bless H. Regulatory fit and cognitive performance: the interactive effect of chronic and situationally induced self-regulatory mechanisms on test performance. Eur J Soc Psychol. 2006;36(3):393–405. 10.1002/ejsp.307.

    Article  Google Scholar 

  23. Fellner B, Holler M, Kirchler E, Schabmann A. Regulatory focus scale (RFS): development of a scale to record dispositional regulatory focus. Swiss J Psychol. 2007;66(2):109–16.

    Article  Google Scholar 

  24. Lanaj K, Chang C-H, Johnson RE. Regulatory focus and work-related outcomes: a review and meta-analysis. Psychol Bull. 2012;138(5):998.

    Article  PubMed  Google Scholar 

  25. Zenger M, Körner A, Maier GW, Hinz A, Stöbel-Richter Y, Brähler E, Hilbert A. The core self-evaluation scale: psychometric properties of the German version in a representative sample. J Pers Assess. 2015;97(3):310–8.

    Article  PubMed  Google Scholar 

  26. Rammstedt B, John OP. Measuring personality in one minute or less: a 10-item short version of the big five inventory in English and German. J Res Pers. 2007;41(1):203–12.

    Article  Google Scholar 

  27. Vaughn LA, Baumann J, Klemann C. Openness to experience and regulatory focus: evidence of motivation from fit. J Res Pers. 2008;42(4):886–94.

    Article  Google Scholar 

  28. Yen CL, Chao SH, Lin CY. Field testing of regulatory focus theory. J Appl Soc Psychol. 2011;41(6):1565–81.

    Article  Google Scholar 

  29. Glaesmer H, Hoyer J, Klotsche J, Herzberg PY. Die deutsche version des Life-Orientation-Tests (LOT-R) zum dispositionellen Optimismus und Pessimismus. Zeitschrift für Gesundheitspsychologie. 2008;16(1):26–31.

    Article  Google Scholar 

  30. Kivimäki M, Vahtera J, Elovainio M, Helenius H, Singh-Manoux A, Pentti J. Optimism and pessimism as predictors of change in health after death or onset of severe illness in family. Health Psychol. 2005;24(4):413.

    Article  PubMed  Google Scholar 

  31. Plomin R, Scheier MF, Bergeman CS, Pedersen NL, Nesselroade JR, McClearn GE. Optimism, pessimism and mental health: a twin/adoption analysis. Personal Individ Differ. 1992;13(8):921–30.

    Article  Google Scholar 

  32. Keller PA. Regulatory focus and efficacy of health messages. J Consum Res. 2006;33(1):109–14.

    Article  Google Scholar 

  33. Leiner DJ: SoSci survey (version 2.6.00-i) [computer software]. ;2015.

    Google Scholar 

  34. Hazlett A, Molden DC, Sackett AM. Hoping for the best or preparing for the worst? Regulatory focus and preferences for optimism and pessimism in predicting personal outcomes. Soc Cogn. 2011;29(1):74.

    Article  Google Scholar 

  35. Strobel A, Beauducel A, Debener S, Brocke B. Eine deutschsprachige Version des BIS/BAS-Fragebogens von Carver und White. Zeitschrift für Differentielle und Diagnostische Psychologie. 2001;22(3):216–27.

    Article  Google Scholar 

  36. Judge TA, Erez A, Bono JE, Thoresen CJ. The core self-evaluations scale: development of a measure. Pers Psychol. 2003;56(2):303–31. 10.1111/j.1744-6570.2003.tb00152.x.

    Article  Google Scholar 

  37. Herzberg PY, Glaesmer H, Hoyer J. Separating optimism and pessimism: a robust psychometric analysis of the revised life orientation test (LOT-R). Psychol Assess. 2006;18:433–8. 10.1037/1040-3590.18.4.433.

    Article  PubMed  Google Scholar 

  38. Glaesmer H, Rief W, Martin A, Mewes R, Brähler E, Zenger M, Hinz A. Psychometric properties and population-based norms of the life orientation test revised (LOT-R). Br J Health Psychol. 2012;17:432–45. 10.1111/j.2044-8287.2011.02046.x.

    Article  PubMed  Google Scholar 

  39. Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, Schneider A, Brähler E. A 4-item measure of depression and anxiety: validation and standardization of the patient health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord. 2010;122(1):86–95.

    Article  PubMed  Google Scholar 

  40. Gierk B, Kohlmann S, Kroenke K, Spangenberg L, Zenger M, Brähler E, Löwe B. The somatic symptom scale–8 (SSS-8): a brief measure of somatic symptom burden. JAMA Intern Med. 2014;174(3):399–407.

    Article  PubMed  Google Scholar 

  41. Brooks R, Rabin R, de Charro F. The measurement and valuation of health status using EQ-5D: a European perspective. Dordrecht, The Netherlands: Kluwer Academic; 2003.

    Book  Google Scholar 

  42. Velicer WF. Determining the number of components from the matrix of partial correlations. Psychometrika. 1976;41(3):321–7. 10.1007/bf02293557.

    Article  Google Scholar 

  43. Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30(2):179–85.

    Article  PubMed  Google Scholar 

  44. O'Connor BP. SPSS and SAS programs for determining the number of components using parallel analysis and velicer’s MAP test. Behav Res Methods Instrum Comput. 2000;32(3):396–402.

    Article  PubMed  Google Scholar 

  45. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.

    Article  Google Scholar 

  46. Hu L, Bentler PM. Fit indices in covariance structure modeling: sensitivity to Underparameterized model misspecification. Psychol Methods. 1998;3(4):424–53.

    Article  Google Scholar 

  47. MacCallum RC, Browne MW, Sugawara HM. Power analysis and determination of sample size for covariance structure modeling. Psychol Methods. 1996;1(2):130–49.

    Article  Google Scholar 

  48. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol Res Online. 2003;8:23–74.

    Google Scholar 

  49. Jöreskog KG, Sörbom D. LISREL 8: structural equation modeling with the SIMPLIS command language: scientific software international; 1993.

    Google Scholar 

  50. Kass RE, Raftery AE. Bayes factors. J Am Stat Assoc. 1995;90(430):773–95.

    Article  Google Scholar 

  51. Raftery AE. Bayesian model selection in social research. Sociol Methodol. 1995;25:111–63.

    Article  Google Scholar 

  52. Steiger JH. EzPATH: a supplementary module for SYSTAT and SYGRAPH. Evanston, IL: SYSTAT; 1989.

    Google Scholar 

  53. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233–55.

    Article  Google Scholar 

  54. Milfont TL, Fischer R. Testing measurement invariance across groups: applications in cross-cultural research. Int J Psychol Res. 2010;3:112–31.

    Article  Google Scholar 

  55. Cohen J. A power primer. Psychological Bulletin. 1992, 112(1). doi: https://0-doi-org.brum.beds.ac.uk/10.1037/0033-2909.112.1.155

  56. Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis. Upper Saddle River, NJ: Prentice Hall; 2010.

    Google Scholar 

  57. Nunnally JC, Bernstein I. Psychological theory. New York: McGraw-Hill; 1994.

    Google Scholar 

  58. George D, Mallery M. Using SPSS for windows step by step: a simple guide and reference. 2003.

    Google Scholar 

  59. Spector PE, Liu C, Sanchez JI. Methodological and substantive issues in conducting multinational and cross-cultural research. Annu Rev Organ Psychol Organ Behav. 2015;2(1):101–31.

    Article  Google Scholar 

  60. Spector PE, Van Katwyk PT, Brannick MT, Chen PY. When two factors don’t reflect two constructs: how item characteristics can produce artifactual factors. J Manag. 1997;23(5):659–77.

    Google Scholar 

  61. Rusu A, Hojbotă A-M, Sălăgean N. Measuring chronic regulatory focus in Romania: adaptation of the regulatory focus questionnaire. Rom J Appl Psychol. 2015;17(2):45–51.

    Google Scholar 

  62. van Vianen AE, Klehe U-C, Koen J, Dries N. Career adapt-abilities scale—Netherlands form: psychometric properties and relationships to ability, personality, and regulatory focus. J Vocat Behav. 2012;80(3):716–24.

    Article  Google Scholar 

  63. Federal Statistical Office of Germany. Population 2013. https://www.destatis.de/DE/ZahlenFakten/GesellschaftStaat/Bevoelkerung/Bevoelkerung.html. Accessed 12 Feb 2016.

Download references

Acknowledgements

We are grateful to Susanne Rau, Stefan Wrabetz, Mark Martin, and Alexander von Eisenhart Rothe for the careful back-translation of the questionnaire.

Funding

The authors received no funding for the reported research.

Availability of data and materials

The dataset used and analysed during the current study is available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

  1. Department of Psychology, University of Münster, Münster, Germany

    Bjarne Schmalbach

  2. Faculty of Applied Human Studies, University of Applied Sciences Magdeburg-Stendal, Stendal, Germany

    Markus Zenger & Ileana Steffens-Guerra

  3. Integrated Research and Treatment Center (IFB) AdiposityDiseases - Behavioral Medicine, Medical Psychology and Medical Sociology, University of Leipzig Medical Center, Leipzig, Germany

    Markus Zenger

  4. Department of Psychology and Counselling, University of Chichester, Chichester, UK

    Roy Spina

  5. Criminological Research Institute of Lower Saxony, Hannover, Germany

    Sören Kliem

  6. Department of Psychology, University of Cyprus, Nicosia, Cyprus

    Michalis Michaelides

  7. Department of Medical Psychology and Medical Sociology, University of Leipzig, Leipzig, Germany

    Andreas Hinz

Authors
  1. Bjarne Schmalbach
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Markus Zenger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Roy Spina
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ileana Steffens-Guerra
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sören Kliem
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michalis Michaelides
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Andreas Hinz
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All listed authors have made substantial contributions to the present research in one way or another. BS, MZ, RS, and IS contributed to conceptualization and design of the study as well as writing of the manuscript. IS and MM contributed to the data collection and analysis as well as writing of the manuscript. AH and SK contributed to the discussion of the results and writing of the manuscript. All authors agree to be accountable for the content of the work. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Markus Zenger.

Ethics declarations

Ethics approval and consent to participate

The present study was conducted in accordance with the Declaration of Helsinki. The ethics commission of the University of Applied Sciences Magdeburg-Stendal (AZ-3973-51) approved of the study as reported. Participants gave their informed consent before they were allowed to participate in the study. Participants under the age of 18 were not recruited.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schmalbach, B., Zenger, M., Spina, R. et al. Gain +1 or Avoid −1: Validation of the German Regulatory Focus Questionnaire (RFQ). BMC Psychol 5, 40 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s40359-017-0207-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s40359-017-0207-y

Keywords

BMC Psychology

ISSN: 2050-7283

Contact us