Skip to main content

Psychometric properties of the painDETECT questionnaire in rheumatoid arthritis, psoriatic arthritis and spondyloarthritis: Rasch analysis and test-retest reliability

Abstract

Background

Pain is inherent in rheumatoid arthritis (RA), psoriatic arthritis (PsA) and spondyloarthritis (SpA) and traditionally considered to be of nociceptive origin. Emerging data suggest a potential role of augmented central pain mechanisms in subsets of patients, thus, valid instruments that can identify underlying pain mechanisms are needed. The painDETECT questionnaire (PDQ) was originally designed to differentiate between pain phenotypes. The objectives were to evaluate the psychometric properties of the PDQ in patients with inflammatory arthritis by applying Rasch analysis and to explore the reliability of pain classification by test-retest.

Methods

For the Rasch analysis 900 questionnaires from patients with RA, PsA and SpA (300 per diagnosis) were extracted from ‘the DANBIO painDETECT study’. The analysis was directed at the seven items assessing somatosensory symptoms and included: 1) the performance of the six-category Likert scale; 2) whether a unidimensional construct was defined; 3) the reliability and precision of estimates. Another group of 30 patients diagnosed with RA, PsA or SpA participated in a test-retest study. Intraclass Correlation Coefficients (ICC) and classification consistency were calculated.

Results

The Rasch analysis revealed: (1) Acceptable psychometric rating scale properties; the frequency distribution peaked in category 0 except for item 5, threshold calibration >10 observations per category, no disorder in the category measures for all items, scale category outfit Mnsq <2.0, small distances (<1.4 logits) between thresholds for category 1, 2 and 3 for all items. (2) The principal component analysis supported unidimensionality; the standardized residuals showed that 53.7% of total variance was explained by the measure and the magnitude of first contrast had an eigenvalue of 1.5, no misfitting items, clinical insignificant different item hierarchies across diagnoses (DIF < 0.5 logits). (3) A targeted item-person map, person and item separation indices of 1.88(reliability = 0.78), and 13.04 (reliability = 0.99). The test-retest revealed: ICC: RA 0.86(0.56–0.96), PsA 0.96(0.74–0.99), SpA 0.93(0.76–98), overall 0.94(0.84–0.98). Classification consistency was: RA 70%, PsA 80%, SpA 90%, overall 80%.

Conclusion

The results support that the PDQ can be used as a classification instrument and assist identification of underlying pain-mechanisms in patients suffering from inflammatory arthritis.

Background

Rheumatoid arthritis (RA), psoriatic arthritis (PsA) and spondyloarthritis (SpA) are considered systemic inflammatory rheumatic diseases that cause joint destruction, disability and pain. The traditional approach to pain management has focused on treatment of the underlying disease using anti-inflammatory, disease-modifying drugs [1, 2]. However, in some patients, pain does not improve despite seemingly good inflammatory control [3,4,5,6,7]. This suggests that although peripheral tissue inflammation significantly contributes to nociceptive pain generation in inflammatory arthritis [8], augmented central pain-processing may play a prominent role in persistent pain [6].Thus, there is a need for instruments that can assist in identifying patients with augmented central pain mechanisms and thereby help tailor an effective, individualised treatment.

To the best of our knowledge no instruments have been developed specifically to assist in mechanisms-based pain classification of patients with inflammatory joint disorders. The painDETECT questionnaire (PDQ) is a symptom-based assessment tool developed to assist identification of neuropathic pain [9]. It assigns a score to the patients, which classifies pain into three groups: neuropathic, unclear or non-neuropathic (nociceptive) pain. Neuropathic pain is characterized by allodynia, hyperalgesia, dysesthesia and sudden pain; somatosensory symptoms assessed by the PDQ [10]. Emerging evidence supports that there are striking pain phenotypic similarities between neuropathic pain and pain conditions characterised by augmented central pain processing; that is how patients express their symptoms of abnormal sensory perceptions and the quality of their pain [11]. Based on this overlap, the PDQ has been used as indicator of augmented central pain processing in patients with osteoarthritis and fibromyalgia [12,13,14,15] and recently, the PDQ has been introduced in studies of pain mechanisms in patients with RA [16, 17] and SpA [18]. Satisfactory psychometric properties of the PDQ have been demonstrated within osteoarthritis [19]. However, they remain to be evaluated within inflammatory arthritis and it is well-established that the psychometric properties of a questionnaire may vary depending on the population it is used in [20]. Because the PDQ is gaining ground as pain phenotyping instrument within these diagnoses, the psychometric properties, should be investigated as a prerequisite to implementing the PDQ in clinical research or daily practice, in order to secure valid and reliable pain classification of these particular patients. Rasch analysis allows detailed analyses of an instruments’ rating scale structure and measurement properties and as such it also gives important information for evaluation of the trichotomous classification system of the PDQ. Rasch analysis has traditionally been applied to questionnaires to evaluate a hierarchy of the items e.g. in the SF-36 [21], but it has also been shown to be useful in questionnaires where the items are equally descriptive of the condition as in the PDQ [22]. Furthermore, Rasch analysis includes a mathematical reliability measure describing how well an instrument differentiates between groups; patients with different pain phenotypes. Finally, large variation in the examined population e.g. with regard to disease severity and gender can ensure generalisability [23].

Whether an instrument has reliable classification ability, can be further investigated by test-retest, which will give an estimation of the stability [20]. Pain phenotypes are as such not expected to alter, thus the classification thereof should be consistent. Estimation of intraclass correlation coefficients based on exact scores can further support reliablity.

The overall purpose of this study was to evaluate the psychometric properties of the PDQ in patients with inflammatory joint disease (RA, PsA, SpA). Specifically, to conduct Rasch analysis, including reliability analysis of pain classification by means of person and item distinction in a sample of patients representing all diagnoses, both genders and every degree of activity of the disease. Further, to explore the agreement of scores and the stability of pain classification by test-retest.

Methods

Study design and setting

The Danish DANBIO-registry is a nationwide rheumatologic clinical quality registry, which covers >90% of adults treated with biologics due to rheumatic disease [24]. The registry also includes data on patients treated with synthetic disease-modifying antirheumatic drugs (DMARDs). Before routine clinical control of the arthritic condition, the patients regularly complete diagnosis specific patient reported outcomes on the DANBIO touch screens in the doctors waiting room. The rheumatologist registers corresponding objective clinical outcomes, hence common rheumatologic disease activity measures such as the disease activity score-28 joints (DAS28) [25, 26] and ankylosing spondylitis disease activity score (ASDAS) [27] are available. These scores are composite scores including subjective and objective parameters of level of inflammatory activity and global health and thus describe the current degree of activity of the specific disease.

Data for the Rasch analysis was acquired from ‘The DANBIO painDETECT study’ (in review), which was a cross-sectional survey describing the prevalence of pain phenotypes among patients with inflammatory arthritis in Denmark. After feasibility was demonstrated during a piloting period of a month at Frederiksberg Hospital, an electronic version of the PDQ was implemented nationwide on the DANBIO touch screens for 6 months (1 Dec 2013–1 June 2014). The test-retest study took place at the Department of Rheumatology, Frederiksberg Hospital, where patients with the diagnoses RA, PsA or SpA registered in DANBIO were randomly invited to complete the PDQ twice on the DANBIO touch screens in connection with a clinical control. Based on clinical opinion the retest should take place within ≥1 and <5 days after the first completion in order to reduce the influence of change in the underlying disease (ongoing peripheral inflammation) [20].

Participants

To be eligible for inclusion in the Rasch analysis the PDQ had to be complete and originate from a patient who had a disease activity score registered on the same day as the questionnaire was completed. Given the very large sample, we were able to include questionnaires from patients with different degrees of disease activity. Seeking to ensure generalizability, it was decided that: 1) the extraction of questionnaires should be stratified in thirds according to three disease activity categories (low, moderate and high) defined by DAS28 or ASDAS, and 2) there should be an equal distribution of gender within the single diagnosis and disease activity category. Finally, patients with PsA may suffer from either peripheral and/or axial involvement [28], hence both DAS28 and ASDAS were accepted as disease activity scores. In cases where both scores were reported, the highest score defined the disease activity category.

These criteria restricted the sample, primarily because of the relatively low number of patients having a high disease activity score (53 women with SpA had a high ASDAS), which led to the final extraction procedure: for each diagnosis within each disease activity category, complete questionnaires from the first 50 female respondents and the first 50 male respondents were included.

In all, a sample of 900 questionnaires from 300 participants with either of the diagnoses (RA, PsA, SpA) and 450 of each gender was compiled. Still, this high number is considered more than sufficient to obtain stable item calibrations in defined subgroups (diagnosis/disease, activity category/gender) with 99% confidence, given good targeting [29].

In the test-retest study, the sample size calculation for the Intraclass correlation coefficient (ICC) was based on the assumption that the observed ICC value across all diagnoses would be ≥0.95 [30], also aiming at a confidence interval narrow enough for the lower 95% confidence limit to be above >0.80. With 10 participants, the 95% CI around an ICC of 0.95 would correspond to 0.83–0.99. Accordingly, the inclusion for the test-retest study was open until 10 patients with each of the diagnoses RA, SpA or PsA had completed the painDETECT twice with no missing data. Patient’s disease activity was scored on the test-day.

The painDETECT questionnaire (PDQ)

The PDQ was originally developed and validated for pain classification purposes [9] and has been translated into several languages, including Danish (www.pfizerpatientreportedoutcomes.com). The PDQ comprises 12 items. The first three assess current pain, strongest pain during the past 4 weeks, and average pain during the past 4 weeks on a 0–10 point numerical rating scale from “none” to “worst imaginable”. The fourth item includes a chart representation of four pain course patterns depicting persistence, fluctuation and attacks; the patients have to choose the one resembling their pain pattern the most. The fifth item display a mannequin on which the patients mark their area of pain and pain radiation also responding to a yes/no question about the presence of radiating pain. The remaining seven questions regarding the presence and severity of somatosensory signs and symptoms are rated on a six-category Likert scale (from never (0) to very strongly (5)): (1) burning sensation in the painful areas, 2) tingling or prickling in areas of pain, 3) light touching is painful, 4) sudden pain attacks in areas of pain, 5) cold or heat is occasionally painful, 6) numbness in the painful areas, 7) slight pressure triggers pain) [9, 14]. For diagnostic purposes, a validated algorithm is used to calculate a total score ranging from −1 to 38. Pain intensity ratings are not included in the total score. The selection of one of four pain course patterns contributes to the total score with a value ranging from −1 to 1; the absence/presence of radiating pain with a value of 0 or 2; and the presence and severity of evaluated somatosensory signs and symptoms with a value ranging from 0 to 35. The resulting total score classifies pain into three groups: a score > 18 indicates that the presence of a predominant neuropathic pain component is likely, a score of 13 to 18 is considered uncertain, and a score < 13 indicates that a neuropathic pain component is not likely present [9]. Used for classification purposes, the PDQ has a sensitivity and specificity of 84% (electronic version) in a mixed chronic pain population using clinician-assessed diagnosis of pain mechanism as a criterion based validity index [9].

Statistics

Baseline characteristics

Group differences were calculated using the non-parametric Kruskal-Wallis test for ordinal and interval variables and Chi-square test (n < 5; Fisher’s exact test) for categorical variables. SAS software (version 9.3; SAS Institute Inc., Cary; North Carolina, USA) was used for the statistical analyses.

Rasch analysis

Seven of the nine PDQ questions which contribute to the scoring algorithm were included in the Rasch analysis. This was because: 1) the majority of points achievable on the scoring algorithm, 35 out of 38, originate from these questions, and 2) the scoring of the remaining two elements of the PDQ does not have a character applicable to Rasch analysis [19]. The item that assesses pain course consists of four different patterns. A score of −1 is assigned to one of the patterns, 0 to another and finally 1 to the remaining two. The item of presence of pain radiation is dichotomous and has a score of either 0 or 2. Thus, neither of the scorings of these two items can logically be converted into an ordinal scale. This was not taken into consideration in the original development of the questionnaire as Rasch analysis was not performed [9]. Furthermore, it has been demonstrated by Moreton et al. [19] that these items perform less satisfactorily in Rasch analysis. The Rasch analysis was carried out applying the Rasch computer program WINSTEPS 3.90.0 [31]. Statistics evaluating aspects of validity and reliability were generated, including fit of the data to the Rasch model assertions [23, 32]. The measures of severity of neuropathic pain symptoms and the item difficulty measures are expressed in logits (log-odds probability units) [33]. Rasch analysis procedures have been described in detail elsewhere [23, 32, 34], hence our description of the Rasch method used is brief.

The analyses were undertaken to assess: first, the performance of the six-category Likert scale (rating scale properties); second, whether the seven items defined a unidimensional construct ‘neuropathic pain’ (unidimensionality); third, the reliability and precision of pain classification by the seven items (precision and reproducibility).

It was decided that the partial credit model (PCM) [35] would be used should the data not fulfil the criteria for the rating scale model (RSM). Both models are used with polytomous data (i.e. data derived from response scales with more than two categories). The PCM assumes that the distance is not the same between different response categories.

Based on Linacre’s guidelines [36, 37], the performance of the Likert scale was addressed with a rating scale analysis initially per diagnosis, followed by an analysis including all diagnoses. Five properties were examined; the frequency distributions, threshold calibration (<10 observations per category), monotonic increase in category measures, scale category outfit (Mnsq), and order of thresholds.

Analysis of dependency was based on correlation statistics that was interpreted as follows: correlation > 0.7 high local dependency, <0.4 low local dependency [34].

To address whether the seven somatosensory items of the PDQ defined a unidimensional construct (i.e. neuropathic pain), a principal component analysis (PCA) of the standardised residuals was performed and the item and person goodness-of-fit statistics were examined [38, 39]. When analysing goodness of fit, underfit and overfit to the Rasch model were evaluated to identify poorly fitting items that needed removal [23]. Also infit and outfit statistics were taken into consideration [23]. Critical values for mean squares were calculated based on the sample sizes for the separate diagnosis (infit MnSq = 1.12, outfit MnSq = 1.35, ZSTD < 2) and overall (infit MnSq =1.06, outfit MnSq S = 1.2, ZSTD < 2) respectively [40]. Subsequently, an evaluation of differential item functioning (DIF) was performed investigating diagnosis, gender and disease activity separately. DIF occurs when the item difficulty estimates vary between groups and items exhibiting DIF therefore, may represent a threat to unidimensionality. Additionally, the hierarchical order of item difficulties across diagnoses was explored.

The precision and reproducibility of the item difficulty estimates and the neuropathic pain severity measures were evaluated by the overall separation and reliability indices. To obtain a desired reliability coefficient of 0.80 for replicability of person and item ordering [23], the separation indices must be at least 2.0, and the reliability index should be as close as possible to 1.0 (range 0.0–1.0) [41]. Further, the item-person map showing the threshold distribution of items and persons respectively was assessed. Match of the range of the two distributions was considered good targeting.

Test-retest reliability

The PDQ was originally designed as a classification tool, and not intended for outcome measurement, thus, the primary statistical analysis for test–retest reliability was based on Intraclass correlation coefficient (ICC) statistics (absolute agreement) [42]. IBM SPSS Statistics 19 software was used for these analyses. A priori, the interpretation of the results was defined as follows: values greater than 0.7 represent acceptable agreement, while values greater than 0.8 represent strong agreement and greater than 0.9 very strong agreement [42]. Finally, the classification consistency (i.e. proportion of no change in pain phenotype) was calculated, as the PDQ originally was designed as a classification tool.

Results

Study sample

In the original ‘DANBIO painDETECT study’ in all 15,978 patients were invited to participate in the survey. They were registered as having any form of RA, PsA, SpA or unspecific inflammatory arthritis (UA) (osteoarthritis not included). In all, 7054 (44.2%) patients completed the PDQ (RA; N = 3826. PsA; N = 1180. SpA; N = 1093. UA; N = 955), while 864 (5.4%) partially completed the PDQ, 6133 (38.4%) declined to participate, and 1927 (12.0%) registered themselves as ‘pain-free’ (excluded).

Of the 7054 complete questionnaires, 4853 were eligible for the Rasch analysis (RA; N = 3199. PsA; N = 921. SpA; N = 723). Due to the strict inclusion procedure the final sample was 900.

Baseline characteristics

Baseline characteristics of the Rasch sample are shown in Table 1. Group differences were found across disease activity categories within all diagnoses. Four differences were found across diagnoses for the baseline test-retest sample including age, disease duration, treatment with DMARD and swollen joint count (Table 2).

Table 1 Baseline characteristics of the Rasch population stratified by disease activity level
Table 2 Baseline characteristics of the test-retest population

Rating scale properties

The likelihood ratio test indicated lack of fit to an interval model (RSM, p < 0.001). Accordingly, the analysis was continued using the PCM [35]. Initially, the diagnostic groups were analysed separately, and subsequently they were combined in one overall analysis. Only minor differences were found between diagnoses; the analyses revealed a frequency distribution that peaked in category 0 of the Likert scale except for item 5 (cold or heat is occasionally painful), which peaked in category 4 for RA and PsA, and category 3 for SpA. In the overall analysis, the distribution for item 5 peaked in category 4. In the diagnosis specific analysis, the threshold calibration showed >10 observations per category except for category 5 in items 3 (light touching is painful) and 4 (sudden pain attacks in areas of pain) for RA, in items 2 (tingling or prickling areas of pain), 3 and 4 for PsA, and in items 2 and 4 for SpA. In the overall analysis >10 observations were found in all categories. Monotonic increase of the category measures was found for all of the items, both in the diagnosis specific and in the overall analysis. With the exception of item 4 in category 5 (few counts) for SpA, the scale category outfit revealed a Mnsq <2.0, indicating no introduction of noise to the measurement in any category. Threshold disordering was found for items 1 (burning sensation in the painful areas), 3, 4, 6 (numbness in the painful areas) and 7 (slight pressure triggers pain) for RA; items 6 and 7 for PsA; item 2, 3 and 6 for SpA and items 2 and 6 in the overall analysis. Small distances (less than 1.4 logits) between thresholds were found in all analyses across all items for categories 1, 2 and 3 (hardly noticed, slightly, moderately) suggesting lack of distinction between categories. Correlations did not indicate dependency for the individual diagnoses or overall sample; RA (0.09– -0.33), PsA (−0.03– -0.37), SpA (0.03– −0.35), overall (−0.01– -0.35).

Unidimensionality

The PCA of the standardised residuals revealed that 57.5% (RA), 52.6% (PsA), 53.1% (PsA) and 53.7% (overall) of the total variances were explained by the measures, respectively and that the magnitude of first contrast had an eigenvalue of 1.6 (RA, PsA, SpA) and 1.5 (overall) both supporting unidimensionality. Table 3 shows the fit statistics. Items 5 and 6 had mean square values above the infit criteria across diagnoses. DIF was observed within all areas tested; gender, diagnosis and disease activity, however the DIF contrasts were well below 0.5 logits [34]. Regarding gender, the DIF was related to items 3 and 4, where it was easier for men to obtain a high score, and items 5 and 6 where it was easier for women to obtain a high score. Furthermore, there was DIF across the three diagnostic groups on items 1, 2, 4 and 7 as illustrated in Fig. 1. This gives rise to different item hierarchies across diagnoses as shown in Table 4, where diagnosis specific item hierarchies based on item difficulty calibrations are presented. In the current analyses, items with a positive calibration were the most difficult (i.e. difficult to obtain a high score; least endorsed), whereas items distributed at the negative end of the scale were the easiest (i.e. easy to obtain a high score; most endorsed). Item number 5 had the same ranking in the hierarchy across all diagnoses being the easiest item, whereas items number 2 and 4 were the two most difficult items. Finally, there was DIF for disease activity for item 2 indicating that participants with high disease activity reported higher scores with regard to tingling or prickling in the painful areas.

Table 3 Item fit statistics
Fig. 1
figure 1

Differential item functioning (DIF) plot illustrating different item difficulty across diagnoses

Table 4 Item difficulty measures causing the different item hierarchies across diagnoses

Precision and reproducibility

The item-person distribution map, Fig. 2, illustrates that the items and participants were targeted and only 3 participants had maximum scores, thus no actual ceiling effect was observed. There was an indication of lack of easier items to capture the persons with less severe neuropathic pain symptoms. In the overall analysis which showed similar results as the diagnosis specific analyses, the person separation index was 1.88 (reliability = 0.78), and the item separation index was found to be 13.04 (reliability = 0.99).

Fig. 2
figure 2

Item-person map illustrating the threshold distributions. The most difficult items and the person with most severe neuropathic pain are shown at the left. Each item is shown in three rows representing different rating scale measures. Items; Center: the mean item difficulty calibration. Bottom: measure level corresponding to a probability of 0.5 of being rated in the lowest category of the rating scale. Top: measure level coresponding to a probability of 0.5 of being rated in the highest category of the scale

Test-retest reliability

Complete data were obtained from thirty participants, ten from each of the three diagnostic groups. The median (IQR) response time between test and retest was 2.5 (2–3) days. The median (IQR) PDQ ‘test’ scores were: RA 15(12–19), PsA 16 (7–27), SpA 7.5 (2–15), total 13.5 (7–19). The median PDQ ‘retest’ scores were RA 13 (10–18), PsA 13.5 (3–25), SpA 5.5 (1–15), total 11.5 (4–18). Intraclass correlation coefficients (ICC) were: RA 0.86 (0.56–0.96), PsA 0.96 (0.74–0.99), SpA 0.93(0.76–98) and total 0.94 (0.84–0.98). The Bland-Altman plots, Fig. 3, illustrate the differences between test and retest scores. The distribution of number of participants in the three PDQ classification categories according to diagnosis is reported in Table 5. Three, two and one participant with RA, PsA and SpA, respectively, changed classification group. This corresponded to a classification consistency of pain phenotype of 70% within RA, 80% within PsA, 90% within SpA, and 80% among participants in total. Those participants who changed group, changed between non-neuropathic and unclear (n = 1) or neuropathic and unclear (n = 5), with only few points between the first and second score.

Fig. 3
figure 3

Bland Altman plots showing the agreement of PDQ scores between test and retest. ‘In total’ refers to the total of all scores across diagnoses. The square in bold in the diagram showing ‘in total’ represents two patients

Table 5 Distribution of participants in the PDQ categories according to diagnosis in the test-retest study

Discussion

From the perspective of the Rasch model, the seven-item version of the PDQ assessing somatosensory symptoms of neuropathic pain demonstrated acceptable psychometric properties across all three diagnoses (RA, PsA and SpA), which was further supported by the test-retest analysis.

Current evidence suggests that both neuropathic pain and pain conditions characterised primarily by augmented central pain processing, e.g. fibromyalgia, may share similar neurobiological underpinnings [11]. Given that these mechanisms give rise to clinical symptoms, it may be expected that centrally mediated pain and neuropathic pain share clinical features, which are captured by neuropathic pain instruments based on somatosensory profiling such as the PDQ. Thus, the objective of this study was to investigate the psychometric properties of the PDQ when applied in pain classification in patients with RA, PsA and SpA. The study did not intend to evaluate construct validity, due to the lack of a clinically feasible and valid reference standard addressing this phenomenon.

The study showed overall acceptable rating scale properties of the PDQ supporting that the instrument may be used in pain classification; assigning patients to one of three categories based on a summed score and a validated algorithm. However, the rating scale analysis also demonstrated a potential for collapsing Likert-scale categories, as well as threshold disordering for items 2 and 6, in the overall analyses, which indicate that the summed PDQ score should be used with caution to grade the severity of neuropathic pain symptoms in inflammatory arthritis, in contrast to findings for osteoarthritis [19]. When focusing on unidimensionality, the test was satisfactory with all items representing the same construct ‘neuropathic pain’. DIF was found for different items for gender, diagnosis and disease activity. However, the magnitude of DIF contrasts was well below 0.5 logits, and hence had no clinical relevance [34]. This, together with the fact that the seven items of the PDQ assess the presence and severity of equally representative somatosensory symptoms of neuropathic pain, reduces the overall influence of the observed DIF on the total score, and it seems unlikely that it represented a threat to unidimensionality when the PDQ was used for classification of the construct ‘neuropathic pain’. Though unproven, there is a perception among some patients with inflammatory arthritis that warm conditions are related to symptom relief [43], which could explain the ranking of item 5 in the item hierarchies and the different use of the categories in the rating scale analysis.

The item–person map (Fig. 2) indicated that the PDQ had targeted items to the examined sample. No ceiling effect was found indicating that the items relevantly captured the neuropathic pain symptoms in the sample, the most severe included [23]. There was an indication of lack of easier items and subsequent lack of precision in the lower end of the scale, which may result from the design of the questionnaire only including items describing prototypical symptoms of neuropathic pain. With the exception of the item describing pain course pattern, no items describe prototypical symptoms of nociceptive pain, consequently the classification of nociceptive pain is based on the lack of neuropathic pain symptoms. This, we consider to be of less importance when the PDQ is being used to classify neuropathic pain. The indication of imprecision with regard to the item’s ability to distinguish between persons is probably explained by the same fact that the items are only describing symptoms of one phenomenon. High item separation was found, which may result from the very large sample size [23].

In the test-retest study, the ICCs reflected strong to very strong agreement depending on diagnosis while the Bland Altman plots showed some differences between test and re-test. In general the second score was lower than the initial score, which could be a result of a higher awareness of pain status, or actual reduction of symptoms, though this is not very likely having the short interval in mind. The PDQ is a classification instrument and accordingly we evaluated whether the difference in score that arose when the PDQ was administered repeatedly over days affected the classification group (pain phenotype). Consistent pain classification was obtained in 70% of participants with RA; 80% of participants with PsA; 90% of participants with SpA, and 80% of participants in total. This, in combination with the fact that no participants changed classification group between non-neuropathic and neuropathic pain indicated satisfactory consistency in pain classification.

Strengths and limitations

The inclusion of a large and diverse sample of patients with inflammatory rheumatic joint disorders was a great strength of the Rasch analysis. The study sample was not representative for the general patient population encountered in daily clinical care, but was chosen to represent as large a variation as possible to enable determination of the validity of the PDQ across the spectra of diagnoses, gender and disease activity. A limitation of the Rasch analysis was that two of the items were not applicable in the Rasch model [19] due to their character, though this may have been handled to some extent by transformation into interval level data, this was not done as there was no intention to create a scale for measuring change and others have demonstrated difficulties in doing so [19]. However, the somatosensory profiling of pain is based on the seven items subjected to analyses [14, 44]. It might be questioned whether the cut off points of the scale validated in patients with various chronic pain conditions are applicable in patients with inflammatory arthritis. Ideally, future research should address the criterion validity and the cut off points of the PDQ scale by testing it against a clinical ‘gold standard’. Although this standard currently does not exist, it could be approached for instance by constructing clinical consensus on signs and symptomatology and the use and interpretation of quantitative sensory testing, test of descending pain pathways and neuro-imaging. The test-retest study was based on a priori power calculations of ICC and was therefore limited by a somewhat small sample size in relation to classification consistency. Furthermore, the study sample reflected the characteristics of the distinct diagnosis and correspondingly differences in baseline characteristics across the three diagnoses were found. Measurement of C-reactive protein is included in the disease activity score, and therefore evaluation of disease activity at retest was not feasible.

Conclusion

In conclusion; from the perspective of the Rasch model, the seven-item version of the PDQ assessing somatosensory symptoms of neuropathic pain based on a six-category Likert scale, demonstrated sufficient psychometric properties when applied in a clinical sample of patients with RA, SpA and PsA. Consistency in pain classification was strong to very strong. It is therefore suggested that the PDQ may be used as an easily applied instrument assisting mechanism-based pain classification and identification of individuals with a significant central pain component, as strategies in addition to inflammatory disease suppression are likely to be required in the management of these patients.

Due to the observed relative problems with the rating scale, caution is urged in grading the severity of somatosensory symptoms in inflammatory arthritis.

Abbreviations

ASDAS:

Ankylosing spondylitis disease activity score

BASDAI:

Bath ankylosing spondylitis disease activity index

BASFI:

Bath ankylosing spondylitis function index

CRP:

C reactive protein

DAS28-CRP:

Disease activity score 28 joints C reactive protein

DIF:

Differential item functioning

DMARD:

Disease-modifying antirheumatic drug

FM:

Fibromyalgia

GH:

Global health

HAQ:

Health assessment questionnaire

HLA-B27:

Human leucocyte antibody, subtype B27

ICC:

Intraclass correlation coefficient

IQR:

Inter quartile range

Mnsq:

Mean-square

PCA:

Principal component analysis

PCM:

Partial credit model

PDQ:

PainDETECT questionnaire

PsA:

Psoriatic arthritis

RA:

Rheumatoid arthritis

RSM:

Rating scale model

SJC:

Swollen joint count

SpA:

Spondyloarthritis

TJC:

Tender joint count

UA:

Unspecific arthritis

VAS:

Visual analogue scale

References

  1. Smolen JS, Landewe R, Breedveld FC, Buch M, Burmester G, Dougados M, et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2013 update. Ann Rheum Dis. 2014;73(3):492–509.

    Article  CAS  PubMed  Google Scholar 

  2. Smolen JS, Braun J, Dougados M, Emery P, Fitzgerald O, Helliwell P, et al. Treating spondyloarthritis, including ankylosing spondylitis and psoriatic arthritis, to target: recommendations of an international task force. Ann Rheum Dis. 2014;73(1):6–16.

    Article  PubMed  Google Scholar 

  3. Lee YC, Cui J, Lu B, Frits ML, Iannaccone CK, Shadick NA, et al. Pain persists in DAS28 rheumatoid arthritis remission but not in ACR/EULAR remission: a longitudinal observational study. Arthritis Res Ther. 2011;13(3):R83.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Lee YC, Nassikas NJ, Clauw DJ. The role of the central nervous system in the generation and maintenance of chronic pain in rheumatoid arthritis, osteoarthritis and fibromyalgia. Arthritis Res Ther. 2011;13(2):211.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Leeb BF, Andel I, Sautner J, Nothnagl T, Rintelen B. The DAS28 in rheumatoid arthritis and fibromyalgia patients. Rheumatology (Oxford). 2004;43(12):1504–7.

    Article  CAS  Google Scholar 

  6. Phillips K, Clauw DJ. Central pain mechanisms in the rheumatic diseases: future directions. Arthritis Rheum. 2013;65(2):291–302.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Wolfe F, Hauser W, Hassett AL, Katz RS, Walitt BT. The development of fibromyalgia--I: examination of rates and predictors in patients with rheumatoid arthritis (RA). Pain. 2011;152(2):291–9.

    Article  PubMed  Google Scholar 

  8. Furst DE, Keystone EC, Braun J, Breedveld FC, Burmester GR, De BF, et al. Updated consensus statement on biological agents for the treatment of rheumatic diseases, 2011. Ann Rheum Dis. 2012;71(Suppl 2):i2–45.

    Article  CAS  PubMed  Google Scholar 

  9. Freynhagen R, Baron R, Gockel U, Tolle TR. painDETECT: a new screening questionnaire to identify neuropathic components in patients with back pain. Curr Med Res Opin. 2006;22(10):1911–20.

    Article  PubMed  Google Scholar 

  10. Baron R, Binder A, Wasner G. Neuropathic pain: diagnosis, pathophysiological mechanisms, and treatment. Lancet Neurol. 2010;9(8):807–19.

    Article  PubMed  Google Scholar 

  11. Maletic V, Raison CL. Neurobiology of depression, fibromyalgia and neuropathic pain. Front Biosci (Landmark Ed). 2009;14:5291–338.

    Article  CAS  Google Scholar 

  12. Amris K, Jespersen A, Bliddal H. Self-reported somatosensory symptoms of neuropathic pain in fibromyalgia and chronic widespread pain correlate with tender point count and pressure-pain thresholds. Pain. 2010;151(3):664–9.

    Article  PubMed  Google Scholar 

  13. Hochman JR, Davis AM, Elkayam J, Gagliese L, Hawker GA. Neuropathic pain symptoms on the modified painDETECT correlate with signs of central sensitization in knee osteoarthritis. Osteoarthr Cartil. 2013;21(9):1236–42.

    Article  CAS  PubMed  Google Scholar 

  14. Koroschetz J, Rehm SE, Gockel U, Brosz M, Freynhagen R, Tolle TR, et al. Fibromyalgia and neuropathic pain--differences and similarities. A comparison of 3057 patients with diabetic painful neuropathy and fibromyalgia. BMC Neurol. 2011;11:55.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Ohtori S, Orita S, Yamashita M, Ishikawa T, Ito T, Shigemura T, et al. Existence of a neuropathic pain component in patients with osteoarthritis of the knee. Yonsei Med J. 2012;53(4):801–5.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Ahmed S, Magan T, Vargas M, Harrison A, Sofat N. Use of the painDETECT tool in rheumatoid arthritis suggests neuropathic and sensization components in pain reporting. J Pain Res. 2014;7:579–88.

    PubMed  PubMed Central  Google Scholar 

  17. Koop SM, Ten Klooster PM, Vonkeman HE, Steunebrink LM, van de Laar MA. Neuropathic-like pain features and cross-sectional associations in rheumatoid arthritis. Arthritis Res Ther. 2015;17(1):237.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Wu Q, Inman RD, Davis KD. Neuropathic pain in ankylosing spondylitis - a psychophysics and brain imaging study. Arthritis Rheum. 2013;65(6):1494–1503.

  19. Moreton BJ, Tew V, das NR, Wheeler M, Walsh DA, Lincoln NB. Pain phenotype in patients with knee osteoarthritis: classification and measurement properties of painDETECT and self-report Leeds assessment of neuropathic symptoms and signs scale in a cross-sectional study. Arthritis Care Res (Hoboken). 2015;67(4):519–28.

    Article  Google Scholar 

  20. Streiner DL, Norman GR. Health measurement scales a practical guide to their development and use. Third ed. New York: Oxford University Press Inc.; 2003.

    Google Scholar 

  21. Hsiao YY, Shih CL, Yu WH, Hsieh CH, Hsieh CL. Examining unidimensionality and improving reliability for the eight subscales of the SF-36 in opioid-dependent patients using Rasch analysis. Qual Life Res. 2015;24(2):279–85.

    Article  PubMed  Google Scholar 

  22. Amris K, Omerovic E, Danneskiold-Samsoe B, Bliddal H, Waehrens EE. The validity of self-rating depression scales in patients with chronic widespread pain: a Rasch analysis of the major depression inventory. Scand J Rheumatol. 2016;45(3):236–46.

    Article  CAS  PubMed  Google Scholar 

  23. Bond TG, Fox CM. Applying the Rasch model. Fundamental measurement in the Human science. second ed. New Jersey: Lawrence Earlbaum Associates, Inc. Publicers; 2007.

    Google Scholar 

  24. Hetland ML. DANBIO--powerful research database and electronic patient record. Rheumatology (Oxford). 2011;50(1):69–77.

    Article  CAS  Google Scholar 

  25. Prevoo ML, van ‘t Hof MA, Kuper HH, van Leeuwen MA, van de Putte LB, Van Riel PL. Modified disease activity scores that include twenty-eight-joint counts. Development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis Rheum. 1995;38(1):44–8.

    Article  CAS  PubMed  Google Scholar 

  26. Salaffi F, Cimmino MA, Leardini G, Gasparini S, Grassi W. Disease activity assessment of rheumatoid arthritis in daily practice: validity, internal consistency, reliability and congruency of the disease activity score including 28 joints (DAS28) compared with the clinical disease activity index (CDAI). Clin Exp Rheumatol. 2009;27(4):552–9.

    CAS  PubMed  Google Scholar 

  27. van der Heijde D, Lie E, Kvien TK, Sieper J, den BF V, Listing J, et al. ASDAS, a highly discriminatory ASAS-endorsed disease activity score in patients with ankylosing spondylitis. Ann Rheum Dis. 2009;68(12):1811–8.

    Article  PubMed  Google Scholar 

  28. Gladman DD, Antoni C, Mease P, Clegg DO, Nash P. Psoriatic arthritis: epidemiology, clinical features, course, and outcome. Ann Rheum Dis. 2005;64(Suppl 2):ii14–7.

    PubMed  PubMed Central  Google Scholar 

  29. Linacre JM. Sample size and item calibration stability. Rasch Meas Trans. 1994;7(4):328.

    Google Scholar 

  30. Gudbergsen H, Bartels EM, Krusager P, Waehrens EE, Christensen R, Danneskiold-Samsoe B, et al. Test-retest of computerized health status questionnaires frequently used in the monitoring of knee osteoarthritis: a randomized crossover trial. BMC Musculoskelet Disord. 2011;12:190.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Winsteps® Rasch measurement computer program. Version 3.90.0 [computer program]. Version 3.90.0. Beaverton, Oregon: Winsteps.com: 2015.

  32. Wright BD, Masters GN. Rating Scale Analysis. Rasch Measurement. Chicago, IL 60637: MESA Press, 5835 S. Kimbark Avenue; 1982.

  33. Wright BD. Logits? Rasch Meas Trans. 1993;7:288.

    Google Scholar 

  34. Linacre JM. A User's Guide to Winsteps® Ministep Rasch-Model Computer Programs. In: Program Manual 3.91.0; 2015. Ref Type: Internet Communication.

    Google Scholar 

  35. Masters GA. A rasch model for partial credit scoring. Psychometrika. 1982;47(18):149–74.

    Article  Google Scholar 

  36. Linacre JM. Category disordering vs. step (threshold) disordering. Rasch Meas Trans. 1999;13:675.

    Google Scholar 

  37. Linacre JM. Investigating rating scale category utility. J Outcome Meas. 1999;3(2):103–22.

    CAS  PubMed  Google Scholar 

  38. Linacre JM, Wright BD. Construction of measures from many-facet data. J Appl Meas. 2002;3(4):486–512.

    PubMed  Google Scholar 

  39. Smith EV Jr. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3(2):205–31.

    PubMed  Google Scholar 

  40. Smith RM, Schumacker RE, Bush MJ. Using item mean squares to evaluate fit to the Rasch model. J Outcome Meas. 1998;2(1):66–78.

    CAS  PubMed  Google Scholar 

  41. Fisher WP. Reliability statistics. Rasch Meas Trans. 1992;6:238.

    Google Scholar 

  42. de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in Medicin. Cambridge: Cambridge University Press; 2011.

    Book  Google Scholar 

  43. Verhagen AP, Bierma-Zeinstra SM, Boers M, Cardoso JR, Lambeck J, de Bie R, et al. Balneotherapy (or spa therapy) for rheumatoid arthritis. Cochrane Database Syst Rev. 2015;4:CD000518.

    Google Scholar 

  44. Baron R, Tolle TR, Gockel U, Brosz M, Freynhagen R. A cross-sectional cohort survey in 2100 patients with painful diabetic neuropathy and postherpetic neuralgia: differences in demographic data and sensory symptoms. Pain. 2009;146(1–2):34–40.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors wish to thank all patients and Departments of Rheumatology in Denmark participating in the ‘DANBIO painDETECT study’. Furthermore, we wish to thank DANBIO and Zitelab ApS.

Funding

The study was supported by grants from Selsbjerg Holding, The Danish Rheumatism Association, Minister Erna Hamilton Legat for Videnskab og Kunst, Axel Muusfeldts Fond, Dagmar Marshalls Fond, Region Hovedstadens Forskningsfond, Bjarne Jensens Fond, and The Oak Foundation.

Availability of data and materials

Data are available from the Danish national rheumatolgic quality registry, DANBIO, for researchers who meet the criteria for access to confidential data. Contact: databasen@danbio-online.dk. “Data are from the DANBIO painDETECT study whose authors may be contacted at PARKER.Frederiksberg@regionh.dk”.

Authors’ contributions

SRM was principal investigator of this study. EEW conducted the Rasch analysis. SRM, EEW, BDS and KA all participated in the draft of the protocol, data interpretation and revision and approval of the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable. According to Danish legislation surveys do not require approval by Ethics Committees and registrations and publications of data from clinical registries do not require patient consent or approval by Ethics Committees. Approval was obtained from the Danish Data Protection Agency.

Informed consent

Patient consent was obtained from all participants on the DANBIO touch screens prior to redirection to the painDETECT questionnaire.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Signe Rifbjerg-Madsen.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rifbjerg-Madsen, S., Wæhrens, E.E., Danneskiold-Samsøe, B. et al. Psychometric properties of the painDETECT questionnaire in rheumatoid arthritis, psoriatic arthritis and spondyloarthritis: Rasch analysis and test-retest reliability. Health Qual Life Outcomes 15, 110 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-017-0681-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-017-0681-1

Keywords