Abstract

The DIERS formetric 4D provides a safe method to monitor and track the progression of postural deformities over time. However, further evaluation of reliability is necessary. Reference values are also needed to indicate postural change. The current study examined the reliability of spine shape parameters produced by the formetric 4D in adults without postural abnormalities and established reference values to determine when real change occurs. Thirty participants were scanned during 1 week. Intraclass correlation coefficients (ICCs) were calculated for 40 spine shape parameters for scans with participants stationary between scans, scans with repositioning between scans, and between days. Within-day and between-day standard error of measurement (SEM), absolute relative SEM, and smallest detectable change (SDC) were reported. ICC for stationary scans was excellent for 29 parameters, good for 10 parameters, and fair for 1 parameter. With repositioning, ICC was excellent for 27 parameters, good for 12 parameters, and fair for 1 parameter. Between days, ICC was excellent for 26 parameters, good for 10 parameters, and fair for 4 parameters. Within-day SEM% was greater than 10% for 6 parameters. Within-day SDC ranged from 1.80 to 25.03 units for a single scan and from 0.97 to 17.93 units for 6 scans. Between-day SEM% was greater than 10% for 9 parameters. Between-day SDC ranged from 1.44 to 28.24 units for a single scan and from 1.05 to 22.2 units for 6 scans. Thirty-six of the 40 spine shape parameters from the DIERS formetric 4D reliably distinguished between participants over time. Reference values were established that can be used to track patient postural change over time. Future research should investigate the clinical relevance of these 40 spine shape parameters and determine when a clinically important change in posture occurs.

1. Introduction

Surface topography (ST) has been used on humans to produce 3-dimensional mapping of the body surface. One ST instrument, the formetric 4D (DIERS Medical Systems, Chicago, IL), shines parallel lines of light across the surface of the posterior trunk and, based on the distortion of those lines, reconstructs a digital image of the surface of the back and depicts a model of the vertebrae of the spine. This approach also produces unique postural measures based on skin surface reference points. Current standards for assessing posture are based on measurements from vertebral bony surfaces on spinal X-rays. A number of the formetric 4D measures have concurrent criterion validity with X-ray measures [16]. Other ST measures have been validated independently of X-ray comparison [79]. Because ST provides the ability to assess posture over time without the possible adverse effects from exposure to radiation, ST has been proposed as an alternative to X-ray. Because clinicians are familiar with managing patients using spinal X-rays, authors have suggested using both ST and X-ray for baseline measurements, then tracking posture more frequently with ST, and reassessing with X-ray when postural change is observed to reduce radiation exposure [2]. To characterize the clinical value of ST tracking of postural changes, ST measurements must be valid and reliable, and examiners need reference values to determine when an actual change has occurred to determine the clinical usefulness of these measures.

To demonstrate reliability, ST should be able to distinguish between participants in a population (i.e., high intraclass correlation coefficient [ICC]) [1012] and exhibit agreement between repeated measurements of participants with stable posture (i.e., low standard error of measurement [SEM]). From SEM, the smallest detectable change (SDC) can be established to help clinicians determine whether a change in a measure is an actual change and not measurement error [11, 13]. The formetric 4D reports 40 named spine shape parameters. Evidence indicates that subsets of these parameters are reliable in healthy participants [8, 1417] and in adolescents with idiopathic scoliosis [1, 2, 18, 19] when measurements are collected within a day [1, 2, 8, 1420], over several days [14, 15, 17, 19], and by different technicians [16, 18, 19]. Of the 29 of 40 parameters previously studied, 21 were evaluated in only a single study [8, 17, 19], and only one study reported the SDC for 7 parameters [19]. Although most studies evaluating the reliability of the formetric 4D used ICC as their reliability index, the intended clinical value of the formetric 4D lies in its ability to track posture; therefore, SEM and SDC must be more thoroughly evaluated.

In the current study, we examined the reliability of all named spine shape parameters produced by the formetric 4D in adults without postural deformities using ICC and SEM, and determined SDC for each parameter to establish standards for monitoring postural change. We accounted for variability in posture attributable to moment-to-moment postural change associated with body sway and breathing, to the testing procedure, and to postural variability over 1 week.

2. Materials and Methods

Thirty participants, balanced between male and female and 3 body mass index (BMI) groups, were recruited from the local community through e-mail, posters, and word-of-mouth. Exclusion criteria included a history of spine surgery, back tattoos, or an inability to stand without assistance. The local institutional review board approved the study. All participants completed informed consent before participating.

The formetric 4D scanning protocol performed in the current study was consistent with the manufacturer’s guidelines and has been previously reported in detail [21]. Participants were positioned 2 meters from the formetric 4D projection and camera unit (Figure 1). The unit projected stripes of light on the surface of the participant’s back (Figure 2(a)). Images of the surface of the back were recorded, digitized, and represented in 3D space (Figure 2(b)). Surface mean and Gaussian curvature were calculated (Figure 2(c)), and the underlying spine was rendered (Figure 2(d)). Each scan recorded 12-13 images over 6 seconds (2 Hz) and was processed based on the manufacturer’s instructions. The instrument then produced 40 named spine shape parameters from a single image that is closest to the average position of the participant. Being unaware of the degree of measurement error this modality produces, the current study used data from each image to calculate the average for each scan and compared them to the manufacturer’s reported values. Spine shape parameters were sorted into 5 subgroups (Table 1).

To determine the error attributed to moment-to-moment postural variability associated with body sway and breathing, participants were scanned 6 times within 6 minutes while they remained stationary between scans. Participants were scanned 6 times with repositioning (stepping off and on the evaluation platform) between scans to evaluate the impact of the set-up procedure on reliability. To determine the level of variability that occurs when posture can be assumed to be functionally stable, the stationary participant between-scan protocol was repeated on 5 days during 1 week within 1 hour of the same time as the original set of scans.

2.1. Statistical Analysis

Paired t-tests were used to test for any difference between the results from the single image closest to the average image and the calculated average from the 12 images. To test whether BMI affected the variability of parameters, within-participant variance was calculated and modelled for 3 BMI ranges (BMI1 = 20–24.9, BMI2 = 25–29.9, and BMI3 = 30–35).

Between-scan ICC for scans with stationary participants between scans (ICC-SBS) was calculated using a nested random effects model (model 1) built for each parameter using each image [21] from the 6 scans on each day. The ICC for scans with repositioning between scans (ICC-R) was calculated using another nested random effects model (model 2) for each parameter using each image from each of the 6 scans. To estimate between-day ICC (ICC-BD), variance estimates from model 1 were used. Parametric bootstrapping [22] was used to calculate the associated 95% confidence interval (CI) for each ICC. The Fleiss ICC (2, 1) formula was used to calculate ICC. ICC less than 0.40 indicated poor reliability, 0.4–0.59 indicated fair reliability, 0.6–0.74 indicated good reliability, and 0.75–1.0 indicated excellent reliability [23].

To measure actual change within the participant, SEM, SEM%, and SDC estimates were calculated. SEM% was calculated for parameters that report only positive or only negative values because parameters that cross zero in repeated scans bring the mean parameter value close to zero and disproportionately inflate SEM%. A value below 10% indicated high measurement stability [11, 24]. Using repositioning scans, within-day SEM% and SDC, which is the 95% CI of the change in parameter value [11], were calculated.

An additional set of random effects models (model 3) were built using data from the first scan from the first 4 days and all 6 repositioning scans. Between-day SEM, SEM%, and SDC were calculated for this model. Additional details about our models, ICC, SEM, and SDC calculations are available in Supplementary Materials 1. All analyses were performed with SAS version 9.4 (SAS Institute, Inc., Cary, NC). A value <0.05 was considered statistically significant.

3. Results

Thirty participants (white, age 30.1 ± 10.1 years, BMI 27.3 ± 4.6) completed the study. The dataset for 1 participant, a single stationary scan for another participant, and a single repositioning scan for a third participant were excluded because clothing obstructed the view of critical landmarks during data collection. In the final analysis, 1042 scans (13,547 images) were used from 15 males (age 31.9 ± 11.9 years, BMI 27.5 ± 4.2) and 14 females (age 28.1 ± 7.6 years, BMI 27.2 ± 5.1). For all parameters, no difference was found between mean parameter values produced from the single image closest to the average image selected by the formetric 4D and the calculated average from all 12 images within a scan (). The BMI1 and BMI3 groups each included 5 male and 5 female participants, while the BMI2 group included 5 male and 4 female participants. No difference was found in mean variability between the 3 BMI groups for all parameters ().

Of the 40 spine shape parameters, 29 had excellent reliability for ICC-SBS, 10 were good, and 1 was fair (Table 2). For ICC-R, 27 parameters had excellent reliability, 12 were good, and 1 was fair. For ICC-BD, 26 parameters had excellent reliability, 10 were good, and 4 were fair.

Within-day SEM% and SDC were calculated from model 2 for a single scan (SDC1) and 6 scans (SDC6). Within-day SEM% was less than 10% for 19 of 25 parameters whose values did not cross zero (Table 3). Between-day SEM% and SDC were calculated from model 3. SEM% was less than 10% for 16 parameters (Table 3) and greater than 10% for 9 parameters. Within-day and between-day SDC1 and SDC6 are reported in Table 3. In both cases, SDC6 was smaller than SDC1 for each parameter. Variance estimates provided in Supplementary Materials 2 can be used to calculate SDC2–5. Figure 3 presents an example of these variance estimates for the kyphotic angle.

4. Discussion

The current study was conducted to determine whether the 40 spine shape parameters of the DIERS formetric 4D can be used reliably in adults without postural deformity. We accounted for several sources of variability by analyzing data from each image (i.e., within scan), from scans during 1 day (stationary between scans and with repositioning), and from 5 days during 1 week to get precise estimates of variance to evaluate reliability. Mean and SD were reported for each parameter to describe the study cohort. ICC, SEM, and SEM% were used to evaluate the reliability of each of the parameters. We calculated within-day SDC to help clinicians know how to interpret parameter change when data is collected before and after interventions on the same day and calculated between-day SDC to evaluate postural change over longer periods of time. While we expected larger BMIs would increase variability, no significant differences in variability were observed up to a BMI of 35.0. Similar findings were reported for small subsets of parameters [8, 16, 20], but no study evaluated the full extent of the defined spine shape parameters as in the current study.

4.1. Reliability: Intraclass Correlation Coefficient

We estimated ICC to determine whether the formetric 4D can produce reliable data to distinguish between participants. To understand how variability from body sway and breathing influences reliability, ICC-SBS was calculated from scans where participants were stationary between scans. In previous studies where only a single image was collected per scan [8, 19] or a scan was reported as an average of images [17], the influence of body sway and breathing on reliability was minimized because within-scan variability was not fully accounted for. By using each image from each scan in the calculation of ICC, we accounted for all available within-scan variance. Overall, ICC-SBS was excellent (n = 29) to good (n = 10) for 39 of the 40 spine shape parameters, indicating moment-to-moment postural variability attributed to body sway and breathing has minimal influence on the measurement’s reliability.

Concerned that repositioning the participant between consecutive scans could cause variability, we evaluated reliability when participants repositioned themselves between scans. Our ICC-R indicated repositioning had little effect on the reliability of the spine shape parameters. We found good agreement with previously reported parameters [8, 14, 17]. In a healthy population, only apical deviation left was reported to have fair ICC on a single day [14]; in the current study, apical deviation had good reliability. Because the previous study did not report their sample variance [14], the ability to make comparisons is limited. For 14 parameters that had not been previously reported in a population without postural deformities, the current study determined reliability ranged from excellent to good (0.96–0.61).

To determine the impact of normal day-to-day postural variability on reliability, ICC was used to evaluate data collected on 5 days during 1 week. Between days, 26 parameters had excellent reliability and 10 parameters had good reliability. These results supported previously reported excellent to good reliability between days for 19 spine shape parameters [14, 17]. The good reliability observed for pelvic torsion in the current study, however, was better than that of Guidetti et al. [14], where follow-up scans were completed on an unspecified separate day. In another study, scans were repeated the following day and the following week and demonstrated similar reliability to ours [17].

Four parameters (angle of coronal imbalance, vertebral rotation amplitude, trunk torsion, and vertebral rotation RMS (root mean square)) had fair ICC-BD in the current study but showed excellent to good reliability in previous studies [14, 17]. Reliability of the first 3 parameters decreased from good ICC-R to fair ICC-BD. Because these parameters had good ICC-SBS and ICC-R and the between-participant variability was constant, the decrease in reliability from ICC-R to ICC-BD can be attributed to incidental day-to-day postural variability that may be related to variations in fluctuating factors such as hydration, fatigue, or stress. Although these 3 parameters may provide useful information when repeated scans are completed during a single day, they were more susceptible to daily postural variability and should be used with caution to track posture over time.

Only vertebral rotation RMS had fair ICC in all 3 assessments. Vertebral rotation RMS represents the calculated RMS of the rotational amplitude along the entire spine. The fair ICC for this parameter may be explained by our population characteristics. Because ICC is more reflective of between-participant variance than within-participant measurement error [11], a population without postural deformities is more likely to have a smaller distribution of measurements (between-participant variance) than those with scoliosis or other postural deformities; thus, a lower ICC would be expected. Tabard-Fougere et al. [19] and Manca et al. [25] measured vertebral rotation RMS with excellent reliability in patients with adolescent idiopathic scoliosis; this higher reliability was likely because of the wider distribution of measurements in those populations (mean = 5.6 ± 2.6 and 6.8 ± 3.6, respectively). Only one other study reported ICC for this parameter in healthy participants [17], but because their sample had a wider distribution of measurements, they also reported higher reliability.

4.2. Measurement Error

In the current study, SEM was used to measure agreement between repeated scans to determine when spine shape parameters can be used to track change. SEM measures noise in repeated measurements from systematic and random error. A small SEM implies that the parameter has less variability and, therefore, is more reliable. Unlike ICC, SEM does not have specific reference values to indicate whether SEM is small enough to be clinically useful. Therefore, we used SEM% and SDC to evaluate the relative noise and to indicate when the actual change occurred.

SEM% was able to be calculated for 25 spine shape parameters. We used a threshold value of 10% to indicate high measurement stability [24]; however, this threshold is not universally accepted [11]. Within-day SEM% for 19 of the 25 parameters was below 10%, suggesting that these parameters may be most reliable, and thus most useful in detecting actual change over time. Six parameters in the spinal deviation subgroup had a within-day SEM% greater than 10%. These six parameters may not be precise enough to detect when a clinically meaningful postural change has occurred in a population without postural deformities. Between days, SEM% for 16 of the 25 parameters was below 10%. Three additional parameters to those listed above, flèche lombaire (depth of lumbar lordosis), flèche cervicale VP (depth of cervical lordosis at the vertebral prominens), and pelvic inclination appeared to be more susceptible to normal daily human variability. Only one other study considered these 4 parameters, but the authors used coefficient of variation, a similar statistic and threshold to SEM%, and reported values greater than 10% [17].

4.3. Clinical Applications

In general, clinicians can have confidence that the 4D formetric is reliable and that the sources of circumstantial error from breathing and postural sway are being accounted for in the standard processing performed by the instrument. So how should the current study’s data be applied clinically? To determine if an immediate change in posture occurs after an intervention, the difference between preintervention and postintervention readings should be compared to within-day SDC1. The clinician should have confidence that any number greater than SDC1 indicates actual change in posture. Narrower SDC thresholds for all spine shape parameters can be easily achieved by doing repeated scans with the participant being repositioned between scans. This influence can be observed in the graphical example for kyphotic angle (Figure 3). Clinicians can use data in Supplementary Materials 2 for other spine shape parameters of specific interest to create their scanning standards, balancing scanning and processing time for repetitive scans to the value of increased SDC precision.

To track posture over time, between-day SDC1 should be used because it accounts for variability from normal day-to-day postural, instrument, and procedural factors. To our knowledge, only one study [19] has reported SDC for 7 spine shape parameters. Although our results found a smaller within-day and between-day SDC for 6 of the 7 parameters, that study [19] evaluated a cohort with scoliosis and used a single image of data in their analysis.

Overall, the DIERS 4D formetric is a relatively new system for evaluating posture with building evidence of the reliability of its 40 defined spine shape parameters. Several of these parameters, which are similar to measurements performed on postural spinal X-rays, have shown a reasonable level of concurrent criterion validity [16], with the formetric 4D reporting consistent but not identical values to X-rays. Because the remainder of the parameters measure something different from an X-ray, it is not possible to compare those measures with the clinical gold standard. These parameters have demonstrated criterion validity in comparison to models with calibrated surface measures. The current study addressed issues of reliability, a requirement of a valid measure, and defined the SDC of the spine shape parameters, thus allowing clinicians and researchers to know when change is not from measurement error. The next step is to determine how SDC relates to the construct of a clinically meaningful change. Determining the minimal clinically important difference (MCID)—the change in a parameter that is clinically important—is key to determining the value of integrating ST into standard medical care. Future research needs to evaluate SDC and patient-reported and functional measures for larger, more diverse populations over time, so reference values for both SDC and MCID can be established for relevant populations. Since the formetric 4D provides a safe, easily used, and objective measure of posture, these longitudinal studies can be easily performed, especially through multicenter collaborations.

4.4. Limitations

The current study had several limitations. Our sample population was narrow consisting of young to middle-aged adult participants with specific BMI ranges and no diagnosed postural deformities, so results can only be generalized to similar populations. In addition, data from only 29 participants were included in the final analysis. Studies have suggested including 15 to 50 participants in reliability studies [12, 26]. In our study, 36 repeated measurements on 29 participants allowed us to calculate precise variance estimates for reliability calculations [11] and were adequate for reliability testing. In the future, a larger and more diverse sample size would help to further refine reference values. Each subgroup in the analysis of the influence of BMI on variability included only 9-10 participants, but findings were similar to those previously reported. Further, one technician performed all scans so interobserver reliability could not be assessed although previous work has reported high interobserver reliability for the formetric 4D when automatic localization of landmarks occurred [3, 16, 18, 19].

5. Conclusions

The current study found that 36 of the 40 defined spine shape parameters from the DIERS formetric 4D can be used reliably to distinguish between participants during 1 week. Variability attributed to body sway and breathing was adequately accounted for by the study’s protocol, and repositioning did not significantly affect reliability. Four parameters (vertebral rotation RMS, angle of coronal imbalance, vertebral rotation amplitude, and trunk torsion) appeared to be more susceptible to variability over time and, therefore, may not be appropriate for tracking postural change. Reference values to track postural change in participants without postural deformities were reported for each parameter using SDC.

Data Availability

The variance estimates used to support the findings of this study are included in the supplementary information file. The raw data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

The authors would like to acknowledge Deborah Goggin, MA, ELS, from the Department of Research Support, A.T. Still University, for editing the manuscript, Vanessa Pazdernik, MS, from the Department of Research Support, A.T. Still University, for statistical support, and Geoffroey-Allen Franklin, MBA, from the A.T. Still Research Institute, A.T. Still University, for assistance in data management. This work was supported by the Osteopathic Heritage Foundation Endowment (grant no. 509-305).

Supplementary Materials

Supplementary Material 1: additional description of the equations used for the statistical analysis. Supplementary Material 2: within-day and between-day  variance estimates for each spine shape parameter. (Supplementary Materialsor remove altogether)