Next Article in Journal
Sprint Variables Are Associated with the Odds Ratios of Non-Contact Injuries in Professional Soccer Players
Next Article in Special Issue
Factors Influencing Safety on Construction Projects (fSCPs): Types and Categories
Previous Article in Journal
Excess Body Weight and Long-Term Incidence of Lung and Colon Cancer in Men; Follow-Up Study of 43 Years
Previous Article in Special Issue
Minimum Clearance Distance in Fall Arrest Systems with Energy Absorber Lanyards
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Modeling Energy Expenditure Estimation in Occupational Context by Actigraphy: A Multi Regression Mixed-Effects Model

1
Department of Engineering and Environmental Sciences, Engineering Centre, Federal Rural University of Semi-arid Region, Mossoró 59625-900, RN, Brazil
2
Associated Laboratory for Energy, Transports and Aeronautics, LAETA (PROA), Faculty of Engineering, University of Porto, 4200-465 Porto, Portugal
3
Department of Production Engineering, Federal University of Paraíba, João Pessoa 58051-970, PB, Brazil
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(19), 10419; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910419
Submission received: 30 July 2021 / Revised: 14 September 2021 / Accepted: 30 September 2021 / Published: 3 October 2021
(This article belongs to the Special Issue Technical and Scientific Research on Occupational Health and Safety)

Abstract

:
The accurate prediction of energy requirements for healthy individuals has many useful applications. The occupational perspective has also been proven to be of great utility for improving workers’ ergonomics, safety, and health. This work proposes a statistical regression model based on actigraphy and personal characteristics to estimate energy expenditure and cross-validate the results with reference standardized methods. The model was developed by hierarchical mixed-effects regression modeling based on the multitask protocol data. Measurements combined actigraphy, indirect calorimetry, and other personal and lifestyle information from healthy individuals (n = 50) within the age of 29.8 ± 5 years old. Results showed a significant influence of the variables related to movements, heart rate and anthropometric variables of body composition for energy expenditure estimation. Overall, the proposed model showed good agreement with energy expenditure measured by indirect calorimetry and evidenced a better performance than the methods presented in the international guidelines for metabolic rate assessment proving to be a reliable alternative to normative guidelines. Furthermore, a statistically significant relationship was found between daily activity and energy expenditure, which raised the possibility of further studies including other variables, namely those related to the subject’s lifestyle.

1. Introduction

The accurate prediction of energy requirements for healthy individuals has many useful applications [1]. Various studies associated with energy expenditure have been conducted within different contexts. From the occupational perspective, it has also been proven to be of great utility for improving workers’ ergonomics, safety, and health [2,3,4,5,6,7,8,9].
The most accurate measurement methods considered are the double-labeled water method and direct and indirect calorimetry by oxygen consumption rate [2,10]. Alternatively, as direct measurements are complex, expensive, and unsuitable for field studies, several models have been adopted as a significant technique for assessing energy requirements [11]. Most of them, developed by regression methods, combine anthropometrics, physiological variables, and movement patterns and are accepted for predicting energy requirements over a wide variety of activities [2,12,13].
Concerning applicable current standards, ISO 8996:2004 [10] is the most relevant and sophisticated one, providing four different levels of accuracy for estimating or determining the metabolic rate, spanning from basic methods (occupation and activity classification) to the previously referred expertise procedures (double-labeled water and direct calorimetry). However, most methods involve some limitations for field measurements and are based on reference values only applicable to specific populations [14].
Furthermore, other alternative methods have emerged based on physical activities quantification to estimate energy expenditure, providing practical advantages. One of these methods is actigraphy, a technique based on movement monitoring with specific criteria to define sleep and wake states, offering minimal subject burden, versatility, and relative cost-efficiency [15,16]. The actigraphs are composed of multidirectional accelerometers, but some have other sensors such as gyroscopes, inclinometers, GPS, and light sensors. Studies on energy expenditure by actigraphy have been developed in both research and clinical settings, to analyze sleep–wake patterns [17], to examine the metabolic demands associated with specific occupational environments [18,19], and to evaluate energy requirements among patient groups [20] and resulting from free-living activities [21].
However, despite their advantages, when using accelerometers, researchers face a challenge identifying which of the available regression equations is best to predict energy expenditure for their study case [22,23]. There are indeed several equations to estimate energy expenditure using actigraphy. Most of these were developed by regression methods using oximetry, some physiological variables, and movement variables [15]. These current regression techniques collect and average accelerometer counts over a specified period and then are used to estimate energy expenditure following the relationship dictated by the prediction equation [15].
More recently, and despite not being widely adopted for use, machine learning modeling of raw accelerometer data has also emerged as a method with strong potential for improving estimates of physical activity and energy requirements from accelerometers [24]. Artificial neural networks, for example, have been applied to estimate energy expenditure by using, as input, demographic variables, physiological variables, and accelerometers signal features that vary during physical activities [24,25]. However, there is no clear evidence of the physiological variables influence on the outcomes of these calculation models, the most efficient number of variables, or the prioritization recommendations of specific variables to be inserted in the models.
In the face of the various methods to estimate energy expenditure, current research trends involve applying one or more prediction techniques and a small number of variables. On the other hand, from the occupational perspective, energy expenditure estimation is associated with work-related health and wellness, evaluating thermal stress and workload, and preventing musculoskeletal disorders and physiological stress [26]. Currently, there is no comprehensive research in which various methods are compared, encompassing an extensive range of characteristics to determine energy requirements from various activities applicable to occupational settings [26].
For occupational contexts, field measurement challenges are found that make the double-labeled water and indirect oximetry unfeasible to apply due to environmental issues, cost, and time restrictions [27]. In addition, tasks variability, multibody movements, and different levels of physical intensity combined make the assessment using a single model a challenging goal to achieve [12,13]. With the increased number of tasks with light or sedentary activities, it is difficult to generalize the energy expenditure for a diverse workforce, supporting the increased importance of personal factors (sex, age, and body composition, among others) in the assessment approach [28]. As a result, aiming to surpass some of these challenges [29,30], methods based on actigraphy combined with other calculation techniques give relevant and accurate results where the application of reference methods is unpracticable [31].
Regarding calculation methods, studies show that there is a diversity of techniques used to calculate energy expenditure [12,13], ranging from log-linear regression [24,32], support vector machine [12,33,34], decision trees [35], Bayesian classification [30], and regression networks [34]. Artificial neural networks are found in various configurations, such as the radial basis function network—RBFN, the generalized regression neural network—GRNN [36], and the multilayer perceptron feedforward artificial neural network—MLP-ANN [37].
Other alternatives involve modeling using hierarchical mixed regression or multilevel regression. Among various features, the multilevel regression technique allows incorporating the hierarchical nature of the data into the analyses, integrating variables measured at different levels of the hierarchy, and examining how regression relationships vary across clusters [38]. Using these modeling techniques makes it possible to decompose the variance and identify its portions: the explained variance that can be attributed by variation in such level and the unexplained variance (or residual variance) [39].
This work aims to propose an actigraphy-based model for energy expenditure estimation in the occupational context based on hierarchical regression modeling, and cross-validate the results obtained with the gold standard (indirect calorimetry) and other validated methodologies (normative guidelines from ISO 8996:2004 and predictive equations). The work is directly guided to occupational enforcement without restricting its application to other contexts covered by the proposed protocol and model.

2. Materials and Methods

The experimental trials were conducted at the Laboratory on Prevention of Occupational and Environmental Risks (PROA) at the Faculty of Engineering of the University of Porto and the Faculty facilities. The volunteers were fully informed of the details of the experimental procedures and were briefed on the purpose, potential risks, and benefits of the experiences. Written consent was read and signed by them prior to starting the trials. The Ethics Committee of the University of Porto approved the study (Report 106/CEUP/2021).

2.1. Sampling

Volunteers between the ages of 18 and 40 years, who declared themselves to be nonsmokers, not frequent users of supplements or dietary supplements, not to have a medical history or any other health condition that would indicate risks or compromise metabolic or cardiorespiratory functions, and not to have physical limitations or other restrictions of movement, were invited to participate in the experiment. The volunteers were invited to participate in the research by formal e-mail messages, and by disclosure on social networks.
Participants were excluded if they had metabolic diseases, cardiovascular diseases or limiting conditions, kidney diseases, diabetes, hypertension, neoplasms, pregnancy or suspected pregnancy, exertional asthma, allergies to any element or activity present in the experiment, condition or alteration of limbs that interferes with body movements, obesity above level I, depression, alcoholism, or suffering from the use of other substances.

2.2. Participants

A total of 54 subjects fulfilled the inclusion criteria and were tested. Four were excluded for not completing all the activities defined in the experimental protocol (Section 2.4).
As a result, 50 healthy men and women (16% black, 42% white, 40% mixed race and 2% Asian) between the ages of 18 and 40 years were included in the study and their physical characteristics are shown in Table 1. In general, participants were considered mentally and physically healthy, were nonsmokers and did not report any disease or medication known to alter metabolic rate nor physical or movement restrictions. Of them, 32% were considered to have a sedentary lifestyle, 42% were moderately active, and 26% were highly active.
Before the experience, each participant completed the informed written consent and two questionnaires. The first questionnaire involved general personal information, eating habits, clinical history, and physical activity level. Questions related to the level of physical activity were based on the Portuguese version of the International Physical Activity Questionnaire (IPAQ) [40]. The second questionnaire addressed inquiries related to sleeping time and quality and stress, anxiety, and depression indicators. Information on sleeping quality and time was collected using the short version of the Pittsburgh Sleep Quality Index questionnaire (PSQI) [41]. Similarly, anxiety, depression, and stress experienced at that moment were assessed through the 21-question version of the Depression Anxiety Stress Scales (DASS) [42].

2.3. Instrumentation and Facilities

The experiments were mostly conducted in a climatic chamber (FITOCLIMA 25000EC20). This chamber (3.20 m × 3.20 m) simulates an office environment and controls temperature to an accuracy of ±0.2 °C and relative humidity ±5%.

2.3.1. Indirect Calorimetry

Energy expenditure was measured from pulmonary gas exchange using a breath-by-breath portable gas analyzer (Cosmed K4b2, Rome, Italy).

2.3.2. Accelerometer-Derived Activity

For recording activity patterns, participants were asked to wear three accelerometers wGT3X-BT (ActiGraph, Pensacola, FL, USA) on their dominant limb in the wrist and ankle and on the right side of the hip. These devices are small in size and lightweight; 3.3 cm × 4.6 cm × 1.5 cm and 42.6 g, respectively. They are sensitive to accelerations from 0.05–2.0 G’s and have a band-limited frequency of 0.25–2.5 Hz. The ActiGraphs were set to sample at a rate of 30 Hz, and an 8-bit A/D converter digitized the signal. They were initialized to collect data in 1 s epochs, and the results were downloaded directly to a compatible computer using a USB cable. The cutpoints for free life activities were defined for the magnitude vector according to Freedson et al. [43].

2.3.3. Physiological Monitoring

A Polar H7 heart rate sensor (Polar Electro, New York, NY, USA) was used to measure cardiac activity, synchronizing its data with the recordings from the actigraphs and the K4b2. An eq02+ Equivital monitor chest belt (Hidalgo, Cambridge, UK) was used for physiological monitoring to record heart rate, respiratory frequency, skin temperature, and movement by accelerometry. As a result, 1.8 kg were added to account for the additional weight of the devices.
Figure 1 exemplifies the equipment’s disposition, with the portable metabolic analyzer in the anterior part of the body (portable unit, battery, mask), an ambient thermometer in the shoulder, and the actigraphs in the wrist, waist, and ankle. According to the fabricant’s instructions, the heart rate monitor was set under the participant’s clothes in direct contact with the thorax skin.

2.4. Experimental Design

Before the trials, participants had their height and weight measured (in light clothing, without shoes). Later, they performed various lifestyle and simulated working activities. Activities were selected to represent a variety of postures and activity levels between light and moderate, considering some of the activities referred to in the tables from ISO 8996:2004 [10] and practices mentioned in the literature. The designed sequence of activities and their respective classification are detailed in Table 2, and their approximate completion was 75 min.
The variables tested for the model were chosen based on the literature: weight [43,44,45,46,47,48,49,50,51,52,53,54,55], height [47,48,49,52,53,54], age [47,48,49,50,51,52,53,54], sex [47,48,49,50,51,52,53,54,55], fat mass [53,54], fat-free mass [50,53,54], ethnicity [53,56,57], sleep time and quality [17,58,59,60], effort required by the task [53], emotional aspects [61,62], actigraphy counts per minute [43,44,45,46,52,53], personal physical level [63], and heart rate [52,64,65,66]. The variables were screened considering the smallest values of significant effects until obtaining the combination of the variables included in the model.

2.5. Data Analysis

Recordings from the devices and information from the questionnaires were gathered and exported to CSV files. Values from cardiac activity, accelerometer counts, and energy expenditure by indirect calorimetry were synchronized and converted to average values per minute.
Model and respective cross-validation analyses were developed using statistical techniques. The modeling process involved variables correlations and establishing a mixed hierarchical model through the software R version 4.0.5 (Ross Ihaka & Robert Gentleman, Auckland, New Zealand). The parameters of variation were estimated using the method cited by Cheung et al. [67], the restricted maximum likelihood (REML).
The adopted parameter of assessment for the model was the bias of standard errors calculated using the difference between model results and standard and literature methods with indirect calorimetry.

2.5.1. Mixed-Effects Regression Modeling

According to Fávero et al. [68], mixed-effects regression models or hierarchical regression models have a primary function in explaining a variable’s behavior over time and identifying its variance components. Hierarchical linear regression is a particular form of a multiple linear regression analysis in which variables are added to the model in sequential steps called “blocks”. This is carried out to statistically “control” the specific variables and see whether adding them improves the model’s ability to predict the criterion variable and investigate a variable’s moderating effect. Accordingly, hierarchical models are multilevel models in which each of these levels is characterized by its submodel, representing the structural relations and residual variability from that level.
Groups characterizing levels of evaluation of the effects of energy expenditure were considered to develop the model. Within lower levels are the activities executed by the participant (considering the movement and activities development), and in a higher level are the participants’ characteristics. During the activities execution, the levels evidence variations in the energy expenditure value. Through the mixed-effect modeling process, it was possible to quantify how much of the variation can be explained by the participant’s intrinsic characteristics (participant’s hierarchical level) and how much comes from the activities’ characteristics by analyzing the activities execution. Furthermore, it was also possible to estimate how much of the energy expenditure variation is caused by other aspects that were not considered in the study.
Variations in energy expenditure, explained by the hierarchical levels, can also result in variations in the mean value, which is known by the intercept of that dependent variable and can result from random variations in the effects of the independent variables. The process for selecting the fixed and random effects from variables was formed by three stages, described below:
(i) After verifying the correlations between the study variables, they were combined and tested into mixed models until reaching a significant correlation. Only random effects were introduced in the intercept. In the following model adjustments, the variable with the least significant effect was excluded, which means that those variables in which the statistical significance test resulted in values close to 0 were eliminated.
This procedure was repeated until obtaining a model in which only significant effects were included (with statistical significance test showing p-values < 0.05).
(ii) Variables with square terms and variables interactions were introduced into the model resulted in the first stage. These terms were those with variables excluded in the previous stage.
(iii) In the model from stage 2, random effects from variables that had mixed effects were successively introduced. It was verified which variables corresponded to participants levels and which were from activities levels. The random effects were introduced, then, in the respective level.
(iv) The variable “level of physical activity” was inserted. The model was remade based on steps (i), (ii), and (iii) to verify whether this variable is significant in the model compared to the model without this variable.
The mixed-effect regression modeling process is described in Appendix A.

2.5.2. Cross-Validation and Comparison with Reference Methodologies

The study considered a sample of 3915 movement records in 15 activities being performed by 50 participants. From the records made, it was verified that there were missing data for 175. Thus, these observations were not considered in obtaining and validating the models. The validation procedure was developed considering two phases. The first validation was carried out with an aleatory subsample (around 10%) of the total collected records. The remaining data was used to develop the model.
During a second validation phase, some other methods were chosen to calculate the energy expenditure and compare it with the results from the models. We chose to apply methods from the ISO 8996:2004 [10] and reference regression equations found in the literature [45,69]. Methods from level 3 (evaluation of metabolic rate from heart rate recordings) were selected from the ISO 8996:2004 standard, as they were found to be feasible and applicable for the collected data and protocol. Level 1 methods (classifications according to occupation and the kind of activity) and level 2 (evaluation of metabolic rate using group assessment tables and through the tabulated values for various activities) did not apply to the activity protocol used, and the double-labeled water and direct calorimetry methods (from level 4) were not viable given the resources and time available for this research.
The Swartz et al. (2000) [45] and the Freedson VM3 combination (2011) based on Freedson et al. [43,69] equations were chosen for considering accelerometry counts and being applicable for occupational situations according to the indicated population and scope of activities. The Swartz equation [45] used the wrist and waist accelerometry counts while Freedson [43,69] was applied considering the waist counts. The Freedson VM3 combination (2011) algorithm combines the Freedson VM3 (2011) algorithm [69] with the work–energy algorithm to calculate energy expenditure. The values adopted as a comparison parameter were those obtained from indirect calorimetry.

3. Results

The model was developed starting with 15 variables (ethnicity, quality index, anxiety level, physical activity level, subjects high, weight, age, body composition—fat-free and non-fat-free mass, sex, acceleration counts of the wrist, waist, and ankle, and heart rate), and after the removal of nine variables, a model containing only variables with significant effects was obtained.
In a second moment, the quadratic effect of weight was introduced in the selected model (which contained six independent variables). This variable was not in the final model selected but has been widely used in previous research. In fact, the variable turned out to be important when considering that its effect on energy expenditure is quadratic. Subsequently, it was also introduced in the selected model interaction effects of the variable sex to investigate whether part of the effect of the movement variables, of wrist and ankle, was dependent on the sex of the individual. These terms presented significant parameters and were included. After introducing these terms, the parameter associated with fat-free mass proved to be nonsignificant and was removed from the model.
The obtained model can be described by Equation (1) with physical activity level variable, and by Equation (2) without physical activity level variable, and explains the behavior of the energy expenditure according to the included variables: Heart rate (x1), Wrist counts per minute (x2), Ankle counts per minute (x3), Weight’s quadratic term (x4²), Physical activity level (x5), Female sex: Wrist counts per minute (x2F1), Female sex: Ankle counts per minute (x3F1). Details on the modeling process can be consulted in the Appendix A.
EE = 3.17 + 0.000035 x 5 + 0.04944 x 1 + 0.000047 x 2 + 0.000213 x 3 + 0.000193 x 4 2 0.000046 x 2 F 1 0.000119 x 3 F 1 + ε + π
EE = 2.999 + 0.04942 x 1 + 0.00004736 x 2 + 0.0002129 x 3 + 0.0001927 x 4 2 0.0000414 x 2 F 1 0.0001223 x 3 F 1 + ε + π

3.1. Mixed-Effects Regression Model—Estimation and Error

The random effect of the hierarchy level related to movements, considering the explanation capacity, was excluded due to the reduced values. Table 3 illustrates the random effects and the levels analyzed, considering the explanation capacity of the expenditure estimated by the model.
Table 3 presents the results of a model selected in the first stage, which considered only random variations in the intercept. These variations can be interpreted as a general average independent of the effects of the independent variables. It is observed that most of the variation in energy expenditure is caused by aspects related to the participants (31.7%) and the activity performed (32.26%), totaling 63.96% of the explained variation. The research variables do not explain 36.04%, which is related to aspects of momentary execution of the activity, representing the residual variation associated with each specific sample record. The difference of results between the model, with and without the variable “physical activity level”, was negligible, being considered null.
Table 4 presents the fixed effects of the variables estimated using the nonrestricted maximum likelihood method.
Regarding fixed effects, analyzing the intercept, negative values were obtained. Although the intercept is commonly considered an average to which the dependent variable tends when all independent variables assume the value zero, it is possible due to negative values even when they seem inconsistent. In the present study, the negative value of the intercept only indicates a tendency of very low values when the variables tend to zero. This negative value of the energy expenditure must be interpreted with caution. Considering that the basal energy value is around 70% of the individual’s total energy expenditure, the case where the independent variables are settled on zero value cannot be observed. The minimum value of energy expenditure prediction will always correspond to a basal heart rate frequency and the subject’s mass. The intercept should only be seen as a correction of the energy expenditure for the boundaries of the model.
The results presented in Table 4 also verify that the most significant effect among the variables was heart rate (0.0494). Among the movement indicators, it was found that wrist movements had a minor effect than movements measured at the ankle. The finding agrees that in everyday activities, whole-body movements are related to the movements of the legs (measured by ankle counts), and the associated energy costs are higher than those performed by the arms [70].
The results in Table 4 also suggest a difference between male and female subjects in the effect of movements on energy expenditure. Therefore, the movement performed during the activities influences energy expenditure in two separate ways: one depending on the movement counts itself, and the second considering the movement combined with the sex of the subject. Female participants tended to spend approximately 0.000046 less per unit increased in the actigraph record present in the wrist than male participants. For the actigraph located on the ankle, the energy expenditure per unit for female participants tended to be approximately 0.000119 less than those of male subjects. The differences in the body size and muscular strength between genders might explain the variation in intensity and amplitude of the movements [71].
Another result from the model and selecting its terms indicates that linear effects of weight were not significant. However, the variable did show a significant effect when its quadratic form was inserted. Thus, evaluating the two types of effect on energy expenditure suggests that the increase in energy expenditure depends on the subject’s weight. As the coefficient effect is positive, we conclude that energy expenditure increases with weight, but the relationship with the quadratic form means the increase is more expressive for individuals with heavier weights.
In the model selected with random effects only in the intercept, successive random effects from the independent variables were inserted, but the explained variance by these random effects of the variables (heart rate, weight, wrist counts per minute, ankle counts per minute and physical activity level), when introduced in the models described in Equations (1) and (2), are very low. Therefore, it would not be helpful to keep a random term in the model that explains so little of the variance of energy expenditure. Thus, the model that has only random variations in the intercept is more appropriate.
Given this, we have a hierarchical mixed regression model for estimating energy expenditure based on the experiment developed according to Equations (1) and (2). The model was able to estimate the energy expenditure based on the variables collected, pointing out the priorities of these variables by their relevance in the model.
Some sample characteristics did not allow analyzing variables, such as ethnicity, a confounding factor related to energy expenditure, by the literature [57]. Although the sample had seven different nationalities, there was not enough variation to identify such a relationship. The same occurs with age, which is presented in the literature as a significant variable. The analyzed methods use this variable as a factor of relation with the energy expenditure, but the developed models did not show a significant association. Possibly, the sample composition may have prevented an analysis of this variable.
Table 4 presents the contribution of the variables. The physical activity level is the variable with a lower estimated effect and higher p-value (0.0000351; p-value = 0.0267). Despite a significant association, there is no clear evidence in the literature on how activity level directly influences energy expenditure. For this reason, a version of the model without physical activity was tested. In Table 5, there are no differences in the adjustments and errors, which means that both models’ performances are the same; however, values in Table 4 indicate that the random variation in the intercept increases from 29.86% to 31.70% when removing physical activity from the model, which means that the variable has a relevant influence on the prediction. Differences in the predicting capability are additionally presented in Section 3.2.
Moreover, with the present model having a significant expression on the random term related to the participants, it needs to be readjusted with new data to be enforced to new subjects. The sample model is generalized concerning the variable set and respective structure; however, predicting the results requires some data from the participants. This feature makes the model more accurate and reliable for application in any situation. The adjustment procedure will cause the model to evolve and be perfectly adapted to the new participant group, producing better estimations. This adjustment can be made with a single collected sample, and not a complete protocol or dataset.

3.2. Comparison with Standard Techniques and Literature Models

The total sample contained 3740 records and was divided into two sample groups: 3416 records (91.33%) were used to adjust the models, and 324 (8.67%) were used as a validation sample. This last subsample was composed of data from aleatory records referring to 19 participants. For the second validation phase, the correlation coefficient values and standard deviation between each method and indirect calorimetry are presented (Table 6).
The values obtained by the other methods were compared with the values obtained by the calorimetry method through the bias standard error and the standard deviation. These values are represented in Bland–Altman graphs [72] to evaluate the agreement between the estimated values and the values measured by indirect calorimetry, consequently indicating the agreement of each method with the reference method indicated in the standard.
The Bland–Altman graphs (Figure 2) illustrate the level of agreement between the measured data and the respective methods presented. Figure 2a,b correspond to the hierarchical mixed model with and without physical activity variables. Comparing the model without the variable “level of physical activity” (a) and the model that includes the variable (b), the standard deviation presents no variation, and the Pearson correlation coefficient shows an insignificant change. The dispersion presented by the cloud of values and the bias standard error remains the same. The physical activity being a variable with a significant association, it can be stated that the relevance of this variable requires further studies with larger datasets to be analyzed.
Figure 2c shows the agreement between the measured data and the equation of Swartz et al. (2000) [45]. Finally, Figure 2d corresponds to the concordance results between the measured data and the VM3 (2011) combined equation of Freedson and colleagues [43,69]. Figure 2e illustrates the agreement between the measured data and the data obtained by the heart rate relation method, presented in ISO 8996:2004 [10].
The mixed models (a) and (b) show good agreement with the values of energy expenditure measured by calorimetry because the bias standard error values are closer to zero. Other techniques present a graphically visual distance and the relationship with heart rate (e) method and the (c) Swartz [45] and (d) Freedson VM3 combined [69] equations.
The correlation coefficients shown in Table 6 evidence the association between these methods and indirect calorimetry. The agreement between values is represented by the mean and standard error (bias) proximity to the zero axes.
Within the standard method (e), the relationship between energy expenditure and heart rate showed the highest bias standard error for the adopted activity protocol, despite being the method with better accuracy among the three standard methods considered for comparison. On the other hand, methods (c) and (d), which are the estimates by the equations, showed higher bias standard errors among all the methods.
The estimates by the Swartz equation [45] showed a general tendency to overestimate the energy expenditure. At the same time, the estimates by the Freedson VM3 (2011) combined equation [69] showed a tendency to underestimate the energy expenditure.
Therefore, considering all the methods evaluated and respective values of error, dispersion, correlation, and agreement with the indirect calorimetry, the mixed models were revealed to be the most appropriate to estimate the energy expenditure values in this study. The difference between the bias standard error of methods (a) and (b) was not significant, the simplified version (b) without the physical activity level variable being a suitable option to estimate the energy expenditure in the occupational context.

4. Discussion

4.1. Energy Expenditure Estimation in the Occupational Context

ISO 8996:2004 [10] is designed to specify different methods for determining metabolic rate in the context of ergonomics of the working environment. Being a reference document, the methods for measuring energy expenditure indicated in ISO 8996:2004 [10] have drawbacks for some instances, especially for field studies. The methods of the observation and screening levels of approach are subject to gross variations between the values in the tables and the actual values. The estimated and tabulated values are appropriate for human averages, being, for men aged 30 years, 70 kg body mass, 1.75 m height, and body surface area 1.80 m²; while for an average of women aged 30 years, 60 kg body mass, 1.70 m height, and body surface area 1.60 m². It is mentioned in the standard [10] that the correction of values is necessary to estimate the metabolic rate for children, the elderly, and people with disabilities, but without specifying or indicating how such corrections should be made.
The errors for using tables are significant, ranging from 5% to 20% error [10]. Such errors are related to environmental conditions, height, weight, gender, and activity characteristics that are being evaluated. Even for a regular working population, individual differences might impose different risk levels when, for example, assessing the heat stress risk using the metabolic rate for the human average [26]. In addition, in ergonomic risk assessment, the evaluation of physical effort and work–rest cycles, the individual adjustments are crucial to prevent overexertion and musculoskeletal-related injuries [28,73].
Furthermore, the standard [10] itself foresees situations where it is necessary to use weighted average values and interpolations when performing resting activities combined with intense activities in an asymmetric distribution. Interpolations are also necessary in cases of applying heart rate values for determining metabolic rate [10]. Heart rate is subject to factors other than physical activity and can easily provide biased results [52,64,65,66]. Another limitation of the standard method, based on heart rate, is the minimum limits of 50 kg and 20 years of age, and maximum limits of 90 kg and 60 years of age, excluding people included in the working population outside this range, i.e., below 50 kg and 20 years of age or above 90 kg and 60 years of age, disregarding, for example, the increase in working age in recent decades. These aspects demand reflections in ergonomics and occupational health in considering a customized way for calculation models to include the variety of activities performed in work situations and the characteristics of the economically active population. The current model presents a significant random effect that comes from the participants. This value increases when we exclude the physical activity level from the model (see Table 3). This reinforces the necessity to adapt the model to the subjects and include variables related to the individuals to improve the accuracy of the predictions.
The model developed reinforced that heart rate is an important variable in determining energy expenditure (Table 4), but contrarily to the standard [10] that includes the dependency on weight and age, it significantly relates to the movement. Despite being one of the variables with a strong correlation with energy expenditure, heart rate has variations that are not easily controlled [14]. Moreover, the linear model proposed by ISO 8996:2004 [10] showed results with errors and dispersion. However, in the models developed, the variable showed paramount relevance in estimation combined with the data regarding movements, as presented in the literature [64,74]. The literature indicates that the limitations of estimation based only on heart rate, especially for light and sedentary activities, can be improved considerably by combining heart rate with actigraphy [75]. It is also the case for activities in which pelvis acceleration is not closely related to whole-body energy expenditure, such as card games and sweeping [64] or free-living activities [74].
There are methods not foreseen in the ISO 8996 standard [10] (such as the use of effort perception scales associated with energy expenditure estimation tables and empirical models) suitable to be enforced in workload assessment that have better performances than the standard methods presented. Some models are developed based on empirical studies of indirect calorimetry and regression techniques involving components of a task or characteristics of a specific group [12,27]. The equations related to movement and activity execution, those by [43,44], widely used in the literature, are some of these examples. The model with uniaxial accelerometer values [44] was used to show that activity patterns can be classified by actigraphy regarding the intensity level of the movements. Nevertheless, the activities monitored were restricted to walking and running on a treadmill, and the sample consisted of 35 persons. The model for triaxial accelerometers [43] was elaborated based on a sample of 50 participants and considered the magnitude vector of the counts as an indicator of the movement quantification. The model proposed by Swartz et al. [45] tried to integrate data from triaxial accelerometers located at the waist and the wrist in a single model, discussing the optimization of the allocation of the devices and the effects of the combined calculations. In our proposal, the modeling process reveals that the counts of the magnitude vectors of the arm and leg actigraphs can better explain variance than the waist counts or the waist combined with the leg counts, which better explain the variance of the global free-living, multitask routines.
Actigraphy is absent from the standards, which indicates an opportunity for it to be explored as an alternative for determining energy expenditure, considering what is already developed and its enforcement potential to occupational contexts. The variables commonly used in equations to estimate energy expenditure are weight, height, age, gender, actigraph counts, body mass index, and heart rate [12,46]. The variables related to the movements, heart rate, and subject’s weight were confirmed to be, under this study’s conditions, those with a more significant influence on energy expenditure estimation. Regarding the sex variable, the natural metabolic differences, body fat and fat-free mass distributions, and the differences in body size must be considered among the differences that explain the association of the variables, as they were in some of the equations analyzed from the literature [76]. The mixed model pointed out possibilities of the influence of sex on the estimation of energy expenditure being related to the differences in the execution of activities between men and women. In Table 4, it is pointed out the negative adjustment relative to sex, considering that women spend less energy than men in the performance of the activities. The model also pointed to a quadratic instead of a direct relationship between subjects’ weight and energy expenditure. It was also important to verify that weight is even more significant than the other related variables, such as fat-free and non-fat-free mass.
One of the advantages of hierarchical mixed modeling is the possibility to analyze the effects of the variables in the model [40,41]. The model reinforced the potential to estimate the energy expenditure based on body movements, which are closely related to the activity performed and the characteristics of each participant. In this sense, another advantage of the model is the possibility of calculation considering these two characteristics—the activity performed and the characteristics of each person. The proposed mixed models, with and without the “physical activity level” variable, change the traditional approaches’ paradigm. It clearly shows that heart rate is an important variable but also includes accelerometer count, their relationship with sex, weight (body plus carried load mass), and physical activity level. Even being the least influential variable in the model, the physical activity level proved significant, indicating a need for further studies on this influence. Either by body characteristics or by metabolic differences [77], among other possible reasons [27,78], it becomes significant in the explanation of the energy expenditure results.
On the other hand, the methods proposed in the expertise approach [79] are more accurate but are neither practical nor very appropriate for field studies, besides being expensive for specific situations. In the case of the double watermarked method, the standard presents only the principle of the method. The minimum recommended execution time for measuring children is six days, for normal adults 12 to 14 days, and for older people, the standard indicates that it may be a more extended period without specifying or estimating it. The standard [10] also admits that the concept is simple in the double-labeled water method, but there are numerous complex details that the user needs to know. However, these details are not mentioned. Considering direct calorimetry, one of the main drawbacks is the difficulty or impossibility of the portability of the equipment for field studies and the high cost [48,79]. Although the improvements of estimation methods increased with technological advances, further studies to explore the causal relationships of energy expenditure variables in the occupational context are more complex than the movement execution analysis. There are intrinsic aspects of the human being and his interaction with the work environment that cannot be easily evaluated [80].
Even having a practical and experimental character, this work also has an exploratory aspect since energy expenditure in the occupational context is not trivial. The exploratory aspect triggered the search for contributions from several areas of knowledge crossing with occupational engineering. The current model was specifically developed to be enforced in the occupational context. A simple equation based on variables that are easily measured by any company, though, make the application of the current technique a perfect way to assess the metabolic rate or physical workload. The method only requires heart rate, wrist and ankle counts per minute, weight, and sex. The cross-validation presented high-quality adjustment values (Table 5), and the comparison with other calculation alternatives demonstrated the best accuracy level.
By measuring simple parameters in the field, it will be possible to predict the metabolic rate and improve the assessments based on energy expenditure made in the occupational context. The proposed system for data collection, in the final version, only requires two actigraphs, a heart rate measurement, and basic data. In the occupational field, the applications are enormous, going from managing the workers’ physical exertion, controlling and managing activity levels, preventing exertional heat stress, and other assessments that can be made continuously in real time without interfering with the work activities.

4.2. Strengths and Limitations

The possibility of developing the practical component with the available resources was essential to ensure the quality of the data and, consequently, of the developed models. An improvement in this regard would allow evaluating all individuals at the beginning of the day and providing a meal offered and quantified by the research team. Another limitation was the time dedicated to each activity of the protocol, since five minutes is a restricted time for good measurements without compromising the data, even being above the minimum recommendation of three minutes. However, if the time of each activity were longer, the quantity and variety of activities would be reduced. Although the proposed model was developed based on experimental data collected exclusively for this purpose, and has been subjected to data cross-validation, one of the study’s main limitations was the impossibility of testing the proposed models in real context activities and with larger samples.
Nevertheless, the main strength of the research is that the proposed mixed models for determining energy expenditure for occupational settings by actigraphy present results close to the best methods of the reference standard.
Finally, regarding the model’s applicability, the fact that it should be adjusted for other participants can be reported as both a strength and limitation for its potential applications. The model’s formulation is closed concerning the variables, but to be applied to other samples with high accuracy, it must be previously readjusted. These adjustments can limit its rapid applicability but guarantee its reliable and accurate performance. The proposed model is a model that must evolve to have precision and accuracy. As the term of the aleatory variable depends on the individuals, it will need to be readjusted with the information of other subjects to be applied to them. The model will learn and evolve in each application until it reaches maturity.

5. Conclusions

According to the literature, based on the historical–technological and normative foundation, the use of actigraphy to determine the energy expenditure in a multitasking occupational environment was a real possibility. Experimental research was developed, which allowed replicating some of the methods identified in the literature, enabling data collection to develop estimation models. As a result, an energy expenditure determination model for occupational settings is proposed.
From ISO 8996:2004 [10], we applied estimation methods by the relationship with heart rate and by indirect calorimetry. As a gold standard measurement [76,79], results from the indirect calorimetry were compared to energy expenditure estimation of all other methods to identify the suitable technique in occupational settings. In addition, two of the equations found in the literature were also applied, and the two estimation models were developed by hierarchical mixed regression. The enforcement of Swartz’s (2000) [45] and Freedson’s VM3 combined (2011) [69] equations resulted in overestimation and underestimation, respectively. Even though these equations apply to occupational context, considering multitask assessments, including load carriage, the sample characteristics and the activities used in their development may influence these differences in results, which is one of the limitations of the energy expenditure equations.
The component of the actigraph allocated to the ankle, followed by the wrist, showed the most significant effect on energy expenditure estimation among the actigraphs combination (from the dominant side and waist positions). The difference in the effect of body movements on energy expenditure presented by the hierarchical model among individuals stands out as a relevant factor. Another significant result concerns the effects of body weight identified as nonlinear by a quadratic component in the hierarchical model, which means a relationship where this effect depends on the observed value of the variable. For the case of this model, the energy expenditure tends to increase with the weight, the variations being more expressive for individuals with higher weights. This relationship needs to be studied in greater depth.
The activity level variable showed a relationship with the energy expenditure. Depending on how active the individual is, it will influence the energy expenditure and, consequently, his/her physical performance at work regarding the execution of movements. As the literature points to an indirect relation, and as the contribution for the energy expenditure is minor, the version of the model without the physical activity level is the final proposal to be enforced in the occupational context. Finally, the two developed models present themselves as a possible way to study people’s energy expenditure in an occupational context, making the development of the system based on actigraphy feasible for this purpose, with a comparable error concerning the methods presented in the ISO 8996:2014 standard [10].
The hierarchical mixed model showed 30% of the variation in the expenditure related to the participants’ factors, 33% to the performance of the activity, and 37% as aspects not explored in the study. Therefore, the 63% (30% + 33%) effect explanation capacity can be considered good, but the other 37% of unexplored aspects are opportunities for future studies. Further research is required to deepen studies about the physical activity level effects on energy expenditure, increase the sample to study the association of age, race, and quadratic impact of weight, and explore the sex variable effect on movements.

Author Contributions

Conceptualization, J.G.; data curation, A.L., D.B. and E.S.; formal analysis, J.G. and L.S.; funding acquisition, J.G.; investigation, A.L.; project administration, J.G.; supervision, J.G.; validation, J.G., M.V. and L.S.; visualization, A.L. and J.G.; writing—original draft, A.L., J.G., D.B. and E.S.; writing—review and editing, A.L., J.G., L.S. and D.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Foundation of Science and Technology (FCT Portugal) through the project grant PCIF/SSO/0063/2018.

Institutional Review Board Statement

The Ethics Committee of the University of Porto approved the study (Report 106/CEUP/2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Modeling Process Description

Appendix A.1. Model Structure

The model was structured in three levels based on collected data. Each level is presented with generic coefficients and their respective variables (see Table A1). The hierarchical level 1 is related to the movements registered by the actigraphs, level 2 corresponds to the activities, and level 3 contains the personal characteristics. However, as none of the available variables is associated with the activity level (level 2), for that level, only random variations linked to the activities were considered. Then, the model structure in the unified composition was formed. Finally, the modeling with the application of the values in the generic model equation was also performed.
For these modeling purposes, the significant variables denominations established within Table A1 were considered.
Table A1. Significant variables of the model according to their associated hierarchical level.
Table A1. Significant variables of the model according to their associated hierarchical level.
Adopted NotationVariableAssociation Hierarchical Model Level
x1 Heart rateParticipant—Level 3
x2 Wrist counts per minuteRecords per minute—Level 1
x3 Ankle counts per minuteRecords per minute—Level 1
x4 WeightParticipant—Level 3
x5 Physical activity levelParticipant—Level 3
F SexParticipant—Level 3

Appendix A.2. Level 1—Associated with the Records per Minute

Equation (A1) indicates that the energy expenditure (EE) recorded at each moment presents a portion that is independent of the variables studied, being an average (β0); another portion that results from the effect of independent variables associated with the momentary execution of the parts of an activity per minute (β1x2 + β2x3); and a third portion resulting from normal random variations associated with those moments (π).
EE = β0 + β1x2 + β2x3 + π

Appendix A.3. Level 2—Associated with Activity

The second level contains a group of equations that describe a detailing of the mean or intercept (β0) and first-level effects. It can be observed that the effects of the variables described at the first level, those associated to the records at each minute, are admitted as fixed and arising from a single parcel. On the other hand, the first-level average, which would be the average energy expenditure arising from the moment when the activity is performed, is the result of an average portion which is, in fact, associated with each moment (α00), and a second portion related to random variations in energy expenditure arising from the activities, which cannot be explained by the independent variables investigated (ε0), as shown in Equations (A2)–(A5). The random variations referring to variables ε1 and ε2 were considered equal to zero because they are very low values.
β 0 = α 00 + ε 0
β 1 = α 10 + ε 1
β 2 = α 20 + ε 2
ε 1 = 0 = ε 2

Appendix A.4. Level 3—Associated with the Participant

In the third level, there is a more detailed description of the effects, and the level 2 mean or intercept, which are attributed to the activities. The set of equations of this level indicates that the effects related to the activity present a mean component associated with each participant of the experiment, a portion associated with the sex of the participant, and a portion resulting from normal random variations linked to other characteristics of the patients.
In addition, at level 3, there is a more detailed description of the components of the level 2 mean, which is associated with activity: a mean portion that is independent of the participant observed; a portion that arises from the effects of independent variables related to participant characteristics, one of these effects being nonlinear, that is, it depends on the value of the independent variable; and a component of random variations arising from additional characteristics of the research participants. There is an indication that the activity-related effects present an average component associated with each participant: a portion associated with the sex of the participant; a portion arising from the activity level of the participant; and a portion arising from normal random variations linked to other characteristics of the participants. Equations (A6)–(A9) illustrate this relationship. The random variations referring to variables u10 and u20 were considered equal to zero for being very low values.
α 00 = γ 000 + γ 001 x 5 + γ 002 x 1 + γ 002 x 4 2 + u 00
α 10 = γ 100 + γ 101 F 1 + u 10
α 20 = γ 200 + γ 201 F 1 + u 20
u 10 = 0 = u 20
To compile these expressions, Equations (A6)–(A9) were combined into Equation (1), from which Equation (A10) was obtained:
EE = α 00 + α 10 x 2 + α 20 x 3 + ε 0 + π
Then, replacing Equations (A6)–(A9) in Equation (A10) results in Equation (A11):
EE = ( γ 000 + γ 001 x 5 + γ 002 x 1 + γ 003 x 4 2 + u 00 ) + ( γ 100 + γ 101 F 1 ) x 2 + ( γ 200 + γ 201 F 1 ) x 3 + ε 0 + π
Respectively, Equation (A11) can be expressed as Equation (A12):
EE = γ 000 + γ 001 x 5 + γ 002 x 1 + γ 003 x 4 2 + γ 100 x 2 + γ 101 F 1 x 2 + γ 200 x 3 + γ 201 F 1 x 3 + ε 0 + π + u 00
where: x1: heart rate; x2: wrist counts per minute; x3: ankle counts per minute; x4²: weight squared term; x5: participant’s physical activity level; x2F1: factor of wrist movement related to sex, x4F1: factor of ankle movement related to sex; γi, j, and k: coefficients; ε, π, and u: random plots not explained by the model.
Equation (A12) indicates that there is an overall mean significantly different from zero that does not depend on the moment when the energy expenditure is recorded and does not depend on the variables present in the model. This equation suggests that there are also random variations associated with the characteristics of the activity’s momentary execution, intrinsic characteristics of the type of activity and movement being performed, and specific characteristics associated with the individual. Therefore, Equation (A12) is a generalization of the model developed.
The variable “physical activity level” represents a classification of the physical activity level of each participant based on the weekly energy expenditure estimated using the Portuguese version of the IPAQ—International Physical Activity Questionnaire [40]. The data of this variable were collected and then tested, presenting significance. However, the effect of this variable was smaller within the model. Then, the model was tested without this variable. In this case, the portion arising from the physical activity level of the participant was excluded from the set of equations of level 3, and Equation (A6) was adapted to Equation (A13).
α 00 = γ 000 + γ 001 x 1 + γ 002 x 4 2 + u 00
Then, following the same procedure, Equation (A14) is obtained:
EE = ( γ 000 + γ 001 x 1 + γ 002 x 4 2 + u 00 ) + ( γ 100 + γ 101 F 1 ) x 2 + ( γ 200 + γ 201 F 1 ) x 3 + ε 0 + π
Equation (A14) can also be expressed as Equation (A15):
EE = γ 000 + γ 001 x 1 + γ 002 x 4 2 + γ 100 x 2 + γ 101 F 1 x 2 + γ 200 x 3 + γ 200 F 1 x 3 + ε 0 + π + u 00
where: x1: heart rate; x2: wrist counts per minute; x3: ankle counts per minute; x4: weight squared term; x3F1: factor of wrist movement related to sex; x4F1: factor of ankle movement related to sex; γi, j, and k: coefficients; ε, π, and u: random plots not explained by the model.
Therefore, Equation (A15) is a generalization of the model developed, excluding the “physical activity level”.

References

  1. Mifflin, M.D.; Jeor, S.T.S.; Hill, L.A.; Scott, B.J.; Daugherty, S.A.; Koh, Y.O. A new predictive equation for resting energy expenditure in healthy individuals. Am. J. Clin. Nutr. 1990, 51, 241–247. [Google Scholar] [CrossRef]
  2. Lucena, A.D.; Guedes, J.C.C.; Vaz, M.A.P.; Da Silva, L.B. Physiological variables in energy expenditure estimation by actigraphy: A systematic review protocol. Int. J. Occup. Environ. Saf. 2018, 2, 59–66. [Google Scholar] [CrossRef] [Green Version]
  3. Chen, J.; Mitrouchev, P.; Coquillart, S.; Quaine, F. Disassembly task evaluation by muscle fatigue estimation in a virtual reality environment. Int. J. Adv. Manuf. Technol. 2016, 88, 1523–1533. [Google Scholar] [CrossRef]
  4. Cao, C.; Liu, Y.; Zhu, W.; Ma, J. Effect of active workstation on energy expenditure and job performance: A sys-tematic review and meta-analysis. J. Phys. Act. Health 2016, 13, 562–571. [Google Scholar] [CrossRef] [PubMed]
  5. Sprod, J.A.; Olds, T.S.; Burton, N.W.; Brown, W.J.; Van Uffelen, J.G.; Ferrar, K.E.; Maher, C.A. Patterns and correlates of time use and energy expenditure in older Australian workers: A descriptive study. Maturitas 2016, 90, 64–71. [Google Scholar] [CrossRef] [PubMed]
  6. Caljouw, S.R.; De Vries, R.; Withagen, R. RAAAF’s office landscape The End of Sitting: Energy expenditure and temporary comfort when working in non-sitting postures. PLoS ONE 2017, 12, e0187529. [Google Scholar] [CrossRef] [PubMed]
  7. Mantzari, E.; Galloway, C.; Wijndaele, K.; Brage, S.; Griffin, S.J.; Marteau, T.M. Impact of sit-stand desks at work on energy expenditure, sitting time and cardio-metabolic risk factors: Multiphase feasibility study with randomised controlled component. Prev. Med. Rep. 2018, 13, 64–72. [Google Scholar] [CrossRef] [PubMed]
  8. D’Silva, R.M.; Chandrasekaran, B. Will energy expenditure differences in work postures influence cognitive outcomes at workplaces? an explorative review. Obes. Med. 2020, 19, 100253. [Google Scholar] [CrossRef]
  9. Bernardi, B.; Abenavoli, L.M.; Franco, G.; Fazari, A.; Zimbalatti, G.; Benalia, S. Worker’s Metabolic Rate Assessment during Weeding. Qual.-Access Success 2020, 21, 139–141. [Google Scholar]
  10. ISO 8996: 2004. Ergonomics of the Thermal Environment—Determination of Metabolic Rate; ISO: Geneva, Switzerland, 2004. [Google Scholar]
  11. Yang, X.; Li, M.; Mao, D.; Zeng, G.; Zhuo, Q.; Hu, W.; Piao, J.; Yang, X.; Huang, C. Basal energy expenditure in southern Chinese healthy adults: Measurement and development of a new equation. Br. J. Nutr. 2010, 104, 1817–1823. [Google Scholar] [CrossRef] [Green Version]
  12. Liu, S.; Gao, R.X.; Freedson, P.S. Computational Methods for Estimating Energy Expenditure in Human Physical Activities. Med. Sci. Sports Exerc. 2012, 44, 2138–2146. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Crouter, S.E.; Kuffel, E.; Haas, J.D.; Frongillo, E.A.; Bassett, D.R. Refined Two-Regression Model for the ActiGraph Accelerometer. Med. Sci. Sports Exerc. 2010, 42, 1029–1037. [Google Scholar] [CrossRef] [Green Version]
  14. Bröde, P.; Kampmann, B. Accuracy of metabolic rate estimates from heart rate under heat stress—An empirical validation study concerning ISO 8996. Ind. Health 2019, 57, 615–620. [Google Scholar] [CrossRef] [Green Version]
  15. Lyden, K.; Kozey, S.L.; Staudenmeyer, J.W.; Freedson, P.S. A comprehensive evaluation of commonly used accelerometer energy expenditure and MET prediction equations. Graefe’s Arch. Clin. Exp. Ophthalmol. 2010, 111, 187–201. [Google Scholar] [CrossRef] [PubMed]
  16. Tryon, W.W. Methods of measuring human activity. J. Behav. Anal. Health Sports Fit. Med. 2008, 1, 58–71. [Google Scholar] [CrossRef]
  17. Robillard, R.; Lambert, T.; Rogers, N. Measuring sleep–wake patterns with physical activity and energy expenditure monitors. Biol. Rhythm Res. 2012, 43, 555–562. [Google Scholar] [CrossRef]
  18. Mac, V.V.T.; Tovar-Aguilar, J.A.; Flocks, J.; Economos, E.; Hertzberg, V.S.; McCauley, L.A. Heat Exposure in Central Florida Fernery Workers: Results of a Feasibility Study. J. Agromedicine 2017, 22, 89–99. [Google Scholar] [CrossRef] [Green Version]
  19. Vincent, G.E.; Ridgers, N.; Ferguson, S.; Aisbett, B. Associations between firefighters’ physical activity across multiple shifts of wildfire suppression. Ergonomics 2016, 59, 1–8. [Google Scholar] [CrossRef]
  20. Slinde, F.; Grönberg, A.M.; Svantesson, U.; Hulthén, L.; Larsson, S. Energy expenditure in chronic obstructive pulmonary disease—evaluation of simple measures. Eur. J. Clin. Nutr. 2011, 65, 1309–1313. [Google Scholar] [CrossRef]
  21. Rousset, S.; Fardet, A.; Lacomme, P.; Normand, S.; Montaurier, C.; Boirie, Y.; Morio, B. Comparison of total energy expenditure assessed by two devices in controlled and free-living conditions. Eur. J. Sport Sci. 2014, 15, 391–399. [Google Scholar] [CrossRef] [PubMed]
  22. Staudenmayer, J.; Pober, D.; Crouter, S.; Bassett, D.; Freedson, P. An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer. J. Appl. Physiol. 2009, 107, 1300–1307. [Google Scholar] [CrossRef]
  23. Ellingson, L.D.; Schwabacher, I.J.; Kim, Y.; Welk, G.J.; Cook, D.B. Validity of an Integrative Method for Pro-cessing Physical Activity Data. Med. Sci. Sports Exerc. 2016, 48, 1629–1638. [Google Scholar] [CrossRef]
  24. Montoye, A.H.K.; Begum, M.; Henning, Z.; A Pfeiffer, K. Comparison of linear and non-linear models for predicting energy expenditure from raw accelerometer data. Physiol. Meas. 2017, 38, 343–357. [Google Scholar] [CrossRef] [PubMed]
  25. Rothney, M.P.; Neumann, M.; Béziat, A.; Chen, K. An artificial neural network model of energy expenditure using nonintegrated acceleration signals. J. Appl. Physiol. 2007, 103, 1419–1427. [Google Scholar] [CrossRef] [PubMed]
  26. Alfano, F.R.D.; Malchaire, J.; Palella, B.I.; Riccio, G. WBGT Index Revisited After 60 Years of Use. Ann. Occup. Hyg. 2014, 58, 955–970. [Google Scholar] [CrossRef] [Green Version]
  27. Ndahimana, D.; Kim, E.-K. Measurement Methods for Physical Activity and Energy Expenditure: A Review. Clin. Nutr. Res. 2017, 6, 68–80. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Brighenti-Zogg, S.; Mundwiler, J.; Schüpbach, U.; Dieterle, T.; Wolfer, D.P.; Leuppi, J.D.; Miedinger, D. Physical Workload and Work Capacity across Occupational Groups. PLoS ONE 2016, 11, e0154073. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Liu, S.; Gao, R.X.; John, D.; Staudenmayer, J.W.; Freedson, P.S. Multisensor Data Fusion for Physical Activity Assessment. IEEE Trans. Biomed. Eng. 2011, 59, 687–696. [Google Scholar] [CrossRef] [PubMed]
  30. Strath, S.J.; Kate, R.J.; Keenan, K.G.; A Welch, W.; Swartz, A.M. Ngram time series model to predict activity type and energy cost from wrist, hip and ankle accelerometers: Implications of age. Physiol. Meas. 2015, 36, 2335–2351. [Google Scholar] [CrossRef] [Green Version]
  31. Shephard, R.J.; Aoyagi, Y. Measurement of human energy expenditure, with particular reference to field studies: An historical perspective. Graefe’s Arch. Clin. Exp. Ophthalmol. 2011, 112, 2785–2815. [Google Scholar] [CrossRef]
  32. Desneves, K.J.; Panisset, M.; Rafferty, J.; Rodi, H.; Ward, L.C.; Nunn, A.; Galea, M.P. Comparison of estimated energy requirements using predictive equations with total energy expenditure measured by the doubly labelled water method in acute spinal cord injury. Spinal Cord 2019, 57, 562–570. [Google Scholar] [CrossRef]
  33. Schmid, M.; Riganti-Fulginei, F.; Bernabucci, I.; Laudani, A.; Bibbo, D.; Muscillo, R.; Salvini, A.; Conforto, S. SVM versus MAP on Accelerometer Data to Distinguish among Locomotor Activities Executed at Different Speeds. Comput. Math. Methods Med. 2013, 2013, 1–7. [Google Scholar] [CrossRef]
  34. Gyllensten, I.C.; Bonomi, A.G. Identifying Types of Physical Activity with a Single Accelerometer: Evaluating Laboratory-trained Algorithms in Daily Life. IEEE Trans. Biomed. Eng. 2011, 58, 2656–2663. [Google Scholar] [CrossRef] [PubMed]
  35. Ermes, M.; Pärkkä, J.; Mäntyjärvi, J.; Korhonen, I. Detection of Daily Activities and Sports with Wearable Sensors in Controlled and Uncontrolled Conditions. IEEE Trans. Inf. Technol. Biomed. 2008, 12, 20–26. [Google Scholar] [CrossRef] [PubMed]
  36. Lin, C.-W.; Yang, Y.-T.C.; Wang, J.-S.; Yang, Y.-C. A Wearable Sensor Module with a Neural-Network-Based Activity Classification Algorithm for Daily Energy Expenditure Estimation. IEEE Trans. Inf. Technol. Biomed. 2012, 16, 991–998. [Google Scholar] [CrossRef]
  37. Gjoreski, H.; Kaluža, B.; Gams, M.; Milić, R.; Luštrek, M. Context-based ensemble method for human energy expenditure estimation. Appl. Soft Comput. 2015, 37, 960–970. [Google Scholar] [CrossRef]
  38. Austin, P.C.; Goel, V.; Van Walraven, C. An Introduction to Multilevel Regression Models. Can. J. Public Health 2001, 92, 150–154. [Google Scholar] [CrossRef] [PubMed]
  39. Weinmayr, G.; Dreyhaupt, J.; Jaensch, A.; Forastiere, F.; Strachan, D.P. Multilevel regression modelling to investigate variation in disease prevalence across locations. Int. J. Epidemiol. 2016, 46, 336–347. [Google Scholar] [CrossRef] [Green Version]
  40. Campaniço, H.M.P.G. Validade simultânea do questionário Internacional de actividade física através dA medição objectiva dA actividade física POR actigrafia proporcional. Ph.D. Thesis, Universidade de Lisboa, Lisbon, Portugal, 2016. [Google Scholar]
  41. Buysse, D.J.; Reynolds III, C.F.; Monk, T.H.; Berman, S.R.; Kupfer, D.J. The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research. Psychiatry Res. 1989, 28, 193–213. [Google Scholar] [CrossRef]
  42. Lovibond, P.F.; Lovibond, S.H. The structure of negative emotional states: Comparison of the Depression Anxi-ety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav. Res. Ther. 1995, 33, 335–343. [Google Scholar] [CrossRef]
  43. Sasaki, J.E.; John, D.; Freedson, P.S. Validation and comparison of ActiGraph activity monitors. J. Sci. Med. Sport 2011, 14, 411–416. [Google Scholar] [CrossRef]
  44. Freedson, P.S.; Melanson, E.; Sirard, J. Calibration of the Computer Science and Applications, Inc. accelerometer. Med. Sci. Sports Exerc. 1998, 30, 777–781. [Google Scholar] [CrossRef]
  45. Swartz, A.M.; Strath, S.J.; Bassett, D.R.; O’Brien, W.L.; King, G.A.; Ainsworth, B.E. Estimation of energy ex-penditure using CSA accelerometers at hip and wrist sites. Med. Sci. Sports Exerc. 2000, 32, S450–S456. [Google Scholar] [CrossRef] [Green Version]
  46. Crouter, S.E.; Clowers, K.G.; Bassett, D.R. A novel method for using accelerometer data to predict energy expenditure. J. Appl. Physiol. 2006, 100, 1324–1331. [Google Scholar] [CrossRef] [PubMed]
  47. A Ganpule, A.; Tanaka, S.; Ishikawa-Takata, K.; Tabata, I. Interindividual variability in sleeping metabolic rate in Japanese subjects. Eur. J. Clin. Nutr. 2007, 61, 1256–1261. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Liu, H.-Y.; Lu, Y.-F.; Chen, W.-J. Predictive Equations for Basal Metabolic Rate in Chinese Adults: A Cross-Validation Study. J. Am. Diet. Assoc. 1995, 95, 1403–1408. [Google Scholar] [CrossRef]
  49. Henry, C.J.; Rees, D.G. New predictive equations for the estimation of basal metabolic rate in tropical peoples. Eur. J. Clin. Nutr. 1991, 45, 177–185. [Google Scholar]
  50. Cunningham, J.J. A reanalysis of the factors influencing basal metabolic rate in normal adults. Am. J. Clin. Nutr. 1980, 33, 2372–2374. [Google Scholar] [CrossRef] [PubMed]
  51. Livingston, E.H.; Kohlstadt, I. Simplified Resting Metabolic Rate-Predicting Formulas for Normal-Sized and Obese Individuals. Obes. Res. 2005, 13, 1255–1262. [Google Scholar] [CrossRef]
  52. Wickham, J.B.; Mullen, N.J.; Whyte, D.G.; Cannon, J. Comparison of energy expenditure and heart rate responses between three commercial group fitness classes. J. Sci. Med. Sport 2017, 20, 667–671. [Google Scholar] [CrossRef]
  53. Warolin, J.; Carrico, A.R.; Whitaker, L.E.; Wang, L.; Chen, K.Y.; Acra, S.; Buchowski, M.S. Effect of BMI on Prediction of Accelerometry-Based Energy Expenditure in Youth. Med. Sci. Sports Exerc. 2012, 44, 2428–2435. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Müller, M.J.; Bosy-Westphal, A.; Klaus, S.; Kreymann, G.; Lührmann, P.M.; Neuhäuser-Berthold, M.; Noack, R.; Pirke, K.M.; Platte, P.; Selberg, O.; et al. World Health Organization equations have shortcomings for predicting resting energy expenditure in persons from a modern, affluent population: Generation of a new reference standard from a retrospective analysis of a German database of resting energy expenditure. Am. J. Clin. Nutr. 2004, 80, 1379–1390. [Google Scholar] [CrossRef]
  55. Henry, J. Basal metabolic rate studies in humans: Measurement and development of new equations. Public Health Nutr. 2005, 8, 1133–1152. [Google Scholar] [CrossRef] [PubMed]
  56. Kumahara, H.; Yoskioka, M.; Yoshitake, Y.; Shindo, M.; Schutz, Y.; Tanaka, H. The Difference between the Basal Metabolic Rate and the Sleeping Metabolic Rate in Japanese. J. Nutr. Sci. Vitaminol. 2004, 50, 441–445. [Google Scholar] [CrossRef] [Green Version]
  57. Brazeau, A.S.; Suppere, C.; Strychar, I.; Belisle, V.; Demers, S.P.; Rabasa-Lhoret, R. Accuracy of Energy Expendi-ture Estimation by Activity Monitors Differs with Ethnicity. Int. J. Sports Med. 2014, 35, 847–850. [Google Scholar]
  58. Roveda, E.; Vitale, J.A.; Bruno, E.; Montaruli, A.; Pasanisi, P.; Villarini, A.; Gargano, G.; Galasso, L.; Berrino, F.; Caumo, A.; et al. Protective Effect of Aerobic Physical Activity on Sleep Behavior in Breast Cancer Survivors. Integr. Cancer Ther. 2016, 16, 21–31. [Google Scholar] [CrossRef] [PubMed]
  59. Dobrosielski, D.A.; Phan, P.; Miller, P.; Bohlen, J.; Douglas-Burton, T.; Knuth, N.D. Associations between vasodilatory capacity, physical activity and sleep among younger and older adults. Graefe’s Arch. Clin. Exp. Ophthalmol. 2015, 116, 495–502. [Google Scholar] [CrossRef]
  60. Melanson, E.L.; Ritchie, H.K.; Dear, T.B.; Catenacci, V.; Shea, K.; Connick, E.; Moehlman, T.M.; Stothard, E.R.; Higgins, J.; McHill, A.W.; et al. Daytime bright light exposure, metabolism, and individual differences in wake and sleep energy expenditure during circadian entrainment and misalignment. Neurobiol. Sleep Circadian Rhythm 2017, 4, 49–56. [Google Scholar] [CrossRef] [PubMed]
  61. Wielopolski, J.; Reich, K.; Clepce, M.; Fischer, M.; Sperling, W.; Kornhuber, J.; Thuerauf, N. Physical activity and energy expenditure during depressive episodes of major depression. J. Affect. Disord. 2015, 174, 310–316. [Google Scholar] [CrossRef]
  62. Watanabe, E.; Okada, A.; Takeshima, N.; Inomata, K. Effects of Increasing Expenditure of Energy during Exercise on Psychological Well-Being in Older Adults. Percept. Mot. Ski. 2001, 92, 288–298. [Google Scholar] [CrossRef]
  63. Chang, C.-H.; Hsu, Y.-J.; Li, F.; Tu, Y.-T.; Jhang, W.-L.; Hsu, C.-W.; Huang, C.-C.; Ho, C.-S. Reliability and validity of the physical activity monitor for assessing energy expenditures in sedentary, regularly exercising, non-endurance athlete, and endurance athlete adults. PeerJ 2020, 8, e9717. [Google Scholar] [CrossRef] [PubMed]
  64. Spierer, D.K.; Hagins, M.; Rundle, A.; Pappas, E. A comparison of energy expenditure estimates from the Actiheart and Actical physical activity monitors during low intensity activities, walking, and jogging. Graefe’s Arch. Clin. Exp. Ophthalmol. 2010, 111, 659–667. [Google Scholar] [CrossRef]
  65. Duncan, G.E.; Lester, J.; Migotsky, S.; Goh, J.; Higgins, L.; Borriello, G. Accuracy of a novel multi-sensor board for measuring physical activity and energy expenditure. Graefe’s Arch. Clin. Exp. Ophthalmol. 2011, 111, 2025–2032. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Kendall, B.; Bellovary, B.; Gothe, N.P. Validity of wearable activity monitors for tracking steps and estimating energy expenditure during a graded maximal treadmill test. J. Sports Sci. 2018, 37, 42–49. [Google Scholar] [CrossRef] [PubMed]
  67. Cheung, M. Implementing Restricted Maximum Likelihood Estimation in Structural Equation Models. Struct. Equ. Model. A Multidiscip. J. 2013, 20, 157–167. [Google Scholar] [CrossRef]
  68. Fávero, L.P.; Belfiore, P.; Silva, F.d.; Chan, B.L. Análise de Dados: Modelagem Multivariada para Tomada de Decisões; Elsevier: Rio De Janeiro, Brazil, 2009. [Google Scholar]
  69. Freedson, P.S.; Lyden, K.; Keadle, S.; Staudenmayer, J. Evaluation of artificial neural network algorithms for predicting METs and activity type from accelerometer data: Validation on an independent sample. J. Appl. Physiol. 2011, 111, 1804–1812. [Google Scholar] [CrossRef] [PubMed]
  70. Kang, J.I.E.; Robertson, R.J.; Goss, F.L.; Dasilva, S.G.; Suminski, R.R.; Utter, A.C.; Zoeller, R.F.; Metz, K.F. Metabolic efficiency during arm and leg exercise at the same relative intensities. Med. Sci. Sports Exerc. 1997, 29, 377–382. [Google Scholar] [CrossRef]
  71. Weber, C.L.; Chia, M.; Inbar, O. Gender Differences in Anaerobic Power of the Arms and Legs—A Scaling Issue. Med. Sci. Sports Exerc. 2006, 38, 129–137. [Google Scholar] [CrossRef] [PubMed]
  72. Bland, J.M.; Altman, D.G. Measuring agreement in method comparison studies. Stat. Methods Med Res. 1999, 8, 135–160. [Google Scholar] [CrossRef]
  73. Fasching, P.; Rinnerhofer, S.; Wultsch, G.; Birnbaumer, P.; Hofmann, P. The First Lactate Threshold Is a Limit for Heavy Occupational Work. J. Funct. Morphol. Kinesiol. 2020, 5, 66. [Google Scholar] [CrossRef]
  74. Villars, C.; Bergouignan, A.; Dugas, J.; Antoun, E.; Schoeller, D.A.; Roth, H.; Maingon, A.C.; Lefai, E.; Blanc, S.; Simon, C. Validity of combining heart rate and uniaxial acceleration to measure free-living physical activity energy expenditure in young men. J. Appl. Physiol. 2012, 113, 1763–1771. [Google Scholar] [CrossRef] [Green Version]
  75. Hay, D.C.; Wakayama, A.; Sakamura, K.; Fukashiro, S. Improved estimation of energy expenditure by artificial neural network modeling. Appl. Physiol. Nutr. Metab. 2008, 33, 1213–1222. [Google Scholar] [CrossRef] [PubMed]
  76. Molina-Luque, R.; Carrasco-Marín, F.; Márquez-Urrizola, C.; Ulloa, N.; Romero-Saldaña, M.; Molina-Recio, G. Accuracy of the Resting Energy Expenditure Estimation Equations for Healthy Women. Nutrients 2021, 13, 345. [Google Scholar] [CrossRef]
  77. Hall, K.D.; Guo, J.; Chen, K.Y.; Leibel, R.L.; Reitman, M.L.; Rosenbaum, M.; Smith, S.R.; Ravussin, E. Methodologic considerations for measuring energy expenditure differences between diets varying in carbohydrate using the doubly labeled water method. Am. J. Clin. Nutr. 2019, 109, 1328–1334. [Google Scholar] [CrossRef] [Green Version]
  78. Westerterp, K.R. Exercise, energy balance and body composition. Eur. J. Clin. Nutr. 2018, 72, 1246–1250. [Google Scholar] [CrossRef] [PubMed]
  79. Moonen, H.P.F.X.; Beckers, K.J.H.; van Zanten, A.R.H. Energy expenditure and indirect calorimetry in critical illness and convalescence: Current evidence and practical considerations. J. Intensiv. Care 2021, 9, 1–13. [Google Scholar] [CrossRef] [PubMed]
  80. Roskoden, F.C.; Krüger, J.; Vogt, L.J.; Gärtner, S.; Hannich, H.J.; Steveling, A.; Lerch, M.M.; Aghdassi, A.A. Physical Activity, Energy Expenditure, Nutritional Habits, Quality of Sleep and Stress Levels in Shift-Working Health Care Personnel. PLoS ONE 2017, 12, e0169983. [Google Scholar] [CrossRef]
Figure 1. Equipment disposition during the experiments.
Figure 1. Equipment disposition during the experiments.
Ijerph 18 10419 g001
Figure 2. Bland–Altman plot of agreement between measured data and (a) the hierarchical mixed model with activity variable, (b) the hierarchical mixed model without physical activity level variable, (c) the Swartz equation (2000) (d) Freedson’s VM3 combined equation (2011), and (e) the heart rate relation method ISO 8996:2004.
Figure 2. Bland–Altman plot of agreement between measured data and (a) the hierarchical mixed model with activity variable, (b) the hierarchical mixed model without physical activity level variable, (c) the Swartz equation (2000) (d) Freedson’s VM3 combined equation (2011), and (e) the heart rate relation method ISO 8996:2004.
Ijerph 18 10419 g002
Table 1. Participants characteristics.
Table 1. Participants characteristics.
VariablesTotal (n = 50)Males (n = 25)Females (n = 25)
MeanSDMeanSDMeanSD
Age (years)29.845.1230.405.7429.284.46
Height (cm)170.209.54176.168.32164.246.55
Weight (kg)69.2914.0677.9813.1560.608.58
FFM (kg)52.3412.6561.6810.7143.005.51
FM (kg)16.545.5915.966.3117.124.84
Note: SD—standard deviation; FFM—fat-free mass; FM—fat mass.
Table 2. Detailed description of protocol of activities.
Table 2. Detailed description of protocol of activities.
Activity SequenceDescriptionDuration (min)Type of Activity
1Lying10Basal
2Sitting, doing computer work5Basal
3Standing, playing with cards5Multitask
4Standing, moving up and down a 2 kg load, metronome: 40 bits/min5Multitask
5Sitting, watching a video5Basal
6Sweeping5Multitask
7Sitting–standing 10 timesFreeMultitask
8Sitting, watching a video5Basal
9Moving plastic boxes with a 5 kg load5Multitask
10Moving plastic boxes with a 10 kg load5Multitask
11Sitting, watching a video5Basal
12Slow walking (from the lab to the stairs)FreeDisplacement
13Stairs (go down and up four floors)FreeDisplacement
14Slow walking (from the stairs to the lab)FreeDisplacement
15Sitting 5Basal
Table 3. Random effects of investigated levels on the intercept.
Table 3. Random effects of investigated levels on the intercept.
LevelParametersIncluding Physical Activity LevelExcluding Physical Activity Level
Explained VarianceRelative ValuesExplained VarianceRelative Values
ParticipantsIntercept0.243929.86%0.266031.70%
ActivitiesIntercept0.270633.12%0.270732.26%
Residual-0.302437.01%0.302436.04%
Total0.8169100.00%0.8391100.00%
Table 4. Fixed effects of the variables before the adjustments.
Table 4. Fixed effects of the variables before the adjustments.
Variable Including Physical Activity Level Excluding Physical Activity Level
Estimated Effectp-ValueEstimated Effectp-Value
Intercept −3.17<0.001−2.999<0.001
Heart rate (x1) 0.04944<0.0010.04942<0.001
Wrist counts per minute (x2) 0.0000473<0.0010.00004736<0.001
Ankle counts per minute (x3) 0.000213<0.0010.0002129<0.001
Weight’s quadratic term (x4²) 0.000193<0.0010.0001927<0.001
Physical activity level (x5)0.00003510.0267
Female sex: Wrist counts per minute (x2F1) −0.000046<0.001−0.0000458<0.001
Female sex: Ankle counts per minute (x3F1) −0.000119<0.001−0.0001191<0.001
Table 5. Measures of adjustment and error of the models.
Table 5. Measures of adjustment and error of the models.
MeasureExcluding Physical Activity Level VariableIncluding Physical Activity Level Variable
R20.83255920.8324836
Bias−0.0329973−0.03372094
MAE0.43974350.4397387
RMSE0.6130140.6131523
Standard Deviation0.61307210.6131713
Table 6. Mean of the errors of the total expenditure of the cycle between the methods applied in relation to the energy expenditure by indirect calorimetry.
Table 6. Mean of the errors of the total expenditure of the cycle between the methods applied in relation to the energy expenditure by indirect calorimetry.
Energy Expenditure Assessment Method Bias Standard Error [kcal] Pearson Correlation Coefficient (r) Standard Deviation [kcal]
(a) Hierarchical mixed-regression model excluding “physical activity level”−0.03300.91290.6131
(b) Hierarchical mixed-regression model including “physical activity level” −0.033720.91280.6132
(c) Swartz equation 1.00380.79480.9157
(d) Freedson VM3 combination equation −1.68820.77790.9528
(e) Heart rate estimation 0.59560.78121.2278
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lucena, A.; Guedes, J.; Vaz, M.; Silva, L.; Bustos, D.; Souza, E. Modeling Energy Expenditure Estimation in Occupational Context by Actigraphy: A Multi Regression Mixed-Effects Model. Int. J. Environ. Res. Public Health 2021, 18, 10419. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910419

AMA Style

Lucena A, Guedes J, Vaz M, Silva L, Bustos D, Souza E. Modeling Energy Expenditure Estimation in Occupational Context by Actigraphy: A Multi Regression Mixed-Effects Model. International Journal of Environmental Research and Public Health. 2021; 18(19):10419. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910419

Chicago/Turabian Style

Lucena, André, Joana Guedes, Mário Vaz, Luiz Silva, Denisse Bustos, and Erivaldo Souza. 2021. "Modeling Energy Expenditure Estimation in Occupational Context by Actigraphy: A Multi Regression Mixed-Effects Model" International Journal of Environmental Research and Public Health 18, no. 19: 10419. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph181910419

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop