Next Article in Journal
Association between Nutrition Policies and Student Body Mass Index
Next Article in Special Issue
Phenol-Rich Food Acceptability: The Influence of Variations in Sweetness Optima and Sensory-Liking Patterns
Previous Article in Journal
Intermittent Fasting Ameliorated High-Fat Diet-Induced Memory Impairment in Rats via Reducing Oxidative Stress and Glial Fibrillary Acidic Protein Expression in Brain
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Facial EMG Activity Is Associated with Hedonic Experiences but Not Nutritional Values While Viewing Food Images

1
Psychological Process Team, Robotics Project, Baton Zone Program, RIKEN, Soraku-gun, Kyoto 619-0288, Japan
2
Field Science Education and Research Center, Kyoto University, Kyoto 606-8502, Japan
3
Kyoto University of the Arts, 2-116 Uryuyama Kitashirakawa, Sakyo, Kyoto 606-8271, Japan
4
Faculty of Agriculture, Ryukoku University, Ohtsu 520-2194, Japan
*
Author to whom correspondence should be addressed.
Submission received: 24 November 2020 / Revised: 14 December 2020 / Accepted: 18 December 2020 / Published: 22 December 2020
(This article belongs to the Special Issue Sensory Perception and Preference of Palatable Food)

Abstract

:
The physiological correlates of hedonic/emotional experiences to visual food stimuli are of theoretical and practical interest. Previous psychophysiological studies have shown that facial electromyography (EMG) signals were related to subjective hedonic ratings in response to food images. However, because other data showed positive correlations between hedonic ratings and objective nutritional values of food, whether the facial EMG reactions to food images could reflect the hedonic evaluation or nutritional assessment of food remains unknown. To address this issue, we measured subjective hedonic ratings (liking, wanting, valence, and arousal) and physiological signals (facial EMG of the corrugator supercilii, zygomatic major, masseter, and suprahyoid muscles, skin potential responses, and heart rates) while participants observed food images that had objective nutritional information (caloric, carbohydrate, fat, and protein contents). The results revealed that zygomatic major EMG activity was positively correlated with ratings of liking, wanting, and valence, but not with any objective nutritional value. These data indicate that facial EMG signals in response to food images reflect subjective hedonic experiences, but not objective nutritional values, associated with the food item.

1. Introduction

Hedonic responses (e.g., liking) to visual food stimuli play a crucial role in our survival and wellbeing, because “we eat first with our eyes”, as has been traditionally said [1], and hedonic responses strongly urge people to consume food [2]. Therefore, elucidating the physiological correlates of subjective hedonic experiences to visual food stimuli is of theoretical and practical interest. As several researchers [3,4,5] have proposed in the general literature on emotion, physiological activity may be the underlying mechanism of subjective hedonic experiences while observing food. Physiological measures are objective indices of subjective hedonic reactions to food materials, which food product developers use to develop new food materials complementing subjective hedonic ratings.
A few previous studies have reported that facial electromyography (EMG) signals were associated with subjective hedonic ratings while viewing food images [6,7,8]. Specifically, Greenwald et al. [6] assessed ratings of valence and arousal (i.e., the quality and intensity of emotional experience, respectively) and measured facial EMG of the corrugator supercilii muscle (related to frowning) and the zygomatic major muscle (related to smiling) while participants observed multiple images, including a food image. The valence ratings were negatively and positively associated with corrugator supercilii and zygomatic major EMG activity, respectively. Nath et al. [7,8] also measured facial EMG signals from these and additional muscles and assessed liking ratings while participants viewed several different food images. The liking ratings were negatively and positively associated with EMG activity of the corrugator supercilii [7,8] and zygomatic major muscles [7], respectively. Corroborating these data, other studies recorded EMG from these facial muscles while participants consumed liquid [9,10,11] or solid [12] food and showed similar associations between hedonic ratings, such as liking, wanting, and valence, and facial EMG activity of these muscles. Relatedly, some studies reported an association between facial expressions analyzed from video data and liking ratings during liquid food consumption [13,14]. Other studies found facial reactions using EMG or video data during the viewing [15,16] or consuming [17,18,19,20,21,22,23,24,25] of food stimuli. These findings suggest that subjective hedonic experiences while viewing food images may be associated with facial EMG activity.
However, whether facial EMG activity primarily reflects subjective hedonic experiences to food or objective nutritional values of the food remains unknown. It is generally assumed that foods with high caloric and/or fat contents are preferable [26] and that human hedonic responses may have evolved to select energy-dense and fatty foods for survival [27]. Consistent with this notion, a recent study has shown that subjective hedonic ratings, including liking, wanting, and valence, for food images were positively associated with the objective nutritional values of the caloric and fat contents of the food [28]. These data suggest that nutritional information about food could be a potential extraneous factor affecting the relationship between hedonic experience and physiological responses, including facial muscle activity. However, ample evidence has shown that hedonic responses to food reflect multiple factors, including learning experiences, and are not directly associated with the nutritional values of food [29]. Based on this line of evidence, we hypothesized that subjective hedonic responses to food images would have a stronger association with facial EMG activity than would the objective nutritional values of the food.
To test this hypothesis, we measured hedonic ratings and physiological signals while participants viewed food images. We presented photographs of Japanese food samples (Figure 1) that were validated as natural and hedonically evocative stimuli in a previous study of Japanese healthy adults [28]. These pictures were accompanied by objective nutrition information for each item, including caloric, carbohydrate, fat, and protein contents. Participants observed the food images and then rated their levels of liking, wanting, valence, and arousal. For physiological signals, we recorded facial EMG signals of the corrugator supercilii and zygomatic major muscles as measures of interest. We additionally recorded EMG signals of the masseter and suprahyoid muscles, which are related to food consumption [30,31,32], in an exploratory manner. As exploratory data, we also recorded skin potential response (SPR) and heart rate (HR), which reflect activity in the autonomic nervous system and are often related to emotional arousal [33,34,35]. We calculated intra-individual correlations [36,37] between the subjective ratings and physiological activity and evaluated the correlation coefficients in second-stage group analyses. Based on ample prior evidence, we predicted that liking, wanting, and valence ratings would show negative and positive associations with corrugator supercilii and zygomatic major EMG activity, respectively. More importantly, we predicted that the objective nutritional values of the food would show less evident associations with facial EMG activity than would subjective hedonic ratings.

2. Materials and Methods

2.1. Participants

We recruited 34 Japanese healthy young-adult participants (20 females; mean ± standard deviation (SD) age, 23.0 ± 5.0 years). We determined sample size using an a priori power analysis according to the guideline [38]. We used G*Power v3.1.9.2 software [39] and aimed to compare intra-individual correlation coefficients of facial EMG activity with subjective hedonic ratings vs. with objective nutrition information using dependent t-tests (two-tailed) with an α level of 0.05, power of 0.80, and effect size Cohen’s d of 0.5 (strong). The results indicated that 34 participants were sufficient. The recruitment of participants was conducted through advertising for healthy experimental participants presenting at the Kyoto University facility, and each participant received 1000 Japanese yen book coupons. No participants reported having physical or psychiatric problems. Participants reported their height and weight and the data showed that their average body mass index (BMI) was normal (mean ± SD, 20.7 ± 2.3; range, 15.1–26.9 kg/m2). All participants were not aware of facial EMG recording and had fasted for more than 3 h prior to the experiment. We assessed each participant’s hunger level before the experiment using a Likert scale (5-point), which ranged from 1 (full) to 5 (hungry) and found that the majority of them were relatively hungry (mean ± SD, 2.9 ± 0.8). After explaining the procedures, all participants gave written informed consent. This study was approved by Ethics Committee of the Unit for Advanced Studies of the Human Mind, Kyoto University on 24 July 2018. The experiment was conducted in accordance with institutional ethical guidelines and the tenets of the Declaration of Helsinki.

2.2. Apparatus

Experimental control was conducted using Presentation software v14.9 (Neurobehavioral Systems, Berkeley, CA, USA) on a Windows computer (HP Z200 SFF, Hewlett–Packard Japan, Tokyo, Japan). Stimuli were represented on a 19-inch cathode ray tube monitor (HM903D-A, Iiyama, Tokyo, Japan) at the resolution of 1024 horizontal × 768 vertical pixels and screen refresh rate of 100 Hz.

2.3. Stimuli

We used 32 color photographs of Japanese food samples (e.g., tempura and grilled fish) developed in a previous study [28] (Figure 1). The original food samples were selected from a Japanese food sample database, the Syokuiku Satisfactory “à La Carte” Tray (SAT) system (Iwasaki, Osaka, Japan). The SAT system contains samples of contemporary Japanese foods that appear in typical Japanese home meals and look similar to actual food. Crucially, the SAT system provides precise nutrient information for each item, including calories, carbohydrate, fat, and protein, through a careful analysis of contained materials. A previous study has shown that the photographs of these Japanese food samples were rated as natural [28]. Three other photographs from the database were used only for practice. The stimulus size was 640 horizontal × 480 vertical pixels, corresponding to a visual angle of approximately 23.9° horizontally × 17.9° vertically.

2.4. Procedure

The experiment was run on an individual basis in a sound-proof shielded room (Science Cabin, Takahashi Kensetsu, Tokyo, Japan). Before the experiment, the participants were informed that the objective of the experiment was to record electric signals from the skin in response to food images. Participants spent approximately 10 min adapting to the experimental environment. After three practice trials, a total of 32 trials were presented in random order separated by a varying intertrial interval (20–30 s).
Each trial began with the fixation point (a white cross) presented for 1 s on the black screen. Then, a food image was presented for 5 s. After that, a response display with four rating scales was presented until the participants finished their responses. The participants were instructed to rate their experiences while viewing the image. Four 9-point rating scales were presented simultaneously in fixed order: liking, wanting, valence, and arousal. Liking and wanting were evaluated using lines with numbers and anchors at the ends with ranges from 1 (dislike) to 9 (like) and 1 (do not want to eat) to 9 (want to eat), respectively. Valence and arousal evaluated using numbers, anchors at the ends, and the schematic images of a self-assessment manikin [40].

2.5. Physiological Data Recording

Facial EMG signals of the corrugator supercilii, zygomatic major, masseter, and suprahyoid muscles were recorded using pre-gelled, self-adhesive silver/silver chloride (Ag/AgCl) electrodes with 0.7-cm diameter and 1.5-cm interelectrode distance (Prokidai, Sagara, Japan). The electrodes were attached according to guidelines [41,42] and methods in previous studies [12,31,32]. A ground electrode was set in the middle of the forehead. The EMG signals were amplified and digitally sampled at 1 kHz using an EMG-025 amplifier (Harada Electronic Industry, Sapporo, Japan) and PowerLab 16/35 data collection system and LabChart Pro v8.0 software (ADInstruments, Dunedin, New Zealand). Online filter was applied (20–400 Hz [43]). Unobtrusive videotaping was conducted using a web camera (HD1080P, Logicool, Tokyo, Japan).
SPR was recorded from the hypothenar eminence of the left palm and the left forearm using pre-gelled, self-adhesive Ag/AgCl electrodes with 1.0-cm diameter (Vitrode F, Nihonkoden, Tokyo, Japan). The electrodes were attached in accordance with guidelines [44]. SPR signals were amplified and digitally sampled using a SPN-01 amplifier (Skinos, Ueda, Japan) and the same data collection system and software as those used for the EMG recording except that there was no online filter.
HR was recorded using a photo-plethysmograph placed on the fingertip of the left second finger. The data were digitally sampled with the same data collection system and software as those used for the EMG recording except for no online filter. The software automatically calculated beats per minute.

2.6. Data Analysis

2.6.1. Preprocessing

We analyzed facial EMG signals using Psychophysiological Analysis Software v3.3 (Computational Neuroscience Laboratory of the Salk Institute, La Jolla, CA, USA) and in-house programs run under Matlab 2018 (MathWorks, Natick, MA, USA). The EMG signals during the 0.5-s pre-stimulus baseline period immediately prior to the stimulus presentation (the fixation point) and the 5-s stimulus presentation period were extracted for each trial. A coder who was blind to the experimental conditions checked the video data and confirmed that no participants made large motion artifacts. The EMG signals for each trial were rectified, baseline-corrected, and averaged. The EMG signal values were then standardized for each participant. To remove the effect of outliers, data with values falling outside the range of ± 3 were removed.
The SPR and HR signals were analyzed in the same way as the EMG analysis except that the signals were not rectified.

2.6.2. Statistical Analysis

We calculated Pearson’s correlation coefficients (r) for each participant to measure individual-level correlations among subjective ratings; between subjective ratings and objective nutritional information (calories (kcal) and relative caloric percentages of carbohydrate, fat, and protein); between subjective ratings and physiological activity; and between objective nutritional information and physiological activity. We predicted the associations between liking/wanting/valence and corrugator supercilii/zygomatic major EMG activity as described in the Introduction. Other relationships were analyzed in the same way for descriptive purposes. The intra-individual correlation coefficients were normalized using Fisher’s z-transformation and then analyzed with one-sample t-tests (two-tailed) to compare the means with zero, in accordance with previous studies that investigated subjective–physiological emotional concordance using food (e.g., [12]) and non-food (e.g., [45]) stimuli. Such a two-stage procedure has been shown to be valid as a random-effects analysis [46]. To visually illustrate the associations between subjective ratings and physiological activity at the group-level, we depicted the relationships between group-averaged subjective ratings and standardized physiological data. The differences between subjective–physiological and nutrition–physiological intra-individual correlation coefficients were also analyzed using paired t-tests (two-tailed) with the same two-stage procedure. The threshold for significance was set at p < 0.05.
Because some previous studies have suggested moderating effects of BMI and hunger on the hedonic [47,48] or nutritional [49,50] processing of food, we performed preliminary analyses of BMI and hunger. We calculated inter-individual correlation coefficients between these measures and intra-individual subjective–physiological or nutrition–physiological correlation coefficients. We only analyzed the physiological data of zygomatic major EMG, as the main analyses showed significant effects only for this measure. The results showed that neither BMI nor hunger level were significantly correlated with the correlation coefficients of zygomatic major EMG activity with subjective ratings or objective nutritional values (|r| < 0.21, p > 0.1). Hence, these participant factors were disregarded.

3. Results

3.1. Subjective Ratings

Table 1 shows the mean intra-individual correlation coefficients among hedonic subjective ratings (liking, wanting, valence, and arousal) for food images and between subjective ratings and objective nutritional values (calories, carbohydrate, fat, and protein). One-sample t-tests for the correlation coefficients after Fisher transformation showed that all subjective ratings were significantly and positively correlated with one another (r > 0.48, p < 0.001). In addition, all of the subjective ratings were positively correlated with objective caloric contents and %fat (r > 0.12, p < 0.05), whereas significant negative correlations were observed with %carbohydrate (r < −0.08, p < 0.05).

3.2. Association between Subjective Ratings and Physiological Activity

The association between subjective ratings and physiological activity while viewing food images at the individual-level was analyzed by calculating the intra-individual correlation coefficients between subjective ratings and the mean physiological activity during image presentation. One-sample t-tests after Fisher transformation demonstrated that the liking, wanting, and valence ratings were significantly and positively correlated with zygomatic major EMG activity (r > 0.10, p < 0.001; Figure 2 and Table 2). Figure 3 illustrates these associations using group-averaged data. Besides, a positive correlation between wanting ratings and SPR reached significance (r > 0.07, p < 0.05). No other associations between subjective ratings and physiological activity reached significance (p > 0.1).

3.3. Association between Objective Nutritional Information and Physiological Activity

The association between objective nutritional values and physiological activity at the individual-level was analyzed as in the above analyses for subjective ratings. No significant correlation was observed between objective nutritional values and physiological responses (r < 0.06, p > 0.1; Figure 4 and Table 3).
We analyzed the correlation coefficients using dependent t-tests to compare the degree of association between zygomatic major EMG activity and subjective hedonic ratings with that between zygomatic major EMG activity and objective nutritional values. The subjective ratings of liking, wanting, and valence were selected to test for associations with zygomatic major EMG activity and compared against all objective nutritional values. The results showed that all of these subjective ratings had significantly stronger correlations with zygomatic major EMG activity (t > 2.20, p < 0.05; Table 4).

4. Discussion

The subjective ratings of liking, wanting, and valence were positively associated with EMG activity in the zygomatic major muscle while the participants viewed food images. These results corroborate prior findings reporting positive associations between subjective valence/liking ratings and zygomatic major EMG activity in response to food images [6,7]. Our study did not show any evident association between hedonic ratings and corrugator supercilii EMG activity, which is inconsistent with previous studies [6,7,8]. These discrepant findings may be due to methodological differences across studies. For example, in contrast to previous studies, our stimuli did not include any negative stimuli, which may have resulted in a lack of activity in the corrugator supercilii muscle.
More importantly, our data newly revealed that zygomatic major EMG activity was not associated with objective nutritional values, including caloric, carbohydrate, fat, or protein contents. In addition, the results revealed a stronger association between zygomatic major EMG activity and subjective hedonic ratings than between zygomatic major EMG activity and objective nutritional values. These results could be important because subjective hedonic ratings of food images are positively associated with the nutritional value of food [28] and, hence, food nutritional values were candidate extraneous variables [51] explaining the link between hedonic responses and facial EMG activity. Our data indicate that facial EMG activity is a physiological correlate of subjective hedonic experiences but not of objective nutritional values associated with food images.
Our results have theoretical implications. First, although it is widely assumed that hedonic responses to food may have evolved to foster acquisition of energy-dense and fatty foods [27] and people are generally good at estimating the nutritional values of visual food stimuli [28,52,53], our data suggest that the hedonic appraisals that produce facial muscle activity are not based solely on such nutritional computation. The results are in line with empirically grounded theory suggesting that innate hedonic responses to food based on national values could be altered by learned values acquired through various experiences such as mere exposure, classical conditioning, and social learning [29]. Consistent with this proposal, numerous studies have shown that learning experiences modulated hedonic responses to food [54]. Behavioral genetic studies also showed that genetic factors were strongly influenced by learning experiences [55]. Taken together, these findings suggest that hedonic appraisal of visual food stimuli involves learned, non-nutritional values attributed to food and produces corresponding bodily responses, including facial expressions. Second, our data heighten the possibility that facial EMG activity is a physiological correlate of subjective hedonic responses to visual food stimuli. In the literature of general emotional processing, the association between subjective emotional experiences and physiological activity has long been debated, and several researchers have proposed that physiological activity may underlie subjective emotional experiences [3,4,5]. Collectively, our data suggest that the production of facial muscle activity and its interoceptive perception may play an important role in the production of subjective hedonic experiences during visual food processing.
Our results also have practical implications. Because hedonic reactions are important for eating behaviors [2], food product developers need to assess hedonic reactions to their new products. However, subjective ratings, which companies mainly rely on, can be biased [56]. Our results provide additional evidence that facial EMG can be an objective correlate of subjective hedonic experiences. Measuring facial EMG has disadvantages relative to assessing subjective ratings, such as the need for equipment and the process of attaching contacts on participants, but may also carry some unique advantages. First, unlike subjective ratings, EMG can be continuously recorded without interfering with behaviors. Second, some previous studies using non-food visual stimuli have shown that facial EMG could detect unconscious emotional responses [57,58,59], which may also occur in the case of visual processing of food [60,61,62,63]. Third, a recent human pharmacological study showed that administration of opioid antagonists reduced zygomatic major EMG activity during the consumption of liked liquid food, but did not modulate the subjective ratings of liking and wanting [11]. The data suggest that facial EMG may more directly reflect activity in the brain reward circuits than subjective ratings under some conditions. Collectively, these advantages suggest that facial EMG recording may provide unique information complementing subjective hedonic ratings in applied consumer research. It would be interesting to assess objective hedonic responses during the viewing of food product packaging in real situations by using wearable devices that measure facial EMG activity.
In addition to facial EMG activity, our results showed that SPR was positively associated with subjective wanting ratings for food images. These results suggest the possibility that autonomic nervous system activity could be associated with the subjective hedonic response to food images in addition to facial muscle activity. However, due to a scarcity of evidence, we could not make preplanned hypotheses regarding physiological measures other than facial EMG; hence, we investigated these measures in an exploratory manner by conducting multiple testing without correction [64]. Additional tests and further confirmatory evidence are needed regarding the association between subjective wanting ratings and autonomic nervous system activity in response to visual food stimuli.
There are several limitations to this study. First, our sample was small and lacked the statistical power to detect weaker effects. Future studies using a larger sample may reveal associations of other physiological measures with subjective hedonic ratings. Second, although our preliminary analyses showed no significant moderator effect of BMI on subjective–physiological or nutrition–physiological correlations, we assessed participants’ BMI only using self-report data, which could differ from measured BMI data [65]. In addition, most of our participants were in the normal weight range, and none were obese. Future investigations measuring BMI objectively and testing various weight groups may reveal an influence of BMI on the association between physiological activity and hedonic or nutritional processing of visual food stimuli. Third, we tested only healthy participants, so the effect of physical (e.g., diabetes) or mental (e.g., eating disorder) problems remain untested. Investigation of the present topic in clinical samples is an important matter for future research. Fourth, we did not assess participants’ psychological traits. Because several previous studies have reported that participant traits such as eating style modulate hedonic reactions to food images [61,66], further investigation is necessary to reveal the modulatory effects of such traits on subjective–physiological associations in hedonic food processing. Fifth, we tested food images only with Japanese participants. Although it is generally assumed that basic hedonic responses are universal [67], several studies have reported that hedonic reactions to visual food stimuli may be different across cultures [68,69,70,71]. Hence, the generalizability of the present findings to other cultures requires further investigation. Finally, we applied only linear analyses. As some recent studies have reported that non-linear analyses using artificial neural networks could effectively classify surface EMG signals [72], such analyses may more sensitively reveal associations between hedonic experiences and facial EMG activity during the observation of food images.

5. Conclusions

Our results demonstrated that facial EMG activity recorded from the zygomatic major muscle was positively correlated with ratings of liking, wanting, and valence, but not with any objective nutritional values. These data indicate that facial EMG activity in response to food images reflect not the objective nutritional values but the subjective hedonic experiences in response to the food. These data have theoretical implications that hedonic appraisals producing facial muscle activity are not based solely on nutritional computation, and facial muscle activity plays an important role in the production of subjective hedonic experiences during visual food processing. The data also have practical implications in that facial EMG recording may provide objective information complementing subjective hedonic ratings in applied consumer research.

Author Contributions

Conceived and designed the experiments: W.S. and T.F. Performed the experiments: W.S. Analyzed the data: W.S. Wrote the paper: W.S., S.Y., and T.F. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by funds from the Research Complex Program from Japan Science and Technology Agency (JST), JST CREST (JPMJCR17A5), JST Mirai Program (JPMJMI20D7), and Japan Society for the Promotion of Science KAKENHI (18K03174).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by Ethics Committee of the Unit for Advanced Studies of the Human Mind, Kyoto University (30-P-6; 24 July, 2018).

Informed Consent Statement

Informed consent was obtained from all participants involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The authors thank Masaru Usami and Kazusa Minemoto for their technical support.

Conflicts of Interest

The authors declare no competing interests.

References

  1. Spence, C.; Okajima, K.; Cheok, A.D.; Petit, O.; Michel, C. Eating with our eyes: From visual hunger to digital satiation. Brain Cogn. 2016, 110, 53–63. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Sørensen, L.B.; Møller, P.; Flint, A.; Martens, M.; Raben, A. Effect of sensory perception of foods on appetite and food intake: A review of studies on humans. Int. J. Obes. Relat. Metab. Disord. 2003, 27, 1152–1166. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Friedman, B.H. Feelings and the body: The Jamesian perspective on autonomic specificity of emotion. Biol. Psychol. 2010, 84, 383–393. [Google Scholar] [CrossRef] [PubMed]
  4. Critchley, H.D.; Garfinkel, S.N. Interoception and emotion. Curr. Opin. Psychol. 2017, 17, 7–14. [Google Scholar] [CrossRef] [PubMed]
  5. Pace-Schott, E.F.; Amole, M.C.; Aue, T.; Balconi, M.; Bylsma, L.M.; Critchley, H.; Demaree, H.A.; Friedman, B.H.; Gooding, A.E.K.; Gosseries, O.; et al. Physiological feelings. Neurosci. Biobehav. Rev. 2019, 103, 267–304. [Google Scholar] [CrossRef] [PubMed]
  6. Greenwald, M.K.; Cook, E.W.; Lang, P.J. Affective judgment and psychophysiological response: Dimensional covariation in the evaluation of pictorial stimuli. J. Psychophysiol. 1989, 3, 51–64. [Google Scholar]
  7. Nath, E.C.; Cannon, P.R.; Philipp, M.C. An unfamiliar social presence reduces facial disgust responses to food stimuli. Food Res. Int. 2019, 126, 108662. [Google Scholar] [CrossRef]
  8. Nath, E.C.; Cannon, P.R.; Philipp, M.C. Co-acting strangers but not friends influence subjective liking and facial affective responses to food stimuli. Food Qual. Prefer. 2020, 82, 103865. [Google Scholar] [CrossRef]
  9. Horio, T. EMG activities of facial and chewing muscles of human adults in response to taste stimuli. Percept. Mot. Ski. 2003, 97, 289–298. [Google Scholar] [CrossRef]
  10. Korb, S.; Massaccesi, C.; Gartus, A.; Lundström, J.N.; Rumiati, R.; Eisenegger, C.; Silani, G. Facial responses of adult humans during the anticipation and consumption of touch and food rewards. Cognition 2020, 194, 104044. [Google Scholar] [CrossRef]
  11. Korb, S.; Götzendorfer, S.J.; Massaccesi, C.; Sezen, P.; Graf, I.; Willeit, M.; Eisenegger, C.; Silani, G. Dopaminergic and opioidergic regulation during anticipation and consumption of social and nonsocial rewards. eLife 2020, 9, e55797. [Google Scholar] [CrossRef] [PubMed]
  12. Sato, W.; Minemoto, K.; Ikegami, A.; Nakauma, M.; Funami, T.; Fushiki, T. Facial EMG correlates of subjective hedonic responses during food consumption. Nutrients 2020, 12, 1174. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Garcia-Burgos, D.; Zamora, M.C. Facial affective reactions to bitter-tasting foods and body mass index in adults. Appetite 2013, 71, 178–186. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. De Wijk, R.A.; He, W.; Mensink, M.G.; Verhoeven, R.H.; de Graaf, C. ANS responses and facial expressions differentiate between the taste of commercial breakfast drinks. PLoS ONE 2014, 9, e93823. [Google Scholar] [CrossRef] [PubMed]
  15. Bradley, M.M.; Codispoti, M.; Cuthbert, B.N.; Lang, P.J. Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion 2001, 1, 276–298. [Google Scholar] [CrossRef] [PubMed]
  16. Hoefling, A.; Likowski, K.U.; Deutsch, R.; Häfner, M.; Seibt, B.; Mühlberger, A.; Weyers, P.; Strack, F. When hunger finds no fault with moldy corn: Food deprivation reduces food-related disgust. Emotion 2009, 9, 50–58. [Google Scholar] [CrossRef] [PubMed]
  17. Epstein, L.H.; Paluchk, R.A. Habituation of facial muscle responses to repeated food stimuli. Appetite 1997, 29, 213–224. [Google Scholar] [CrossRef]
  18. Greimel, E.; Macht, M.; Krumhuber, E.; Ellgring, H. Facial and affective reactions to tastes and their modulation by sadness and joy. Physiol. Behav. 2006, 89, 261–269. [Google Scholar] [CrossRef]
  19. Armstrong, J.E.; Hutchinson, I.; Laing, D.G.; Jinks, A.L. Facial electromyography: Responses of children to odor and taste stimuli. Chem. Senses 2007, 32, 611–621. [Google Scholar] [CrossRef] [Green Version]
  20. Weiland, R.; Ellgring, H.; Macht, M. Gustofacial and olfactofacial responses in human adults. Chem. Senses 2010, 35, 841–853. [Google Scholar] [CrossRef] [Green Version]
  21. Wendin, K.; Allesen–Holm, B.H.; Bredie, W.L.P. Do facial reactions add new dimensions to measuring sensory responses to basic tastes? Food Qual. Prefer. 2011, 22, 346–354. [Google Scholar] [CrossRef]
  22. De Wijk, R.A.; Kooijman, V.; Verhoeven, R.H.G.; Holthuysen, N.T.E.; de Graaf, C. Autonomic nervous system responses on and facial expressions to the sight, smell, and taste of liked and disliked foods. Food Qual. Prefer. 2012, 26, 196–203. [Google Scholar] [CrossRef]
  23. Danner, L.; Haindl, S.; Joechl, M.; Duerrschmid, K. Facial expressions and autonomous nervous system responses elicited by tasting different juices. Food Res. Int. 2014, 64, 81–90. [Google Scholar] [CrossRef] [PubMed]
  24. Kostyra, E.; Rambuszek, M.; Waszkiewicz–Robak, B.; Laskowski, W.; Blicharski, T.; Poławska, E. Consumer facial expression in relation to smoked ham with the use of face reading technology. The methodological aspects and informative value of research results. Meat Sci. 2016, 119, 22–31. [Google Scholar] [CrossRef] [PubMed]
  25. Armstrong, J.E.; Laing, D.G.; Jinks, A.L. Taste-elicited activity in facial muscle regions in 5–8-week-old infants. Chem. Senses 2017, 42, 443–453. [Google Scholar] [CrossRef] [PubMed]
  26. Manabe, Y.; Matsumura, S.; Fushiki, T. Preference for high-fat foods in animals. In Fat Detection: Taste, Texture, and Post Ingestive Effects; Montmayeur, J.P., le Coutre, J., Eds.; CRC Press: Boca Raton, FL, USA, 2010; pp. 243–264. [Google Scholar]
  27. Drewnowski, A.; Almiron-Roig, E. Human perceptions and preferences for fat-rich foods. In Fat Detection: Taste, Texture, and Post Ingestive Effects; Montmayeur, J.P., Le Coutre, J., Eds.; CRC Press: Boca Raton, FL, USA, 2010; pp. 265–291. [Google Scholar]
  28. Sato, W.; Minemoto, K.; Sawada, R.; Miyazaki, Y.; Fushiki, T. Image database of Japanese food samples with nutrition information. PeerJ 2020, 8, e9206. [Google Scholar] [CrossRef] [PubMed]
  29. Eertmans, A.; Baeyens, F.; Van den Bergh, O. Food likes and their relative importance in human eating behavior: Review and preliminary suggestions for health promotion. Health Educ. Res. 2001, 16, 443–456. [Google Scholar] [CrossRef]
  30. Ioannides, Y.; Seers, J.; Defernez, M.; Raithatha, C.; Howarth, M.S.; Smith, A.; Kemsley, E.K. Electromyography of the masticatory muscles can detect variation in the mechanical and sensory properties of apples. Food Qual. Prefer. 2009, 20, 203–215. [Google Scholar] [CrossRef]
  31. Ishihara, S.; Nakauma, M.; Funami, T.; Tanaka, T.; Nishinari, K.; Kohyama, K. Electromyography during oral processing in relation to mechanical and sensory properties of soft gels. J. Texture Stud. 2011, 42, 254–267. [Google Scholar] [CrossRef]
  32. Kohyama, K.; Gao, Z.; Ishihara, S.; Funami, T.; Nishinari, K. Electromyography analysis of natural mastication behavior using varying mouthful quantities of two types of gels. Physiol. Behav. 2016, 161, 174–182. [Google Scholar] [CrossRef]
  33. Golland, Y.; Keissar, K.; Levit-Binnun, N. Studying the dynamics of autonomic activity during emotional experience. Psychophysiology 2014, 51, 1101–1111. [Google Scholar] [CrossRef] [PubMed]
  34. Christopoulos, G.I.; Uy, M.A.; Yap, W.J. The body and the brain: Measuring skin conductance responses to understand the emotional experience. Organ. Res. Methods 2016, 22, 394–420. [Google Scholar] [CrossRef]
  35. Sato, W.; Kochiyama, T.; Yoshikawa, S. Physiological correlates of subjective emotional valence and arousal dynamics while viewing films. Biol. Psychol. 2020, 157, 107974. [Google Scholar] [CrossRef] [PubMed]
  36. Curran, P.J.; Bauer, D.J. The disaggregation of within-person and between-person effects in longitudinal models of change. Annu. Rev. Psychol. 2011, 62, 583–619. [Google Scholar] [CrossRef] [Green Version]
  37. Zhang, Q.J.; Wang, L.P. Aggregating and testing intra-individual correlations: Methods and comparisons. Multivar. Behav. Res. 2014, 49, 130–148. [Google Scholar] [CrossRef]
  38. Kyonka, E.G.E. Tutorial: Small-N power analysis. Perspect. Behav. Sci. 2018, 42, 133–152. [Google Scholar] [CrossRef]
  39. Faul, F.; Erdfelder, E.; Lang, A.G.; Buchner, A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 2007, 39, 175–191. [Google Scholar] [CrossRef]
  40. Bradley, M.M.; Lang, P.J. Measuring emotion: The Self-Assessment Manikin and the Semantic Differential. J. Behav. Exp. Psychiatry 1994, 25, 49–59. [Google Scholar] [CrossRef]
  41. Fridlund, A.J.; Cacioppo, J.T. Guidelines for human electromyographic research. Psychophysiology 1986, 23, 567–589. [Google Scholar] [CrossRef]
  42. Schumann, N.P.; Bongers, K.; Guntinas-Lichius, O.; Scholle, H.C. Facial muscle activation patterns in healthy male humans: A multi-channel surface EMG study. J. Neurosci. Methods 2010, 187, 120–128. [Google Scholar] [CrossRef]
  43. Van Boxtel, A. Optimal signal bandwidth for the recording of surface EMG activity of facial, jaw, oral, and neck muscles. Psychophysiology 2001, 38, 22–34. [Google Scholar] [CrossRef] [PubMed]
  44. Boucsein, W. Electrodermal Activity, 2nd ed.; Springer: Tokyo, Japan, 2011. [Google Scholar]
  45. Van der Zwaag, M.D.; Westerink, J.; van den Broek, E.L. Emotional and psychophysiological responses to tempo, mode, and percussiveness. Music Sci. 2011, 15, 250–269. [Google Scholar] [CrossRef]
  46. Mumford, J.A.; Poldrack, R.A. Modeling group fMRI data. Soc. Cogn. Affect. Neurosci. 2007, 2, 251–257. [Google Scholar] [CrossRef] [Green Version]
  47. Johnson, S.L.; Boles, R.E.; Burger, K.S. Using participant hedonic ratings of food images to construct data driven food groupings. Appetite 2014, 79, 189–196. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Stoeckel, L.E.; Cox, J.E.; Cook, E.W.; Weller, R.E. Motivational state modulates the hedonic value of food images differently in men and women. Appetite 2007, 48, 139–144. [Google Scholar] [CrossRef] [PubMed]
  49. Larkin, D.; Martin, C.R. Caloric estimation of healthy and unhealthy foods in normal-weight, overweight and obese participants. Eat. Behav. 2016, 23, 91–96. [Google Scholar] [CrossRef] [PubMed]
  50. Horne, D.; Palermo, R.; Neumann, M.F.; Housley, R.; Bell, J. Can people accurately estimate the calories in food images? An optimised set of low- and high-calorie images from the food-pics database. Appetite 2019, 139, 189–196. [Google Scholar] [CrossRef] [PubMed]
  51. Lederer, D.J.; Bell, S.C.; Branson, R.D.; Chalmers, J.D.; Marshall, R.; Maslove, D.M.; Ost, D.E.; Punjabi, N.M.; Schatz, M.; Smyth, A.R.; et al. Control of confounding and reporting of results in causal inference studies. Guidance for authors from editors of respiratory, sleep, and critical care journals. Ann. Am. Thorac. Soc. 2019, 16, 22–28. [Google Scholar] [CrossRef] [Green Version]
  52. Brunstrom, J.M.; Drake, A.C.L.; Forde, C.G.; Rogers, P.J. Undervalued and ignored: Are humans poorly adapted to energy-dense foods? Appetite 2018, 120, 589–595. [Google Scholar] [CrossRef]
  53. Toepel, U.; Knebel, J.F.; Hudry, J.; le Coutre, J.; Murray, M.M. The brain tracks the energetic value in food images. Neuroimage 2009, 44, 967–974. [Google Scholar] [CrossRef]
  54. Spill, M.K.; Johns, K.; Callahan, E.H.; Shapiro, M.J.; Wong, Y.P.; Benjamin-Neelon, S.E.; Birch, L.; Black, M.M.; Cook, J.T.; Faith, M.S.; et al. Repeated exposure to food and food acceptability in infants and toddlers: A systematic review. Am. J. Clin. Nutr. 2019, 109, 978S–989S. [Google Scholar] [CrossRef] [PubMed]
  55. Wardle, J.; Cooke, L. Genetic and environmental determinants of children’s food preferences. Br. J. Nutr. 2008, 99, S15–S21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Nielsen, L.; Kaszniak, A.W. Conceptual, theoretical, and methodological issues in inferring subjective emotion experience: Recommendations for researchers. In Handbook of Emotion Elicitation and Assessment; Coan, J.A., Allen, J.J.B., Eds.; Oxford University Press: New York, NY, USA, 2007; pp. 361–375. [Google Scholar]
  57. Dimberg, U.; Thunberg, M.; Elmehed, K. Unconscious facial reactions to emotional facial expressions. Psychol. Sci. 2000, 11, 86–89. [Google Scholar] [CrossRef] [PubMed]
  58. Bornemann, B.; Winkielman, P.; van der Meer, E. Can you feel what you do not see? Using internal feedback to detect briefly presented emotional stimuli. Int. J. Psychophysiol. 2012, 85, 116–124. [Google Scholar] [CrossRef]
  59. Kaiser, J.; Davey, G.C.; Parkhouse, T.; Meeres, J.; Scott, R.B. Emotional facial activation induced by unconsciously perceived dynamic facial expressions. Int. J. Psychophysiol. 2016, 110, 207–211. [Google Scholar] [CrossRef]
  60. Ziauddeen, H.; Subramaniam, N.; Gaillard, R.; Burke, L.K.; Farooqi, I.S.; Fletcher, P.C. Food images engage subliminal motivation to seek food. Int. J. Obes. Relat. Metab. Disord. 2012, 36, 1245–1247. [Google Scholar] [CrossRef] [Green Version]
  61. Sato, W.; Sawada, R.; Kubota, Y.; Toichi, M.; Fushiki, T. Unconscious affective responses to food. PLoS ONE 2016, 11, e0160956. [Google Scholar] [CrossRef] [Green Version]
  62. Sato, W.; Kochiyama, T.; Minemoto, K.; Sawada, R.; Fushiki, T. Amygdala activation during unconscious visual processing of food. Sci. Rep. 2019, 9, 7277. [Google Scholar] [CrossRef] [Green Version]
  63. Sato, W. Association between dieting failure and unconscious hedonic responses to food. Front. Psychol. 2020, 11, 2089. [Google Scholar] [CrossRef]
  64. Armstrong, R.A. When to use the Bonferroni correction. Ophthalmic Physiol. Opt. 2014, 34, 502–508. [Google Scholar] [CrossRef]
  65. Maukonen, M.; Männistö, S.; Tolonen, H. A comparison of measured versus self-reported anthropometrics for assessing obesity in adults: A literature review. Scand. J. Public Health 2018, 46, 565–579. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Hou, R.; Mogg, K.; Bradley, B.P.; Moss-Morris, R.; Peveler, R.; Roefs, A. External eating, impulsivity and attentional bias to food cues. Appetite 2011, 56, 424–427. [Google Scholar] [CrossRef] [PubMed]
  67. Ekman, P.; Cordaro, D. What is meant by calling emotions basic. Emot. Rev. 2011, 3, 364–370. [Google Scholar] [CrossRef]
  68. Vu, T.M.H.; Tu, V.P.; Duerrschmid, K. Gazing behavior reactions of vietnamese and austrian consumers to austrian wafers and their relations to wanting, expected and tasted liking. Food Res. Int. 2018, 107, 639–648. [Google Scholar] [CrossRef]
  69. Sato, W.; Rymarczyk, K.; Minemoto, K.; Wojciechowski, J.; Hyniewska, S. Cultural moderation of unconscious hedonic responses to food. Nutrients 2019, 11, 2832. [Google Scholar] [CrossRef] [Green Version]
  70. Torrico, D.D.; Fuentes, S.; Gonzalez Viejo, C.; Ashman, H.; Dunshea, F.R. Cross-cultural effects of food product familiarity on sensory acceptability and non-invasive physiological responses of consumers. Food Res. Int. 2019, 115, 439–450. [Google Scholar] [CrossRef]
  71. Sato, W.; Rymarczyk, K.; Minemoto, K.; Hyniewska, S. Cultural differences in food detection. Sci. Rep. 2020, 10, 17285. [Google Scholar] [CrossRef]
  72. Jochumsen, M.; Niazi, I.K.; Zia Ur Rehman, M.; Amjad, I.; Shafique, M.; Gilani, S.O.; Waris, A. Decoding attempted hand movements in stroke patients using surface electromyography. Sensors 2020, 20, 6763. [Google Scholar] [CrossRef]
Figure 1. Examples of food images.
Figure 1. Examples of food images.
Nutrients 13 00011 g001
Figure 2. Mean (with standard error) intra-individual correlation coefficients (r) between subjective hedonic ratings and physiological activity while viewing food images. Corrugator = corrugator supercilii; Zygomatic = zygomatic major; SPR = skin potential response; HR = heart rate. *** p < 0.001; * p < 0.05.
Figure 2. Mean (with standard error) intra-individual correlation coefficients (r) between subjective hedonic ratings and physiological activity while viewing food images. Corrugator = corrugator supercilii; Zygomatic = zygomatic major; SPR = skin potential response; HR = heart rate. *** p < 0.001; * p < 0.05.
Nutrients 13 00011 g002
Figure 3. Group-mean (with standard error) values (dots) and regression lines (dashed lines) of subjective ratings (liking, wanting, and valence) and zygomatic major electromyography activity (standardized for each individual).
Figure 3. Group-mean (with standard error) values (dots) and regression lines (dashed lines) of subjective ratings (liking, wanting, and valence) and zygomatic major electromyography activity (standardized for each individual).
Nutrients 13 00011 g003
Figure 4. Mean (with standard error) intra-individual correlation coefficients (r) between objective nutritional values and physiological activity while viewing food images. No significant correlation was observed (p > 0.10). Corrugator = corrugator supercilii; Zygomatic = zygomatic major; SPR = skin potential response; HR = heart rate.
Figure 4. Mean (with standard error) intra-individual correlation coefficients (r) between objective nutritional values and physiological activity while viewing food images. No significant correlation was observed (p > 0.10). Corrugator = corrugator supercilii; Zygomatic = zygomatic major; SPR = skin potential response; HR = heart rate.
Nutrients 13 00011 g004
Table 1. Mean (with standard error) correlation coefficients among subjective ratings and between subjective ratings and nutritional information values.
Table 1. Mean (with standard error) correlation coefficients among subjective ratings and between subjective ratings and nutritional information values.
WantingValenceArousalCalorieCarbohydrateFatProtein
Liking0.770.660.510.27−0.150.19−0.04
(0.03)(0.04)(0.06)(0.04)(0.03)(0.03)(0.03)
Wanting 0.730.570.19−0.130.14−0.01
(0.04)(0.05)(0.04)(0.04)(0.04)(0.04)
Valence 0.480.20−0.110.13−0.04
(0.07)(0.04)(0.04)(0.04)(0.04)
Arousal 0.20−0.090.13−0.06
(0.04)(0.04)(0.03)(0.04)
Significant results (p < 0.05) are in bold.
Table 2. Results of one-sample t-tests (two-tailed; t-, p-, and Cohen’s d-values) for correlation coefficients between subjective hedonic ratings and physiological signals.
Table 2. Results of one-sample t-tests (two-tailed; t-, p-, and Cohen’s d-values) for correlation coefficients between subjective hedonic ratings and physiological signals.
RatingStatisticPhysiological
CorrugatorZygomaticMasseterSuprahyoidSPRHR
Likingt0.294.170.760.951.840.79
p0.7740.0000.4500.3510.0740.437
d0.050.710.120.160.310.13
Wantingt0.664.321.410.032.440.84
p0.5150.0000.1690.9800.0200.408
d0.110.740.240.000.410.15
Valencet0.323.840.760.291.860.32
p0.7510.0010.4510.7730.0720.753
d0.070.660.140.050.300.06
Arousalt0.491.810.240.851.441.28
p0.6290.0790.8130.4040.1580.208
d0.080.310.040.150.250.22
Degrees of freedom are 33 for all. Significant results (p < 0.05) are in bold. SPR = skin potential response; HR = heart rate.
Table 3. Results of one-sample t-tests (two-tailed; t-, p-, and Cohen’s d-values) for correlation coefficients between nutritional information and physiological signals.
Table 3. Results of one-sample t-tests (two-tailed; t-, p-, and Cohen’s d-values) for correlation coefficients between nutritional information and physiological signals.
RatingStatisticPhysiological
CorrugatorZygomaticMasseterSuprahyoidSPRHR
Likingt0.061.170.020.350.111.82
p0.9550.2490.9860.7270.9140.077
d0.010.200.010.060.020.31
Wantingt0.180.170.350.351.870.90
p0.8590.8660.7260.7310.0710.375
d0.030.030.050.060.320.16
Valencet0.080.030.221.951.370.48
p0.9360.9770.8280.0600.1790.637
d0.010.000.040.330.230.09
Arousalt0.000.060.211.061.070.76
p0.9980.9560.8380.2960.2940.453
d0.000.010.030.180.190.13
Degrees of freedom are 33 for all. No significant correlation was observed (p > 0.10). SPR = skin potential response; HR = heart rate.
Table 4. Results of dependent t-tests (two-tailed; t-, p-, and Cohen’s d-values) contrasting correlation coefficients between zygomatic major muscle activity and hedonic ratings with those between muscle activity and nutritional information.
Table 4. Results of dependent t-tests (two-tailed; t-, p-, and Cohen’s d-values) contrasting correlation coefficients between zygomatic major muscle activity and hedonic ratings with those between muscle activity and nutritional information.
RatingStatisticNutrition
CalorieCarbohydrateFatProtein
Likingt4.882.982.892.56
p0.0000.0050.0070.015
d0.890.680.700.67
Wantingt4.282.952.772.68
p0.0000.0060.0090.011
d0.890.680.700.67
Valencet4.002.212.922.41
p0.0000.0340.0060.022
d0.810.590.620.58
Degrees of freedom are 33 for all. Significant results (p < 0.05) are in bold.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sato, W.; Yoshikawa, S.; Fushiki, T. Facial EMG Activity Is Associated with Hedonic Experiences but Not Nutritional Values While Viewing Food Images. Nutrients 2021, 13, 11. https://0-doi-org.brum.beds.ac.uk/10.3390/nu13010011

AMA Style

Sato W, Yoshikawa S, Fushiki T. Facial EMG Activity Is Associated with Hedonic Experiences but Not Nutritional Values While Viewing Food Images. Nutrients. 2021; 13(1):11. https://0-doi-org.brum.beds.ac.uk/10.3390/nu13010011

Chicago/Turabian Style

Sato, Wataru, Sakiko Yoshikawa, and Tohru Fushiki. 2021. "Facial EMG Activity Is Associated with Hedonic Experiences but Not Nutritional Values While Viewing Food Images" Nutrients 13, no. 1: 11. https://0-doi-org.brum.beds.ac.uk/10.3390/nu13010011

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop