Next Article in Journal
Vaccinations, Mobility and COVID-19 Transmission
Next Article in Special Issue
Usability and Effects of a Combined Physical and Cognitive Intervention Based on Active Video Games for Preschool Children
Previous Article in Journal
Use of Restorative Justice and Restorative Practices at School: A Systematic Literature Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Hot Executive Function Assessment Instruments in Preschool Children: A Systematic Review

Escuela de Psicología, Facultad de Ciencias, Universidad Mayor, Temuco 4801043, Chile
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(1), 95; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19010095
Submission received: 16 November 2021 / Revised: 10 December 2021 / Accepted: 11 December 2021 / Published: 23 December 2021
(This article belongs to the Special Issue Advances in Children’s Health and Well-Being)

Abstract

:
The study aimed to systematically analyze the empirical evidence that is available concerning batteries, tests or instruments that assess hot executive functions (EFs) in preschoolers, identifying which are the most used instruments, as well as the most evaluated hot EFs. For the review and selection of articles, the systematic review methodology PRISMA was used. The article search considered the EBSCO, Web of Science (WoS), SciELO and PubMed databases, with the keywords “Hot executive function”, “Assessment”, “test”, “evaluation”, using the Boolean operators AND and OR indistinctly, between 2000 and April 2021. Twenty-four articles were selected and analyzed. The most commonly used instruments to assess hot EFs in preschool children were the Delayed Gratification Task, the Child’s Play Task, and the Delayed Reward Task. Amongst those analyzed, 17 instruments were found to assess hot EFs in preschoolers. The accuracy and conceptual clarity between the assessment of cognitive and emotional components in EFs is still debatable. Nevertheless, the consideration of affective temperature and reward stimulus type, could be an important influence when assessing EFs in this age range. Evidence of the possible involvement of cortical and subcortical structures, as well as the limbic system, in preschool executive functioning assessment has also been incorporated.

1. Introduction

This study is framed in the context of neuropsychology, a clinical discipline pertaining to a part of neuroscience that focuses on a neural interpretation of the behavioral and affective cognitive evidence in people [1,2]. Along these lines, the mnesic, attentional, and executive functions (EFs), which is the particular interest of this study, are evaluated according to a person’s response in relation to a possible neurological correlate.
Executive function (EF) is a concept incorporated within the discipline of neuropsychology [3,4]. Alexander Luria associated the prefrontal lobe with the control of superior intellectual activity, whereas the term Executive Functions (EFs) was attributed to Muriel Lezak [5]. EFs are defined as a set of neurocognitive skills that can inhibit, regulate and/or plan behavior, emotional behavior, and complex social functioning, contributing to adaptability, and orienting goal-directed behavior in the individual. Through these processes, proactive, autonomous, and productive activities can be developed [2,5,6,7,8,9].
In recent decades there has been significant interest in the evaluation of EFs during childhood since they contribute to school and social development, and their dysfunction being the cause of some psychopathological and behavioral disorders [2,10,11,12]. Therefore, preschool is considered a period of greater sensitivity in executive development [13], linked to the maturation of cortical brain regions [14,15].
EFs can be classified into cold (only cognitive components) and hot (with socio-emotional components). The former requires logical and critical analysis, involving conscious control of thoughts and actions, such as planning and cognitive flexibility, where preferentially the dorsolateral prefrontal cortex is involved [16]. On the other hand, hot EFs incorporate the socioemotional domain and can be evoked by motivational and emotionally meaningful contexts [2,17,18]. Such domains include emotional regulation, empathy, self-awareness, and spatial adaptation [4], as well as the ability to delay gratification, emotion management, and affective decision making [19]. This implies critical engagement of brain areas such as the anterior prefrontal area, dorsolateral area, cingulate area, and supraorbital area [20,21]. Nevertheless, the boundary between hot and cold EFs is under discussion since both are intimately related to adaptive functions [22].
Regarding theoretical models of EF processing, the Iterative Reprocessing (IR) Model [23] and the Somatic Marker Model [24,25] stand out. The first model posits that EFs modulate attention and control behavior, allowing behavior to be more adaptive, planned, and focused on problem solving [26,27]. It involves the neural processes in cortical structures requiring complex circuits that underlie cognitive processes. These processes are associated with reflection, and lead to the development of specific skills, establishing a continuum between hot and cold EFs [2]. The second neurocognitive model allows framing the impact of emotions on decision making [24,25] through somatic markers. These markers are elaborated in front of important stimuli experienced by the individual and subsequently evoked through similar stimuli. Furthermore, they organize actions by virtue of future outcomes, linked to positive or negative valences that attract attention to relevant stimuli and allow the elaboration of novel action sequences, according to the demand of the context [28]. Thus, this model contributes to the support of cognitive processes, such as advantageous decision making, and allows the person to perform appropriate social behavior [24,25].
In relation to EF assessment, there is a predominance of instruments that examine cognitive skills in general although there are discussions regarding their methodological approach with respect to various theoretical currents [29]. Among the most commonly used instruments to assess EFs are the Wisconsin test and Trail Making Test, and less frequently, the Hayling Test, Iowa Gambling Task (IGT), and Tower of London/Hanoi [30,31]. Fundamentally, these evaluative instruments have been designed for cold EFs, while there is a lack in hot EF evaluations; furthermore, there is less evidence in research related to children and young people, since adult participants seem to be the most studied population in the application of EF instruments [31].
Given that research on hot EFs is scarce, especially when regarding assessment instruments, this review aims to systematically analyze the empirical evidence available pertaining to batteries, tests, or instruments that assess hot EFs in preschool children, as a contribution to the knowledge of the most commonly used instruments when assessing hot executive functions. The intention of this study is to acknowledge key neurocognitive-affective functions in child development as possible educational and socioemotional skill predictors at an early age. This research expects to contribute to a greater interest in promoting these neurocognitive functions in preschool education, with emphasis on their evaluation and stimulation, to develop a better academic, cognitive and socioemotional performance.

2. Materials and Methods

The article review was based on international PRISMA statements [32]. The article selection process began with the identification of articles in the Web of Science (WoS), EBSCO, SciELO and PubMed databases, using the keywords in Spanish and English “Función ejecutiva cálida”, “Evaluación”, “Prueba”; “Hot executive function”, “Assessment”, “test”, “evaluation”, with the Boolean operators AND and OR as appropriate, between the periods 2000 to 2020 in April 2021. The review process was confirmed by a second reviewer to ensure the inclusion validity. Differences in opinion were discussed, reaching consensus on the inclusion or exclusion of the study. The methodological quality of the reviewers for each review, as well as the evidence, was assessed using PRISMA.
The review of articles is based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) considering selected articles that refer to the effect of interventions on the topic of warm EFs [33,34].
A total of 118 articles were found in WoS, 54 in EBSCO, 16 in SciELO, and 4 in PubMed, for a total of 192 results. The inclusion criteria consisted of (i) strictly empirical research, (ii) a primary focus on Hot EF assessment instruments, (iii) studies done only with a preschool age range, and (iv) publications occurring between 2000 and 2020. The exclusion criteria pertain to (i) systematic reviews or meta-analyses, (ii) articles presenting data only on Cold Executive Functions, and (iii) articles not including a preschool aged sample.
Of the 192 results, 59 duplicates were eliminated among the four databases, leaving 133 articles. Thereafter, 109 articles were discarded for being systematic reviews (n = 13), meta-analyses (n = 3), for not including instruments that evaluate hot EFs (n = 38) and for not including a preschool aged sample (n = 55) (See Figure 1).

3. Results

Between the years 2000 and April 2021, there exist 24 articles related to the topic of hot EFs in preschoolers, mainly focused from 2011 to 2020 (n = 22; 91.7%), where 87.5% (n = 21) evaluate hot and cold EFs. Only three articles exclusively evaluate hot EFs (12.5%). The 24 selected publications use mixed samples and incorporate at least one assessment instrument for this neuropsychological function, most of them coming from WoS (n = 20; 83.3%), followed by EBSCO (n = 11; 45.8%), PubMed (n = 2; 8.3%) and SCIELO (n = 1; 4.2%) (See Figure 1).
Research seems to be predominantly done in the USA (n = 7; 29.2%), then Canada (n = 3; 12.5%), and Italy, the Netherlands, and Poland combined (n = 2; 8.3%). Some variables have been associated with altered hot EFs in preschool children, such as preterm birth (n = 2; 8.3%), obesity (n = 1; 4.2%), attention deficit disorder (n = 1; 4.2%), and developmental coordination disorder (n = 1; 4.2%). Among the most used instruments with hot EFs in preschool children are the Delay of Gratification Task (n = 9; 37.8%), followed by Children’s Gambling Task (n = 6; 25%), and Gift Delay Task (n = 6; 25%), totaling 17 instruments. The most studied hot EFs were Gratification Delay (n = 16; 66.7%), Decision Making (n = 7; 29.2%) and Emotional Self-Regulation (n = 4; 16.7). The list of instruments that were considered, together with the function evaluated and psychometric aspects that account for reliability and validity aspects, are shown in Table 1. It can be seen that some studies refer exclusively to hot EF aspects and others to the combination of cold and hot EFs.
The hot EF assessment instruments reviewed, for the most part, have an individual format. Two relevant classifications were identified: the first being related to decision making by means of a card game (IGT and ChGT), and the second being related to a gratification delay while waiting to be rewarded (LMT, DGT, GDT, SDT, PSRA, MIDA, CDT, and SwT). Assessment instruments typically use rewards in their application, among them, those which incorporate food (LMT, DGT, DCCS, SDT, PSRA, and CDT), stickers (SS, DGT), coins (DGT), gifts (GDT), and toys (PSRA), were distinguished. The aim of this article is to systematically analyze the empirical evidence available on the types of batteries, tests, or instruments that assess hot EFs in preschool children. In summary, 17 evaluative tools published in 24 articles were reported (See Table 2).
As can be observed in Table 2, the DGT test and PSRA battery stand out as being the most frequently used instruments with measuring gratification delay since they involve considering or waiting for a greater reward. Others, such as CDT and SDT, wait for the sound of a bell to receive a reward. Whereas, with computational applications, games that include prizes, versus waiting for gratification, have also been used. An example of such being MIDA which is more commonly used in children over 5 years of age. Gestures made when approaching a more entertaining toy are also measured using tests such as SwT. Questionnaires that are completed by external observers, such as teachers or parents, where they check the access gratification control to EFIn, are also used. Others deal with attentional inhibition to a desirable object while performing tasks, which can be seen in tests such as DCCS and GDT. ERC and the EM-FIST Tests evaluate affective flexibility in the performance of a task with the influence of a significant character. There are also those in which rewards are given when the least advantageous one is chosen, such as the LMT and the SS, a situation that is referred to as inverse reward in the case of the former. The IGT and ChGT use cards where people evaluate those that have something advantageous such as smiley faces.

4. Discussion

The revised articles evaluate hot and cold EFs, covering emotional and cognitive aspects respectively, noting distinct definitions concerning hot and cold EFs with a slight difference between them [82]. For some authors, EFs are a set of neurocognitive abilities that allow adaptability and generate goal-directed behaviors, including emotional and cognitive aspects [5,6,7,8,9]. Yet, according to other authors, this concept only considers cold FEs [83]. Despite these conceptual differences, there is consensus that both aspects are involved in the integral development in individuals [84].
The most studied hot executive function would be gratification delay, which is defined by the willingness to access immediate rewards in favor of delayed gratifications of higher value [85]. Regarding the underlying neural mechanisms, as described in literature, limbic areas of the brain are associated as being sensitive to immediate rewards, while the lateral prefrontal cortex is considered as influencing the ability to delay gratification [86,87]. This neurocognitive assessment process involves two paradigms in a young child’s inclination to exhibit a gratification delay: delayed gratification choice and maintenance [46].
The second most studied hot executive function is decision making, despite being often classified as a cold or cognitive EF exclusively, is also involves emotional or hot components actively influencing this function [4]. Possible positive and negative outcomes or consequences, associated with a specific choice of activity, are considered in decision making [88]. This process is related to the somatic marker hypothesis, since actions are analyzed and organized by virtue of future outcomes, with positive or negative valence [24]. As described by Kable and Glimcher (2009), the performance of this task involves dorsolateral prefrontal areas for decision making, the amygdala to express emotional unpleasantness, basal ganglia to modulate behavior, the anterior cingulate cortex in order to relate amongst one another, and the nucleus accumbens in reward circuits, among others [89], where the IOWA Gambling Task (IGT) has been mostly used [69].
The third most studied hot executive function is self-regulation, in which evidence shows that the ventromedial and orbitofrontal cortex are associated as playing an active role in the processes of inhibition, emotion and reward elicitation [88]. Self-regulation is a complex and multifactorial concept [90] that acts at different executive functioning levels that represents the ability to voluntarily plan and modulate one’s behavior for an adaptive purpose [91]. Some authors consider the concept of behavioral self-regulation as synonymous with hot EFs [92,93], while others extend the concept, considering it as both hot and cold at the same time [94]. The Preschool Self-Regulation Assessment (PSRA) is used to evaluate hot and cold aspects where the focus is on the EF of delayed gratification [56,57,58,59].
Reward is a common factor in hot EF assessments although there is disagreement as to whether a hot EF task must include rewards, or some type of appetitive stimulus [95], or whether it only needs to elicit an emotional stimulus or increased motivation for it to be performed [16]. In relation to this, some authors propose that the EF performance depends on the influence that the motivational factor has on being either intrinsic or extrinsic [96].
According to reviewed evidence, hot EFs have implications on ADHD symptoms and behavioral problems [21]. They can be affected in adverse contexts, although improving when a training system is incorporated [47]. Hot EFs were not associated with the development of physical or relational aggression, nor significantly with Theory of Mind (ToM), socioeconomic adversity, cognitive self-regulation, or obesity [42,43,48,56]. There are no reported studies relating hot EFs and autism spectrum disorder (ASD) in preschoolers, though both concepts should be further studied. Such is due to the implication that this neurocognitive function has in personal and emotional interpretation, regulation of social behavior and understanding of social and contextual cues [97], all aspects that may be altered in ASD as currently conceptualized [98].
Favoring hot EFs, especially in the willingness to delay gratification, decision making and behavioral self-regulation, during early childhood predicts greater success academically and socially [99,100] and is to health and economic well-being in adulthood [101,102,103,104]. Hot EFs begin to develop early in life, enabling the development of inhibitory control, attention and working memory, forming the basis of voluntary control of behavior and thought, and the ability to interpret one’s own emotion as well as another’s, therefore enhancing the capacity for self-regulation and learning [5].
Consequently, longitudinal studies that consider problems such as addictions, behavioral disorders, or other pathologies where hot EF based brain structures are involved, are suggested so that predictive hot EF characteristics in preschoolers can be identified. It is also recommended that more studies and instrumental validations be carried out in both Latin American and Spanish-speaking countries, since there is little evidence of research in this population. The future of EF assessment faces the challenge of explaining the integration of cognitive and emotional components. Therefore, the evaluation of EFs should consider the type of stimulus or reward involved and must take into account the temperature of the cognitive activity.
Two limitations can be observed in the study, one being that these instruments are based on visual stimuli, thus requiring a preserved visual capacity, while not considering other sensory-perceptual pathways such as auditory, somesthetic, chemical, olfactory or gustatory. On the other hand, only four electronic databases were selected for the searches: EBSCO, WoS, SciELO and PubMed. Thus, it is possible that there are other articles available on the subject. In addition, the lack of conceptual unification of EFs limits the number of articles identified on the evaluation of hot EFs at a preschool age.

5. Conclusions

The most commonly used hot EF instruments in preschoolers are the Delay of Gratification Task (DGT), Gift Delay Task, Children’s Gambling Task and Preschool Self-Regulation Assessment (PSRA). Most of them assess delayed gratification, affective decision making and self-regulation with emotional components. The accuracy and conceptual clarity between the assessment of cognitive and emotional components in EFs is still debatable. The consideration of the affective temperature and the decision to choose the reward stimulus may have an impact on EF performance, situations that are suggested as involving limbic system structures, the lateral prefrontal cortex, ventromedial cortex, and the nucleus accumbens, among others. Likewise, the study of EFs integrated in their hot and cold aspects, can report a panorama of greater comprehensiveness in the cognitive-affective functioning of preschool children. However, the instruments are not designed with inclusivity criteria that considers other sensory-perceptual channels that may influence EFs. It is pertinent to continue studies in order to incorporate instruments from diverse information inputs into the executive system. The promising development of hot EFs in preschoolers can contribute to a diagnosis and design of rehabilitation strategies, allowing them to better perform in their educational and socio-cognitive life.

Author Contributions

V.M. and L.M. were responsible for the conceptualization, investigation, formal analysis and writing the original draft preparation. S.C. was responsible for the systematic review methodology. K.C. was responsible for reviewing and editing. H.B. was responsible for the supervision and editing of the entire review. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

The authors would like to thank the Master’s in Neuropsychology Graduate Program, part of the School of Psychology at the Universidad Mayor, Temuco, Chile.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Portellano, J.A. Introducción a la Neuropsicología; Mc Graw Hill: Madrid, Spain, 2005; pp. 3–5. [Google Scholar]
  2. Zelazo, P.D. Executive Function and Psychopathology: A Neurodevelopmental Perspective. Annu. Rev. Clin. Psychol. 2020, 16, 431–454. [Google Scholar] [CrossRef] [Green Version]
  3. Diamond, A.; Prevor, M.B.; Callender, G.; Druin, D.P. Prefrontal Cortex Cognitive Deficits in Children Treated Early and Continuously for PKU. Monogr. Soc. Res. Child Dev. 1997, 62, 1–206. [Google Scholar] [CrossRef]
  4. Portellano, J.A. Neuroeducación y Funciones Ejecutivas; Cepe: Madrid, Spain, 2018; pp. 4–160. [Google Scholar]
  5. Calle Sandoval, D.A. Filogenia y Desarrollo de Funciones Ejecutivas. Psicogente 2017, 20, 368–381. [Google Scholar] [CrossRef] [Green Version]
  6. Flores, J.; Ostrosky, F.; Lozano, A. Batería Neuropsicológica de Funciones Ejecutivas y Lóbulos Frontales-2 (BANFE); Manual Moderno: Mexico City, Mexico, 2014. [Google Scholar]
  7. Rojas Barahona, C. Funciones Ejecutivas y Educación; Ediciones Universidad Católica de Chile: Santiago, Chile, 2017. [Google Scholar]
  8. Zelazo, P.D.; Müller, U.; Frye, D.; Marcovitch, S.; Argitis, G.; Boseovski, J.; Chiang, J.K.; Hongwanishkul, D.; Schuster, B.V.; Sutherland, A. The Development of Executive Function in Early Childhood. Monogr. Soc. Res. Child Dev. 2003, 68, vii-137. [Google Scholar] [CrossRef]
  9. Zelazo, P.D.; Frye, D. Cognitive Complexity and Control: II. the Development of Executive Function in Childhood. Curr. Dir. Psychol. Sci. 1998, 7, 121–126. [Google Scholar] [CrossRef]
  10. Biederman, J.; Petty, C.R.; Wozniak, J.; Wilens, T.E.; Fried, R.; Doyle, A.; Henin, A.; Bateman, C.; Evans, M.; Faraone, S.V. Impact of Executive Function Deficits in Youth with Bipolar I Disorder: A Controlled Study. Psychiatry Res. 2011, 186, 58–64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Montroy, J.J.; Merz, E.C.; Williams, J.M.; Landry, S.H.; Johnson, U.Y.; Zucker, T.A.; Assel, M.; Taylor, H.B.; Lonigan, C.J.; Phillips, B.M.; et al. Hot and Cool Dimensionality of Executive Function: Model Invariance across Age and Maternal Education in Preschool Children. Early Child. Res. Q. 2019, 49, 188–201. [Google Scholar] [CrossRef]
  12. Närhi, V.; Lehto-Salo, P.; Ahonen, T.; Marttunen, M. Neuropsychological Subgroups of Adolescents with Conduct Disorder: Neuropsychological Subtypes of Conduct Disorder. Scand. J. Psychol. 2010, 51, 278–284. [Google Scholar] [CrossRef] [PubMed]
  13. Stelzer, F.; Alejandro Cervigni, M.; Martino, P. Desarrollo de las Funciones Ejecutivas en Niños Preescolares: Una Revisión de Algunos de Sus Factores Moduladores. Lib. Rev. Psicol. 2011, 17, 93–100. [Google Scholar]
  14. Garon, N.; Bryson, S.E.; Smith, I.M. Executive Function in Preschoolers: A Review Using an Integrative Framework. Psychol. Bull. 2008, 134, 31–60. [Google Scholar] [CrossRef] [Green Version]
  15. Gogtay, N.; Giedd, J.N.; Lusk, L.; Hayashi, K.M.; Greenstein, D.; Vaituzis, A.C.; Nugent, T.F.; Herman, D.H.; Clasen, L.S.; Toga, A.W.; et al. Dynamic Mapping of Human Cortical Development during Childhood through Early Adulthood. Proc. Natl. Acad. Sci. USA 2004, 101, 8174–8179. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Zelazo, P.D.; Muller, U. Executive Function in Typical and Atypical Development. In Blackwell Handbook of Childhood Cognitive Development; Goswami, U., Ed.; Blackwell Publishers Ltd.: Hoboken, NJ, USA, 2002; pp. 445–469. [Google Scholar] [CrossRef]
  17. Brock, L.L.; Rimm-Kaufman, S.E.; Nathanson, L.; Grimm, K.J. The Contributions of ‘Hot’ and ‘Cool’ Executive Function to Children’s Academic Achievement, Learning-Related Behaviors, and Engagement in Kindergarten. Early Child. Res. Q. 2009, 24, 337–349. [Google Scholar] [CrossRef]
  18. Hongwanishkul, D.; Happaney, K.R.; Lee, W.S.C.; Zelazo, P.D. Assessment of Hot and Cool Executive Function in Young Children: Age-Related Changes and Individual Differences. Dev. Neuropsychol. 2005, 28, 617–644. [Google Scholar] [CrossRef]
  19. Bernabei, L.; Bersani, F.; Delle Chiaie, R.; Pompili, E.; Casula, S.; D’Aniello, G.; Corrado, A.; Vergnani, L.; Macrì, F.; Biondi, M.; et al. A Preliminary Study on Hot and Cool Executive Functions in Bipolar Disorder and on Their Association with Emotion Regulation Strategies. Riv. Psichiatria 2018, 53, 331–335. [Google Scholar] [CrossRef]
  20. Bubb, E.J.; Metzler-Baddeley, C.; Aggleton, J.P. The Cingulum Bundle: Anatomy, Function, and Dysfunction. Neurosci. Biobehav. Rev. 2018, 92, 104–127. [Google Scholar] [CrossRef]
  21. Nguyen, L.; Murphy, K.; Andrews, G. Cognitive and Neural Plasticity in Old Age: A Systematic Review of Evidence from Executive Functions Cognitive Training. Ageing Res. Rev. 2019, 53, 1–17. [Google Scholar] [CrossRef] [PubMed]
  22. Zelazo, P.D.; Carlson, S.M. Hot and Cool Executive Function in Childhood and Adolescence: Development and Plasticity. Child Dev. Perspect. 2012, 6, 354–360. [Google Scholar] [CrossRef]
  23. Cunningham, W.A.; Zelazo, P.D. Attitudes and Evaluations: A Social Cognitive Neuroscience Perspective. Trends Cognit. Sci. 2007, 11, 97–104. [Google Scholar] [CrossRef]
  24. Damasio, A.R. El Error de Descartes: La Razón de las Emociones; Andrés Bello: Santiago, Chile, 1994; pp. 10–334. [Google Scholar]
  25. García, M.; de los, Á. Las Funciones Ejecutivas Cálidas y el Rendimiento Académico. Tesis Doctoral, Universidad Complutense, Madrid, Spain, 2012. Available online: https://dialnet.unirioja.es/servlet/tesis?codigo=95146 (accessed on 16 April 2021).
  26. Muñoz Céspedes, J.M.; Tirapu Ustárroz, J. Rehabilitación de las Funciones Ejecutivas. Rev. Neurol. 2004, 38, 656–663. [Google Scholar] [CrossRef] [PubMed]
  27. Zelazo, P.D. Executive Function: Reflection, Iterative Reprocessing, Complexity, and the Developing Brain. Dev. Rev. 2015, 38, 55–68. [Google Scholar] [CrossRef]
  28. Arteaga, G.; Quebradas, D. Funciones Ejecutivas y Marcadores Somáticos: Apuestas, Razón y Emociones. El Hombre y la Máquina 2010, 34, 115–129. [Google Scholar]
  29. Kluwe-Schiavon, B.; Viola, T.W.; Grassi-Oliveira, R. Modelos Teóricos Sobre Construto Único ou Múltiplos Processos das Funções Executivas. Neuropsicol. Latinoam. 2012, 4, 29–34. [Google Scholar]
  30. Ardila, A.; Ostrosky, F. Guía Para el Diagnóstico Neuropsicológico. 2012. Available online: http://www.inips.com.mx/archivos/Ardila__Ostrosk_Guia_para_el_Diagnostico_Neuropsicologico.pdf. (accessed on 17 April 2021).
  31. De Santana, A.N.; Melo, M.R.A.; Da Silva-Moita-Minervino, C.A. Instrumentos de Avaliação das Funções Executivas: Revisão Sistemática dos Últimos Cinco Anos. Rev. Aval. Psicol. 2019, 18, 96–107. [Google Scholar] [CrossRef] [Green Version]
  32. Urrútia, G.; Bonfill, X. Declaración PRISMA: Una Propuesta Para Mejorar la Publicación de Revisiones Sistemáticas y Metaanálisis. Med. Clín. 2010, 135, 507–511. [Google Scholar] [CrossRef] [PubMed]
  33. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. BMJ 2021, 372, 71. [Google Scholar] [CrossRef] [PubMed]
  34. Urrútia, G.; Bonfill, X. La Declaración PRISMA: Un Paso Adelante en la Mejora de las Publicaciones de la Revista Española de Salud Pública. Rev. Esp. Salud Publ. 2013, 87, 99–102. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Chi, S.-A.; Kim, S.; Kim, N.-H. A Study of School Adjustment Related Variables of Young Children. S. Afr. J. Educ. 2018, 38, 1–9. [Google Scholar]
  36. Martins, E.C.; Mărcuș, O.; Leal, J.; Visu-Petra, L. Assessing Hot and Cool Executive Functions in Preschoolers: Affective Flexibility Predicts Emotion Regulation. Early Child Dev. Care 2018, 190, 1667–1681. [Google Scholar] [CrossRef]
  37. Garon, N.; Longard, J. Loss Frequency Versus Long-Term Outcome in Preschoolers’ Decision Making on a Child Variant of the Iowa Gambling Task. Appl. Neuropsychol.: Child 2015, 4, 221–229. [Google Scholar] [CrossRef]
  38. Kerr, A.; Zelazo, P.D. Development of “Hot” Executive Function: The Children’s Gambling Task. Brain Cognit. 2004, 55, 148–157. [Google Scholar] [CrossRef]
  39. O’Toole, S.; Monks, C.P.; Tsermentseli, S. Associations between and Development of Cool and Hot Executive Functions across Early Childhood. Br. J. Dev. Psychol. 2017, 36, 142–148. [Google Scholar] [CrossRef] [PubMed]
  40. O’Toole, S.; Tsermentseli, S.; Humayun, S.; Monks, C.P. Cool and Hot Executive Functions at 5 Years Old as Predictors of Physical and Relational Aggression between 5 and 6 Years Old. Int. J. Behav. Dev. 2018, 43, 157–165. [Google Scholar] [CrossRef]
  41. Poland, S.E.; Monks, C.P.; Tsermentseli, S. Cool and Hot Executive Function as Predictors of Aggression in Early Childhood: Differentiating between the Function and Form of Aggression. Br. J. Dev. Psychol. 2016, 34, 181–197. [Google Scholar] [CrossRef]
  42. Putko, A. Zimne versus Gorące Funkcje Zarządzające i Język a Rozumienie Przez Dzieci Własnych Oraz Innych Osób Stanów Umysłowych. Psychol. Rozw. 2013, 18, 65–82. [Google Scholar]
  43. Beck, D.M.; Eales, L.; Carlson, S.M. Hot and Cool Executive Function and Body Mass Index in Young Children. Cognit. Dev. 2020, 54, 1–10. [Google Scholar] [CrossRef]
  44. Hodel, A.S.; Brumbaugh, J.E.; Morris, A.R.; Thomas, K.M. Hot Executive Function Following Moderate-to-Late Preterm Birth: Altered Delay Discounting at 4 Years of Age. Dev. Sci. 2016, 19, 221–234. [Google Scholar] [CrossRef] [PubMed]
  45. Imuta, K.; Hayne, H.; Scarf, D. I Want It All and I Want It Now: Delay of Gratification in Preschool Children. Dev. Psychobiol. 2014, 56, 1541–1552. [Google Scholar] [CrossRef] [PubMed]
  46. Mulder, H.; Hoofs, H.; Verhagen, J.; van der Veen, I.; Leseman, P.P.M. Psychometric Properties and Convergent and Predictive Validity of an Executive Function Test Battery for Two-Year-Olds. Front. Psychol. 2014, 5, 1–17. [Google Scholar] [CrossRef] [Green Version]
  47. Pellizzoni, S.; Apuzzo, G.M.; De Vita, C.; Agostini, T.; Passolunghi, M.C. Evaluation and Training of Executive Functions in Genocide Survivors. The Case of Yazidi Children. Dev. Sci. 2019, 22, 1–14. [Google Scholar] [CrossRef]
  48. Slot, P.L.; Mulder, H.; Verhagen, J.; Leseman, P.P.M. Preschoolers’ Cognitive and Emotional Self-Regulation in Pretend Play: Relations with Executive Functions and Quality of Play. Infant Child Dev. 2017, 26, 1–21. [Google Scholar] [CrossRef]
  49. Talwar, V.; Carlson, S.M.; Lee, K. Effects of a Punitive Environment on Children’s Executive Functioning: A Natural Experiment. Soc. Dev. 2011, 20, 805–824. [Google Scholar] [CrossRef]
  50. Merz, E.C.; Landry, S.H.; Williams, J.M.; Barnes, M.A.; Eisenberg, N.; Spinrad, T.L.; Valiente, C.; Assel, M.; Taylor, H.B.; Lonigan, C.J.; et al. Associations among Parental Education, Home Environment Quality, Effortful Control, and Preacademic Knowledge. J. Appl. Dev. Psychol. 2014, 35, 304–315. [Google Scholar] [CrossRef] [Green Version]
  51. Merz, E.C.; Landry, S.H.; Montroy, J.J.; Williams, J.M. Bidirectional Associations between Parental Responsiveness and Executive Function during Early Childhood. Soc. Dev. 2016, 26, 591–609. [Google Scholar] [CrossRef] [PubMed]
  52. Sulik, M.J.; Huerta, S.; Zerr, A.A.; Eisenberg, N.; Spinrad, T.L.; Valiente, C.; Di Giunta, L.; Pina, A.A.; Eggum, N.D.; Sallquist, J.; et al. The Factor Structure of Effortful Control and Measurement Invariance across Ethnicity and Sex in a High-Risk Sample. J. Psychopathol. Behav. Assess. 2010, 32, 8–22. [Google Scholar] [CrossRef] [Green Version]
  53. Pauli-Pott, U.; Schloß, S.; Heinzel-Gutenbrunner, M.; Becker, K. Multiple Causal Pathways in Attention-Deficit/Hyperactivity Disorder—Do Emerging Executive and Motivational Deviations Precede Symptom Development? Child Neuropsychol. 2017, 25, 179–197. [Google Scholar] [CrossRef] [PubMed]
  54. Beck, D.M.; Schaefer, C.; Pang, K.; Carlson, S.M. Executive Function in Preschool Children: Test–Retest Reliability. J. Cognit. Dev. 2011, 12, 169–193. [Google Scholar] [CrossRef] [Green Version]
  55. Alesi, M.; Pecoraro, D.; Pepi, A. Executive Functions in Kindergarten Children at Risk for Developmental Coordination Disorder. Eur. J. Spec. Needs Educ. 2018, 34, 285–296. [Google Scholar] [CrossRef]
  56. Finch, J.E.; Obradović, J. Unique Effects of Socioeconomic and Emotional Parental Challenges on Children’s Executive Functions. J. Appl. Dev. Psychol. 2017, 52, 126–137. [Google Scholar] [CrossRef]
  57. Bassett, H.H.; Denham, S.; Wyatt, T.M.; Warren-Khot, H.K. Refining the Preschool Self-Regulation Assessment for Use in Preschool Classrooms. Infant Child Dev. 2012, 21, 596–616. [Google Scholar] [CrossRef]
  58. Denham, S.A.; Warren-Khot, H.K.; Bassett, H.H.; Wyatt, T.; Perna, A. Factor Structure of Self-Regulation in Preschoolers: Testing Models of a Field-Based Assessment for Predicting Early School Readiness. J. Exp. Child Psychol. 2012, 111, 386–404. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Walczak, T.Z.; Chrzan-Dętkoś, M. Hot and Cool Executive Functions in Very and Extremely Preterm Preschool Children. Health Psychol. Rep. 2018, 6, 40–49. [Google Scholar] [CrossRef]
  60. Rothbart, M.K.; Ahadi, S.A.; Hershey, K.L.; Fisher, P. Investigations of Temperament at Three to Seven Years: The Children’s Behavior Questionnaire. Child Dev. 2001, 72, 1394–1408. [Google Scholar] [CrossRef]
  61. Kuntsi, J.; Stevenson, J.; Oosterlaan, J.; Sonuga-Barke, E.J.S. Test-Retest Reliability of a New Delay Aversion Task and Executive Function Measures. Br. J. Dev. Psychol. 2001, 19, 339–348. [Google Scholar] [CrossRef]
  62. Dalen, L.; Sonuga-Barke, E.J.S.; Hall, M.; Remington, B. Inhibitory Deficits, Delay Aversion and Preschool AD/HD: Implications for the Dual Pathway Model. Neural Plast. 2004, 11, 1–11. [Google Scholar] [CrossRef] [Green Version]
  63. Pauli-Pott, U.; Roller, A.; Heinzel-Gutenbrunner, M.; Mingebach, T.; Dalir, S.; Becker, K. Inhibitory Control and Delay Aversion in Unaffected Preschoolers with a Positive Family History of Attention Deficit Hyperactivity Disorder. J. Child Psychol. Psychiatry 2014, 55, 1117–1124. [Google Scholar] [CrossRef] [PubMed]
  64. Carlson, S.M.; Davis, A.C.; Leach, J.G. Less is More: Executive Function and Symbolic Representation in Preschool Children. Psychol. Sci. 2005, 16, 609–616. [Google Scholar] [CrossRef] [PubMed]
  65. Choi, E.; Song, H.-N. Development of Children’s Cool and Hot Executive Function and Its Relationship to Children’s Self-Regulation. Korean J. Child Stud. 2013, 34, 99–114. [Google Scholar] [CrossRef]
  66. Mărcuş, O.; Stanciu, O.; MacLeod, C.; Liebregts, H.; Visu-Petra, L. A Fistful of Emotion: Individual Differences in Trait Anxiety and Cognitive-Affective Flexibility during Preadolescence. J. Abnorm. Child Psychol. 2015, 44, 1231–1242. [Google Scholar] [CrossRef]
  67. Shields, A.; Cicchetti, D. Emotion Regulation among School-Age Children: The Development and Validation of a New Criterion Q-Sort Scale. Dev. Psychol. 1997, 33, 906–916. [Google Scholar] [CrossRef]
  68. Garon, N.; Moore, C. Complex Decision-Making in Early Childhood. Brain Cognit. 2004, 55, 158–170. [Google Scholar] [CrossRef]
  69. Bechara, A.; Damasio, A.R.; Damasio, H.; Anderson, S.W. Insensitivity to Future Consequences Following Damage to Human Prefrontal Cortex. Cognition 1994, 50, 7–15. [Google Scholar] [CrossRef]
  70. Carlson, S.M.; Moses, L.J. Individual Differences in Inhibitory Control and Children’s Theory of Mind. Child Dev. 2001, 72, 1032–1053. [Google Scholar] [CrossRef]
  71. Kochanska, G.; Murray, K.; Jacques, T.Y.; Koenig, A.L.; Vandegeest, K.A. Inhibitory Control in Young Children and Its Role in Emerging Internalization. Child Dev. 1996, 67, 490–507. [Google Scholar] [CrossRef]
  72. Kochanska, G.; Murray, K.; Harlan, E.T. Effortful Control in Early Childhood: Continuity and Change, Antecedents, and Implications for Social Development. Dev. Psychol. 2000, 36, 220–232. [Google Scholar] [CrossRef] [PubMed]
  73. Petersen, I.T.; Hoyniak, C.P.; McQuillan, M.E.; Bates, J.E.; Staples, A.D. Measuring the Development of Inhibitory Control: The Challenge of Heterotypic Continuity. Dev. Rev. 2016, 40, 25–71. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  74. Zelazo, P.D. The Dimensional Change Card Sort (DCCS): A Method of Assessing Executive Function in Children. Nat. Protoc. 2006, 1, 297–301. [Google Scholar] [CrossRef] [PubMed]
  75. Kochanska, G.; Murray, K.; Coy, K.C. Inhibitory Control as a Contributor to Conscience in Childhood: From Toddler to Early School Age. Child Dev. 1997, 68, 263–277. [Google Scholar] [CrossRef] [PubMed]
  76. Smith-Donald, R.; Raver, C.C.; Hayes, T.; Richardson, B. Preliminary Construct and Concurrent Validity of the Preschool Self-regulation Assessment (PSRA) for Field-Based Research. Early Child. Res. Q. 2007, 22, 173–187. [Google Scholar] [CrossRef]
  77. Asendorpf, J.B. Development of Inhibition during Childhood: Evidence for Situational Specificity and a Two-Factor Model. Dev. Psychol. 1990, 26, 721–730. [Google Scholar] [CrossRef]
  78. Prencipe, A.; Zelazo, P.D. Development of Affective Decision Making for Self and Other: Evidence for the Integration of First- and Third-Person Perspectives. Psychol. Sci. 2005, 16, 501–505. [Google Scholar] [CrossRef]
  79. Thompson, C.; Barresi, J.; Moore, C. The Development of Future-Oriented Prudence and Altruism in Preschoolers. Cognit. Dev. 1997, 12, 199–212. [Google Scholar] [CrossRef]
  80. Mischel, W.; Shoda, Y.; Rodriguez, M. Delay of Gratification in Children. Science 1989, 244, 933–938. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  81. Mischel, W.; Ebbesen, E.B. Attention in Delay of Gratification. J. Personal. Soc. Psychol. 1970, 16, 329–337. [Google Scholar] [CrossRef] [Green Version]
  82. Henríquez, F.; Martínez-Pernía, D.; Forno, G.; Nuñez-Huasaf, J.; Slachevsky, A. Anatomía Funcional del Córtex Prefrontal y Modelos de Funcionamiento. In Tratado de Neuropsicología Clínica, 2nd ed.; Labos, E., Slachevsky, A., Torralva, T., Fuentes, P., Manes, F., Eds.; Librería Akadia Editorial: Buenos Aires, Argentina, 2019; pp. 453–473. [Google Scholar]
  83. Stuss, D.T. Functions of the Frontal Lobes: Relation to Executive Functions. J. Int. Neuropsychol. Soc. 2011, 17, 759–765. [Google Scholar] [CrossRef] [PubMed]
  84. Tirapu Ustárroz, J.; Bausela Herreras, E.; Cordero Andrés, P. Modelo de Funciones Ejecutivas Basado en Análisis Factoriales en Población Infantil y Escolar: Metaanálisis. Rev. Neurol. 2018, 67, 215–225. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  85. Carrillo de la Peña, M.T.; Luengo, M.A. Demora de la Gratificación y Conducta Antisocial en los Adolescentes. Anál. Modif. Cond. 1993, 19, 643–663. [Google Scholar]
  86. McClure, S.M.; Laibson, D.I.; Loewenstein, G.; Cohen, J.D. Separate Neural Systems Value Immediate and Delayed Monetary Rewards. Science 2004, 306, 503–507. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  87. McClure, S.M.; Ericson, K.M.; Laibson, D.I.; Loewenstein, G.; Cohen, J.D. Time Discounting for Primary Rewards. J. Neurosci. 2007, 27, 5796–5804. [Google Scholar] [CrossRef]
  88. Torralva, T.; Manes, F. Funciones Ejecutivas y Trastornos del Lóbulo Frontal. In Tratado de Neuropsicología Clínica, 2nd ed.; Labos, E., Slachevsky, A., Torralva, T., Fuentes, P., Manes, F., Eds.; Librería Akadia Editorial: Buenos Aires, Argentina, 2019; pp. 475–495. [Google Scholar]
  89. Kable, J.W.; Glimcher, P.W. The Neurobiology of Decision: Consensus and Controversy. Neuron 2009, 63, 733–745. [Google Scholar] [CrossRef] [Green Version]
  90. McClelland, M.; Cameron Ponitz, C.; Messersmith, E.; Tominey, S. Self-Regulation: The Integration of Cognition and Emotion. Handb. Life-Span Dev. 2010, 1, 509–553. [Google Scholar] [CrossRef]
  91. Barkley, R.A. The Executive Functions and Self-Regulation: An Evolutionary Neuropsychological Perspective. Neuropsychol. Rev. 2001, 11, 1–29. [Google Scholar] [CrossRef]
  92. Goldberg, E.; Podell, K. Adaptive versus Veridical Decision Making and the Frontal Lobes. Conscious. Cognit. 1999, 8, 364–377. [Google Scholar] [CrossRef]
  93. Slachevsky, A.; Peña, M.; Pérez, C.; Bravo, E.; Alegría, P. Neuroanatomical Basis of Behavioral Disturbances in Patients with Prefrontal Lesions. Biol. Res. 2006, 39, 237–250. [Google Scholar] [CrossRef] [Green Version]
  94. de Luna Antonio, R.; Pompeia, S. A Fractionated Analysis of Hot and Cool Self-Regulation in Cigarette Smokers from Different Socioeconomic Backgrounds. PLoS ONE 2019, 14, e0220222. [Google Scholar] [CrossRef]
  95. Allan, N.P.; Lonigan, C.J. Examining the Dimensionality of Effortful Control in Preschool Children and Its Relation to Academic and Socioemotional Indicators. Dev. Psychol. 2011, 47, 905–915. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  96. Metcalfe, J.; Mischel, W. A Hot/Cool-System Analysis of Delay of Gratification: Dynamics of Willpower. Psychol. Rev. 1999, 106, 3–19. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  97. Stuss, D.T.; Levine, B. Adult Clinical Neuropsychology: Lessons from Studies of the Frontal Lobes. Annu. Rev. Psychol. 2002, 53, 401–433. [Google Scholar] [CrossRef] [PubMed]
  98. American Psychiatric Association—APA. Manual diagnóstico y estadístico de los trastornos mentales DSM-5, 5a ed.; Editorial Médica Panamericana: Madrid, Spain, 2014. [Google Scholar]
  99. Mischel, W.; Shoda, Y.; Peake, P.K. The Nature of Adolescent Competencies Predicted by Preschool Delay of Gratification. J. Personal. Soc. Psychol. 1988, 54, 687–696. [Google Scholar] [CrossRef]
  100. Shoda, Y.; Mischel, W.; Peake, P.K. Predicting Adolescent Cognitive and Self-Regulatory Competencies from Preschool Delay of Gratification: Identifying Diagnostic Conditions. Dev. Psychol. 1990, 26, 978–986. [Google Scholar] [CrossRef]
  101. Ayduk, O.; Mendoza-Denton, R.; Mischel, W.; Downey, G.; Peake, P.K.; Rodriguez, M. Regulating the Interpersonal Self: Strategic Self-Regulation for Coping with Rejection Sensitivity. J. Personal. Soc. Psychol. 2000, 79, 776–792. [Google Scholar] [CrossRef]
  102. Ayduk, Ö.; Zayas, V.; Downey, G.; Cole, A.B.; Shoda, Y.; Mischel, W. Rejection Sensitivity and Executive Control: Joint Predictors of Borderline Personality Features. J. Res. Personal. 2008, 42, 151–168. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  103. Moffitt, T.E.; Arseneault, L.; Belsky, D.; Dickson, N.; Hancox, R.J.; Harrington, H.; Houts, R.; Poulton, R.; Roberts, B.W.; Ross, S.; et al. A Gradient of Childhood Self-Control Predicts Health, Wealth, And Public Safety. Proc. Natl. Acad. Sci. USA 2011, 108, 2693–2698. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  104. Schlam, T.R.; Wilson, N.L.; Shoda, Y.; Mischel, W.; Ayduk, O. Preschoolers’ Delay of Gratification Predicts Their Body Mass 30 Years Later. J. Pediatr. 2013, 162, 90–93. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. PRISMA Flowchart.
Figure 1. PRISMA Flowchart.
Ijerph 19 00095 g001
Table 1. Hot EF instruments.
Table 1. Hot EF instruments.
InstrumentEvaluated FunctionAmountAuthorPsicometric Aspects
Less is More Task (LMT)Inverse reward contingency1(Chi et al., 2018) [35]Internal consistency = 0.9. Intraclass correlation Coefficient (ICC) = 0.97
Sticker Search (SS)Decision making1(Chi et al., 2018) [35]Internal consistency = 0.91. Intra class correlation Coefficient (ICC) = 0.97
Emotional Flexible Item Selection Task (EM-FIST) Affective flexibility1(Martins et al., 2018) [36]Not reported in this article
The Emotion Regulation Checklist (ERC)Emotional regulation1(Martins et al., 2018) [36]Significance level of α = 0.63
Iowa Gambling Task (IGT)Decision making1(Garon y Longard, 2015) [37]Not reported in this article
Children’s Gambling Task(ChGT)Decision making6(Hongwanishkul et al., 2005 [18]; Kerr y Zelazo, 2004 [38]; O’Toole et al., 2017 [39], 2018 [40]; Poland et al., 2016 [41]; Putko, 2013 [42])Not reported in this article
Delay of Gratification task (DGT)Gratification delay9(Beck et al., 2020 [43]; Hodel et al., 2016 [44]; Hongwanishkul et al., 2005 [18]; Imuta et al., 2014 [45]; Mulder et al., 2014 [46]; Pellizzoni et al., 2019 [47]; Slot et al., 2017 [48]; Talwar et al., 2011 [49])The test-retest reliability is 0.99. (Pellizzoni et al., 2019) [47]. Kappa (n = 53): 0.89 for tactile behavior and 0.74 for tearing the wrapping paper (Mulder et al., 2014) [46].
Gift Delay task (GDT)Gratification Delay6(Montroy et al., 2019 [11]; O’Toole et al., 2018 [40]; Pellizzoni et al., 2019 [47]; Poland et al., 2016 [41]; Slot et al., 2017 [48]; Talwar et al., 2011 [49]).The test-retest reliability is 0.97 for latency and 0.88 for violations (Pellizzoni et al., 2019) [47]. Latency to first glance (in seconds) was used in all analyses (ICC = 0.86–0.96), as it was available in all four studies (n = 1750) (Merz et al., 2014 [50], 2016 [51]; Sulik et al., 2010 [52]). Latency scores are highly correlated with other rating scores often derived from the task (r> 0.70) (Montroy et al., 2019) [10]. Reliability is tested in 10–20% of cases.
K = 0.95 (Pauli-Pott et al., 2017) [53]. Factor loadings for each of the indicators of the latent constructs of hot executive functions were ≥ 0.77 and ≥0.41, respectively (all pags <0.001) (Slot et al., 2017) [48].
Dimensional Change card Sort (DCCS)Flexiblity-Hot Version and Gratification delay2(Beck et al., 2011 [54]; Talwar et al., 2011 [49]) Overall same-day test-retest reliability (ICC = 75) on three of the tasks: Conflict-Cool, Conflict-Hot, and Delay-Hot. Delay-Cool, test-retest reliability did not meet psychometric standards (ICC 1⁄4 0.49) (Beck et al., 2011) [54].
Snack Delay Task (SDT)Gratification delay2(Alesi et al., 2018 [55]; Slot et al., 2017 [48])The factor loadings for each of the indicators of the latent constructs for hot executive functions were ≥ 0.77 and ≥0.41, respectively (all pags <0.001) (Alesi et al., 2018) [55].
Gift Wrap Task (GWT) Gratification delay4(Alesi et al., 2018 [55]; Finch y Obradović, 2017 [56]; O’Toole et al., 2017 [39]; Pauli-Pott et al., 2017 [53])Not reported in this article
Preschool Self-Regulation Assessment (PSRA)Self-regulation4(Bassett et al., 2012 [57]; Denham et al., 2012 [58]; Finch y Obradović, 2017 [56]; Walczak y Chrzan-Dętkoś, 2018 [59])The correlation coefficient between the two raters (two-way random model) in nine children was equal to 0.99 (Walczak y Chrzan-Dętkoś, 2018) [59]. Confirmatory factor analyses showed two components at each time point—hot and cold executive control—and cross-time correlations showed significant stability of individual differences (Bassett et al., 2012) [57]. (SR, α = 0.96) (Finch y Obradović, 2017) [56]
Teacher-reported (EFIn) Child behavioral rating1(Montroy et al., 2019) [11]Both scales were highly correlated, r = 0.76, and belong to the CBQ effort control factor (Rothbart et al., 2001) [60], subsequently averaged to create a single score (Sulik et al., 2010) [52].
Maudsley’s Index of Childhood Delay Aversion (MIDA) adapted versionAversion to delay1(Hodel et al., 2016) [45]High test-retest reliability among participants (Kuntsi et al., 2001) [61].
Cookie-Delay Task (CDT)Gratification delay1(Pauli-Pott et al., 2017) [53]Factorial and construct validity (Dalen et al., 2004 [62]; Pauli-Pott et al., 2014 [63]). Reliability is tested in 10–20% of cases. ICC = 0.99
Stranger-with-Toys (SwT)Gratification delay1(Pauli-Pott et al., 2017) [53]Reliability is proven in 10–20% of cases. ICC = 0.90
Table 2. Hot EF Test Description.
Table 2. Hot EF Test Description.
TestAuthorDescription
LMT(Chi et al., 2018) [35](Carlson et al., 2005) [64]. The test has two levels: the first with 12 trials (choose between large and small candy tray). The second with 16 trials (two puppets, same rule and reverse reward). Duration: 18 min approximately.
SS(Chi et al., 2018) [35](Choi y Song, 2013) [65]. The test uses 16 boxes with transparent lids, the child receives a reward when he or she selects the correct box.
EM-FIST.(Martins et al., 2018) [36]Version adapted from Mărcuş et al., (2015) [66]. The test presents 2 demonstration trials, 4 practice trials and 12 application trials; in them, children are shown cards with emotional and non-emotional characteristics.
ERC(Martins et al., 2018) [36](Shields y Cicchetti, 1997) [67]. A 4-point Likert-type scale with 24 items. The ERC is composed of two different scales: a Negativity/Likability scale and the Emotion Regulation Scale.
IGT(Garon y Longard, 2015) [37]Children’s version of the Iowa Gambling Task. The administration of this task was inspired by Garon y Moore (2004) [68]. Sixty trials where children choose between two decks of cards and are told that the bear symbol would lead to winning a reward while the tiger symbol would lead to losing a reward, are presented.
ChGT(Hongwanishkul et al., 2005 [18]; Kerr y Zelazo, 2004 [38]; O’Toole et al., 2017 [39], 2018 [40]; Poland et al., 2016 [41]; Putko, 2013 [42]) Simplified version of the Iowa Gambling Task (Bechara et al., 1994) [69] and adapted by Kerr y Zelazo (2004) [38]. Six demonstration trials and 50 test trials are presented, where children choose between two decks of cards and are told that the happy face corresponds to a reward while the sad face corresponds to the loss of a reward.
GDT o GWT(Alesi et al., 2018 [55]; Finch y Obradović, 2017 [56]; Montroy et al., 2019 [11]; O’Toole et al., 2017 [39], 2018 [40]; Pauli-Pott et al., 2017 [53]; Pellizzoni et al., 2019 [47]; Poland et al., 2016 [41]; Slot et al., 2017 [48]; Talwar et al., 2011 [49])(Carlson et al., 2005 [64]; Carlson y Moses, 2001 [70]; Kochanska et al., 1996 [71], 2000 [72]; Petersen et al., 2016 [73]). The task consists of telling children that they will receive a present, but that they cannot look at it while the experimenter noisily wraps the present, duration: one minute.
DCCS(Beck et al., 2011 [54]; Talwar et al., 2011 [49])Adapted from Zelazo (2006) [74]. Card sorting task, which in the hot version shows candies. First, it is sorted by shapes, where after 6 consecutive correct attempts, it is sorted by colors, then 12 trials are performed with instructions changing if a star appears on the card.
SDT(Alesi et al., 2018 [55]; Slot et al., 2017 [48])(Kochanska et al., 1996 [71], 1997 [75], 2000 [72]). The activity consists of showing children an attractive object, and then being asked to try not to touch it until the research assistant has completed another task.
PSRA(Bassett et al., 2012 [57]; Denham et al., 2012 [58]; Finch y Obradović, 2017 [57]; Walczak y Chrzan-Dętkoś, 2018 [59])(Smith-Donald et al., 2007) [76]. The PSRA is a battery composed of 10 tests that evaluate self-regulation. Within these tests, 4 correspond to evaluation of warm EFs, specifically delay of gratification (Toy Wrap, Toy Wait, Snack Delay and Tongue Task). It is performed through observing a child’s behavior, with interpretations that suggest the activation of areas in the nervous system.
EFIn(Montroy et al., 2019) [11](Merz et al., 2014 [50], 2016 [51]; Sulik et al., 2010 [52]). This questionnaire is answered by teachers and is composed of two scales: 13-item attention concentration scale and 14-item inhibitory control scale from the Child Behavior Questionnaire (CBQ) (Rothbart et al., 2001) [57].
MIDA(Hodel et al., 2016) [44]Version adapted from Kuntsi et al., (2001) [61]. The task consists of a computer game set in a spaceship environment, where one must shoot asteroids to save a fictitious planet and receive rewards according to the time one waits to shoot.
CDT(Pauli-Pott et al., 2017) [53](Carlson et al., 2005 [64]; Petersen et al., 2016 [73]). In this task, the child is instructed to wait for a bell to ring before he or she can retrieve a candy that is being covered by a transparent cup. Six trials are performed, plus one practice trial, with delay intervals between 10 and 40 s.
SwT(Pauli-Pott et al., 2017) [53](Asendorpf, 1990 [77]; Pauli-Pott et al., 2014 [63]). In this task, the child sits at a table with an unappealing toy. A stranger enters the room, with interesting toys, and plays with them while not assisting the child. After 3 min, he invites the child to play with him along with the toys, for 2 min.
Among the Delay of Gratification Task (DGT) instruments, it is possible to distinguish three different tasks.
DGT(Beck et al., 2020 [43]; Hodel et al., 2016 [44]; Hongwanishkul et al., 2005 [17])Prencipe y Zelazo Version (2005) [78] adapted from Thompson et al., (1997) [79]. The test presents 9 test types, created by crossing 3 reward types and 3 choice types (one now and two later, one now and four later, one now and six later), with 2 demonstration tests at the beginning. In the article by Hodel et al., (2016) [44] only 2 reward types are presented.
DGT(Beck et al., 2020 [43]; Imuta et al., 2014 [45]; Talwar et al., 2011 [49])(Mischel et al., 1989 [80]; Mischel y Ebbesen, 1970 [81]). Two rewards are presented, a small one (2 pieces) and a large one (10 pieces), the child being evaluated must wait to obtain the larger reward.
DGT(Mulder et al., 2014 [46]; Pellizzoni et al., 2019 [47]; Slot et al., 2017 [45])Adapted from Kochanska et al., (1996 [71], 2000 [72]). The activity consists of instructing the child to try not to touch the gift for a delay of 1 min.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mehsen, V.; Morag, L.; Chesta, S.; Cleaton, K.; Burgos, H. Hot Executive Function Assessment Instruments in Preschool Children: A Systematic Review. Int. J. Environ. Res. Public Health 2022, 19, 95. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19010095

AMA Style

Mehsen V, Morag L, Chesta S, Cleaton K, Burgos H. Hot Executive Function Assessment Instruments in Preschool Children: A Systematic Review. International Journal of Environmental Research and Public Health. 2022; 19(1):95. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19010095

Chicago/Turabian Style

Mehsen, Vannia, Lilian Morag, Sergio Chesta, Kristol Cleaton, and Héctor Burgos. 2022. "Hot Executive Function Assessment Instruments in Preschool Children: A Systematic Review" International Journal of Environmental Research and Public Health 19, no. 1: 95. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph19010095

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop