http://orcid.org/0000-0002-7470-2756
Figures
Abstract
Background
Executive functions (EFs) play a critical role in cognitive and social development. During preschool years, children show not only rapid improvement in their EFs, but also appear sensitive to developmentally appropriate interventions.
Aim
EMIL is a training program for German preschool teachers that was developed and implemented to improve the EFs of preschoolers. The aim of the present study was to evaluate its effects on the EFs of children between three and six years old.
Method
The teacher training (eight sessions, 28.5 hours) was implemented in four preschools. The EFs of children of the intervention group (n = 72, 32 girls, Mage = 48 months) and the control group of four other matched preschools (n = 61, 27 girls, Mage = 48 months) were tested before, during, and after the intervention using different measures assessing working memory, inhibitory control, and cognitive flexibility.
Results
The intervention group showed significant gains on three out of seven EF tests (behavioral inhibition, visual-spatial working memory, and combined EFs) compared to the control group. Post hoc analyses for children with low initial EFs scores revealed that participation in the intervention led to significant gains in inhibitory control, visual-spatial working memory, and phonological working memory as well as a marginally significant difference for combined EFs. However, effect sizes were rather small.
Citation: Walk LM, Evers WF, Quante S, Hille K (2018) Evaluation of a teacher training program to enhance executive functions in preschool children. PLoS ONE 13(5): e0197454. https://doi.org/10.1371/journal.pone.0197454
Editor: Chandan Vaidya, Georgetown University, UNITED STATES
Received: July 7, 2017; Accepted: May 2, 2018; Published: May 24, 2018
Copyright: © 2018 Walk et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Relevant data can be found at https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/U76G9C.
Funding: This work was supported by the Baden-Württemberg Stiftung gGmbH, (https://www.bwstiftung.de) to LMW, WFE, SQ. The funder agreed to the study design and gave their consent to the publication.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Young children often act ‘in the heat of the moment’. They act impulsively, can be easily distracted, have trouble waiting or sitting still for a prolonged period, and show little persistence in what they do [1]. These skills of cognitive control and behavioral regulation are often referred to as executive functions (EFs). EFs are top-down mental processes that enable goal-directed action as well as adaptive responses to novel or challenging situations and unfamiliar tasks when acting automatically would be inadequate or impossible [2, 3]. EFs make it possible to concentrate and pay attention, take the time to think before acting, control feelings, and resist temptations [4]. Thus, they are important for higher cognitive functions such as planning, judgement, decision making, structuring and execution of tasks, and for the detection and correction of errors [5–7]. EFs encompass three separable but related components: working memory, inhibitory control, and cognitive flexibility [8]. Working memory is the ability to maintain, update, and monitor information and to mentally work with or manipulate this information. Hence, working memory is important to plan and act in a goal-directed manner and stay on task. Inhibitory control or inhibition describes the ability to resist a first inclination and think before acting. It is needed to control impulses and ignore distracting stimuli in order to stay focused. Cognitive flexibility is the ability to shift between tasks or mental sets and adjust to changed demands or precedencies. It is also important to take on a new perspective and to switch between perspectives [9, 10]. These cognitive skills form the basis for intentional self-controlled behavior and are of great importance in doing well at school, work, and in mastering the demands of daily life [11].
Over the years, numerous studies have shown that EFs are associated with the cognitive and social-emotional development of children and predict many life outcomes: EFs show significant correlations with academic achievement and school success [12–14]. Better EFs are related to proficiency in mathematics [15–18], reading and literacy [15, 19, 20], and the ability of verbal and nonverbal reasoning [21]. Studies have shown that the EFs of preschoolers predict their school readiness and later academic performance [12, 18, 22]. In addition, EFs are correlated with social competence, socially appropriate behavior [23–25], and emotion regulation [26].
EFs emerge in early childhood and continue to develop over childhood and adolescence until early adulthood [27]. This long period of development is related to the maturation of the prefrontal cortex where the neural correlates are found [28]. This area undergoes one of the longest periods of development; only in young adulthood this region is fully developed [29, 30]. Since it has been demonstrated that EFs improve rapidly through the preschool and elementary school years [29, 31] and the brain has greater neural and behavioral plasticity during early childhood [32], those time periods bear great potential for the enhancement of EFs [33, 34].
Studies have shown that different games, activities and exercises promote the EFs of preschool children, for example circle games, pretend-play, and physical activity [35–37]. Moreover, specially developed curricula for preschool and primary schools such as Tools of the Mind and Promoting Alternative Thinking Strategies (PATHS) aim to strengthen children’s EFs [10, 38, 39]. Those curricula are based on a teacher training that implement the promotion of EFs into both daily routine and special lessons. It should be noted, however, that the evaluation studies of these curricula come to inconclusive results [10, 40].
One reason may be that various factors that are associated with EFs such as gender, parents’ education, socio-economic status, and employment level [41–44] and have shown to mediate the impact of cognitive training programs on the improvement of children’s EFs [38, 45], are not always sufficiently controlled for.
Several principles have to be taken into acount when attempting to enhance the development of EFs in young children [46]:
- EFs must be continually challenged to see improvements. For that, it is crucial to create individual curricula and programs to enable an appropriate challenge for each child.
- There is a greater chance to get transfer effects on other cognitive, social, and behavioral competencies if the training program of EFs is more global. Programs should address many EF components and self-regulatory skills, such as in fully integrated curricula [47, 48].
- Another key element is repetition. EFs benefit the most if they are addressed again and again. Training throughout the day and every day produces more improvements than lessons only once or twice per week.
- Intervention studies showed that preschool programs and curricula do not need expensive equipment to support EFs [49]. Teachers need basic knowledge, further education, and professional support on how to promote children’s EFs.
- In order to achieve the best results in improving EFs it is important to bear in mind children’s emotional and social development. EF activities should bring joy and confidence to make sure children are willing to devote time to them.
- Because of the process of development and the rapid improvement of EFs in the preschool years, interventions should start as early as possible [14].
Despite this knowledge and the growing interest in promoting EFs in children, there is no early childhood education program to enhance EFs in Germany.
The newly developed EMIL intervention aims at strengthening preschoolers EFs through teacher training [50, 51].Public preschools provide optimal access to the majority of children (about 80% of all three- to six-year-olds attend preschool). Implementing an education program in the preschool setting could equip children with competencies to be successful in school and life, and possibly reduce the achievement gap [52].EMIL was developed on the basis of research findings, in line with the workings of German preschools, and with the help of preschool teachers. All before mentioned principles were taken into account in the development: EMIL focuses on individual promotion in a social context. All activities are integrated into everyday life. As a result, a continuous promotion of EFs takes place. The implemented activities and exercises are playful and appropriate to the current needs and skills of the children.
The aim of the present study is to evaluate whether participation in the EMIL teacher training leads to gains in the EFs of preschool children.
Methods
Ethics statement
The study was approved by the local ethical committee of the Ulm University. All research procedures and participant recruitment materials were reviewed and approved. Parents of participating children were informed about the procedures of the study before giving their written consent. Participating children were given verbal information about the procedure.
Participants
Eight preschools took part in the study. They all belonged to the same school district and worked according to the same pedagogical concept called ‘infans’ [53]. In total, 67 preschool teachers (64 female, 3 male) and 133 children (74 male, 59 female) participated in the study. Children were recruited through letters distributed by the preschools. Information events were organized at each of the eight preschools for the parents to ask questions. At the time of first testing, children’s age ranged from 30 to 60 months (Mage = 48 months, SD = 7.65 months). The intervention group (four preschools with 33 teachers) consisted of 72 children (32 girls, 40 boys, Mage = 48 months, SD = 7.8 months), the control group (the other four preschools with 34 teachers) of 61 children (27 girls, 34 boys, Mage = 48 months, SD = 7.5 months).
Design
The preschools that took part in the study had open classrooms. In 2015, the open classroom concept was implemented in more than 13% of all preschools in Germany, making it a well-established concept of preschool care [54]. In open classrooms children are not assigned to a particular teacher or class. The children are free to move from one room to another and work with different teachers and children according to their wishes and needs. Subsequently, in the present study it was not possible to assign groups at classroom level but only at preschool level. The individual preschools varied in size as well as in the age distribution and socio-economic status (SES) of the children. To control for these differences, preschools were paired based on the following criteria: number of children in preschool, sex and age distribution, proportion with immigration background, and SES (estimated by the preschool principal). One preschool of each pair was randomly assigned to the intervention. The other became the “practice as usual” control group.
Fig 1 shows the study design. In order to gain insight in the children’s development of EFs, they were tested at three different times over the course of one year (before the intervention, seven months into the intervention, and two months after). Over a period of nine months, the 33 preschool teachers of the EMIL intervention group received eight training sessions (total number of hours: 28.5 h).
EMIL—An intervention program to enhance EF skills
EMIL is an intervention program designed to enhance EF skills in children. It consists of a teacher training program and its implementation in preschools [51, 55]. Research findings and the experiences of preschool teachers both contributed to its development. The training program consisted of eight sessions. Five training sessions were carried out with all preschool teachers of the four intervention preschools together. The other three sessions took place with each preschool team individually at their preschool.
The sessions involved presentations on the definition, meaning, development, and training of EFs. The preschool teachers learned about the cognitive and social-emotional development of children, the development of EFs and their importance for social and academic skills. They also learned different ways to enhance EFs in the preschool setting. The teachers reflected on these aspects and discussed ideas on how they can modify demands on EFs and enhance EFs in the daily routines of their own preschool. Different methods and activities that were proven to enhance EFs (e.g., physical and mindfulness activities, role-play) were introduced and practiced. The teachers received materials to give them ideas on how to transfer what was learned into practice at their preschool.
EMIL covers four aspects that can be addressed in all German preschools regardless of their pedagogical concept: 1.) attitude (teacher’s mindset and perception of the child); 2.) interaction & communication (e.g., talking with children and asking questions to activate and involve the child); 3.) structures (set times, interior design/provided materials, rules/rituals, and group structure); and 4.) activities (e.g., games, physical activity, pretend-play, relaxation and mindfulness techniques).
The EMIL training program was delivered to complete teams of preschool teachers. That was important because in Germany many preschools have an open classroom concept, requiring a common understanding and approval of daily routines by the team. By having the whole team taking part in the training program, they were able to work together on solutions for their preschool.
While the teacher training program has a predetermined structure with predefined contents, how teachers incorporate these ideas in their daily work was not imposed on them. EMIL intended to enable preschool teachers to adjust their work in a way that enhances children’s EFs purposefully but en passant. In this regard, EMIL is neither a preschool concept nor an add-on but rather an add-in that is supposed to be easily integrated into various preschool environments.
The teachers were expected to identify situations and opportunities in their preschool based on examples discussed during the training sessions and to support children individually, depending on the situation. In this way, EMIL is meant to be integrated into various preschool curricula and to be adapted to the needs of differing preschools, children and organizational structures. This transfer to differing settings was supported by three aspects of the teacher training:
- Teachers acquired an ‘EF-lens’. That means they learnt to see preschool situations in terms of EFs considering typical situations like lunch, playing board games, and doing sports as opportunities to enhance children’s EFs.
- Teachers worked on the issues of their preschool. Different preschools face different challenges. During the training sessions, the teachers were encouraged to apply the new knowledge to their own setting and set realistic goals for improvements.
- Teachers were encouraged to see the resources of their preschool and the strengths of their children. Rather than focusing on weaknesses, the trainer helped the teachers focus on enhancing those strengths.
In the course of the teacher training, one preschool team for example decided to improve EF skills and self-regulated behavior by changing the room layout. They created retreat opportunities for the youngest and provided more space for playing with building blocks for the older children. With this modification children could easier meet their own needs and regulate their own emotions. As a result, there were fewer situations of excessive EF demands and conflicts among the children. Another preschool team provided more time for physical activities to improve EFs and played more games like “Simon says” for impulse control. They incorporated in their daily routines good old familiar games as well as new games to strengthen EFs in children.
Various changes of this kind have been implemented by all four preschools—some of them were more extensive, others rather small, but all were in line with the individual situation and the aim of the EMIL program.
Testing procedure
EFs were assessed using seven different tasks appropriate for the age group. The tasks were administered by the test administrators in two individual sessions, each lasting 30 minutes, in a quiet room at the preschools. All children received the same test battery. All tasks were presented in a fixed order for all children [56]: Tower, Block Recall, and Head-Toes-Knees-Shoulders were part of the first session. Hearts & Flowers, Day & Night, and Digit Span forward and backward were part of the second session.
Measures
Behavioral inhibition.
In the Tower task [57], the child takes turns with the test administrator to build a tall tower out of wooden building blocks. After a brief demonstration of turn-taking, the test administrator begins building the tower. Afterwards, the test administrator does not take a turn unless the child communicates that it is her turn, e.g., verbally or by handing her a block. Different from the original task that uses 20 blocks, each child was presented with 15 building blocks. Children’s mistakes (placing a block when it was not their turn) were counted. The sum of the two trials was used in analyses (max. 26 mistakes).
Inhibitory control.
In the Day & Night task [9, 58], the child is asked to react to 16 pictures of either a sun or a moon appearing in random order on the computer screen. The child is told to say”sun” whenever the moon appears on the screen and say “moon” when the sun appears. After four practice trials, no feedback was given to the child during the 16 trials. The child was awarded two points for every correct answer, one if the child corrected themselves and zero points if the answer was wrong (max. 32 points).
Behavioral self-regulation.
The Head-Toes-Knees-Shoulders task (HTKS) [42, 59] requires children to respond to commands first naturally and then in the “opposite” way. There are rules the child has to remember to respond correctly to behavioral commands. In the first of the three parts, the child was told to touch his/her head when the command “Touch your toes” was given, and to touch his/her toes when the command “Touch your head” was given. After two questions to check understanding, children were given four practice trials and the instructions were repeated up to three times during the practice trials. Then ten test commands were given verbally in random but fixed order, without feedback. In the second part, two additional commands where introduced. When asked to “Touch your shoulders”, the child had to touch his/her knees. When asked to “Touch your knees”, the child had to touch his/her shoulders. In the third part, all commands changed. Now, when asked to “Touch your head”, the child had to touch his/her knees and vice versa. When asked to “Touch your shoulders”, the child had to touch his/her toes and vice versa. During the testing portion, the test administrator stated the behavioral commands without modeling any actions. Children received two points for a correct response, one point for a self-correct, defined as making any discernable motion (ranging from slight to complete) toward the incorrect response but ending with the correct response. Zero points were given for an incorrect response. If children received at least four points on the 10 items, the next rule was added. For the three parts with 30 trials the total score was 60 points.
Visual-spatial working memory.
In the Block Recall task [60] the child is asked to remember a sequence that the test administrator shows. The child is presented with nine wooden cubes located randomly on a board. The test administrator taps a sequence of blocks with a stick. The child’s task is to tap with his/her own stick the same blocks in the same order. The test administrator begins with tapping one block. The length of the sequence is increased by one additional block when two sequences of the same length are correctly repeated by the child. The child is awarded one point for each correct repetition (max. 21 points).
Phonological working memory.
The Digit Span forward and the Digit Span backward task [61] were used to assess phonological working memory. The digit recall test requires the child to repeat a sequence of digits in correct serial order. Lists of the digits 1 to 9 are read out aloud by the test administrator at the rate of one digit per second. Following a short practice session with two trials, the test administrator reads out a maximum of four lists of each length. List length is increased by one if the child recalls three lists at that length correctly. Testing continued until the child recalled two lists of one length incorrectly. The number of lists correctly recalled is scored (max. 12 points). The backward digit recall test is identical to the forward digit recall test in all respects except that it requires the child to recall the sequence of spoken digits in reverse order. Practice trials were given in order to ensure that the child understands the concept of “reverse”. The number of lists repeated correctly was scored (max. 6 points).
Combined EFs (working memory, inhibitory control, and cognitive flexibility).
The Hearts & Flowers task [10, 62] requires the child to react correctly and as fast as possible to a stimulus (red heart or blue flower) presented on a computer screen (right or left side). Depending on the stimulus and the side of the screen that it appears on, the child has to press one of two buttons as quickly as possible. Hearts & Flowers contains three conditions with 10 practice and 40 testing trials each. The congruent condition places minimal demands on EFs. The child is instructed “to press the button on the same side as the heart”. Therefore, the child has to remember the rule and apply it as quickly and correctly as possible. The incongruent condition demands, in addition to working memory, inhibitory control. It requires the children remember the rule “to press on the side opposite the flower” and inhibit the tendency to follow the rule of the congruent condition. The mixed condition demands all three core EF skills (inhibitory control, working memory, and cognitive flexibility). Red hearts and blue flowers appear in a random order on either the right or the left side of the screen. Children need to apply the rules of the congruent and the incongruent condition flexibly. In all three conditions, children were given seven seconds to respond. If they responded too fast (in less than 0.4 seconds) the response was not taken into account. If they responded too slow, it was counted as an error. Children received one point for every correct response (max. 120 points).
Family demographics.
Primary caregivers were asked to complete a short background questionnaire on the family including citizenships, languages spoken in the home, and family income.
Teacher satisfaction.
After every EMIL training session, a short questionnaire was handed to all participating teachers. The teachers were asked to rate their level of satisfaction on a scale from 1 to 6 (1 = ‘very satisfied’ to 6 = ‘not satisfied at all’) concerning the following aspects of the EMIL training: learning content, instruction methods, relevance for teaching practice, learning outcomes, and collaboration with the EMIL instructors.
Missing data
Not all children were able to take part in all testing sessions due to extraneous circumstances (e.g., being sick or on vacation). At the t2 assessment, one child of the control group did not take part in the second of the two testing session due to prolonged absence from school. At t3, three children of the intervention group were not present for the first testing session and 3 children (one of the control and two of the intervention group) were absent during the second testing session. Also, not all children that were present chose to participate in every test presented to them in the testing session. In other cases, their performance on the tests could not be analyzed due to obvious problems understanding the instructions. The test with the highest refusal or abortion rate was the Hearts & Flowers which was the longest and most monotonous task of the session.
The return rate for the caregiver questionnaire was 97% in the intervention group and 89% in the control group. However, some parents did not answer all questions in the questionnaire. Response rates were especially low for family income with data missing for 23 out of the 124 children whose parents filled in the questionnaire.
Still, data were assumed to be missing completely at random (MCAR). Little’s MCAR test [63] was performed for all dependent and independent variables used in the following analyses. Little’s MCAR did not reach significance, suggesting that data were indeed missing completely at random (χ2 (638, N = 133) = 628.03, p = .603). Missing data were not imputed.
Statistical analyses
IBM SPSS Statistics, version 22.0 for Windows [64] was used for the statistical analyses. Chi-Square tests were conducted to check for differences in children’s background variables (e.g., gender, age) and family demographics (e.g., educational and occupational level of parents) between the intervention and the control group. Pearson’s correlation coefficients were calculated between children’s background and family variables and EF measures.
Univariate Analyses of Covariance (ANCOVAs) were conducted to assess group differences in performance gains on EF measures. ANCOVAs were preferred over repeated measures Analyses of Variance because they provide a more accurate estimate of the effect of the intervention as they control for pre-existing differences [65]. Group (intervention vs. control) served as the between-subject factor. Age, maternal and paternal educational and occupational level, and t1 pre-test score for each individual test were entered as covariates. Dependent variables were EF scores at t2 and t3. An estimate of the effect size, partial eta squared (η2), was calculated for each dependent variable.
Results
Table 1 presents the response rate for each construct, descriptive statistics, and Chi-Square test results for the intervention and the control group. The children belonged mostly to well-educated families. Almost 90% of parents were German citizens. About 8% of the children did not speak German as their first language. The sample can be considered representative for the population from which it was drawn. Chi-Square tests showed no significant differences between the two groups in any of the demographic variables. The matching process appeared effective in creating comparable groups prior to intervention. However, there are some tendencies observed for both parental educational and occupational background.
Descriptive statistics (i.e., means, standard deviations, possible score ranges) for the EF tasks for all three assessments are shown in Table 2. The percentage of missing values per EF task ranged between 0 and 5%, with the exception of up to 9% in the second and third condition of the HTKS and the Hearts & Flowers task, which is mostly attributable to the duration of both tasks. Ceiling effects were noted for the Tower at t3. Floor effects were found for Digit Span backwards at t1 and t2.
Table 3 shows the correlations among EF test scores at pre-assessment as well as with children’s background variables. All EF measures show significant correlations with one another, except for the HTKS and Digit Span forward (p = .065). The highest correlations (r = .660 and r = .642, both ps < .001) were found among the three subtests of the Hearts & Flowers task. Significant correlations with age were found for all EF measures, which was not surprising given the age range of the participants. When controlling for age, significant correlations were found for time spend at preschool and inhibitory control (Day & Night), maternal educational level and working memory (Digit Span forward), both paternal educational and maternal occupational level and combined EFs (Hearts & Flowers mix) as well as for paternal educational level and combined EFs (Hearts & Flowers incongruent). Significant correlations were also found between family income and both working memory (Digit Span forward) and combined EFs (Hearts & Flowers congruent).
To test the efficacy of the teacher training, a between-group comparison (intervention vs. control group) using analyses of covariance was conducted. ANCOVAs were conducted once to compare performances between the intervention and the control group at t2 and again to compare performances at t3. The selection of covariates (age and educational and occupational level of both parents in addition to performance at t1) was supported by the results of the Chi-square tests and the correlational analyses. The results of the ANCOVAs are presented in Table 4. Note that the due to missing data in the caregiver questionnaire the entering of covariates lowered the sample sizes in both the intervention and the control group. At t2, significant intervention effects were found only for the Tower [F(1, 105) = 16.73, p < 0.01, partial eta2 = .14]. Performance on Tower at t2 was associated with performance on Tower at t1. Hearts & Flowers congruent [F(1, 100) = 3.19, p = 0.07, partial eta2 = .03] showed marginally significant differences between the two groups at t2. Performance on Hearts & Flowers congruent at t2 was influenced by age and performance at t1.
At t3, significant differences between the intervention and the control group were found for the Block Recall [F(1, 100) = 9.41, p < 0.01, partial eta2 = .09]. Both age and performance at t1 affected performance at t3. Additionally, a significant differences were found for Hearts & Flowers congruent [F(1, 99) = 4.36, p = 0.04, partial eta2 = .04]. Performance was influenced by age and performance at t1. No significant intervention effects were found in the other EF tests: Day & Night, HTKS, Digit Span forward and backward, and Hearts & Flowers incongruent and mix.
Previous studies have found effects for children with lower initial levels of EFs even when no effects became evident for the overall sample [38, 49, 66]. To test this assumption, post hoc analyses with the same covariates were carried out for children scoring at or below the 50th percentile. Significant differences in favor of the intervention group were found for the following tests: Tower and Digit Span forward at t2 and Block Recall at t3. Of the children scoring initially low on the Tower (1 or more mistakes), 43 belonged to the intervention and 25 to the control group. At t2, the children of the intervention group obtained an average score of 2.95 (SD = 4.62) and the children of the control group an average score of 8.30 (SD = 8.50). As lower scores indicate better performance, the intervention group outperformed the control group at t2 [F(1, 50) = 11.14, p < 0.01, partial eta2 = .18]. Of the children scoring low on the Block Recall at t1 (5 points or less), 36 belonged to the intervention group and 33 to the control group. At t3, the children of the intervention group had an average score of 8.35 (SD = 2.64), whereas the children of the control group had an average score of 6.27 (SD = 3.57). Children of the intervention group scored significantly higher at t3 [F(1, 37) = 9.23, p < 0.01, partial eta2 = .16]. For the Digit Span forward, children at or below the 50th percentile obtained a score of 5 points or less at t1. 41 children belonged to the intervention group and 30 to the control group. At t2, the children of the intervention group had an average score of 5.22 (SD = 1.55) and the children of the control group an average score of 4.45 (SD = 1.63), marking a significant difference [F(1, 51) = 4.27, p < 0.05, partial eta2 = .07]. Of the children scoring at or below the 50th percentile on the Hearts & Flowers congruent (score of 24.5 or lower), 34 belonged to the intervention and 31 to the control group. The children of the intervention group obtained an average score of 24.90 (SD = 11.44) at t2 and a score of 28.48 (SD = 11.21) at t3. The children of the control group a score of 19.83 (SD = 10.50) at t2 and a score of 22.54 (SD = 10.33) at t3. A marginally significant difference were found for both t2 [F(1, 46) = 3.59, p = 0.06, partial eta2 = .07] and t3 [F(1, 45) = 2.96, p = 0.09, partial eta2 = .06].
We also assessed the teacher satisfaction regarding several aspects of the EMIL training. Mean levels of satisfaction for the five aspects (learning contents, instruction methods, relevance for teaching practice, learning outcomes, and collaboration with the instructors) were calculated across all participating teachers and training sessions. The majority of the teachers who participated in the EMIL training reported high satisfaction across all five aspects (mean rating score of 1.5 out of 6, SD = 0.70). None of the five questions had a mean satisfaction rating less than 1.8.
Discussion
The aim of the present study was to evaluate the effects of an intensive teacher training on children’s EFs. The results showed that children whose teachers took part in the EMIL training program obtained significant higher scores on three out of seven EF measures (inhibitory control, visual-spatial working memory, and combined EFs) compared to a control group. Although significant gains were found, the number of effects as well as the effect sizes were, contrary to our expectations, quite small. This might be due to the fact that the intervention did not focus on children with EF deficits or lower socio-economic background. Instead, EMIL was applied with a middle-class sample and with all children visiting the preschool taking part in the intervention. Children from low-income families often display greater shortcoming in regard to their EFs and self-regulation skills [67, 68]. Other intervention studies found that only those children starting out with low EF scores show significant improvements but not those starting out high [38, 49, 66]. In our study post-hoc analyses for children scoring low at the first assessment revealed similar although not the same results as for the overall sample. Again, children of the intervention group scored significantly higher on inhibitory control at t2 and visual-spatial working memory at t3. Therefore, the differences found for the whole sample may be attributed to the sub-sample of children with low initial EF scores. As they started out lower, there was more room for improvement, which in turn led to greater variability in the post-test scores making it easier to identify changes. In addition to the results for the whole sample, a significant difference in phonological memory capacity was found in favor of the intervention group once only children with low EFs were taken into account. Also, the effect sizes were larger than the ones for the whole sample, although still quite small.
The preschools in our study were located in the same school district; hence, their classroom resources, staffing structure, and educational level were similar. The preschools were well-matched at school level and then randomly assigned to intervention and control group. ANCOVAs controlled for age, parental educational and occupational levels as well as score on pre-test. Therefore, children of the intervention group did not perform better because they were older, more economically advantaged, had more highly educated parents, or started out with higher scores than the control group as the analysis controlled for the influence of those factors. Unfortunately, the inclusion of several background variables in the analyses also resulted in a loss of power due to missing data.
There are several potential reasons that significant differences and near-significant trends only emerged for those three measures but not for others. One reason could be that the EMIL teachers supported the skills required in those three tests especially well with the activities they implemented and the way they guided the children. Teachers were not aware of the tests that were administered. Therefore, it can be dismissed that they trained exactly what the tests asked of the children. However, turn taking and collaboration, as assessed by the Tower test, makes up an important part of preschool life. Children in the intervention group may have received better support by their teachers when practicing collaborative play and sharing as a result of the EMIL training. It is assumed that EMIL influenced the guidance that teachers provided to the children of the intervention group as well as the implementation of fitting and well-considered activities thereby offering children more opportunities to develop their EFs. This in turn may have led to higher scores on the inhibitory control test. The gains in visual-spatial and phonological working memory could be attributed to the implementation of various activities to strengthen children’s working memory, e.g., challenging the children to get a number of items from the kitchen when setting the table. Also, preschool teachers reported changes in the way they communicated with the children, which might have taxed—among other things—children’s working memory. By returning questions to the children (‘You want to color. Okay! What materials do you need for water coloring and where do you find them?’) and involving them in their own thought processes (e.g., to find a solution or a compromise: ‘I wonder how we can solve this situation. Do you have an idea?’), children were encouraged to think for themselves. Learning how to scaffold children in their own thinking process (e.g., by given prompts or summarizing important facts) was an important part of the teacher training. However, it has to be noted, that the Digit Span backwards also measures phonological working memory but children showed no improvement in this test. Looking at the mean scores for this specific test, it becomes clear that it was challenging for a lot of children, as it showed clear floor effects.
It is difficult to explain the lack of results regarding the HTKS and the Day & Night. Both are rather ‘playful’ measures that resemble games that are assumed to require EFs such as ‘Simon says’. Taking a closer look at well-known games and discussing the load they may put on children’s EFs was part of the teacher training and have been implemented by the teachers of the intervention group. It may be though that those kinds of games are such a common activity in preschools that they were also played frequently with the children of the control group.
Some differences became apparent already at t2, but did not last and could not be detected at the third assessment whereas other effects emerged only at t3, three months after the teacher training had ended. It could be argued that the teacher training sped up the development of EFs in the children of the intervention group and that the children of the control group simply caught up six months later. It could also be the case that the fade-out of the intervention resulted in a drop of motivation among the teachers and thereby in a drop of EF activities.
Another reason for the low number of significant results may be that the intervention led to gains in children’s EFs but in ways not detected by the EF tests chosen for the evaluation [14]. The frequently described difficulty of choosing appropriate measures for preschoolers that assess EFs in reliable way may apply here [69].
During the training sessions, teachers often reported changes that they had perceived in their children’s everyday behavior. They had observed that children concentrated better on what they are doing, collaborated more, helped each other out, and solved problems more independently. It would have been useful to implement objective observation tools to track putative changes not only in children’s EFs but also in their self-regulation as its closer related to everyday activities [70].
The obtained results are in line with the extant body of research on preschool programs aiming to improve EFs in children. Evaluation studies of teacher trainings, e.g., Tools of the Mind [39] and Promoting Alternative Thinking Strategies (PATHS) [71], indicate that modifications in daily teaching practice can lead to small but significant gains in preschooler’s self-regulation skills and EFs. Curricula that practice diverse skills and all EFs all day long in preschool could produce widespread cognitive benefits [72]. An all-day Tools of the Mind curriculum for example showed greater benefits on children’s EFs than a Tools add-on to existing curricula [72]. However, it should be noted that some studies on the Tools of the Mind program have failed to find significant results [40]. Evaluations suggest that PATHS leads to higher emotional knowledge skills and children were rated as more socially competent than the children in the control group [73]. But here, too, the effects on EFs are rather small [38]. In general, most study results should be treated with caution: Some studies lack a control group or a baseline measure [10]. Control variables such as maternal education and socio-economic status, which are associated with children’s EFs [41–44], are often not accounted for. And when intervention effects are found, they are often over-interpreted [14].
Despite the small effect sizes and methodological issues, there are still some promising approaches on how to strengthen EF in preschool children. Then why was a new intervention developed? The contents and structure of the mostly US-American programs could not be simply implemented in Germany, because there are critical differences in the way that preschools work in the USA and Germany. More than 13% of German preschools have open classrooms where children can walk in and out [54]. Much of the time is dedicated to children’s free play. Furthermore, German preschools do not follow any predefined educational curricular for reading, writing, and arithmetic. These academic skills are taught in primary schools. Therefore, preschool teachers and their administrations have a lot of freedom to structure their day according to their needs and are hesitant to exchange this liberty for rigid programs. PATHS is a program with fixed content that requires a class structure. Tools of the Mind is more open and flexible but incorporates the enhancements of EF skills also in academic learning settings. Therefore, a new intervention program, EMIL, was developed to support the EFs of children in German preschools. The EMIL intervention, as described in the methods section, works solely with the preschool teachers who then implement changes to their classroom practice. The participating teams of preschool teachers developed ideas on how to adapt their pedagogical practices and everyday activities to promote their children’s EFs. As a result, they could respond more appropriately to the needs of their children and apply changes to areas that they thought needed attention (e.g., physical activities, pretend-play, interior design). As the teacher training involved sessions with the whole preschool teams, changes in time and room structure could be decided on right away and put to practice immediately thereafter. For a feasible and sustainable implementation with high fidelity, it was decided to train preschool teachers and not to use experts from outside [49]. The implementation in each individual preschool did not involve costly materials. In order to reach as many children as possible, it is important that the implementation of an intervention can be easily translated in every preschool setting and does not require expensive materials [49]. No special equipment is needed to address the four main aspects of EMIL (attitude, interaction & communication, structures, and activities). Once teachers learned about the connection between these aspects and the enhancement of EFs, they could identify simple strategies to support their children. Considering both aspects that EMIL trained the teachers of the preschools and that there is no additional equipment needed, we assume that the EMIL intervention is a very feasible way to support children’s EFs. This assumption is also supported by the results of the questionnaires which demonstrated the high satisfaction of the teachers with the EMIL training.
The translation of the teacher training into preschool practice by teachers depending on the circumstances in their preschools also created drawbacks for the study. Measures of treatment fidelity to track to what extent the intervention has been implemented by the teachers [40] were not implemented as preschools were encouraged to find their own translations. Each preschool worked on what they perceived needed most attention. The lack of standardization is a limitation of the study but is at the same time a feature and lies in the heart of the intervention idea. EMIL was designed to be readily implemented in German preschools as an ecologically valid intervention that continues after researchers have finished their work. The lack of standardization makes it harder to find substantial effects. But effects were found. Possibly they were found because of the flexibility and customizability of the EMIL practices. The involvement of the teachers in how to implement EMIL in their preschools was meant to make sure that EMIL practices were anchored into everyday activities in every classroom. Therefore, it can be assumed that children had more exposure to EF enhancing practices.
A second limitation of the study is that only a passive and no active control group was recruited. The teachers of the control group did not receive any standardized intervention. However, German preschool teachers are entitled to five days per year of continuing education. The control group received over the course of the intervention their individually chosen training courses provided by the school district. In this respect both groups differ little as both received teacher trainings. Still, it cannot be ruled out that teachers taking part in EMIL were more motivated through their participation as a team than the teachers in the control group.
The current study is limited by the relatively small sample size due to missing data. Larger samples that enable analyses to account for the nested structure of data as well as follow-ups to assess longer-term effects of training at 6 months and beyond are needed to more rigorously assess the effects and the longevity of training. Assessment would be augmented by incorporating other objective measures that are appropriate for children between three and six years of age. It is assumed that EMIL influenced the teaching practice and the guidance that teachers provide to the children. However, as project fidelity has not been observed in an objective manner, it is difficult to put a finger on the active ingredients. For future studies it would be useful to track which activities have been implemented by the preschool teachers in order to gain some insight on how much of the content of the teacher training was transferred into everyday practice. Additionally, it should be considered to implement recurring check-ins with the teacher teams or to send out monthly newsletters with a short theoretical input and ideas for pedagogical activities to hold up motivation after the fade-out. Also, preschool teachers showed high levels of satisfaction with the training contents and reported changes in children’s everyday behavior but again, these were not yet measured in an objective manner outside of the standardized EFs tests. Still, the EMIL teacher training program led presumably to EMIL practices in preschools that enhanced EFs in children in return. The findings indicate that teacher training could not only be an ecologically valid intervention but also lead to significant benefits for children’s EFs. But although the approach appears promising, larger randomized-controlled trials are needed to determine how children can be effectively supported in their development of EFs.
Conclusion
EMIL is a preschool intervention program that aims to enhance EFs by considering the individual needs of the children, the teachers, and structures of the preschool. It can be customized for every preschool. The obtained results add to the evidence that training of preschool teachers may lead to significant gains in children’s EFs and especially in those starting out low. Given the centrality of EFs to school readiness, social-emotional competences, and academic achievement, it is of great interest to equip teachers with the knowledge and the tools necessary to support children in this regard early in life.
Acknowledgments
We thank all the participants involved in this study and the eight preschools for permitting us to do this research.
References
- 1. Espy KA, McDiarmid MM, Cwik MF, Stalets MM, Hamby A, Senn TE. The contribution of executive functions to emergent mathematic skills in preschool children. Developmental neuropsychology. 2004;26(1):465–86. pmid:15276905
- 2. Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annual Review of Neuroscience. 2001;24(1):167.
- 3. Zelazo PD, Müller U, Frye D, Marcovitch S. The development of executive function. Monographs of the Society for Research in Child Development. 2003;68(3):93–119.
- 4. Diamond A. Executive functions. Annual Review of Psychology. 2013;64:135–68. pmid:23020641
- 5.
Baddeley A, Della Salla S. Working memory and executive control. In: Roberts AC, Robbins TW, Weiskrantz L, editors. The prefrontal cortex Executive and cognitive functions. Oxford: Oxford University Press; 2003. p. 9–21.
- 6. Carlson SM. Executive Function in Context: Development, Measurement, Theory, and Experience. Monographs of the Society for Research in Child Development. 2003;68(3):138–51. pmid:14723274
- 7.
Roberts AC. Introduction. In: Roberts AC, Robbins TW, Weiskrantz LE, editors. The prefrontal cortex: Executive and cognitive functions. Oxford: Oxford University Press; 2003. p. 1–5.
- 8. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The unity and diversity of executive functions and their contributions to complex "Frontal Lobe" tasks: a latent variable analysis. Cognitive Psychology. 2000;41(1):49–100. pmid:10945922
- 9. Diamond A. Consequences of variations in genes that affect dopamine in prefrontal cortex. Cereb Cortex. 2007;17 Suppl 1:i161–70.
- 10. Diamond A, Barnett WS, Thomas J, Munro S. Preschool program improves cognitive control. Science. 2007;318(5855):1387–8. pmid:18048670
- 11. Blair C. Executive function and early childhood education. Current Opinion in Behavioral Sciences. 2016;10:102–7.
- 12. Blair C. School readiness: Integrating cognition and emotion in a neurobiological conceptualization of children's functioning at school entry. American Psychologist. 2002;57(2):111–27. pmid:11899554
- 13. Duckworth AL, Seligman ME. Self-discipline outdoes IQ in predicting academic performance of adolescents. Psychological Science. 2005;16(12):939–44. pmid:16313657
- 14. Jacob R, Parkinson J. The potential for school-based interventions that target executive function to improve academic achievement: A review. Review of Educational Research. 2015;85(4):512–52.
- 15. Blair C, Razza RP. Relating Effortful Control, Executive Function, and False Belief Understanding to Emerging Math and Literacy Ability in Kindergarten. Child Development. 2007;78(2):647–63. pmid:17381795
- 16. Bull R, Espy KA, Wiebe SA. Short-Term Memory, Working Memory, and Executive Functioning in Preschoolers: Longitudinal Predictors of Mathematical Achievement at Age 7 Years. Developmental neuropsychology. 2008;33(3):205–28. pmid:18473197
- 17. Bull R, Espy KA, Wiebe SA, Sheffield TD, Nelson JM. Using confirmatory factor analysis to understand executive control in preschool children: Sources of variation in emergent mathematic achievement. Developmental science. 2011;14(4):679–92. pmid:21676089
- 18. Coldren JT. Cognitive control predicts academic achievement in kindergarten children. Mind, Brain, and Education. 2013;7(1):40–8.
- 19. Becker DR, Miao A, Duncan RJ, McClelland MM. Behavioral self-regulation and executive function both predict visuomotor skills and early academic achievement. Early Childhood Research Quarterly. 2014;29(4):411–24.
- 20. McClelland MM, Cameron CE, Connor CM, Farris CL, Jewkes AM, Morrison FJ. Links between behavioral regulation and preschoolers' literacy, vocabulary, and math skills. Developmental Psychology. 2007;43(4):947–59. pmid:17605527
- 21. van der Sluis S, de Jong PF, van der Leij A. Executive functioning in children, and its relations with reasoning, reading, and arithmetic. Intelligence. 2007;35(5):427–49.
- 22. Sasser TR, Bierman KL, Heinrichs B. Executive functioning and school adjustment: The mediational role of pre-kindergarten learning-related behaviors. Early childhood research quarterly. 2015;30:70–9. pmid:27231409
- 23. Kochanska G, Murray KT, Harlan ET. Effortful control in early childhood: continuity and change, antecedents, and implications for social development. Developmental Psychology. 2000;36(2):220–32. pmid:10749079
- 24. Morgan AB, Lilienfeld SO. A meta-analytic review of the relation between antisocial behavior and neuropsychological measures of executive function. Clin Psychol Rev. 2000;20(1):113–36. pmid:10660831
- 25. Rhoades BL, Greenberg MT, Domitrovich CE. The contribution of inhibitory control to preschoolers' social–emotional competence. Journal of Applied Developmental Psychology. 2009;30(3):310–20.
- 26. Carlson SM, Wang TS. Inhibitory control and emotion regulation in preschool children. Cognitive Development. 2007;22(4):489–510.
- 27. Huizinga M, Dolan CV, van der Molen MW. Age-related change in executive function: developmental trends and a latent variable analysis. Neuropsychologia. 2006;44(11):2017–36. pmid:16527316
- 28. Gogtay N, Giedd JN, Lusk L, Hayashi KM, Greenstein D, Vaituzis AC, et al. Dynamic mapping of human cortical development during childhood through early adulthood. Proceedings of the National Academy of Sciences of the United States of America. 2004;101(21):8174–9. pmid:15148381
- 29.
Diamond A. Normal development of prefrontal cortex from birth to young adulthood- Cognitive functions, anatomy, and biochemistry. In: Stuss , Knight R, editors. Principles of Frontal Lobe Function. New York, NY: Oxford University Press; 2002.
- 30. Stuss DT. Biological and psychological development of executive functions. Brain and Cognition. 1992;20(1):8–23. pmid:1389124
- 31. Bunge SA, Zelazo PD. A brain-based account of the development of rule use in childhood. Current Directions in Psychological Science. 2006;15(3):118–21.
- 32. Wass S, Porayska-Pomsta K, Johnson MH. Training attentional control in infancy. Current biology. 2011;21(18):1543–7. pmid:21889346
- 33. Flook L, Smalley S.L., Kitil M.J., Galla B.M., Kaiser-Greenland, S., Locke J., Ishijima E., Kasari C. Effects of mindful awareness practices on executive functions in elementary school children. Journal of Applied School Psychology. 2010;26(1):70–95.
- 34. Kray J, Ferdinand NK. How to Improve Cognitive Control in Development During Childhood: Potentials and Limits of Cognitive Interventions. Child Development Perspectives. 2013;7(2):121–5.
- 35. Schmitt SA, McClelland MM, Tominey SL, Acock AC. Strengthening school readiness for Head Start children: Evaluation of a self-regulation intervention. Early Childhood Research Quarterly. 2015;30:20–31.
- 36. Thibodeau RB, Gilpin AT, Brown MM, Meyer BA. The effects of fantastical pretend-play on the development of executive functions: An intervention study. Journal of Experimental Child Psychology. 2016;145:120–38. pmid:26835841
- 37. Campbell DW, Eaton WO, McKeen NA. Motor activity level and behavioural control in young children. International Journal of Behavioral Development. 2002;26(4):289–96.
- 38. Bierman KL, Nix RL, Greenberg MT, Blair C, Domitrovich CE. Executive functions and school readiness intervention: Impact, moderation, and mediation in the Head Start REDI program. Development and Psychopathology. 2008;20(3):821–43. pmid:18606033
- 39.
Bodrova E, Leong DJ. Tools of the Mind: Pearson; 2007.
- 40. Barnett WS, Jung K, Yarosz DJ, Thomas J, Hornbeck A, Stechuk R, et al. Educational effects of the Tools of the Mind curriculum: A randomized trial. Early Childhood Research Quarterly. 2008;23(3):299–313.
- 41. Matthews JS, Ponitz CEC, Morrison FJ, National Institute of Child H, Human D, National Science F, et al. Early gender differences in self-regulation and academic achievement. Journal of Educational Psychology. 2009;101(3):689–704.
- 42. Ponitz CEC, McClelland MM, Matthews JS, Morrison FJ. A structured observation of behavioral self-regulation and its contribution to kindergarten outcomes. Developmental Psychology. 2009;45(3):605–19. pmid:19413419
- 43. Raver CC, Blair C, Willoughby M. Poverty as a predictor of 4-year-olds' executive function: New perspectives on models of differential susceptibility. Developmental psychology. 2013;49(2):292. pmid:22563675
- 44. Sarsour K, Sheridan M, Jutte D, Nuru-Jeter A, Hinshaw S, Boyce WT. Family socioeconomic status and child executive functions: The roles of language, home environment, and single parenthood. Journal of the International Neuropsychological Society. 2011;17(1):120–32. pmid:21073770
- 45. Segretin MS, Lipina SJ, Hermida MJ, Sheffield TD, Nelson JM, Espy KA, et al. Predictors of cognitive enhancement after training in preschoolers from diverse socioeconomic backgrounds. Frontiers in psychology. 2014;5:205. pmid:24659975
- 46. Diamond A, Lee K. Interventions shown to aid executive function development in children 4 to 12 years old Science. 2011;334(6054):959–64.
- 47. Raver CC, Jones SM, Li-Grining C, Zhai F, Bub K, Pressler E. CSRP's Impact on low-income preschoolers' preacademic skills: self-regulation as a mediating mechanism. Child Dev. 2011;82(1):362–78. pmid:21291447
- 48. Riggs NR, Greenberg MT, Kusche CA, Pentz MA. The mediational role of neurocognition in the behavioral outcomes of a social-emotional prevention program in elementary school students: effects of the PATHS Curriculum. Prevention Science. 2006;7(1):91–102. pmid:16572300
- 49. Tominey SL, McClelland MM. Red light, purple light: Findings from a randomized trial using circle time games to improve behavioral self-regulation in preschool. Early Education & Development. 2011;22(3):489–519.
- 50. Quante S, Evers WF, Otto M, Hille K, Walk LM. EMIL-Ein Kindergarten-Konzept zur Stärkung der Selbstregulation durch Förderung der exekutiven Funktionen. Diskurs Kindheits- und Jugendforschung. 2016;11(4):417–33.
- 51.
Baden-Württemberg Stiftung. EMIL—Emotionen regulieren lernen. In: Walk L, Quante S, Evers W, Otto M, Deffner C, editors. Ein Qualifizierungskonzept für pädagogische Fachkräfte. Bad Rodach: Wehrfritz; 2016.
- 52. Blair C, Raver CC. Closing the achievement gap through modification of neurocognitive and neuroendocrine function: Results from a cluster randomized controlled trial of an innovative approach to the education of children in kindergarten. PLoS One. 2014;9(11):e112393. pmid:25389751
- 53.
Laewen H-J, Andres B. Das infans-konzept der Frühpädagogik: Bildung und Erziehung in Kindertagesstätten: verlag das netz; 2011.
- 54.
Meiner-Teubner C, Kopp K, Schilling M. Träger von Kindertageseinrichtungen im Spiegel der amtlichen Statistik. Eine Analyse der Strukturen, der Bildungsbeteiligung, des Personals und von Qualitätskriterien Herausgegeben von Forschungsverbund DJI/TU Dortmund Dortmund: Eigenverlag Forschungsverbund DJI/TU Dortmund.
- 55. Quante S, Evers W. F., Otto M., Hille K., & Walk L. M. EMIL–Ein Kindergarten-Konzept zur Stärkung der Selbstregulation durch Förderung der exekutiven Funktionen. Diskurs Kindheits-und Jugendforschung. 2016;11(4).
- 56. Carlson SM, Moses LJ. Individual Differences in Inhibitory Control and Children's Theory of Mind. Child Development. 2001;72(4):1032–53. pmid:11480933
- 57. Kochanska G, Murray K, Jacques TY, Koenig AL, Vandegeest KA. Inhibitory control in young children and its role in emerging internalization. Child Development. 1996;67(2):490–507. pmid:8625724
- 58. Gathercole SE, Pickering SJ, Ambridge B, Wearing H. The Structure of Working Memory From 4 to 15 Years of Age. Developmental Psychology. 2004;40(2):177–90. pmid:14979759
- 59. Ponitz CEC, McClelland MM, Jewkes AM, Connor CM, Farris CL, Morrison FJ. Touch your toes! Developing a direct measure of behavioral regulation in early childhood. Early Childhood Research Quarterly. 2008;23(2):141–58.
- 60. Alloway TP, Gathercole SE, Pickering SJ. Verbal and visuospatial short‐term and working memory in children: Are they separable? Child Development. 2006;77(6):1698–716. pmid:17107455
- 61.
Petermann F, Petermann U. HAWIK-IV: Hamburg-Wechsler Intelligenztest für Kinder-IV. New York: H. Huber 2008.
- 62. Davidson MC, Amso D, Anderson LC, Diamond A. Development of cognitive control and executive functions from 4 to 13 years: evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia. 2006;44(11):2037–78. pmid:16580701
- 63. Little RJ. A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association. 1988;83(404):1198–202.
- 64.
Corp I. IBM SPSS statistics for windows, version 22.0. Armonk, NY: IBM Corp. 2013.
- 65. Dimitrov DM, Rumrill PD Jr. Pretest-posttest designs and measurement of change. Work. 2003;20(2):159–65. pmid:12671209
- 66. Connor CM, Ponitz CC, Phillips BM, Travis QM, Glasney S, Morrison FJ. First graders' literacy and self-regulation gains: The effect of individualizing student instruction. Journal of School Psychology. 2010;48(5):433–55. pmid:20728691
- 67. Evans GW, Rosenbaum J. Self-regulation and the income-achievement gap. Early Childhood Research Quarterly. 2008;23(4):504–14.
- 68. Wanless SB, McClelland MM, Tominey SL, Acock AC. The influence of demographic risk factors on children's behavioral regulation in prekindergarten and kindergarten. Early Education & Development. 2011;22(3):461–88.
- 69. Anderson PJ, Reidy N. Assessing executive function in preschoolers. Neuropsychol Rev. 2012;22(4):345–60. Epub 2012/10/31. pmid:23109046
- 70. Whitebread D, Coltman P, Pasternak DP, Sangster C, Grau V, Bingham S, et al. The development of two observational tools for assessing metacognition and self-regulated learning in young children. Metacognition and Learning. 2009;4(1):63–85.
- 71.
Kusché CA, Greenberg MT. The PATHS curriculum. Seattle, WA: Developmental Research and Programs; 1994.
- 72. Diamond A, Ling DS. Conclusions about interventions, programs, and approaches for improving executive functions that appear justified and those that, despite much hype, do not. Developmental Cognitive Neuroscience. 2016;18:34–48. pmid:26749076
- 73. Domitrovich CE, Cortes RC, Greenberg MT. Improving young children's social and emotional competence: a randomized trial of the preschool "PATHS" curriculum. Journal of Primary Prevention. 2007;28(2):67–91. pmid:17265130