http://orcid.org/0000-0003-0699-7588
Figures
Abstract
Background
Many organisations promote eHealth applications as a feasible, low-cost method of addressing mental ill-health and stress amongst their employees. However, there are good reasons why the efficacy identified in clinical or other samples may not generalize to employees, and many Apps are being developed specifically for this group. The aim of this paper is to conduct the first comprehensive systematic review and meta-analysis evaluating the evidence for the effectiveness and examine the relative efficacy of different types of eHealth interventions for employees.
Methods
Systematic searches were conducted for relevant articles published from 1975 until November 17, 2016, of trials of eHealth mental health interventions (App or web-based) focused on the mental health of employees. The quality and bias of all identified studies was assessed. We extracted means and standard deviations from published reports, comparing the difference in effect sizes (Hedge’s g) in standardized mental health outcomes. We meta-analysed these using a random effects model, stratified by length of follow up, intervention type, and whether the intervention was universal (unselected) or targeted to selected groups e.g. “stressed”.
Results
23 controlled trials of eHealth interventions were identified which overall suggested a small positive effect at both post intervention (g = 0.24, 95% CI 0.13 to 0.35) and follow up (g = 0.23, 95% CI 0.03 to 0.42). There were differential short term effects seen between the intervention types whereby Mindfulness based interventions (g = 0.60, 95% CI 0.34 to 0.85, n = 6) showed larger effects than the Cognitive Behaviour Therapy (CBT) based (g = 0.15, 95% CI 0.02 to 0.29, n = 11) and Stress Management based (g = 0.17, 95%CI -0.01 to 0.34, n = 6) interventions. The Stress Management interventions however differed by whether delivered to universal or targeted groups with a moderately large effect size at both post-intervention (g = 0.64, 95% CI 0.54 to 0.85) and follow-up (g = 0.69, 95% CI 0.06 to 1.33) in targeted groups, but no effect in unselected groups.
Interpretation
There is reasonable evidence that eHealth interventions delivered to employees may reduce mental health and stress symptoms post intervention and still have a benefit, although reduced at follow-up. Despite the enthusiasm in the corporate world for such approaches, employers and other organisations should be aware not all such interventions are equal, many lack evidence, and achieving the best outcomes depends upon providing the right type of intervention to the correct population.
Citation: Stratton E, Lampit A, Choi I, Calvo RA, Harvey SB, Glozier N (2017) Effectiveness of eHealth interventions for reducing mental health conditions in employees: A systematic review and meta-analysis. PLoS ONE 12(12): e0189904. https://doi.org/10.1371/journal.pone.0189904
Editor: Phil Reed, Swansea University, UNITED KINGDOM
Received: August 18, 2017; Accepted: December 4, 2017; Published: December 21, 2017
Copyright: © 2017 Stratton et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: ES, IC, SH & NG are supported in partnership with beyondblue with donations from the Movember Foundation. AL is supported by NHMRC-ARC Dementia Research Development Fellowship. RAC is funded by an Australian Research Council Future Fellowship.
Competing interests: NG reports a research grant from Medibio Pty Ltd, administered through the University of Sydney, to evaluate a workplace E-Health intervention. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Mental health problems in the workforce are common and have a substantial impact on employee wellbeing, productivity, absenteeism, compensation claims, and the social welfare systems [1–3]. Reported annual productivity losses to organisations and workforces caused by mental health conditions are estimated at $225US billion in the USA [4] and £13 billion in the UK [5].
The majority of mental ill-health seen in the workforce is due to common mental disorders, most notably, depression and anxiety [6–8], accounting for up to 12% of the Australian working population [9]. However, common mental disorders may go unnoticed in the workplace, as they can often be characterized as work stress or other stress related conditions [7]. More severe mental illness is less common in the workplace, due to lower levels of unemployment in those with severe mental illness [10].
Over the recent decades, organisations have increasingly recognised the importance of maximizing employee health, both for ethical reasons, to improve productivity, meet legislation changes and reduce their cost burden [11,12]. While physical health promotion interventions are well established in many workplaces [13], workplace mental health interventions have lagged. Despite mental illness now being the leading cause of work incapacity and sickness absence [14], and depression estimated to be the leading cause of disability at work by 2020 [15], a recent systematic meta-review found that there no workplace mental health interventions that could be considered evidence-based [16].
The past decade has seen an explosion in the delivery of eHealth interventions targeting common mental illnesses such as depression and anxiety, as well as those focused upon broader concepts of stress and distress [17] through Apps and via the Internet. The components of these interventions have included Cognitive Behavioural Therapy, Stress Management, Mindfulness approaches and Cognitive training. Some eHealth interventions offer fully unguided self-help programs while others involve supported guidance throughout and are thus more costly [18]. Their effectiveness has been examined in both general population and in clinical settings. Two previous systematic review and meta-analysis found that eHealth interventions delivered to general population could both reduce and prevent depression and anxiety [11,19]. Similar results were found in a systematic review and meta-analysis of eHealth interventions in a clinical setting [20].
Thus there is currently ample evidence for the short and long term benefits for eHealth delivered Cognitive Behavioural Therapy (CBT) for treating anxiety and depressive conditions in both general population and clinical settings [21–23], with greater improvement shown for those interventions that include guidance throughout the intervention period [21,24]. Evidence has also emerged for the effectiveness of Mindfulness based eHealth interventions in improving symptoms in both unselected and symptomatic people [25].
However, we know employed people differ systemically from both general or clinical populations used in most eHealth studies (in terms of symptom profile, risks, function and response [26]) Therefore, this evidence may not be generalisable to the occupational setting.
Many workplaces now provide employees with access to mental health assistance, usually through Employee Assistance Programs (EAPs), providing employees with a range of integrated services including short term counseling, management consultations, organisational and team interventions, often with aggregate reporting to the organisation [27]. EAPs are estimated to cost US workplaces up to US$40.00 per person [28]. To mitigate the cost of these, many organisations are now providing eHealth interventions and applications into their workplace health management systems for employees, either by creating their own programs for internal use or buying commercially available products [29,30]. However there is no guidance on whether eHealth interventions are effective in the workplace, or even whether they may cause harm [30]. Given this gap in the evidence we undertook a systematic review of the effectiveness of eHealth interventions delivered to employees through the workplace with the aim of informing organisations and employees that eHealth interventions targeting mental ill-health and work stress are safe and effective.
Methods
This work complies with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [31].
We aimed to identify all published, peer reviewed, clinical trials including randomized controlled trials (RCTs), controlled trials & pre/post trials using an eHealth intervention targeted at employees that reported outcomes on a standardized mental health measure of depression, anxiety and/or stress.
Eligibility criteria
Inclusion
We included only studies evaluating the outcome of an eHealth based intervention, defined as a therapeutic intervention delivered through a website, smartphone or tablet App, focused on the mental health of employees. Participants of the studies had to be in current paid employment and working age adults between 18 to 65 years of age. Included studies were peer-reviewed articles published in English.
Exclusion
Studies were excluded from the review if they focused on volunteer workers, unemployed participants, general or clinical population studies that did not mention being targeted to employees or in a workplace setting, examined non-mental health outcomes, or used telephone and/or email interventions only. Studies without a control group were also excluded from the meta-analysis.
Search strategy
A thorough literature search was conducted using the electronic databases MEDLINE, PsycINFO, Cochrane Register of Controlled Trials (CENTRAL) and EMBASE for relevant articles published from 1975 (the first eHealth intervention for employees was identified in 2004 [32]) until 17 November 2016. Keywords were searched relating to ‘workplace’ and ‘intervention’ and ‘outcome’ and ‘study design’ and an example of a search strategy for these databases is displayed in S1 Table. To increase coverage for relevant databases, we also manually screened the table of contents of the Journal of Medical Internet Research, Journal of Internet Interventions, Occupational and Environmental medicine and the Journal of Occupational Environmental Medicine, as well as the reference list of included studies.
Study selection criteria
Identification.
After duplicates were removed, authors (ES) screened all titles and abstracts to identify potentially relevant studies. Abstracts and Full-text versions of potentially eligible studies were independently assessed by two investigators (ES and IC). Disagreements were adjudicated in conjunction with the senior author (NG).
Data collection and coding of outcomes.
We collected the mean, and standard deviation (SD) of standardized measures of (dis)stress, depression and/or anxiety, and sample size (n) of participants in each arm (intervention and control) at baseline and each follow-up. Where studies used a number of measures, these were pooled as a single composite Mental Health outcome. When SDs were not reported, we contacted the authors. Three authors were contacted, and two of those responded with relevant data [33,34]. In one study [35] the SD could not be obtained from the paper or the authors; effect sizes for this study were derived from 2-tailed p-value for Group × Time interaction and sample sizes. One author did not respond and we were unable to obtain data so this study was excluded from the meta-analysis [36].
Where studies reported results of the same intervention in different papers (e.g., a post intervention and follow-up study), papers were grouped together and treated as one study and we used the first follow-up outcome point in the analysis.
We then categorized the studies by intervention type, in which three main types were identified from the primary paper as to the main component of the intervention: Cognitive Behavioural Therapy (CBT), Stress Management, and Mindfulness-based treatments, and by whether the intervention was given to unselected employees (universal) or targeted to those selected for higher symptom scores or another indication of poorer mental health (indicated). Sensitivity analysis results were also assessed by whether the intervention was unguided (self-help) or guided (feedback, rather than just technical support, as this is known to affect the outcome [37].
Quality assessment and risk of bias within studies.
The quality of the identified studies was assessed using the Downs and Black checklist [38]. Specifically developed for public health, and used previously in similar reviews in the field [16], the Downs and Black checklist demonstrates good inter-rater reliability (r = 0.75) and strong criterion validity (r = 0.90) [11]. The checklist has 27-items to score within five sub categories: reporting, external validity, internal validity -assessing risk of bias & confounding, and power. The checklist was modified to simplify the power item to a score of either zero = no or one = yes based on whether the studies reported sufficient power to detect a clinically significant effect, as reported in previous studies [11,39]. The maximum score for the modified checklist was 28 with most items reporting on yes = one, no = zero or unable to determine = zero, with the exception of one question that used yes = two, partially = one, and no = zero. The first author (ES) individually scored each included paper. Scores were pooled into four categories as used in other reviews [11]: Excellent = 26 to 28, Good = 20 to 25, Fair = 15 to 19 and Poor = 14 and less. Any rated poor were reviewed by an independent research assistant and discrepancies adjudicated by the senior author (NG) and excluded.
As a further standardized measure we assessed Risk of Bias using the Cochrane Guidelines [40]. For this analysis five of the six items (sequence generation, allocation concealment, assessor blinding, incomplete outcome data and selective outcome reporting) were used to assess bias as all of the trials included in the Meta-analysis had only a wait list control group, and it would be impossible for participants and personnel to be blinded to the arm that they were randomized to (S1 Fig).
Statistical analysis
The summary measure was the standardized mean difference (SMD, calculated as Hedge’s g), of change in the effect sizes between baseline and each follow-up. A positive effect size (SMD) indicated that the intervention group had superior effects to the control group. Using standard measures of effect size, SMDs of 0.2 were considered small, 0.5 moderate, and 0.8 large [41]. Precision of effect sizes was estimated using 95% confidence interval (CI). Pooling of effect sizes across studies was done using random effects model in Comprehensive Meta-Analysis V3. Random effects analysis was used as we could not make the assumption that these studies represented a common effect as the different types of interventions delivered may result in large heterogeneity [42].
Analyses were conducted in three stages, first, we combined results of all studies to achieve a combined effect size at each time point, immediately post-intervention and at follow-up. We then estimated pooled effect sizes for each of the three intervention types (CBT, Stress Management, and Mindfulness based interventions). Studies targeting unselected employees were analysed separately from those targeting ‘symptomatic’ (selected) employees such as those having reported increased ‘stress’ or having a mental health condition at baseline measures indicated for intervention. Studies were then stratified using the post-intervention and follow-up combined SMD for each study in each sub-group.
Heterogeneity of real effects across studies was quantified using the I2 statistic to estimate the proportion observed variance not due to sampling error.
To assess small study effect (in the case where at least 10 studies were available for analysis) we used a funnel plot for the overall effects and each of the grouped intervention types which compared the outcome effects with their standard errors. We used Egger regression test to further examine asymmetry of the funnel plot [43] with a statistical significance based on a P-value less than 0.05. In the case where at least 10 studies were available for analysis and a small study effect was found we used a Duval and Tweedie trim and fill to quantify the magnitude of small study effect [44].
Results
Search results
The search strategy identified a total of 1147 titles (Fig 1). After the removal of duplicates (n = 276), 871 titles and abstracts were reviewed by author (ES). Of those, 723 studies were excluded on the basis of the inclusion/exclusion criteria, leaving 108 studies potentially relevant to the research question. The 108 abstracts were examined by the two independent researchers (ES and IC), and 68 articles were excluded. Both researchers independently examined the full text of 40 articles, where a further 8 articles were excluded. The 32 remaining articles were identified as meeting criteria for quality assessment [32–37,45–71]. Four papers were identified as reporting on different follow-up periods and were merged [48,49] and [50,53]. After the quality assessment of all studies using the Down’ & Black Checklist, two studies were excluded from the analysis as they were found to be of ‘poor’ quality [45,55]. Two papers did not have a control group [56,57], and one study used a face-to-face control group [68]. One study [58] included two intervention groups, which were treated as two studies in the meta-analysis. The two intervention groups’ SMDs were computed and the mean (n) of the control group was evenly divided among each intervention group to ensure that control participants were only included once in the analysis. The two studies using cognitive training [59,60] were not included for the meta-analysis as the outcomes were not standardized mental health outcomes. One paper was excluded due to missing data [36]. This approach left 23 studies to be analysed in the meta-analysis, 22 of which were randomized controlled trials and a “controlled” trial [33].
Table 1 shows the details of each included intervention. Eleven studies were identified to have a CBT intervention [32,33,35,45–53,56,61], six studies described themselves as Stress Management [34,36,62–66], and six studies used Mindfulness-based approaches [57,58,67,69–71]. Of the CBT interventions, nine were web-based interventions while two were smartphone Apps. All of the Stress Management interventions were web-based interventions. Of the Mindfulness based interventions, five were web-based and one was on a smartphone App (Table 1).
Meta-analysis results
Overall effect of employee eHealth interventions compared to control conditions.
For the 23 trials identified (Fig 2), there was a small, significant positive overall effect post intervention (g = 0.24, 95% CI 0.13 to 0.35, p = <0.00). However, moderate to large heterogeneity was detected (I2 = 67.6%), and there was a significant difference between the effect of intervention types (Q = 9.82 (df2), p = <0.00).
When stratified by intervention type, CBT (n = 11) showed a very small, significant positive effect size and virtually no heterogeneity (g = 0.15, 95% CI 0.02 to 0.29, p = 0.03, I2 = 1.9%). Mindfulness based interventions (n = 6) showed a moderate to large positive effect size and no heterogeneity (g = 0.60, 95% CI 0.34 to 0.85, p = <0.00, I2 = 0.0%). Stress Management interventions (n = 6) had a non-significant small positive effect size with large heterogeneity (g = 0.17, 95% CI -0.01 to 0.34, p = 0.07, I2 = 86.8%).
At follow-up, there was an overall small significant positive effect (g = 0.23, 95% CI 0.03 to 0.42, p = 0.02) and again moderate to large heterogeneity was detected (I2 = 77.7%). When stratified by intervention type, CBT interventions (n = 6) did not maintain the post-intervention effect (g = 0.09, 95% CI -0.18 to 0.36, p = 0.52, I2 = 0.0%). Mindfulness intervention still showed a small positive, but not statistically significant effect (g = 0.32, 95% CI -0.09 to 0.73, p = 0.12, I2 = 0.0%). Stress Management interventions (n = 3) showed a moderate statistically significant positive effect, however large heterogeneity was detected (g = 0.40, 95% CI 0.04 to 0.77, p = 0.03, I2 = 95.1%). There was no significant difference between the intervention types detected (Q = 2.11 (df2), p = 0.35).
Universal vs targeted interventions.
There were no differences in the effect of CBT (Fig 3) at post-intervention for unselected (n = 6) (g = 0.15, 95% CI 0.05 to 0.26, p = 0.00, I2 = 13.5%) or selected (n = 5) (g = 0.13, 95% CI -0.01 to 0.27, p = 0.06, I2 = 7.4%). This continued into follow-up for unselected (n = 3) (g = 0.14, 95% CI 0.01 to 0.26, p = 0.04, I2 = 0.0%) and selected (n = 3) (g = 0.09, 95% CI -0.09 to 0.26, p = 3.40, I2 = 6.2%).
However, the effect of Stress Management interventions differed between selected and unselected employees at both post-intervention and follow-up. Interventions delivered to an unselected group (n = 4) showed a very small non-significant negative post-intervention effect (g = -0.03, 95% CI -0.16 to 0.09, p = 0.57, I2 = 0.0%) whereas, interventions given to a selected group showed a moderate to large significant effect reflected in the significant difference between these two groups at post-intervention (Q = 29.63 (df1), p< = 0.01) and high heterogeneity (g = 0.64, 95% CI 0.43 to 0.85, p = 0.00, I2 = 70.1%), we can also see that At follow-up there was only study in an unselected group showing a small non-significant negative effect (g = -0.16, 95% CI -0.41 to 0.09, p = 0.21, I2 = 0.0%). In contrast interventions in selected groups continued to show a significant moderate to large effect size, however large heterogeneity was detected (g = 0.69, 95% CI 0.06 to 1.33, p = 0.00, I2 = 89.5%). All Mindfulness-based interventions were aimed at unselected employees in the studies.
Small study effect.
The funnel plots (S2 Fig) of the 23 studies included in the meta-analysis at post-intervention (Panel A in S2 Fig) showed significant asymmetry (Egger’s intercept = 2.53, p = 0.01). After conducting a trim and fill analysis six studies were imputed; there was an adjusted effect size, which was statistically significant (g = 0.12, 95% CI = 0.01 to 0.25) suggesting greater effect in smaller studies (Panel B in S2 Fig). There was no significant asymmetry in the 13 studies at follow-up (Egger’s intercept = 0.32, p = 0.83) (Panel C in S2 Fig). The only sub-group that had more than 10 studies was post-intervention selected CBT (n = 11) (Panel D in S2 Fig), which showed no significant asymmetry (Egger’s intercept = 1.05, p = 0.27)
Overview of efficacy of intervention type and moderators of efficacy across each mental health outcome.
A summary of all of the outcomes is visually presented in Table 2, a matrix showing each Hedge’s g effect size for each intervention and each moderator. Overall, there is evidence for the unselected and guided CBT in reducing overall symptoms, which appears to be due to the effects on depression and stress, but not anxiety. The overall effects of unselected and unguided CBT were maintained at follow up, mainly due to the follow up effects of CBT on stress.
Mindfulness in unselected and unguided formats had a moderate to large effect size (g = 0.59) in reducing overall symptoms, a small to moderate effect in reducing depression (g = 0.34), and a large effect size (g = 0.68) in reducing stress. Unguided and unselected Mindfulness had a small to moderate effect on overall symptoms at follow up, with a large effect on stress.
Stress Management in selected formats had a large effect size (g = 0.64) and moderate effects when guided (g = 0.37) in reducing overall symptoms, a large effect in reducing depression (g = 0.63), anxiety (g = 0.83) and stress (g = 0.64). These results continued at post-intervention however the effect on Stress Management was no longer significant.
Discussion
This study provides the first comprehensive review of the published evidence for the effectiveness of a range of work-based eHealth interventions addressing the mental health of employees.
Our results were drawn from 32 trials, testing a range of online and mobile applications utilizing Cognitive Behavioural techniques, Stress Management based approaches, and Mindfulness based interventions, 23 studies were suitable for the meta-analysis.
Overall pooled eHealth interventions showed a small significant positive effect at post intervention and follow-up for reducing overall mental health (depression, anxiety and stress) in both universal and selected employees which is similar to a recent review of eHealth interventions for general population [19], providing further evidence for potential use on eHealth interventions as a low cost, alternative to face-to-face interventions for employees [4]. However, this result showed large heterogeneity, which is examined in our sub-group analysis. There is evidence of a small study effect in the overall 23 studies at post-intervention, a possible cause for this is the clinical heterogeneity between the participants in the large and small studies, the smaller studies were targeted at the selected group (n = 1328 participants) so that a favourable outcome of the selected group may be expected compared to the larger amount of participants in the universal studies (n = 2922) [72].
As planned, sub-group analyses were performed on selected and universal interventions. Mindfulness interventions were all universal and unguided interventions, and resulted in a moderately large and statistically significant effect size at post intervention, this result has a potential to make a meaningful change when considered on a population level and is a contrary result to previous findings for interventions delivered to a universal population. Previous research indicates that large effect sizes are unlikely to be found in interventions delivered to general populations who may not be unwell [19, 73]. However, this appeared to be relatively short lived with a halved effect size at follow-up.
There was no difference between universal and targeted CBT interventions, although, previous evidence suggests that selected interventions may be more effective than universal interventions [20,74,75]. Both groups showed very small if any effect at post-intervention or follow-up, indicating that CBT interventions appeared not to have any statistical benefits either universal or targeted working populations which seems to differ from large results seen in both universal [76] and clinical [77], populations. This could be due to recent evidence that shows employed people differ systemically from the general or clinical in terms of symptom profile, function and response [26]. It may also be that the setting, with propensity for perverse incentives, or perceived coercion by employers may not be an effective therapeutic milieu.
In contrast, eHealth Stress Management interventions did appear to have benefits when used in a selected fashion e.g. amongst those reporting increased stress, showing a moderately large effect at post-intervention and a moderate effect size follow-up however, large heterogeneity was detected showing that the two selected studies had a significant difference in what can assume is the sample size as the follow-up length and intervention designs were both very similar. Importantly, when the same type of Stress Management based eHealth interventions were used in unselected (universal) employees, there was no effect compared to wait list controls. Only one study reported a follow up and suggested psychological harm, which may, if replicated, be another example of well-meaning intentions going awry, as some believe to occur with psychological debriefing [78]. It is not clear why a Stress Management intervention would not be effective when used on an unselected population, though it may relate to the dangers of providing non-help seeking populations with too much information, leading them to feel more anxious and vulnerable, as suggested by the authors of these studies[79], or could reflect intra-study effects e.g. differential drop out.
The outcome measures were then analysed separately by means of mental health condition.
We can see evidence for workplace eHealth interventions that are targeted and guided with low risk of bias reducing depression overall at post-intervention. There is no evidence to suggest that any eHealth intervention in the workplace have any effect on reducing anxiety level or symptoms at either post-intervention or follow-up. For stress levels it is evident that Stress Management interventions are most effective at post-intervention. It is evident that where a high risk of bias is found: in overall interventions, CBT and Mindfulness are all due to stress outcomes, it is unclear why, but this may be due to the different self-reporting measures used to report stress.
Strengths and limitations
The main strengths of this review are the detailed systematic search strategy, the clearly defined inclusion and exclusion criteria and the assessment of the quality of the studies. There are a number of potential limitations, first, despite widespread use, the number of studies examining eHealth interventions in the workplace was surprisingly small with only 23 studies able to be included in the meta-analysis and for some of the subgroups there were too few to draw strong conclusions. Second, although some of the studies had clearly defined the intervention type, e.g. reporting only using CBT approaches, other interventions prioritised one approach in a more eclectic intervention, e.g. using “Mindfulness with aspects of Stress Management”, and we had to group these studies into that dominant intervention basis. However the high heterogeneity of differences of true effects when all these eHealth interventions were combined was reduced substantially when analysed by intervention type, sometimes to zero, supporting this grouping. Where a study had several outcome measures, we decided to pool them into one ‘overall mental health’ combined category, however Table 2 shows the outcome specific moderators and each level of efficacy in the intervention groups and overall. As self-reported measures were used in all studies, our conclusions are limited to self-reported reduction of symptoms rather than a clinical diagnosis. Finally, initial screening of some titles for exclusion was only completed by one author.
Conclusion
This review demonstrated the evidence that certain types of eHealth interventions delivered to employees via their workplace can be effective at reducing mental health and stress symptoms although the evidence base is affected by a small study effect that seems to inflate effectiveness. If an eHealth intervention is to be offered to all employees, in a universal fashion, then Mindfulness approaches appear to have a stronger effect than the other types. There is little to recommend Stress Management approaches delivered to the whole workforce, and one study suggests that providing this type of intervention may even be harmful. In contrast the use of Stress Management eHealth interventions by workers who are reporting high levels of stress may have a positive effect, despite few studies. Thus although eHealth interventions are now popular and widely promoted in workplaces it appears that some caution is required in their advocacy and uptake and more evidence is needed on the effectiveness, targeting, implementation and potential risks of these new technologies.
Several considerations for future research and practice for delivering eHealth interventions to employees are evident. First, it is important to consider what the intended populations needs from the interventions to ensure the greatest potential for benefit, for example, the diverse mental health status of the employees should be considered, and where possible interventions should be offered that best fit a range of symptoms which may entail more than one application. Second, it is important to select interventions on the basis of available evidence, as some intervention types may have little or no effect on the intended outcome or may even be potentially harmful. Third, it is important for organisations that are providing interventions to their employees consider both the effectiveness of the interventions and design features to ensure that they can be applied to both universal and selected groups of people, and to be aware that not all employees would benefit from the same type of intervention. Fourth, more research is needed in the form of randomised controlled trials to understand which type of interventions would best benefit different types of employees and mental health conditions, especially Mindfulness interventions that are guided and targeting symptomatic employees, as there is no current evidence for this group.
Acknowledgments
ES, IC, SH & NG are supported in partnership with beyondblue with donations from the Movember Foundation. AL is supported by NHMRC-ARC Dementia Research Development Fellowship. RAC is funded by an Australian Research Council Future Fellowship.
References
- 1.
PricewaterhouseCoopers. (2014) Creating a mentally healthy workplace Return on investment analysis. Final Report. Retrieved from https://www.headsup.org.au/docs/default-source/resources/beyondblue_workplaceroi_finalreport_may-2014.pdf
- 2. Glozier N. Mental ill health and fitness for work. Occup Environ Med 2002; 59:714–20. pmid:12356935
- 3. Harvey SB, Henderson M, Lelliott P, Hotopf M. Mental health and employment: much work still to be done. Br J Psychiatry, 2009; 194(3):201–203 pmid:19252144
- 4. Stewart W, Ricci J, Chee E, & Morganstein D. Lost productive work time costs from health conditions in the United States: Results from the American productivity audit. Journal of Occupational & Environmental Medicine, 2003; 45(12), 1234–1246.
- 5.
Black C. Working for a healthier tomorrow. Dame Carol Black’s Review of the health of Britain’s working age population. Department of Work and Pensions 2008.
- 6. Harvey S, Modini M, & Joyce S, Milligan-Saville JS, Tan L, Mykletun A. et al. Can work make you mentally ill? A systematic meta-review of work related risk factors for common mental health problems. Occup Environ Med 2017;74(4):301–310 pmid:28108676
- 7. Knudsen A, Harvey S, Mykletun A, and Overland S Common mental disorders and long-term sickness absence in a general working population. The Hordaland Health Study. Acta Psychiatr Scand 2013;127:287–97. pmid:22775341
- 8. Knudsen A, Overland S, Aakvaag HF, Harvey SB, Hotopf M and Mykletun A. Common mental disorders and disability pension award: seven year follow-up of the HUSK study. J Psychosom Res 2010;69:59–67 pmid:20630264
- 9. Harvey Samuel B, Deady Mark, Wang Min-Jung, Mykletun Arnstein, Butterworth Peter, Christensen Helen and Mitchell Philip B. Is the prevalence of mental illness increasing in Australia? Evidence from national health surveys and administrative data, 2001–2014. Med J Aust 2017; 206 (11): 490–493 pmid:28918719
- 10. Harvey S, Modini M, Christensen H, & Glozier N. Severe mental illness and work: What can we do to maximise the employment opportunities for individuals with psychosis? Australian & New Zealand Journal of Psychiatry (2013);47: (5):421–4.
- 11. Tan L, Wang M.-J, Modini M, Joyce S, Mykletun A, Christensen H. et al. Preventing the development of depression at work: A systematic review and meta-analysis of universal interventions in the workplace. MBC Medicine, 2014; 12, 74.
- 12.
National Institute for Health and Clinical Excellence: Workplace health promotion: how to encourage employees to be physically active. NICE Public Health Guidance 13. 2008, London, UK: National Institute for Health and Clinical Excellence.
- 13.
Brunton G, Dickson K, Khatwa M, Caird J, Oliver S, Hinds K.et al, (2016) Developing evidence informed, employer-led workplace health. London: EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London.
- 14. Henderson M, Harvey S, Overland S, Mykletun A, & Hotopf M: Work and common psychiatric disorders. J R Soc Med. 2011, 104: 198–207. pmid:21558098
- 15. Mathers CD, Loncar D: Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med. 2006, 3
- 16. Joyce S, Modini M, Christensen H, Mykletun A, Bryant R, Mitchell PB. et al. Workplace interventions for common mental disorders: a systematic meta-review, Psychological Medicine, 2016;46(4), 683–697 pmid:26620157
- 17. Harrison V, Proudfoot J, Wee P, Parker G, Pavlovic DH, Manicavasagar V. Mobile mental health: review of the emerging field and proof of concept study. J Ment Health 2011; 20:509–524. pmid:21988230
- 18. Andersson G, Hesser H, Veilord A, Svedling L, Andersson F, Sleman O. et al. Randomised controlled non-inferiority trial with 3-year follow-up of Internet-delivered versus face-to-face group cognitive behavioural therapy for depression. Journal of Affective Disorders, 2013; 151(3), 986–994. pmid:24035673
- 19. Deady M, Choi I, Calvo R, Glozier N, Christensen H, & Harvey S. ‘eHealth interventions for the prevention of depression and anxiety in the general population: A systematic review and meta-analysis’. BMC Psychiatry, 2017;17
- 20. Richards D, & Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin. Psychol. Rev, 2012; (32) 329–342
- 21. Andrews G, Cuijpers P, Craske M, McEvoy P, Titov N. Computer Therapy for the Anxiety and Depressive Disorders Is Effective, Acceptable and Practical Health Care: A Meta-Analysis. PLoS ONE 5, 2010 (10).
- 22. So M, Yamaguchi S, Hashimoto S, Sado M, Furukawa T & McCrone P, Is computerised CBT really helpful for adult depression?-A meta-analytic re-evaluation of CCBT for adult depression in terms of clinical implementation and methodological validity. BMC Psychiatry 2013, 13:113 pmid:23587347
- 23. Gilbody S, Littlewood E, Hewitt C, et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial, BMJ, 2015;351.
- 24. Andrews G, Cuijpers P, Carlbring P, Riper H, Hedman E, Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry 2014;13:288–295 pmid:25273302
- 25. Spijkerman M, Pots W, Bohlmeijer E. Effectiveness of online mindfulness-based interventions in improving mental health: A review and meta-analysis of randomised controlled trials. Clinical Psychology 2016;102:(45) 114
- 26. McIntyre RS, Florea I, Tonnoir B, Loft H, Lam RW, Christensen MC. Efficacy of Vortioxetine on Cognitive Functioning in Workinf Patients with Major Depressive Disorder. Journal Clinical Psychiatry, 2017;78:115–121
- 27.
Flanagan P, & Ots J. EAP counselling: Outcomes, impact & return on investment 2011.
- 28.
Dunning M, (2014 Jan 5). Employee assistance programs underutilized by employees. Retrieved from http://www.businessinsurance.com/article/20140105/NEWS03/301059979
- 29. Birgit W, Horn A, Maercker A. Internet-based versus face-to-face cognitive-behavioral intervention for depression: A randomized controlled non-inferiority trial. Journal of Affective Disorders, 2013.
- 30. Ahthes E, Mobile mental-health apps have exploded onto the market, but few have been thoroughly tested. Pocket Psychiatry, Nature, 2016;532(7)
- 31. Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med 6(7): e1000097. pmid:19621072
- 32. Grime P, Computerized cognitive behavioural therapy at work: a randomised controlled trial in employees with recent stress-related absenteeism. Occupational Medicine 2004;54:353–359 pmid:15289593
- 33. Billings D, Royer F, Hendrickson A, Dove D, A web-based approach to managing stress and mood disorders in the workforce. Journal of Occupational and Environmental Medicine, 2008;50(8): 960–968. pmid:18695455
- 34. Cook R, Hersch R, Schlossberg D, Leaf S. A Web-based health promotion program for older workers: Randomized controlled trial. Journal of medical Internet research, 2015. 17(3).
- 35. Hasson D, Anderberg U, Töres T, Arnetz B Psychophysiological effects of a web-based stress management system: A prospective, randomized controlled intervention study of IT and media workers. BMC Public Health. 2005; 5: 78. pmid:16042796
- 36. Eisen K, Allen G, Bollash M, Pescatello L. Stress management in the workplace: A comparison of a computer-based and in-person stress management intervention. Computers in Human Behavior. 2008. 24(2): 486–496
- 37. Andersson G, Cuijpers P, Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cognitive Behaviour Therapy 2009; 38:4.
- 38. Downs SH, Black N: The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998, 52: 377–384. 1. pmid:9764259
- 39. Samoocha D, Bruinvels D, Elbers N, Anema J, van der Beek A: Effectiveness of web-based interventions on patient empowerment: a systematic review and meta-analysis. J Med Internet Res. 2010, 12
- 40.
Higins J, Green S, editors Cochrane handbook for systematic reviews of interventions version 5.1.0. The Cochrane Collaboration.
- 41.
Cohen J, Statistical Power Analysis for Behavioural Sciences, Hillsdale, NJ: Lawrence Erlbaum Associates; 1988(2).
- 42.
Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 [updated March 2011]. Oxford, United Kingdom: The Cochrane Collaboration; 2009.
- 43.
Rothstein H, Sutton A, Borenstein M. Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. Chichester, United Kingdom: John Wiley & Sons Ltd, 2005.
- 44. Duval S, Tweedie R: Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in met-analysis. Biometrics, 2000:56:455–463. pmid:10877304
- 45. Shimazu A, Irimajiri H, Sakamoto M, Amano S, Effects of web-based psychoeducation on self-efficacy, problem solving behavior, stress responses and job satisfaction among workers: a controlled clinical trial. Journal of Occupational Health, 2005;47(5): 405–13. pmid:16230834
- 46. Lappalainen P, Kaipainen K, Lappalainen K, Hoffrén R, Myllymaki T, Linnunen ML. et al. Feasibility of a personal health technology-based psychological intervention for men with stress and mood problems: randomized controlled pilot trial. JMIR Research Protocols, 2013; 2(1).
- 47. Boiler L, Ketelaar S, Nieuwenhuijsen K, Smeets O, Gartner F, Sluiter J. Workplace mental health promotion online to enhance well-being of nurses and allied health professionals: A cluster-randomized controlled trial. Internet Interventions 1, 2014;196–204
- 48. Geraedts A, Kleiboer AM, Twisk J, Wiezer NM, van Mechelen W, Cuijpers P.Long-term results of a web-based guided self-help intervention for employees with depressive symptoms: randomized controlled trial. Journal of medical Internet research, 2014;16(7).
- 49. Geraedts A, Wiezer N, van Mechelen W, Cuijpers P, Short-term effects of a web-based guided self-help intervention for employees with depressive symptoms: randomized controlled trial. Journal of medical Internet research, 2014;16(5).
- 50. Imamura K, Kawakami N, Furukawa T, Matsuyama Y, Shimazu A, Umanodan R. et al. Effects of an Internet-based cognitive behavioral therapy (iCBT) program in Manga format on improving subthreshold depressive symptoms among healthy workers: a randomized controlled trial. PLoS ONE, 2014;9(5).
- 51. Mori M, Taajima M, Kimura R, Sasaki N, Somemura H, Ito Y. et al. A Web-Based Training Program Using Cognitive Behavioral Therapy to Alleviate Psychological Distress Among Employees: Randomized Controlled Pilot Trial. JMIR research protocols, 2014. 3(4).
- 52. Phillips R, Schneider J, Molosankwe I, Leese M, Foroushani PS, Grime P. et al. Randomized controlled trial of computerized cognitive behavioural therapy for depressive symptoms: effectiveness and costs of a workplace intervention. Psychological Medicine, 2014;44(4): 741–52. pmid:23795621
- 53. Imamura K, Kawakami N, Furukawa T, Matsuyama Y, Shimazu A, Umanodan R. et al. Does Internet-based cognitive behavioral therapy (iCBT) prevent major depressive episode for workers? A 12-month follow-up of a randomized controlled trial. Psychological medicine, 2015;45(09): 1907–1917.
- 54. Yamagishi M, Kobayashi T, Nagami M, Shimazu A, Kageyama T. Effect of web-based assertion training for stress management of Japanese nurses. Journal of Nursing Management, 2007. 15(6): 603–607. pmid:17688565
- 55. Yamagishi M, Nakamura Y, Effects of web-based career identity training for stress management among Japanese nurses: a randomized control trial. Journal of Occupational Health, 2008. 50(2): 191–193. pmid:18403870
- 56. Takechi S, Kikuchi T, Horisawa S, Nakagawa A, Yoshimura , Mimura M. Effectiveness of a Cognitive Behavioral Therapy-Based Exercise Program for Healthy Employees. Advances in Physical Education, 2015;5(4): 263
- 57. Ahtinen A, Mattila E, Valkkynen P, Kaipainen K, Vanhala T, Ermes M. et al. Mobile mental wellness training for stress management: Feasibility and design implications based on a one-month field study. JMIR Mhealth Uhelath, 2013; 1(2).
- 58. Mak W, Chan A, Cheung E, Lin C, Ngai K, Enhancing Web-based mindfulness training for mental health promotion with the health action process approach: Randomised controlled trial. Journal of Medical Internet Research, 2015; 17(1): 1
- 59. Abbott J-A, Klein B, Hamilton C, Rosenthal A. The impact of online resilience training for sales managers on wellbeing and performance. Sensoria: A Journal of Mind, Brain & Culture, 2009. 5(1): 89–95.
- 60. Borness C, Crawford J, Valenzuela M. Putting brain training to the test in the workplace: a randomized, blinded, multisite, active-controlled trial. PLoS ONE [Electronic Resource], 2013. 8(3): p. e59982
- 61. Birney A, Gunn R, Russell J, Ary D. MoodHacker mobile wen app with email for adults to self-manage mild-to-moderate depression: Randomized controlled trial. JMIR Mhealth Uhelath, 2016;4(1).
- 62. Cook R, Hersch R, Back A, Hendrickson A. A field test of a web-based workplace health promotion program to improve dietary practices, reduce stress, and increase physical activity: randomized controlled trial. Journal of Medical Internet Research, 2007. 9(2): e17. pmid:17581811
- 63. Ebert D, Lehr D, Boss L, Riper H, Cuijpers P, Andersson G. et al. Efficacy of an internet-based problem-solving training for teachers: Results of a randomized controlled trial. Scandinavian Journal of Work, Environment & Health, 2014. 40(6): 582–596
- 64. Umanodan R, Minami M, Kawakami N. Effects of computer-based stress management training on psychological well-being and work performance in japanese employees: a cluster randomized controlled trial. Industrial Health, 2014. 52(6): 480–91. pmid:25055847
- 65. Stansfeld S, Kerry S, Chamdola T. Russell J, Berney L, Hounsome N. et al. Pilot study of a cluster randomised trial of guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM study. BMJ Open 2015;5
- 66. Heber E, Lehr D, Ebert D, Berking M, Riper H. Web-Based and Mobile Stress Management Intervention for Employees: A Randomized Controlled Trial. Journal of medical Internet research, 2016. 18(1): 21.
- 67. Glück T, Maercker A, A randomized controlled pilot study of a brief web-based mindfulness training. BMC Psychiatry 2011; 11:175 pmid:22067058
- 68. Wolever RQ, Bobinet KJ, McCabe K, Mackenzie ER, Fekete E, Kusnick CA. et al. Effective and viable mind-body stress reduction in the workplace: a randomized controlled trial. Journal of occupational health psychology, 2012. 17(2): 246–258. pmid:22352291
- 69. Aikens K, Astin J, Pelletier K, Levanovich K, Baase CM, Park YY. et al. Mindfulness goes to work. JOEM, 2014;56(7).
- 70. Ly K, Asplund K, Andersson G. Stress management for middle managers via an acceptance and commitment-based smartphone application: a randomized controlled trial. Internet Interventions, 2014. 1(3): 95–101.
- 71. Allexandre D, Bernstein A, Walker E, Hunter J, Roizen MF, and Morledge TJ. A web-based mindfulness stress management program in a corporate call center. A randomized clinical trial to evaluate the added benefit of onsite group. JOEM, 2016; 58(3).
- 72.
Schwarzer G, Carpenter J, Rücker G. (2015) Small-Study Effects in Meta-Analysis. In: Meta-Analysis with R. Use R!. Springer, Cham
- 73.
Rose G. The strategy of prevention medicine. Oxford: Oxford University Press; 1994.
- 74. Schröder J, Berger T, Westermann S, Klein JP, Moritz S. Internet interventions for depression: new developments. Dialogues in Clinical Neuroscience. 2016;18(2):203–212. pmid:27489460
- 75. Sheffield JK, Spence SH, Rapee RM, Kowalenko N, Wignall A, Davis A, McLoone J. Evaluation of universal, indicated, and combined cognitive-behavioral approaches to the prevention of depression among adolescents. J Consult Clin Psychol. 2006;74(1):66:66 pmid:16551144
- 76. Spek V, Cuijpers P, Nyklicek I, Smits N, Riper H, Keyzer J. et al. One-year follow-up results of a randomized controlled clinical trial on internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years. Psychol Med. 2008;38(5):635–9 pmid:18205965
- 77. Andrews G, Cuijpers P, Craske M, McEvoy P, & Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS ONE, 2010;5 (10),
- 78. Wessely S & Deahl M. Psychological debriefing is a waste of time (in debate). Br J Psychiatry; 2003. 183:12–14. pmid:12835237
- 79. Wessely S, Bryant RA, Greenberg N, Earnshaw M, Sharpley J, Hughes JH. et al. Does psychoeducation help prevent Post Traumatic Psychological Distress? Psychiatry: Interpersonal and Biological Processes 2008; 71, 4, 287–302