https://orcid.org/0000-0002-7570-8105
Figures
Abstract
A large literature has demonstrated the link between poverty and mental ill-health. Yet, the potential causal effects of poverty alleviation measures on mental disorders are not well-understood. In this systematic review, we summarize the evidence of the effects of a particular kind of poverty alleviation mechanism on mental health: the provision of cash transfers in low- and middle-income countries. We searched eleven databases and websites and assessed over 4,000 studies for eligibility. Randomized controlled trials evaluating the effects of cash transfers on depression, anxiety, and stress were included. All programs targeted adults or adolescents living in poverty. Overall, 17 studies, comprising 26,794 participants in Sub-Saharan Africa, Latin America, and South Asia, met the inclusion criteria of this review. Studies were critically appraised using Cochrane’s Risk of Bias tool and publication bias was tested using funnel plots, egger’s regression, and sensitivity analyses. The review was registered in PROSPERO (CRD42020186955). Meta-analysis showed that cash transfers significantly reduced depression and anxiety of recipients (dpooled = -0.10; 95%-CI: -0.15, -0.05; p<0.01). However, improvements may not be sustained 2–9 years after program cessation (dpooled = -0.05; 95%-CI: -0.14, 0.04; ns). Meta-regression indicates that impacts were larger for unconditional transfers (dpooled = -0.14; 95%-CI: -0.17, -0.10; p<0.01) than for conditional programs (dpooled = 0.10; 95%-CI: 0.07, 0.13; p<0.01). Effects on stress were insignificant and confidence intervals include both the possibility of meaningful reductions and small increases in stress (dpooled = -0.10; 95%-CI: -0.32, 0.12; ns). Overall, our findings suggest that cash transfers can play a role in alleviating depression and anxiety disorders. Yet, continued financial support may be necessary to enable longer-term improvements. Impacts are comparable in size to the effects of cash transfers on, e.g., children’s test scores and child labor. Our findings further raise caution about potential adverse effects of conditionality on mental health, although more evidence is needed to draw robust conclusions.
Citation: Wollburg C, Steinert JI, Reeves A, Nye E (2023) Do cash transfers alleviate common mental disorders in low- and middle-income countries? A systematic review and meta-analysis. PLoS ONE 18(2): e0281283. https://doi.org/10.1371/journal.pone.0281283
Editor: M. Harvey Brenner, University of North Texas Health Science Center, UNITED STATES
Received: January 9, 2021; Accepted: January 19, 2023; Published: February 22, 2023
Copyright: © 2023 Wollburg et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: JS was supported by the Joachim Herz Foundation (https://www.joachim-herz-stiftung.de/en/). AR received funding from the Wellcome Trust (220206/Z/20/Z, https://wellcome.org). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
1) Introduction
Common mental disorders are a critical public health issue, with more than 250 million people affected by anxiety and over 300 million people suffering from depression globally [1]. More than 80% of the global burden of common mental disorders, i.e. depression and anxiety disorders, falls on low- and middle-income countries (LMICs) [1]. People who live in poverty in LMICs are disproportionately affected by mental ill-health due to their exposure to risk factors, such as food insecurity, social exclusion, trauma and violence [2–8]. Poverty is further correlated with higher levels of stress and lower quality of life and psychosocial wellbeing [8,9]. The high prevalence of mental disorders is not only damaging in itself, but can contribute to the persistence of poverty through, e.g., lower productivity, stigmatization, higher health expenditures, and reduced self-control [8,10,11].
The association between poverty and mental health is not a spurious correlation, however, and several studies indicate that economic poverty causes and exacerbates psychological disorders [8,12]. Together, these studies support the social causation hypothesis, which states that living in conditions of poverty is connected to a multitude of severe stressors that increase vulnerability to mental disorders [6,10]. Accordingly, interventions that reduce monetary poverty may intervene on the social causation pathways and, thus, can help alleviate the burden of common mental disorders in targeted populations.
In this systematic review, therefore, we collate the causal evidence on the psychological impacts of one such intervention–the provision of cash transfers–to investigate whether monetary poverty alleviation can play a role in strengthening psychological health in LMICs.
Cash transfer programs (CTPs), which provide a financial safety net to people in poverty, are hypothesized to improve mental health outcomes by, e.g., reducing financial strain and instability, which has been linked to heightened stress and depressive symptoms in LMICs [3]. Cash transfers were also shown to facilitate social inclusion [4,13] and to improve physical health indicators [14–16], factors which have been linked to stress, anxiety and depressive symptoms in LMICs [3,6,17].
On the other hand, CTPs may adversely affect mental health, as they can aggravate social exclusion [18] and are sometimes associated with increased health risks, e.g. higher body mass index [19,20], thereby potentially increasing risks of mental ill-health. Finally, making CTPs conditional on certain behaviours can increase feelings of stress when conditions are overly demanding [21]. Conditionality may further exclude particularly vulnerable individuals, which could increase mental health inequalities [22,23].
As CTPs become a common component of social protection and poverty reduction in LMICs, it is important to better understand their effects on common mental disorders. In this systematic review and meta-analysis, we synthesize the evidence from randomized controlled trials on the mental health effects of CTPs in LMICs. Specifically, our main objectives are:
- To analyze the effects of CTPs on depression and anxiety in LMICs, compared to inactive control groups.
- To examine how CTPs impact recipients’ stress, compared to inactive control groups.
- To study whether unconditional and conditional CTPs differ in their effects on mental health.
- To study the long-term psychological effects of CTPs after program cessation.
To our knowledge, this is the most comprehensive systematic review and meta-analysis on the mental health effects of cash transfers. Three earlier reviews considered studies on cash transfers and common mental disorders [11,14,24] and found some encouraging effects on children’s cortisol levels and aggressive symptoms, and positive, but insignificant, effects on depression and anxiety of children and adults [25–28]. Yet, since relevant studies published over the last decade are not included, these reviews do not provide a timely, comprehensive overview of current evidence. Moreover, none of the earlier reviews conducted a meta-analysis to offer a quantitative summary of the results because of the limited number of available studies. Three recent papers have synthesized more current evidence. Ridley et al. (2020) conducted a literature review and meta-analysis of the psychological impacts of anti-poverty programs, including cash transfers [12]. Our review extends their work by using a systematic review methodology and comprehensive search strategy, which allowed us to retrieve additional relevant studies. Moreover, our review pushes the literature forward by providing a comparison of the impacts of conditional and unconditional cash transfers on mental health. Making the receipt of transfers conditional on requirements, such as regular school attendance of children and health-clinic visits, has been shown to increase effectiveness for those outcomes [14,29]. However, adding an element of conditionality may also lead to unintended consequences, such as increased stress among recipients [21] or adverse effects for those loosing eligibility [22]. As a result, conditionality might negatively affect psychological health and could exacerbate mental health inequalities. Understanding the psychological effects of conditionality has therefore important implications for CTPs as a social protection strategy.
Secondly, Zimmerman et al. (2021) published a systematic review and meta-analysis on the effects of cash transfers on mental health outcomes of children and young people [30]. Since Zimmerman and colleagues focus on children and adolescents, however, their analysis does not include many of the studies analyzed in this review.
Finally, McGuire et al. (2020) conducted a systematic review of quasi-experimental and experimental studies of CTPs and their effects on subjective wellbeing and mental health [31]. Our review complements their work in two ways. Firstly, we were able to retrieve additional grey literature papers [32–34]. In light of the likelihood of publication bias detected in this review (see section 3.6), this is an important addition and allows us to paint a more comprehensive picture of the effects. Moreover, we use an advanced meta-analytic method–robust variance estimation (RVE)–which corrects for dependency between effect sizes, thus producing more accurate estimations of the overall effect than other meta-analytic models [35]. Moreover, RVE allowed us to integrate all reported effect sizes, thus avoiding loss of information. This is highly relevant for the cash transfer literature as studies often analyze data from the same CTP or report multiple effect sizes per sample.
2) Methods
This review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-guidance [36].
2.1) Criteria for considering studies for this review
Table 1 provides an overview of the inclusion/exclusion criteria for this review, which are explained in more detail below.
Participants, context, and comparison.
This review focuses on people living in poverty, who are recipients of CTPs. Since mental health disorders persisting into adulthood tend to manifest in the ages 12–24 [37], both adults and adolescents, who are CTP recipients, are included. The indirect effects of CTPs on family members of recipients, e.g. children, are not the focus of this review. Participants in inactive control groups, who received no transfers or were enrolled at a later stage (waitlist control), served as comparison group. Active control groups receiving alternative interventions were not included, as this makes causal inference about the effects of CTPs difficult.
Intervention.
We included conditional and unconditional CTPs targeted at households living in poverty in LMICs. We did not apply an absolute low-income/poverty threshold but relied on the relative threshold for grant eligibility applied by the organizations administering CTPs. We included programs providing regular small transfers as well as one-time lump-sum payments. “Cash plus”-programs, which combine CTPs with complementary interventions, e.g. antidepressant treatment, were not included in the review, as it is difficult to disentangle the causal effects of CTPs on mental health. Moreover, other economic strengthening programs, such as microloans, are not included, as they may operate through different causal mechanisms.
Outcomes.
Our review focuses on common mental disorders, i.e. depressive and anxiety disorders [1], as well as stress. We focus on common mental disorders, as opposed to severe mental illnesses, such as schizophrenia, since socio-economic risk factors are of limited importance and, thus, CPTs may not readily impact more severe mental disorders [11,38]. Studies using validated surveys were included in this review, using e.g. the Center for Epidemiologic Studies Depression Scale, the General Health Questionnaire, or Cohen’s perceived stress scale. We included both post-intervention and follow-up measurements, as they can provide important insights into longer-term effects.
Study types.
Randomized controlled trials (RCT) and cluster-RCTs were included in this review. Due to the random allocation of participants/clusters into control and treatment units, these designs tend to ensure that known and unknown confounders are balanced between groups [39]. This reduces the risk of selection bias and allows for robust causal assumptions about the effectiveness of CTPs [39–41]. Qualitative or observational studies, which tend to have lower robustness in determining causality, were not included [39].
2.2) Search methods for identification of studies
We searched the following electronic databases covering relevant literature from Public Health, Psychology, Economics, and other Social Sciences: Web of Science (Clarivate), Scopus (Elsevier), MEDLINE (Ovid), EMBASE (Ovid), PsycINFO (Ovid), Global Health (Ovid), and Econlit (ProQuest). To avoid publication bias, we further conducted grey literature searches [42]. We hand-searched the 3ie evidence portal and J-PAL database of randomized evaluations to retrieve unpublished impact evaluations and the website of The Transfer Project, the Innovations for Poverty Action database, and Ideas/Repec [43]. The last search was conducted on 17 April 2020.
The search syntax used for the literature search can be found in S1 Appendix in S1 File. The search syntax as well as the selection of databases/websites was informed by relevant literature and systematic reviews [11,29,44], the Effective Practice and Organisation of Care (EPOC) collection of databases and search terms for LMICs [43,45], and input from the University’s librarian. We piloted the search terms in two databases and refined the syntax together with the librarian to achieve sufficient sensitivity [41]. No study-design filters were applied, since they tend to increase the risk of excluding relevant studies that do not use standardized methodological reporting [46]. Moreover, we included Medical Subject Heading (MeSh)-terms and used truncation and wildcards [41].
2.3) Data collection and analysis
Data extraction.
Using the online-tool Rayyan, CW removed duplicate articles and screened abstracts/titles of the remaining records [47]. To reduce bias in study selection [48], JS screened 10% of titles/abstracts, which were randomly selected by searching the first 17 studies of each letter of the alphabet (excluding Q, X, and Y). Reviewer agreement was high (408 of 427 double-screened studies) and discrepancies were resolved through discussion. 184 studies were included for full-text screening, 10% of which, selected through a random number generator, were again double-screened by a second reviewer. Conflicts (1 of 18 studies) were resolved through discussion.
Results and characteristics of included studies (participant and program characteristics, setting, outcome measurement, and methodological details) were extracted in Excel guided by the EPOC data extraction form [49].
Risk of bias.
When potential biases and study limitations are not taken into account, the results of systematic reviews can be misleading [50]. We therefore evaluated the risk of bias of included studies using the newly-updated Cochrane risk-of-bias tool (RoB-2). RoB-2 is a comprehensive analysis tool that covers biases arising due to the randomization process, deviations from intended interventions, missing outcome data, measurement of the outcome, and selection of reported results [51]. Unlike other tools, the RoB-2 employs explicit decision-making algorithms that facilitate a standardized RoB-assessment [51]. However, we decided not to apply an overall risk of bias rating per study determined by the most serious RoB, since this would inappropriately give equal weight to all domains and would not allow us to discriminate between studies with one and multiple high-risk domains [52]. Cluster-RCTs were assessed with the adapted RoB-2 for cluster-randomized trials [53], which includes an additional domain to address identification/recruitment bias that can arise in cluster-RCTs [54]. A second reviewer conducted RoB-assessments of a randomly-chosen 10% of included studies and came to the same overall RoB-judgments. Discrepancies in the answers to sub-questions per domain were resolved through discussion.
Meta-analysis.
Meta-analysis can increase confidence in intervention effects by aggregating information from several studies in different settings, yielding higher statistical power than individual studies, and highlighting potential inconsistencies between studies [50].
Traditional fixed-effect meta-analysis relies on the assumption that primary studies are statistically independent, and their effect sizes estimate the same ‘true’ population effect [35,55]. In the context of social intervention research, the assumptions of the traditional fixed-effect meta-analysis model are often violated [56]. We therefore extended the model in two ways. Firstly, our analysis relies on a random-effects model, which does not assume that all studies represent variations of the same intervention effect [41]. This is a more accurate model for our data, since included studies vary in program characteristics, target groups, and country context [55]. The random-effects model may be written as:
Where yj is the estimated effect in the jth study, uj represents the study-level random variation, and ej is the estimation error between the observed and ‘true’ effect for study j [56]. Thus, the model includes two sources of variation: between-studies (uj) and within-study (ej) [55].
We further adjusted the model for dependency within and between studies using robust variance estimation (RVE). RVE is an advanced meta-analytic technique that corrects standard errors of dependent effect sizes, thus producing more accurate estimations of the overall effect [35]. Studies in this review are dependent in two important ways: five trials analyze overlapping samples of the same CTP and, thus, their error terms are correlated [56]. Moreover, four trials report multiple relevant effect estimates, which are statistically dependent [35]. RVE has the advantage of accommodating both sources of dependency, which avoids loss of information as all relevant effect sizes can be included [56,57]. Moreover, RVE does not require accurate knowledge of the underlying covariance structures between effect sizes, as opposed to other meta-analytic models, e.g. multivariate meta-analysis (see [35] for demonstration). The RVE meta-analytic model used in this review may be written as:
Where yij is the ith effect size in the jth cash transfer program, β0 represents the average population effect, uj denotes the study-level random effect, and eij is the residual error term [56].
RVE was conducted in R (version 3.5.2) using the robumeta package [57]. We extracted effect estimates from primary studies and converted them into a common standardized effect size, Cohen’s d, using Wilson’s effect size calculator [58]. Inverse variance weights for correlated effects were used, so that more precise effect estimates contribute more to the overall estimate [41,56]. Following Tanner-Smith et al. (2016), we assumed a within-study/program correlation of rho = 0.8 and conducted sensitivity analyses for different rho-values. Adjustments for small sample sizes were applied and results are reported with 95%-confidence intervals [41,56]. All R code is provided in S4 Appendix in S1 File.
Meta-regression
To explore the relative effects of conditional vs unconditional CTPs, we conducted RVE meta-regression with a mixed-effects model so as to accommodate within-study and between-study variation. The meta-regression model can be written as:
Where the covariate β1, which represents a dummy variable specifying whether the CTP was conditional, is added to the RVE-model in above section [56]. Meta-regression was performed for depression and anxiety only, since all studies analyzing stress outcomes examined unconditional CTPs.
Assessment of heterogeneity.
A high variability across studies can produce misleading results, when it masks systematic differences between studies [46]. We therefore assessed heterogeneity using Tau2, which measures the between-study variance, and I2, which estimates the percentage of between-study variability that is a result of heterogeneity rather than random error [50]. Generally, heterogeneity is considered insubstantial for I2 up to 40%, moderate between 30%–60%, substantial between 50%–90%, and high between 75%–100% [50]. However, since meta-analysis with a small number of studies can lead to both under- and overestimation of heterogeneity, these categories are considered suggestive, not definite [59]. Finally, since heterogeneity estimates in RVE can be inaccurate [60], we conducted multilevel random-effects meta-analyses for all outcomes as an additional test of heterogeneity.
Publication bias.
Publication bias can lead to overestimation of effects in systematic reviews [61–64]. Where possible, we assessed publication bias using contour-enhanced funnel plots, which map effect sizes against standard errors [65]. Since this requires a minimum of ten studies per meta-analysis, we could only draw plots for depression and anxiety outcomes [65]. To guide the interpretation of funnel plots, we tested for significant asymmetry using Egger’s regression test [66]. It should be noted that funnel plot asymmetry may occur for reasons other than publication bias and traditional methods may not adequately account for effect size dependency [65,67]. We therefore conducted further analysis using the R package PublicationBias, which can be applied to data with dependent effect sizes and permits an assessment of the potential impact of different degrees of publication bias on results [68].
Confidence in the evidence.
We assessed the certainty in the body of evidence using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach [69]. GRADE ranks confidence in findings from high to very low based on risk of bias, effect consistency, imprecision, indirectness, and publication bias [42].
Robustness.
We tested the robustness of RVE-results to different within-study/program correlation coefficients [56] and conducted additional assessments of heterogeneity using multilevel meta-analysis (MLMA) [70]. The relatively small number of studies included in meta-analysis did not permit a sensitivity analysis based on risk of bias (RoB). Excluding high-risk studies from meta-analysis could have led to underpowered, and potentially misleading, results. Instead, the impact of RoB is accounted for using the GRADE approach.
2.4) Difference between review and protocol
A review protocol was registered with PROSPERO (registration number CRD42020186955) and the following modification was made to the pre-specified methodology: We originally intended to conduct additional meta-regression to assess the effects of RoB and explore heterogeneity along the lines of covariates such as age and gender. However, the number of retrieved studies did not allow for this additional analysis.
3) Results
3.1) Description of the studies
5,925 records were retrieved through electronic databases and 271 through searching grey literature websites. After removing duplicates, a total of 4,143 titles/abstracts was screened, of which 184 were included for full-text review. After assessing full texts for eligibility, 17 records were included and 167 studies excluded. 109 of these did not report relevant outcomes, but focused on e.g. subjective wellbeing, 25 studies were not an RCT/cluster-RCT, 17 trials were not a CTP according to the eligibility criteria of this review, and 10 studies focused on the wrong population, e.g. children. Six studies were ongoing trials, replications, or working paper versions of included studies, or did not report relevant outcomes. S2 Appendix in S1 File lists all full-text reviewed studies and reasons for exclusion. An overview of the search process is provided in Fig 1 [36].
3.1.1) Characteristics of included studies.
S3 Appendix in S1 File provides an overview of the characteristics of included studies, which are discussed in more detail below.
Study type and methods. All but three included studies were cluster-RCTs. Twelve studies were published in peer-reviewed journals, two studies were working papers [34,71], two were evaluation reports [33,72] and one record was a conference proceeding [32]. Almost all included studies reported effect sizes as regression coefficients (13/17), with four exceptions: Hjelm et al. (2017) calculated mean differences, and Kilburn et al. (2016), Pettifor, Wang et al. (2016), and Abdoulayi et al. (2017) reported binary proportions.
Setting. A large share of included trials was conducted in Sub-Saharan Africa (13/17), with four studies located in Malawi, four in Kenya, two in South Africa, and one each in Zambia, Mali, and Uganda. Three trials were run in Latin America (Nicaragua and Ecuador) and one in Bangladesh. With the exception of the Urban Microinsurance project [73], all trials were either conducted in rural areas (13 of 17 studies) or focused on both urban and rural households (3 of 17 studies).
Intervention. The 17 studies examined 13 different programs. More than half of the studies examined unconditional CTPs (10 studies), five looked at conditional programs (CCTs) and two studies compared the effects of conditional and unconditional transfers [21,72]. Conditions focused on school attendance (6 studies), health check-ups (2 studies), and/or the development of a business proposal (3 studies). Even in the absence of explicit conditionality, however, there was strong messaging around desired behaviors, i.e. investments in education and basic needs, in two studies [33,74] and in one study participants perceived transfers to be conditional even though they were not [75]. Conversely, in CCTs, conditions were not always strictly monitored [76,77].
Transfer values were equivalent varied between US$144 and US$1,525 over the length of the program, which is equivalent to approximately 9%–23% of participants monthly consumption (calculations based on 15 studies for which data was available, see S3 Appendix in S1 File for cash values per program). Most CTPs provided payments on a monthly or bimonthly basis over a period of nine months to four years. Three programs delivered one-time lump sums: GiveDirectly’s CTP, Uganda’s Youth Opportunity Program, and the Nairobi Urban Microinsurance Project.
Participants and comparison groups. Overall, the studies included 26,794 participants, with a sample size for relevant outcomes between 487 and 16,133 participants. Transfers were targeted to low-income and/or deprived communities, as indicated by, e.g., low monthly household expenditure and consumptions [34,75,76,78–80], inability to meet basic needs [33,74], food insecurity [75,81], low educational attainment and high HIV risk [21,72]. Beneficiaries were predominantly female, with eight studies targeting women/mostly women. Six studies included mixed gender samples and two studies measured mental health outcomes of male partners of female beneficiaries. More than half of the trials assessed adult mental health (13 studies), eight studies included young adults and adolescents in the ages of 13–24. Two programs–the Malawi Social Cash Transfer Program and the HIV Prevention Trials Network study–provided cash allowances to households with comorbidities, e.g. HIV and disabilities. As per inclusion criteria of this review, control groups received no transfers (11 studies) or entered the program at a later stage (6 studies). Typically, control groups lived in geographically separated villages/communes, although three studies also included ‘spillover controls’, i.e. households living in treatment villages but not receiving transfers [21,71,82].
Outcomes. 13 studies measured depression, using the 10-item or 20-item Center for Epidemiologic Studies Depression Scale (CES-D), the 9-item Patient Health Questionnaire (PHQ-9), and/or the 10-item Children’s Depression Index (CDI). Two studies measured anxiety and depressive symptoms using the 12-item General Health Questionnaire (GHQ-12), and one study assessed anxiety using the Revised Children’s Manifest Anxiety Scale (CMAS). Stress was measured in 11 studies, ten of which employed the 4-item or 14-item Cohen’s Perceived Stress Scale (PSS). Hjelm et al. (2017) used the six negatively-worded items of Cohen’s PSS, since they showed higher internal reliability.
Most studies provided post-intervention measurements (13 studies), and five studies included follow-ups at 2, 4 or 9 years after the end of the program. Data collection occurred mostly in private interviews with enumerators of the same sex or through computer/audio-assisted self-interviews (8 studies).
Funding. All articles disclosed sources of research funding. In 12 trials, there was partial overlap between research and program funders, which potentially introduces funding bias, i.e. reporting of results that favor the interests of funders [83,84]. Although funding bias cannot be ruled out, note that 4 out of 5 independently-funded studies reported positive results, vis-à-vis 5 out of 12 studies with overlap between research and program funders.
3.2) Risk of bias in included studies
As shown in Fig 2 [85], six included studies were at high risk of bias in at least one domain. This was due to significant baseline imbalances, which likely affected mental health outcomes [78], selection bias or differential attrition that was not corrected for [34,72,78] and missing information about loss to follow-up [32]. Two studies received a high RoB-rating due to selective outcome reporting: Macours and Vakis (2014) reported depression outcomes only for one treatment arm; Paxson and Schady (2010) did not find positive effects for urban households, possibly due to implementation failure, and subsequently excluded these from the analysis. All studies used validated self-report questionnaires to measure mental health outcomes. Since participants and personnel are aware of treatment status, this could potentially influence the results, e.g. due to social desirability bias or interviewer effects [86]. Thus, following Higgins et al. (2019), all included studies are judged as raising some concerns. Moreover, eight studies raised some concerns of bias because no protocol was available or reported outcomes had not been pre-specified.
3.3) Effects of the intervention
Depression and anxiety.
11 studies reported depression outcomes, using CES-D, PHQ-9 and CDI-questionnaires, one study measured anxiety using the CMAS-questionnaire, and two studies measured common mental disorders, including depressive/anxiety symptoms, using the GHQ-12. Since CES-D, PHQ, and GHQ-measures have considerable overlap and exhibit similar response patters [87], it was concluded that anxiety and depression represent overlapping constructs. For instance, GHQ-12, CES-D and PHQ-9 all include items on sleep disturbances, feelings of depression, self-worth, or ability to concentrate [88–90]. Thus, anxiety and depression outcomes were meta-analyzed jointly.
Outcomes were grouped into two timepoints: post-intervention effects, which are measured when the program is still ongoing or has recently ended, and follow-up effects, representing outcomes measured 2–9 years after program cessation.
11 studies covering eight CTPs measured depression/anxiety post-intervention. The study by Roy et al. (2019) was not included as it only reported aggregated measures of mental health. Meta-analysis shows a significant positive, but small, effect on depression and anxiety (dpooled = -0.102; 95%-CI: -0.151, -0.0526; p<0.01). The between-study variance is Tau2 = 0.0035, and the non-random across-study variation is I2 = 50.11%, which indicates moderate to substantial heterogeneity. Note, however, that MLMA-estimates for heterogeneity are much smaller (I2 = 15%), although statistically significant. Fig 3 illustrates that while most effects represent improvements, they tend to be small and a few confidence intervals cross zero, representing non-significant effects.
Notes: RVE correlated effects model with small-sample corrections. Robust standard errors adjusted at program-level. Outcomes are coded so that negative Cohen’s d-values indicate improvements. Diamond and dashed line display overall estimate of dpooled = -0.102, width of diamond represents 95%-CI [-0.15,-0.05].
Meta-analysis for follow-up measurements comprises five studies. RVE-estimates fail to reach significance, indicating that small improvements post-intervention may not last after program cessation (dpooled = -0.0508; 95%-CI: -0.139, 0.0374; ns). However, since the degrees of freedom are below 4, indicating low power, dpooled should be interpreted with caution. Fig 4 illustrates that effect sizes are small and several cross the line-of-no-effect. Heterogeneity is relatively low with I2 = 12.15% and Tau2 = 0.000412, although meta-analysis with a small number of studies may not yield accurate heterogeneity-estimates [59].
Notes: RVE correlated effects model with small-sample corrections. Robust standard errors adjusted at program-level. Outcomes are coded so that negative Cohen’s d-values indicate improvements. Diamond and dashed line display overall estimate of dpooled = -0.0508, width of diamond represents 95%-CI [-0.14, 0.04].
Perceived stress.
Ten studies, which reported impacts of CTPs on recipients’ stress were meta-analyzed, nine of which used Cohen’s PSS, and one used all negatively-worded items of the PSS [75]. As for the analyses above, we partitioned outcomes into post-intervention effects and follow-up measurements, which were reported by two studies, 2 and 9 years after program cessation.
Seven studies, analyzing eight programs, measured recipients’ stress post-intervention. RVE meta-analysis finds insignificant results with wide confidence intervals, including both the possibility of a negligible increase and small decrease in stress (dpooled = -0.102; 95%-CI: -0.321, 0.117; ns). Moreover, heterogeneity is considerable, with non-random across-study variability of I2 = 94.03% and a Tau2 value of 0.051856. Thus, dpooled may be misleading and should be cautiously interpreted. Fig 5 illustrates these varied effects, with some studies reporting significant, small increases in stress [28] and others finding small to moderate stress reductions [74,82].
Notes: RVE correlated effects model with small-sample corrections. Robust standard errors adjusted at program-level. Outcomes are coded so that negative Cohen’s d-values indicate improvements. Diamond and dashed line display overall estimate of dpooled = -0.102, width of diamond represents 95%-CI [-0.32, 0.12].
Due to the small number of studies reporting follow-up data on perceived stress, no meta-analysis was conducted. Haushofer and Shapiro (2018) find that the moderate improvements in recipients’ stress levels post-intervention, greatly decreased one year later (d = -0.12, 95%-CI: -0.22, -0.02). Blattman, Fiala and Martinez (2018) obtain insignificant effects 9 years after participants received a cash grant of approximately $400/recipient (d = -0.02, 95%-CI: -0.11, 0.07). Similar to depression/anxiety outcomes, this may indicate that CTPs do not impact stress in the longer-term. Table 2 provides an overview of RVE-results for all three meta-analysis.
3.4) Meta-regression
Table 3 displays the results for meta-regression, which assesses whether effects differ for conditional and unconditional programs. Meta-regression was performed for depression/anxiety outcomes only, since too few studies reported recipients’ stress. To increase power, both post-intervention and follow-up measurements are included. Nonetheless, with 13 studies and 22 effect sizes, meta-regression is still relatively underpowered, as illustrated by the low df-values, and should therefore be interpreted as exploratory only. The results indicate that there are small improvements in depression/anxiety outcomes in UCT-programs, which are larger than the effects of unconditional and conditional programs combined (dpooled = -0.14; 95%-CI: -0.17, -0.10; p<0.01). The CCT-estimate suggests that adding conditionality may decrease positive effects on depression and anxiety (dpooled = 0.10; 95%-CI: 0.07, 0.13; p<0.01). Heterogeneity was reduced to I2 = 0.00%, although I-squared values may not be accurate due to the small number of studies analyzed [59].
3.5) Robustness
All meta-analyses were robust to different rho-values (S5 Appendix in S1 File). Conducting MLMA produced similarly small improvements in depression/anxiety post-intervention and null-results with wide confidence intervals for perceived stress (Table 4). For depression/anxiety at follow-up, however, MLMA revealed very small significant effects, indicating that low power in the RVE-analysis may have prevented the detection of significant results. Estimates for I-squared were lower than RVE-estimates, with small between study heterogeneity for depression/anxiety at both post-intervention (I2 = 11.49%) and follow-up (I2 = 0.00%), but considerable heterogeneity for stress (I2 = 85.74%). In line with these results, tests for heterogeneity were significant for both depression/anxiety and stress post-intervention, but insignificant for depression/anxiety at follow-up.
3.6) Publication bias
Fig 6 displays the contour-enhanced funnel plot for depression/anxiety post-intervention. The plot shows some asymmetry, with studies missing in areas where effects would be insignificant (white area) and favor the control rather than the intervention (right-hand side). This indicates that publication bias is plausible [65], although Egger’s regression test shows no significant asymmetry (z = -0.7849, p = 0.4325). Further analysis following Mathur and Vanderweele (2019) suggests that results are relatively robust to different levels of publication bias. Assuming a 40% higher likelihood of positive findings to be published [63], meta-analysis estimates remain significant at the 5%-level (p = 0.044), although the pooled estimate would be much smaller (d = -0.036, 95%-CI: -0.07, -0.002).
4) Discussion
4.1) Discussion of the main results and confidence in the evidence
Can cash transfers play a role in alleviating common mental disorders in LMICs? This systematic review summarized the evidence on the effects of CTPs on stress, anxiety, and depressive symptoms in adults and adolescents who live in poverty. Meta-analysis of 11 studies and pooling data from 22,488 participants shows that cash grants significantly improve depression and anxiety post-intervention. Following GRADE-criteria, the overall confidence is judged to be moderate, due to some indication of publication bias and since meta-analyzed trials carried intermediate to high risk of bias. The magnitude of the effect is comparable to meta-analysis on other distal outcomes in the cash transfer literature, e.g. on child labor [91] and test scores [29]. Moreover, our effect sizes are similar to those found by Ridley et al. [12] and McGuire et al. [31], who also report significant positive impacts on common mental disorders. Zimmerman et al. [35], on the other hand, find positive, but much smaller and insignificant aggregate effects on depressive symptoms in children and young people. The authors note, however, that the validity of the pooled effect size is limited due to substantial heterogeneity.
The effects of CTPs on stress are less clear. Meta-analysis of seven studies and 19,071 recipients yielded non-significant results with wide confidence intervals including the possibility of both meaningful reductions and small increases in stress. Due to high heterogeneity and imprecision, the overall confidence is judged to be very low, and, thus, the pooled estimate may not be informative with regard to the actual effects of CTPs on stress [42]. The limited number of retrieved studies precluded further investigation of the reasons for the heterogenous results.
After program cessation, no statistically significant impact on depression and anxiety was found, although meta-analysis was underpowered, which could have prevented the detection of a significant effect. Conclusions about long-term effects are further complicated by difficulties inherent to follow-up studies, e.g. due to high attrition and mobility of participants [92]. In light of low power, relatively wide confidence intervals, and since publication bias could not be assessed, the overall certainty in depression/anxiety outcomes at follow-up was rated as low, meaning that further research may substantially change the pooled estimate of this meta-analysis [69].
There is some indication that stress effects also fade after program cessation, with two studies finding small impacts two years [71] and null-results nine years [93] after completion of the CTP.
Table 5 provides an overview of the GRADE assessment.
4.2) Implications for research and practice
This review contributes to the emergent literature on the links between income increases, poverty alleviation, and mental health. Its findings align with evidence from high-income countries suggesting a causal effect of positive income shocks on mental health [94–97]. Moreover, the small improvements in depression/anxiety symptoms lend some weight to the hypothesis that poverty reduction strengthens psychological health. Hence, intervening on the social causation pathway, by improving the economic circumstances of individuals, can play a role in addressing the poverty-mental health cycle in LMICs [11].
Furthermore, our findings have important implications for cash transfers as a social protection strategy: providing ongoing financial support to people living in poverty not only improves poverty indicators and school attendance, for example, but also meaningfully impacts depression and anxiety outcomes of beneficiaries. However, there is some indication that potential positive effects may not persist after program cessation. Thus, continued financial support may be necessary to allow for longer-term improvements. Importantly, we did not find evidence of adverse effects on depression or anxiety, with almost all studies showing either positive or null-results on average. However, meta-regression indicates that conditionality diminishes the positive effects of cash transfers on mental health. This could introduce trade-offs between the negative impact observed in this review and the favorable effects of conditionality found on, for instance, school attendance [29] and health-clinic visits [14].
It is important to note, however, that due to the limited number of studies, further research is needed to equip practitioners and policymakers with a better understanding of the role of conditionality for mental health. Such studies could further analyze the potential of soft conditionality in the form of labelling and messaging, which may suffice to achieve desired goals without putting as much strain on participants [98,99].
4.3) Limitations and potential biases in the review process
In line with Shea et al. (2017), several steps were undertaken to reduce the risk of bias in this review, such as pre-specifying methods in a published protocol, including MeSh-terms and truncation in the search syntax, adopting a dual-reviewer approach, and searching grey literature websites. Moreover, we used an innovative meta-analytic method to account for statistical dependency between studies and conducted several robustness tests to confirm the accuracy of our estimates.
Nonetheless, the review is subject to a number of limitations. First, although restricting eligibility to randomized trials increases confidence in causal effects, there are important shortcomings of RCT designs. Smaller-scale, controlled experiments have limited generalizability to larger contexts, due to, e.g., unanticipated equilibrium-effects or implementation challenges at scale [100–103]. Moreover, RCTs are typically uninformative with regard to causal mechanisms underlying observed effects, interactions with contextual factors, and differential effects on subgroups, which may not benefit or even be harmed by an intervention [101,104,105]. Although we were able to explore the role of one potential mechanism–conditionality–the limitations of RCTs also apply to this review. As more trials become available, hypotheses about causal mechanisms and subgroup effects, e.g. along the lines of gender and age, should be investigated using meta-regression. Furthermore, additional analysis of quasi-experimental research and longitudinal studies may improve estimates of the effects of CTPs at larger scale.
Second, meta-regression results are limited by low power as well as problems of confounding inherent to this type of analysis [106,107]. UCTs and CCTs may differ in important ways beyond the element of conditionality, introducing the possibility that unknown confounders are responsible for the observed difference. Moreover, treating conditionality as binary variable may neglect more nuanced cases, e.g. when strong messaging in UCTs acts as quasi-conditionality or conditions are not enforced in CCT-programs [29]. This is especially relevant since studies included in this review did not always monitor conditions, one UCT was perceived as conditional, and there was messaging and labelling in UCT trials. Thus, the results should be interpreted as exploratory. Further research may provide more robust evidence on the role of conditionality for mental health.
Third, as expected for a review spanning different countries, programs, and participant groups, heterogeneity was moderate to substantial in two of the conducted meta-analyses. While meta-regression identified conditionality as one significant source of heterogeneity for depression/anxiety outcomes, the limited number of studies did not allow us to include additional covariates in our meta-regression model to further explore variability, particularly for stress outcomes. Nonetheless, we concur with the view that there is value in conducting and reporting meta-analysis, even when heterogeneity is high, as it can highlight inconsistencies and aid narrative synthesis that may otherwise produce misleading results [108].
Fourth, since included studies relied on self-reported outcomes, they potentially overestimate treatment effects when participants reported improvements due to social desirability and/or interviewer effects [109]. Conversely, self-reports may have led to underreporting due to the stigma attached to mental disorders in LMICs [37]. In light of the difficulties of objectively measuring CMDs, the included trials may be the best currently available evidence on the causal effects of cash transfers on mental health. To mitigate potential biases, future research should adopt strategies to assess and reduce social desirability bias [109], as applied, for instance, by Roy et al. (2019).
Finally, regarding the generalizability of findings beyond included studies, the following limitations should be noted. With the exception of three studies, most trials were conducted in Sub-Saharan Africa, which reduces applicability to other regions and LMICs. Moreover, most studies focused on rural settings and, thus, their findings may not readily apply to urban areas, which are connected to distinct risk/protective factors for mental health [10]. Moreover, extrapolation of research findings typically requires evidence beyond intervention effectiveness, such as insights into mechanisms, implementation, and contextual factors [110–112], the provision of which is beyond the scope of this review.
5) Conclusion
Our findings lend weight to the hypothesis that poverty alleviation can play a role in strengthening psychological health of people living in poverty in LMICs. In particular, our analysis shows that providing populations living in poverty with cash transfers leads to improvements of depression and anxiety disorders. However, these benefits may not be sustained once the financial support ends. The findings also indicate that conditionality might diminish the positive mental health effects. Policies aiming to address the poverty-mental health cycle should therefore consider unconditional, longer-term support to populations living in poverty. No firm conclusions can be drawn regarding the effects of CTPs on recipients’ stress. Thus, more research is needed to furnish the analysis of stress outcomes, the long-term effects after program cessation and the comparison between conditional and unconditional CTPs.
References
- 1.
WHO. Depression and Other Common Mental Disorders: Global Health Estimates. Geneva: World Health Organization; 2017.
- 2. Lund C, Cois A. Simultaneous social causation and social drift: Longitudinal analysis of depression and poverty in South Africa. J Affect Disord 11Internet]. 2018;229:396–402. Available from: pmid:29331699
- 3. Hamad R, Fernald L, Karlan DS, Zinman J. Social and economic correlates of depressive symptoms and perceived stress in South African adults. J Epidemiol Community Health. 2008;62(6):538–44. pmid:18477753
- 4. Fleischer NL, Fernald L, Hubbard AE. Depressive symptoms in low-income women in rural Mexico. Epidemiology. 2007;18(6):678–85. pmid:18049184
- 5.
Patel V, Lund C, Hatherill S, Plagerson S, Corrigall J, Funk M, et al. Mental disorders: equity and social determinants. In: Equity, social determinants of health and public health programmes. Geneva: World Health Organisation; 2009. p. 115–34.
- 6. Lund C, Breen A, Flisher AJ, Kakuma R, Corrigall J, Joska JA, et al. Poverty and common mental disorders in low and middle income countries: A systematic review. Soc Sci Med. 2010;71(3):517–28. pmid:20621748
- 7. Patel V, Kleinman A. Poverty and common mental disorders in developing countries. Bull World Health Organ. 2003;81(8):609–15. pmid:14576893
- 8. Haushofer J, Fehr E. On the psychology of poverty. Science (80-). 2014;344(6186):862–7. pmid:24855262
- 9. Chemin M, de Laat J, Haushofer J. Negative Rainfall Shocks Increase Levels of the Stress Hormone Cortisol Among Poor Farmers in Kenya. SSRN Electron J. 2013.
- 10. Lund C, Brooke-Sumner C, Baingana F, Baron EC, Breuer E, Chandra P, et al. Social determinants of mental disorders and the Sustainable Development Goals: a systematic review of reviews. The Lancet Psychiatry. 2018;5(4):357–69. pmid:29580610
- 11. Lund C, De Silva M, Plagerson S, Cooper S, Chisholm D, Das J, et al. Poverty and mental disorders: Breaking the cycle in low-income and middle-income countries. Lancet [Internet]. 2011;378(9801):1502–14. Available from: pmid:22008425
- 12. Ridley M, Rao G, Schilbach F, Patel V. Poverty, depression, and anxiety: Causal evidence and mechanisms. Science (80-). 2020;370(6522):eaay0214. pmid:33303583
- 13. Drucza K. Cash Transfers in Nepal: Do They Contribute to Social Inclusion? Oxford Dev Stud [Internet]. 2016;44(1):49–69. Available from: https://search.proquest.com/docview/1786123583?accountid=13042.
- 14. Gaarder MM, Glassman A, Todd JE. Conditional cash transfers and health: unpacking the causal chain. J Dev Eff. 2010;2(50):6–50.
- 15. Lagarde M, Haines A, Palmer N. Conditional cash transfers for improving uptake of health interventions in low- and middle-income countries: A systematic review. J Am Med Assoc. 2007;298(16):1900–10. pmid:17954541
- 16. Bastagli F, Hagen-Zanker J, Harman L, Barca V, Sturge G, Schmidt T, et al. Cash transfers: what does the evidence say? A rigorous review of programme impact and of the role of design and implementation features. ODI Rep [Internet]. 2016;1–300. Available from: https://www.odi.org/sites/odi.org.uk/files/resource-documents/10749.pdf.
- 17. Ohrnberger J, Anselmi L, Fichera E, Sutton M. The effect of cash transfers on mental health: Opening the black box—A study from South Africa. Soc Sci Med. 2020;260(113181). pmid:32688162
- 18. Plagerson S, Patel V, Harpham T, Kielmann K, Mathee A. Does money matter for mental health? Evidence from the Child Support Grants in Johannesburg, South Africa. Glob Public Health [Internet]. 2011;6(7):760–76. Available from: http://www.tandfonline.com/doi/abs/10.1080/17441692.2010.516267. pmid:20938853
- 19. Fernald L, Gertler P, Hou X. Cash Component of Conditional Cash Transfer Program Is Associated with Higher Body Mass Index and Blood Pressure in Adults. J Nutr. 2008;138(11):2250–2257. pmid:18936227
- 20. Forde I, Chandola T, Garcia S, Marmot MG, Attanasio O. The impact of cash transfers to poor women in Colombia on BMI and obesity: Prospective cohort study. Int J Obes. 2012;36(9):1209–14. pmid:22143619
- 21. Baird S, de Hoop J, Özler B. Income shocks and adolescent mental health. J Hum Resour. 2013;48(2):370–403.
- 22. Baird S, Chirwa E, de Hoop J, Özler B. Girl Power: Cash Transfers and Adolescent Welfare. Evidence from a Cluster-Randomized Experiment in Malawi [Internet]. NBER Working Paper Series. National Bureau of Economic Research, Inc, NBER Working Papers: 19479; 2013. Report No.: 19479. Available from: https://search.proquest.com/docview/1496900153?accountid=13042.
- 23. Lorenc T, Petticrew M, Welch V, Tugwell P. What types of interventions generate inequalities? Evidence from systematic reviews. J Epidemiol Community Health. 2013;67(2):190–3. pmid:22875078
- 24. Glassman A, Duran D, Fleisher L, Singer D, Sturke R, Angeles G, et al. Impact of conditional cash transfers on maternal and newborn health. J Heal Popul Nutr. 2013;31(4 Suppl 2):S48–S66.
- 25. Fernald L, Gertler PJ, Neufeld LM. Role of cash in conditional cash transfer programmes for child health, growth, and development: an analysis of Mexico’s Oportunidades. Lancet. 2008;371(9615):828–37. pmid:18328930
- 26. Fernald L, Gunnar MR. Poverty-alleviation program participation and salivary cortisol in very low-income children. Soc Sci Med [Internet]. 2009;68(12):2180–9. Available from: http://www.sciencedirect.com/science/journal/02779536. pmid:19406546
- 27. Ozer E, Fernald L, Manley JG, Gertler PJ. Effects of a conditional cash transfer program on children’s behavior problems. Pediatrics [Internet]. 2009;123(4):630–7. Available from: http://pediatrics.aappublications.org. pmid:19336354
- 28. Paxson C, Schady N. Does Money Matter? The Effects of Cash Transfers on Child Development in Rural Ecuador. Econ Dev Cult Change. 2010;59(1):187–229. pmid:20821896
- 29. Baird S, Ferreira FHG, Özler B, Woolcock M. Relative Effectiveness of Conditional and Unconditional Cash Transfers for Schooling Outcomes in Developing Countries: A Systematic Review. Campbell Syst Rev. 2013;9(1):1–124.
- 30. Zimmerman A, Garman E, Avendano-Pabon M, Araya R, Evans-Lacko S, McDaid D, et al. The impact of cash transfers on mental health in children and young people in low-income and middle-income countries: A systematic review and meta-analysis. BMJ Glob Heal. 2021;6(4):1–16. pmid:33906845
- 31. McGuire J, Kaiser C, Bach-Mortensen A. The impact of cash transfers on subjective well-being and mental health in low- and middle- income countries: A systematic review and meta-analysis [Internet]. 2020. Available from: https://osf.io/preprints/socarxiv/ydr54/.
- 32. Pettifor A, Wang J, Selin A, Hughes J, Gomez-Olive X, Wagner R, et al. The impact of a cash transfer on young South African women’s on mental health: HPTN 068. In: AIDS Conference. Durban, South Africa; 2016.
- 33. Abdoulayi S, Angeles G, Zietz S, Barrington C, Brugh K, Handa S, et al. Evaluating the effectiveness of an unconditional social cash transfer programme for the ultra poor in Malawi [Internet]. 3ie Grantee Final Report. New Delhi; 2017. Available from: https://www.3ieimpact.org/sites/default/files/2018-08/GranteeFinalReportTW1.1015.pdf.
- 34. Roy S, Hidrobo M, Hoddinott J, Koch B, Ahmed A. Can transfers and behavior change communication reduce intimate partner violence four years post-program? Experimental evidence from Bangladesh. [Internet]. IFPRI—Discussion Papers. Washington; 2019. Report No.: 01869. Available from: http://ebrary.ifpri.org/utils/getfile/collection/p15738coll2/id/133421/filename/133632.pdf.
- 35. Hedges L V., Tipton E, Johnson MC. Robust variance estimation in meta-regression with dependent effect size estimates. Res Synth Methods. 2010;1:39–65. pmid:26056092
- 36. Moher D, Liberati A, Tetzlaff J, Altman D. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009;6(7).
- 37. Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet. 2007;369(9569):1302–13. pmid:17434406
- 38. Saraceno B, Levav I, Kohn R. The public mental health significance of research on socio-economic factors in schizophrenia and major depression. World Psychiatry. 2005;4(3):181–5. pmid:16633546
- 39.
Duflo E, Glennerster R, Kremer M. Using Randomization in Development Economics Research: A Toolkit. In: Schultz TP, Strauss JA, editors. Handbook of Development Economics. Elsevier; 2007. p. 3895–962.
- 40.
Solomon P, Cavanaugh MM, Draine J. Randomized Controlled Trials: Design and Implementation for Community-Based Psychosocial Interventions. Oxford: Oxford University Press; 2009. 1–224 p.
- 41. Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions version 6.0 [Internet]. Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page M, et al., editors. Cochrane Collaboration; 2019. Available from: www.training.cochrane.org/handbook.
- 42. Schünemann H, Brożek J, Guyatt G, Oxman A, editors. Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach [Internet]. The GRADE Working Group; 2013 [cited 2020 Apr 11]. Available from: www.guideline development.org/handbook.
- 43. EPOC. A collection of Databases, Websites and Journals relevant to Low- and Middle-Income Countries, Cochrane Effective Practice and Organisation of Care Group [Internet]. 2013 [cited 2020 Apr 18]. Available from: https://epoc.cochrane.org/lmic-databases.
- 44. Harman L, Bastagli F, Hagen-Zanker J, Sturge G, Barca V. Cash transfers: what does the evidence say? Annexes. Overseas Dev Inst [Internet]. 2016;(July):1–152. Available from: www.odi.org/twitter.
- 45. EPOC. LMIC Filters, Cochrane Effective Practice and Organisation of Care Group [Internet]. 2012 [cited 2020 Mar 21]. Available from: https://epoc.cochrane.org/lmic-filters.
- 46.
Petticrew M, Roberts H. Systematic Reviews in the Social Sciences: A Practical Guide. Oxford: Blackwell Publishing Ltd; 2008.
- 47. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(210). pmid:27919275
- 48. Stoll CRT, Izadi S, Fowler S, Green P, Suls J, Colditz GA. The value of a second reviewer for study selection in systematic reviews. Res Synth Methods. 2019;10(4):539–45. pmid:31272125
- 49. EPOC. Data Collection Checklist Cochrane Effective Practice and Organisation of Care Group. 2002.
- 50. Deeks JJ, Higgins JPT, Altman DG. Chapter 10: Analysing data and undertaking meta-analyses. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions version 60 [Internet]. Cochrane Collaboration; 2019. Available from: https://training.cochrane.org/handbook/current/chapter-10.
- 51. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. Br Med J. 2019;366(l4898). pmid:31462531
- 52. Bero L, Chartres N, Diong J, Fabbri A, Ghersi D, Lam J, et al. The risk of bias in observational studies of exposures (ROBINS-E) tool: Concerns arising from application to observational studies of exposures. Syst Rev. 2018;7(1):1–11.
- 53. Eldridge S, Campbell M, Campbell M, Dahota A, Giraudeau B, Higgins JPT, et al. Revised Cochrane risk of bias tool for randomized trials (RoB 2.0): Additional considerations for cluster randomized trials. Guidance Document. 2016.
- 54. Hahn S, Puffer S, Torgerson DJ, Watson J. Methodological Bias in Cluster Randomised Trials. BMC Med Res Methodol. 2005;5(10). pmid:15743523
- 55. Borenstein M, Hedges L V., Higgins JPT, Rothstein HR. A basic introduction to fixed-effect and random-effects models for meta-analysis. Res Synth Methods. 2010;1(2):97–111. pmid:26061376
- 56. Tanner-Smith EE, Tipton E, Polanin JR. Handling Complex Meta-analytic Data Structures Using Robust Variance Estimates: a Tutorial in R. J Dev Life-Course Criminol. 2016;2(1):85–112.
- 57. Fisher Z, Tipton E. robumeta: An R-package for robust variance estimation in meta-analysis. 2015; Available from: http://arxiv.org/abs/1503.02220.
- 58. Wilson DB. Practical Meta-Analysis Effect Size Calculator [Internet]. Campbell Collaboration. 2014. Available from: https://www.campbellcollaboration.org/escalc/html/EffectSizeCalculator-Home.php
- 59. Von Hippel PT. The heterogeneity statistic I2 can be biased in small meta-analyses. BMC Med Res Methodol. 2015;15(1):1–8. pmid:25880989
- 60. Moeyaert M, Ugille M, Natasha Beretvas S, Ferron J, Bunuan R, Van den Noortgate W. Methods for dealing with multiple outcomes in meta-analysis: a comparison between averaging effect sizes, robust variance estimation and multilevel meta-analysis. Int J Soc Res Methodol. 2017;20(6):559–72.
- 61. Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B. Evidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: Review of studies in new drug applications. Br Med J. 2003;326(7400):1171–3.
- 62. Joober R, Schmitz N, Annable L, Boksa P. Publication bias: What are the challenges and can they be overcome? J Psychiatry Neurosci. 2012;37(3):149–152. pmid:22515987
- 63. Franco A, Malhotra N, Simonovits G. Publication bias in the social sciences: Unlocking the file drawer. Science (80-). 2014;345(6203):1502–5.
- 64. Onishi A, Furukawa TA. Publication bias is underreported in systematic reviews published in high-impact-factor journals: Metaepidemiologic study. J Clin Epidemiol [Internet]. 2014;67(12):1320–6. Available from: pmid:25194857
- 65. Page MJ, Higgins JPT, Sterne JAC. Chapter 13: Assessing risk of bias due to missing results in a synthesis. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions version 60 [Internet]. Cochrane Collaboration; 2019. Available from: https://training.cochrane.org/handbook/current/chapter-13.
- 66. Pustejovsky JE, Rodgers MA. Testing for funnel plot asymmetry of standardized mean differences. Res Synth Methods. 2019;10(1):57–71. pmid:30506832
- 67. Rodgers MA, Pustejovsky JE. Evaluating meta-analytic methods to detect selective reporting in the presence of dependent effect sizes. MetaArxiv [Internet]. 2019;1–25. Available from: https://osf.io/preprints/metaarxiv/vqp8u/.
- 68. Mathur MB, Vanderweele TJ. Sensitivity Analysis for Publication Bias in Meta-Analyses. 2019.
- 69. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94. pmid:21195583
- 70. Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw [Internet]. 2010;36(3):1–48. Available from: https://www.jstatsoft.org/v036/i03.
- 71. Haushofer J, Shapiro J. The Long-Term Impact of Unconditional Cash Transfers: Experimental Evidence from Kenya. Mimeo. 2018.
- 72. Baird S, Chirwa E, McIntosh C, Özler B. What happens once the intervention ends? The medium-term impacts of a cash transfer programme in Malawi. 3ie Impact Eval Rep [Internet]. 2015;27. Available from: https://www.3ieimpact.org/evidence-hub/publications/impact-evaluations/what-happens-once-intervention-ends-medium-term.
- 73. Haushofer J, Chemin M, Jang C, Abraham J. Economic and psychological effects of health insurance and cash transfers: Evidence from a randomized experiment in Kenya. J Dev Econ. 2020;144(102416).
- 74. Angeles G, de Hoop J, Handa S, Kilburn K, Milazzo A, Peterman A, et al. Government of Malawi’s unconditional cash transfer improves youth mental health. Soc Sci Med. 2019 Mar 1;225:108–19. pmid:30826585
- 75. Hjelm L, Handa S, de Hoop J, Palermo T. Poverty and perceived stress: evidence from two unconditional cash transfer programs in Zambia. Soc Sci Med [Internet]. 2017;177:110–7. Available from: http://www.sciencedirect.com/science/journal/02779536. pmid:28167339
- 76. Macours K, Schady N, Vakis R. Cash Transfers, Behavioral Changes, and the Cognitive Development of Young Children: Evidence from a Randomized Experiment. Am Econ J Appl Econ. 2012;4(2):247–273.
- 77. Macours K, Vakis R. Changing households’ investment behaviour through social interactions with local leaders: Evidence from a randomised transfer programme. Econ J. 2014;124(576):607–33.
- 78. Kilburn K, Thirumurthy H, Halpern CT, Pettifor A, Handa S. Effects of a large-scale unconditional cash transfer program on mental health outcomes of young people in Kenya. J Adolesc Heal [Internet]. 2016;58(2):223–9. Available from: http://www.sciencedirect.com/science/article/pii/S1054139X15003791. pmid:26576822
- 79. Kilburn K, Hughes JP, MacPhail C, Wagner RG, Gomez-Olive FX, Kahn K, et al. Cash Transfers, Young Women’s Economic Well-Being, and HIV Risk: Evidence from HPTN 068. AIDS Behav. 2019;23(5):1178–94. pmid:30415429
- 80. Pettifor A, MacPhail C, Selin A, Gomez-Olive X, Hughes JP R. W, et al. HPTN 068 conditional cash transfer to prevent HIV infection among young women in South Africa: Results of a randomized controlled trial. J Int AIDS Soc [Internet]. 2015;18:45–6. Available from: http://www.jiasociety.org/index.php/jias/article/view/20479/pdf.
- 81. Heath R, Hidrobo M, Roy S. Cash Transfers, Polygamy, and Intimate Partner Violence: Experimental Evidence from Mali. J Dev Econ. 2020;143(102410).
- 82. Haushofer J, Shapiro J. The Short-term Impact of Unconditional Cash Transfers to the Poor: Experimental Evidence from Kenya. Q J Econ. 2016;131(4):1973–2042. pmid:33087990
- 83. Holman B, Bero L, Mintzes B, Catalogue of Bias Collaboration. Industry Sponsorship bias. In: Catalogue of Bias [Internet]. 2019. Available from: https://catalogofbias.org/biases/industry-sponsorship-bias/.
- 84. Lundh A, Lexchin J, Mintzes B, Schroll JB, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev [Internet]. 2017;2(MR000033):1465–858. Available from: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.MR000033.pub3/full. pmid:28207928
- 85. McGuinness L, Higgins JPT. Risk-of-bias VISualization (robvis): An R package and Shiny web app for visualizing risk-of-bias assessments. Res Synth Methods. 2020;1–7. pmid:32336025
- 86. Higgins JPT, Savović J, Page MJ, Sterne JA. Guidance Document: Revised Cochrane risk-of-bias tool for randomized trials (RoB 2) [Internet]. 2019. Available from: https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool?authuser=0.
- 87. Tomitaka S, Kawasaki Y, Ide K, Akutagawa M, Ono Y, Furukawa TA. Responses to depressive symptom items exhibit a common mathematical pattern across the European populations. Sci Rep. 2019;9(14923):1–9. pmid:31624304
- 88. Radloff LS. The CES-D Scale: A Self-Report Depression Scale for Research in the General Population. Appl Psychol Meas. 1977;1(3):385–401.
- 89. Goldberg D, Gater R, Sartorius N, Ustun T, Piccinelli M, Gureje O, et al. The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychol Med. 1997;27(1):191–7. pmid:9122299
- 90. Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann. 2002;32(9):509–515.
- 91. Kabeer N, Waddington H. Economic impacts of conditional cash transfer programmes: a systematic review and meta-analysis. J Dev Eff [Internet]. 2015;7(3):290–303. Available from: http://dx.doi.org/10.1080/19439342.2015.1068833.
- 92. Millán TM, Barham T, Macours K, Maluccio JA, Stampini M. Long-term impacts of conditional cash transfers: Review of the evidence. World Bank Res Obs. 2019;34(1):119–159.
- 93. Blattman C, Fiala N, Martinez S. The Long Term Impacts of Grants on Poverty: 9-Year Evidence from Uganda’s Youth Opportunities Program. SSRN Electron J. 2018.
- 94. Lindahl M. Estimating the effect of income on health and mortality using lottery prizes as an exogenous source of variation in income. J Hum Resour. 2005;40(1):144–68.
- 95. Apouey B, Clark AE. Winning big but feeling no better? the effect of lottery prizes on physical and mental health. Health Econ. 2015;24(5):516–538. pmid:24677260
- 96. Gardner J, Oswald AJ. Money and mental wellbeing: A longitudinal study of medium-sized lottery wins. J Health Econ. 2007;26(1):49–60. pmid:16949692
- 97. Reeves A, McKee M, Mackenbach J, Whitehead M, Stuckler D. Introduction of a National Minimum Wage Reduced Depressive Symptoms in Low-Wage Workers: A Quasi-Natural Experiment in the UK. Heal Econ (United Kingdom). 2017;26(5):639–55. pmid:27046821
- 98. Benhassine N, Devoto F, Duflo E, Dupas P, Pouliquen V. Turning a shove into a nudge?: A “labeled cash transfer” for education. Am Econ J Econ Policy. 2015;7(3):86–125.
- 99. Pace N, Daidone S, Davis B, Pellerano L. Shaping Cash Transfer Impacts through “Soft-Conditions”: Evidence from Lesotho. J Afr Econ. 2019;28(1):39–69.
- 100. Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. Br Med J. 2017;358(j4008). pmid:28935701
- 101. Deaton A, Cartwright N. Understanding and misunderstanding randomized controlled trials. Soc Sci Med. 2018;210:2–21. pmid:29331519
- 102. Banerjee A, Banerji R, Berry J, Duflo E, Kannan H, Mukerji S, et al. From proof of concept to scalable policies: Challenges and solutions, with an application. J Econ Perspect. 2017;31(4):73–102.
- 103. List JA, Suskind D, Al-Ubaydli O. The Science of Using Science: Towards an Understanding of the Threats to Scaling Experiments. Univ Chicago, Becker Friedman Inst Econ Work Pap No 2019–73. 2019.
- 104. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review—A new method of systematic review designed for complex policy interventions. J Heal Serv Res Policy. 2005;10(1 suppl):21–34. pmid:16053581
- 105. Petticrew M, Tugwell P, Kristjansson E, Oliver S, Ueffing E, Welch V. Damned if you do, damned if you don’t: Subgroup analysis and equity. J Epidemiol Community Health. 2012;66(1):95–8. pmid:21652518
- 106. Lipsey MW. Those confounded moderators in meta-analysis: Good, bad, and ugly. Ann Am Acad Pol Soc Sci. 2003;587:69–81.
- 107. Thompson SG, Higgins JPT. How should meta-regression analyses be undertaken and interpreted? Stat Med. 2002;21(11):1559–73. pmid:12111920
- 108. Ioannidis J, Patsopoulos N, Rothstein H. Reasons or excuses for avoiding meta-analysis in forest plots. Br Med J. 2008;336(7658):1413–5.
- 109. Nederhof AJ. Methods of coping with social desirability bias: A review. Eur J Soc Psychol. 1985;15(3):263–80.
- 110. Cartwright N. Knowing what we are talking about: Why evidence doesn’t always travel. Evid Policy. 2013;9(1):97–112.
- 111. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. Realist randomised controlled trials: A new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75(12):2299–306. pmid:22989491
- 112. Durlak JA, DuPre EP. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50. pmid:18322790