Skip to main content

Choice of observational study design impacts on measurement of antipsychotic risks in the elderly: a systematic review

Abstract

Background

Antipsychotics are frequently and increasingly prescribed to treat the behavioural symptoms associated with dementia despite their modest efficacy. Evidence regarding the potential adverse events of antipsychotics is limited and little is known about the longer-term safety of these medicines in the elderly. The aim of this review was to determine the impact of the choice of observational study design and methods used to control for confounding on the measurement of antipsychotic risks in elderly patients.

Methods

We searched PUBMED and the Cochrane controlled trials register for double-blind randomised controlled trials (RCTs), meta-analyses and published observational studies of antipsychotics.

Results

Forty four studies were identified for the endpoints; death, cerebrovascular events, hip fracture and pneumonia. RCTs found a 20% to 30% increased risk of death, or an absolute increase of 1extra death per 100 patients with atypical antipsychotics compared to non-use. Cohort and instrumental variable analyses estimated between 2 to 7 extra deaths per 100 patients with conventional compared to atypical antipsychotics. RCTs found a 2 to 3 times increased risk of all cerebrovascular events with atypical antipsychotics compared to placebo and no association with serious stroke that required hospitalisation. Observational studies using cohort and self-controlled case-series designs reported similar results; no association where the endpoint was stroke causing hospitalisation and a doubling of risk when minor stroke was included. No RCTs were available for the outcome of hip fracture or pneumonia. Observational studies reported a 20% to 40% increased risk of hip fracture with both antipsychotic classes compared to non-use. The risk of pneumonia was a 2 to 3 times greater with both classes compared to non-use while a self-controlled case-series study estimated a 60% increased risk. Conventional antipsychotics were associated with a 50% greater hip fracture risk than atypical antipsychotics, while the risk of pneumonia was similar between the classes.

Conclusions

Choice of observational study design is critical in studying the adverse effects of antispychotics. Cohort and instrumental variable analyses gave more consistent results to clinical studies for mortality outcomes as have self-controlled case-series for the risk of cerebrovascular events and stroke. Observational evidence has highlighted the potential for antipsychotics to be associated with serious adverse events that were not reported in RCTs including hip fracture and pneumonia. Good quality observational studies are required, that employ appropriate study designs that are robust towards unmeasured confounding, to confirm the potential excess risk of hip fracture and pneumonia with antipsychotics.

Peer Review reports

Background

Antipsychotics are frequently, and increasingly, prescribed to treat the behavioural symptoms associated with dementia despite their modest efficacy and potential for serious side effects [1, 2]. A Cochrane review [2] failed to find any evidence of benefit with haloperidol treatment in patients with agitated dementia and recommended that it should not be used routinely. Another Cochrane review [1] found that atypical antipsychotics may help to improve symptoms of dementia such as aggression, psychosis and agitation,[3–7] however, improvements were often limited to patients with more severe dementia [5]. Large head to head randomised trials of atypical and conventional antipsychotics have not been performed in the elderly, however, one post-hoc analysis of a small experimental study [8] found that risperidone may be more effective in reducing aggressiveness than haloperidol.

Side effects are common with both classes of antipsychotics and include; extra-pyramidal symptoms [3–7] and somnolence [4–6]. These effects may be less frequent [9] and less severe [8] with risperidone compared to haloperidol, but only at lower doses of the medicines [9]. Experimental evidence regarding the more serious adverse events of antipsychotics is limited to atypical antipsychotics and little is known about the safety of conventional antipsychotics in the elderly. Furthermore, most randomised controlled trials have limited follow-up of up to 12 weeks [1] and the safety of both antipsychotic classes with long-term treatment remains unclear.

Post marketing observational studies of antipsychotics have identified many safety issues associated with antipsychotics, however, study results vary and conclusions are inconsistent.

Previous reviews of observational studies of antispychotics have focused on the clinical safety of conventional and atypical antipsychotics [10–13]. The aim of this review was to synthesise the current evidence from observational studies, regarding the serious adverse events of antipsychotics in elderly patients and to determine the impact of the observational study design utilised and the technique employed to control for confounding on study results.

A review of available meta-analyses of randomised controlled trial evidence was performed for comparison purposes. The endpoints of interest were death, cerebrovascular events, hip fracture and pneumonia.

Methods

This review was performed according to the Quality of Reporting of Meta-analyses (PRISMA http://www.prisma-statement.org/) guidelines (see online Additional File 1 PRISMA 2009 checklist).

We searched the PUBMED database and the Cochrane controlled trials register for all English-language articles published up to December 2010. We also conducted a manual search of bibliographies for other relevant articles. We included double-blind randomised controlled trials (RCTs), meta-analyses and published observational studies that evaluated adverse events of either conventional or atypical antipsychotic medications in elderly populations. All studies were included if they reported at least one of the adverse events of interest; death, cerebrovascular events, hip fracture or pneumonia. Studies specifically investigating the use of antipsychotics in schizophrenic patients were not included. Individual RCTs contributing to meta-analysis were not included in this review to avoid double counting of studies. In PUBMED we combined the results of 2 search domains: Dementia (MESH terms Dementia OR Dementia, Vascular NOT Schizophrenia), and drug therapy (Antipsychotic Agents) with each of the following searches for the outcomes of interest; death (Death OR Death, Sudden, Cardiac OR Death, Sudden OR Mortality), cerebrovascular events (Stroke), hip fracture (Hip Fractures) and pneumonia (Pneumonia OR Pneumonia, Bacterial OR Pneumonia, Aspiration). Author 1 (NP) was responsible for the retrieval and review of studies to be included in the final review. Author 2 (ER) provided independent assessment of studies when required.

We identified 106 articles, 7 of which were duplicates. Of the 99 unique records, 33 articles were excluded based upon review of the title and abstract. We reviewed 66 full text articles, of which 22 were excluded (Figure1). Articles were excluded if they were editorials, letters, did not contain original data or outcome data of interest or were commentaries on already included published data.

Figure 1
figure 1

Flow diagram of the selected studies.

We included observational studies that employed either a case–control design, a cohort design or a self-controlled case-series design. Studies that also used an instrumental variable analysis in addition to the standard cohort analysis were also included. The use of instrumental variables has been suggested as a possible alternative to conventional analyses when there is concern about the effect of unmeasured confounding [14, 15]. Instrumental variable (IV) analysis attempts to mimic the process of randomisation in an RCT by exploiting the existence of another variable (the instrument) which can be measured in the available data, which is highly correlated with the probability of exposure but unrelated to the outcome of interest except through its association with treatment [16]. The instrument is similar to random arm assignment in that it should distribute both measured and unmeasured patient characteristics evenly between exposure groups resulting in an estimate less affected by confounding. The self-controlled case-series design compares the risk of adverse events in periods of exposure compared to non-exposure within the same person. This design attempts to limit the effects of major unmeasured confounders as the within-person study design controls implicitly for confounders that do not vary over time [17].

The final identified studies were grouped by outcome type and categorised according to the primary study medication comparison. Studies were rated according to a hierarchy of evidence of study designs [18] with meta analyses considered as the highest level of evidence, observational studies were considered as lower quality. Data were extracted including the study population, study size, study design, propensity for bias, procedures employed to minimise bias, a rating of study quality, duration of follow-up, outcome rate in the reference group, effect estimate (either rate ratio, odds ratio, hazard ratio or risk difference depending on the study design utilised) and appropriate 95% confidence intervals. The propensity for bias was assigned as ‘Low’ for RCTs and ‘Moderate’ for observational studies. Study quality was assigned as ‘High’ for RCTs. Observational studies were assigned a ‘Moderate’ quality rating if specific methods were employed to minimise bias otherwise studies were assigned a ‘Low’ quality if they made only minimal efforts to control for potential bias. Study designs such as the self-controlled case-series or instrumental variable analysis are not formally recognised in the hierarchy of evidence, however, we have considered these studies as they attempt to account for the common problem of unmeasured confounding in observational studies. The probable place of instrumental variable analysis in the hierarchy is either equivalent to or better than cohort studies. The place of the self-controlled case-series is as yet unclear.

In this review we specifically aimed to determine the extent to which the study design employed and the methods utilised to control for confounding, impacted on study results. Thus it was considered inappropriate to proceed with a formal meta-analysis due to the likely heterogeneity of studies.

Results

This review included 44 studies, 16 evaluated the risk of death, 18 evaluated cerebrovascular events, 8 evaluated the risk of hip fracture and 6 evaluated the risk of pneumonia associated with antipsychotic prescribing. Details of the studies meeting our search criteria are presented in Table 1 for death outcomes, Table 2 for cerebrovasular events, Table 3 for hip fracture and Table 4 for pneumonia.

Table 1 Studies on the risk of death associated with antipsychotic medicines
Table 2 Studies on the risk of cerebrovascular events associated with antipsychotic medicines
Table 3 Studies on the risk of hip/femur fracture associated with antipsychotic medicines
Table 4 Studies on the risk of pneumonia associated with antipsychotic medicines

Risk of death associated with antipsychotic medicines

Meta-analysis and RCT evidence: studies that compared antipsychotic treatment to placebo

Meta-analyses of risperidone compared to placebo showed a non-significant 20% to 30% increased relative risk of death with short-term treatment (<12 weeks) [5, 19, 20]. One additional RCT found a 42% increased relative risk of death with atypical antipsychotics with extended duration of treatment [21]. Only one RCT was located that measured the risk of death associated with conventional antipsychotics compared to placebo [8]. This study, limited to 12 weeks duration, found a non-significant 68% increased relative risk of death with haloperidol [8], however, this may be due to insufficient statistical power as the number of patients in this study was small. No RCT evidence was available comparing the risk of death between the classes.

Observational evidence: studies that compared antipsychotic treatment to non-use

Observational cohort study evidence for atypical antipsychotics compared to non-use [22] was consistent with the longer duration RCT results [21] while a case–control study gave a much higher estimate [23]. Three observational studies found that conventional antipsychotics were associated with an increased risk of death compared to non-use [23, 25, 26] while one [24] case–control study found no difference in risk (Table 1).

Observational evidence: studies that compared conventional and atypical antipsychotic treatment

The majority of observational studies comparing the risk of death between the classes were performed using a cohort study design. Conventional antipsychotics were consistently associated with a 20-40% relative increased risk of death when compared to atypical antipsychotics [22, 26–29, 31, 32, 56]. Absolute risks, however, varied between studies according to the method employed to control for confounding. Conventional statistical methods adjusting for measured covariates suggested an increased risk over 6 months of between 2 and 3 deaths per 100 patients treated with conventional compared to atypical antipsychotics [22, 27, 56] while those that used an instrumental variable analysis, to adjust for unmeasured confounding, found an increased risk of between 4 and 7 deaths per 100 patients treated over 6 months [28, 29] and up to 10 deaths per 100 over 12 months [31]. Only one observational cohort study [26] and one case–control study [23] found no significant difference between the classes.

Risk of cerebrovascular events associated with antipsychotic medicines

Meta-analysis and RCT evidence: studies that compared antipsychotic treatment to placebo

Five meta-analyses reported a significantly increased risk of cerebrovascular events with atypical antipsychotics compared to placebo [1, 4–6, 32] (Table 2). When the outcome was limited to cerebrovascular events requiring hospitalisation no increased risk was observed [4, 32]. No RCT evidence was located for the risk of cerebrovascular events with conventional antipsychotics or for the comparison between classes.

Observational evidence: studies that compared antipsychotic treatment to non-use

Observational cohort studies found similar results to the meta-analyses of atypical antipsychotics compared to placebo. Of the two cohort studies, one study, that included all diagnoses of stroke from general practitioners’ medical records, found a significantly increased risk [33], while the other, investigating the more serious outcome definition of hospitalization for stroke, found no association with atypical antipsychotics compared to non-use [34]. Two case–control studies failed to find any association between atypical antipsychotics and cerebrovascular events compared to non-use [35, 36]. Two studies using a self-controlled case-series design, to adjust for unmeasured confounding, also found similar results to the RCTs when similar definitions of cerebrovascular events were considered. One study found an increased risk of stroke as diagnosed through general practitioners’ medical records for up to 70 days after initiation of atypical antipsychotics [37] while the other found no increased risk of hospitalization for stroke after initiation of atypical antipsychotics [38].

The strongest available evidence for the risk of cerebrovascular events with conventional antipsychotics was from observational cohort studies. One study found a significantly increased risk of stroke as diagnosed in general practitioners’ medical records [33] while the other found no increased risk of hospital admissions for cerebrovascular events [34] (Table 2). Two case–control studies failed to find any association between conventional antipsychotics and cerebrovascular events [35, 36]. One self-controlled case-series study found an increased risk of stroke, as diagnosed in GPs’ medical records, with conventional antipsychotic initiation compared to non-use which persisted up to 140 days after treatment initiation [37]. Another self-controlled case-series study found that the risk of hospitalization for stroke was increased in the first week only after initiation of antispychotics [38].

A temporal association between antipsychotics and cerebrovascular events was identified in observational studies. Three studies, all using different study designs, found that the risk associated with antipsychotic initiation was highest immediately following treatment initiation but returned to base-line with longer term treatment [37, 40, 41].

Observational evidence: studies that compared conventional and atypical antipsychotic treatment

Six cohort studies compared the risk of stroke between the classes with conflicting results. Three studies found equivalent risk between the classes [42–44]. One study found a reduced risk with conventional compared to atypical [39] while two found an increased risk [33, 45] with conventional compared to atypical antipsychotics (Table 2). An instrumental variable analysis found an increased risk of stroke with conventional antispychotics, however, the numerical results of this analysis were not presented [45].

Risk of hip fracture associated with antipsychotic medicines

Meta-analysis and RCT evidence: studies that compared antipsychotic treatment to placebo

No RCT evidence for the risk of hip fracture associated with either conventional or atypical antipsychotics was located.

Observational evidence: studies that compared antipsychotic treatment to non-use

Only one observational study employing a cohort design [46] was located that investigated the association between antipsychotics and hip fracture. This study found a 2.2 times excess risk of hip fracture with atypical antispychotics compared to non use. Of the four case–control studies, one found an increased risk of hip fracture with atypical antipsychotics compared to non-use[47], two studies found no increased risk [35, 48] and one study found equivalent risk in new users but increased risk in prevalent users [49]. A self-controlled case-series study [50] found a significantly increased risk of hospitalization for hip fracture with atypical antipsychotics which was highest in the first week after initiation. The risk declined with increased duration of treatment and remained significantly raised by over 40% with long-term treatment.

Conventional antipsychotics were associated with a significantly increased risk of hip fracture in three case–control studies [35, 47, 48], while one case–control study found no increased risk [49]. A self-controlled case-series study [50] found a significantly increased risk of hip fracture with conventional antipsychotics after 1 week continuous treatment.

Observational evidence: studies that compared atypical and conventional antipsychotic treatment

Only one cohort study [46] was identified that directly compared the risk of hip fracture between the classes of antipsychotics. This study found a significantly increased risk of hip fracture with conventional antipsychotics compared to atypical antipsychotics [46] (Table 3).

Risk of pneumonia associated with antipsychotic medicines

Meta-analysis and RCT evidence: studies that compared antipsychotic treatment to placebo

No RCT evidence for the risk of pneumonia associated with either atypical or conventional antipsychotics was located.

Observational evidence: studies that compared antipsychotic treatment to non-use

Observational evidence for the risk of pneumonia with atypical antispychotics compared to non-use was limited to three case–control studies [52–54] and one self controlled case-series study [50]. The case–control studies found a 2–3 times increased risk of pneumonia [52–54] (Table 4). A self controlled case-series study found a 70% increased risk of pneumonia after initiation of atypical antipsychotics [50].

Two case–control studies found a significantly increased risk of pneumonia with conventional antipsychotics[52, 53] and one self-controlled case-series study found a 60% increased risk compared to non-exposure.

Two case–control studies of all antipsychotics combined identified a significantly increased risk of pneumonia associated with treatment [52, 55]. One study found that the risk was highest in the first week of treatment and returned to base-line levels after more than 90 days treatment [52].

Observational evidence: studies that compared atypical and conventional antipsychotic treatment

Two studies were located comparing the risk of pneumonia between the classes [46, 54]. Both studies found no difference in the risk of pneumonia between the classes [45] (Table 4).

Discussion

This review included 44 studies that evaluated the risk of either death, cerebrovascular events, hip fracture or pneumonia associated with antipsychotic prescribing in the elderly. We found that observational evidence appears to support the findings from RCTs, where available, however the magnitude risk differed according to the methods used to control for confounding.

RCT evidence for atypical antipsychotics showed an absolute increase of 1 extra death per 100 people treated. Collectively, observational evidence showed that conventional antipsychotics were associated with a greater risk of death than the atypical antipsychotics, however, the estimates of absolute risk differed between studies. Risk estimates from covariate adjusted cohort studies ranged from 2 to 3 extra deaths per 100 patients treated with conventional compared to atypical antipsychotics over 6 months while instrumental variable analysis estimates ranged from 4 and 7 extra deaths per 100 patients over 6 months. These discrepancies suggest that unmeasured confounding may have contributed to an underestimate of risk in the traditional cohort studies. Many of the cohort studies also employed propensity score methods to adjust for confounding either by use of propensity score matching [22, 26] or numerical adjustment by propensity score quintiles [28, 29, 31]. In these latter studies propensity score adjustment estimates were consistent with multivariate adjusted results while instrumental variable analyses were marginally different suggesting some residual unmeasured confounding in the propensity score and multivariate adjusted analyses. Additionally studies have undertaken sensitivity analyses to rule out potential bias from unmeasured confounding which revealed that only very strong unmeasured confounders would explain the observed increased mortality association with conventional antipsychotic use, if in fact, the observed difference was not true [22, 28].

RCT evidence of the risk of cerebrovascular events was limited to the atypical antipsychotics and demonstrated an increased risk of all cerebrovascular events[1] but not serious strokes requiring hospitalization [4, 33]. Cerebrovascular events were the most studied and reported adverse event in observational studies of antipsychotics compared to non-use, however, the definition of this outcome was not consistent between studies. In general, cohort studies reported negative associations when investigating cerebrovascular hospitalisation events and positive associations when investigating outcomes defined as a diagnosis of all cerebrovascular events from general practitioners’ medical records which supports the findings from available RCTs. In contrast, case–control studies failed to find statistically significant results for either outcome definition. Case–control studies often employ techniques to minimise possible bias, such as matching or numerical adjustment for potential confounders, however, studies of this type may still be subject to unmeasured confounding [57]. Self-controlled case-series studies found similar results to RCT evidence when similar definition of cerebrovascular events were used which suggests that this technique may be a reliable design for the investigation of adverse events not previously detected in RCTs. One of the advantages of the self-controlled case-series design is that it controls implicitly for patient-specific confounders that do not vary over time. This means that it is not necessary to adjust for variables such as sex, frailty or other risk factors that are constant over time. However, a limitation of this approach is that it is unable to adjust for changes in prescribing due to rapid changes in underlying disease severity [17]. Observational cohort studies comparing the antipsychotic classes have used consistent definitions of outcome, specifically, hospitalisation for stroke, however, results vary according to the methods employed to adjust for differences between treatment groups. Of the 6 studies that used numerical covariate adjustment, three found no difference in risk [42–44] between the classes, one found a reduced risk [39], while two found an increased risk [33, 45] with conventional compared to atypical antispychotics. One study [45], used an instrumental variable method to adjust for unmeasured confounding. This study found a 10% increased risk of stroke with conventional compared to atypical antipsychotics but only after 60 days treatment, however, the instrumental variable estimates were not presented and the prevalence of cerebrovascular disease at baseline in the studied population, described in a separate paper, was high [29].

While no RCT data for the risk of hospitalisation for hip fracture could be located, a Cochrane review [1] found that risperidone may be associated with an increased risk of falls in the elderly which suggests that an increased risk of hip fracture may also be likely. Observational studies reported an increased risk of hip fracture with both classes compared to non-use and this risk may increase with increasing duration of therapy. A study using a self-controlled case-series design [50], found an increased risk of hospitalization for hip fracture for both conventional and atypical antipsychotics. It is unclear whether the risk of hip fracture differs between the classes. Only one cohort study [46] investigated the comparative risk of hip fracture between the classes finding an increased risk with conventional antipsychotics.

Meta-analyses [19–50, 52–58] of randomized controlled trials found that one of the major causes of death associated with atypical antipsychotics was pneumonia. Few observational studies, however, have investigated the risk of pneumonia associated with antipsychotics in elderly patients, and most have used a case–control design. An increased risk of pneumonia was found with both classes [52, 55] compared to non-use or previous use [53]. One case–control study identified that the risk appeared to be highest in the first week of treatment but returned to baseline after 90 days [52]. A study using a self-controlled case-series design [50] also found and increased risk of hospitalization for pneumonia for both conventional and atypical antipsychotics. The risk of pneumonia was similar between the classes [46, 54]. One study, which used an instrumental variable analysis, found no difference in the risk of pneumonia between conventional and atypical antipsychotics [45].

As in any systematic review, publication bias is a potential limitation of this study. It is possible that only positive observational study findings may have been published. In particular, the majority of published studies investigating hip fracture and pneumonia associated with antipsychotics reported significantly increased risks with treatment compared to non-use. Additionally, our search criteria specified that only those study designs that resulted in standard effect estimates were included for comparison purposes. We therefore excluded case reports and studies that used designs such as the self-controlled cohort analysis [59]. We only included outcomes that could be consistently defined to limit heterogeneity across studies. The endpoints for this study, cerebrovascular events, hip fracture and pneumonia, were chosen because we believed that patients were likely to present to hospital for these conditions, and therefore were outcomes that would most likely be available in observational studies using administrative claims databases. The application of methods such as the self controlled case-series and instrumental variable analyses have evolved mainly to address unmeasured confounding due to the lack of clinical information in claims databases. Antipsychotics have also been associated with other adverse events such as deep vein thrombosis, diabetes onset and heat stroke which were not included in this review.

The aim of this review was to explore the effects of study design on the results of observational studies of antipsychotics. To do this we simplified our comparisons to with-in class comparisons and we have not considered differences according to individual products, dose or effect modifiers. The majority of published observational studies have provided comparisons between classes, however, where available we have presented the results by individual products and by dose. Besides study design, many other factors may have contributed to the differences observed among observational studies. These include differences in populations studied, in terms of drug utilization patterns and health care settings, differences in the definition of outcome and variations in the number and type of confounders that may have been included in the analysis. We have attempted to limit the impact of these effects by considering the effects of antipsychotics in the elderly only and by limiting our events to serious adverse events potentially requiring hospitalization. In the case of cerebrovascular events we considered cerebrovascular events separately to hospitalizations for stroke as these were the two events most often considered in observational studies.

Where possible we compared available meta-analyses and randomised controlled trial evidence with the results of observational studies, however, experimental evidence was typically generated prior to when many of the observational studies were performed and may have included different patient populations. RCT evidence is generally considered of higher quality than observational studies,[18] however, there are many examples where RCTs on the same clinical topic have produced conflicting results [60]. High quality observational studies, whether cohort or case–control designs, have consistently found similar results to RCTs [60].

Conclusions

This review has identified that the harms associated with antipsychotics in the elderly are under reported in published RCTs and the risks of treatment may not be limited to death and cerebrovascular events. Collectively, evidence suggests that atypical antipsychotics are associated with an increased risk of death, cerebrovascular events, hip fracture and pneumonia. Based on RCT evidence [5, 6, 8, 61–63] the number needed to treat with risperidone to show clinical benefit ranges from 3 to 9 patients over a 12 week period (Table 5). This means that for every 100 patients treated with risperidone we would expect between 8 and 33 patients to receive any clinical improvement in symptoms of aggression or psychosis. The risk-benefit ratio suggests that there will be 1 excess death for every 11 to 33 person helped with these medicines [19], 1 excess hospitalization for hip fracture for every 4 to 12 patients helped and 1 excess hospitalization for pneumonia for every 2 to 5 patients helped [50]. Considering the modest improvement in terms of efficacy and the increased risk of mortality associated with hip fracture and pneumonia, the risks associated with antipsychotics may now outweigh their benefit. In the absence of RCT data, good quality observational studies will be required, that employ appropriate study designs that are robust towards unmeasured confounding, to clarify the risks of antipsychotic use in the elderly.

Table 5 Efficacy of atypical antipsychotics in elderly patients with dementia: Number needed to treat

References

  1. Ballard C, Waite J: The effectiveness of atypical antipsychotics for the treatment of aggression and psychosis in Alzheimer’s disease. Cochrane Database Syst Rev. 2006, 1: CD003476-

    PubMed  Google Scholar 

  2. Lonergan E, Luxenberg J, Colford J: Haloperidol for agitation in dementia. Cochrane Database Syst Rev. 2002, 2: CD002852-

    PubMed  Google Scholar 

  3. Ballard C, Fossey J, Sharp S: Antipsychotics in patients with Alzheimer’s disease–what is their clinical value?. Nat Clin Pract Neurol. 2007, 3 (5): 248-249.

    Article  PubMed  Google Scholar 

  4. De Deyn PP, Katz IR, Brodaty H, Lyons B, Greenspan A, Burns A: Management of agitation, aggression, and psychosis associated with dementia: a pooled analysis including three randomized, placebo-controlled double-blind trials in nursing home residents treated with risperidone. Clin Neurol Neurosurg. 2005, 107 (6): 497-508. 10.1016/j.clineuro.2005.03.013.

    Article  PubMed  Google Scholar 

  5. Katz I, de Deyn PP, Mintzer J, Greenspan A, Zhu Y, Brodaty H: The efficacy and safety of risperidone in the treatment of psychosis of Alzheimer’s disease and mixed dementia: a meta-analysis of 4 placebo-controlled clinical trials. Int J Geriatr Psychiatry. 2007, 22 (5): 475-484. 10.1002/gps.1792.

    Article  PubMed  Google Scholar 

  6. Schneider LS, Dagerman K, Insel PS: Efficacy and adverse effects of atypical antipsychotics for dementia: meta-analysis of randomized, placebo-controlled trials. Am J Geriatr Psychiatry. 2006, 14 (3): 191-210.

    Article  PubMed  Google Scholar 

  7. Schneider LS, Tariot PN, Dagerman KS, et al: Effectiveness of atypical antipsychotic drugs in patients with Alzheimer’s disease. N Engl J Med. 2006, 355 (15): 1525-1538. 10.1056/NEJMoa061240.

    Article  CAS  PubMed  Google Scholar 

  8. De Deyn PP, Rabheru K, Rasmussen A, et al: A randomized trial of risperidone, placebo, and haloperidol for behavioral symptoms of dementia. Neurology. 1999, 53 (5): 946-955. 10.1212/WNL.53.5.946.

    Article  CAS  PubMed  Google Scholar 

  9. van Iersel MB, Zuidema SU, Koopmans RT, Verhey FR: Olde Rikkert MG. Antipsychotics for behavioural and psychological problems in elderly people with dementia: a systematic review of adverse events. Drugs Aging. 2005, 22 (10): 845-858.

    CAS  PubMed  Google Scholar 

  10. Sacchetti E, Turrina C, Valsecchi P: Cerebrovascular accidents in elderly people treated with antipsychotic drugs: a systematic review. Drug Saf. 2010, 33 (4): 273-288. 10.2165/11319120-000000000-00000.

    Article  CAS  PubMed  Google Scholar 

  11. Takkouche B, Montes-Martinez A, Gill SS, Etminan M: Psychotropic medications and the risk of fracture: a meta-analysis. Drug Saf. 2007, 30 (2): 171-184. 10.2165/00002018-200730020-00006.

    Article  PubMed  Google Scholar 

  12. Trifiro G: Antipsychotic drug use and community-acquired pneumonia. Curr Infect Dis Rep. 2011, 13 (3): 262-268. 10.1007/s11908-011-0175-y.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Trifiro G, Spina E, Gambassi G: Use of antipsychotics in elderly patients with dementia: do atypical and conventional agents have a similar safety profile?. Pharmacol Res. 2009, 59 (1): 1-12. 10.1016/j.phrs.2008.09.017.

    Article  CAS  PubMed  Google Scholar 

  14. Brookhart MA, Wang PS, Solomon DH, Schneeweiss S: Instrumental variable analysis of secondary pharmacoepidemiologic data. Epidemiology. 2006, 17 (4): 373-374. 10.1097/01.ede.0000222026.42077.ee.

    Article  PubMed  Google Scholar 

  15. Greenland S: An introduction To instrumental variables for epidemiologists. Int J Epidemiol. 2000, 29 (6): 1102-10.1093/oxfordjournals.ije.a019909.

    Article  PubMed  Google Scholar 

  16. Martens EP, Pestman WR, de Boer A, Belitser SV, Klungel OH: Instrumental variables: application and limitations. Epidemiology. 2006, 17 (3): 260-267. 10.1097/01.ede.0000215160.88317.cb.

    Article  PubMed  Google Scholar 

  17. Whitaker HJ, Farrington CP, Spiessens B, Musonda P: Tutorial in biostatistics: the self-controlled case series method. Stat Med. 2006, 25 (10): 1768-1797. 10.1002/sim.2302.

    Article  PubMed  Google Scholar 

  18. Merlin T, Weston A, Tooher R: Extending an evidence hierarchy to include topics other than treatment: revising the Australian ‘levels of evidence’. BMC Med Res Methodol. 2009, 9: 34-10.1186/1471-2288-9-34.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Schneider LS, Dagerman KS, Insel P: Risk of death with atypical antipsychotic drug treatment for dementia: meta-analysis of randomized placebo-controlled trials. JAMA. 2005, 294 (15): 1934-1943. 10.1001/jama.294.15.1934.

    Article  CAS  PubMed  Google Scholar 

  20. Haupt M, Cruz-Jentoft A, Jeste D: Mortality in elderly dementia patients treated with risperidone. J Clin Psychopharmacol. 2006, 26 (6): 566-570. 10.1097/01.jcp.0000239796.21826.39.

    Article  CAS  PubMed  Google Scholar 

  21. Ballard C, Hanney ML, Theodoulou M, et al: The dementia antipsychotic withdrawal trial (DART-AD): long-term follow-up of a randomised placebo-controlled trial. Lancet Neurol. 2009, 8 (2): 151-157. 10.1016/S1474-4422(08)70295-3.

    Article  CAS  PubMed  Google Scholar 

  22. Gill SS, Bronskill SE, Normand SL, et al: Antipsychotic drug use and mortality in older adults with dementia. Ann Intern Med. 2007, 146 (11): 775-786.

    Article  PubMed  Google Scholar 

  23. Trifiro G, Verhamme KM, Ziere G, Caputi AP, Ch Stricker BH, Sturkenboom MC: All-cause mortality associated with atypical and typical antipsychotics in demented outpatients. Pharmacoepidemiol Drug Saf. 2007, 16 (5): 538-544. 10.1002/pds.1334.

    Article  CAS  PubMed  Google Scholar 

  24. Raivio MM, Laurila JV, Strandberg TE, Tilvis RS, Pitkala KH: Neither atypical nor conventional antipsychotics increase mortality or hospital admissions among elderly patients with dementia: a two-year prospective study. Am J Geriatr Psychiatry. 2007, 15 (5): 416-424. 10.1097/JGP.0b013e31802d0b00.

    Article  PubMed  Google Scholar 

  25. Ray WA, Meredith S, Thapa PB, Meador KG, Hall K, Murray KT: Antipsychotics and the risk of sudden cardiac death. Arch Gen Psychiatry. 2001, 58 (12): 1161-1167. 10.1001/archpsyc.58.12.1161.

    Article  CAS  PubMed  Google Scholar 

  26. Kales HC, Valenstein M, Kim HM, et al: Mortality risk in patients with dementia treated with antipsychotics versus other psychiatric medications. Am J Psychiatry. 2007, 164 (10): 1568-1576. 10.1176/appi.ajp.2007.06101710. quiz 1623

    Article  PubMed  Google Scholar 

  27. Hollis J, Grayson D, Forrester L, Brodaty H, Touyz S, Cumming R: Antipsychotic medication dispensing and risk of death in veterans and war widows 65 years and older. Am J Geriatr Psychiatry. 2007, 15 (11): 932-941. 10.1097/JGP.0b013e31813547ca.

    Article  PubMed  Google Scholar 

  28. Schneeweiss S, Setoguchi S, Brookhart A, Dormuth C, Wang PS: Risk of death associated with the use of conventional versus atypical antipsychotic drugs among elderly patients. Cmaj. 2007, 176 (5): 627-632. 10.1503/cmaj.061250.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Wang PS, Schneeweiss S, Avorn J, et al: Risk of death in elderly users of conventional vs. atypical antipsychotic medications. N Engl J Med. 2005, 353 (22): 2335-2341. 10.1056/NEJMoa052827.

    Article  CAS  PubMed  Google Scholar 

  30. Liperoti R, Onder G, Landi F, et al: All-cause mortality associated with atypical and conventional antipsychotics among nursing home residents with dementia: a retrospective cohort study. J Clin Psychiatry. 2009, 70 (10): 1340-1347. 10.4088/JCP.08m04597yel.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Pratt NL, Roughead EE, Salter A, Ryan P: Antipsychotics and the risk of death in the elderly: an instrumental variable analysis using two preference based instruments. Pharmacoepidemiol Drug Saf. 2010, 19 (7): 699-707. 10.1002/pds.1942.

    Article  PubMed  Google Scholar 

  32. Herrmann N, Lanctot KL: Do atypical antipsychotics cause stroke?. CNS Drugs. 2005, 19 (2): 91-103. 10.2165/00023210-200519020-00001.

    Article  PubMed  Google Scholar 

  33. Sacchetti E, Trifiro G, Caputi A, et al: Risk of stroke with typical and atypical anti-psychotics: a retrospective cohort study including unexposed subjects. J Psychopharmacol. 2008, 22 (1): 39-46.

    Article  PubMed  Google Scholar 

  34. Barnett MJ, Wehring H, Perry PJ: Comparison of risk of cerebrovascular events in an elderly VA population with dementia between antipsychotic and nonantipsychotic users. J Clin Psychopharmacol. 2007, 27 (6): 595-601. 10.1097/jcp.0b013e31815a2531.

    Article  CAS  PubMed  Google Scholar 

  35. Kolanowski A, Fick D, Waller JL, Ahern F: Outcomes of antipsychotic drug use in community-dwelling elders with dementia. Arch Psychiatr Nurs. 2006, 20 (5): 217-225. 10.1016/j.apnu.2006.04.004.

    Article  PubMed  Google Scholar 

  36. Liperoti R, Gambassi G, Lapane KL, et al: Cerebrovascular events among elderly nursing home patients treated with conventional or atypical antipsychotics. J Clin Psychiatry. 2005, 66 (9): 1090-1096. 10.4088/JCP.v66n0901.

    Article  PubMed  Google Scholar 

  37. Douglas IJ, Smeeth L: Exposure to antipsychotics and risk of stroke: self controlled case series study. BMJ. 2008, 337: a1227-10.1136/bmj.a1227.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Pratt NL, Roughead EE, Ramsay E, Salter A, Ryan P: Risk of hospitalisation for stroke associated with antipsychotic use in the elderly: a self controlled case-series result. Drugs Aging. 2010, 27 (11): 885-893. 10.2165/11584490-000000000-00000.

    Article  PubMed  Google Scholar 

  39. Percudani M, Barbui C, Fortino I, Tansella M, Petrovich L: Second-generation antipsychotics and risk of cerebrovascular accidents in the elderly. J Clin Psychopharmacol. 2005, 25 (5): 468-70. 10.1097/01.jcp.0000178414.14685.c4.

    Article  PubMed  Google Scholar 

  40. Sacchetti E, Turrina C, Cesana B, Mazzaglia G: Timing of stroke in elderly people exposed to typical and atypical antipsychotics: a replication cohort study after the paper of Kleijer, et al. J Psychopharmacol. 2010, 24 (7): 1131-2. 10.1177/0269881109103202.

    Article  CAS  PubMed  Google Scholar 

  41. Kleijer BC, van Marum RJ, Egberts AC, Jansen PA, Knol W, Heerdink ER: Risk of cerebrovascular events in elderly users of antipsychotics. J Psychopharmacol. 2008

    Google Scholar 

  42. Herrmann N, Mamdani M, Lanctot KL: Atypical antipsychotics and risk of cerebrovascular accidents. Am J Psychiatry. 2004, 161 (6): 1113-5. 10.1176/appi.ajp.161.6.1113.

    Article  PubMed  Google Scholar 

  43. Gill SS, Rochon PA, Herrmann N, et al: Atypical antipsychotic drugs and risk of ischaemic stroke: population based retrospective cohort study. BMJ. 2005, 330 (7489): 445-10.1136/bmj.38330.470486.8F.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Finkel S, Kozma C, Long S, Greenspan A, Mahmoud R, Baser O, Engelhart L: Risperidone treatment in elderly patients with dementia: relative risk of cerebrovascular events versus other antipsychotics. Int Psychogeriatr. 2005, 17 (4): 617-29. 10.1017/S1041610205002280.

    Article  PubMed  Google Scholar 

  45. Wang PS, Schneeweiss S, Setoguchi S, et al: Ventricular arrhythmias and cerebrovascular events in the elderly using conventional and atypical antipsychotic medications. J Clin Psychopharmacol. 2007, 27 (6): 707-10. 10.1097/JCP.0b013e31815a882b.

    Article  PubMed  Google Scholar 

  46. Normand SL, Sykora K, Li P, Mamdani M, Rochon PA, Anderson GM: Readers guide to critical appraisal of cohort studies: 3. Analytical strategies to reduce confounding. BMJ. 2005, 330 (7498): 1021-3. 10.1136/bmj.330.7498.1021.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Liperoti R, Onder G, Lapane KL, et al: Conventional or atypical antipsychotics and the risk of femur fracture among elderly patients: results of a case–control study. J Clin Psychiatry. 2007, 68 (6): 929-34. 10.4088/JCP.v68n0616.

    Article  CAS  PubMed  Google Scholar 

  48. Pouwels S, van Staa TP, Egberts AC, Leufkens HG, Cooper C, de Vries F: Antipsychotic use and the risk of hip/femur fracture: a population-based case–control study. Osteoporos Int. 2009, 20 (9): 1499-506. 10.1007/s00198-008-0826-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Jalbert JJ, Eaton CB, Miller SC, Lapane KL: Antipsychotic use and the risk of hip fracture among older adults afflicted with dementia. J Am Med Dir Assoc. 2010, 11 (2): 120-7. 10.1016/j.jamda.2009.10.001.

    Article  PubMed  Google Scholar 

  50. Pratt N, Roughead EE, Ramsay E, Salter A, Ryan P: Risk of hospitalization for hip fracture and pneumonia associated with antipsychotic prescribing in the elderly: a self-controlled case-series analysis in an Australian health care claims database. Drug Saf. 2011, 34 (7): 567-75. 10.2165/11588470-000000000-00000.

    Article  PubMed  Google Scholar 

  51. Wang PS, Bohn RL, Glynn RJ, Mogun H, Avorn J: Hazardous benzodiazepine regimens in the elderly: effects of half-life, dosage, and duration on risk of hip fracture. Am J Psychiatry. 2001, 158 (6): 892-8. 10.1176/appi.ajp.158.6.892.

    Article  CAS  PubMed  Google Scholar 

  52. Knol W, van Marum RJ, Jansen PA, Souverein PC, Schobben AF, Egberts AC: Antipsychotic drug use and risk of pneumonia in elderly people. J Am Geriatr Soc. 2008, 56 (4): 661-6. 10.1111/j.1532-5415.2007.01625.x.

    Article  PubMed  Google Scholar 

  53. Trifiro G, Gambassi G, Sen EF, et al: Association of community-acquired pneumonia with antipsychotic drug use in elderly patients: a nested case–control study. Ann Intern Med. 2010, 152 (7): 418-25. W139-40

    Article  PubMed  Google Scholar 

  54. Gau JT, Acharya U, Khan S, Heh V, Mody L, Kao TC: Pharmacotherapy and the risk for community-acquired pneumonia. BMC Geriatr. 2010, 10: 45-10.1186/1471-2318-10-45.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Wada H, Nakajoh K, Satoh-Nakagawa T, et al: Risk factors of aspiration pneumonia in Alzheimer’s disease patients. Gerontology. 2001, 47 (5): 271-6. 10.1159/000052811.

    Article  CAS  PubMed  Google Scholar 

  56. Hollis J, Forrester L, Brodaty H, Touyz S, Cumming R, Grayson D: Risk of death associated with antipsychotic drug dispensing in residential aged care facilities. Aust N Z J Psychiatry. 2007, 41 (9): 751-758. 10.1080/00048670701519864.

    Article  PubMed  Google Scholar 

  57. Rothman KJ, Greenland S, Lash TL: Modern epidemiology. 2008, Wolters Kluwer Health/Lippincott Williams & Wilkins, Philadelphia, 3

    Google Scholar 

  58. Kuehn BM: FDA warns antipsychotic drugs may be risky for elderly. JAMA. 2005, 293 (20): 2462-10.1001/jama.293.20.2462.

    Article  CAS  PubMed  Google Scholar 

  59. Star K, Bate A, Meyboom RH, Edwards IR: Pneumonia following antipsychotic prescriptions in electronic health records: a patient safety concern?. Br J Gen Pract. 2010, 60 (579): e385-94. 10.3399/bjgp10X532396.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Concato J, Shah N, Horwitz RI: Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000, 342 (25): 1887-92. 10.1056/NEJM200006223422507.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Brodaty H, Ames D, Snowdon J, et al: Risperidone for psychosis of Alzheimer’s disease and mixed dementia: results of a double-blind, placebo-controlled trial. Int J Geriatr Psychiatry. 2005, 20 (12): 1153-7. 10.1002/gps.1409.

    Article  PubMed  Google Scholar 

  62. Katz IR, Jeste DV, Mintzer JE, Clyde C, Napolitano J, Brecher M: Comparison of risperidone and placebo for psychosis and behavioral disturbances associated with dementia: a randomized, double-blind trial. Risperidone Study Group. J Clin Psychiatry. 1999, 60 (2): 107-15.

    Article  CAS  Google Scholar 

  63. Sultzer DL, Davis SM, Tariot PN, et al: Clinical symptom responses to atypical antipsychotic medications in Alzheimer’s disease: phase 1 outcomes from the CATIE-AD effectiveness trial. Am J Psychiatry. 2008, 165 (7): 844-54. 10.1176/appi.ajp.2008.07111779.

    Article  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Acknowledgements

This research was funded by the Australian Government Department of Veterans’ Affairs. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nicole Pratt.

Additional information

Competing interests

The authors have no competing interests to declare.

Authors’ contributions

NP and ER carried out the identification of studies to be included in this review. All authors participated in the design and interpretation of the study. All authors contributed to the drafting of the manuscript and have approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Pratt, N., Roughead, E.E., Salter, A. et al. Choice of observational study design impacts on measurement of antipsychotic risks in the elderly: a systematic review. BMC Med Res Methodol 12, 72 (2012). https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2288-12-72

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2288-12-72

Keywords