Skip to main content
Download PDF

Naringin provides neuroprotection in CCL2-induced cognition impairment by attenuating neuronal apoptosis in the hippocampus

Behavioral and Brain Functions volume 16, Article number: 4 (2020) Cite this article

Abstract

Background

Chemokine C–C motif ligand 2 (CCL2) is one of the most widely recognised proinflammatory chemokines in cognitive disorders. Currently, CCL2-targeting drugs are extremely limited. Thus, this study aimed to explore the neuroprotection afforded by naringin in CCL2-induced cognitive impairment in rats.

Methods

Before the CCL2 intra-hippocampal injection, rats were treated with naringin for 3 consecutive days via intraperitoneal injection. Two days post-surgery, the Morris water maze (MWM) and novel object recognition (NORT) tests were performed to detect spatial learning and memory and object cognition, respectively. Nissl staining and dUTP nick-end labelling (TUNEL) staining were performed to assess histopathological changes in the hippocampus. Commercial kits were used to measure the activity of superoxide dismutase (SOD) and glutathione peroxidase (GSH-Px) and the content of malondialdehyde (MDA). Quantitative real-time polymerase chain reaction (qRT-PCR) was performed to examine the relative mRNA expression of interleukin 1β, (IL-1β), interleukin 6 (IL-6), glutamate/aspartate transporter (GLAST), glutamate transporter-1 (GLT-1), phosphate-activated glutaminase (PAG), cysteine aspartic acid-specific protease 8 (caspase-8), cysteine aspartic acid-specific protease 3 (caspase-3), cell lymphoma/leukaemia-2 (Bcl-2), and Bcl-2 associated X protein (Bax).

Results

In the MWM, the average escape latency and average swimming distance were significantly reduced and the crossing times were increased in the naringin-treated groups, compared with the CCL2 group. The NORT results revealed that, compared with the CCL2 rats, the discrimination index in the naringin-treated rats increased significantly. Nissl and TUNEL staining revealed that naringin protected the structure and survival of the neurons in the CA1 zone of the hippocampus. In the naringin-treated groups, the SOD and GSH-Px activities were increased, whereas the MDA levels were decreased. Furthermore, in the naringin-treated groups, the relative mRNA expression of IL-1β and IL-6 was significantly decreased; GLAST and GLT-1 mRNA expression levels were increased, whereas PAG was decreased. In the naringin-treated groups, the relative mRNA expression levels of caspase-8, caspase-3, and Bax were decreased, whereas that of Bcl-2 was increased.

Conclusion

Collectively, these data indicated that naringin alleviated the CCL2-induced cognitive impairment. The underlying mechanisms could be associated with the inhibition of neuroinflammation, oxidative stress, apoptosis, and the regulation of glutamate metabolism.

Background

The chemokine C–C motif ligand 2 (CCL2), also known as the monocyte chemoattractant protein-1(MCP-1) [1, 2], belongs to the C–C chemokine family [3]. It has the potent ability to activate and recruit mononuclear phagocytes and activate T cells and B cells; functions that are well-characterised in the immune system [4, 5]. However, recent studies have revealed that CCL2 is also involved in several central nervous system (CNS) diseases, such as epilepsy, Alzheimer’s disease, and ischaemic brain injury [1]. Elevated CCL2 has been detected in the cerebrospinal fluid (CSF) of patients with Alzheimer’s disease (AD) and HIV-associated neurocognitive disorder (HAND) [6,7,8,9]. In the brain, CCL2 is produced mainly by macrophages and microglia, which, in turn, activate microglia and release numerous inflammatory cytokines [10, 11], such as interleukin 6 (IL-6) and interleukin 1β (IL-1β), exacerbating the extent of inflammation and resulting in neuronal injury. Thus, as a potential proinflammatory mediator, we postulated that CCL2 is closely associated with neuroinflammation and cognitive impairment.

In addition to neuroinflammation, our previous study has indicated a novel role of CCL2 in mediating excitotoxicity in an in vitro study. The administration of CCL2 enhances N-methyl-d-aspartic acid (NMDA) receptor-mediated excitatory postsynaptic currents (EPSCs) and ultimately impairs neuronal dendrites in the hippocampal CA1 region, inducing neuronal death in the hippocampus [12]. Based on these findings, we hypothesised that CCL2 impairs neurons via multiple pathways and could be a potential therapeutic target in several CNS diseases.

However, drugs currently available against CCL2 are extremely limited. Naringin, a flavonoid naturally existing in grapefruit and other citrus fruits, possesses numerous biological benefits. Preclinical evidence has suggested the protective role of naringin in the prevention of cardiovascular disease, diabetes, and neurodegeneration via antioxidant and anti-inflammation properties [13,14,15,16,17]. Another study has demonstrated that naringin can alleviate the progression of atherosclerosis by downregulating CCL2 expression [18]. However, the potential protective effects of naringin against CCL2-induced neuronal impairment have not been investigated. Therefore, in this study, we investigated the effect of naringin on CCL2-induced cognitive impairment and elucidated the possible underlying mechanisms.

Materials and methods

Reagents and instruments

CCL2 (R&D system) and naringin (purity > 98%) were purchased from Sigma Chemicals (USA). RT-PCR primers were obtained from Generay Biotech (Japan). The TRIzol reagent for RT-PCR was purchased from TaKaRa Bio Inc (Japan). The commercial kits were purchased from Nanjing Jiancheng Bio-engineering Institute (Nanjing, China). TUNEL and the Nissl kit were procured from Beyotime Institute of Biotechnology (Haimen, China).

Experimental animal grouping

All animal experiments were performed in accordance with the guidelines of the Animal Ethical Committee of Guangxi University. Seventy-seven SPF male Sprague–Dawley rats (4–6 weeks old, weighing 180–220 g) were provided by the Guangxi Medical University. The rats were maintained in an air-conditioned room (22 ± 2 °C, 12-h light/dark cycle) with free access to water. The rats were randomly divided into seven groups (n = 11), including the control group, sham group, model group (5 ng CCL2), positive drug treatment group (CCL2 + 10 mg/kg memantine), naringin low dose group (CCL2 + 25 mg/kg naringin), naringin middle dose group (CCL2 + 50 mg/kg naringin), and naringin high dose group (CCL2 + 100 mg/kg naringin), as shown in Fig. 1.

Fig. 1
figure 1

Experimental designs

Full size image

Stereotaxic surgery and drugs treatment

Firstly, CCL2 was dissolved in 100 ng μL−1 using sterile saline and then diluted to 1 ng μL−1 before the experiment. With the exception of the control group, each group underwent a bilateral hippocampal injection. Briefly, rats were anaesthetised using an intraperitoneal (i.p.) injection of 1% sodium pentobarbital (45 mg kg−1). The fur on the rat’s head was removed following anaesthesia. According to the stereotaxic map of rat brain, a 26 GS micro-syringe was used to inject the test drugs into the hippocampus following the coordinate positions of AP = − 3.7 mm, ML = ± 3.0 mm, and DV = − 3.0 mm. The injection volume was 2.5 μL per side, with a constant speed of 0.3 μL/min; the sham group received an equal volume of sterile saline. After administration, the needle was left in place for another 5 min to avoid leakage of the drug and ensure complete absorption. Next, we sutured the skin and administered penicillin (300,000 units kg−1, i.p.) to prevent the development of any infection. Before the administration of CCL2, the rats in the treatment groups were treated with naringin and memantine repeatedly for 3 consecutive days via i.p. injection. The rats in the control, sham, and model (5 ng CCL2) groups were administered equal volumes of normal saline for 3 consecutive days. On the third day, drug administration was performed 30 min before the bilateral hippocampal injection.

Morris water maze (MWM)

In rats, spatial learning and memory assess began on the third day following hippocampal injection. The methodology was as described by Vorhees et al. [19]. The MWM paradigm consisted of a circular pool, with a diameter of 120 cm and a height of 110 cm, a video capture system, and a software analysis system. The pool was divided into four equal quadrants, including NW, SW, SE, and NE. Near the wall of each quadrant, a distinct marker of similar size and different shape was placed. The water temperature was controlled at 22 ± 1 °C. In the centre of the SW quadrant, a platform was submerged 2 cm below the water surface. The experiment consisted of three phases: (1) habituation phase: To enable environmental adaptation and avoid stress, all rats were allowed to swim in the pool for 60 s before performing the experiment; (2) spatial navigation phase: This phase was performed for five consecutive days. On each day, the rats were placed in the water from different quadrants and administered four trails each day. We recorded the time from the start to find the platform, termed the escape latency. Additionally, swimming speed and swimming distance were measured. Each trial was performed for 90 s. If the rat failed to reach the platform within 90 s, we guided the animal to the platform for 30 s and recorded the escape latency as 90 s. (3) Probe trial: This phase was performed 24 h after the end of spatial navigation. We removed the platform and introduced the rats at a random quadrant for 90 s. The crossing times to reach the position of the platform were recorded as the evaluated index.

New object recognition test (NORT)

This experiment was conducted after the MWM for 2 consecutive days. The methods were as described by Leger et al. [20]. The apparatus consisted of a transparent plastic box (60 cm × 40 cm × 80 cm), two identical objects A, a different object B, and a video recording system. On the first day, the rat was habituated to the box for 5 min. Then, the rat was returned to the cage and the box was wiped using 75% alcohol to prevent the odour of the preceding rat to influence the next rat. Twenty-four hours later, we first placed two identical object As at the two adjacent corners of the box. The rat was given 10 min to freely explore the environment. One hour later, one object A was replaced with object B and the rat was allowed to explore for 5 min. We recorded the total time spent at A (time for the familiar; TF) and B (time for novel; TN), respectively. The discrimination index (DI) was evaluated according to the following formula: DI = TN/(TN + TF) * 100%.

Samples preparation

Following the performance of NORT, the rats were anaesthetised with 10% chloral hydrate and decapitated. The brain was quickly removed on a culture dish filled with ice-cold saline (~ 4 °C). Three samples of the whole-brain were used for Nissl and TUNEL staining (n = 3), four samples of one side of the hippocampus were used for RT-PCR (n = 4), and eight samples of the other side of the hippocampus were used for oxidative stress detection (n = 8).

Nissl staining and TUNEL staining

Nissl staining was conducted according to the kit protocols. Images were photographed using an Olympus BX53 fluorescence microscope at 400×. TUNEL staining was performed in accordance with the manufacturer’s protocol. An Olympus BX53 fluorescence microscope was used to capture the images under 400×. The apoptotic cells were quantitatively assessed, with three animals examined per group and three slices per hippocampal sample.

Oxidative stress determination

To examine the effects of naringin in CCL2-induced hippocampal oxidative stress, we measured the expression levels of glutathione peroxidase (GSH‑PX), malondialdehyde (MDA), and superoxide dismutase (SOD). Briefly, the hippocampus was prepared as a 10% homogenate using iced saline. The total protein concentration of each sample was determined by the BCA method. SOD, GSH-PX activity, and MDA content were detected according to the specific kit instructions.

qRT-PCR experiment

Briefly, total RNA extracted from the hippocampus was evaluated according to the RNA extraction kit instructions. RNA was reverse transcribed into cDNA as directed by the reverse transcription kit. The PCR reaction was quantified using the SYBE Green reagent and analysed by the StepOnePlus™ Real-Time PCR System. GAPDH was used as the reference gene. The relative mRNA expression was calculated using the 2−ΔΔCt method. Table 1 presents the primer sequence.

Table 1 The primer sequences of target genes
Full size table

Statistical analysis

Data analyses were performed using SPSS version 20.0 (IBM Corp., Armonk, NY, USA). All data are expressed as the mean ± SEM. In the case of the MWM, escape latency, swimming speed, and swimming distance were analysed using the two-way ANOVA of repeated measures, whereas one-way ANOVA was performed on the rest of the measured data analysis. Significance was defined at P < 0.05.

Results

Naringin improves the spatial learning and memory of CCL2-administered rats

To evaluate the protective role of naringin in CCL2-induced spatial learning and memory impairment, we performed the MWM test. In spatial navigation training, the swimming speed for all groups demonstrated no significant differences (Fig. 2a). The escape latency of each group gradually decreased across the training days (Fig. 2d). Compared to the sham group, the escape latency of the CCL2 group was significantly increased; naringin treatment significantly decreased the escape latency (F(6,63) = 5.448, P < 0.001, Fig. 2b). Additionally, the results of swimming distances were comparable to those of escape latency (F(6,63) = 6.280, P < 0.001, Fig. 2c). The swimming path on training day 5 is shown in Fig. 2e. In the probe trial, the crossing times in the CCL2 group decreased significantly compared to the sham group; in the naringin-treated group, crossing times were significantly increased compared to the CCL2 group (F(6, 63) = 4.794, P < 0.001, Fig. 2f).

Fig. 2
figure 2

Naringin improves the learning and memory functions of CCL2 administered rats. Effect of Naringin on spatial learning in CCL2-treated rat were evaluated using the Morris water maze for five consecutive days. a The average swimming speeds among groups. There were no significance among groups. b The escape latency among groups. CCL2 group spent more time to found hidden platform compared with the Naringin treatment groups. c The average swimming distances among groups. The CCL2 treatment rats showed a significantly longer courses to arrived platform compaerd with the Naringin treatment groups. d The escape latency tendency during 5-day training. The time to found platform is shorten across days. e The typical track of searching for the hidden platform on training day 5. f The number of crossings of the target quadrant. The number of crossings of the target quadrant in the Naringin treatment groups significantly incresed compared with CCL2 group was observed. Values are expressed as mean ± SEM, control group, sham group, memantine group, Naringin low dose group, Naringin middle dose group, Naringin high dose group: n = 10;CCL2 group: n = 9; Positive drug group: n = 11 (#P < 0.05, ##P < 0.01 vs sham, *P < 0.05, **P < 0.01 vs CCL2)

Full size image

Naringin ameliorates recognition memory in CCL2-administered rats

To further evaluate cognitive function, NORT was performed following the MWM assay. In the CCL2 group, the DIs was significantly reduced compared to the sham group. Compared to the CCL2 group, the naringin-treated groups demonstrated a significant increase in the DI in a dose-dependent manner (F(6, 48) = 4.899, P < 0.001, Fig. 3).

Fig. 3
figure 3

Naringin ameliorates recognition memory of CCL2–administered rats in novel object recognition. Effects of Naringin on cognitive function in CCL2-Induced rats was evaluate by novel object recognition test. a The discrimination index among group. CCL2 group rats showed significant lower discrimination index compared with the Naringin treatment groups. b The discrimination index of individual of each group. Naringin treatment groups rats spent more time to explore the novel object when compared to CCL2 group. Values are expressed as mean ± SEM, control group, sham group, Positive drug group, memantine group, Naringin low dose group, Naringin middle dose group, Naringin high dose group: n = 8; CCL2 group: n = 7 (#P < 0.05, ##P < 0.01 vs sham, *P < 0.05, **P < 0.01 vs CCL2)

Full size image

Naringin protects neurons in the hippocampal CA1 zone

Nissl staining revealed the morphological changes induced in the CA1 structure of the hippocampus. Compared to the sham group, the CCL2 group exhibited numerous damaged neurons in the hippocampal CA1 region, presenting indistinct cell boundaries, with small darkened and shrunken nuclei. In contrast, the naringin-treated groups demonstrated only minimal morphological changes (Fig. 4a). Furthermore, TUNEL staining was used to quantify the number of apoptotic neurons in the CA1 zone. In the CCL2 group, the number of the apoptotic neurons was significantly higher than that in the sham group; naringin treatment inhibited neuronal apoptosis (F(6, 14) = 124.862, P < 0.001, Fig. 4b, c).

Fig. 4
figure 4

The effects of Naringin on neuroprotection. a Represents photomicrographs of Nissl staining of brain tissue sections across hippocampus CA1 region (magnification 400×). b Represents photomicrographs of TUNEL staining of brain tissue sections across hippocampus CA1 region,TUNEL staining to detect neuronal apoptosis in the brain tissues of rats, arrows indicate apoptotic cells (magnification 400×). c The TUNEL-positive cells. Values are expressed as mean ± SEM, n = 3 (#P < 0.05, ##P < 0.01 vs sham, *P < 0.05, **P < 0.01 vs CCL2)

Full size image

Naringin reduces oxidative stress induced by CCL2 in rats

In the hippocampus, the MDA content and enzymatic activity of SOD and GSH-Px were measured using commercial kits. Compared to the sham group, GSH‑Px and SOD activities were significantly decreased in the hippocampus of the CCL2 group, whereas the MDA content was significantly increased. Compared to the CCL2 group, naringin treatment significantly increased the activity of SOD (F(6, 49) = 11.736, P < 0.001, Fig. 5a) and GSH‑Px (F(6, 49) = 6.603, P < 0.001, Fig. 5c) while decreasing the MDA content (F(6, 49) = 48.557, P < 0.001, Fig. 5b).

Fig. 5
figure 5

Effect of different dose of Naringin 25 mg/kg, Naringin 50 mg/kg, and Naringin 100 mg/kg on the oxidative stress status in CCL2 treated rats. The supernatant of hippocampus homogenate was used for the assay of SOD, GSH-PX activity and MDA levels. A significant increase in (a) SOD and (c) GSH-PX activity in Naringin treatment groups compared with model group. b A significant reduction in MDA levels in Naringin treatment groups compared with model group. Values are expressed as mean ± SEM, n = 8 (#P < 0.05, ##P < 0.01, *P < 0.05, **P < 0.01 vs CCL2)

Full size image

Naringin decreases inflammatory-associated mRNA expression

Here, we detected the mRNA expression of IL-6 and IL-1β to evaluate whether naringin could decrease the extent of CCL2-induced inflammation. In the CCL2 group, the mRNA expression levels of IL-6 and IL-1β were significantly higher than the sham group. Compared to the CCL2 group, naringin significantly decreased the mRNA expression of IL-6 (F(6, 17) = 3.087, P < 0.05, Fig. 6a) and IL-1β (F(6, 17) = 2.541, P < 0.05, Fig. 6b).

Fig. 6
figure 6

Effects of Naringin on IL-1β,IL-6 mRNA expression in the hippocampus of CCL2-treated rats. Quantitative real-time PCR analysis of messenger (m)RNA levels. Relative expression of: a IL-1βmRNA and b IL-6mRNA. qPCR analysis showed increased expression of IL-1β,IL-6 mRNA in Hippocampus of CCL2 rats. This result showing that Naringin significantly decreased expression of IL-1β, IL-6 mRNA in CCL2group rat.The experiments were repeated four times independently. Values are expressed as mean ± SEM, n = 4 (#P < 0.05, ##P < 0.01 vs sham, *P < 0.05, **P < 0.01 vs CCL2)

Full size image

Naringin regulates glutamate metabolism-associated mRNA expression

We detected the major regulators involved in glutamate metabolism, including glutamate transporter-1 (GLT-1), glutamate/aspartate transporter (GLAST), and phosphate-activated glutaminase (PAG). In the CCL2 group, the mRNA expression of PAG was higher than that in the sham group, whereas the GLAST and GLT-1 expression levels were lower. Compared to the CCL2 group, naringin significantly decreased the mRNA expression of PAG (F(6, 17) = 2.582, P > 0.05, Fig. 7a) and increased the mRNA expression of GLAST (F(6, 17) = 2.421, P > 0.05, Fig. 7b) and GLT-1(F(6, 17) = 2.723, P < 0.05, Fig. 7c).

Fig. 7
figure 7

Effects of Naringin on PAG, GLAST, and GLT-1mRNA expression in the hippocampus of CCL2-treated rats. Quantitative real-time PCR analysis of messenger (m)RNA levels. Relative expression of: a The PAG mRNA. b The GLAST mRNA. c The GLT-1 mRNA. qPCR analysis showed increased expression of PAG mRNA while decreased expression of GLAST, GLT-1 mRNA in hippocampus of CCL2 rats, This result showing that Naringin significantly decreased expression of PAG mRNA while significantly increased GLAST, GLT-1 mRNA in CCL2 group rat.The experiments were repeated four times independently. Values are expressed as mean ± SEM, n = 4 (#P < 0.05, ##P < 0.01 vs sham, *P < 0.05, **P < 0.01 vs CCL2)

Full size image

Naringin decreases apoptosis-associated mRNA expression

In the CCL2 group, the mRNA expression of cysteine aspartic acid-specific protease 3 (caspase-3), cysteine aspartic acid-specific protease 8 (caspase-8), and Bcl-2 associated X protein (Bax) were significantly upregulated, whereas cell lymphoma/leukaemia-2 (Bcl-2) was downregulated. Compared to the CCL2 group, naringin significantly decreased the mRNA expression levels of caspase-3 (F(6, 17) = 2.269, P > 0.05, Fig. 8a), caspase-8 (F(6, 17) = 3.545, P < 0.05, Fig. 8b), Bax (F(6, 18) = 1.679, P > 0.05, Fig. 8c), and increased Bcl-2 mRNA expression (F(6, 17) = 3.677, P < 0.05, Fig. 8d).

Fig. 8
figure 8

Effects of Naringin oncaspase-3, caspase-8,Bax,Bcl-2mRNA expression in the hippocampus of CCL2-treated rats. Quantitative real-time PCR analysis of messenger (m)RNA levels. Relative expression of: a The caspase-3 mRNA. b The caspase-8 mRNA. c The Bax mRNA expression. d The Bcl-2 mRNA. qPCR analysis showed increased expression of caspase-3, caspase-8, Bax mRNA while decreased expression of Bcl-2 in hippocampus of CCL2 rats, This result showing that Naringin significantly decreased expression of caspase-3, caspase-8, Bax mRNA while significantly increased Bcl-2 mRNA in CCL2 group rat.The experiments were repeated four times independently. Values are expressed as mean ± SEM, n = 4 (#P < 0.05, ##P < 0.01 vs sham, *P < 0.05, **P < 0.01 vs CCL2)

Full size image

Discussion

In addition to its well-characterised immune response function, CCL2 has recently demonstrated a pathophysiological role in several CNS diseases such as stroke, epilepsy, ischaemic brain injury [1], and neurodegenerative diseases [21, 22]. Previously, studies have reported increased CCL2 expression in the cerebrospinal fluid of patients with AD and HAND [6,7,8,9] in association with cognitive decline [6, 10]. Our previous study has demonstrated that CCL2 dose-dependently impairs spatial memory and object recognition in rats [23]. Furthermore, in-depth investigations have elucidated that the potential mechanisms are related to inflammation, oxidative stress, excitotoxicity, and neuronal apoptosis [6, 10]. Thus, CCL2, a multi-potent pathological factor, could be established as a therapeutic target to prevent or treat neurodegenerative diseases. However, currently available anti-CCL2 drugs remain limited. Thus, in the present study, we explored the neuroprotective effects of naringin against CCL2 induced damage.

The MWM and NORT are common behavioural paradigms used to evaluate spatial learning and memory and object cognition in rodents. In the MWM, swimming speeds did not significantly differ among groups, indicating that the surgery and drug treatment did not impair locomotor function in the experimental animals. In the CCL2 group, the escape latency, as well as the swimming distances, were significantly longer compared to the sham group; the crossing times were significantly decreased, confirming the detrimental effects of CCL2 in spatial learning and memory. Additionally, in the CCL2-treated group, NORT exhibited poor object recognition behaviour. However, naringin significantly improved cognition, as indicated by the shorter escape latency and swimming distances, increased crossing times, and DIs. Collectively, these results revealed the protective role of naringin against CCL2-induced cognitive impairment. Notably, a few studies have demonstrated that naringin improves learning and memory impairments induced by gp120, a crucial pathogenic factor of HAND pathogenesis [15].

In the brain, CCL2 is mainly produced by macrophages and microglia, the key mediators of neuroinflammation [24]. During inflammatory progression, CCL2 not only attracts immune cells to specific sites but also promotes the release of other inflammatory factors, including IL-6 and IL-1β, exacerbating the extent of neuroinflammation [10, 11]. Researchers have revealed that naringin demonstrates anti-inflammatory activity. For instance, naringin can attenuate increased tumor necrosis factor-α (TNF-α) levels in a kainic acid-induced animal model [25] and reduce periplaque-activated microglia and astrocytes in APP/PS1 transgenic mice [26]. Therefore, in this study, we examined the hippocampal expression of IL-1β and IL-6 mRNA to elucidate whether naringin could alleviate CCL2-induced neuroinflammation. In the CCL2 group, IL-1β and IL-6 mRNA expression significantly increased compared to the sham group; naringin treatment significantly decreased the mRNA expression of both interleukins, confirming the anti-inflammatory effects of naringin against CCL2-mediated neuroinflammation.

In general, neuroinflammation is accompanied by oxidative stress. Oxidative stress has been known to participate in the pathogenesis of several neurodegenerative diseases [27, 28]. A large number of reactive oxygen species (ROS) produced by oxidative stress can cause lipid peroxidation and DNA damage, provoking secondary neuronal damage, and ultimately damaging cognition [29]. Under normal circumstances, antioxidant defence systems, including antioxidative enzyme systems such as SOD and non-enzyme systems such as GSH-Px, could maintain equilibrium between the oxidative and antioxidative stress levels. For example, SOD scavenges free radicals and prevents lipid peroxidation in vivo to prevent oxidative damage. GSH-Px specifically catalyses hydrogen peroxide (H2O2) into water (H2O) to decrease the expression of H2O2 [16, 29]. Therefore, elevated SOD and GSH-Px activities could directly reflect a powerful antioxidative ability. In addition, the increased expression of MDA, as a major metabolite of lipid oxidation, reflects the oxidative degree [30]. Here, we observed that the expression levels of GSH‑Px and SOD were significantly reduced in the CCL2 group, whereas the expression of MDA was increased. This further confirmed the role of CCL2 in mediating oxidative stress. Naringin treatment markedly increased the expression of GSH‑Px and SOD in the hippocampus, and significantly reduced MDA levels. These results revealed the antioxidative stress effects of naringin. In fact, a few reports have revealed that naringin could ameliorate cognitive deficits by enhancing antioxidative stress [29, 31], as demonstrated by our current results.

In addition, our previous studies have observed that CCL2 can enhance NMDA receptor-mediated EPSC and mediate Ca2+ influx [12, 32]. This can impair the structure of neuronal dendrites in the hippocampal CA1 region and induce neuronal death, indicating that CCL2 can provoke excitotoxicity via a presynaptic mechanism and increase the release of glutamate [12, 32]. As the major excitatory neurotransmitter in the CNS, glutamate is involved in normal synaptic transmission and the process of long-term potentiation (LTP). However, the abnormal and excessive accumulation of glutamate in the synaptic cleft can trigger neuronal damage, termed as excitotoxicity. Physiologically, there is a glutamate-glutamine cycle between neurons and glial cells, mainly regulated by GLT-1, GLAST, and PAG. GLT-1 and GLAST are located in astrocytes; they take in the excessive glutamate and maintain normal neurotransmission. PAG is an enzyme located in the presynaptic terminal and catalyses glutamine to glutamate, which could enhance the level of glutamate [33, 34]. Therefore, the dysregulation of these regulators could lead to the excessive accumulation of glutamate in the synaptic cleft and eventually induce excitotoxicity [35,36,37]. Here, we tested the mRNA expression of PAG, GLAST, GLT-1 to elucidate whether naringin influenced glutamate metabolism. The results demonstrated that compared to the sham group, PAG mRNA expression levels increased, whereas the GLAST and GLT-1 mRNA expression levels decreased in the CCL2 group. In contrast, naringin treatment significantly reduced the PAG mRNA expression and increased the mRNA expression levels of GLAST and GLT-1, demonstrating that naringin has a protective effect on CCL2-induced excitotoxicity via the regulation of glutamate metabolism.

Apoptosis is a type of programmed cell death that clears the aging and necrotic organelles to maintain the normal physiological function in the body [38,39,40]. However, abnormal activation of apoptosis has been known to play a role in the pathophysiological processes of several diseases, including neurodegenerative diseases [12, 32]. In the CNS, neuroinflammation, oxidative stress, and excitotoxicity are the main factors inducing excessive neuronal apoptosis and cognition decline [29, 41,42,43,44]. The present results, combined with our previous research, demonstrated that CCL2 impaired cognitive function; the underlying mechanisms may associate with neuroinflammation, oxidative stress, and excitotoxicity. Thus, we proposed that the CL2 administration can induce hippocampal neuronal apoptosis. First, we observed the morphological changes in the hippocampal CA1 zones using Nissl and TUNEL staining. An obvious impairment of CA1 structure was observed in the CCL2 group via Nissl staining. Additionally, in the CCL2 treatment group, TUNEL staining demonstrated a significant increase in apoptotic hippocampal neurons in the CA1 zone, validating our hypothesis. Reportedly, naringin demonstrates anti-apoptotic effects in a cerebral infarction model [45] and quinolinic acid (QA)-induced neurotoxicity rat mode [46]. In our results, naringin treatment significantly protected the hippocampal neurons, consistent with the other observed outcomes. As apoptosis is regulated by a cascade of genes, we further examined the mRNA expression of caspase-8, caspase-3, Bax, and Bcl-2, to explore the apoptotic pathway. Caspase-8 is the upstream molecule that further activates caspase-3, a key apoptosis executive molecular [47, 48]. Furthermore, Bax and Bcl-2 are important mediators for apoptotic regulation. Bax is released from the mitochondrial inter-membrane space and amplifies the apoptotic signal. Conversely, Bcl-2 possesses anti-apoptotic effects [49,50,51]. In the model group, the mRNA expression levels of caspase-3,caspase-8, and Bax were upregulated, whereas the mRNA expression of Bcl-2 was downregulated. Naringin treatment significantly decreased the mRNA expression of caspase-3,caspase-8,and Bax, and significantly increased Bcl-2 expression, suggesting anti-apoptotic properties.

Conclusion

In our study, we observed that naringin can afford protection against CCL2-induced cognition impairment; moreover, the underlying mechanisms were related to reduced inflammation, antioxidative stress, anti-apoptosis, and glutamate metabolism, indicating the potential neuronal protective effects of naringin as shown in Fig. 9.

Fig. 9
figure 9

Naringin improves CCL2-induced cognition impairment mechanism illustration. Naringin treatment inhibited the oxidation, inflammation, reducing excitotoxicity and ultimately alleviating neurons apotosis and damage in rats with learning and memory impairment

Full size image

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on request.

References

  1. Bose S, Cho J. Role of chemokine CCL2 and its receptor CCR2 in neurodegenerative diseases. Arch Pharm Res. 2013;36(9):1039–50.

    Article  CAS  PubMed  Google Scholar 

  2. Xie RG, Gao YJ, Park CK, Lu N, Luo C, Wang WT, Wu SX, Ji RR. Spinal CCL2 promotes central sensitization, long-term potentiation, and inflammatory pain via CCR2: further insights into molecular, synaptic, and cellular mechanisms. Neurosci Bull. 2017;34(1):1–9.

    Google Scholar 

  3. Yu FPS, Dworski S, Medin JA. Deletion of MCP-1 impedes pathogenesis of acid ceramidase deficiency. Sci Rep. 2018;8(1):1808.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  4. Galasso JM, Liu Y, Szaflarski J, Warren JS, Silverstein FS. Monocyte chemoattractant protein-1 is a mediator of acute excitotoxic injury in neonatal rat brain. Neuroscience. 2000;101(3):737–44.

    Article  CAS  PubMed  Google Scholar 

  5. Galasso JM, Miller MJ, Cowell RM, Harrison JK, Warren JS, Silverstein FS. Acute excitotoxic injury induces expression of monocyte chemoattractant protein-1 and its receptor, CCR2, in neonatal rat brain. Exp Neurol. 2000;165(2):295–305.

    Article  CAS  PubMed  Google Scholar 

  6. Carvallo L, Lopez L, Che FY, Lim J, Eugenin EA, Williams DW, et al. Buprenorphine decreases the CCL2-mediated chemotactic response of monocytes. J Immunol. 2015;194(7):3246–58.

    Article  CAS  PubMed  Google Scholar 

  7. Lee WJ, Liao YC, Wang YF, Lin IF, Wang SJ, Fuh JL. Plasma MCP-1 and cognitive decline in patients with Alzheimer’s disease and mild cognitive impairment: a two-year follow-up study. Sci Rep. 2018;8(1):1280.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  8. Dhillon NK, Williams R, Callen S, Zien C, Narayan O, Buch S. Roles of MCP-1 in development of HIV-dementia. Front Biosci. 2008;13(10):3913–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Thames AD, Briones MS, Magpantay LI, Martinez-Maza O, Singer EJ, Hinkin CH, Morgello S, et al. The role of chemokine C-C motif ligand 2 genotype and cerebrospinal fluid chemokine C-C motif ligand 2 in neurocognition among HIV-infected patients. AIDS. 2015;29(12):1483–91.

    Article  CAS  PubMed  Google Scholar 

  10. Xu J, Dong H, Qian Q, Zhang X, Wang Y, Jin W, Qian Y. Astrocyte-derived CCL2 participates in surgery-induced cognitive dysfunction and neuroinflammation via evoking microglia activation. Behav Brain Res. 2017;332:145–53.

    Article  CAS  PubMed  Google Scholar 

  11. Persidsky Y, Hill J, Zhang M, Dykstra H, Winfield M, Reichenbach NL, et al. Dysfunction of brain pericytes in chronic neuroinflammation. J Cereb Blood Flow Metab. 2016;36(4):794–807.

    Article  CAS  PubMed  Google Scholar 

  12. Zhou Y, Tang H, Xiong H. Chemokine CCL2 enhances NMDA receptor-mediated excitatory postsynaptic current in rat hippocampal slices-a potential mechanism for HIV-1-associated neuropathy? J Neuroimmune Pharmacol. 2016;11(2):306–15.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Hsueh TP, Sheen JM, Pang JH, Bi KW, Huang CC, Wu HT, Huang ST. The anti-atherosclerotic effect of naringin is associated with reduced expressions of cell adhesion molecules and chemokines through NF-κB pathway. Molecules. 2016;21(2):195.

    Article  PubMed Central  CAS  Google Scholar 

  14. Igase M, Okada Y, Ochi M, Igase K, Ochi H, Okuyama S, Furukawa Y, Ohyagi Y. Auraptene in the peels of Citrus kawachiensis (Kawachibankan) contributes to the preservation of cognitive function: a randomized, placebo-controlled, double-blind study in healthy volunteers. J Prev Alzheimers Dis. 2018;5(3):197–201.

    CAS  PubMed  Google Scholar 

  15. Qin S, Chen Q, Wu H, Liu C, Hu J, Zhang D, Xu C. Effects of naringin on learning and memory dysfunction induced by gp120 in rats. Brain Res Bull. 2016;124:164–71.

    Article  CAS  PubMed  Google Scholar 

  16. Liu X, Liu M, Mo Y, Peng H, Gong J, Li Z, Chen J, Xie J. Naringin ameliorates cognitive deficits in streptozotocin-induced diabetic rats. Iran J Basic Med Sci. 2016;19(4):417–22.

    PubMed  PubMed Central  Google Scholar 

  17. Wang D, Yan J, Chen J, Wu W, Zhu X, Wang Y. Naringin improves neuronal insulin signaling, brain mitochondrial function, and cognitive function in high-fat diet-induced obese mice. Cell Mol Neurobiol. 2015;35(7):1061–71.

    Article  CAS  PubMed  Google Scholar 

  18. Lee CH, Jeong TS, Choi YK, Hyun BH, Oh GT, Kim EH, et al. Anti-atherogenic effect of citrus flavonoids, naringin and naringenin, associated with hepatic ACAT and aortic VCAM-1 and MCP-1 in high cholesterol-fed rabbits. Biochem Biophys Res Commun. 2001;284(3):681–8.

    Article  CAS  PubMed  Google Scholar 

  19. Vorhees CV, Williams MT. Morris water maze: procedures for assessing spatial and related forms of learning and memory. Nat Protoc. 2006;1(2):848–58.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Leger M, Quiedeville A, Bouet V, Haelewyn B, Boulouard M, Schumann-Bard P, et al. Object recognition test in mice. Nat Protoc. 2013;8(12):2531–7.

    Article  CAS  PubMed  Google Scholar 

  21. Tian DS, Peng J, Murugan M, Feng LJ, Liu JL, Eyo UB, et al. Chemokine CCL2-CCR2 signaling induces neuronal cell death via STAT3 activation and IL-1β production after status epilepticus. J Neurosci. 2017;37(33):7878–92.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. Hirt-Minkowski P, Rush DN, Gao A, Hopfer H, Wiebe C, Nickerson PW, Schaub S, Ho J. Six-month urinary CCL2 and CXCL10 levels predict long-term renal allograft outcome. Transplantation. 2016;100(9):1988–96.

    Article  CAS  PubMed  Google Scholar 

  23. Chen JM, Tan LQ, Jiang JJ, et al. Effects of chemokine CCL2 on learning memory in rats and its mechanisms. Chin Pharmacol Bull. 2019;35(7):62–7.

    Google Scholar 

  24. Sawyer AJ, Tian W, Saucier-Sawyer JK, Rizk PJ, Saltzman WM, Bellamkonda RV, Kyriakides TR. The effect of inflammatory cell-derived MCP-1 loss on neuronal survival during chronic neuroinflammation. Biomaterials. 2014;35(25):6698–706.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Jeong KH, Jung UJ, Kim SR. Naringin attenuates autophagic stress and neuroinflammation in kainic acid-treated hippocampus in vivo. Evid Based Complement Alternat Med. 2015;2015:1–9.

    Google Scholar 

  26. Yang W, Zhou K, Zhou Y, An Y, Hu T, Lu J, et al. Naringin dihydrochalcone ameliorates cognitive deficits and neuropathology in APP/PS1 transgenic mice. Front Aging Neurosci. 2018;10:169.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  27. Nookala AR, Shah A, Noel RJ, Kumar A. HIV-1 tat-mediated induction of CCL5 in astrocytes involves NF-κB, AP-1, C/EBPα and C/EBPγ transcription factors and JAK, PI3K/Akt and p38 MAPK signaling pathways. PLoS ONE. 2013;8(11):78855.

    Article  CAS  Google Scholar 

  28. Tremblay MÈ, Marker DF, Puccini JM, Muly EC, Lu SM, Gelbard HA. Ultrastructure of microglia-synapse interactions in the HIV-1 tat-injected murine central nervous system. Commun Integr Biol. 2013;6(6):e27670.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  29. Qi Z, Xu Y, Liang Z, Li S, Wang J, Wei Y, Dong B. Naringin ameliorates cognitive deficits via oxidative stress, proinflammatory factors and the PPARγ signaling pathway in a type 2 diabetic rat model. Mol Med Rep. 2015;12(5):7093–101.

    Article  CAS  PubMed  Google Scholar 

  30. Liu YW, Zhu X, Yang QQ, Lu Q, Wang JY, Li HP, et al. Suppression of methylglyoxal hyperactivity by mangiferin can prevent;diabetes-associated cognitive decline in rats. Psychopharmacology. 2013;228(4):585–94.

    Article  CAS  PubMed  Google Scholar 

  31. Viswanatha GL, Shylaja H, Moolemath Y. The beneficial role of naringin—a citrus bioflavonoid, against oxidative stress-induced neurobehavioral disorders and cognitive dysfunction in rodents: a systematic review and meta-analysis. Biomed Pharmacother. 2017;94(10):909–29.

    Article  CAS  PubMed  Google Scholar 

  32. Zhou Y, Liu J, Xiong H. HIV-1 glycoprotein 120 enhancement of N-methyl-d-aspartate NMDA receptor-mediated excitatory postsynaptic currents: implications for HIV-1-associated neural injury. J Neuroimmune Pharmacol. 2017;12(2):314–26.

    Article  PubMed  Google Scholar 

  33. Hu X, Yang J, Sun Y, Gao X, Zhang L, Li Y, et al. Lanthanum chloride impairs memory in rats by disturbing the glutamate-glutamine cycle and over-activating NMDA receptors. Food Chem Toxicol. 2018;113:1–13.

    Article  CAS  PubMed  Google Scholar 

  34. Shimamoto A, Rappeneau V, Munjal H, Farris T, Davis C, Wilson A, et al. Glutamate-glutamine transfer and chronic stress-induced sex differences in cocaine responses. Neuroscience. 2018;391:104–19.

    Article  CAS  PubMed  Google Scholar 

  35. Tong H, Zhang X, Meng X, Xu P, Zou X, Qu S. Amyloid-beta peptide decreases expression and function of glutamate transporters in nervous system cells. Int J Biochem Cell Biol. 2017;85:75–84.

    Article  CAS  PubMed  Google Scholar 

  36. Pu B, Xue Y, Wang Q, Hua C, Li X. Dextromethorphan provides neuroprotection via anti-inflammatory and anti-excitotoxicity effects in the cortex following traumatic brain injury. Mol Med Rep. 2015;12(3):3704–10.

    Article  CAS  PubMed  Google Scholar 

  37. King AE, Woodhouse A, Kirkcaldie MT, Vickers JC. Excitotoxicity in ALS: overstimulation, or overreaction? Exp Neurol. 2016;275(Pt 1):162–71.

    Article  CAS  PubMed  Google Scholar 

  38. Lopez NE, Gaston L, Lopez KR, Coimbra RC, Hageny A, Putnam J, et al. Early ghrelin treatment attenuates disruption of the blood brain barrier and apoptosis after traumatic brain injury through a UCP-2 mechanism. Brain Res. 2012;1489(18):140–8.

    Article  CAS  PubMed  Google Scholar 

  39. Wang HC, Yang TM, Lin YJ, Chen WF, Ho JT, Lin YT, et al. Serial serum leukocyte apoptosis levels as predictors of outcome in acute traumatic brain injury. BioMed Res Int. 2014;2014(3):720870.

    PubMed  PubMed Central  Google Scholar 

  40. Zhang L, Ding K, Wang H, Wu Y, Xu J. Traumatic brain injury-induced neuronal apoptosis is reduced through modulation of PI3K and autophagy pathways in mouse by FTY720. Cell Mol Neurobiol. 2016;36(1):131–42.

    Article  CAS  PubMed  Google Scholar 

  41. Liu S, Zhang L, Wu Q, Wu Q, Wang T. Chemokine CCL2 induces apoptosis in cortex following traumatic brain injury. J Mol Neurosci. 2013;51(3):1021–9.

    Article  CAS  PubMed  Google Scholar 

  42. Sun C, Zhang YY, Tang CL, Wang SC, Piao HL, Tao Y, et al. Chemokine CCL28 induces apoptosis of decidual stromal cells via binding CCR3/CCR10 in human spontaneous abortion. Mol Hum Reprod. 2013;19(10):676–86.

    Article  CAS  PubMed  Google Scholar 

  43. Lawrence DM, Seth P, Durham L, Diaz F, Boursiquot R, Ransohoff RM, Major EO. Astrocyte differentiation selectively upregulates CCL2/monocyte chemoattractant protein-1 in cultured human brain-derived progenitor cells. Glia. 2010;53(1):81–91.

    Article  Google Scholar 

  44. Muratori C, Mangino G, Affabris E, Federico M. Astrocytes contacting HIV-1-infected macrophages increase the release of CCL2 in response to the HIV-1-dependent enhancement of membrane-associated TNFα in macrophages. Glia. 2010;58(16):1893–904.

    Article  PubMed  Google Scholar 

  45. Gaur V, Aggarwal A, Kumar A. Protective effect of naringin against ischemic reperfusion cerebral injury: possible neurobehavioral, biochemical and cellular alterations in rat brain. Eur J Pharmacol. 2009;616(1–3):147–54.

    Article  CAS  PubMed  Google Scholar 

  46. Cui J, Wang G, Kandhare AD, Mukherjee-Kandhare AA, Bodhankar SL. Neuroprotective effect of naringin, a flavone glycoside in quinolinic acid-induced neurotoxicity: possible role of PPAR-γ, Bax/Bcl-2, and caspase-3. Food Chem Toxicol. 2018;121:95–108.

    Article  CAS  PubMed  Google Scholar 

  47. Liu HC, Zhang Y, Zhang S, Xin T, Li WH, Wu WL, et al. Correlation research on the protein expression (p75NTR, bax, bcl-2, and caspase-3) and cortical neuron apoptosis following mechanical injury in rat. Eur Rev Med Pharmacol Sci. 2015;19(18):3459–67.

    PubMed  Google Scholar 

  48. Zhao T, Fu Y, Sun H, Liu X. Ligustrazine suppresses neuron apoptosis via the Bax/Bcl-2 and caspase-3 pathway in PC12 cells and in rats with vascular dementia. IUBMB Life. 2018;70(1):60–70.

    Article  CAS  PubMed  Google Scholar 

  49. Yao Q, Wang W, Jin J, Min K, Yang J, Zhong Y, et al. Synergistic role of caspase-8 and caspase-3 expressions: prognostic and predictive biomarkers in colorectal cancer. Cancer Biomark. 2018;21(4):899–908.

    Article  CAS  PubMed  Google Scholar 

  50. Li J, Wang Q, Wang Z, Cui N, Yang B, Niu W, et al. Tetrandrine inhibits colon carcinoma HT-29 cells growth via the Bcl-2/caspase 3/PARP pathway and G1/S phase. Biosci Rep. 2019;39:BSR20182109.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Rubio C, Mendoza C, Trejo C, Custodio V, Rubio-Osornio M, Hernández L, et al. Activation of the extrinsic and intrinsic apoptotic pathways in cerebellum of kindled rats. Cerebellum. 2019;18(4):750–60.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the National Natural Science Foundation of China and the National Foundation of Guangxi for financial support. The authors are also thankful to the Departmental Facility and Central Facility at the Guangxi Medical University Life Science Research Institute.

Funding

This work was supported by the National Natural Foundation of China (No 81660213, 81360192, 81660706), the National Foundation of Guangxi (No 2017GXNSFAA198187, 2018JJA140536), and the Guangxi First-class Discipline Project for Pharmaceutical Sciences (No. GXFCDP-PS-2018).

Author information

Author notes

  1. Jiang-yi Long—The first author

Authors and Affiliations

  1. Department of Pharmacology, Guangxi Medical University, Nanning, 53002, Guangxi, China

    Jiang-yi Long, Jian-min Chen, Yuan-jun Liao, Yi-jun Zhou & Yan Zhou

  2. Guangxi Key Laboratory of AIDS Prevention and Treatment, Guangxi Medical University, Nanning, 530021, Guang, China

    Bing-yu Liang

Authors
  1. Jiang-yi Long
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jian-min Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuan-jun Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yi-jun Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bing-yu Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yan Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JL and YZ were involved in designing this study JC conducted the behavioural analysis and data acquisition. All authors were involved in the experimentation and analysis of data and provided their intellectual input. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Yan Zhou.

Ethics declarations

Ethics approval and consent to participate

The experiments were performed on animals as per the norms of the Institutional Ethics Committee, GXMU, China.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Long, Jy., Chen, Jm., Liao, Yj. et al. Naringin provides neuroprotection in CCL2-induced cognition impairment by attenuating neuronal apoptosis in the hippocampus. Behav Brain Funct 16, 4 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12993-020-00166-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12993-020-00166-6

Keywords

Behavioral and Brain Functions

ISSN: 1744-9081

Contact us