Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Jul 9;15(7):e0223395. doi: 10.1371/journal.pone.0223395

Prenatal exposure to the probiotic Lactococcus lactis decreases anxiety-like behavior and modulates cortical cytoarchitecture in a sex specific manner.

Natalia Surzenko 1,2,*,#, Eneda Pjetri 1,#, Carolyn A Munson 1, Walter B Friday 1, Jonas Hauser 3, Ellen Siobhan Mitchell 3,*
Editor: Judith Homberg4
PMCID: PMC7347133  PMID: 32645024

Abstract

Development of the cerebral cortex may be influenced by the composition of the maternal gut microbiota. To test this possibility, we administered probiotic Lactococcus lactis in drinking water to mouse dams from day 10.5 of gestation until pups reached postnatal day 1 (P1). Pups were assessed in a battery of behavioral tests starting at 10 weeks old. We found that females, but not males, exposed to probiotic during prenatal development spent more time in the center of the open field and displayed decreased freezing time in cue associated learning, compared to controls. Furthermore, we found that probiotic exposure changed the density of cortical neurons and increased the density of blood vessels in the cortical plate of P1 pups. Sex-specific differences were observed in the number of mitotic neural progenitor cells, which were increased in probiotic exposed female pups. In addition, we found that probiotic treatment in the latter half of pregnancy significantly increased plasma oxytocin levels in mouse dams, but not in the offspring. These results suggest that exposure of naïve, unstressed dams to probiotic may exert sex-specific long-term effects on cortical development and anxiety related behavior in the offspring.

Introduction

Neocortical development is influenced by a variety of environmental factors, including maternal nutrition, stress and exposure to pathogens. In terms of cortical patterning and growth, the impact of essential micronutrients, such as choline, has been well-characterized; however, less is known on the influence of food-derived microbiota, e.g. probiotics and alterations in cortical development at different stages [1]. While the fetal gut is sterile before birth, it is increasingly clear that factors from the maternal microbiota can induce specific patterns of gene expression in the fetal gut, as well as in the brain [13]. After birth, microbial colonization of the infant gastrointestinal tract has been shown to have widespread influence on brain development and behavior [4]. For example, mice whose gut microbiota were depleted via antibiotics or who were raised in a germ-free facility, demonstrated exaggerated responses to stress and social stimuli, and displayed neurochemical and brain structural abnormalities [5, 6]. Recently, neonatal exposure to probiotics, such as Bifidobacterium longum and Lactobacillus rhamnosous, have been shown to reverse maladaptive learning behaviors in innately anxious mice [7]. Probiotics have also alleviated behavioral effects in other models of anxiety disorders, such as those induced by maternal separation, social defeat or other types of early life stress [810]. Mounting data on brain-gut axis has revealed several pathways where probiotic treatment can affect microbiota populations, brain signaling, and subsequently anxiety in mouse models of disease [1, 7, 9]. However, there is less consensus on the behavioral effects of probiotics in naïve, wild type mice lacking exposure to stress paradigms.

Neurochemical investigations have revealed that probiotic treatment reduced inflammatory cytokines and stress-related hormones, which are often chronically activated in anxiety disorders [7, 11]. For instance, modulation of the vagus nerve has been implicated in behavioral effects of probiotics, since vagal resection blocks the anti-inflammatory, anxiolytic activity of probiotics [11]. Additionally, probiotics may impact brain development by improving maternal health and immune-mediated stress responses. Exposure to probiotics, such as Lactobacillus reuteri, can increase plasma oxytocin [12], potentially enhancing nurture instincts and pup handling in treated dams. Studies such as these implicate changes in neuroendocrine signaling brought on by plasma metabolites derived from the probiotics or from specific commensal microbiota interacting with the probiotics. In fetuses with rudimentary microbiomes, metabolites from maternal microbiome access the fetal blood stream via placental transfer [2]. However, there is a dearth of knowledge on how probiotic exposure in utero, i.e. before postnatal colonization, affects structural brain development in wild type, naïve neonates. In the present study, we investigated whether neonatal exposure to the probiotic Lactococcus lactis (L. lactis) induces long-lasting changes in cortical layer structure. We found that the density of distinct types of cortical neurons were changed by probiotic exposure, as well as increased proliferation of cortical neural progenitor cells. Additionally, we measured anxiety and emotional learning capacity in probiotic-exposed mice and found that maternal L. lactis exposure ameliorates anxiety-related behavior in offspring.

Materials and methods

Animals

All experiments were performed at the David H. Murdock Research Institute Center for Laboratory Animal Science facilities in accordance with the standards of the U.S. National Institutes of Health Guide for Care and Use of Laboratory Animals and were approved by the Institutional Animal Care and Use Committee at this facility. Nestin-CFPnuc transgenic mice were generously provided by Grigori Enikolopov (Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA) [13] and were maintained on a mixed C57BL/6J and C57BL6/N background (97% C57BL/6J). Mice were habituated to modified AIN93G diet (#103186, Dyets Inc., Bethlehem, PA) for at least two weeks before breeding and until the end of the experiments.

Pregnant dams were randomly divided in two groups: one group was given the probiotic Lactococcus lactis (L. lactis) in drinking water (5X10^5 CFU/ml) from gestational day (GD) 10.5 to postnatal day 1 while the other group (Control) received drinking water only. The drinking water was refreshed daily. Probiotic CFU was confirmed to remain unchanged after study completion.

Behavioral tests

Mice were tested at 10–13 weeks in the behavioral battery for locomotor activity and anxiety-like behavior in open field, exploratory behavior in object investigation, anxiety-like behavior in the light-dark box test and learning and memory in fear conditioning test [14]. In the control group, nine male and ten female mice were tested, while in the L.lactis exposed group, ten males and twelve females were tested. The mice were littermates from multiple litters. The mice were kept on a 12:12 hr light-dark schedule and were tested in the light phase, in addition, male and female mice were tested on separate days and were given at least 48 hr between the tests.

Open field test

A widely used test to assess locomotor activity and as a measure of anxiety-like behavior in a novel, stressful environment [15]. The open field was a circular arena with diameter 80 cm and height 35 cm that was evenly illuminated with white light. The mice were allowed to explore for 5 min while the test was recorded and analyzed with an automated tracking system, Ethovision XT® (Noldus Information Technologies, The Netherlands). We measured total distance moved, velocity, latency to center zone, and total duration in the center zone.

Object investigation test

In this test, we measured the exploratory activity of a mouse towards a novel non-aversive object placed in the center of the arena after they are familiar with the environment [16, 17]. The mice started facing the wall in the same open field arena and allowed to habituate for 2 min. Then, the novel object is introduced in the center of the arena and the mice are allowed to explore it freely for 3 min. The total time investigating the object was scored manually.

Light-dark box

The light-dark exploration test is used to measure anxiety-like behavior and the conflict between rodents’ exploratory behavior and aversion to open and brightly illuminated areas [18].

The test box (44 × 21 × 21 cm; l x w x h) is divided into two unequal compartments by a partition (1 cm) with a small aperture (5 × 7 cm) in the center by the floor level, allowing the mice to move freely between the chambers. The dark chamber, 1/3 of the box, is black and covered with a lid. The light chamber is white and brightly illuminated. The test mouse was placed into the dark chamber facing the end wall and allowed to explore for 5-min. Ethovision XT® was used to record locomotor activity in the light zone. Transition between chambers, when all four paws are placed in one chamber, was scored manually. Duration in each chamber and the latency to go to the light chamber was also recorded.

Contextual and cued fear conditioning test

Contextual and cued fear conditioning was performed using a conditioned fear paradigm over 3-days using Near-Infrared image tracking system (MED Associates, Burlington, VT) [19]. On the first day, after an initial 2-min exploration time (background activity), mice were exposed to a 30-s tone (85 dB, 2800Hz), followed by a 2-s scrambled foot shock (0.75mA) (CS1) under white light conditions. Mice received 3 additional tone-shock pairings (CS2 and CS3), with 80-s between the stimuli pairings, totaling a 9.2-min session. The response to the shock was measured with automatic assessment of the levels of freezing (immobility, except for breathing) using the Video Freeze (MED Associates Inc.) software. All mice learned the association between the tone and the shock, and the response to the tone increased with each pairing.

Immunohistochemistry

P1 brains, representing pups from 4–5 independent litters, were fixed in 4% PFA, cryopreserved through incubation in 10%-20%-30% sucrose/1 X PBS gradient over 72 hours at 4°C, mounted in O.C.T. compound and stored at -20°C. Brains were cryo-sectioned coronally at 20 μm over a series of 7 slides, such that each slide contained representative non-consecutive brain sections. Slides were re-hydrated in 1X PBS and incubated in blocking solution containing 2% goat serum/0.01% Triton-X in 1X PBS for 1 hour at room temperature. Antibodies were dissolved in blocking solution and applied over night at 4°C as follows: anti-PECAM1 (rat, 1:50; Thermo Fisher Scientific); anti-PH3 (rabbit, 1:1000; Millipore-Sigma) anti-Satb2 (mouse, 1:250; Abcam); anti-Tbr1 (rabbit, 1:250; Abcam). DAPI (1:4000; Millipore-Sigma) was used to detect cell nuclei. The following secondary antibodies were used: goat anti-rabbit CY3 (1:250; Jackson Immunoresearch); goat anti-mouse Alexa488 (1:1000; Jackson Immunoresearch); goat anti-rat CY3 (1:250; Jackson Immunoresearch).

Image acquisition and cell density analyses

Image z-stacks were acquired using Zeiss LSM710 laser scanning confocal microscope and 20X objective. Obtained stacks spanned 12–14 μm and contained 5–7 optical slices. Brains were analyzed at the level of the presumptive visual cortex. ImageJ (NIH) software was used in manual and automated cell density analyses. Tbr1-expressing cells were manually counted in 60 x 60 μm regions of the lower cortical plate. Satb2-expressing cells were manually counted in 60 x 60 μm regions of the upper cortical plate. PECAM1-expressing blood vessels were manually counted in 100 x 100 μm regions of the upper cortical plate; fluorescence intensity and blood vessel areas were measured using ImageJ automated particle analysis module. PH3-expressing cells in the ventricular zone were manually counted on images collected at 10X magnification.

Oxytocin measurements

Dams were administered probiotics in water, or water alone (control) starting at day 10.5 of pregnancy and plasma was collected 1 day after birth. Plasma oxytocin was extracted and measured according to the protocol supplied by the manufacturer of the ELISA kit (Enzo Life Sciences; ADI-900-153A-0001). Measurements were conducted using BioTek Synergy2 plate reader.

Statistical analyses

Statistical analyses were performed with IBM SPSS Statistics (behavioral assays) and Graphpad (Prism) software. Data were checked for outliers using Grubbs test, normality using the Shapiro-Wilk test of normality and, for homogeneity of variances using Levene’s test. Independent samples T-Test and to account for sex effects, two-way ANOVA analysis, with treatment (control and probiotic) and sex (male and female) as factors, was used to analyze the data. When there was a significant sex effect, a separate analysis by sex was conducted. If the data were not normally distributed, non-parametric Mann-Whitney test was used. In the fear conditioning experiment, repeated-measures ANOVA was also used to analyze the freezing behavior during the tests. Results are expressed as mean ± SEM unless otherwise specified.

Results

Maternal probiotic supplementation reduces anxiety-like offspring behavior in light-dark box test

To evaluate whether prenatal exposure to probiotics impacts anxiety-like behavior, mice were tested in the open field and light-dark box and novel object exploration test. In the light-dark box test, there was a significant interaction between the effects of sex and treatment on activity levels in the light zone (F(1,36) = 4.54, p = 0.04, Fig 1A). A separate by sex t-test analysis showed that this effect was driven by female mice (Control 193.5 ± 45 cm and L. lactis 323 ± 126 cm, p = 0.005, Student’s t-test) while there was no difference in male mice (Control 258.2 ± 97 cm and L. lactis 252.5 ± 104 cm, p > 0.05, Student’s t-test, Fig 1B). The L. lactis-exposed mice spent 10% more time in the light zone than the controls, but this difference did not reach significance with two-way ANOVA analysis for either simple main effects or interaction between these effects (p > 0.05, Fig 1C). Main effects analysis showed a trend for significance for the effects of in utero L. lactis exposure (F(1,36) = 3.817, p = 0.059), but there were no differences between males and females (p > 0.05).

Fig 1. Maternal probiotic supplementation reduces anxiety-like offspring behavior in light-dark box test.

Fig 1

(A) There was a significant interaction between the effects of sex and treatment on activity levels in the light zone (p = 0.04). (B) The difference in (A) was driven by female mice (p = 0.005). (C) Probiotic-exposed mice (male n = 9 and female n = 12) spent 10% more time than the controls ((male n = 9 and female n = 10) in the light zone, however this didn’t reach significance.

In the open field, the latency to enter the center zone is lower in L. lactis-exposed mice than in control mice. However, this difference did not reach significance (Control 49.09 ± 15.7s and L. lactis 17.73 ± 3.9s, p = 0.06, S1A Fig) and there were no sex differences (p > 0.05). The activity levels were similar between the groups (Control 2547 ± 112 cm and L. lactis 2795 ± 103 cm, p > 0.05) and there were no sex differences (p > 0.05). We also looked at the percentage of time spent in the center as another measure of anxiety-like behavior. We did not find an effect of L. lactis treatment (Control 6.84 ± 1.63% and L. lactis 7.04 ± 1.38%, p > 0.05), but there was a strong main effect of sex, with female mice spending significantly more time in the center than male mice (F(1,37) = 100, p < 0.001, S1B Fig).

In the novel object exploration test, there was no difference in the latency to approach the object (Control 45.56 ± 9.53 s and L. lactis 29.98 ± 7.22 s, p > 0.05 S2A Fig), and there were no main effects of sex. Time spent investigating the object was not different between the groups (Control 8.94 ± 2.15 s and L. lactis 11.23 ± 2.86 s, p > 0.05 S2B Fig).

Maternal probiotic supplementation differentially affects female mice in fear conditioning test

Treatment with probiotic did not affect conditioning, when analyzed with repeated measures ANOVA (p > 0.05). There was a significant interaction between sex and group (F(1.34) = 4.257, p = 0.047) with control female mice showing higher levels of freezing than males, however, the main effect of sex did not reach significance (p = 0.06; Fig 2A).

Fig 2. Maternal probiotic supplementation differentially affects female mice in fear conditioning test.

Fig 2

(A) In utero exposure to probiotics did not affect conditioning of the mice. Control female mice (n = 10) showed higher levels of freezing than males (n = 8), however, the main effect of sex did not reach significance (p = 0.06). (B) Probiotic exposure did not have an effect on the contextual memory of mice. Though female mice (n = 10) showed higher levels of freezing than male mice (n = 10), separate sex analysis showed no treatment effect. (C) Probiotic exposure did not affect the first minute response to tone, but there is a significant treatment effect in female mice, shown in detail in panel (D).

On the following day, mice were evaluated for their context-dependent learning. Mice were placed back into the original test chamber for a 5-min session, this time with no tone or foot shock. Probiotic treatment did not have an effect on the first minute response (p > 0.05) and there was no interaction between group and sex with univariate ANOVA (p > 0.05). However, there was a significant sex effect (F(1.34) = 4.287, p = 0.046) with female mice showing higher levels of freezing. Separate analysis in female and male mice showed no treatment effect (p > 0.05, S3A Fig). Repeated measures analysis, for the 5 minutes of the session, showed no differences between the groups and also no effect of sex (p > 0.05, Fig 2B). Analysis of average freezing time during the 5-min session showed no effect of treatment or sex (p > 0.05, S3B Fig).

On the third day of testing, associative learning to the tone cue was evaluated. The conditioning chambers were modified by turning off the white light and keeping only Near-Infrared light, by modifying the chamber using a black Plexiglas insert in an A-shape to change the wall and another insert to change the floor surface, and, by adding a novel odor (vanilla flavoring). Mice were placed in the modified chamber and allowed to explore it for a final 5-min session. After 2-min, the acoustic stimulus was presented continuously for a 3-min period. Compared to control, probiotic treatment did not have an effect on the first minute response to tone (p > 0.05) and there was no interaction between group and sex, or a sex effect with univariate ANOVA (p > 0.05, S4A Fig). Repeated measures analysis for the 3 minutes of tone presentation showed no differences between the groups (p > 0.05) and neither the interaction between groups and sex, nor sex effect, reached statistical significance (p > 0.05, Fig 2C). However, separate analysis in female and male mice showed a significant treatment effect with repeated measures analysis for the 3 minutes of tone presentation in female mice (F(1.18) = 5.700, p = 0.028, Fig 2D) but not in male mice (p > 0.05). Treatment with probiotic reduced the freezing time in female mice in the second and third minutes of tone presentation, while the female mice in the control group maintained similar freezing levels. Overall, the above results suggest that probiotics are predominantly affecting female behavior after in utero exposure.

L. lactis exposure during pregnancy induces an increase in maternal oxytocin levels

Oxytocin is a known hormonal mediator of maternal behavior [20]. To examine whether L. lactis exposure during pregnancy may increase maternal oxytocin levels, we measured oxytocin in plasma of treated and control dams 1 day after birth (Fig 3). We find that oxytocin levels are significantly increased in plasma of L. lactis-treated dams compared to control dams (Fig 3A; p = 0.0008 by Student’s t-test). Oxytocin levels were not increased in plasma of pups at P28 (Fig 3B). These results suggest that probiotics exposure during pregnancy may modulate the levels of maternal oxytocin.

Fig 3. Increase in plasma oxytocin levels in probiotics-treated dams.

Fig 3

(A) Oxytocin levels are increased in the plasma of dams treated with L. lactis between day 0.5 of pregnancy and 1 day after birth (n = 5) compared to Control dams (n = 8). P = 0.0008 by Student’s t-test. (B) Plasma oxytocin levels remain unchanged in 3-month old male and female pups exposed to L. lactis between E0.5 and P1 (n = 5–6 per sex/group).

Maternal supplementation with L. lactis modulates development of cortical vasculature in the pups

Maternal gut microbiota is known to influence blood vessel permeability in the developing embryo [21]. In this study, we examined whether the process of blood vessel formation during cortical development is impacted by maternal exposure to L. lactis. To this end, we evaluated the expression of PECAM1 (CD31), an endothelial cell marker, in the developing cortices of L. lactis-exposed compared to control P1 pups. We find that blood vessel number in the cortical plate is increased in probiotics-exposed male (p = 0.0007 by Student’s t-test) and female (p = 0.0037 by Student’s t-test) pups compared to control pups (Fig 4A–4C). Furthermore, expression levels of PECAM1, measured by fluorescence intensity, is increased in L. lactis-exposed pups (Fig 4B and 4E; p = 0.0002 by Student’s t-test). Finally, analysis of blood vessel areas reveals an increase in the average blood vessel area in probiotics-exposed compared to control pups (Fig 4F; p = 0.0006). Together, these results demonstrate that maternal exposure to probiotics modulates formation of the vasculature in the developing embryonic brain.

Fig 4. Maternal exposure to probiotics modulates formation of cortical vasculature in the pups.

Fig 4

(A) Blood vessel outlines based on CD31 expression demonstrate increase in the density of cortical blood vessels in probiotic-exposed P1 pups compared to control pups. Counting masks are shown in red. (B) Immunofluorescent images of CD31 staining show increased staining intensity in P1 L. lactis-exposed compared to control cortices. White squares designate areas of blood vessel density analyses. (C-D) Increase in blood vessel density within the cortical wall is detected in both male (C; p = 0.0007 by Students t-test; control n = 18; L. lactis n = 9) and female (D; p = 0.0037 by Two-tailed Student’s t-test; control n = 15; L. lactis n = 20) L. lactis-exposed versus control P1 pups. (E) Average expression levels of CD31 per blood vessel is increased in L. lactis-exposed P1 pup cortices (p = 0.0045 by Two-tailed Student’s t-test; control n = 33; L. lactis n = 18). (F) Average blood vessel area is increased in P1 probiotic-exposed compared to control pups (p = 0.0045 by Two-tailed Student’s t-test; control n = 33; L. lactis n = 18). Scale bar in (B): 80 μm. CP—cortical plate; VZ—ventricular zone.

In utero exposure to L. lactis leads to structural changes in pyramidal neuronal cell layer organization of the cerebral cortex

Mouse cortical neurogenesis begins around embryonic day 11.5 (E11.5) and continues throughout gestation while cortical gliogenesis peaks during postnatal development [22]. Cortical pyramidal cell layers are generated in the inside-out manner, such that lower layer neurons (layers VI and V) are produced early in development, followed by the upper layer neurons (layers VI-II) [23]. To determine whether maternal supplementation with L. lactis from E10.5 through postnatal day 1 (P1) affects cellular composition of the developing cortex we examined the expression of the cortical lower layers marker, Tbr1 (layer VI), and upper layers marker, Satb2 (layers II-V), at P1. We find that the density of Tbr1-expressing neurons in L. lactis-exposed pups is increased (Fig 5A–5D; p < 0.0001 and p = 0.05, respectively, by Student’s t-test). However, cortical layer VI thickness, as determined by the thickness of Tbr1-positive cell layer, is not statistically significant between groups in either male or female pups (Fig 5A (bracket), 5E-5F). Similarly, the density of Satb2-expressing layer II-IV neurons is also increased, albeit only in male probiotics-exposed pups (Fig 5B and 5G; p = 0.0006 by Student’s t-test) (Fig 5B and 5H).

Fig 5. Changes in cortical neuronal marker expression in P1 pups induced by maternal intake of probiotics during pregnancy.

Fig 5

(A) Expression of Tbr1 increased in the cortices of P1 pups exposed to L. lactis, compared to control pups. White brackets indicate Tbr1 layer thickness. (B) Density of Satb2-expressing cells in the upper layer of the cortical wall is increased in P1 L. lactis-exposed compared to control pups. Insets show higher magnification images of areas designated by white boxes. (C-D) Density of Tbr1-expressing cells is increased in male (C; p < 0.0001 by Two-tailed Student’s t-test; control n = 26; L. lactis n = 13) and female (D; p = 0.05 by Two-tailed Student’s t-test; control n = 10; L. lactis n = 18) probiotic-exposed P1 pups. (E-F) Tbr1 layer thickness was not significantly increased in probiotic-exposed compared to control P1 pups. (G-H) Density of Satb2-expressing cells is increased in the upper cortical layers (II-IV) of probiotic-exposed P1 male pups (G; p = 0.0006 by Two-tailed Student’s t-test; control n = 7; L. lactis n = 5), but not female pups (E; p = 0.16 by Two-tailed Student’s t-test; control n = 5; L. lactis n = 5) compared to control groups. Scale bar in (A): 80 μm. CP—cortical plate.

Cortical pyramidal neurons and glia ultimately arise from neural progenitor cells (NPCs) that reside in the ventricular zone [22]. We therefore sought to examine whether the proliferative capacity of early postnatal NPCs may be affected by exposure to probiotic. We find that the density of mitotic NPCs expressing phosphorylated histone H3 (PH3), a marker of mitosis, is increased in the ventricular zone of probiotics-exposed female (Fig 6A and 6C; p = 0.0009 by Student’s t-test), but not male pups, compared to P1 control female and male pups. Together, these results suggest that proliferative properties of postnatal cortical NPCs, as well as genesis and placement of cortical neurons within the cortical plate, are modulated by maternal exposure to probiotics.

Fig 6. Expression of mitotic marker PH3 is increased in probiotics-exposed female P1 pups.

Fig 6

(A) Larger numbers of PH3-expressing cells (white arrows) are observed in the cortical ventricular zone (VZ) of L. lactis-exposed versus control P1 pups. (B-C) Increase in PH3-expressing cells is significant in female pups (C; p = 0.0009 by Two-tailed Student’s t-test; control n = 8; L. lactis n = 15), but not in male pups (B) (p > 0.9 by Two-tailed Student’s t-test; control n = 18; L. lactis n = 15), compared to control groups. Scale bar in A: 60 μm.

Discussion

As observed in the present study and in previous studies, prenatal probiotic treatment may have long-lasting effects on the cortex and cortical-driven behavior. Although the supposed sterility of the fetal gut is now disputed, previous studies have repeatedly shown that colonization of the neonatal microbiome can be altered via maternal stress and/or diet [24]. For example, the gut microbiomes of humans or rodents exposed to prenatal stress tend towards less diversity and numbers of lactic acid-producing strains compared to the microbiomes of unstressed offspring [2]. Additionally, developmental exposure to Bifidobacterium and Lactococcus strains have been shown to impact gut microbiome organization and immune responses, and subsequent stress reactivity in animal models [4, 25]. However, the above studies did not report the role of sex in modulation of stress via microflora interventions. Several groups have observed that maternal separation increased anxiety-like behaviors in the offspring, and probiotic treatment reversed stress effects in male rodents, but not female rodents [26, 27]. Emerging evidence also indicates that sex influences microbiome colonization and alters neurotransmitter metabolism into adulthood [28].

Anxiety in rodents can manifest through several types of behavior, such as open space avoidance or over-activity, and these symptoms vary according to age, sex and environmental factors [22]. Both females and males exhibited similar anxiety-like behaviors in the light dark box. However, probiotic treatment significantly increased light zone activity in the light-dark box in females only. In the fear conditioning test the control females’ freezing was significantly higher than control males. This baseline sex effect is in keeping with previously reported results on differences between female and male mice in fear conditioning paradigms [29, 30]. Interestingly, a female-only effect of probiotics was observed in the cue associated fear conditioning, where probiotic-treated females exhibited significantly less freezing time after a fear-associated tone than the control females. Overall, these results may indicate that probiotics modulated anxiolytic behaviors that tend to be higher in females [31, 32].

It is unclear how probiotics are differentially affecting female anxiety-like behaviors. Maternal care may differ according to sex [33], and dams who received probiotics exhibited higher levels of plasma oxytocin, a reputed ‘bonding’ hormone. Oxytocin enhancement of nurturing behavior may increase female offspring resiliency even in the absence of overt prenatal stress, while additional nurturing for unstressed males may confer no additional benefit. Alternatively, it may be possible that the measurement parameters of fear conditioning and light-dark box are more sensitive to sex differences than the open field test, which is more prone to variability across testing environments and time periods [29, 31]. Further research is needed to understand how in utero probiotics exposure inhibits anxiety-like behaviors, in terms of maternal versus offspring stress responses, quality of maternal care, and offspring sex.

Changes in the expression patterns of cortical vasculature, neuronal and proliferation markers in probiotic-treated mice suggest that temporal progression of cortical layer development and vascularization may be modulated by the treatment. Appropriate development of cortical architecture is dependent on a signaling sequence of growth factors, vascular integration and cross-talk between cortical layer regions [34].In this study, P1 pup cortices were examined for changes in the cortical layer markers, Tbr1 and Satb2, a marker of mitosis, PH3, and a marker of angiogenesis, PECAM1 [35, 36]. Pronounced differences in cortical layer anatomy were observed in probiotics’ treated mice. Specifically, probiotic treatment induced increases in layer VI and layers II-V neuronal marker expression. In addition, vascularization in the upper layers of the cerebral wall, measured by blood vessel density, as well as average blood vessel area, were also increased in response to probiotic exposure. Taken together these results suggest that patterning of cortical structural organization in the fetus may be sensitive to maternal dietary intake of probiotics.

The immune systems of probiotic-treated neonates may be better primed in utero to respond to pre- and post-birth microbial exposure compared to untreated pups. The developing brain is highly sensitive to maternal immune signaling, as indicated by disrupted cortical expression patterns after maternal infection [37, 38]. Kim et al recently reported that mouse dam injection of synthetic double-stranded RNA, mimicking viral infection, or gavage of segmented filamentous bacteria decreased cortical expression of Satb2 in offspring, and this effect was coupled with anxiogenic behavior in an open field and social approach test [39]. Furthermore, IL-17 production and gastrointestinal Th-17 cell activation was shown to be the mediator of Satb2 loss of expression. A marker of angiogenesis, CD31 (PECAM1), examined in the present study, also acts as a receptor for leukocyte activation and thus its upregulation in probiotic-treated brains may be part of an immune signaling cascade that links the gut to rate of cortical development [40]. An increase in CD31 expression may also underlie the observed increase of blood vessels after probiotic supplementation.

Radial glia populations that give rise to progenitors are mainly localized to regions adjacent to brain capillaries, and rates of proliferation are influenced by signaling factors from the periphery [34]. Along with the increased density of cortical upper layer blood vessels seen in probiotic brains, proliferation of cortical progenitors, as indicated by PH3, was also upregulated in female probiotic pups compared to control pups, and a trend effect was observed in male pups. In mice, cortical proliferation occurs during mid-gestation and subsides during early postnatal development—a temporal stage approximately equivalent to the middle of the second trimester in humans [34]. It is unknown if higher levels of PH3 expression during this time period, indicative of increased NPC proliferation and thus gliogenesis, is associated with improved resilience to stress. However, previous studies reported that decreased expression of PH3 in the developing cortex leads to anxiety-like behavior in male, but not female mice exposed to human antibodies [35]. Further studies are required to delineate sex-specific pathways regulating NPC proliferation and subsequent behavior.

In conclusion, we have shown that probiotic treatment during the latter half of gestation alters cortical cytoarchitecture in P1 offspring, suggesting that changes in cortical neuronal layer and vasculature protein expression at early postnatal stages may be associated with behavioral outcomes later in life [2224]. Probiotic supplementation abrogated select anxiety-like behaviors, and improved emotional learning in females. It is presently unknown how observed changes in cortical cellular marker expression patterns may have contributed to altered behavior in probiotic-treated females, or whether changes in nurturing due to raised oxytocin levels may also have influenced sex-specific behavior differences. Further studies are needed to address the questions above and more clearly delineate the role of probiotics for human brain development.

Supporting information

S1 Data

(ZIP)

S1 Fig

Maternal probiotic supplementation (n = 22) did not have a significant effect on open field behavior, neither on the latency to enter the center zone compared to control mice (n = 18) (A) nor in the time spent in the center (B). We did observe a sex effect, where female mice (n = 22) spend significantly more time in the center than male mice (n = 18) (B).

(TIF)

S2 Fig

Maternal probiotic supplementation (n = 20) did not have a significant effect on novel object investigation, neither in the latency to approach the object compared to the control mice (n = 17) (A), nor in the time spent investigating the object (B).

(TIF)

S3 Fig. Maternal probiotic supplementation did not have an effect in contextual learning.

(A) Female mice showed higher levels of freezing in the first minute of contextual learning but there was no treatment effect. (B) Probiotic exposure had no effect on average freezing time during the 5-min session showed no effect of treatment or sex.

(TIF)

S4 Fig. Cue associated learning.

Probiotic exposure did not have an effect on the first minute response to tone in either male (control n = 8 and probiotic n = 10) or female mice (control n = 10 and probiotic n = 10).

(TIF)

Acknowledgments

We thank Dr. Steven Zeisel for his input in the design of this study; Dr. David Horita for critically evaluating this manuscript; and Dr. Steven Oreña for technical assistance with oxytocin assays.

Data Availability

All relevant data are within the paper and supporting information file. Each data file can also be access through researchgate with the following DOIs: DOI: 10.13140/RG.2.2.32607.48808 DOI: 10.13140/RG.2.2.25896.60163 DOI: 10.13140/RG.2.2.25896.60163 DOI: 10.13140/RG.2.2.29252.04480 DOI: 10.13140/RG.2.2.19185.71527 DOI: 10.13140/RG.2.2.23694.59206

Funding Statement

NS and EP received funding from Société des Produits Nestlé SA. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. URL: www.nestle.com

References

  • 1.Wang Y., et al. , Maternal dietary intake of choline in mice regulates development of the cerebral cortex in the offspring. Faseb j, 2016. 30(4): p. 1566–78. 10.1096/fj.15-282426 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Diaz Heijtz R., et al. , Normal gut microbiota modulates brain development and behavior. Proc Natl Acad Sci U S A, 2011. 108(7): p. 3047–52. 10.1073/pnas.1010529108 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Hoban A.E., et al. , Microbial regulation of microRNA expression in the amygdala and prefrontal cortex. Microbiome, 2017. 5(1): p. 102 10.1186/s40168-017-0321-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Dinan T.G. and Cryan J.F., Brain-Gut-Microbiota Axis and Mental Health. Psychosom Med, 2017. 79(8): p. 920–926. 10.1097/PSY.0000000000000519 [DOI] [PubMed] [Google Scholar]
  • 5.Hoban A.E., et al. , Regulation of prefrontal cortex myelination by the microbiota. Transl Psychiatry, 2016. 6: p. e774 10.1038/tp.2016.42 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Luczynski P., et al. , Growing up in a Bubble: Using Germ-Free Animals to Assess the Influence of the Gut Microbiota on Brain and Behavior. Int J Neuropsychopharmacol, 2016. 19(8). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Savignac H.M., et al. , Bifidobacteria modulate cognitive processes in an anxious mouse strain. Behav Brain Res, 2015. 287: p. 59–72. 10.1016/j.bbr.2015.02.044 [DOI] [PubMed] [Google Scholar]
  • 8.Ait-Belgnaoui A., et al. , Probiotic gut effect prevents the chronic psychological stress-induced brain activity abnormality in mice. Neurogastroenterol Motil, 2014. 26(4): p. 510–20. 10.1111/nmo.12295 [DOI] [PubMed] [Google Scholar]
  • 9.Liu Y.W., et al. , Psychotropic effects of Lactobacillus plantarum PS128 in early life-stressed and naive adult mice. Brain Res, 2016. 1631: p. 1–12. 10.1016/j.brainres.2015.11.018 [DOI] [PubMed] [Google Scholar]
  • 10.Bharwani A., et al. , Oral treatment with Lactobacillus rhamnosus attenuates behavioural deficits and immune changes in chronic social stress. BMC Med, 2017. 15(1): p. 7 10.1186/s12916-016-0771-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bercik P., et al. , The anxiolytic effect of Bifidobacterium longum NCC3001 involves vagal pathways for gut-brain communication. Neurogastroenterol Motil, 2011. 23(12): p. 1132–9. 10.1111/j.1365-2982.2011.01796.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Varian B.J., et al. , Microbial lysate upregulates host oxytocin. Brain Behav Immun, 2017. 61: p. 36–49. 10.1016/j.bbi.2016.11.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Encinas J.M., Vaahtokari A., and Enikolopov G., Fluoxetine targets early progenitor cells in the adult brain. Proc Natl Acad Sci U S A, 2006. 103(21): p. 8233–8. 10.1073/pnas.0601992103 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Pjetri E. and Zeisel S.H., Deletion of one allele of Mthfd1 (methylenetetrahydrofolate dehydrogenase 1) impairs learning in mice. Behav Brain Res, 2017. 332: p. 71–74. 10.1016/j.bbr.2017.05.051 [DOI] [PubMed] [Google Scholar]
  • 15.Hall C.S. Emotional behavior in the rat. I. Defecation and urination as measures of individual differences in emotionality. 1934. 18, 385–403. [Google Scholar]
  • 16.Misslin R. and Ropartz P., Responses in Mice to a Novel Object. Behaviour, 1981. 78(3/4): p. 169–177. [Google Scholar]
  • 17.van Gaalen M.M. and Steckler T., Behavioural analysis of four mouse strains in an anxiety test battery. Behav Brain Res, 2000. 115(1): p. 95–106. 10.1016/s0166-4328(00)00240-0 [DOI] [PubMed] [Google Scholar]
  • 18.Crawley J. and Goodwin F.K., Preliminary report of a simple animal behavior model for the anxiolytic effects of benzodiazepines. Pharmacol Biochem Behav, 1980. 13(2): p. 167–70. 10.1016/0091-3057(80)90067-2 [DOI] [PubMed] [Google Scholar]
  • 19.Huang H.S., et al. , Behavioral deficits in an Angelman syndrome model: effects of genetic background and age. Behav Brain Res, 2013. 243: p. 79–90. 10.1016/j.bbr.2012.12.052 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Yoshihara C., Numan M., and Kuroda K.O., Oxytocin and Parental Behaviors. Curr Top Behav Neurosci, 2018. 35: p. 119–153. 10.1007/7854_2017_11 [DOI] [PubMed] [Google Scholar]
  • 21.Braniste V., et al. , The gut microbiota influences blood-brain barrier permeability in mice. Sci Transl Med, 2014. 6(263): p. 263ra158. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Hevner R.F., From radial glia to pyramidal-projection neuron: transcription factor cascades in cerebral cortex development. Mol Neurobiol, 2006. 33(1): p. 33–50. 10.1385/MN:33:1:033 [DOI] [PubMed] [Google Scholar]
  • 23.Agirman G., Broix L., and Nguyen L., Cerebral cortex development: an outside-in perspective. FEBS Lett, 2017. 591(24): p. 3978–3992. 10.1002/1873-3468.12924 [DOI] [PubMed] [Google Scholar]
  • 24.Zijlmans M.A., et al. , Maternal prenatal stress is associated with the infant intestinal microbiota. Psychoneuroendocrinology, 2015. 53: p. 233–45. 10.1016/j.psyneuen.2015.01.006 [DOI] [PubMed] [Google Scholar]
  • 25.Cowan C.S., Callaghan B.L., and Richardson R., The effects of a probiotic formulation (Lactobacillus rhamnosus and L. helveticus) on developmental trajectories of emotional learning in stressed infant rats. Transl Psychiatry, 2016. 6(5): p. e823 10.1038/tp.2016.94 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Jasarevic E., et al. , Stress during pregnancy alters temporal and spatial dynamics of the maternal and offspring microbiome in a sex-specific manner. Sci Rep, 2017. 7: p. 44182 10.1038/srep44182 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.McVey Neufeld K.A., et al. , Neurobehavioural effects of Lactobacillus rhamnosus GG alone and in combination with prebiotics polydextrose and galactooligosaccharide in male rats exposed to early-life stress. Nutr Neurosci, 2017: p. 1–10. [DOI] [PubMed] [Google Scholar]
  • 28.Clarke G., et al. , The microbiome-gut-brain axis during early life regulates the hippocampal serotonergic system in a sex-dependent manner. Mol Psychiatry, 2013. 18(6): p. 666–73. 10.1038/mp.2012.77 [DOI] [PubMed] [Google Scholar]
  • 29.Day H.L.L. and Stevenson C.W., The neurobiological basis of sex differences in learned fear and its inhibition. Eur J Neurosci, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Singewald N. and Holmes A., Rodent models of impaired fear extinction. Psychopharmacology (Berl), 2019. 236(1): p. 21–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Bangasser D.A. and Wicks B., Sex-specific mechanisms for responding to stress. J Neurosci Res, 2017. 95(1–2): p. 75–82. 10.1002/jnr.23812 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Tronson N.C. and Keiser A.A., A Dynamic Memory Systems Framework for Sex Differences in Fear Memory. Trends Neurosci, 2019. 42(10): p. 680–692. 10.1016/j.tins.2019.07.009 [DOI] [PubMed] [Google Scholar]
  • 33.Moore C.L. and Morelli G.A., Mother rats interact differently with male amd female offspring. Journal of comparative and physiological psychology, 1979. 93(4): p. 677 10.1037/h0077599 [DOI] [PubMed] [Google Scholar]
  • 34.Borrell V., Recent advances in understanding neocortical development. F1000Research, 2019. 8: p. F1000 Faculty Rev-1791. [Google Scholar]
  • 35.MuhChyi C., et al. , Epigenetic regulation of neural stem cell fate during corticogenesis. International journal of developmental neuroscience: the official journal of the International Society for Developmental Neuroscience, 2013. 31(6): p. 424–433. [DOI] [PubMed] [Google Scholar]
  • 36.Rezaie P. and Male D., Colonisation of the developing human brain and spinal cord by microglia: a review. Microscopy research and technique, 1999. 45(6): p. 359–382. [DOI] [PubMed] [Google Scholar]
  • 37.Brimberg L., et al. , Caspr2-reactive antibody cloned from a mother of an ASD child mediates an ASD-like phenotype in mice. Mol Psychiatry, 2016. 21(12): p. 1663–1671. 10.1038/mp.2016.165 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Richetto J. and Riva M.A., Prenatal maternal factors in the development of cognitive impairments in the offspring. Journal of reproductive immunology, 2014. 104–105: p. 20–25. 10.1016/j.jri.2014.03.005 [DOI] [PubMed] [Google Scholar]
  • 39.Kim J.A., et al. , Anti-Inflammatory Effects of a Mixture of Lactic Acid Bacteria and Sodium Butyrate in Atopic Dermatitis Murine Model. J Med Food, 2018. 21(7): p. 716–725. 10.1089/jmf.2017.4116 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Qing Z., et al. , Inhibition of antigen-specific T cell trafficking into the central nervous system via blocking PECAM1/CD31 molecule. J Neuropathol Exp Neurol, 2001. 60(8): p. 798–807. 10.1093/jnen/60.8.798 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Judith Homberg

28 Oct 2019

PONE-D-19-25682

Prenatal exposure to the probiotic Lactococcus lactis decreases anxiety-like behavior and modulates cortical cytoarchitecture in a sex specific manner.

PLOS ONE

Dear Dr Hauser,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please find the reviewer comments below.

We would appreciate receiving your revised manuscript by Dec 12 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Judith Homberg

Academic Editor

PLOS ONE

Journal Requirements:

1. 

When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.  During our initial internal evaluation of your submission, we noted that your study reports experiments carried out in a mouse model. Therefore, at this time, we ask that you please update your title to reflect the experimental animal model. For example, Prenatal exposure to the probiotic Lactococcus lactis decreases anxiety-like behavior and modulates cortical cytoarchitecture in a sex specific manner in mice.

3.  Thank you for stating the following in the Competing Interests section:

"I have read the journal's policy and the authors of this manuscript have the following competing interests: ESM and JH are or were employees of Société des Produits Nestlé SA, a for-profit institution, and received support in the form of salaries. "

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Manuscript No. PONE-D-19-25682

In this work the Authors treated pregnant dams with the probiotic Lactococcus lactis. Then, behavioral, biochemical and histological experiments were carried out on the offspring or their mothers. Findings suggest that exposure dams to the probiotic may exert sex-specific long-term effects on cortical development and anxiety related behavior in the offspring.

Gut microbiota and probiotic bacteria are widely in focus of many researches. This work also adds potential interesting results to attempts of others. However, the manuscript (MS) to be matured needs a substantial revision.

My comments:

1-It seems the main aim of the study was not to examine sex dependency of probiotic treatment, so, the Authors need to also focus on the main goal.

2-In Abstract, line 34, Authors say "probiotics treatment throughout pregnancy". But according to Methods the treatment occurred during second half of pregnancy.

3-While not mothers and not offspring were exposed to stress, a question raise why the Authors introduced the pups to tests that evaluate anxiety stress.

4-As far as I know Bifidus (as mentioned in this MS) is not a popular name to replace Bifidobacterium species.

5-Some sentences refer to work of others but no reference is given. For instance, line 56-58 and line 60-61.

6-I could not understand the dose of probiotic. Further, the Lactobacillus is an anaerobic bacterium. Diluting probiotic in water leads to abrupt decrease of dosage. Therefore, the Authors need to explain how they kept the dosage consistent.

7-In Results Authors must give degree of freedom (F…,…=..) when using ANOVA as they did for light-dark box test. But in some other cases they do not mention F. Moreover, to show a significant difference it is not enough to give just F, but the P values from post test is necessary.

8- Not necessary to mention (SEM) in Y axis of figures (like fig 2).

9- According to “Statistical analyses” error bars indicate SEM. Based on, some comparisons like those in the curves E and F in figures 4 and 5 or curve B in figure 6 seem not to be significant. Please check them.

10-It is not clear how the Authors compared different groups, especially male and female groups. For instance, in many cases it is stated that there was a significant difference between females and males. Question is, in which group, probiotic treated or control group. A comparison of male and female animals in the control group is not valuable, unless the difference is evident between those treated with probiotics. Please clear it.

11-The real Discussion begins from line 383. But from this part on the findings are discussed with just 3 references. Thus, the Authors are expected to present a stronger discussion which also cover all findings.

12-Despite the MS is almost well written, however, concerning English language, it requires a whole revision.

13-Please follow consistency over the MS. For instance, Lactobacillus lactis is mentioned differently in lines 73 and 77.

14-Line 91, what do you mean: (John and Bell 1976, Council 1995).

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Mahmoud Salami

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 9;15(7):e0223395. doi: 10.1371/journal.pone.0223395.r002

Author response to Decision Letter 0


14 Jan 2020

Dear Prof. Homberg,

We are delighted to hear that the Reviewers found our manuscript technically sound, with data supporting the conclusions. We thank the Reviewers for their time and insightful comments. Below, we provide the details of our manuscript revisions, which reflect the Reviewer’s comments and concerns.

Reviewer comment 1:

1-It seems the main aim of the study was not to examine sex dependency of probiotic treatment, so, the Authors need to also focus on the main goal.

Author response:

In agreement with the Reviewer’s comment, we have ensured that the text referring to sex-dependent variation in responses to probiotic treatment does not appear in the Introduction section of the manuscript, but is included in the Discussion (pages 17-18)

Reviewer comment 2:

2-In Abstract, line 34, Authors say "probiotics treatment throughout pregnancy". But according to Methods the treatment occurred during second half of pregnancy.

Author response:

We have corrected this statement in the manuscript Abstract to more accurately reflect the period of probiotic treatment during the second half of pregnancy (line 30).

Reviewer comment 3:

3-While not mothers and not offspring were exposed to stress, a question raise why the Authors introduced the pups to tests that evaluate anxiety stress.

Author response:

Based on the existing literature, linking treatment with probiotic and reduced anxiety (reviewed in Lach et al. Neurotherapeutics 15(1):36-59 2018), we hypothesized that our treatment might result in a decrease of anxiety in the mice. Considering that the behavior in the light-dark box test and in the open field not only is sensible to manipulation increasing anxiety, but also reflect an important variability due to innate higher or lower anxiety levels, we expected these tests to detect an anxiolytic effect of our treatment.

Reviewer comment 4:

4-As far as I know Bifidus (as mentioned in this MS) is not a popular name to replace Bifidobacterium species.

Author response:

We have corrected the text referring to the Bifidobacterium species throughout the manuscript.

Reviewer comment 5:

5-Some sentences refer to work of others but no reference is given. For instance, line 56-58 and line 60-61.

Author response:

We have added the appropriate references to the statements included in lines 56-58 and 60-61, and have checked the remainder of the manuscript for proper use of citations.

Reviewer comment 6:

6-I could not understand the dose of probiotic. Further, the Lactobacillus is an anaerobic bacterium. Diluting probiotic in water leads to abrupt decrease of dosage. Therefore, the Authors need to explain how they kept the dosage consistent.

Author response:

In the Materials and Methods section of the manuscript, we mention the dose of the probiotic diluted daily in the drinking water based on the concentration of the powder, which was determined at the beginning and confirmed at the end of the study.

In reference to the probiotic stability in water and the actual dose received by animals - the Lactobacillus species are facultative aerobes, so they can tolerate oxygen very well. We therefore did not expect a drastic fast reduction of probiotic concentration in water due to exposure to oxygen.

Reviewer comment 7:

7-In Results Authors must give degree of freedom (F…,…=..) when using ANOVA as they did for light-dark box test. But in some other cases they do not mention F. Moreover, to show a significant difference it is not enough to give just F, but the P values from post test is necessary.

Author response:

Univariate (two-way) ANOVA analysis, with treatment (control and probiotic) and sex (male and female) as factors, was used to analyze some of the data. Both factors have only two groups and no post-hoc analysis is available. For our fear conditioning experiments we ran the repeated measures ANOVA. In the results section we have made sure all the significant results are shown with their p-value and F-value when univariate or repeated measures ANOVA was used for analysis.

Reviewer comment 8:

8- Not necessary to mention (SEM) in Y axis of figures (like fig 2).

Author response:

Some of our figures are shown as means with standard error of means (SEM). For these figures, we would like to keep the SEM in Y-axis as it helps the readers to understand the data distribution. The error bars may also represent standard deviation and we want to make the correct annotation.

Reviewer comment 9:

9- According to “Statistical analyses” error bars indicate SEM. Based on, some comparisons like those in the curves E and F in figures 4 and 5 or curve B in figure 6 seem not to be significant. Please check them.

Author response:

To address the Reviewer’s concern with regards to statistical significance of our findings, we have confirmed the analyses and the P values reported in Figures 4, 5 and 6. In addition, the original data is available at ResearchGate for verification.

Reviewer comment 10:

10-It is not clear how the Authors compared different groups, especially male and female groups. For instance, in many cases it is stated that there was a significant difference between females and males. Question is, in which group, probiotic treated or control group. A comparison of male and female animals in the control group is not valuable, unless the difference is evident between those treated with probiotics. Please clear it.

Author response:

The statistical approach for the analyses was to use a two-way ANOVA with treatment (control and probiotic) and sex (male and female) as factors, this provided us with the statistical mean to identify: main effect of sex (males different from females independently of the treatment), main effect of treatment (control different from probiotic independently of sex) or an interaction of the two (effect of the treatment is dependent of the sex). Thus, when we report a main effect of sex in the manuscript, we report a difference between the males and the females, independently of the treatment effect (e.g. the increased levels of freezing observed in females during the 2nd day of fear conditioning). With this model we also can better understand if any treatment effect is dependent on the sex of the subject (e.g. the difference observed in freezing time during contextual and cue fear training, where the probiotic effect was observed in females only, visible as the decrease of freezing time in treated females compared to control females, while such an effect was not observed in males). We have included the information on which groups were compared in the manuscript text by stating whether the statistical difference referred to a main effect of gender or an interaction of treatment and gender (see examples aforementioned).

Reviewer comment 11:

11-The real Discussion begins from line 383. But from this part on the findings are discussed with just 3 references. Thus, the Authors are expected to present a stronger discussion which also cover all findings.

Author response:

To address this concern, we have revised the Discussion section of the manuscript, which now addresses all the findings and includes appropriate references.

Reviewer comment 12:

12-Despite the MS is almost well written, however, concerning English language, it requires a whole revision.

Author response:

To ensure the manuscript is written in proper English, we have enlisted the help of a native English-speaking scientist in evaluating the manuscript text and suggesting revisions where necessary.

Reviewer comment 13:

13-Please follow consistency over the MS. For instance, Lactobacillus lactis is mentioned differently in lines 73 and 77.

Author response:

We have ensured the consistency of the text referring to Lactococcus lactis species used in this study.

Reviewer comment 14:

14-Line 91, what do you mean: (John and Bell 1976, Council 1995).

Author response:

We have ensured that all references cited in the text follow a consistent format.

Attachment

Submitted filename: Probiotic response letter Plos One 12.12.19.docx

Decision Letter 1

Judith Homberg

18 Feb 2020

PONE-D-19-25682R1

Prenatal exposure to the probiotic Lactococcus lactis decreases anxiety-like behavior and modulates cortical cytoarchitecture in a sex specific manner.

PLOS ONE

Dear Dr Hauser,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please find the reviewer comments below.

We would appreciate receiving your revised manuscript by Apr 03 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Judith Homberg

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: 1-The 3rd question was:

"While not mothers and not offspring were exposed to stress, a question raise why the Authors introduced the pups to tests that evaluate anxiety stress." The Authors say "we hypothesized that our treatment might result in a decrease of anxiety in the mice." However, they research shows that there is no difference between control and probiotic treated animals when testing anxiety.

2- the 7th question was:

"In Results Authors must give degree of freedom (F…,…=..) when using ANOVA as they did for light-dark box test. But in some other cases they do not mention F. Moreover, to show a significant difference it is not enough to give just F, but the P values from post test is necessary."

The Authors say "Univariate (two-way) ANOVA analysis, with treatment (control and probiotic) and sex (male and female) as factors, was used to analyze some of the data. Both factors have only two groups and no post-hoc analysis is available." However, suppose you compare only two lines of data, therefore, ANOVA is not a right analysis; in this case an analysis like t-test is more appropriate.

3-Also: When the between group differences are not statistically significant it means there is no any difference. So, a title like (Maternal probiotic supplementation reduces anxiety-like offspring behavior in light-dark box test) is not acceptable.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 9;15(7):e0223395. doi: 10.1371/journal.pone.0223395.r004

Author response to Decision Letter 1


3 Apr 2020

Reviewer’s comment 1:

The 3rd question was:

"While not mothers and not offspring were exposed to stress, a question raise why the Authors introduced the pups to tests that evaluate anxiety stress." The Authors say "we hypothesized that our treatment might result in a decrease of anxiety in the mice." However, they research shows that there is no difference between control and probiotic treated animals when testing anxiety.

Author’s response:

We thank the Reviewer for pointing to the potential confusion in the manuscript. Our initial response to the Reviewer was: “Based on the existing literature, linking treatment with probiotic and reduced anxiety (reviewed in Lach et al. Neurotherapeutics 15(1):36-59 2018), we hypothesized that our treatment might result in a decrease of anxiety in mice. Considering that the behavior in the light-dark box test and in the open field not only is sensible to manipulation increasing anxiety, but also reflect an important variability due to innate higher or lower anxiety levels, we expected these tests to detect an anxiolytic effect of our treatment.”

Furthermore, in the Introduction section of our manuscript (pp.3-4) we have emphasized that experimental manipulations affecting the microbiota, such as probiotic treatment or absence of the microbiota, have shown to impact anxiety behaviors in multiple models. Thus, we appear to have addressed the reasons for testing the link between the probiotic treatment and anxiety.

With respect to the “difference between control and probiotic-treated animals when testing anxiety”, we have revised the Results section of our manuscript, titled “Maternal probiotic supplementation reduces anxiety-like offspring behavior in light-dark box test” (pp. 9-11), and a corresponding Figure 1, along with its legend, to highlight the significant findings.

Specifically, we replaced panel B in the revised Figure 1 with a graph demonstrating the significant impact of probiotic treatment on the distance moved in the light zone in female mice. In summary, revised Figure 1 now demonstrates (A) statistically significant effect of probiotic treatment on the distance moved in the light zone when mice of both sexes are considered in the analyses, (B) statistically significant effect of probiotic treatment on the distance moved in the light zone in female mice, which appear to drive the overall effect, and (C) a trend towards significance for the time spent in the light zone when both sexes are considered (p = 0.059), with probiotic-treated animals spending 10% more time in the light zone. Together with the trend towards significance in the effect of the probiotic treatment on the latency to enter the center zone in the open field test (Figure S1; p = 0.06), our data strongly support an anxiolytic effect of the probiotic treatment.

Reviewer’s comment 2-1:

2- the 7th question was:

"In Results Authors must give degree of freedom (F…,…=..) when using ANOVA as they did for light-dark box test. But in some other cases they do not mention F. Moreover, to show a significant difference it is not enough to give just F, but the P values from post test is necessary."

Author’s response:

To address this concern, we have ensured to include information on both - the degrees of freedom and the p values - in the revised manuscript text and figure legends, where appropriate.

Reviewer’s comment 2-2:

The Authors say "Univariate (two-way) ANOVA analysis, with treatment (control and probiotic) and sex (male and female) as factors, was used to analyze some of the data. Both factors have only two groups and no post-hoc analysis is available." However, suppose you compare only two lines of data, therefore, ANOVA is not a right analysis; in this case an analysis like t-test is more appropriate.

Author’s response:

We thank the Reviewer for their careful consideration of the statistical analyses performed in our manuscript. We agree with the Reviewer that when comparing only two lines of data, a t-test would be more appropriate. However, considering that in addition to the effect of the treatment we also had to consider sex, we were conservative with our data analyses and utilized a method allowing to assess all the important factors, as well as the interactions between these factors. Therefore, ANOVA is an appropriate method of data analysis when multiple factors are taken into consideration.

Importantly, while Reviewer’s comment “suppose you compare only two lines of data, therefore, ANOVA is not a right analyses; in this case an analysis like a t-test is more appropriate” is technically correct, there is no difference in the results generated by a t-test and an ANOVA when comparing only two groups - presenting the data from an ANOVA analysis is equivalent to presenting the data from a t-test. Therefore, we feel that to keep the manuscript consistent with regards to data analysis methods, presenting the ANOVA analyses throughout the manuscript is appropriate.

Reviewer’s comment 3:

3-Also: When the between group differences are not statistically significant it means there is no any difference. So, a title like (Maternal probiotic supplementation reduces anxiety-like offspring behavior in light-dark box test) is not acceptable.

Author response:

In our answer to Reviewer’s comment 1 above, we have summarized the significant results of our study in relation to the anxiolytic effects of the probiotic treatment in light-dark box test. Briefly, we have found a significant effect of the probiotic treatment on the distance moved in the light zone (Figure 1A), which is driven by female mice (Figure 1B), and a trend towards significance for the effect of the probiotic treatment on the duration of time spent in the light zone (p = 0.059; Figure 1C). Together, these results justify the title of this manuscript section.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Judith Homberg

28 Apr 2020

Prenatal exposure to the probiotic Lactococcus lactis decreases anxiety-like behavior and modulates cortical cytoarchitecture in a sex specific manner.

PONE-D-19-25682R2

Dear Dr. Hauser,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Judith Homberg

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Mahmoud Salami

Acceptance letter

Judith Homberg

29 Jun 2020

PONE-D-19-25682R2

Prenatal exposure to the probiotic Lactococcus lactis decreases anxiety-like behavior and modulates cortical cytoarchitecture in a sex specific manner.

Dear Dr. Hauser:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Judith Homberg

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Data

    (ZIP)

    S1 Fig

    Maternal probiotic supplementation (n = 22) did not have a significant effect on open field behavior, neither on the latency to enter the center zone compared to control mice (n = 18) (A) nor in the time spent in the center (B). We did observe a sex effect, where female mice (n = 22) spend significantly more time in the center than male mice (n = 18) (B).

    (TIF)

    S2 Fig

    Maternal probiotic supplementation (n = 20) did not have a significant effect on novel object investigation, neither in the latency to approach the object compared to the control mice (n = 17) (A), nor in the time spent investigating the object (B).

    (TIF)

    S3 Fig. Maternal probiotic supplementation did not have an effect in contextual learning.

    (A) Female mice showed higher levels of freezing in the first minute of contextual learning but there was no treatment effect. (B) Probiotic exposure had no effect on average freezing time during the 5-min session showed no effect of treatment or sex.

    (TIF)

    S4 Fig. Cue associated learning.

    Probiotic exposure did not have an effect on the first minute response to tone in either male (control n = 8 and probiotic n = 10) or female mice (control n = 10 and probiotic n = 10).

    (TIF)

    Attachment

    Submitted filename: Probiotic response letter Plos One 12.12.19.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and supporting information file. Each data file can also be access through researchgate with the following DOIs: DOI: 10.13140/RG.2.2.32607.48808 DOI: 10.13140/RG.2.2.25896.60163 DOI: 10.13140/RG.2.2.25896.60163 DOI: 10.13140/RG.2.2.29252.04480 DOI: 10.13140/RG.2.2.19185.71527 DOI: 10.13140/RG.2.2.23694.59206


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES