Abstract
Objective
To review the impact of sleep, stress, and/or depression on postpartum weight retention.
Methods
We searched three electronic databases, PubMed, ISI Web of Science, and PsycInfo. Studies were included if they were published between January 1990 and September 2013 in English, measured sleep, stress, and/or depression in the postpartum period and assessed the association of these factors with postpartum weight retention. Two reviewers reviewed included articles and rated study quality using a modified version of the Downs and Black scale.
Results
Thirteen studies met our pre-defined eligibility criteria, reporting on 9 study samples. Two were cross-sectional studies and eleven were longitudinal studies. The study sample size ranged from 74 to 37,127. All four studies examining short sleep duration and postpartum weight retention reported a positive association. The four studies examining postpartum stress and weight retention reported non-significant associations only. Of 7 studies examining postpartum depression and weight retention, 3 reported non-significant associations, and 4 reported positive associations.
Conclusion
Research investigating the impact of postpartum sleep, stress, depression and weight retention is limited. Future longitudinal studies are needed.
Keywords: sleep duration, stress, depression, postpartum weight retention, postpartum women
INTRODUCTION
The prevalence of overweight and obesity is increasing and has doubled worldwide since 1980.1 In 2010, approximately 35% of adult women in the United States were obese.2 Women of childbearing age are at particularly high risk for significant weight gain during their reproductive years. On average, women retain between 0.5 and 3 kg from their pre-pregnancy weight one year after giving birth;3 42% return back to their pre-pregnancy weight,4 10% retain 5-10 kg, and an additional 3% retain over 10 kg one year postpartum.5 Women who fail to lose their pregnancy associated weight in the postpartum period are at significant risk of weight gain and midlife obesity in comparison with women who returned to their pre-pregnancy weight.6 Failure to lose weight gained during pregnancy can also lead to increased body mass index for subsequent pregnancies, contributing to an increased risk of maternal and neonatal complications.7 Inasmuch, the postpartum period is a window of opportunity to impact the obesity epidemic and favorably influence maternal and child health.
Women experience dramatic alterations in sleep,8–10 life challenges and stress,11,12 and a greater likelihood of experiencing depressive symptoms in the post-partum period.8 Disordered sleep, stress, and depressive symptoms are associated with weight gain in the general population.13–15 Average sleep duration of less than 5 hours or over 8 hours have been linked to weight gain and the development of obesity among non-pregnant women.16 Persistent sleep deprivation results in a variety of physiological changes, including a decrease in plasma leptin levels and an increase in ghrelin levels, which stimulate appetite and contribute to the development of obesity.17 Persons with high levels of perceived stress, or with multiple stressors, are also at higher risk for developing abdominal obesity and comorbidities.18 Sleep deprivation, stress, and depression are associated with alterations in plasma cortisol levels,18–20 Hypercortisolism stimulates the intake of carbohydrates and fat, and reduces energy expenditure,21 which contributes to overall obesity.
Longer sleep duration and lower stress levels are associated with greater weight loss in weight loss trials .22 Despite the availability of efficacious postpartum weight loss interventions,23,24 unique challenges exist in the postpartum period, including disruptions in sleep and greater stress and depression. A recent systematic review examining the association between postpartum depression and maternal obesity found mixed results and anti-depressant use was not associated with postpartum weight retention;25 however, this review did not evaluate sleep duration or stress, which are also potential risk factors for weight retention in the postpartum period. The objective of this systematic review was to synthesize the currently available evidence of the impact of sleep, stress, and depression on postpartum weight retention.
METHODS
Data Sources and Search Strategy
Three electronic databases [PubMed, ISI Web of Science, PsycInfo] were searched for relevant articles in September 2013. A research librarian at the University of Massachusetts Medical School helped develop a search algorithm within the domains of sleep, stress, depression and postpartum weight retention (PPWR). Key words used in these searches included sleep, insomnia, apnea, stress, life events, distressed, depression, depressive symptoms, mood, postpartum, postpartum, postnatal, women with young children, women with infants, post pregnancy, post childbirth, childbearing, weight retention, weight loss, weight gain, obese, obesity, body mass, body mass index (BMI), and adiposity. The full algorithm is detailed in Appendix A. Bibliographies of articles eligible for inclusion in the systematic review were also searched for additional references.
Inclusion and exclusion criteria
Publications included in this review had to: (1) be published between 1 January 1990 and 1 September 2013; (2) be published in English; (3) include as the study sample postpartum women who gave birth to their youngest child within the past 5 years; (4) assess any one of the following as the primary outcome: postpartum weight loss, PPWR, or transition to overweight or obesity through childbearing; and (5) examine at least one determinant of interest: sleep, stress, and/or depression in the postpartum period.
Publications were not considered for review if they did not meet inclusion criteria or: (1) were review articles, commentaries, editorials, or expert opinions; (2) were case reports or case series; (3) did not examine the association between at least one of the determinant(s) of interest and PPWR; (4) included women with multiple gestations.
Review process and data extraction
One author (RSX) performed an initial review of the titles and abstracts of all articles and excluded articles that did not meet our eligibility criteria. Two authors (RSX, ARKD) reviewed the full-text articles of a 1% random sample of articles that were excluded at this stage (n=32); and agreement was 100% that all these articles had been appropriately excluded from inclusion in this review. Full-text articles were retrieved and retained for data abstraction if none of the exclusion criteria were met. One author (RSX) abstracted data from all included studies using a standardized form. The form included information on study design (e.g., cross-sectional, prospective or retrospective cohort, case-control study), sample size, the country in which the study was conducted, characteristics of study participants (e.g., age, parity, race/ethnicity, and pre-pregnancy body mass index), length of study/follow-up, time points of assessment, measures of predictors of interest (e.g., self-reported or via in-person interview), measures of outcome (e.g., self-reported weight, weight abstracted from medical record, or measured weight), major findings, and covariates included in multivariable regression models if applicable. Abstraction also included when and how postpartum sleep, stress, depression, and weight were measured in each study. The author (RSX) also abstracted how sleep duration was measured, either by self-report in number of hours spent sleeping or by using a validated questionnaire, and the categorization of sleep duration and the reference group, if available. Measures of postpartum stress and depression, by self-report or validated questionnaire, were also abstracted. The primary study outcomes included total PPWR, substantial PPWR, or return to pre-pregnancy weight (i.e., PPWR of zero). PPWR was defined by subtracting pre-pregnancy weight from postpartum weight. The author abstracted how PPWR was defined in each study. A second author (ARKD) then independently reviewed all included studies and confirmed data presented in the tables.
Quality rating
We used a modification of the Downs and Black checklist to assess the methodological quality of each study, which has been used in a previous review.26 The Downs and Black checklist was developed to assess the quality of both nonrandomized and randomized studies,27 containing 27 items with a maximum score of 32. We removed 8 items assessing randomization techniques that were not relevant to the objective of this review. The item on statistical power was dichotomized into whether or not the study reported a priori power analysis, with a score of 1. Our modified checklist consisted of 19 items with a maximum score of 20, assessing appropriate reporting of study objectives, methods and results, external and internal validity, and power analysis, where higher score indicates better study methodological quality. Two authors (RSX and ARKD) independently rated the quality of each study. We reported the observed proportion of agreement between the two raters.28 We also calculated the intra-class correlation coefficient (ICC), a measure of inter-rater reliability and agreement for the quality rating total scores. An ICC >0.75 indicates almost excellent inter-rater reliability, ICC=0.40-0.75 indicates fair to good agreement, and ICC<0.40 indicates poor agreement.29 Any discrepancies in quality ratings between the two reviewers were resolved through discussion.
RESULTS
Study selection
The literature search yielded 5,586 articles, from which 1,630 duplicates were removed, leaving 3,956 articles for review (Figure 1). Of these, 3,299 were excluded on the basis of title reviews and 595 based on reviews of the abstract. Of the 62 full-text articles reviewed, 12 met the inclusion criteria.30–41 One additional publication42 was identified from a search of bibliographies, for a total of 13 publications included in this review. The most common reasons for excluding publications after full-text review included no assessment of PPWR as the outcome variable (n=28), no assessment of postpartum sleep, stress, or depression as the predictor variable (n=17), or no associations examined between predictor variable(s) and PPWR (n=5). This review includes 13 articles, which report on 9 study samples.
Figure 1.
Article selection process.
Study characteristics
The characteristics of studies are included in Table 1. Included studies were published between 1996 and 2013. The majority of studies recruited participants from hospitals,31,32,35,38,39,42 community newspaper birth announcements,40,41 or randomly selected participants from a registry of pregnant women.30,37 Eleven studies were prospective cohort studies and two were cross-sectional studies.42,43 Seven of the 11 prospective studies recruited women during pregnancy with average gestational ages from 20 weeks to 40 weeks and followed them for up to 12 months,30,32,35,38 18 months,37 and 3 years postpartum.39 The other four prospective studies recruited women within 3 months31 and 6 months33,34,40 postpartum and followed them up to 14 months, 18 months, and 2.5 years postpartum, respectively. Two cross-sectional studies recruited women at an average of 4.6 months43 and 6 months postpartum.42 Seven studies32,35,36,38–41 were conducted in the United States, and six international studies were conducted in the Netherlands,30 Belgium,31 United Kingdom,33,34 Denmark,37 and Taiwan.42
Table 1.
Study characteristics
First Author, Year | Study Design, Country | N | Sample Characteristics | Predictors | Weight measures | Quality Rating | |||
---|---|---|---|---|---|---|---|---|---|
Sleep | Stress | Depression | Pre-pregnancy | PP | |||||
Althuizen 201130 | Prospective cohort, Netherlands | 118 | Age: 31.6 (SD=4.3) Primiparous: 49% Race/ethnicity: 93% European Pre-pregnancy BMI: 24.3 (SD=3.7) |
X | Self-reported | Self-reported | 13 | ||
Biesmans 201331 | Prospective cohort, Belgium | 75 | Age: 30.1 (SD=4.3) Primiparous: N/A Race/ethnicity: 93.3% Belgian nationality Pre-pregnancy BMI: N/A |
X | Self-reported | Self-reported, and measured | 14 | ||
Gunderson 200832 | Prospective cohort, US | 940 | Age: 33 (SD=4.7) Primiparous: 46.7%a Race/ethnicity: White (78%) Pre-pregnancy BMI: 24.3 (SD=4.7) |
X | X | Self-reported | Self-reported | 18 | |
Harris 199934 | Prospective cohort, UK | 74 | Age: 33.5 (SE=0.6) Primiparous: 37.8% Race/ethnicity: N/A Pre-pregnancy BMI: N/A |
X | X | Measured at first trimester | Measured | 15 | |
Harris 199933 | Prospective cohort, UK | 74 | Age: 33.5 (SE=0.6) Primiparous: 37.8% Race/ethnicity: N/A Pre-pregnancy BMI: N/A |
X | X | Measured at first trimester | Measured | 17 | |
Herring 200835 | Prospective cohort US | 850 | Age: 33.0 (SD=4.7) Primiparous: 48% Race/ethnicity: 79% Whitea Pre-pregnancy BMI: 24.2 (SD=4.7) |
X | X | Self-reported | Self-reported | 17 | |
Huang 201042 | Cross-sectional Taiwan | 602 | Age: 30.2 (SD=4.4) Primiparous: 44.2% Race: Asian Pre-pregnancy BMI: 21.5 (SD=3.3) |
X | Measured at first trimester and abstracted from medical record | Measured | 16 | ||
Oken 200836 | Prospective cohort, US | 902 | Age: 33.0 (SD=4.7) Primiparous: 47.5% Race: 79% White Pre-pregnancy BMI: 24.3 (SD=4.8) |
X | Self-reported | Self-reported | 17 | ||
Pedersen 201131 | Prospective cohort, Denmark | 37127 | Age: 25-34 (76.9%) Primiparous: 40.4% Race: N/A Pre-pregnancy BMI: 27.1% OW/OB |
X | Self-reported | Self-reported | 18 | ||
Siega-Riz 201038 | Prospective cohort study, US | 550 | Age: 31.0 (SD=5.5) Primiparous: 46% Race: 76.4% non-Hispanic White Pre-pregnancy BMI: 33% OW/OB |
X | X | Self-reported | Measured | 17 | |
Taveras 201139 | Prospective cohort, US | 586 | Age: 37.7 (SD=5.0) at 3Y PP Primiparous: 30% Race/ethnicity: 74% White Pre-pregnancy BMI: 24.8 (SD=5.2) |
X | X | Self-reported | Measured | 15 | |
Walker 199634 | Prospective cohort, US | 88 (6M PP) 75 (18M PP) |
Age: 26.4 (SD N/A) Primiparous: 41% Race/ethnicity: 98% White Pre-pregnancy BMI: 14.8% OW/OB |
X | Self-reported | Self-reported | 12 | ||
Walker 199735 | Cross-sectional, US | 149 | Age: 30.2 (SD=5.5) Primiparous: N/A Race/ethnicity: 77% White Pre-pregnancy BMI: N/A |
X | X | Self-reported | Self-reported | 14 |
*M: months; BMI: body mass index; N/A: not available; PP: postpartum; OW: overweight; OB: obese. SD: standard deviation; SE: standard error
Calculated from numbers in the Tables
Analytic sample sizes ranged from 74 to 37127 participants. Six studies30,31,33,34,40,41 had 200 or fewer participants. Mean sample ages ranged from 2640 to 3839 years. The proportion of first-time mothers ranged from 30%39 to 49%.30 Five U.S studies32,35,38,39,43 reported the proportion of the sample that was non-Hispanic Whites, which ranged from 74%39 to 98%.40 Pre-pregnancy weights were either self-reported30–32,36–41 or measured during the first trimester to provide an estimate of pre-pregnancy weight.33,34,42 Postpartum weights were either self-reported30,32,35–37,40,41 or directly measured.33,34,37–39,42
Quality ratings
Raters agreed on 89% of all 19 quality rating items across the 13 included studies (range: 69-100%). The differences of total quality rating scores between two raters ranged from -2 to 2, with an average of 0. The agreement on total quality rating scores was excellent, with an ICC of 0.81 (95%CI: 0.50-0.93). After resolving discrepancies, total quality rating scores ranged from 12 to 18 with an average score of 15.6 (SD=1.9) out of a possible score of 20, indicating good to high study quality.
Postpartum sleep duration
Four studies reported the association between sleep duration and PPWR (Table 2). Postpartum sleep duration was self-reported as the number of hours spent sleeping in the 24-hour period in the past week30 or in the past month.32,38,39 One study reported the inverse association between number of hours spent in sleep at 6 months postpartum and total PPWR at 12 months postpartum.30 Another study showed positive association between short sleep duration, which was defined as less than 5 hours of sleep and total PPWR at 3 years postpartum39. Three studies30,32,38 found mixed results in the association between postpartum sleep duration and substantial PPWR. Less than 5 hours of sleep at 3 months and 6 months postpartum were associated with a two-fold38 and three-fold32 risk of substantial PPWR at 12 months postpartum, respectively; however, continuous number of hours spent in sleep was not associated with substantial PPWR at 12 months postpartum.30 Decrease in sleep duration from 6 months to 12 months postpartum was associated with a two-fold increased risk of substantial PPWR at 12 months postpartum.32
Table 2.
Postpartum sleep duration and PPWR
First Author, Year | Sleep Duration | Primary Outcome | Main Findings |
---|---|---|---|
Althuizen, 201130 | Self-reported, 6W PP 6M PP 12M PP | Total PPWR 12M PP SPPWR (PPWR ≥ 5kg) 12M PP |
Unadjusted: Not reported Adjusted: Sleep (hours/day) with total PPWR: b=−0.53, 95%CI: −1.08, −0.02 Model adjusted for social comparison for PA, energy intake, total GWG, and pre-pregnancy BMI Sleep (hours/day) with SPPWR: Non-significant finding (data not shown) |
Gunderson, 200832 | Self-reported 6M PP 12M PP | SPPWR (PPWR ≥ 5kg) 12M PP | 5 hours vs. 7 hours of sleep at 6M PP with SPPWR: Unadjusted: OR=3.08, 95%CI: 1.76-5.38 Adjusted: OR=3.13, 95%CI: 1.42- 6.94 Model adjusted for sociodemographics, parity, pre-pregnancy BMI, GWG, PP behaviors, and change in sleep duration from 6M to 12M PP Decrease in sleep duration vs. no change from 6M PP to 12M PP with SPPWR Unadjusted: OR=1.94, 95%CI: 1.19-3.17 Adjusted: OR=2.05, 95%CI: 1.11-3.78 Model adjusted for sociodemographics, parity, pre-pregnancy BMI, GWG, PP behaviors, and change in sleep duration from 6M to 12M PP |
Siega-Riz, 201038 | Self-reported 3M PP | SPPWR (PPWR>=10lbs, 4.5kg) 3M PP 12M PP | <=5 hours vs. 8+ hours of sleep with SPPWR at 3M PP: Unadjusted: Not reported Adjusted: OR=1.9, 95%CI: 1.5-2.4 Model adjusted for pre-pregnancy BMI, GWG, income, delivery mode, and depression <=5 hours vs. 8+ hours of sleep with SPPWR at 12 PP: Unadjusted: Not reported Adjusted: Non-significant (data not shown) |
Taveras 201139 | Self-reported 6M PP 12M PP | Total PPWR 3Y PP | <=5 hours vs. >5 hours of sleep with total PPWR Unadjusted: b=1.27, 95%CI: 0.08-2.61 Adjusted: b=1.44, 95%CI: 0.02-2.86 Model adjusted for maternal age, race/ethnicity, education, parity, pre-pregnancy BMI, excessive GWG, and PP behaviors |
* W: week; M: month; Y: year; PP: postpartum; PPWR: postpartum weight retention; SPPWR: substantial postpartum weight retention; GWG: gestational weight gain; BMI: body mass index; PA: physical activity; ED: eating disorder.
Postpartum stress
Four studies, from three study populations, reported the unadjusted associations between postpartum stress and PPWR (Table 3). One study40 found a non-significant association between postpartum stress and PPWR after use of a multivariable regression model, but the specific findings were not reported. Postpartum stress was assessed using different instruments, including the Parenting Stress Scale,33,34 Perceived Stress Scale40 and the Stress Scale from Psychosocial Profile.41 Stress present at 6 months postpartum was not associated with total PPWR at 18 months postpartum,40 or PPWR over 0.4kg at 2.5 years postpartum.33,34 At 12 months postpartum, women's experiences of life-event stress were also not associated with total PPWR.41
Table 3.
Postpartum Stress and PPWR
First Author, Year | Stress | Primary Outcome | Main Findings |
---|---|---|---|
Harris 199934 | Parenting Stress Index 2.5Y PP | SPPWR (PPWR>0.4kg) 2.5Y PP |
Unadjusted average Parenting Stress Index score by SPPWR No SPPWR: 221.8 (SD=5.9), SPPWR: 223.2 (SD=6.5); p value: not significant (data not shown) Adjusted: Not reported |
Harris 199933 | Parenting Stress Index 2.5Y PP | PPWR 2.5Y PP |
Unadjusted Spearman Correlation: r=0.09; p=0.43 Adjusted: Not reported |
Walker 199640 | Perceived Stress Scale 6M PP | PPWR 6M PP 18M PP |
Unadjusted: Not significant (data not shown) Adjusted: Not significant (data not shown) Model adjusted for race and GWG |
Walker 199741 | The Stress Scale from Psychosocial Profile 12M PP | PPWR 12M PP |
Unadjusted Spearman Correlation: r= 0.07; p value: not significant (data not shown) Adjusted: Not reported |
* M: month; PP: postpartum; PPWR: postpartum weight retention; SPPWR: substantial postpartum weight retention; GWG: gestational weight gain.
Postpartum depression
Eight studies reported the association between postpartum depression and PPWR (Table 4). Postpartum depression was measured using the Edinburgh Postnatal Depression Scale (EPDS),31,33–36 Chinese version of the Beck Depression Inventory,42 Center for Epidemiologic Studies-Depression Scale (CES-D),41 and Symptoms Checklist-92.37 Three studies reported the non-significant bivariate association between postpartum depression at 6 months postpartum and PPWR over 5 kg at 12 months postpartum,36 and PPWR over 0.4 kg at 2.6 years postpartum,33,34 respectively; while two studies reported a significant association.31,41 Compared to women who had no depression at both pregnancy and postpartum period, those with depression only at 6 months postpartum period had an increased risk of PPWR over 5 kg at 12 months postpartum.35,37 However, studies found conflicting results for women who had depression at both pregnancy and postpartum period. Depression at both periods did not increase women's risk of substantial PPWR over 5 kg at 12 months postpartum, where depression was assessed using EPDS;35 however, it did increase women's risk of substantial PPWR at 12 months when questions for anxiety and depression were combined into a single scale.37
Table 4.
Postpartum Depression and PPWR
First Author Year | Depression | Primary outcome | Main Findings |
---|---|---|---|
Huang 2010 | BDI Chinese 6M PP | Total PPWR 6M PP |
Unadjusted: Not reported Adjusted: BDI with total PPWR among pre-pregnancy NW women: b=−0.10, p<0.01 Model adjusted for body image, GWG, external health control, and parity of 1 BDI with total PPWR among other women: Not significant (data not shown) |
Herring 200835 | EPDS 6M PP | SPPWR (PPWR>=5kg) 12M PP | Both pregnancy and PP depression vs. neither depression with SPPWR: Unadjusted: OR=1.28, 95%CI: 0.37-4.41 Adjusted: OR=0.68, 95%CI: 0.16-2.99 Model adjusted for pre-pregnancy BMI, GWG, parity, and maternal sociodemographics Only PP depression vs. neither depression with SPPWR: Unadjusted: OR=3.00, 95%CI: 1.40-6.41 Adjusted: OR=2.54, 95%CI: 1.06-6.09 Model adjusted for pre-pregnancy BMI, GWG, parity, and maternal sociodemographics Adjusted: OR= 2.38, 95%CI: 0.96-5.88 Model adjusted for pre-pregnancy BMI, GWG, parity, maternal sociodemographics, and PP behaviors |
Biesmans, 201331 | EPDS, 3M PP | PPWR (Yes/No) 14M PP |
Unadjusted mean EPDS score by PPWR (Yes/No): PPWR: 6.9 (SD=4.9), No PPWR: 5.0 (SD=3.1); p=0.042 Adjusted: Not reported |
Oken, 200836 | EPDS, 6M PP | SPPWR (PPWR ≥ 5kg) 12M PP |
Unadjusted percentage of women with a EPDS score >12 by SPPWR: SPPWR: 12%, No SPPWR: 7%; p=0.09 Adjusted: Not reported |
Pedersen 201137 | Symptoms Checklist-92 6M PP | SPPWR (PPWR ≥ 5kg) 6M PP 18M PP |
Unadjusted: Not reported Adjusted (data abstracted from figure): Both pregnancy and PP depression vs. neither depression with SPPWR at 6M PP: OR=1.4, 95%CI: 1.3-1.6 SPPWR at 18M PP: OR=1.5, 95%CI: 1.3-1.7 Model adjusted for age, parity, pre-pregnancy BMI, smoking, and exercise during pregnancy Only PP depression vs. neither depression with SPPWR at 6M PP: OR=1.1, 95%CI: 0.98-1.2 SPPWR at 18M PP: OR=1.3, 95%CI: 1.1-1.5 Model adjusted for age, parity, pre-pregnancy BMI, smoking, and exercise during pregnancy |
Harris 199934 | EPDS 6M PP | SPPWR (PPWR ≥ 0.4kg 2.6Y PP |
Unadjusted mean EPDS score by SPPWR: SPPWR: 6.6 (SD=0.9), No SPPWR: 5.0 (SD=0.8); p value: not significant (data not shown) Adjusted: Not reported |
Harris 199933 | EPDS 6M PP | PPWR 2.6Y PP |
Unadjusted Spearman Correlation: r=−0.05; p=0.65 Adjusted: Not reported |
Walker 199741 | CES-D 12M PP | PPWR 12M PP |
Unadjusted Spearman Correlation: r=0.20; p<0.01 Adjusted: Not reported |
BDI: Beck Depression Inventory; M: month; PP: postpartum; PPWR: postpartum weight retention; NW: normal weight; GWG: gestational weight gain; SPPWR: substantial postpartum weight retention; Y: year; BMI: body mass index; preg: pregnancy; EPDS: Edinburgh Postpartum Depression Scale; CESD: Center for Epidemiologic studies Depression Scale.
DISCUSSION
This review synthesized the findings of currently available studies that have examined the impact of postpartum sleep duration, stress, and depression on PPWR. Short sleep duration was associated with greater postpartum weight retention. Specifically, women with less than 5 hours of sleep at 6 months postpartum had a two to three-fold risk of retaining more than 5 kg of weight at one to three years postpartum. Postpartum stress was not associated with PPWR, while the association between postpartum depression and PPWR was mixed. Women with depression only in the postpartum period had a higher risk of retaining pregnancy-related weight for over 5 kg, compared to those without depression both during pregnancy and postpartum.
Our findings among postpartum women were comparable to the findings in the general adult population. A recent systematic review15 of sleep duration and subsequent weight gain found mixed associations between sleep duration and subsequent weight gain. Eight of 13 studies in adults found positive associations between short sleep duration and subsequent weight gain, while another five found non-significant associations. Another recent review of depression and obesity found less consistent evidence that depression leads to obesity.44 Childbearing age is an important life stage for women that may result in substantial weight retention and lead to the development of obesity.45 However, only a small number of studies have examined women's psychosocial experiences in relation to weight loss during the postpartum period. Future studies are needed to examine the impact of women's psychosocial experiences on PPWR, and the future development of obesity.
Methodological issues in included studies
This review revealed a number of findings regarding methodology. First, we found that most studies used self-reported pre-pregnancy weight and self-reported postpartum weight, rather than weights measured by research staff. This is a limitation in the field, as self-reported weight is well recognized to be an underestimation of actual weight in the general population.46 Among women of childbearing age, self-reported weight was, on average, 1.5 kg lighter than their measured weights in previous research.47 Three studies included in this review used weight measured in the first trimester to estimate the pre-pregnancy weight.33,34,42 As reported in a prior study, self-reported weight was on average 1.8 kg lighter than weight measured at initiation of prenatal care.48 Underestimation of pre-pregnancy weight will result in the overestimation of PPWR. While measuring pre-pregnancy weight is often not possible in the clinical setting, researchers should measure a woman's weight in the postpartum period to derive a better and more accurate measurement of PPWR.
Second, postpartum sleep duration was self-reported in the form of number of hours spent in sleeping. Many postpartum women experience frequent nocturnal awakening that results in fragmented sleep or sleep disturbances that reduce sleep quality.9 Recent research has discovered that mothers' total sleep time is preserved, but their sleep patterns are highly fragmented.49 Although sleep pattern and quality were often measured among postpartum women in relation to their daily activities, depressive symptoms, and other health conditions,9,50 our review did not find any studies examining women's sleep pattern and quality during the postpartum period and its relationship to PPWR. We suggest future studies examine sleep quality and particular patterns of disordered sleep among postpartum women and assess its relationship to PPWR.
Third, seven studies adjusted for a wide range of potentially confounding variables in estimating the association between postpartum psychosocial experiences and PPWR. Most studies included pre-pregnancy weight status and total or excessive gestational weight gain in their multivariable model, which were independently associated with a twofold to threefold risk of PPWR.45 The lack of consistency in covariate selection is a limitation in the literature that hinders its systematic review. Considering the significant association between diet, physical activity, and weight gain, we suggest future studies consistently adjust for postpartum physical activity, diet, pre-pregnancy weight status, gestational weight gain, and demographics in their multivariable regression models.
Fourth, four studies reported a non-significant association between postpartum stress and weight retention. The postpartum period is a potentially stressful transition period during which women face new tasks of motherhood and changes in their bodies.51 Measures of stress used in the studies reviewed may not have captured aspects of stress particular to the postpartum period, which may bias the results towards the null hypothesis, even if there is a true association between postpartum stress and weight retention. All four studies that examined the association between postpartum stress and weight retention were published before 2000, and stressors faced recently by postpartum women may have changed over the past 15 years. More contemporary data are needed to examine the influence of stress on weight retention in the postpartum period.
Fifth, sleep disruption is one manifestation of major depression in adult populations52 and there is a strong bi-directional association between alterations of sleep and depression.53 Women with new onset of postpartum depression had a 2.5 times increased odds of retaining over 5 kg of weight, compared to women without depression during pregnancy and postpartum period. However, after adjusting for postpartum behaviors, including sleep, there was no significant association between new onset of postpartum depression and PPWR.35 Although a few studies included sleep duration and postpartum depression in their adjusted models, the combined effect of sleep duration and depression on PPWR could not be determined in this review. Meanwhile, three studies presented the non-significant bivariate association between postpartum stress and PPWR, and the non-significant bivariate association between postpartum depression and PPWR. As postpartum stress and depression was also highly correlated, we were not able to determine whether one predictor mediated the association between the other and PPWR. Considering the interrelationships between sleep duration, stress, and depression, future research is needed to examine their combined effect on PPWR.
Study Strengths and Limitations
This systematic review has several strengths. We reviewed multiple databases and used a systematic approach to identify published research from the clinical, psychological, and nursing literature. Two authors independently reviewed articles and rated study quality. This review extends the current literature on postpartum weight retention by examining the associations of sleep duration and depression with weight retention, and highlights the lack of literature on postpartum stress and weight retention and the need for future research in this area. This review also has several limitations. Two authors reviewed the full-text articles of a 1% random sample of articles excluded based on title alone; all articles were found to have been excluded appropriately, suggesting that our review process was unlikely to have omitted relevant articles from inclusion in this systematic review. We used a modified version of the Downs & Black checklist. While the original checklist demonstrated sufficient psychometric validity,27 this modified version has not been validated. However, this modified version has been used in previous research.26 This review included only studies published in English, potentially omitting pertinent research published in other languages. Because of the sparse literature available, and the differing ascertainment methods and timing of measurement of sleep, stress, depression, and post-partum weight loss across studies, a quantitative meta-analysis could not be performed.
Conclusion
Validated measures of postpartum sleep patterns, ideally over varying periods, are needed in future research. Given the limited evidence about whether sleep, stress, and depression impact PPWR, we suggest additional observational research to establish the role of these three factors in postpartum weight loss in order to better identify women at greatest risk for PPWR. Future postpartum weight loss intervention studies may be important to address these factors in the intervention content to better help postpartum women lose weight.
Highlights.
Little work on sleep, stress, depression, and post-partum weight retention (PPWR)
Short sleep duration associated with greater PPWR in 4 studies
Four studies did not find an association between stress and PPWR
Mixed findings for depression and PPWR (n=4 positive; n=3 no association)
Research is needed to untangle effects of sleep, stress, and depression on PPWR
Acknowledgements
Support provided by NIH grants UL1TR000161 (RSX), 1U01HL105268 (SDP, RJG, MEW), R01HL35434 (RJG), and KL2TR000160 (MEW). The funding sources had no involvement in the study design, analysis and interpretation of data, in writing the report, nor in the decision to submit the article for publication.
RSX completed the abstraction of titles and abstracts. RSX and ARKD independently reviewed articles and rated study quality, and reviewed the full-text articles of a random 1% sample of articles excluded based on title. RSX and MEW drafted the manuscript. RSX, ARKD, RJG, SLP, SDP, and MEW helped interpret the results. ARKD, RJG, SLP, and SDP provided critical revision to the manuscript. All authors had read the article and approved the final version to be submitted.
Appendix A. Searching Algorithm
[(Sleep OR insomnia OR snoring OR apnea) OR
(Stress OR distressed OR hassle OR stressful OR life events) OR
(Depression OR depress OR depressive OR antidepressant OR mood)]
AND
(Post-partum OR postpartum OR post pregnancy OR postnatal OR after pregnancy OR post childbirth OR after delivery OR after childbirth OR moms OR mothers OR women with young children OR women with infants)
AND
(Weight loss OR weight gain OR weight change OR weight retention OR body mass OR adiposity OR obesity OR overweight OR obese)
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Competing Interest Statement
All authors have completed the Unified Competing Interest form at http://www.icmje.org/coi_disclosure.pdf and declare that 1) Dr. Pagoto is on the advisory board of Empower Fitness and had a contract with Sears FitStudio. 2) The other authors have no other potential conflicts of interest to report.
References
- 1.World Health Organization. Overweight and Obese 2013 Available at: http://www.who.int/mediacentre/factsheets/fs311/en/index.html.
- 2.Flegal KM, Carroll MD, Kit BK, Ogden CL. Prevalence of obesity and trends in the distribution of body mass index among US adults, 1999-2010. JAMA. 2012;307(5):491–7. doi: 10.1001/jama.2012.39. doi:10.1001/jama.2012.39. [DOI] [PubMed] [Google Scholar]
- 3.Gore S, Brown DM, West D. The role of postpartum weight retention in obesity among women: a review of the evidence. Ann Behav Med. 2003;26(2):149–159. doi: 10.1207/S15324796ABM2602_07. [DOI] [PubMed] [Google Scholar]
- 4.Olson CM, Strawderman MS, Hinton PS, Pearson T a. Gestational weight gain and postpartum behaviors associated with weight change from early pregnancy to 1 y postpartum. Int J Obes Relat Metab Disord. 2003;27(1):117–27. doi: 10.1038/sj.ijo.0802156. doi:10.1038/sj.ijo.0802156. [DOI] [PubMed] [Google Scholar]
- 5.Rode L, Kjærgaard H, Ottesen B, Damm P, Hegaard HK. Association between gestational weight gain according to body mass index and postpartum weight in a large cohort of Danish women. Matern Child Health J. 2012;16(2):406–13. doi: 10.1007/s10995-011-0775-z. doi:10.1007/s10995-011-0775-z. [DOI] [PubMed] [Google Scholar]
- 6.Rooney BL, Schauberger CW, Mathiason M a. Impact of perinatal weight change on long-term obesity and obesity-related illnesses. Obstet Gynecol. 2005;106(6):1349–56. doi: 10.1097/01.AOG.0000185480.09068.4a. doi:10.1097/01.AOG.0000185480.09068.4a. [DOI] [PubMed] [Google Scholar]
- 7.Villamor E, Cnattingius S. Interpregnancy weight change and risk of adverse pregnancy outcomes: a population-based study. Lancet. 2006;368(9542):1164–70. doi: 10.1016/S0140-6736(06)69473-7. doi:10.1016/S0140-6736(06)69473-7. [DOI] [PubMed] [Google Scholar]
- 8.Milgrom J, Gemmill AW, Bilszta JL, et al. Antenatal risk factors for postnatal depression: a large prospective study. J Affect Disord. 2008;108:147–157. doi: 10.1016/j.jad.2007.10.014. [DOI] [PubMed] [Google Scholar]
- 9.McBean AL, Montgomery-Downs HE. Timing and variability of postpartum sleep in relation to daytime performance. Physiol Behav. 2013;122:134–9. doi: 10.1016/j.physbeh.2013.09.003. doi:10.1016/j.physbeh.2013.09.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Montgomery-Downs HE, Insana SP, Clegg-Kraynok MM, Mancini LM. Normative longitudinal maternal sleep: the first four postpartum months. Am J Obstet Gynecol. 2010;203(5):465, e1–465.e7. doi: 10.1016/j.ajog.2010.06.057. doi:10.1016/j.ajog.2010.06.057.Normative. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Rholes WS, Simpson JA, Friedman M. Avoidant attachment and the experience of parenting. Personal Soc Psychol Bull. 2006;32:275–285. doi: 10.1177/0146167205280910. doi:10.1177/0146167205280910. [DOI] [PubMed] [Google Scholar]
- 12.Abidin R, Flens JR, Austin WG. The Parenting Stress Index. Forensic Uses Clin Assess Instruments. 2006:297–328. [Google Scholar]
- 13.Patel SR, Blackwell T, Redline S, et al. The association between sleep duration and obesity in older adults. Int J Obes (Lond) 2008;32(12):1825–1834. doi: 10.1038/ijo.2008.198. doi:10.1038/ijo.2008.198; 10.1038/ijo.2008.198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Atlantis E, Baker M. Obesity effects on depression: systematic review of epidemiological studies. Int J Obes (Lond) 2008;32(6):881–891. doi: 10.1038/ijo.2008.54. doi:10.1038/ijo.2008.54; 10.1038/ijo.2008.54. [DOI] [PubMed] [Google Scholar]
- 15.Magee L, Hale L. Longitudinal associations between sleep duration and subsequent weight gain: a systematic review. Sleep Med Rev. 2012;16(3):231–41. doi: 10.1016/j.smrv.2011.05.005. doi:10.1016/j.smrv.2011.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Patel SR. Reduced sleep as an obesity risk factor. Obes Rev. 2009;10(Suppl 2)(9):61–8. doi: 10.1111/j.1467-789X.2009.00664.x. doi:10.1111/j.1467-789X.2009.00664.x. [DOI] [PubMed] [Google Scholar]
- 17.Knutson KL, Spiegel K, Penev P, Van Cauter E. The metabolic consequences of sleep deprivation. Sleep Med Rev. 2007;11(3):163–78. doi: 10.1016/j.smrv.2007.01.002. doi:10.1016/j.smrv.2007.01.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Björntorp P. Do stress reactions cause abdominal obesity and comorbidities? Obes Rev. 2001;2(2):73–86. doi: 10.1046/j.1467-789x.2001.00027.x. doi:10.1046/j.1467-789x.2001.00027.x. [DOI] [PubMed] [Google Scholar]
- 19.Copinschi G. Metabolic and endocrine effects of sleep deprivation. Essent Psychopharmacol. 2005;6:341–347. [PubMed] [Google Scholar]
- 20.Björntorp P, Rosmond R. Obesity and cortisol. Nutrition. 2000;16:924–936. doi: 10.1016/s0899-9007(00)00422-6. doi:10.1016/S0899-9007(00)00422-6. [DOI] [PubMed] [Google Scholar]
- 21.Kyrou I, Chrousos GP, Tsigos C. Stress, visceral obesity, and metabolic complications. Ann N Y Acad Sci. 2006;1083:77–110. doi: 10.1196/annals.1367.008. doi:10.1196/annals.1367.008. [DOI] [PubMed] [Google Scholar]
- 22.Elder CR, Gullion CM, Funk KL, Debar LL, Lindberg NM, Stevens VJ. Impact of sleep, screen time, depression and stress on weight change in the intensive weight loss phase of the LIFE study. Int J Obes (Lond) 2012;36(1):86–92. doi: 10.1038/ijo.2011.60. doi:10.1038/ijo.2011.60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Van der Pligt P, Willcox J, Hesketh KD, et al. Systematic review of lifestyle interventions to limit postpartum weight retention: implications for future opportunities to prevent maternal overweight and obesity following childbirth. Obes Rev. 2013;14:792–805. doi: 10.1111/obr.12053. doi:10.1111/obr.12053. [DOI] [PubMed] [Google Scholar]
- 24.Amorim Adegboye A, Linne Y. Diet or exercise , or both , for weight reduction in women after childbirth ( Review ). Cochrane database Syst Rev. 2013;(7) doi: 10.1002/14651858.CD005627.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Milgrom J, Skouteris H, Worotniuk T, Henwood A, Bruce L. The association between ante- and postnatal depressive symptoms and obesity in both mother and child: A systematic review of the literature. Women's Heal Issues. 2012;22(3):e319–e328. doi: 10.1016/j.whi.2011.12.001. [DOI] [PubMed] [Google Scholar]
- 26.Hajduk AM, Kiefe CI, Person SD, Gore JG, Saczynski JS. Cognitive change in heart failure: a systematic review. Circ Cardiovasc Qual Outcomes. 2013;6(4):451–60. doi: 10.1161/CIRCOUTCOMES.113.000121. doi:10.1161/CIRCOUTCOMES.113.000121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Heal. 1998;52:377–384. doi: 10.1136/jech.52.6.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Cunningham M. More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters. 2009:1–7. [Google Scholar]
- 29.Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8. doi: 10.1037//0033-2909.86.2.420. [DOI] [PubMed] [Google Scholar]
- 30.Althuizen E, van Poppel MN, de Vries JH, Seidell JC, van Mechelen W. Postpartum behaviour as predictor of weight change from before pregnancy to one year postpartum. BMC Public Health. 2011;11(1):165. doi: 10.1186/1471-2458-11-165. doi:10.1186/1471-2458-11-165; 10.1186/1471-2458-11-165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Biesmans K, Franck E, Ceulemans C, Jacquemyn Y, Van Bogaert P. Weight during the postpartum period: what can health care workers do? Matern Child Health J. 2013;17(6):996–1004. doi: 10.1007/s10995-012-1077-9. doi:10.1007/s10995-012-1077-9. [DOI] [PubMed] [Google Scholar]
- 32.Gunderson EP, Rifas-Shiman SL, Oken E, et al. Association of fewer hours of sleep at 6 months postpartum with substantial weight retention at 1 year postpartum. Am J Epidemiol. 2008;167(2):178–87. doi: 10.1093/aje/kwm298. doi:10.1093/aje/kwm298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Harris HE, Ellison GT, Clement S. Do the psychosocial and behavioral changes that accompany motherhood influence the impact of pregnancy on long-term weight gain? J Psychosom Obstet Gynaecol. 1999;20(2):65–79. doi: 10.3109/01674829909075579. [DOI] [PubMed] [Google Scholar]
- 34.Harris HE, Ellison GT, Clement S. Relative importance of heritable characteristics and lifestyle in the development of maternal obesity. J Epidemiol Community Health. 1999;53(2):66–74. doi: 10.1136/jech.53.2.66. doi:10.1136/jech.53.2.66. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Herring SJ, Rich-Edwards JW, Oken E, Rifas-Shiman SL, Kleinman KP, Gillman MW. Association of postpartum depression with weight retention 1 year after childbirth. Obes Silver Spring Md. 2008;16:1296–1301. doi: 10.1038/oby.2008.71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Oken E, Taveras EM, Popoola FA, Gillman MW. Television, walking, and diet: Associations with postpartum weight retention. Am J Prev Med. 2008;32(4):305–311. doi: 10.1016/j.amepre.2006.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Pedersen P, Baker JL, Henriksen TB, et al. Influence of psychosocial factors on postpartum weight retention. Obesity (Silver Spring) 2011;19(3):639–646. doi: 10.1038/oby.2010.175. doi:10.1038/oby.2010.175; 10.1038/oby.2010.175. [DOI] [PubMed] [Google Scholar]
- 38.Siega-riz AM, Herring AH, Carrier K, Evenson KR, Dole N, Deierlein A. Sociodemographic, perinatal, behavioral and psychosocial predictors of weight retention at 3 and 12 months postpartum. Obesity (Silver Spring) 2010;18(10):1996–2003. doi: 10.1038/oby.2009.458. doi:10.1038/oby.2009.458.Sociodemographic. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Taveras EM, Rifas-Shiman SL, Rich-Edwards JW, Gunderson EP, Stuebe AM, Mantzoros CS. Association of maternal short sleep duration with adiposity and cardiometabolic status at 3 years postpartum. Obes Silver Spring Md. 2011;19:171–178. doi: 10.1038/oby.2010.117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Walker LO. Predictors of weight gain at 6 and 18 months after childbirth: a pilot study. J Obstet Gynecol Neonatal Nurs. 1996;25(1):39–48. doi: 10.1111/j.1552-6909.1996.tb02511.x. [DOI] [PubMed] [Google Scholar]
- 41.Walker LO. Weight and weight-related distress after childbirth: relationships to stress, social support, and depressive symptoms. J Holist Nurs. 1997;15(4):389–405. doi: 10.1177/089801019701500406. [DOI] [PubMed] [Google Scholar]
- 42.Huang T-T, Wang H-S, Dai F-T. Effect of pre-pregnancy body size on postpartum weight retention. Midwifery. 2010;26(2):222–31. doi: 10.1016/j.midw.2008.05.001. doi:10.1016/j.midw.2008.05.001. [DOI] [PubMed] [Google Scholar]
- 43.Fowles ER, Walker LO. Correlates of dietary quality and weight retention in postpartum women. J Community Health Nurs. 2006;23(3):187–197. doi: 10.1207/s15327655jchn2303_5. doi:10.1207/s15327655jchn2303. [DOI] [PubMed] [Google Scholar]
- 44.Faith MS, Butryn M, Wadden TA, Fabricatore A, Nguyen AM, Heymsfield SB. Evidence for prospective associations among depression and obesity in population-based studies. Obes Rev. 2011;12:e438–e453. doi: 10.1111/j.1467-789X.2010.00843.x. doi:10.1111/j.1467-789X.2010.00843.x. [DOI] [PubMed] [Google Scholar]
- 45.Gunderson EP. Childbearing and obesity in women: weight before, during and after pregnancy. Obstet Gynecol Clin North Am. 2009;36(2):1–17. doi: 10.1016/j.ogc.2009.04.001. doi:10.1016/j.ogc.2009.04.001.Childbearing. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Gorber SC, Gorber B. A comparison of direct vs. self-report measures for assessing height, weight and body mass index: a systematic review. Obes Rev. 2007;8:307–326. doi: 10.1111/j.1467-789X.2007.00347.x. [DOI] [PubMed] [Google Scholar]
- 47.Kuczmarski M, Kuczmarski R, Najjar M. Effects of age on validity of self-reported height, weight, and body mass index: findings from the Third National Health and Nutrition Examination Survey, 1988-1994. J Am Diet Assoc. 2001;101:28–34. doi: 10.1016/S0002-8223(01)00008-6. doi:10.1016/S0002-8223(01)00008-6. [DOI] [PubMed] [Google Scholar]
- 48.Holland E, Moore Simas T a, Doyle Curiale DK, Liao X, Waring ME. Self-reported Pre-pregnancy Weight Versus Weight Measured at First Prenatal Visit: Effects on Categorization of Pre-pregnancy Body Mass Index. Matern Child Health J. 2013;17(10):1872–8. doi: 10.1007/s10995-012-1210-9. doi:10.1007/s10995-012-1210-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Montgomery-Downs HE, Insana SP, Clegg-Kraynok MM, Mancini LM. Normative longitudinal maternal sleep: the first 4 postpartum months. Am J Obstet Gynecol. 2010;203:465, e1–e7. doi: 10.1016/j.ajog.2010.06.057. doi:10.1016/j.ajog.2010.06.057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Goyal D, Gay C, Lee K. Fragmented maternal sleep is more strongly correlated with depressive symptoms than infant temperament at three months postpartum. Arch Womens Ment Health. 2009;12:229–237. doi: 10.1007/s00737-009-0070-9. doi:10.1007/s00737-009-0070-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Hung C-H, Chung H-H. The effects of postpartum stress and social support on postpartum women's health status. J Adv Nurs. 2001;36(5):676–684. doi: 10.1046/j.1365-2648.2001.02032.x. doi:10.1046/j.1365-2648.2001.02032.x. [DOI] [PubMed] [Google Scholar]
- 52.Brasić JR. Screening people with disturbed sleep for depression. Percept Mot Skills. 2006;103:765–766. doi: 10.2466/pms.103.3.765-766. doi:10.2466/PMS.103.7.765-766. [DOI] [PubMed] [Google Scholar]
- 53.Voderholzer U, Riemann D, Berger M. Sleep and depression — results from psychobiological studies: an overview. Biol Psychol. 2001;57:67–103. doi: 10.1016/s0301-0511(01)00090-4. doi:10.1016/S0301-0511(01)00090-4. [DOI] [PubMed] [Google Scholar]