Skip to main content
PLOS One logoLink to PLOS One
. 2020 Apr 2;15(4):e0231037. doi: 10.1371/journal.pone.0231037

Shift work and long work hours and their association with chronic health conditions: A systematic review of systematic reviews with meta-analyses

Adovich S Rivera 1,*, Maxwell Akanbi 1, Linda C O’Dwyer 1,2, Megan McHugh 1,3
Editor: Omid Beiki4
PMCID: PMC7117719  PMID: 32240254

Abstract

Background

Previous reviews have demonstrated that shift work and long work hours are associated with increased risk for chronic conditions. However, these reviews did not comprehensively assessed the body of evidence, and some were not conducted in a systematic manner. A better understanding of the health consequences of shift work and long work hours will aid in creating policy and practice recommendations. This review revisits the epidemiologic evidence on the association of shift work and long work hours with chronic conditions with particular emphasis on assessing the quality of the evidence.

Methods and findings

We conducted a systematic review of systematic reviews with meta-analyses (SR-MA) that assessed the link between shift work or long work hours and chronic conditions (PROSPERO CRD42019122084). We evaluated the risk of bias of each SR-MA using AMSTAR v2 and assessed the overall evidence for each condition using the GRADE approach. We included 48 reviews covering cancers, cardiovascular diseases, metabolic syndrome and related conditions, pregnancy complications, depression, hypertension, and injuries. On average, only 7 of 16 AMSTAR items were fulfilled. Few SR-MAs had a registered protocol and nearly all failed to conduct a comprehensive search. We found moderate grade evidence linking shift work to breast cancer and long work hours to stroke. We found low grade evidence linking both shift work and long work hours with low to moderate increase in risk for some pregnancy complications and cardiovascular diseases. Low grade evidence also link long work hours and depression.

Conclusions

Moderate grade evidence suggest that shift work and long work hours increase the risk of breast cancer and stroke, but the evidence is unclear on other chronic conditions. There is a need for high-quality studies to address this gap. Stakeholders should be made aware of these increased risks, and additional screening and prevention should be considered, particularly for workers susceptible to breast cancer and stroke.

Introduction

Jobs that require work outside the traditional daytime hours of approximately 8 AM to 6 PM have become ubiquitous across economically developed nations. Some jobs such as those in healthcare, manufacturing, and law enforcement routinely require night time or prolonged shifts. In the United States (US) and European Union (EU), a fifth of employees are shift workers [1]. Additionally, a substantial share of the work force works more than the usual 40 hours per week, with 36.1% of the global workforce clocking in excessive hours (more than 48 hours) per week [1].

Shift work schedules and long work hours give rise to acute and chronic health effects ranging from metabolic syndrome to cancers that arise from shared and interacting biological pathways [25]. Shift work disrupts a person’s circadian rhythm and the internal processes controlled by this rhythm, such as clock genes for cell proliferation and melatonin secretion. These disruptions promote inflammation and oncogenesis and are immunosuppressive[35]. For example, breast cancer among female shift works has been attributed to increasing DNA methylation with increasing exposure to shift work[4]. Long work hours, meanwhile, not only cuts into non-work hours that the body needs for rest and recovery but can also be a form of psychologic stress [2,6], and if chronically exposed, this stress can lead to cardiovascular disease [7]. Non-standard work hours can also induce unhealthy coping behaviors, such as low physical activity and poor diets [2].

Recognizing the potentially harmful effects of shift work and long work hours, many governments have enacted laws and regulations restricting their use [8]. While in almost all countries there are restrictions on the maximum allowed work hours and stipulated compensation for work done in excess of these hours, regulation of shift work is more varied. The EU restricts the numbers of night work hours a person can perform per day [8]. The EU, Japan, and South Korea, also require special health examinations for night shift workers and have imposed shift work prohibitions on pregnant women [8]. The US has imposed few restrictions on non-standard work hours, and the policies that exist typically focus on the effects of non-standard work hours on productivity and safety, such as fatigue and occupational injuries [8].

Prior reviews of epidemiologic evidence have concluded that non-standard work hours are associated with increased risk for breast cancer, metabolic disease, and cardiovascular disease [912]. However, these reviews lacked a comprehensive approach for judging the body of evidence, considered only select sources of bias, and some were not conducted in a systematic manner. These weaknesses restrict the ability to confidently quantify the increased risk caused by shift work and long work hours, prevent the calculation of the associated healthcare costs, and therefore, fall short of motivating changes in policy and practice.

In this paper, we report on our systematic review of systematic reviews with meta-analysis (i.e., “umbrella review”) on the association of exposure by workers to shift work and long work hours (hereinafter referred to as “non-standard work hours”) with chronic or high cost conditions. Given the plethora of reviews on various conditions, we felt that compiling and systematically assessing the evidence would be helpful for clinicians and policy makers as they consider appropriate policies and guidelines on these two common non-standard work hour set-ups. Results may also be of interest to employees, who potentially bear an increased risk of chronic illness, and employers and insurers, which often bear the healthcare costs associated with chronic illnesses. We also identify any gaps in the available body evidence to help direct future research.

Materials and methods

Screening, inclusion and exclusion criteria

We included any study that conducted a systematic review of the literature (as opposed to purposive or undocumented selection of articles) using at least one database to examine how exposure by adult workers to shift work or long work hours affect the risk of having or acquiring a chronic or high-cost condition. We included only those that pooled the results in a meta-analysis since only these studies report quantified risk measures that are necessary for making policy decisions regarding non-standard work hours. The screening was done by two authors (AR, MM) independently and differences were resolved by consensus.

We defined shift work as any work outside the standard daytime work hours of approximately 8 AM to 6 PM, and this includes rotating shift work, fixed nights, and evening work. Long work hours was defined as work with a duration that exceeds 40 hours per week. The chronic conditions included in this review were a combination of the highest cost conditions with at least ten percent prevalence among adults in the US, and conditions with the highest personal health spending in the US, for example, diabetes, ischemic heart disease, and low back and neck pain [13,14].

We excluded reviews that investigated (1) biologic mechanisms behind the effects of non-standard work hours on health, (2) association of non-standard work hours and risk factors of chronic conditions (e.g. smoking, low physical activity), and (3) interventions to mitigate effects of non-standard work hours. We excluded reviews that measured impact of non-standard work hours on biomarkers instead of diagnosis (e.g. blood pressure as a continuous outcome vs hypertension), quality of life, sleep-related measures (e.g. disturbances, length, quality), and other employee outcomes (e.g. absenteeism, productivity, work-related stress). Reviews that only had abstracts available were excluded.

We searched the following electronic bibliographic databases from inception to April 2019: MEDLINE Pubmed, Embase (embase.com), Scopus, CINAHL (Ebsco), Web of Science, PsycINFO (Ebsco), ABI Inform Global (Ebsco), Business Source Premier (Ebsco), and Risk Abstracts (ProQuest). We also looked for grey literature in the following sites: Grey Literature Report, OpenGrey, CADTH, Systematic review repository (AHRQ), Epistomonikos, PROSPERO, Working time conference meetings/abstracts, CDC National Institute for Occupational Safety and Health, and Proquest Dissertations. The search strategy was adapted and developed using similar reviews and iterative searches by the research librarian in our team (LO), and a copy can be found in the S1 File. To capture additional relevant literature, we contacted authors of PROSPERO protocols that were marked as completed or were past the registered completion date to ask about availability of their review. We also hand searched the references of included studies to identify potentially relevant articles.

There were no language, country or date restrictions in the search, but we only included articles written in English, Spanish or French due to logistical factors. For Spanish and French articles, an English summary was produced and used for the screening.

Data extraction and quality assessment

Three authors (AR, MA, and MM) performed data extraction and quality assessment independently using standardized forms with each paper being assigned to two reviewers. Conflicts were resolved through discussion. We extracted pooled risk estimates, which were commonly reported as odds ratios (OR) or risk ratios (RR). As most meta-analyses had multiple pooled estimates, we extracted the main pooled results for each outcome of interest and any available dose-response results. We also extracted subgroup analyses based on shift type, design (e.g. cohort only), gender, age group, quality assessment (e.g. high-quality studies only), and race.

To provide a comprehensive and transparent assessment of the evidence, we utilized A MeaSurement Tool to Assess systematic Reviews (AMSTAR) v2 to assess the quality of an individual systematic review with meta-analysis (SR-MA) [15], and the Grades of Recommendation, Assessment, Development and Evaluation (GRADE) approach to judge the overall body evidence for each outcome [16]. For each paper, we counted the number of AMSTAR items that were fulfilled and divided by the total items to get a quality score. GRADE classifies evidence into high, moderate, low, or very low, which reflects the confidence that the studies capture the true effect or association of interest. Since all included SR-MAs pooled results from observational studies, the baseline quality of evidence was “low” and we down- or upgraded the assessment of each outcome following the GRADE criteria which considers risk of bias, imprecision, inconsistency (including heterogeneity), indirectness, and publication bias. For both AMSTAR and GRADE assessments, two authors (AR and MM) conducted independent assessments and resolved differences through consensus. In the Results below, we report quantitative findings of conditions with moderate or low grade evidence and the extracted results of individual studies can be found in the S4 File.

Deviations from the protocol

The review protocol (S5 File) was registered in PROSPERO (CRD42019122084), and we made three modifications. First, we revised the inclusion criteria to limit our scope to SR-MAs. This allowed us to focus on assessing the evidence on the strength of association between non-standard work hours and each outcome. Second, we modified the search strategy to better capture articles that examined the effects of long work hours. The final modification was the adoption of the GRADE approach to assess the overall quality of the evidence. The PRISMA checklist can be found in the S2 File.

Results

Overview of search results

Of the 2,936 articles identified in the initial search, we included 289 in the full text screen. Forty-eight (48) SR-MAs were ultimately included in the analysis (Fig 1) (See S3 File for list of articles excluded in full text screen). Among those articles, 41 (85%) used shift work as the exposure, and 12 (25%) used long work hours. The articles covered the following outcomes: cancers [1732] (16, 33%), cardiovascular disease [3341] (9, 19%), metabolic syndrome, diabetes mellitus, and obesity [4250] (9, 19%), complications of pregnancy [5158] (8, 17%), depression [43,45,59] (4, 8%), hypertension [60] (1, 2%), and injuries [61] (1, 2%). Some conditions we identified to be chronic or high cost (e.g. low back and neck pain, and lower respiratory tract infections) had not been a subject of eligible systematic review with meta-analysis.

Fig 1. PRISMA flowchart for systematic reviews.

Fig 1

Nearly all SR-MAs had a pooled estimate for the association between exposure to any shift work and an outcome, using “never exposed to shift work” or “regular day shift” as control. The definition of long work hours varied, with the lower limit usually set at or above 40 hours per week. Most SR-MAs used standard hours (35–40 hours per week) as the control. (Table 1)

Table 1. Characteristics of included reviews.

Author—Year Chronic condition (s) Exposure(s) assessed Control Types of Studies included Databases search Inclusive Search dates Studies Included in meta-analysis AMSTAR score
CANCERS
He 2015[26] Breast cancer Any type of shift work Not explicitly reported cross-sectional, case-control, cohort Pubmed inception to January 2014 15 4
Ijaz 2013[27] Breast cancer Evening, Fixed, Night, Rotating Day work case-control, cohort Pubmed, EMBASE, CINAHL, PsycInfo, LILACS, OSH Update and ProQuest dissertation and theses databas up to May 2012 12 14
Jia 2013[28] Breast cancer Night shift Preferred reference was the absence of night work case-control, cohort Pubmed, EMBASE, CNKI, Chinese Wanfang Database 1980 to Sept 2012 13 8
Kamdar 2013[29] Breast cancer Fixed, Night/Overnight, Rotating Never had a night shift case-control, cohort PubMed, Embase, CINAHL, Proquest Digital Dissertations, and Web of Science (Conference Proceedings Citations Index) inception to March 1 2012 16 7
Kolstad 2010[30] Breast cancer Night, Rotating, Unspecified Not clearly stated case-control, cohort PubMed, Science Citation Index inception to May 2007 9 4
Li 2017[31] Breast cancer Night, rotating work that included any number of hours between 000 and 0500 Day workers case-control, cohort Pubmed, Embase Medline (1946 to 2015 March 10) and Embase (1974 to 2015 March 10) 20 8
Lin 2015[37] Breast cancer Fixed, Night, Rotating none or regular day Prospective cohort studies Pubmed, ProQuest inception to September 2014 16 5
Megdal 2005[20] Breast cancer Any work that included Night/overnight No night work or in trades with less than 40% night work cohort, case-control PUBMED January 1960 to January 2005 6 6
Travis 2016[22] Breast cancer Any night, Rotating never night shift, day work prospective cohort Pubmed, Scopus, Web of Science up to December 31, 2015 10 8
Wang 2013[23] Breast cancer Fixed, Rotating no exposure Cohort, nested case-control, case-control PUBMED, Embase, PSYCInfo, APC Journal Club and Global Health January 1971 to May 2013 10 4
Wang 2015[24] Colorectal cancer Night shift (ever or regular) never night shift; regular daytime shift Cohort, case-control PubMed, Web of Science, Cochrane Library, EMBASE and the Chinese National Knowledge Infrastructure databases Inception till March 2015 6 7
Du 2017[17] Prostate Cancer Night, Airline-related, Unspecified Not specified prospective or retrospective cohort design PubMed, ScienceDirect, and Embase (Ovid) inception to February 4, 2017 9 8
Gan 2018[25] Prostate Cancer Evening, Night, Mixed, Rotating Not explicitly reported case-control, cohort PubMed, Embase, Web of Science and China National Knowledge Infrastructure up to September 2017 15 7
Mancio 2018[19] Prostate cancer Fixed, Rotating daytime work cohort, case-control Pubmed inception to 17 November 2016 9 7
Rao 2015[21] Prostate cancer Any type daytime, fixed day, or never shift work cross-sectional, cohort, case-control EMBASE, PubMed, Ovid, Web of Science, the Cochrane register, and the China National Knowledge Infrastructure databases January 1966 to December 25, 2014 8 7
Erren 2008[18] Breast and Prostate Cancer Night, Rotating, flight attendants Daytime workers case-control, cohort Pubmed, ISI Web of Knowledge inception to March, 2007 7 4
Liu 2018[32] Breast, Digestive System, Hematological system, Prostate, Reproductive system, Lung, Skin cancers Fixed, Rotating, Mixed Never or shorter duration night shift case-control, cohort, nested case-control study PubMed, Embase, Web of Science Inception to May 2018 58 7
COMPLICATIONS OF PREGNANCY
Bonde 2013 [51] Pregnancy 3-shift work, Evening/night work, changing shift, work before 0800 or 1800 Day work, no shift work, all women working >30 hours/week Cross-sectional, case-control, cohort Pubmed, EMBASE Jan 1966 to June 2012 13 8
Bonzini 2007 [53] Pregnancy Fixed, rotating/changing, or unspecified Not shift work or day only Cross-sectional, case-control, cohort Pubmed, Embase 1966 to December 2005 Preterm: 14 10
LBW: 6
Bonzini 2011 [52] Pregnancy Night, rotating, Unspecified Working women not exposed to shift work cross-sectional, case-control, cohort Pubmed bibliographic databases 1966 to February 2010 Preterm: 16 6
LBW: 6
SGA 10
Cai 2019 [54] Pregnancy rotating, fixed night, long work hours—more than 40 hours per week fixed day or standard working hours, < = 40 hours per week cross-sectional, case-control, cohort MEDLINE, EMBASE, Cochrane Library, CINAHL, ClinicalTrials.gov, Science Citation Index Expanded and Conference Proceedings Citation up to march 15, 2019 62 in SR, 59 in MA 15
Mozurkewich 2000[55] Pregnancy Any type, night, rotating We considered a subject to be “exposed” if she continued to have the assessed work-related exposure at least through the second trimester of pregnancy. cross-sectional, case-control, cohort Pubmed 1966 to August 1999 6 7
Palmer 2013[51] Pregnancy Any type, evening, fixed, night, rotating, unspecified daytime work case-control, cohort, cross-sectional Pubmed, Embase 1966 to 31 December 2011 preterm: 19 6
SGA: 11
Quansah 2010[57] Pregnancy Any type "not exposed" cohort, case-control, cross-sectional Pubmed, Embase January 1966 through August 2009 4 5
van Melick 2014[58] Pregnancy Any type no shift work, 40 hours per week cohort, case-control Pubmed, Embase 1990 to Nov 1 2013 11 8
CARDIOVASCULAR, METABOLIC AND OTHER CONDITIONS
Cheng 2019[33] CVD Night work, rotating, irregular/other, mixed following International Labor Organization standards Daytime workers case–control or cohort study PubMed, Web of Science and Embase January 1970 to October 2017 21 8
Kang 2012[34] CVD Long work hours: >40 hours per week (lower limit varies but 40 seems to be the lowest) lowest category levels of working hours in each of the studies e.g. if reported <40, 40 to 50, 50 to 60, and > = 60, they used < 40 case–control study or cohort study MEDLINER (PubMed), EMBASE, and the Cochrane Central Register of Controlled Trials Up to March 2011 to September 2011. 11 6
Kivimaki 2015[35] CVD Long work hours: Published studies: varied from 45 h or more to 47 to 55 h or more per week. Published studies: standard working hours cohort Embase, Pubmed, Individual-Participant-Data Meta-analysis in Working Populations (IPD-Work) Consortium inception to Aug 20, 2014 CHD: 5 published, 20 unpublished
Stroke: 1 published, 16 unpublished
11
Unpublished data: 35 to 40 hours per week
Unpublished data: > = 55 h per week
Li 2016[36] CVD Evening, Irregular, Mixed, Night, Rotating, Unspecified shifts No shift work cohort (prospective, retrospective cohort, nested case–control PubMed, Embase, and ISI Web of Science databases up to 22 December 2015 5 4
Torquati 2018[38] CVD Fixed, rotating, mixed, any work that differed from standard hours (07:00/08:00–17:00/18:00) non-shift workers (ie, those who only worked usual daytime hours, 08:00–17:00 hours) case-control or cohort Pubmed, Scopus, Web of Science 2006 to 2016 21 9
Virtanen 2012[39] CVD long working hours: from ≥10 to >11 h per day or > 40 to 60 h per week those who worked “normal” hours cross-sectional, cohort, case-control Medline inception of the database (1966) until January 19, 2011 12 5
Vyas 2012[40] CVD Evening, Mixed, Night, Rotating, Unspecified/Irregular Most studies (n = 30) used non-shift day workers as the referent category, and the remainder used the general population as controls (n = 4). cohort (prospective and retrospective), case-control Pubmed including PrePubmed, Embase, BIOSIS Previews, Cochrane CENTRAL, Conference Proceedings Citation Index-Science, Google Scholar, ProQuest Dissertation Abstracts, Scopus, and Science Citation Index Expanded inception until 1 January 2012 34 8
Wang 2018[41] CVD Rotating, Mixed, Unspecified/Irregular non-shift day workers Cohort studies Pubmed, Embase inception to 1 December 2017 5 7
Angerer 2017 [59] Depression night shift work: shift work that included night work between 11 p.m. and 6 a.m Working during the day or with a varying frequency of night shifts Longitudinal studies: cohort study, case-control study, quasi-experimental study PubMed, Scopus, PsycINFO, PSYNDEX, Medpilot. Start of database to Oct 2015 5 10
Lee 2017[62] Depression Night shift not specified cross-sectional, longitudinal, cohort Pubmed, Embase PubMed (1970 to August 2016) and EMBASE (1987
to August 2016)
11 5
Virtanen 2018[63] Depression most often defined as ≥55 weekly hours shorter hours (usu standard hours (most often 35–40 hours)) large prospective studies including cohort studies with both published and unpublished data. PubMed and Embase, Web of Science up to January 2017 published: 10, unpublished: 18 11
Watanabe 2016[64] Depression Long work hours: beyond normal (35–40) hours per week Normal work hours prospective cohort (including nested case-control) MEDLINE (PubMed), PsycINFO, and PsycARTICLES search done on 15 July 2016 7 9
Anothaisintawee 2016 [42] Diabetes mellitus Rotating shift work, Unspecified shift work. Regular day workers Cohort studies Pubmed, Scopus Inception through November 2013 9 10
Cosgrove 2012[43] Diabetes Mellitus Long work hours (>50 h overtime per month, or > = 11 hours per day, or > = 61 hrs per week 0 to 25 h of overtime per month or <8h/day or 21–40 h per week cross-sectional, cohort, case-control. for long work hours, all studies were cohort Pubmed, Allied and Comp Med, British Nursing Index 1994, Kings Fund, CINAHL, DH data, EMBASE, PsychInfo from 1806, major diabetes journals (Diabetes, Diabetes Care,
Diabetologia, Diabetic Medicine, Diabetes Research and Clinical Practice, Diabetes Metabolism Research and Reviews) from
1806 to March 2010 3 6
Gan 2015[44] Diabetes mellitus Evening, Irregular, Night, Rotating, Mixed, Unspecified Not explicitly reported cross-sectional, case-control, cohort PubMed, Embase, Web of Science, ProQuest Dissertation and Theses up to April 2014 12 6
Kivimaki 2015[45] Diabetes mellitus long working hours as 55 h or more of work per week the reference category as 35–40 h of work per week prospective cohort PubMed, Embase up to April 30, 2014 4 studies + 19 datasets 4
Manohar 2017[60] Hypertension Rotating Individuals with non-shift work status cohort, cross-sectional or case-control Ovid PUBMED, EMBASE, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials inception to October 2016 27 8
Watanabe 2018[50] Metabolic Syndrome Night, Rotating, Unspecified daytime or not shift work prospective cohort PubMed, Embase, PsycINFO, PsycARTICLES and the Japan Medical Abstracts Society databases up to 2016 3 7
Wang 2014[49] Metabolic Syndrome/Obesity Fixed or rotating based on International Labor Organization definition unclear cohort, case-control, cross-sectional PubMed and Embase 1971 to 2013 13 6
Liu 2018[46] Obesity Rotating, Night, Mixed non-shift workers (8-hour day shift workers) cohort, cross-sectional, case-control Pubmed, Embase inception to December 2017 23 4
Saulle 2018[47] Obesity Any type day shift cross-sectional, cohort Pubmed, Scopus search done on May 2016 4 5
Sun 2018[48] Obesity Fixed, night, rotating not reported cross-sectional, cohort Pubmed 42795 28 7
Fischer 2017[61] Occupational Injury Afternoon or evening, Night or graveyard Morning or day shift case-control, cross-sectional, and retrospective and prospective cohort studies Pubmed up to April 4, 2016 29 8

CVD–cardiovascular disease, SGA–small for gestational age, LBW–low birth weight

On average 7 (SD: 2.37) of the 16 AMSTAR items were fulfilled yielding an average score of 44.7% (SD: 14.8). Only 19 (39.5%) SR-MAs had a score of 50% or higher. Few SR-MAs had a registered protocol and nearly all failed to conduct a comprehensive search. We flagged several SR-MAs for inappropriate analysis due to pooling of hazards ratio with odds and risk ratios. (Fig 2) GRADE assessment of evidence with the pooled risk estimate from the SR-MA with the highest AMSTAR score for each outcome is summarized in Table 2.

Fig 2. Quality assessment of included reviews using AMSTAR v2 (n = 41).

Fig 2

Red is not fulfilled, blue is fulfilled, and purple is partially fulfilled. RoB means risk of bias.

Table 2. GRADE assessment summary of findings.

Outcome Number of SR/MA Risk estimate from review with highest quality scorea Quality of EVIDENCE Comments
A) Shift work
Breast Cancer 12 Every exposed: RR 1.1 (1.03 to 1.18, I2 = 62)[31] ⊕⊕⊕ Moderate Upgraded due to dose response
Dose response (every 5 years): RR 1.05 (1.01 to 1.10, I2 = 55)[27]b
Ischemic heart disease 1 RR 1.13 (1.08 to 1.20, I2 = 52.7) [33] ⊕⊕ Low
Ischemic stroke 2 Risk Ratio 1.05 (1.01 to 1.09, I2 = 0)[40] ⊕⊕ Low
Gestational Hypertension 1 OR 1.19 (0.97 to 1.45, I2 = 2)[54]c ⊕⊕ Low
Myocardial infarction 2 RR 1.27 (1.17 to 1.39, I2 = 0)[33] ⊕⊕ Low
Preterm delivery 5 RR 1.2 (1.01 to 1.42, phet = 0.002)[53] ⊕⊕ Low Significant heterogeneity but robust conclusions in subgroup analysis
Small for gestational age 4 RR 1.07 (0.96 to 1.96, phet = 0.51)[53] ⊕⊕ Low
All-cause mortality 2 Risk Ratio 1.04 (0.97 to 1.11)[40] ⊕ Very low Downgrade for heterogeneity and imprecision
CVD: any event (CHD, IHD, MI, stroke) 2 ES 1.17 (1.09 to 1.25, I2 = 67)[38] ⊕ Very low Downgrade for heterogeneity No upgrade for dose response due to low quality of review
Depression 2 Risk Estimate 1.42 (0.92 to 2.19, I2 = 74.4)[59] ⊕ Very low Downgrade for high risk of bias, heterogeneity, and imprecision
Diabetes mellitus 2 RR 1.4 (1.18 to 1.66, I2 = 95)[42] ⊕ Very Low Downgrade for heterogeneity
Hypertension 1 OR 1.10 (1.00 to 1.20, I2 = 85)[60] ⊕ Very Low Downgrade for heterogeneity
Low birth weight 2 OR 1.27 (0.93 to 1.74, phet = 0.39)[52] ⊕ Very Low Downgrade for high risk of bias and imprecision
Metabolic Syndrome 2 RR 1.59 (1.00 to 2.54, phet = 0.049)[50] ⊕ Very low Downgrade for high risk of bias and publication bias
Miscarriage 3 OR 1.12 (0.96 to 1.3, phet = 0.53)[51] ⊕ Very low Downgrade for high risk of bias
Obesity 4 OR 1.25 (1.11 to 1.41, I2 = 95.9)[48] ⊕ Very low Downgrade for high risk of bias and heterogeneity
Occupational Injuries 1 RR 1.33 (0.98 to 1.8, I2 = 98.4)[61]b ⊕ Very low Downgrade for high risk of bias, heterogeneity, and imprecision
Preeclampsia 1 OR 1.05 (0.63 to 1.75, I2 = 0%)[54]d ⊕ Very low Downgrade for imprecision
Colorectal cancer 2 OR 1.15 (1.01 to 1.32, I2 = 40.2)[32] ⊕ Very low Downgrade for high risk of bias and publication bias
Hematologic cancers 1 OR 1.08 (0.99 to 1.17, I2 = 54.7)[32] ⊕ Very low Downgrade for high risk of bias
Lung cancer 1 OR 1.08 (0.87 to 1.35, I2 = 53.4)[32] ⊕ Very low Downgrade for high risk of bias
Prostate cancer 5 1.05 (1.00 to 1.11, I2 = 24)[17] ⊕ Very low Downgrade for publication bias No upgrade for dose-response due to low quality of SR
Reproductive system cancers 1 OR 1.06 (0.85 to 1.32, I2 = 49.5)[32] ⊕ Very low Downgrade for high risk of bias
Skin cancer 1 OR 0.93 (0.5 to 1.74, I2 = 74.9)[32] ⊕ Very low Downgrade for high risk of bias and publication bias
B) Long work hours
Stroke 1 RR 1.33 (1.11 to 1.61, I2 = 0)[35] ⊕ Moderate Upgrade due to dose response
Coronary disease 2 RR 1.13 (1.02 to 1.26 I2 = 0)[35] ⊕⊕ Low
Depression 2 OR 1.14 (1.03 to 1.25, I2 = 45.1)[63] ⊕⊕ Low
Low birthweight 1 OR 1.43 (1.11 to 1.84, I2 = 0)[54] ⊕⊕ Low
Preterm delivery 2 OR 1.12 (1.11 to 1.33, I2 = 30)[54] ⊕⊕ Low
Any CVD (CHD, IHD, MI) 1 OR 1.37 (1.11 to 1.70, phet = 0.037)[34] ⊕ Very low Downgrade evidence for high risk of bias and heterogeneity
Diabetes Mellitus 2 RR 1.14 (0.35 to 3.72, I2 = 67)[43] ⊕ Very low Downgrade for high risk of bias, heterogeneity, imprecision, and publication bias
Gestational Hypertension 1 OR 0.99 (0.72 to 1.37, I2 = 62)[54] ⊕ Very low Downgrade for heterogeneity
Miscarriage 2 OR 1.36 (1.25 to 1.49, phet = 0.02)[51] ⊕ Very low Downgrade for heterogeneity and publication bias
Small for Gestational Age 1 OR 1.16 (1.0 to 1.36, I2 = 57)[54] ⊕ Very Low Downgrade for heterogeneity

a–exposure is any type of shift work or >8 hours work per day unless specified otherwise

b–increase in risk every 5 year increase in exposure to shift work

c—exposure is rotating shift work

d–exposure is fixed shift work, GRADE assessment: ⊕ - very low, ⊕⊕ - low, ⊕⊕⊕ - moderate, phet−p-value for heterogeneity test

Shift work

We found moderate grade evidence for the association between breast cancer and shift work. Most [18,20,23,26,28,31,32] (7 out of 9) included SR-MAs on breast cancer found a significantly increased risk among shift workers compared to non-shift workers. Focusing on the most recent SR-MAs, which included only high-quality articles, Li (2015) [31] found that shift workers have an 11% increased risk for breast cancer compared to non-shift workers (RR 1.11, 95% CI 1.02 to 1.20, I2 = 48%). Ijaz et al. (2013) [27] also detected a significant dose-response relationship with 5% increase in risk for every five years of exposure (RR 1.05, 95%CI 1.10 to 1.10, I2 = 55%). Lin et al (2015) [37] found a significant association between rotating shift work and breast cancer, although this should be interpreted with caution due to the review’s low quality.

Six SR-Mas [33,3638,40,41] investigated the association between cardiovascular disease and shift work. We found low grade evidence for ischemic heart disease, myocardial infarction, and ischemic stroke. Cheng et al. (2019) [33] found that there was a 13% increase in risk for ischemic heart disease among shift workers versus controls (1.13, 95%CI: 1.08 to 1.20, I2 = 52.7). While they [33] detected a significant dose-response relationship for ischemic heart disease such that each year of shift work led to a 0.9% increase in risk for ischemic heart disease (RR 1.009, 95% CI: 1.006 to 1.012, phetertogeneity > 0.05), we did not upgrade the evidence rating due to significant heterogeneity of the main and dose-response analyses. This increased risk for ischemic heart disease was present both rotating and fixed night shift work, and they also reported an increased risk for myocardial infarction (1.27, 95%CI: 1.17 to 1.39, I2 = 0) [33]. Meanwhile, Vyas et al. (2012) [40] reported a 5% increase in risk for ischemic stroke (RR 1.05, 95%CI 1.01 to 1.09, I2 = 0) among shift workers. We rated evidence that linked shift work to broadly defined cardiovascular disease (vs specific forms such as stroke) was very low (Table 2).

Among complications of pregnancy, the association between shift work and two complications, preterm delivery and small-for-gestational-age infant was supported by low-grade evidence. Bonzini et al. (2007) [53] estimated a significant increase in risk for preterm birth among shift workers (RR 1.20, 95%CI: 1.01–1.42, pheterogeneity = 0.002). They also found that results that trended towards significance on shift work and small-for-gestational-age (RR 1.07, 95%CI: 0.96–1.19, I2 = 3.3%). The lower quality update of Bonzini et al. ‘s review [52] found significant increased risk for both outcomes among shift workers.

Cai et al. (2019) [54] estimated the effects of rotating shifts and fixed night shifts on complications of pregnancy and rated the link between the two types of shift work and gestational hypertension to be low grade. Fixed shifts were associated with gestational hypertension (OR = 1.19, 95%CI: 1.1 to 1.29, I2 = 0%) and there was a trend towards significance between rotating shift and gestational hypertension (OR = 1.19, 95%CI: 0.97 to 1.45, I2 = 0%).[54] Fixed shifts were also associated with increased risk for preterm delivery (OR = 1.21, 95%CI: 1.03 to 1.42, I2 = 36%). Rotating shifts, meanwhile, was associated with increased the risk of preterm delivery (OR = 1.13, 95%CI: 1.00 to 1.28, I2 = 31%), and offspring that are small for gestational age (OR = 1.18, 95%CI: 1.01 to 1.38, I2 = 0%). We assessed the evidence for miscarriages and preeclampsia to be very low due to imprecision or inconsistency.

We found very low-grade evidence regarding shift work’s effect on risk for depression, diabetes mellitus, hypertension, miscarriages, occupational injuries, obesity, metabolic syndrome, and other cancers (colorectal, hematologic, lung, prostate, reproductive system, and skin) (Table 2). Most of the SR-MAs of these outcomes had high risk of bias. The common unmet AMSTAR items are related to protocol registration, search comprehensiveness, listing excluded studies, assessing impact of funding sources, use of appropriate pooling technique, and assessing and discussing risk of bias of included studies in the meta-analysis. (Fig 2) There were also limitations related to imprecision or unexplained heterogeneity.

Long work hours

Stroke is the only outcome that had moderate grade evidence associated with long work hours. Kivimaki et al. (2015) [35] found that there was a 33% increased risk of stroke among those who worked more than 40 hours per week, compared to those who work standard hours (RR: 1.33, 95%CI: 1.11 to 1.61, I2 = 0). Their metaregression results suggested that risk might be higher among those with high socio-economic status (compared to low socio-economic status) but there were no differences by age group or sex. They also observed a dose-response relationship with longer hours per week translating to higher risk (RR 1.11, 95%CI: 1.05 to 1.17; 11% increase per increase in work hour category).

There was low-grade evidence supporting the association between depression, coronary disease, and selected complications of pregnancy (preterm delivery and low birthweight) with long work hours. Virtanen et al. (2018) [63] found 14% higher odds (OR 1.14, 95%CI 1.03 to 1.25, I2 = 45.1%) of depression among those who worked >40 hours per week. Kivimaki et al. (2015) [54] found a 13% increased risk for coronary disease for those doing long work hours (RR 1.13, 95%CI: 1.02 to 1.26 I2 = 0).[35] Cai et al. (2019) found a 21% increase in odds for preterm delivery (OR 1.21, 95%CI: 1.11 to 1.13, I2 = 30%) and a 43% increase in odds of having low birth weight offspring (OR 1.43, 95%CI: 1.11 to 1.84, I2 = 0%) among women working >40 hours per week during pregnancy. They also reported a significant linear relationship between hours worked and the risk of preterm delivery.

We found very low-grade evidence for long work hours and the following outcomes: miscarriage, preeclampsia, gestational hypertension, small for gestational age, diabetes mellitus, and any cardiovascular disease (Table 2). SR-MAs had high risk of bias and issues with the heterogeneity of results casting doubt on the significant relationships detected by these reviews. Unmet AMSTAR items leading to the high risk of bias were similar to that of reviews on shift work.

Discussion

We found moderate grade evidence linking shift work to breast cancer and long work hours to stroke. We also found low-grade evidence linking shift work to ischemic heart disease, myocardial infarction, ischemic stroke, gestational hypertension, preterm delivery, and small-for-age babies, and low-grade evidence on the association between long work hours and coronary disease, depression, low birthweight babies, and preterm delivery (Table 2). Our conclusions align with previous reviews[10,11], though we identified specific diseases (e.g. stroke and myocardial infarction) rather than adopting broad categories (e.g., cardiovascular disease). Our study is notable because we found that not all associations of non-standard work hours to cardiovascular diseases and cancers were supported by sufficient quality evidence.

Our findings should be of interest to workers, unions, and other organizations that advocate for workplace well-being. Workers should be informed of the risks associated with these jobs and the evidence-based screenings and interventions that might mitigate the risk. The increased occurrence of these outcomes ultimately translates to increased healthcare costs, which burdens the workers and businesses. We recognize that in some industries (e.g., manufacturing, transportation, hospitals, and police/fire departments), shift work and long work hours may be inevitable; nevertheless, employers should be aware of the healthcare costs associated with their non-standard work hours, potentially consider alternative schedules, and encourage screenings and interventions to reduce risk. In countries like the US, where self-insured companies bear the additional costs of these conditions, there might be a case for restricting non-standard work hours that balances lost productivity with potential savings due to the prevention of these conditions.

Findings may also be of interest to policymakers, as several countries have enacted policies to protect shift workers such as restricting total shift work hours per week and requiring companies to offer free health exams to shift workers [8]. It is still rare for governments to require companies to provide compensation to employees harmed by shift work. The exception is Denmark, where shift workers who develop breast cancer receive compensation. The first claimants received amounts ranging from US$ 3,000 to US$ 100,000, funded through their employers’ insurance companies [65]. However, current evidence does not clearly identify advantages of fixed shifts over rotating shifts and does not suggest a specific threshold for maximum number of hours per week. Both topics warrant more research. Our findings, however, suggest that a maximum lifetime exposure cap might be warranted, particularly when the risk from exposure has meaningful dose-response association. This policy should be considered for occupations where shift work is unavoidable, such as healthcare and law enforcement. In countries with universal healthcare insurance, regulating non-standard work hours may translate into non-trivial societal savings.

Screening and behavioral changes are commonly used preventive interventions for various health conditions. While we found moderate evidence suggesting non-standard work hours may increase the risk for certain conditions captured in current screening or preventive guidelines (e.g. breast cancer and stroke); there are no specific recommendations for screening for these conditions based on work hours. It is unclear whether there should be unique guidelines for those exposed to non-standard work hours (e.g. should shift workers be screened at earlier ages?). Some research exists on behavioral interventions for shift workers [66]. Guidance for employers on managing the impact of shift work remains largely focused on designing efficient shift schedules and promoting healthy lifestyle among workers [66,67]. The effect of these interventions in the long term and on the risk for acquiring chronic conditions should continue to be investigated.

We performed a comprehensive search and assessment of the literature to arrive at our findings. We used a reproducible method for assessing the evidence, and as new reviews are produced, our assessments can be updated following the same methodology. Despite the number of SR-MAs included, several research questions related to the epidemiologic link between non-standard work hours and chronic conditions remain unanswered. Studies on differential risks are needed. Examples would be studies that compare rotating versus fixed shift and studies that look at sex or geographic differences. Dose-response meta-analyses are also needed, especially for establishing causality.

We focused on epidemiologic evidence in this review, but it should be acknowledged that mechanistic studies that investigate how shiftwork alters biological processes to increase the risk for various conditions are necessary to prove with certainty that non-standard work hours are causing these outcomes. These studies, together with epidemiologic studies, are also needed to guide intervention and policy development. We found studies that proposed disease mechanisms for two conditions with moderate grade evidence. For breast cancer, shift work leads to disruption of circadian rhythms which in turn lead to genetic and epigenetic changes that promote cancer growth [4]. For stroke, long work hours is a source of stress and this stress leads to damage to the cardiovascular system. Long work hours can also promote unhealthy behaviors that further increase risk for stroke [6,7].

Several SR-MAs included in this study failed to meet the current standards for systematic reviews and meta-analyses as outlined in AMSTAR. Requirements such as protocol registration, comprehensive search strategies, and appropriate pooling of studies were most commonly unmet. Failing to meet AMSTAR conditions was a common reason for downgrading the evidence. We recommend that future SR-MAs are conducted in accordance with these guidelines to ensure minimization of risk of bias.

We downgraded much of the evidence due to issues of heterogeneity. The individual studies pooled by meta-analyses that we reviewed often had differences in definitions, and measurement of exposures, and included populations. There were also differences in the variables used to calculate adjusted risk estimates. Despite these potential sources of heterogeneity, subgroup analyses often failed to identify any socio-demographic or study design-related factors as a significant source of heterogeneity. Fortunately, individual level cohort data is increasingly becoming available and allows for individual-level meta-analyses. These individual-level meta-analyses allow researchers to apply more consistent definitions and utilize the same regression models for getting adjusted measures of association.

Our review has several limitations. One is that we focused on SR-MAs and did not look for additional observational studies. Some of the SR-MAs we included (e.g., those regarding pregnancy complications) were published more than five years ago, and new observational studies may provide better quality evidence regarding these outcomes. We were also limited to outcomes where meta-analyses were performed. On account of these, we may have missed high quality observational studies. Another weakness is that we assessed papers based on the data published. Some AMSTAR criteria may have been fulfilled during the conduct of the study, but were excluded from the published manuscript resulting in lower quality scores. Finally, there are new work hour arrangements, such as flexible work hours or compressed workweeks, that we did not include in this review. Health effects of these arrangements might be similar to those included here if these work arrangements induce circadian rhythm disruptions or exceed the standard work hour length.

Conclusion

Non-standard work hours are likely associated with several chronic outcomes. There is moderate grade evidence linking shift work to breast cancer and long work hours to stroke. There is low-grade evidence that suggests an increased risk of depression, some forms of cardiovascular diseases, and complications of pregnancy with exposure to non-standard work hours. Differential risk across different types of shift work and diverse populations should also be studied. Our results suggest that non-standard work hours may be detrimental to employee health. Workers should be informed of the potential risks associated with these jobs, and additional screening and preventive measures for breast cancer and stroke may be warranted. Higher quality research needs to be conducted to ascertain effects on other chronic and high-cost outcomes and to guide stronger policy recommendations.

Supporting information

S1 File. Search strategy.

(PDF)

S2 File. PRISMA checklist.

(PDF)

S3 File. List of excluded articles in full text screen.

(XLSX)

S4 File. Pooled results of included reviews per condition.

(PDF)

S5 File. Registered protocol.

(PDF)

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This project is funded through the Robert Wood Johnson Foundation (https://www.rwjf.org/) (Grant Number 7610) awarded to MM. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Messenger Jon. Working time and the future of work Future of Work Research Paper Series. Geneva, Switzerland: International Labor Office; 2018. p. 44 Available: https://www.ilo.org/global/topics/future-of-work/publications/research-papers/WCMS_649907/lang—en/index.htm [Google Scholar]
  • 2.Merkus SL, Holte KA, Huysmans MA, Van Mechelen W, Van Der Beek AJ. Nonstandard working schedules and health: The systematic search for a comprehensive model. BMC Public Health. 2015;15: 1–15. 10.1186/1471-2458-15-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Puttonen S, Harma M, Hublin C. Shift work and cardiovascular disease—pathways from circadian stress to morbidity. Scand J Work Environ Health. 2010;36: 96–108. 10.5271/sjweh.2894 [DOI] [PubMed] [Google Scholar]
  • 4.Haus EL, Smolensky MH. Shift work and cancer risk: Potential mechanistic roles of circadian disruption, light at night, and sleep deprivation. Sleep Med Rev. 2013;17: 273–284. 10.1016/j.smrv.2012.08.003 [DOI] [PubMed] [Google Scholar]
  • 5.Reiter RJ, Tan DX, Korkmaz A, Ma S. Obesity and metabolic syndrome: Association with chronodisruption, sleep deprivation, and melatonin suppression. Ann Med. 2012;44: 564–577. 10.3109/07853890.2011.586365 [DOI] [PubMed] [Google Scholar]
  • 6.Haines VY, Marchand A, Genin E, Rousseau V. A balanced view of long work hours. Int J Work Heal Manag. 2012;5: 104–119. 10.1108/17538351211239153 [DOI] [Google Scholar]
  • 7.Kivimäki M, Steptoe A. Effects of stress on the development and progression of cardiovascular disease. Nat Rev Cardiol. 2018;15: 215–229. 10.1038/nrcardio.2017.189 [DOI] [PubMed] [Google Scholar]
  • 8.Gartner J, Rosa RR, Roach G, Kubo T, Takahashi M. Working Time Society consensus statements: Regulatory approaches to reduce risks associated with shift work—a global comparison. Ind Health. 2019;57: 245–263. 10.2486/indhealth.SW-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Wang XS, Armstrong MEG, Cairns BJ, Key TJ, Travis RC. Shift work and chronic disease: The epidemiological evidence. Occup Med (Chic Ill). 2011;61: 78–89. 10.1093/occmed/kqr001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Kecklund G, Axelsson J. Health consequences of shift work and insufficient sleep. BMJ. 2017;356: i6599 10.1136/sbmj.i6599 [DOI] [PubMed] [Google Scholar]
  • 11.Ganster DC, Rosen CC, Fisher GG. Long Working Hours and Well-being: What We Know, What We Do Not Know, and What We Need to Know. J Bus Psychol. 2018;33: 25–39. 10.1007/s10869-016-9478-1 [DOI] [Google Scholar]
  • 12.Moreno CRC, Marqueze EC, Sargent C, Wright KP Jr, Ferguson SA, Tucker P. Working Time Society consensus statements: Evidence-based effects of shift work on physical and mental health. Ind Health. 2019;57: 139–157. 10.2486/indhealth.SW-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Dieleman JL, Baral R, Birger M, Bui AL, Bulchis A, Chapin A, et al. US spending on personal health care and public health, 1996–2013. JAMA—J Am Med Assoc. 2016;316: 2627–2646. 10.1001/jama.2016.16885 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Soni A, Mitchell E. Expenditures for Commonly Treated Conditions among Adults Age 18 and Older in the US Civilian Noninstitutionalized Population, 2013. Stat Br. [PubMed]
  • 15.Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358: 1–9. 10.1136/bmj.j4008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336: 924–926. 10.1136/bmj.39489.470347.AD [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Du HB, Bin KY, Liu WH, Yang FS. Shift work, night work, and the risk of prostate cancer: A meta-analysis Based on 9 cohort studies. Med (United States). 2017;96 10.1097/MD.0000000000008537 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Erren TC, Pape HG, Reiter RJ, Piekarski C. Chronodisruption and cancer. Naturwissenschaften. 2008;95: 367–382. 10.1007/s00114-007-0335-y [DOI] [PubMed] [Google Scholar]
  • 19.Mancio J, Leal C, Ferreira M, Norton P, Lunet N. Does the association of prostate cancer with night-shift work differ according to rotating vs. fixed schedule? A systematic review and meta-analysis. Prostate Cancer Prostatic Dis. 2018;21: 337–344. 10.1038/s41391-018-0040-2 [DOI] [PubMed] [Google Scholar]
  • 20.Megdal SP, Kroenke CH, Laden F, Pukkala E, Schernhammer ES. Night work and breast cancer risk: A systematic review and meta-analysis. Eur J Cancer. 2005;41: 2023–2032. 10.1016/j.ejca.2005.05.010 [DOI] [PubMed] [Google Scholar]
  • 21.Rao D, Yu H, Bai Y, Zheng X, Xie L. Does night-shift work increase the risk of prostate cancer? A systematic review and meta-analysis. Onco Targets Ther. 2015;8: 2817–2826. 10.2147/OTT.S89769 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Travis RC, Balkwill A, Fensom GK, Appleby PN, Reeves GK, Wang XS, et al. Night shift work and breast cancer incidence: Three prospective studies and meta-analysis of published studies. J Natl Cancer Inst. 2016;108: 1–9. 10.1093/jnci/djw169 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Wang F, Yeung KL, Chan WC, Kwok CCH, Leung SL, Wu C, et al. A meta-analysis on dose-response relationship between night shift work and the risk of breast cancer. Ann Oncol. 2013;24: 2724–2732. 10.1093/annonc/mdt283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Wang X, Ji A, Zhu Y, Liang Z, Wu J, Li S, et al. A meta-analysis including dose-response relationship between night shift work and the risk of colorectal cancer. Oncotarget. 2015;6: 25046–25060. 10.18632/oncotarget.4502 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Gan Y, Li L, Zhang L, Yan S, Gao C, Hu S, et al. Association between shift work and risk of prostate cancer: A systematic review and meta-analysis of observational studies. Carcinogenesis. 2018;39: 87–97. 10.1093/carcin/bgx129 [DOI] [PubMed] [Google Scholar]
  • 26.He C, Anand ST, Ebell MH, Vena JE, Robb SW. Circadian disrupting exposures and breast cancer risk: a meta-analysis. Int Arch Occup Environ Health. 2015;88: 533–547. 10.1007/s00420-014-0986-x [DOI] [PubMed] [Google Scholar]
  • 27.Ijaz S, Verbeek J, Seidler A, Lindbohm ML, Ojajärvi A, Orsini N, et al. Night-shift work and breast cancer—A systematic review and meta-analysis. Scand J Work Environ Heal. 2013;39: 431–447. 10.5271/sjweh.3371 [DOI] [PubMed] [Google Scholar]
  • 28.Jia Y, Lu Y, Wu K, Lin Q, Shen W, Zhu M, et al. Does night work increase the risk of breast cancer? A systematic review and meta-analysis of epidemiological studies. Cancer Epidemiol. 2013;37: 197–206. 10.1016/j.canep.2013.01.005 [DOI] [PubMed] [Google Scholar]
  • 29.Kamdar BB, Tergas AI, Mateen FJ, Bhayani NH, Oh J. Night-shift work and risk of breast cancer: A systematic review and meta-analysis. Breast Cancer Res Treat. 2013;138: 291–301. 10.1007/s10549-013-2433-1 [DOI] [PubMed] [Google Scholar]
  • 30.Kolstad HA, Erlandsen M, Frost P, Bonde JP. Should we warn against night shifts to prevent breast cancer? Occup Environ Med. 2010;67: 797 10.1136/oem.2010.056499 [DOI] [PubMed] [Google Scholar]
  • 31.Li M. Night Shift Work and Risk of Breast Cancer: A Case-control Study among Hong Kong Chinese Women. Chinese University of Hong Kong; 2015. [Google Scholar]
  • 32.Liu W, Zhou Z, Dong D, Sun L, Zhang G. Sex differences in the association between night shift work and the risk of cancers: A meta-analysis of 57 articles. Dis Markers. 2018;2018 10.1155/2018/7925219 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Cheng M, He H, Wang D, Xu L, Wang B, Ho KM, et al. Shift work and ischaemic heart disease: Meta-analysis and dose-response relationship. Occup Med (Chic Ill). 2019;69: 182–188. 10.1093/occmed/kqz020 [DOI] [PubMed] [Google Scholar]
  • 34.Kang MY, Park H, Seo JC, Kim D, Lim YH, Lim S, et al. Long working hours and cardiovascular disease: A meta-analysis of epidemiologic studies. J Occup Environ Med. 2012;54: 532–537. 10.1097/JOM.0b013e31824fe192 [DOI] [PubMed] [Google Scholar]
  • 35.Kivimäki M, Jokela M, Nyberg ST, Singh-Manoux A, Fransson EI, Alfredsson L, et al. Long working hours and risk of coronary heart disease and stroke: A systematic review and meta-analysis of published and unpublished data for 603 838 individuals. Lancet. 2015;386: 1739–1746. 10.1016/S0140-6736(15)60295-1 [DOI] [PubMed] [Google Scholar]
  • 36.Li M, Huang JT, Tan Y, Yang BP, Tang ZY. Shift work and risk of stroke: A meta-analysis. Int J Cardiol. 2016;214: 370–373. 10.1016/j.ijcard.2016.03.052 [DOI] [PubMed] [Google Scholar]
  • 37.Lin X, Chen W, Wei F, Ying M, Wei W, Xie X. Night-shift work increases morbidity of breast cancer and all-cause mortality: A meta-analysis of 16 prospective cohort studies. Sleep Med. 2015;16: 1381–1387. 10.1016/j.sleep.2015.02.543 [DOI] [PubMed] [Google Scholar]
  • 38.Torquati L, Mielke GI, Brown WJ, Kolbe-Alexander T. Shift work and the risk of cardiovascular disease. A systematic review and meta-analysis including dose-response relationship. Scand J Work Environ Heal. 2018;44: 229–238. 10.5271/sjweh.3700 [DOI] [PubMed] [Google Scholar]
  • 39.Virtanen M, Heikkilä K, Jokela M, Ferrie JE, Batty GD, Vahtera J, et al. Long working hours and coronary heart disease: A systematic review and meta-analysis. Am J Epidemiol. 2012;176: 586–596. 10.1093/aje/kws139 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Vyas M V., Garg AX, Iansavichus A V., Costella J, Donner A, Laugsand LE, et al. Shift work and vascular events: Systematic review and meta-analysis. BMJ. 2012;345: 1–11. 10.1136/bmj.e4800 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Wang D, Ruan W, Chen Z, Peng Y, Li W. Shift work and risk of cardiovascular disease morbidity and mortality: A dose–response meta-analysis of cohort studies. Eur J Prev Cardiol. 2018;25: 1293–1302. 10.1177/2047487318783892 [DOI] [PubMed] [Google Scholar]
  • 42.Anothaisintawee T, Reutrakul S, Van Cauter E, Thakkinstian A. Sleep disturbances compared to traditional risk factors for diabetes development: Systematic review and meta-analysis. Sleep Med Rev. 2016;30: 11–24. 10.1016/j.smrv.2015.10.002 [DOI] [PubMed] [Google Scholar]
  • 43.Cosgrove MP, Sargeant LA, Caleyachetty R, Griffin SJ. Work-related stress and Type 2 diabetes: Systematic review and meta-analysis. Occup Med (Chic Ill). 2012;62: 167–173. 10.1093/occmed/kqs002 [DOI] [PubMed] [Google Scholar]
  • 44.Gan Y, Yang C, Tong X, Sun H, Cong Y, Yin X, et al. Shift work and diabetes mellitus: A meta-analysis of observational studies. Occup Environ Med. 2015;72: 72–78. 10.1136/oemed-2014-102150 [DOI] [PubMed] [Google Scholar]
  • 45.Kivimäki M, Virtanen M, Kawachi I, Nyberg ST, Alfredsson L, Batty GD, et al. Long working hours, socioeconomic status, and the risk of incident type 2 diabetes: A meta-analysis of published and unpublished data from 222120 individuals. Lancet Diabetes Endocrinol. 2015;3: 27–34. 10.1016/S2213-8587(14)70178-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Liu Q, Shi J, Duan P, Liu B, Li T, Wang C, et al. Is shift work associated with a higher risk of overweight or obesity? A systematic review of observational studies with meta-analysis. Int J Epidemiol. 2018;47: 1956–1971. 10.1093/ije/dyy079 [DOI] [PubMed] [Google Scholar]
  • 47.Saulle R, Bernardi M, Chiarini M, Backhaus I, Torre G La Shift work, overweight and obesity in health professionals: a systematic review and meta-analysis. Clin Ter. 2018;169: e189–e197. 10.7417/T.2018.2077 [DOI] [PubMed] [Google Scholar]
  • 48.Sun M, Feng W, Wang F, Li P, Li Z, Li M, et al. Meta-analysis on shift work and risks of specific obesity types. Obes Rev. 2018;19: 28–40. 10.1111/obr.12621 [DOI] [PubMed] [Google Scholar]
  • 49.Wang F, Zhang L, Zhang Y, Zhang B, He Y, Xie S, et al. Meta-analysis on night shift work and risk of metabolic syndrome. Obes Rev. 2014;15: 709–720. 10.1111/obr.12194 [DOI] [PubMed] [Google Scholar]
  • 50.Watanabe K, Sakuraya A, Kawakami N, Imamura K, Ando E, Asai Y, et al. Work-related psychosocial factors and metabolic syndrome onset among workers: a systematic review and meta-analysis. Obes Rev. 2018;19: 1557–1568. 10.1111/obr.12725 [DOI] [PubMed] [Google Scholar]
  • 51.Bonde JP, Jørgensen KT, Bonzini M, Palmer KT. Miscarriage and occupational activity: A systematic review and meta-analysis regarding shift work, working hours, lifting, standing, and physical workload. Scand J Work Environ Heal. 2013;39: 325–334. 10.5271/sjweh.3337 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Bonzini M, Palmer KT, Coggon D, Carugno M, Cromi A, Ferrario MM. Shift work and pregnancy outcomes: A systematic review with meta-analysis of currently available epidemiological studies. BJOG An Int J Obstet Gynaecol. 2011;118: 1429–1437. 10.1111/j.1471-0528.2011.03066.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Bonzini M, Coggon D, Palmer KT. Risk of prematurity, low birthweight and pre-eclampsia in relation to working hours and physical activities: A systematic review. Occup Environ Med. 2007;64: 228–243. 10.1136/oem.2006.026872 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Cai C, Vandermeer B, Khurana R, Nerenberg K, Featherstone R, Sebastianski M, et al. The impact of occupational shift work and working hours during pregnancy on health outcomes: a systematic review and meta-analysis. Am J Obstet Gynecol. 2019. 10.1016/j.ajog.2019.06.051 [DOI] [PubMed] [Google Scholar]
  • 55.Mozurkewich EL, Luke B, Avni M, Wolf FM. Working conditions and adverse pregnancy outcome: A meta-analysis. Obstet Gynecol. 2000;95: 623–635. 10.1016/s0029-7844(99)00598-0 [DOI] [PubMed] [Google Scholar]
  • 56.Palmer KT, Bonzini M, Harris EC, Linaker C, Bonde JP. Work activities and risk of prematurity, low birth weight and pre-eclampsia: An updated review with meta-analysis. Occup Environ Med. 2013;70: 213–222. 10.1136/oemed-2012-101032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Quansah R, Jaakkola JJ. Occupational exposures and adverse pregnancy outcomes among nurses: A systematic review and meta-analysis. J Women’s Heal. 2010;19: 1851–1862. 10.1089/jwh.2009.1876 [DOI] [PubMed] [Google Scholar]
  • 58.van Melick MJGJ, van Beukering MDM, Mol BW, Frings-Dresen MHW, Hulshof CTJ. Shift work, long working hours and preterm birth: a systematic review and meta-analysis. Int Arch Occup Environ Health. 2014;87: 835–849. 10.1007/s00420-014-0934-9 [DOI] [PubMed] [Google Scholar]
  • 59.Angerer P, Schmook R, Elfantel I, Li J. Night Work and the Risk of Depression. Dtsch Arztebl Int. 2017;114: 404–411. 10.3238/arztebl.2017.0404 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Manohar S, Thongprayoon C, Cheungpasitporn W, Mao MA, Herrmann SM. Associations of rotational shift work and night shift status with hypertension: A systematic review and meta-analysis. J Hypertens. 2017;35: 1929–1937. 10.1097/HJH.0000000000001442 [DOI] [PubMed] [Google Scholar]
  • 61.Fischer D, Lombardi DA, Folkard S, Willetts J, Christiani DC. Updating the “Risk Index”: A systematic review and meta-analysis of occupational injuries and work schedule characteristics. Chronobiol Int. 2017;34: 1423–1438. 10.1080/07420528.2017.1367305 [DOI] [PubMed] [Google Scholar]
  • 62.Lee A, Myung SK, Cho JJ, Jung YJ, Yoon JL, Kim MY. Night shift work and risk of depression: Meta-analysis of observational studies. J Korean Med Sci. 2017;32: 1091–1096. 10.3346/jkms.2017.32.7.1091 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Virtanen M, Jokela M, Madsen IEH, Magnusson Hanson LL, Lallukka T, Nyberg ST, et al. Long working hours and depressive symptoms: Systematic review and meta-analysis of published studies and unpublished individual participant data. Scand J Work Environ Heal. 2018;44: 239–250. 10.5271/sjweh.3712 [DOI] [PubMed] [Google Scholar]
  • 64.Watanabe K, Imamura K, Kawakami N. Working hours and the onset of depressive disorder: A systematic review and meta-analysis. Occup Environ Med. 2016;73: 877–884. 10.1136/oemed-2016-103845 [DOI] [PubMed] [Google Scholar]
  • 65.Wise J. Danish night shift workers with breast cancer awarded compensation. BMJ. 2009;338 10.1136/bmj.b1152 [DOI] [PubMed] [Google Scholar]
  • 66.Neil-Sztramko SE, Pahwa M, Demers PA, Gotay CC. Health-related interventions among night shift workers: A critical review of the literature. Scand J Work Environ Heal. 2014;40: 543–556. 10.5271/sjweh.3445 [DOI] [PubMed] [Google Scholar]
  • 67.Health and Safety Executive. Managing Shiftwork. Heal Saf Guid. 2006. 10.1518/107118188786762261 [DOI] [Google Scholar]

Decision Letter 0

Omid Beiki

15 Jan 2020

PONE-D-19-34056

Shift Work and Long Work Hours and their Association with Chronic Health Conditions: A Systematic Review of Systematic Reviews with Meta-analyses

PLOS ONE

Dear Mr Rivera,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Feb 29 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Omid Beiki, M.D., Ph.D.

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a very comprehensive review. I would have liked more conceptual discussion on potential underlying mechanisms. For example, I would have liked more on the link between work patterns and breast cancer. That work would affect breast cancer onset seems to me like a stretch.

Then there is an issue of heterogeneity of effects. I would expect that work-related stress would have a greater effect on the probability of stroke among 64-year olds than among 34 year olds. More on such heterogeneity would be desirable to have.

For some worker types, night shifts are unavoidable, e.g. health workers, firemen, police.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Apr 2;15(4):e0231037. doi: 10.1371/journal.pone.0231037.r002

Author response to Decision Letter 0


27 Feb 2020

Detailed below are our responses to the comments. These can also be found in the Response to comments file we uploaded.

Comment 1: Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.*

Response: We have made the necessary changes to fulfill PLOS ONE’s style requirements. Since they were numerous and minor, we did not include these among the tracked changes. We hope this makes the manuscript more readable.

Comment 2: This is a very comprehensive review. I would have liked more conceptual discussion on potential underlying mechanisms. For example, I would have liked more on the link between work patterns and breast cancer. That work would affect breast cancer onset seems to me like a stretch.

Response: We agree with the comment regarding the conceptual discussion and have added more detailed examples of biological pathways that link shift work and long work hours with chronic conditions in both the introduction and discussion. To align with our results, we focused on mechanisms that explain the link between breast cancer and stroke to non-standard work hours. Changes made with corresponding page and line numbers are below:

• Page 3, Lines 55 to 60 New statements:

“For example, breast cancer among female shift works has been attributed to increasing DNA methylation with increasing exposure to shift work[4]. Long work hours, meanwhile, not only cuts into non-work hours that the body needs for rest and recovery, but can also be a form of psychologic stress [2,6], and if chronically exposed, this stress can lead to cardiovascular disease [7]. Non-standard work hours can also induce unhealthy coping behaviors, such as low physical activity and poor diets [2].”

• Page 28, lines 302 to 306

“We found studies that proposed disease mechanisms for two conditions with moderate grade evidence. For breast cancer, shift work leads to disruption of circadian rhythms which in turn lead to genetic and epigenetic changes that promote cancer growth [4]. For stroke, long work hours is a source of stress, and this stress leads to damage to the cardiovascular system. Long work hours can also promote unhealthy behaviors that further increase risk for stroke [6,7].”

Comment 3: Then there is an issue of heterogeneity of effects. I would expect that work-related stress would have a greater effect on the probability of stroke among 64-year olds than among 34 year olds. More on such heterogeneity would be desirable to have.

Response: We were also interested in any important subgroups such as age and sex. However, not all reviews included these in their analysis. We have added the results of the limited subgroup analyses related to stroke. We have previously reported subgroups based on shift type and total length of shift work exposure for breast cancer. We did not include additional subgroups for other conditions since the overall evidence for these conditions was low or very low in quality. We have included the new statements with corresponding page and line numbers below:

• Page 25, Lines 229 to 231

“Their metaregression results suggested that risk might be higher among those with high socio-economic status (compared to low socio-economic status) but there were no differences by age group or sex. “

• Page 29, Lines 312 to 318

“We downgraded much of the evidence due to issues of heterogeneity. The individual studies pooled by meta-analyses that we reviewed often had differences in definitions, measurement of exposures, and included populations. There were also differences in the variables used to calculate adjusted risk estimates. Despite these potential sources of heterogeneity, subgroup analyses often failed to identify any socio-demographic or study design-related factors as a significant source of heterogeneity. Fortunately, individual level cohort data is increasingly becoming available and allows for individual-level meta-analyses.”

Comment 4: For some worker types, night shifts are unavoidable, e.g. health workers, firemen, police.

Response: We agree with this comment and have added this detail in both the introduction and discussion.

• Page 3, Lines 45 to 46

“Some jobs such as those in healthcare, manufacturing, and law enforcement routinely require night time or prolonged shifts.”

• Page 23, Lines 282 to 283

“This policy should be considered for occupations where shift work is unavoidable, such as healthcare and law enforcement.”

Attachment

Submitted filename: Plos - Response to Reviewers.docx

Decision Letter 1

Omid Beiki

16 Mar 2020

Shift Work and Long Work Hours and their Association with Chronic Health Conditions: A Systematic Review of Systematic Reviews with Meta-analyses

PONE-D-19-34056R1

Dear Dr. Rivera,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Omid Beiki, M.D., Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Omid Beiki

18 Mar 2020

PONE-D-19-34056R1

Shift Work and Long Work Hours and their Association with Chronic Health Conditions: A Systematic Review of Systematic Reviews with Meta-analyses

Dear Dr. Rivera:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Omid Beiki

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Search strategy.

    (PDF)

    S2 File. PRISMA checklist.

    (PDF)

    S3 File. List of excluded articles in full text screen.

    (XLSX)

    S4 File. Pooled results of included reviews per condition.

    (PDF)

    S5 File. Registered protocol.

    (PDF)

    Attachment

    Submitted filename: Plos - Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES