Skip to main content
PLOS One logoLink to PLOS One
. 2021 Feb 4;16(2):e0246451. doi: 10.1371/journal.pone.0246451

Systematic review and meta-analysis of cohort studies of long term outdoor nitrogen dioxide exposure and mortality

David M Stieb 1,2,*,#, Rania Berjawi 2,#, Monica Emode 3,#, Carine Zheng 2,¤a,, Dina Salama 2,¤b,, Robyn Hocking 4,, Ninon Lyrette 5,¤c,, Carlyn Matz 5,, Eric Lavigne 2,5,, Hwashin H Shin 1,6,
Editor: Gianluigi Forloni7
PMCID: PMC7861378  PMID: 33539450

Abstract

Objective

To determine whether long term exposure to outdoor nitrogen dioxide (NO2) is associated with all-cause or cause-specific mortality.

Methods

MEDLINE, Embase, CENTRAL, Global Health and Toxline databases were searched using terms developed by a librarian. Screening, data extraction and risk of bias assessment were completed independently by two reviewers. Conflicts were resolved through consensus and/or involvement of a third reviewer. Pooling of results across studies was conducted using random effects models, heterogeneity among included studies was assessed using Cochran’s Q and I2 measures, and sources of heterogeneity were evaluated using meta-regression. Sensitivity of pooled estimates to individual studies was examined and publication bias was evaluated using Funnel plots, Begg’s and Egger’s tests, and trim and fill.

Results

Seventy-nine studies based on 47 cohorts, plus one set of pooled analyses of multiple European cohorts, met inclusion criteria. There was a consistently high degree of heterogeneity. After excluding studies with probably high or high risk of bias in the confounding domain (n = 12), pooled hazard ratios (HR) indicated that long term exposure to NO2 was significantly associated with mortality from all/ natural causes (pooled HR 1.047, 95% confidence interval (CI), 1.023–1.072 per 10 ppb), cardiovascular disease (pooled HR 1.058, 95%CI 1.026–1.091), lung cancer (pooled HR 1.083, 95%CI 1.041–1.126), respiratory disease (pooled HR 1.062, 95%CI1.035–1.089), and ischemic heart disease (pooled HR 1.111, 95%CI 1.079–1.144). Pooled estimates based on multi-pollutant models were consistently smaller than those from single pollutant models and mostly non-significant.

Conclusions

For all causes of death other than cerebrovascular disease, the overall quality of the evidence is moderate, and the strength of evidence is limited, while for cerebrovascular disease, overall quality is low and strength of evidence is inadequate. Important uncertainties remain, including potential confounding by co-pollutants or other concomitant exposures, and limited supporting mechanistic evidence. (PROSPERO registration number CRD42018084497)

Introduction

Traditional cohort studies involving recruitment of individual participants and long term follow-up over many years have been foundational in linking long term air pollution exposure to mortality [1, 2]. However, these studies are time-consuming and expensive, and may not be representative of the general population depending on recruitment procedures and response rates. More recently, large “synthetic” cohorts have been established by linking administrative or health survey data with address and mortality data [35]. Compared to traditional cohort studies, these newer cohort studies have the advantages of being less expensive and time-consuming, more statistically powerful and more representative of the general population. However, they potentially lack data on important covariates such as smoking, which could confound the association between air pollution and mortality. Both types of cohort studies have benefited from innovations in exposure assessment, including utilization of remote sensing, chemical/meteorological and dispersion models, as well as land use regression models [68]. These innovations have revolutionized exposure assessment, reducing reliance on sparse networks of ground monitors and increasing both geographic coverage and spatial resolution of estimated exposures.

With increasing exposure assessment capabilities, interest has grown in specific air pollution sources, including traffic. Nitrogen dioxide (NO2) is a commonly employed marker of traffic-related urban air pollution [9, 10], although it also more broadly reflects any combustion in air, from sources such as industry and fossil fuel powered electric power generating stations [11, 12]. Ambient concentrations of NO2 have declined considerably over the last 15–20 years in North America, Europe, Japan and South Korea, but concentrations are increasing in other areas (e.g. China, North Korea and Taiwan) [13]. Numerous studies have evaluated health effects of NO2 on diverse body systems. However, whether long term NO2 exposure is causally related to mortality remains an unresolved question. A particular complicating factor is whether NO2 itself is to blame, or whether it is simply acting as a marker for specific air pollution sources i.e. emissions from vehicles, or more generally as a marker for spatial variation in the urban air pollution mixture [9]. Carbon monoxide and certain chemical components of fine particulate matter, also primarily originating from vehicle emissions, are key potential confounders, given their well-established pathophysiological mechanisms of action [14]. Effects of NO2 could also be confounded by other concomitant traffic-related exposures such as noise or stress [15].

The aforementioned combination of methodological developments has led to rapid growth in the number and geographic diversity of cohort studies, and makes it timely to synthesize the available evidence. Five previous systematic reviews/ meta-analyses have evaluated the association of long term NO2 exposure and mortality [1620]. However, only one of these reviews conducted an assessment of risk of bias over multiple domains, none provided pooled estimates from paired single and multi-pollutant models from the same primary studies, and only studies published up to 2018 were included. Our objective is therefore to determine whether long term exposure to outdoor NO2 is associated with all-cause or cause-specific mortality based on an up to date synthesis of the available evidence.

Methods

The protocol is registered with PROSPERO (CRD42018084497) (S1 File) [21].

Literature searches

MEDLINE, Embase, CENTRAL, Global Health and Toxline databases were searched using terms developed by a librarian (S1 Table). The search strategy underwent Peer Review of Electronic Search Strategies (PRESS) [22]. Searches were last updated February 25, 2020. Inclusion criteria were as follows: Participants/population: Humans; Intervention(s), exposure(s): Exposure to outdoor NO2 (and other oxides of nitrogen); Comparator(s)/control: Lower levels of exposure; Main outcomes: Mortality from all/ natural causes or specific causes; Study design: cohort. Publications in abstract form only were excluded. Publications in English or French were included and there were no restrictions on publication date. Effect measures considered were: mortality effects reported as regression coefficients, hazard ratios (HR) or relative risks associated with exposures over a period of years, expressed per specified increment in exposure. The present review is one part of a series of reviews of effects of NO2, all of which were included in the original search. Other reviews pertain to non-asthma respiratory morbidity and ischemic heart disease morbidity related to short term exposure [21]. Studies were selected for the present review if reported outcomes matched the inclusion criteria specified above.

Screening, data extraction and risk of bias assessment

Screening and data extraction were completed independently by two reviewers in DistillerSR. Conflicts between reviewers were resolved through consensus and/or involvement of a third reviewer. All studies retrieved from literature searches were screened for relevance based on title and abstract according to the above inclusion criteria. Where relevance could not be determined based on abstract and title, the full text was reviewed. Manual searches were also completed of reference lists of all relevant studies. Bibliographic data, study location and timing, population age group(s), sample size, cause of death (including the International Classification of Diseases (ICD) code(s) if available), method of exposure assessment, pollutant (including name, units, descriptive statistics), type of regression model, effect measure and standard error or confidence interval, model covariates (potential confounders) and their specification were extracted from all studies meeting inclusion criteria. When single pollutant results were presented for multiple exposure periods, we extracted the most highly statistically significant result (regardless of the direction of the association), or that reported by the authors as their primary finding. Results from multi-pollutant models that resulted in the greatest reduction in magnitude of effect compared to single pollutant results were selected in order to bracket the magnitude of effect from each study. Our objective in this regard was not to assess the magnitude of the association with NO2 in the presence of a single co-pollutant common to all studies, but rather to determine the maximum potential for confounding of the association of mortality with NO2 by any co-pollutant(s). Results expressed per pollutant increment expressed in μg/m3 were converted to parts per billion [23], and those based on nitrogen oxides (NOx) were converted by multiplying the log(HR) by 2.31 (the average ratio of log(HR) based on NO2 to log(HR) based on NOx in four studies based on 25 cohorts [2427]). Where required data were not provided, authors were contacted by e-mail. In some instances Engauge Digitizer [28] was employed to extract numeric results presented only in graph form. The Navigation Guide systematic review methodology [29] was employed to evaluate risk of bias at the study level according to the following domains: selection bias, exposure assessment, confounding, outcome assessment, completeness of outcome data, selective outcome reporting, conflict of interest (including sources of funding) and other sources of bias. Criteria are detailed in S1 Fig. In the confounding domain, we considered age, sex, smoking and socioeconomic status as critical potential confounders. As a sensitivity analysis, we treated body mass index (BMI) rather than smoking as a critical confounder, as specified in the World Health Organization (WHO) risk of bias criteria [30]. Assessment of risk of bias was completed independently by two reviewers and conflicts between reviewers were resolved through consensus and/or involvement of a third reviewer.

Data analysis

Pooling of HRs across studies was conducted using random effects models computed using Restricted Maximum Likelihood (REML) estimation, with sensitivity analyses employing Dersimonian and Laird and Empirical Bayes estimators [31]. Heterogeneity among included studies was assessed using Cochran’s Q and I2 measures, and sources of heterogeneity were evaluated using meta-regression [31]. Sensitivity of pooled estimates to individual studies was examined using Leave One Out analysis and publication bias was evaluated using Funnel plots, Begg’s and Egger’s tests, and trim and fill [31]. Subgroup analyses were conducted by cause of death, region, risk of bias characterization (pre-specified in protocol) and single vs. multi-pollutant models. Analysis was conducted in R version 3.6.0 [32] using the metafor package [31].

Overall rating of quality and strength of evidence

We applied the Navigation Guide methodology [33] and the causality determination framework used by the US EPA and Health Canada [12] (S2 and S3 Tables) to judge the overall quality and strength of the evidence, and likelihood of a causal relationship. Following the Navigation Guide methodology, given the observational nature of the evidence, the starting point for rating overall quality was “moderate,” which was downgraded or upgraded to “low” or “high” based on the criteria summarized in S2 Table [33]. Identification of multiple upgrading or downgrading factors does not necessarily mean that overall quality is upgraded or downgraded multiple levels. Rather, the overall degree of upgrading or downgrading is based on reviewer judgement of the overall importance and impact of all factors considered [33]. The Navigation Guide characterizes strength of evidence of toxicity as “sufficient”, “limited”, “inadequate” or “indicative of a lack of toxicity” (S2 Table), based on the overall quality of the evidence, the direction of effect, confidence in the effect and any other factors identified as germane by the reviewers [33]. Given the parallels with the USEPA/Health Canada causality determination criteria (S3 Table), while we did not conduct a systematic review of other lines of evidence, we drew upon summaries of other lines of evidence from a recent assessment document [11], supplemented by findings from more recent mechanistic studies, in order to characterize the likelihood of a causal relationship.

Results

A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagram summarizing disposition of studies identified in literature searches is shown in Fig 1. As indicated earlier, the present review is one part of a series of reviews of effects of NO2 on multiple outcomes, all of which were included in the original search, which is reflected in numeric results reported in Fig 1. Seventy-nine studies were included in our final analysis based on 47 cohorts, plus one set of pooled analyses of multiple European cohorts. Study characteristics are summarized in S4 Table. Approximately the same proportion of studies was conducted in North America (n = 32, 41%) and Europe (n = 35, 44%), while a smaller proportion (n = 12, 15%) was conducted elsewhere. Cohorts were mostly drawn from the general population, with the exception of six cohorts based on mortality follow-up after diagnosis of hypertension [3438], myocardial infarction [3941], stroke [42, 43], or lung cancer [26, 44]. Cohort sizes ranged from 1,800 to 14.1 million participants. Fifty-one studies (65%) employed modelling while 28 (35%) employed ground monitoring as the source of exposure data, and almost all, n = 74 (94%), employed NO2 as the exposure metric, while only 5 (6%) employed NOx. The most frequently examined causes of death were all/natural cause (non-accidental), (n = 56, 71%), cardiovascular (n = 37, 47%), respiratory (n = 35, 44%), lung cancer (n = 32, 41%), ischemic heart disease (n = 27, 34%), and cerebrovascular (n = 26, 33%). Thirty-eight studies (48%) were mostly conducted post 2000 (majority of study duration after 2000).

Fig 1. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram.

Fig 1

Risk of bias ratings for individual studies are shown in S2 Fig and reasons for assigned ratings of risk of bias greater than low risk (or unable to assess) for individual studies are provided in S5 Table. The greatest variability in ratings occurred in the exposure assessment and confounding domains, while ratings in the other six domains (selection bias, outcome assessment, completeness of outcome data, selective outcome reporting, conflict of interest, other sources of bias) were generally low or probably low risk of bias. Forty-six studies (58.2%) were rated probably high or high risk of bias or unable to assess in the exposure assessment domain (although bias would be expected to be non-differential) because exposure was based on an area-level average, did not account for change of address, relied on a single monitor, there was evidence of a mediocre correlation of modelled or measured values with ground measurements in the target community, or there was insufficient information. Twelve studies (15.2%) were rated probably high or high risk of bias in the confounding domain because of lack of adjustment for one or more key potential confounders (age, sex, smoking, socio-economic status). An additional eight studies did not adjust for BMI or account for obesity as a potential confounder through other covariates such as comorbidity or analysis of associations with exposure in complementary data.

Effect estimates and pooled effect estimates

All effect estimates from individual studies, including from single and multi-pollutant models, and by population and outcome subgroup are provided in forest plots by region in S3 Fig. Of these, we excluded estimates from pooling if they were superseded by other studies encompassing the same geographic area or time period, e.g. in subsequent multi-city studies or those spanning a longer study duration, results were provided only from multi-pollutant models, or there were too few studies of the outcome, leaving 53 studies included in the meta-analysis (see S4 Table). Pooled estimates based on single pollutant model results by cause of death are summarized in Table 1. Pooled estimates were largest for respiratory and cerebrovascular causes of death, similar for cardiovascular and ischemic heart disease, and smallest for all/natural cause and lung cancer. All pooled estimates were characterized by a high degree of heterogeneity.

Table 1. Pooled estimates by cause of death and sensitivity analyses.

Cause of death N P(Q) I2 (%) Pooled HR per 10 ppb Lower 95% CI Upper 95% CI
All/ Natural causes 39 <0.0001 99.3 1.064 1.034 1.094
Cardiovascular 29 <0.0001 99.9 1.139 0.997 1.301
Respiratory 29 <0.0001 99.7 1.174 1.016 1.357
Lung cancer 28 <0.0001 96.6 1.084 1.045 1.124
Ischemic heart disease 19 <0.0001 96.1 1.128 1.076 1.182
Cerebrovascular 17 <0.0001 99.7 1.167 0.936 1.456
Excluding studies with probably high or high risk of bias in confounding domain
All/ Natural causes 32 <0.0001 96.7 1.047 1.023 1.072
Cardiovascular 23 <0.0001 92.8 1.058 1.026 1.091
Respiratory 24 <0.0001 65.9 1.062 1.035 1.089
Lung cancer 23 <0.0001 85.1 1.083 1.041 1.126
Ischemic heart disease 14 0.0001 69.9 1.111 1.079 1.144
Cerebrovascular 13 0.0738 0.1 1.014 0.997 1.032
Excluding studies with probably high or high risk of bias in confounding domain and exposure based on NOx
All/ Natural causes 29 <0.0001 92.4 1.033 1.016 1.051
Cardiovascular 21 <0.0001 94.3 1.056 1.020 1.093
Respiratory 21 <0.0001 67.6 1.057 1.031 1.085
Lung cancer 21 <0.0001 85.6 1.075 1.033 1.119
Ischemic heart disease 12 0.0003 56.7 1.104 1.078 1.131
Cerebrovascular 11 0.0488 0.5 1.013 0.996 1.032
Excluding studies with probably high or high risk of bias in confounding domain (WHO criteria–BMI rather than smoking as critical potential confounder)
All/ Natural causes 31 <0.0001 98.4 1.063 1.027 1.100
Cardiovascular 19 <0.0001 98.1 1.097 1.025 1.173
Respiratory 18 0.0129 0.1 1.041 1.028 1.054
Lung cancer 17 <0.0001 89.7 1.082 1.0279 1.134
Ischemic heart disease 14 <0.0001 91.4 1.149 1.093 1.208
Cerebrovascular 13 <0.0001 96.3 1.080 0.973 1.200

Meta-regression and sensitivity analysis

Meta-regression revealed that the magnitude of the log HR for cardiovascular, respiratory and ischemic heart disease mortality was significantly larger for studies conducted outside North America and Europe (p = 0.002, 0.025, 0.021 respectively). For lung cancer mortality, standard deviation (p = 0.0009) and range (p = 0.006) of NO2 exposure were significantly positively associated with log HR. Probably high or high risk of bias in the confounding domain was significantly positively associated with log HR for all/ natural cause (p = 0.040), respiratory (p = 0.006) and cerebrovascular (p = 0.036) mortality. In a sensitivity analysis, treating BMI rather than smoking as a critical potential confounder, as specified in the WHO risk of bias criteria, probably high or high risk of bias in the confounding domain was not associated with log HR. Risk of bias in the exposure assessment domain, study interquartile range NO2 and timing of study primarily before or after 2000 were not significant predictors of the log HR. Residual heterogeneity remained high (I2 >80%) even after accounting for significant predictor variables.

Based on meta-regression findings, studies with probably high or high risk of bias in the confounding domain (n = 12) were excluded, resulting in substantially smaller pooled HRs for cardiovascular, respiratory and cerebrovascular mortality (Table 1). Pooled estimates were significantly smaller for cerebrovascular mortality (p = 0.031) and significantly larger for ischemic heart disease mortality (p = 0.002), than for all/ natural cause mortality. Fig 2 presents a forest plot of HRs from individual studies and pooled estimates for all/ natural cause mortality, after exclusion of studies with probably high or high risk of bias in the confounding domain. The pooled estimate for North America was smaller than those for Europe and other countries, and heterogeneity among primary studies was lower for North American studies. Forest plots for other causes of death are provided in S4 Fig. Applying the WHO risk of bias criteria (treating BMI rather than smoking as a critical potential confounder) resulted in a somewhat larger pooled estimate for all/natural cause mortality, considerably larger pooled estimates for cardiovascular and cerebrovascular mortality, together with much greater heterogeneity for the latter, and a somewhat smaller pooled estimate with narrower confidence intervals and considerably less heterogeneity for respiratory mortality (Table 1).

Fig 2. Hazard ratios from single pollutant models from individual cohort studies and pooled estimates by region, for all/ natural cause mortality (AC/NC).

Fig 2

Results were generally insensitive to the exclusion of studies employing NOx as the exposure metric [4547], with the exception of all/natural cause mortality, for which the pooled estimate was somewhat smaller (Table 1). Findings were also insensitive to excluding cohorts of individuals with pre-existing disease [36, 39, 41, 42] (pooled estimate of HR for all/natural cause mortality 1.050, 95% CI 1.022–1.078). Pooled estimates were not sensitive to employing alternative estimators except that confidence intervals tended to be slightly narrower based on Dersimonian and Laird, and slightly wider based on Empirical Bayes (S1 Text). In leave one out analyses, heterogeneity among respiratory and ischemic heart disease studies was sensitive to exclusion of results from Katanoda et al. [48] and Turner et al. [49] respectively (S6 Table). Egger’s test revealed significant funnel plot asymmetry for all/ natural cause (p = 0.0022) and lung cancer (p = 0.031) mortality, while Begg’s test indicated significant funnel plot asymmetry only for lung cancer mortality (p = 0.022). Trim and fill analysis estimated that there were 4 missing studies with log HR below the pooled estimate for lung cancer mortality (S5 Fig), reducing the pooled estimate slightly to 1.066 (95%CI 1.024–1.110).

Effects of co-pollutants, noise and green space

A forest plot of nine paired estimates of associations with all/ natural cause mortality from single and multi-pollutant models from the same study, after exclusion of studies with probably high or high risk of bias in the confounding domain, is shown in Fig 3. The pooled estimate from single pollutant models was higher than that from multi-pollutant models with 1–4 co-pollutants, and the confidence interval for the multi-pollutant pooled estimate included 1, indicating no association. However, the difference between pooled estimates for single and multi-pollutant models was not significant (p = 0.13). Fewer paired estimates from single and multi-pollutant models were available for other causes of death. Pooled estimates from multi-pollutant models were consistently smaller in magnitude than those from single pollutant models, and the pooled estimates based on multi-pollutant models included 1, indicating no association, with the exception of ischemic heart disease mortality which was based on only three studies (Table 2).

Fig 3. Hazard ratios from individual cohort studies and pooled estimates from single and multi-pollutant models for all/ natural cause mortality (AC/NC).

Fig 3

Table 2. Pooled estimates from single and multi-pollutant models by cause of death.

Cause of death Model n Pooled HR (95% CI) p (difference)
All/natural cause Single 9 1.036 (1.011–1.061) 0.13
Multi 9 1.006 (0.976–1.036)
Cardiovascular Single 4 1.053 (1.011–1.096) 0.26
Multi 4 1.018 (0.975–1.063)
Lung cancer Single 5 1.057 (0.967–1.156) 0.65
Multi 5 1.028 (0.948–1.115)
Respiratory Single 5 1.039 (1.024–1.054) 0.21
Multi 5 1.013 (0.977–1.051)
Cerebrovascular Single 2 1.000 (0.976–1.025) 0.67
Multi 2 0.977 (0.879–1.086)
Ischemic heart disease Single 3 1.106 (1.064–1.150) 0.21
Multi 3 1.071 (1.038–1.105)

Few studies have jointly examined effects of NO2 and noise. Sørensen et al. found that NO2 exhibited a significant positive association with fatal stroke when modelled jointly with traffic noise [50], while in the same cohort, Hvidtfeldt et al. found that NO2 remained significantly associated with natural cause mortality after adjustment for traffic noise, although the magnitude of the association was reduced, and NO2 was no longer significantly associated with cardiovascular mortality after adjustment for traffic noise [51]. Héritier et al. [52] also reported that the association of NO2 with myocardial infarction mortality was no longer significant after adjustment for traffic, rail and aircraft noise. Klompmaker et al. found no association between NO2, PM2.5, greenness or traffic noise and mortality [53], and Tonne et al. observed a negligible change in the association between NO2 and mortality with additional adjustment for traffic noise [40]. Nieuwenhuijsen et al. [54] found that the association of NO2 with mortality was reduced in magnitude in models with noise and/or green space.

Shape of exposure-response relationship

Twenty-nine studies evaluated the shape of the exposure-response relationship between NO2 or NOx and mortality by examining the association by pollutant quantile [24, 41, 44, 47, 5557], plotting the association using a non-linear function of pollutant concentration and/or testing the significance of the difference between linear and non-linear models [5, 25, 27, 45, 46, 50, 51, 53, 5769], or plotting associations by city [48]. Of these, 19 studies found a linear association [27, 41, 44, 50, 51, 53, 5557, 60, 6365, 6769], in some instances only in subsets of the data by cause of death [5, 45, 46], and five studies concluded that the association was supralinear [25, 45, 47, 59, 66]. Three found evidence of a threshold [48, 61, 62], but only one study identified specific numeric values, ranging from 20–40 μg/m3, depending on age and cause of death [62]. Two studies reported no association, based on analysis by quantiles [24], and using a non-linear function of NO2 [58]. While there was some variation in findings by cause of death in individual studies, overall there was evidence of an exposure-response relationship across all six causes of death.

Discussion

Based on an analysis of 53 cohort studies, pooled estimates of associations indicated that long term exposure to outdoor NO2 was significantly associated with mortality from all/ natural causes, cardiovascular disease, lung cancer, respiratory disease, and ischemic heart disease. There was a consistently high degree of heterogeneity among results from primary studies, which was only partially accounted for in meta-regression. The magnitude of the observed association was larger in studies with probably high or high risk of bias in the confounding domain, and pooled estimates were substantially smaller for cardiovascular, respiratory and cerebrovascular mortality when these studies were excluded. Heterogeneity based on I2 was reduced substantially for cerebrovascular and respiratory mortality after excluding these studies, which we believe is related to the combination of a smaller number of studies and exclusion of studies reporting associations of a magnitude that differed substantially from the remaining studies. We also found that pooled estimates were sensitive to which covariates were considered critical potential confounders; pooled estimates for cardiovascular and cerebrovascular mortality were considerably larger when BMI rather than smoking was treated as a critical potential confounder, as specified in the WHO risk of bias criteria. We did not find an association between log HR and risk of bias in the exposure assessment domain, although one would expect that greater exposure measurement error (likely non-differential) would tend to bias associations towards the null, depending on the type of error [7073]. Indeed, Crouse et al. reported that the magnitude of the association was larger when change of residential address was accounted for [59]. There was evidence of publication bias based on tests of funnel plot asymmetry for all/ natural cause and lung cancer mortality, but application of trim and fill revealed only small reductions in pooled estimates of association. The pooled estimate for all/natural cause mortality based on single pollutant models was larger than that based on multi-pollutant models, and confidence intervals on the multi-pollutant pooled estimate overlapped 1 or no association. Of the approximately one-third of studies that examined the shape of the exposure response relationship, most concluded that it was linear.

There have been five previous systematic reviews/meta-analyses of the association between long term NO2 exposure and mortality in cohort studies. Pooled estimates from these studies are summarized in Table 3 in comparison with the present study, by cause of death. With the exception of the recent paper by Huangfu and Atkinson [20], for all four categories of cause of death, pooled estimates from the present study were based on approximately twice as many primary studies as the most recent previous systematic review. Pooled estimates varied most for cardiovascular and respiratory mortality, while they were relatively consistent in magnitude for all/natural cause and lung cancer mortality. Our pooled estimate was the largest for respiratory mortality based on all studies, but consistent with lower pooled estimates from other studies after excluding those with probably high or high risk of bias in the confounding domain. Heterogeneity among results from primary studies was uniformly high in earlier meta-analyses, with the exception of one pooled estimate for respiratory mortality based on only 8 primary studies. Only Huangfu and Atkinson [20], conducted an assessment of risk of bias over multiple domains, but neither they nor the other systematic reviews provided pooled estimates from paired single and multi-pollutant models from the same primary studies. In subgroup analyses, Atkinson et al. found that pooled estimates of associations with all/ natural cause, cardiovascular and lung cancer mortality based on cohorts restricted to older age groups were larger than those based on all ages [19]. Additionally, those based on models adjusting for key confounders (BMI, smoking) were smaller than those without these adjustments (natural cause, cardiovascular, respiratory and lung cancer mortality), similar to our findings; and those for natural cause and cardiovascular mortality based on residential exposure estimates were larger than those based on area level exposures [19]. In Faustini et al’s systematic review, the effects of excluding studies based on individuals with pre-existing disease, older age groups, or with area level exposure characterization were inconsistent [17]. Hamra et al. found little impact of method of exposure characterization or presence or absence of adjustment for selected confounders (with the exception of studies including adjustment for occupation, which generated a smaller pooled estimate) [18]. Huangfu and Atkinson also found little impact of adjustment for selected confounders [20]. They concluded that the certainty of evidence was moderate for all-cause, respiratory and acute lower respiratory infection mortality, and high for chronic obstructive pulmonary disease mortality [20].

Table 3. Comparison of pooled estimates from current study and previous meta-analyses.

Cause of death Author Centralb Lower 95%CI Upper 95%CI n I2 (%)
All/Natural cause Stieb 2020 1.064 1.034 1.094 39 99
Stieb 2020a 1.047 1.023 1.072 32 97
Huangfu 2020 1.038 1.010 1.067 24 97
Atkinson 2018 1.038 1.019 1.057 20 84
Faustini 2014 1.079 1.036 1.124 12 89
Hoek 2013 1.106 1.059 1.156 12 73
Cardiovascular Stieb 2020 1.139 0.997 1.301 29 100
Stieb 2020a 1.058 1.026 1.091 23 93
Faustini 2014 1.265 1.172 1.365 16 98
Atkinson 2018 1.057 1.038 1.096 15 83
Respiratory Stieb 2020 1.174 1.016 1.357 29 100
Stieb 2020a 1.062 1.035 1.089 24 66
Huangfu 2020 1.057 1.019 1.097 15 83
Atkinson 2018 1.057 1.019 1.096 13 76
Faustini 2014 1.046 1.032 1.061 8 0
Lung cancer Stieb 2020 1.084 1.045 1.124 28 97
Stieb 2020a 1.083 1.041 1.126 23 85
Atkinson 2018 1.096 1.038 1.156 16 88
Hamra 2015 1.077 1.019 1.156 15 73

aAfter exclusion of studies with probably high or high risk of bias in confounding domain.

bPer 10 ppb.

Other lines of evidence

The 2016 US Environmental Protection Agency (EPA) Integrated Science Assessment on oxides of nitrogen concluded that toxicological evidence suggested there were several possible mechanisms through which long term exposure to NO2 could contribute to adverse respiratory and cardiovascular effects, including pulmonary inflammation, oxidative stress, pulmonary injury, changes in lung morphology, impaired respiratory immune defences, atherosclerosis, autonomic dysfunction, and changes in lipid metabolism [11]. Examples of findings from relevant studies include the modulation of alveolar macrophage activity in rats in association with NO2 exposure [74], and increased mortality from respiratory infection in mice in two older studies of NO2 exposure [75, 76]. With respect to cardiovascular effects, in one study, long term exposure to NO2 was associated with reduced heart rate variability, but only in women [77]. In a Spanish cross sectional study, long term NO2 exposure was associated with increased blood pressure [78] and subclinical atherosclerosis [79]. A more recent study in Germany found that those with higher long term NO2 exposure had significantly higher odds of elevated ankle-brachial index, reflective of arterial stiffening, although the magnitude of the association was reduced in a joint model with PM2.5 absorbance (a proxy for elemental carbon) [80]. Overall, however, the evidence base was considered limited, associations were inconsistent, and it was difficult to separate effects of NO2 from those of co-pollutants [11]. With respect to short term exposure to NO2 and mortality, a recent systematic review concluded that there was a high degree of certainty of the evidence linking 24 hour average exposure and mortality [81]. While there may be a degree of overlap in the effects captured by studies of short term and long term exposure, the overall health impact captured by each type of design is not identical [82], and certainty of evidence regarding effects of short term exposure does not necessarily imply certainty regarding effects of long term exposure.

Overall rating of quality and strength of evidence

In their 2016 Science Assessments, both the US EPA and Health Canada concluded that the evidence was suggestive of, but not sufficient to infer, a causal relationship between long term NO2 exposure and mortality, based on a smaller number of studies, and fewer studies examining the impact of adjustment for co-pollutants than considered here, as well as limited and inconsistent supporting mechanistic evidence from human and animal studies [11, 12]. Applying the Navigation Guide methodology [33] and the causality determination framework used by the US EPA and Health Canada [12] to our current findings, several factors are considered downgrading factors in interpreting the overall quality of evidence. These include the significant heterogeneity among studies even after accounting for sources of heterogeneity, and the relatively large proportion of studies rated as probably high or high risk of exposure assessment bias (57.1%) (even though presence of this bias was not associated with magnitude of association in meta-regression). There was also evidence of publication bias, particularly for lung cancer mortality, but it did not have a substantial impact on pooled estimates of association. Risk of bias from residual confounding was evaluated both in relation to inclusion of critical potential confounders in statistical models, as well as impacts of co-pollutants and other co-exposures on the magnitude of associations. Pooled estimates indicated that NO2 remained significantly associated with all/natural cause, cardiovascular, lung cancer, respiratory and ischemic heart disease mortality after exclusion of 12 studies with probably high or high risk of bias in the confounding domain. However, after excluding these studies, only 9 studies of all/natural cause mortality provided estimates based on both single and multi-pollutant models, and the pooled estimate indicated that NO2 was no longer significantly associated with mortality after adjusting for co-pollutants. Fewer paired estimates from single and multi-pollutant models were available for other causes of death. Pooled estimates from multi-pollutant models were consistently smaller in magnitude than those from single pollutant models, and the pooled estimates based on multi-pollutant models included 1, indicating no association, with the exception of ischemic heart disease mortality, which was based on only three studies. Multi-pollutant models should be interpreted with caution in that the sensitivity of the effect of one pollutant to inclusion of other pollutants in a joint model is affected by factors such as the correlation among pollutants and their relative degree of exposure measurement error [83]. There is nonetheless evidence of confounding by co-pollutants of the association of long term NO2 exposure with mortality. Few studies jointly modelled NO2 with traffic noise. In a recent review, Tétrault et al. concluded that cardiovascular effects of long term air pollution exposure were probably independent of noise, but this was based on only nine studies, including only one study of air pollution and mortality [15]. One study found that that the association of NO2 with mortality was reduced in magnitude in models with both noise and/or green space [54]. Specifically with respect to cerebrovascular mortality, imprecision is also considered a downgrading factor, as the 95% CI on the pooled estimate overlapped the null. In contrast to these downgrading factors, characterization of the exposure-response relationship as linear, supralinear, or linear with a threshold in 27 of the 29 studies in which this was evaluated, is considered an upgrading factor applicable to all six causes of death. Huangfu and Atkinson also downgraded the evidence in relation to heterogeneity for all cause and respiratory mortality, and upgraded it in relation to evidence of an exposure-response relationship [20]. Based on these considerations, we conclude that for all causes of death other than cerebrovascular disease, the overall quality of the evidence from cohort studies is moderate, the strength of evidence of toxicity is limited, and the overall evidence continues to be suggestive of, but not sufficient to infer, a causal relationship between long term NO2 exposure and mortality. In the case of cerebrovascular disease mortality, owing to the smaller number of primary studies and the non-significant smaller magnitude association based on the pooled estimate, we conclude that the overall quality of the evidence from cohort studies is low, the strength of evidence is inadequate, and the overall evidence is inadequate to infer a causal relationship. Upgrading to a conclusion that there is sufficient evidence for a causal relationship would require more conclusive evidence ruling out potential confounders as well as consistent supporting animal toxicological and human clinical evidence. Future studies could address uncertainties related to confounding by co-pollutants by more consistently examining their correlations and effects in multi-pollutant models, in particular adjusting for other traffic-related pollutants and concomitant exposures like noise, green space and stress. Only about one third of the studies we reviewed addressed the shape of the concentration-response relationship, therefore examination of this issue in future studies would also be informative. While the evidence reviewed does not support the unequivocal conclusion that long term exposure to outdoor NO2 causes an increased risk of death, identifying the true causal agent is of major importance to public health. Vehicle emissions are one of the main sources of NO2, but vehicle emissions, and secondary pollutants arising from vehicle emissions also include numerous other potentially toxic pollutants such as carbon monoxide, particulate matter, benzene, formaldehyde, acetaldehyde, 1,3-butadiene, ozone, nitrates and organic and inorganic acids [10]. If the true causal agent is not NO2, control measures which specifically reduce NO2 will not reduce mortality risks. Conversely, identification and control of the true causal agent will have considerable public health benefits.

Conclusions

We conducted a synthesis of the evidence from 79 cohort studies examining the association between long term NO2 exposure and natural cause and cause-specific mortality, including sensitivity analyses based on pooling method, leave one out analysis and trim and fill, meta-regression to examine sources of heterogeneity, and analysis of single vs. multi-pollutant models. We concluded that for all causes of death other than cerebrovascular disease, the overall quality of the evidence is moderate and the strength of evidence of toxicity was categorized as limited, while for cerebrovascular disease the overall quality of the evidence is low, and strength of evidence was rated inadequate. Important uncertainties remain, including potential confounding by co-pollutants or other concomitant exposures, and limited supporting mechanistic evidence. Identification and control of the true causal agent linking long term NO2 exposure and mortality, whether NO2 itself or another correlated exposure, will have considerable public health benefits.

Supporting information

S1 Fig. Risk of bias criteria.

(PDF)

S2 Fig. Risk of bias ratings for individual studies.

(PDF)

S3 Fig. Forest plots by region.

(PDF)

S4 Fig. Hazard ratios from single pollutant models from individual cohort studies and pooled estimates by region (specific causes of death).

(PDF)

S5 Fig. Funnel plot of log(hazard ratio) vs. standard error, lung cancer mortality.

(PDF)

S1 File. Review protocol.

(PDF)

S2 File. Data.

(CSV)

S3 File. PRISMA 2009 checklist.

(PDF)

S1 Table. Details of search strategies.

(PDF)

S2 Table. Navigation guide criteria for overall quality and strength of evidence.

(PDF)

S3 Table. USEPA/Health Canada criteria for evaluating likelihood of causal relationship.

(PDF)

S4 Table. Characteristics of primary studies.

(PDF)

S5 Table. Reasons for assigned ratings of risk of bias greater than low risk (or unable to assess).

(PDF)

S6 Table. Leave one out analyses.

(PDF)

S1 Text. Sensitivity to estimator.

(PDF)

Acknowledgments

We thank Lisa Glandon, MIS (Health Library, Health Canada) for peer review of the MEDLINE search strategy as well as Tania Onica and Barry Jessiman (Health Canada) for helpful comments. We also thank Drs. Wenqi Gan, Hsien-Ho Lin and Fred Lipfert for their responses to requests for additional information on their studies.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The study was funded by Health Canada under operating funding. There is no grant number associated with the funding. Authors DMS, RH, NL,CM, EL and HHS receive a salary from the funder. Authors RB, ME, CZ and DS were employed as students by the funder. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Dockery DW, Pope CA 3rd, Xu X, Spengler JD, Ware JH, Fay ME, et al. An association between air pollution and mortality in six U.S. cities. N Engl J Med. 1993;329: 1753–1759. 10.1056/NEJM199312093292401 [DOI] [PubMed] [Google Scholar]
  • 2.Pope CA 3rd, Thun MJ, Namboodiri MM, Dockery DW, Evans JS, Speizer FE, et al. Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med. 1995;151: 669–674. 10.1164/ajrccm/151.3_Pt_1.669 [DOI] [PubMed] [Google Scholar]
  • 3.Crouse DL, Peters PA, van Donkelaar A, Goldberg MS, Villeneuve PJ, Brion O, et al. Risk of nonaccidental and cardiovascular mortality in relation to long-term exposure to low concentrations of fine particulate matter: A Canadian national-level cohort study. Environ Health Perspect. 2012;120: 708–714. 10.1289/ehp.1104049 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Eum K-D, Kazemiparkouhi F, Wang B, Manjourides J, Pun V, Pavlu V, et al. Long-term NO2 exposures and cause-specific mortality in American older adults. Environ Int. 2019;124: 10–15. 10.1016/j.envint.2018.12.060 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Fischer PH, Marra M, Ameling CB, Hoek G, Beelen R, de Hoogh K, et al. Air Pollution and Mortality in Seven Million Adults: The Dutch Environmental Longitudinal Study (DUELS). Environ Health Perspect. 2015;123: 697–704. 10.1289/ehp.1408254 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Van Donkelaar A, Martin RV, Spurr RJD, Burnett RT. High-Resolution Satellite-Derived PM2.5 from Optimal Estimation and Geographically Weighted Regression over North America. Environ Sci Technol. 2015;49: 10482–10491. 10.1021/acs.est.5b02076 [DOI] [PubMed] [Google Scholar]
  • 7.Hystad P, Setton E, Cervantes A, Poplawski K, Deschenes S, Brauer M, et al. Creating national air pollution models for population exposure assessment in Canada. Environ Health Perspect. 2011;119: 1123–1129. 10.1289/ehp.1002976 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Robichaud A, Ménard R, Zaïtseva Y, Anselmo D. Multi-pollutant surface objective analyses and mapping of air quality health index over North America. Air Qual Atmosphere Health. 2016;9: 743–759. 10.1007/s11869-015-0385-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Levy I, Mihele C, Lu G, Narayan J, Brook JR. Evaluating Multipollutant Exposure and Urban Air Quality: Pollutant Interrelationships, Neighborhood Variability, and Nitrogen Dioxide as a Proxy Pollutant. Environ Health Perspect. 2014;122: 65–72. 10.1289/ehp.1306518 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.HEI Panel on the Health Effects, of Traffic-Related Air Pollution. Traffic-Related Air Pollution: A Critical Review of the Literature on Emissions, Exposure, and Health Effects. Boston, Massachusetts: Health Effects Institute; 2010. [Google Scholar]
  • 11.USEPA. Integrated Science Assessment for Oxides of Nitrogen—Health Criteria. Research Triangle Park, North Carolina: US EPA; 2016. Report No.: EPA/600/R-15/068. [Google Scholar]
  • 12.Health Canada. Human Health Risk Assessment for Ambient Nitrogen Dioxide. Ottawa, Canada: Health Canada; 2016. [Google Scholar]
  • 13.Geddes JA, Martin RV, Boys BL, van Donkelaar A. Long-Term Trends Worldwide in Ambient NO 2 Concentrations Inferred from Satellite Observations. Environ Health Perspect. 2016;124: 281–289. 10.1289/ehp.1409567 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Brook RD, Rajagopalan S, Pope CA, Brook JR, Bhatnagar A, Diez-Roux AV, et al. Particulate Matter Air Pollution and Cardiovascular Disease: An Update to the Scientific Statement From the American Heart Association. Circulation. 2010;121: 2331–2378. 10.1161/CIR.0b013e3181dbece1 [DOI] [PubMed] [Google Scholar]
  • 15.Tétreault L-F, Perron S, Smargiassi A. Cardiovascular health, traffic-related air pollution and noise: are associations mutually confounded? A systematic review. Int J Public Health. 2013;58: 649–666. 10.1007/s00038-013-0489-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Hoek G, Krishnan RM, Beelen R, Peters A, Ostro B, Brunekreef B, et al. Long-term air pollution exposure and cardio- respiratory mortality: a review. Environ Health. 2013;12: 43 10.1186/1476-069X-12-43 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Faustini A, Rapp R, Forastiere F. Nitrogen dioxide and mortality: review and meta-analysis of long-term studies. Eur Respir J. 2014;44: 744–753. 10.1183/09031936.00114713 [DOI] [PubMed] [Google Scholar]
  • 18.Hamra GB, Laden F, Cohen AJ, Raaschou-Nielsen O, Brauer M, Loomis D. Lung Cancer and Exposure to Nitrogen Dioxide and Traffic: A Systematic Review and Meta-Analysis. Environ Health Perspect. 2015;123: 1107–1112. 10.1289/ehp.1408882 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Atkinson R, Butland B, Anderson H, Maynard R. Long-term Concentrations of Nitrogen Dioxide and Mortality: A Meta-analysis of Cohort Studies. Epidemiology. 2018;29: 460–472. 10.1097/EDE.0000000000000847 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Huangfu P, Atkinson R. Long-term exposure to NO2 and O3 and all-cause and respiratory mortality: A systematic review and meta-analysis. Environ Int. 2020;144: 105998 10.1016/j.envint.2020.105998 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Stieb D, Lyrette N, Lavigne E, Hocking R, Zheng C, Salama D, et al. Systematic review and meta-analysis of effects of outdoor nitrogen dioxide: short term exposure and cardio-respiratory morbidity and long term exposure and mortality. In: PROSPERO International prospective register of systematic reviews [Internet]. 19 Feb 2018 [cited 16 Aug 2019]. Available: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=84497
  • 22.McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J Clin Epidemiol. 2016;75: 40–46. 10.1016/j.jclinepi.2016.01.021 [DOI] [PubMed] [Google Scholar]
  • 23.Canada Health. Investigating human exposure to contaminants in the environment: a handbook for exposure calculations. Ottawa: Health Canada; 1995. Available: http://publications.gc.ca/Collection/H49-96-1-1995E-1.pdf [Google Scholar]
  • 24.Dehbi H-M, Blangiardo M, Gulliver J, Fecht D, de Hoogh K, Al-Kanaani Z, et al. Air pollution and cardiovascular mortality with over 25 years follow-up: A combined analysis of two British cohorts. Environ Int. 2017;99: 275–281. 10.1016/j.envint.2016.12.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Dirgawati M, Hinwood A, Nedkoff L, Hankey GJ, Yeap BB, Flicker L, et al. Long-term Exposure to Low Air Pollutant Concentrations and the Relationship with All-Cause Mortality and Stroke in Older Men: Epidemiology. 2019;30: S82–S89. 10.1097/EDE.0000000000001034 [DOI] [PubMed] [Google Scholar]
  • 26.Sifaki-Pistolla D, Lionis C, Koinis F, Georgoulias V, Tzanakis N. Lung cancer and annual mean exposure to outdoor air pollution in Crete, Greece: Eur J Cancer Prev. 2017;26: S208–S214. 10.1097/CEJ.0000000000000407 [DOI] [PubMed] [Google Scholar]
  • 27.Beelen R, Raaschou-Nielsen O, Stafoggia M, Andersen ZJ, Weinmayr G, Hoffmann B, et al. Effects of long-term exposure to air pollution on natural-cause mortality: an analysis of 22 European cohorts within the multicentre ESCAPE project. The Lancet. 2014;383: 785–795. 10.1016/S0140-6736(13)62158-3 [DOI] [PubMed] [Google Scholar]
  • 28.Mitchell M, Muftakhidinov B, Winchen T. Engauge Digitizer Software. Available: http://markummitchell.github.io/engauge-digitizer
  • 29.Lam J, Sutton P, Kalkbrenner A, Windham G, Halladay A, Koustas E, et al. A Systematic Review and Meta-Analysis of Multiple Airborne Pollutants and Autism Spectrum Disorder. PLOS ONE. 2016;11: e0161851 10.1371/journal.pone.0161851 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.WHO Global Air Quality Guidelines Working Group on Risk of Bias Assessment. Risk of Bias Assessment Instrument for Systematic Reviews Informing WHO Global Air Quality Guidelines. WHO Regional Office for Europe; 2020. [Google Scholar]
  • 31.Viechtbauer W. Conducting Meta-Analyses in R with the metafor Package. J Stat Softw. 2010;36: 1–48. 10.18637/jss.v036.i03 [DOI] [Google Scholar]
  • 32.R Core Team. R: A language and environment for statistical computing In: R Foundation for Statistical Computing; [Internet]. 2019. [cited 28 Oct 2019]. Available: https://www.R-project.org/. [Google Scholar]
  • 33.Lam J, Sutton P, McPartland J, Davidson L, Daniels N, Sen S, et al. Applying the Navigation Guide Systematic Review Methodology Case Study #5 Association between Developmental Exposures to PBDEs and Human Neurodevelopment: A Systematic Review of the Evidence Protocol April 2015. [cited 18 Aug 2019]. Available: http://www.crd.york.ac.uk/PROSPEROFILES/17890_PROTOCOL_20150322.pdf [Google Scholar]
  • 34.Lipfert FW, Baty JD, Miller JP, Wyzga RE. PM 2.5 Constituents and Related Air Quality Variables As Predictors of Survival in a Cohort of U.S. Military Veterans. Inhal Toxicol. 2006;18: 645–657. 10.1080/08958370600742946 [DOI] [PubMed] [Google Scholar]
  • 35.Lipfert FW, Wyzga RE, Baty JD, Miller JP. Traffic density as a surrogate measure of environmental exposures in studies of air pollution health effects: Long-term mortality in a cohort of US veterans. Atmos Environ. 2006;40: 154–169. 10.1016/j.atmosenv.2005.09.027 [DOI] [Google Scholar]
  • 36.Lipfert FW, Wyzga RE. Environmental predictors of survival in a cohort of U.S. military veterans: A multi-level spatio-temporal analysis stratified by race. Environ Res. 2019; 108842 10.1016/j.envres.2019.108842 [DOI] [PubMed] [Google Scholar]
  • 37.Lipfert FW, Wyzga RE, Baty JD, Miller JP. Air Pollution and Survival within the Washington University–EPRI Veterans Cohort: Risks Based on Modeled Estimates of Ambient Levels of Hazardous and Criteria Air Pollutants. J Air Waste Manag Assoc. 2009;59: 473–489. 10.3155/1047-3289.59.4.473 [DOI] [PubMed] [Google Scholar]
  • 38.Lipfert FW, Wyzga RE. Revisiting the Veterans Cohort Mortality Study: New results and synthesis. J Air Waste Manag Assoc. 2018;68: 1248–1268. 10.1080/10962247.2018.1498409 [DOI] [PubMed] [Google Scholar]
  • 39.Tonne C, Wilkinson P. Long-term exposure to air pollution is associated with survival following acute coronary syndrome. Eur Heart J. 2013;34: 1306–1311. 10.1093/eurheartj/ehs480 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Tonne C, Halonen JI, Beevers SD, Dajnak D, Gulliver J, Kelly FJ, et al. Long-term traffic air and noise pollution in relation to mortality and hospital readmission among myocardial infarction survivors. Int J Hyg Environ Health. 2016;219: 72–78. 10.1016/j.ijheh.2015.09.003 [DOI] [PubMed] [Google Scholar]
  • 41.Rosenlund M, Picciotto S, Forastiere F, Stafoggia M, Perucci CA. Traffic-Related Air Pollution in Relation to Incidence and Prognosis of Coronary Heart Disease. Epidemiology. 2008;19: 121–128. 10.1097/EDE.0b013e31815c1921 [DOI] [PubMed] [Google Scholar]
  • 42.Maheswaran R, Pearson T, Smeeton NC, Beevers SD, Campbell MJ, Wolfe CD. Impact of Outdoor Air Pollution on Survival After Stroke: Population-Based Cohort Study. Stroke. 2010;41: 869–877. 10.1161/STROKEAHA.109.567743 [DOI] [PubMed] [Google Scholar]
  • 43.Desikan A, Crichton S, Hoang U, Barratt B, Beevers SD, Kelly FJ, et al. Effect of Exhaust- and Nonexhaust-Related Components of Particulate Matter on Long-Term Survival After Stroke. Stroke. 2016;47: 2916–2922. 10.1161/STROKEAHA.116.014242 [DOI] [PubMed] [Google Scholar]
  • 44.Eckel SP, Cockburn M, Shu Y-H, Deng H, Lurmann FW, Liu L, et al. Air pollution affects lung cancer survival. Thorax. 2016;71: 891–898. 10.1136/thoraxjnl-2015-207927 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Stockfelt L, Andersson EM, Molnár P, Rosengren A, Wilhelmsen L, Sallsten G, et al. Long term effects of residential NOx exposure on total and cause-specific mortality and incidence of myocardial infarction in a Swedish cohort. Environ Res. 2015;142: 197–206. 10.1016/j.envres.2015.06.045 [DOI] [PubMed] [Google Scholar]
  • 46.Nafstad P, Håheim LL, Wisløff T, Gram F, Oftedal B, Holme I, et al. Urban air pollution and mortality in a cohort of Norwegian men. Environ Health Perspect. 2004;112: 610–615. 10.1289/ehp.6684 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Cao J, Yang C, Li J, Chen R, Chen B, Gu D, et al. Association between long-term exposure to outdoor air pollution and mortality in China: A cohort study. J Hazard Mater. 2011;186: 1594–1600. 10.1016/j.jhazmat.2010.12.036 [DOI] [PubMed] [Google Scholar]
  • 48.Katanoda K, Sobue T, Satoh H, Tajima K, Suzuki T, Nakatsuka H, et al. An Association Between Long-Term Exposure to Ambient Air Pollution and Mortality From Lung Cancer and Respiratory Diseases in Japan. J Epidemiol. 2011;21: 132–143. 10.2188/jea.je20100098 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Turner MC, Jerrett M, Pope CA, Krewski D, Gapstur SM, Diver WR, et al. Long-Term Ozone Exposure and Mortality in a Large Prospective Study. Am J Respir Crit Care Med. 2016;193: 1134–1142. 10.1164/rccm.201508-1633OC [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Sørensen M, Lühdorf P, Ketzel M, Andersen ZJ, Tjønneland A, Overvad K, et al. Combined effects of road traffic noise and ambient air pollution in relation to risk for stroke? Environ Res. 2014;133: 49–55. 10.1016/j.envres.2014.05.011 [DOI] [PubMed] [Google Scholar]
  • 51.Hvidtfeldt UA, Sørensen M, Geels C, Ketzel M, Khan J, Tjønneland A, et al. Long-term residential exposure to PM2.5, PM10, black carbon, NO2, and ozone and mortality in a Danish cohort. Environ Int. 2019;123: 265–272. 10.1016/j.envint.2018.12.010 [DOI] [PubMed] [Google Scholar]
  • 52.Héritier H, Vienneau D, Foraster M, Eze IC, Schaffner E, de Hoogh K, et al. A systematic analysis of mutual effects of transportation noise and air pollution exposure on myocardial infarction mortality: a nationwide cohort study in Switzerland. Eur Heart J. 2019;40: 598–603. 10.1093/eurheartj/ehy650 [DOI] [PubMed] [Google Scholar]
  • 53.Klompmaker JO, Hoek G, Bloemsma LD, Marra M, Wijga AH, van den Brink C, et al. Surrounding green, air pollution, traffic noise exposure and non-accidental and cause-specific mortality. Environ Int. 2020;134: 105341 10.1016/j.envint.2019.105341 [DOI] [PubMed] [Google Scholar]
  • 54.Nieuwenhuijsen M, Gascon M, Martinez D, Ponjoan A, Blanch J, Garcia-Gil M, et al. Air Pollution, Noise, Blue Space, and Green Space and Premature Mortality in Barcelona: A Mega Cohort. Int J Environ Res Public Health. 2018;15: 2405 10.3390/ijerph15112405 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Gan WQ, Koehoorn M, Davies HW, Demers PA, Tamburic L, Brauer M. Long-Term Exposure to Traffic-Related Air Pollution and the Risk of Coronary Heart Disease Hospitalization and Mortality. Environ Health Perspect. 2011;119: 501–507. 10.1289/ehp.1002511 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Cesaroni G, Porta D, Badaloni C, Stafoggia M, Eeftens M, Meliefste K, et al. Nitrogen dioxide levels estimated from land use regression models several years apart and association with mortality in a large cohort study. Environ Health. 2012;11: 48 10.1186/1476-069X-11-48 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Cesaroni G, Badaloni C, Gariazzo C, Stafoggia M, Sozzi R, Davoli M, et al. Long-Term Exposure to Urban Air Pollution and Mortality in a Cohort of More than a Million Adults in Rome. Environ Health Perspect. 2013;121: 324–331. 10.1289/ehp.1205862 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Gan WQ, FitzGerald JM, Carlsten C, Sadatsafavi M, Brauer M. Associations of Ambient Air Pollution with Chronic Obstructive Pulmonary Disease Hospitalization and Mortality. Am J Respir Crit Care Med. 2013;187: 721–727. 10.1164/rccm.201211-2004OC [DOI] [PubMed] [Google Scholar]
  • 59.Crouse DL, Peters PA, Hystad P, Brook JR, van Donkelaar A, Martin RV, et al. Ambient PM2.5, O3, and NO2 exposures and associations with mortality over 16 years of follow-up in the canadian census health and environment cohort (CanCHEC). Environ Health Perspect. 2015;123: 1180–1186. 10.1289/ehp.1409276 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Raaschou-Nielsen O, Andersen ZJ, Jensen SS, Ketzel M, Sørensen M, Hansen J, et al. Traffic air pollution and mortality from cardiovascular disease and all causes: a Danish cohort study. Environ Health. 2012;11: 60 10.1186/1476-069X-11-60 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Kim H, Kim J, Kim S, Kang S, Kim H, Kim H, et al. Cardiovascular Effects of Long‐Term Exposure to Air Pollution: A Population‐Based Study With 900 845 Person‐Years of Follow‐up. J Am Heart Assoc. 2017;6 10.1161/JAHA.117.007170 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Næss Ø, Nafstad P, Aamodt G, Claussen B, Rosland P. Relation between Concentration of Air Pollution and Cause-Specific Mortality: Four-Year Exposures to Nitrogen Dioxide and Particulate Matter Pollutants in 470 Neighborhoods in Oslo, Norway. Am J Epidemiol. 2007;165: 435–443. 10.1093/aje/kwk016 [DOI] [PubMed] [Google Scholar]
  • 63.Chen H, Goldberg MS, Burnett RT, Jerrett M, Wheeler AJ, Villeneuve PJ. Long-term exposure to traffic-related air pollution and cardiovascular mortality. Epidemiology. 2013;24: 35–43. 10.1097/EDE.0b013e318276c005 [DOI] [PubMed] [Google Scholar]
  • 64.Lim CC, Hayes RB, Ahn J, Shao Y, Silverman DT, Jones RR, et al. Mediterranean Diet and the Association Between Air Pollution and Cardiovascular Disease Mortality Risk. Circulation. 2019;139: 1766–1775. 10.1161/CIRCULATIONAHA.118.035742 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Lim CC, Hayes RB, Ahn J, Shao Y, Silverman DT, Jones RR, et al. Association between long-term exposure to ambient air pollution and diabetes mortality in the US. Environ Res. 2018;165: 330–336. 10.1016/j.envres.2018.04.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Raaschou-Nielsen O, Sørensen M, Ketzel M, Hertel O, Loft S, Tjønneland A, et al. Long-term exposure to traffic-related air pollution and diabetes-associated mortality: a cohort study. Diabetologia. 2012;56: 36–46. 10.1007/s00125-012-2698-7 [DOI] [PubMed] [Google Scholar]
  • 67.Andersen ZJ, Kristiansen LC, Andersen KK, Olsen TS, Hvidberg M, Jensen SS, et al. Stroke and Long-Term Exposure to Outdoor Air Pollution From Nitrogen Dioxide: A Cohort Study. Stroke. 2012;43: 320–325. 10.1161/STROKEAHA.111.629246 [DOI] [PubMed] [Google Scholar]
  • 68.Yang Y, Tang R, Qiu H, Lai P-C, Wong P, Thach T-Q, et al. Long term exposure to air pollution and mortality in an elderly cohort in Hong Kong. Environ Int. 2018;117: 99–106. 10.1016/j.envint.2018.04.034 [DOI] [PubMed] [Google Scholar]
  • 69.Jerrett M, Burnett RT, Beckerman BS, Turner MC, Krewski D, Thurston G, et al. Spatial Analysis of Air Pollution and Mortality in California. Am J Respir Crit Care Med. 2013;188: 593–599. 10.1164/rccm.201303-0609OC [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Setton E, Marshall JD, Brauer M, Lundquist KR, Hystad P, Keller P, et al. The impact of daily mobility on exposure to traffic-related air pollution and health effect estimates. J Expo Sci Environ Epidemiol. 2011;21: 42–48. 10.1038/jes.2010.14 [DOI] [PubMed] [Google Scholar]
  • 71.Armstrong BG. Effect of measurement error on epidemiological studies of environmental and occupational exposures. Occup Environ Med. 1998;55: 651–656. 10.1136/oem.55.10.651 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Armstrong BG. The effects of measurement errors on relative risk regressions. Am J Epidemiol. 1990;132: 1176–1184. 10.1093/oxfordjournals.aje.a115761 [DOI] [PubMed] [Google Scholar]
  • 73.Richmond-Bryant J, Long TC. Influence of exposure measurement errors on results from epidemiologic studies of different designs. J Expo Sci Environ Epidemiol. 2019. 10.1038/s41370-019-0164-z [DOI] [PubMed] [Google Scholar]
  • 74.Kumae T, Arakawa H. Comparison of effects of in vivo nitrogen dioxide exposure starting from different periods on alveolar macrophage activity, assessed by a chemiluminescence technique in Brown-Norway rats. Luminescence. 2006;21: 226–232. 10.1002/bio.911 [DOI] [PubMed] [Google Scholar]
  • 75.Miller FJ, Graham JA, Raub JA, Ming JW, Ménache MG, House DE, et al. Evaluating the toxicity of urban patterns of oxidant gases. II. Effects in mice from chronic exposure to nitrogen dioxide. J Toxicol Environ Health. 1987;21: 99–112. 10.1080/15287398709531005 [DOI] [PubMed] [Google Scholar]
  • 76.Ehrlich R. Interaction between environmental pollutants and respiratory infections. Environ Health Perspect. 1980;35: 89–99. 10.1289/ehp.803589 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Dietrich DF, Gemperli A, Gaspoz J-M, Schindler C, Liu L-JS, Gold DR, et al. Differences in Heart Rate Variability Associated with Long-Term Exposure to NO 2. Environ Health Perspect. 2008;116: 1357–1361. 10.1289/ehp.11377 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Foraster M, Basagaña X, Aguilera I, Rivera M, Agis D, Bouso L, et al. Association of Long-Term Exposure to Traffic-Related Air Pollution with Blood Pressure and Hypertension in an Adult Population–Based Cohort in Spain (the REGICOR Study). Environ Health Perspect. 2014;122: 404–411. 10.1289/ehp.1306497 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Rivera M, Basagaña X, Aguilera I, Foraster M, Agis D, de Groot E, et al. Association between Long-Term Exposure to Traffic-Related Air Pollution and Subclinical Atherosclerosis: The REGICOR Study. Environ Health Perspect. 2013;121: 223–230. 10.1289/ehp.1205146 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Zhang S, Wolf K, Breitner S, Kronenberg F, Stafoggia M, Peters A, et al. Long-term effects of air pollution on ankle-brachial index. Environ Int. 2018;118: 17–25. 10.1016/j.envint.2018.05.025 [DOI] [PubMed] [Google Scholar]
  • 81.Orellano P, Reynoso J, Quaranta N, Bardach A, Ciapponi A. Short-term exposure to particulate matter (PM10 and PM2.5), nitrogen dioxide (NO2), and ozone (O3) and all-cause and cause-specific mortality: Systematic review and meta-analysis. Environ Int. 2020;142: 105876 10.1016/j.envint.2020.105876 [DOI] [PubMed] [Google Scholar]
  • 82.Eftim S, Dominici F. Multisite Time-Series Studies Versus Cohort Studies: Methods, Findings, and Policy Implications. J Toxicol Environ Health A. 2005;68: 1191–1205. 10.1080/15287390590936076 [DOI] [PubMed] [Google Scholar]
  • 83.Billionnet C, Sherrill D, Annesi-Maesano I. Estimating the Health Effects of Exposure to Multi-Pollutant Mixture. Ann Epidemiol. 2012;22: 126–141. 10.1016/j.annepidem.2011.11.004 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Gianluigi Forloni

4 Nov 2020

PONE-D-20-27306

Systematic review and meta-analysis of cohort studies of long term outdoor nitrogen dioxide exposure and mortality

PLOS ONE

Dear Dr. Stieb,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses all the points raised during the review process.

Please submit your revised manuscript by Dec 19 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Gianluigi Forloni

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following financial disclosure:

" The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

At this time, please address the following queries:

  1. Please clarify the sources of funding (financial or material support) for your study. List the grants or organizations that supported your study, including funding received from your institution.

  2. State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

  3. If any authors received a salary from any of your funders, please state which authors and which funders.

  4. If you did not receive any funding for this study, please state: “The authors received no specific funding for this work.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The present manuscript reports the results of a systematic review, aimed to analyse the effects of long-term exposures to ambient NO2 on all-cause and cause-specific mortality, including cardiovascular, respiratory, and cerebrovascular mortality. The study was well conducted, with a rigorous methodology, and a thorough data analysis. The results are interesting, and the interpretation of findings seems to be adequate to extract several highly relevant conclusions for the study field. I have a few concerns I think should be addressed before publication, in order to make some improvements to this already excellent piece of work.

Major comments

My main concern is related to the “rating of quality and strength of evidence” analysis. Two very distinct tools were employed, the Navigation Guide methodology, and the causality determination framework. Within the text, this evaluation was very briefly explained, in fact it was barely mentioned, in the methodology section. There are no results associated with this analysis, and from the mention in the methodology, it jumps directly to the final part of the discussion and conclusions. It is worth noting that this analysis appeared to be relevant enough to be included in the conclusions, and within the abstract.

Given the importance of the strength of evidence evaluation, I guess it deserves further analysis and a better description of the procedures. The main observation is that the authors seem to imply that these two tools were somehow related, but actually they are quite different in the purpose and application. The Navigation Guide is a method for research synthesis in the context of systematic reviews. On the contrary, the causality determination framework is a general framework to consider causality, similar to the Bradford Hill criteria, which includes not only systematic reviews of epidemiological studies but also an overview of different type of studies, based on diverse scientific disciplines.

On one hand, the causality determination framework analysis cannot be performed using the results of this study, it needs many other sources. In this sense, it could be useful to enhance the discussion section, but not for the conclusion section or the abstract, where the main conclusions of this particular study are the ones that should be specifically mentioned.

On the other hand, the methodology lacks a thorough explanation about the way the Navigation Guide was applied. Many if not all the criteria to analyse the strength of evidence need concrete rules to judge the downgrading or upgrading of the level of evidence. This rules were not reported in the text. For example, how large should the magnitude of the effect be, or how “substantial” should the risk of bias be, in order to trigger the downgrades? These rules cannot be understood by reading the Table S2, and they should be clarified in the text or in the table. In addition, the results of the assessment for each criterion/mortality cause should be reported. I have some further observations for specific criteria (see below).

The authors judged the risk of bias criterion (a relatively large proportion of studies rated as probably high or high risk) as sufficient to downgrade the level of evidence. However, it can be seen in Table 1 that the sensitivity analysis excluding articles showing high risk of bias still demonstrate positive and significant HRs for almost all the mortality causes. In this sense, the merely presence of articles showing high risk of bias does not necessarily imply that the evidence is weak, provided that significant pooled HRs can be obtained through a considerable number of articles showing low or probably low risk of bias.

In the same line of thoughts, the high heterogeneity reported for almost all mortality causes could be related to natural variation or true heterogeneity (there are many discussions regarding the real value of the I2 parameter to analyse heterogeneity). If this is true, the observed heterogeneity might have an influence on the estimation (and precision) of the true HR value, but not necessarily on the causal relationship.

In page 10, the authors stated that they excluded studies encompassing the same geographic area or time period. The exact rule for article selection should be reported, e.g. whether broader geographic area or more extended time period was prioritized.

Observing Figure S3 (forest plots), it seems that HR estimates from single-pollutant and multipollutant models from the same articles were included at the same time in the pooled HRs. I’m not sure about it, as this is not clear for me in the text. If this is the case, a problem with double-counting of individual estimates might arise in the pooled estimates.

Another aspect to revise and justify, provided that I am not misinterpreting the procedures, is the combination of different co-pollutants species and different number of co-pollutants in the same pooled estimate.

Minor comments

It is rather surprising the very low value of the I2 for cerebrovascular and respiratory mortality in the sensitivity analysis, as compared to the I2 for the other analyses. At first sight, the difference seems not to be attributable to the number of studies. I think this warrants a mention in the discussion section.

When analysing the exposure-response relationship, the authors found three articles which found evidence of a threshold. These thresholds should be mentioned, as this values are relevant for further analyses, unless they have decided that the results of these studies should not be considered due to some reason. Anyway, I think this should be discussed.

Page 19: “If the true causal agent is not NO2, control measures which specifically reduce NO2 will not reduce mortality risks”.

Comment: this sentence needs further development, i.e. more details should be mentioned regarding which might be specific measures addressed to exclusively reduce NO2. Otherwise, the sentence appears as out-of-place here.

The World Health Organization is carrying out a process to update the global Air Quality Guidelines. To that end, a number of systematic reviews were commissioned to different research groups, with the aim of being an input for the new update of the guidelines. The objective of one of these systematic reviews partially overlaps with the objective of this study, i.e. long-term exposure to nitrogen dioxide and ozone and all-cause and respiratory mortality (see https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=89853 ). That review is going to be included in a special issue ( https://www.sciencedirect.com/journal/environment-international/special-issue/10MTC4W8FXJ ), but as far as I know it is not currently available. Given the relevance and similarities of both reviews, and the work the authors performed in the discussion section comparing this study with previous reviews, perhaps the authors could verify the link, to see if the aforementioned paper become available before the submission of the new version of this manuscript.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Pablo Orellano

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Feb 4;16(2):e0246451. doi: 10.1371/journal.pone.0246451.r002

Author response to Decision Letter 0


18 Dec 2020

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

________________________________________

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The present manuscript reports the results of a systematic review, aimed to analyse the effects of long-term exposures to ambient NO2 on all-cause and cause-specific mortality, including cardiovascular, respiratory, and cerebrovascular mortality. The study was well conducted, with a rigorous methodology, and a thorough data analysis. The results are interesting, and the interpretation of findings seems to be adequate to extract several highly relevant conclusions for the study field. I have a few concerns I think should be addressed before publication, in order to make some improvements to this already excellent piece of work.

Major comments

My main concern is related to the “rating of quality and strength of evidence” analysis. Two very distinct tools were employed, the Navigation Guide methodology, and the causality determination framework. Within the text, this evaluation was very briefly explained, in fact it was barely mentioned, in the methodology section. There are no results associated with this analysis, and from the mention in the methodology, it jumps directly to the final part of the discussion and conclusions. It is worth noting that this analysis appeared to be relevant enough to be included in the conclusions, and within the abstract.

Given the importance of the strength of evidence evaluation, I guess it deserves further analysis and a better description of the procedures. The main observation is that the authors seem to imply that these two tools were somehow related, but actually they are quite different in the purpose and application. The Navigation Guide is a method for research synthesis in the context of systematic reviews. On the contrary, the causality determination framework is a general framework to consider causality, similar to the Bradford Hill criteria, which includes not only systematic reviews of epidemiological studies but also an overview of different type of studies, based on diverse scientific disciplines.

On one hand, the causality determination framework analysis cannot be performed using the results of this study, it needs many other sources. In this sense, it could be useful to enhance the discussion section, but not for the conclusion section or the abstract, where the main conclusions of this particular study are the ones that should be specifically mentioned.

On the other hand, the methodology lacks a thorough explanation about the way the Navigation Guide was applied. Many if not all the criteria to analyse the strength of evidence need concrete rules to judge the downgrading or upgrading of the level of evidence. This rules were not reported in the text. For example, how large should the magnitude of the effect be, or how “substantial” should the risk of bias be, in order to trigger the downgrades? These rules cannot be understood by reading the Table S2, and they should be clarified in the text or in the table. In addition, the results of the assessment for each criterion/mortality cause should be reported. I have some further observations for specific criteria (see below).

RESPONSE: We thank Dr. Orellano for these detailed and thoughtful comments. We agree that this aspect of our paper was not sufficiently transparent and have added further details to the methods and discussion sections and revised the abstract. Note that we have opted to report our conclusions on the overall quality and strength of the evidence, as well as likelihood of causal relationships, in the discussion section, as we consider this interpretation of our findings.

First, we have expanded the methods section under “Overall rating of quality and strength of evidence,” as follows. “We applied the Navigation Guide methodology [33] and the causality determination framework used by the US EPA and Health Canada [12] (S2, S3 Tables) to judge the overall quality and strength of the evidence, and likelihood of a causal relationship. Following the Navigation Guide methodology, given the observational nature of the evidence, the starting point for rating overall quality was “moderate,” which was downgraded or upgraded to “low” or “high” based on the criteria summarized in Table S2 [33]. Identification of multiple upgrading or downgrading factors does not necessarily mean that overall quality is upgraded or downgraded multiple levels. Rather, the overall degree of upgrading or downgrading is based on reviewer judgement of the overall importance and impact of all factors considered [33]. The Navigation Guide characterizes strength of evidence of toxicity as “sufficient”, “limited”, “inadequate” or “indicative of a lack of toxicity” (S2 Table), based on the overall quality of the evidence, the direction of effect, confidence in the effect and any other factors identified as germane by the reviewers [33]. Given the parallels with the USEPA/Health Canada causality determination criteria (S3 Table), while we did not conduct a systematic review of other lines of evidence, we drew upon summaries of other lines of evidence from a recent assessment document [11], supplemented by findings from more recent mechanistic studies, in order to characterize the likelihood of a causal relationship.” Regarding concrete rules or criteria for upgrading/downgrading the quality of evidence, additional details are available from reference 33. However, the Navigation Guide does not prescribe quantitative criteria.

Second, we have also added to the discussion section as follows. “Specifically with respect to cerebrovascular mortality, imprecision is also considered a downgrading factor, as the 95% CI on the pooled estimate overlapped the null….we conclude that for all causes of death other than cerebrovascular disease, the overall quality of the evidence from cohort studies is moderate, the strength of evidence of toxicity is limited, and the overall evidence continues to be suggestive of, but not sufficient to infer, a causal relationship between long term NO2 exposure and mortality. In the case of cerebrovascular disease mortality, owing to the smaller number of primary studies and the non-significant smaller magnitude association based on the pooled estimate, we conclude that the overall quality of the evidence from cohort studies is low, the strength of evidence is inadequate, and the overall evidence is inadequate to infer a causal relationship.”

Finally, we have changed the concluding statements in the abstract as follows. “For all causes of death other than cerebrovascular disease, the overall quality of the evidence is moderate, and the strength of evidence is limited, while for cerebrovascular disease, overall quality is low and strength of evidence is inadequate. Important uncertainties remain, including potential confounding by co-pollutants or other concomitant exposures, and limited supporting mechanistic evidence.”

The authors judged the risk of bias criterion (a relatively large proportion of studies rated as probably high or high risk) as sufficient to downgrade the level of evidence. However, it can be seen in Table 1 that the sensitivity analysis excluding articles showing high risk of bias still demonstrate positive and significant HRs for almost all the mortality causes. In this sense, the merely presence of articles showing high risk of bias does not necessarily imply that the evidence is weak, provided that significant pooled HRs can be obtained through a considerable number of articles showing low or probably low risk of bias.

RESPONSE: We have clarified our reasoning on the issue of confounding in this section of the discussion, noting that, “Risk of bias from residual confounding was evaluated both in relation to inclusion of critical potential confounders in statistical models, as well as impacts of co-pollutants and other co-exposures on the magnitude of associations. Pooled estimates indicated that NO2 remained significantly associated with all/natural cause, cardiovascular, lung cancer, respiratory and ischemic heart disease mortality after exclusion of 12 studies with probably high or high risk of bias in the confounding domain. However, after excluding these studies, only 9 studies of all/natural cause mortality provided estimates based on both single and multi-pollutant models, and the pooled estimate indicated that NO2 was no longer significantly associated with mortality after adjusting for co-pollutants. Fewer paired estimates from single and multi-pollutant models were available for other causes of death. Pooled estimates from multi-pollutant models were consistently smaller in magnitude than those from single pollutant models, and the pooled estimates based on multi-pollutant models included 1, indicating no association, with the exception of ischemic heart disease mortality which was based on only three studies. Multi-pollutant models should be interpreted with caution in that the sensitivity of the effect of one pollutant to inclusion of other pollutants in a joint model is affected by factors such as the correlation among pollutants and their relative degree of exposure measurement error [81]. There is nonetheless evidence of confounding by co-pollutants of the association of long term NO2 exposure with mortality.” We have also noted that it is possible that associations of NO2 with mortality are confounded by noise and green space, but few studies have evaluated this.

In the same line of thoughts, the high heterogeneity reported for almost all mortality causes could be related to natural variation or true heterogeneity (there are many discussions regarding the real value of the I2 parameter to analyse heterogeneity). If this is true, the observed heterogeneity might have an influence on the estimation (and precision) of the true HR value, but not necessarily on the causal relationship.

RESPONSE: Dr. Orellano is correct that high heterogeneity could simply reflect natural variation among studies. Nonetheless, inconsistency/heterogeneity is clearly identified as a downgrading factor in the Navigation Guide, and as we emphasize in this section of the discussion, it could not be explained by the various factors we considered in meta-regression. We note that the new systematic review by Huangfu and Atkinson (2020) that Dr. Orellano mentioned in his final comment, also downgraded the evidence for both all cause and respiratory mortality in relation to inconsistency/heterogeneity. We have added a statement about Huangfu and Atkinson’s conclusion on this issue to the discussion.

In page 10, the authors stated that they excluded studies encompassing the same geographic area or time period. The exact rule for article selection should be reported, e.g. whether broader geographic area or more extended time period was prioritized.

RESPONSE: We have added shading to supplementary table S4 to indicate which papers were selected (n=53) vs. not selected in relation to overlapping time periods and geographic areas (n=21), as well as results only being available from multi-pollutant models (n=1), or too few studies of the outcome (n=4). Note that in reviewing our exclusions we made two changes, opting to include results from an additional two studies (five effect size estimates) of COPD mortality in the pooled estimate for respiratory mortality, and results from an additional two studies of myocardial infarction mortality in the pooled estimate for ischemic heart disease mortality. These changes did not materially affect the pooled estimates.

Observing Figure S3 (forest plots), it seems that HR estimates from single-pollutant and multipollutant models from the same articles were included at the same time in the pooled HRs. I’m not sure about it, as this is not clear for me in the text. If this is the case, a problem with double-counting of individual estimates might arise in the pooled estimates.

RESPONSE: There are no pooled estimates associated with Figure S3 forest plots, thus there is no potential for double counting. In keeping with PRISMA guidelines, these plots simply show all extracted results for all included papers, including results for population subgroups and results from single and multi-pollutant models.

Another aspect to revise and justify, provided that I am not misinterpreting the procedures, is the combination of different co-pollutants species and different number of co-pollutants in the same pooled estimate.

RESPONSE: If the reviewer is referring to Figure S3, the same response applies as for the previous comment, i.e. there are no pooled estimates associated with these forest plots. If the reviewer is referring to Figure 3, as explained in the Methods section pertaining to data extraction, “Results from multi-pollutant models that resulted in the greatest reduction in magnitude of effect compared to single pollutant results were selected in order to bracket the magnitude of effect from each study.” We have further clarified in the methods section that, “Our objective was not to assess the magnitude of the association with NO2 in the presence of a single co-pollutant common to all studies, but rather to determine the maximum potential for confounding of the association of mortality with NO2 by any co-pollutant(s).”

Minor comments

It is rather surprising the very low value of the I2 for cerebrovascular and respiratory mortality in the sensitivity analysis, as compared to the I2 for the other analyses. At first sight, the difference seems not to be attributable to the number of studies. I think this warrants a mention in the discussion section.

RESPONSE: We have added a statement in the discussion indicating that we believe this is related to the combination of a smaller number of studies and exclusion of studies reporting associations of a magnitude that differed substantially from the remaining studies.

When analysing the exposure-response relationship, the authors found three articles which found evidence of a threshold. These thresholds should be mentioned, as this values are relevant for further analyses, unless they have decided that the results of these studies should not be considered due to some reason. Anyway, I think this should be discussed.

RESPONSE: We have clarified in this section that of three studies finding evidence of a threshold, only one study identified specific numeric values, ranging from 20-40 µg/m3, depending on age and cause of death.

Page 19: “If the true causal agent is not NO2, control measures which specifically reduce NO2 will not reduce mortality risks”.

Comment: this sentence needs further development, i.e. more details should be mentioned regarding which might be specific measures addressed to exclusively reduce NO2. Otherwise, the sentence appears as out-of-place here.

RESPONSE: We have added further explanatory text indicating that, “Vehicle emissions are one of the main sources of NO2, but vehicle emissions, and secondary pollutants arising from vehicle emissions, also include numerous other potentially toxic pollutants such as carbon monoxide, particulate matter, benzene, formaldehyde, acetaldehyde, 1,3-butadiene, ozone, nitrates and organic and inorganic acids.” Thus, if a pollutant control technology only reduces NO2, but NO2 is not primarily responsible for adverse health effects, anticipated health benefits of pollution control measures will not be realized.

The World Health Organization is carrying out a process to update the global Air Quality Guidelines. To that end, a number of systematic reviews were commissioned to different research groups, with the aim of being an input for the new update of the guidelines. The objective of one of these systematic reviews partially overlaps with the objective of this study, i.e. long-term exposure to nitrogen dioxide and ozone and all-cause and respiratory mortality (see https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=89853 ). That review is going to be included in a special issue ( https://www.sciencedirect.com/journal/environment-international/special-issue/10MTC4W8FXJ ), but as far as I know it is not currently available. Given the relevance and similarities of both reviews, and the work the authors performed in the discussion section comparing this study with previous reviews, perhaps the authors could verify the link, to see if the aforementioned paper become available before the submission of the new version of this manuscript.

RESPONSE: We thank Dr. Orellano for noting this and we have now included this paper in our summary of other systematic reviews and meta-analyses. We also noted two studies (Hartiala et al. 2016, Desikan et al. 2016) that were included in this review which were not included in our analysis. We have added these, but they did not materially affect our results.

Attachment

Submitted filename: PLOS response to reviewers.docx

Decision Letter 1

Gianluigi Forloni

20 Jan 2021

Systematic review and meta-analysis of cohort studies of long term outdoor nitrogen dioxide exposure and mortality

PONE-D-20-27306R1

Dear Dr. Stieb,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Gianluigi Forloni

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In this submission, all my concerns were carefully addressed. The issues that seemed unclear in the previous round of revision were sufficiently explained, and the suggested modifications were incorporated. Thus, in my opinion this new version of the manuscript is suitable for publication in PLOS ONE. I congratulate Dr. Stieb and colleagues for the outstanding work performed for this systematic review.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Pablo Orellano

Acceptance letter

Gianluigi Forloni

25 Jan 2021

PONE-D-20-27306R1

Systematic review and meta-analysis of cohort studies of long term outdoor nitrogen dioxide exposure and mortality

Dear Dr. Stieb:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Gianluigi Forloni

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Risk of bias criteria.

    (PDF)

    S2 Fig. Risk of bias ratings for individual studies.

    (PDF)

    S3 Fig. Forest plots by region.

    (PDF)

    S4 Fig. Hazard ratios from single pollutant models from individual cohort studies and pooled estimates by region (specific causes of death).

    (PDF)

    S5 Fig. Funnel plot of log(hazard ratio) vs. standard error, lung cancer mortality.

    (PDF)

    S1 File. Review protocol.

    (PDF)

    S2 File. Data.

    (CSV)

    S3 File. PRISMA 2009 checklist.

    (PDF)

    S1 Table. Details of search strategies.

    (PDF)

    S2 Table. Navigation guide criteria for overall quality and strength of evidence.

    (PDF)

    S3 Table. USEPA/Health Canada criteria for evaluating likelihood of causal relationship.

    (PDF)

    S4 Table. Characteristics of primary studies.

    (PDF)

    S5 Table. Reasons for assigned ratings of risk of bias greater than low risk (or unable to assess).

    (PDF)

    S6 Table. Leave one out analyses.

    (PDF)

    S1 Text. Sensitivity to estimator.

    (PDF)

    Attachment

    Submitted filename: PLOS response to reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES