Skip to main content
Environmental Health Perspectives logoLink to Environmental Health Perspectives
. 2024 Mar 6;132(3):037003. doi: 10.1289/EHP12969

Quantifying Multipollutant Health Impacts Using the Environmental Benefits Mapping and Analysis Program–Community Edition (BenMAP-CE): A Case Study in Atlanta, Georgia

Evan Coffman 1,, Ana G Rappold 1, Rachel C Nethery 2, Jim Anderton 3, Meredith Amend 3, Melanie A Jackson 3, Henry Roman 3, Neal Fann 4, Kirk R Baker 4, Jason D Sacks 1
PMCID: PMC10916644  PMID: 38445893

Abstract

Background:

Air pollution risk assessments do not generally quantify health impacts using multipollutant risk estimates, but instead use results from single-pollutant or copollutant models. Multipollutant epidemiological models account for pollutant interactions and joint effects but can be computationally complex and data intensive. Risk estimates from multipollutant studies are therefore challenging to implement in the quantification of health impacts.

Objectives:

Our objective was to conduct a case study using a developmental multipollutant version of the Environmental Benefits Mapping and Analysis Program—Community Edition (BenMAP-CE) to estimate the health impact associated with changes in multiple air pollutants using both a single and multipollutant approach.

Methods:

BenMAP-CE was used to estimate the change in the number of pediatric asthma emergency department (ED) visits attributable to simulated changes in air pollution between 2011 and 2025 in Atlanta, Georgia, applying risk estimates from an epidemiological study that examined short-term single-pollutant and multipollutant (with and without first-order interactions) exposures. Analyses examined individual pollutants (i.e., ozone, fine particulate matter, carbon monoxide, nitrogen dioxide (NO2), sulfur dioxide, and particulate matter components) and combinations of these pollutants meant to represent shared properties or predefined sources (i.e., oxidant gases, secondary pollutants, traffic, power plant, and criteria pollutants). Comparisons were made between multipollutant health impact functions (HIF) and the sum of single-pollutant HIFs for the individual pollutants that constitute the respective pollutant groups.

Results:

Photochemical modeling predicted large decreases in most of the examined pollutant concentrations between 2011 and 2025 based on sector specific (i.e., source-based) estimates of growth and anticipated controls. Estimated number of avoided asthma ED visits attributable to any given multipollutant group were generally higher when using results from models that included interaction terms in comparison with those that did not. We estimated the greatest number of avoided pediatric asthma ED visits for pollutant groups that include NO2 (i. e., criteria pollutants, oxidants, and traffic pollutants). In models that accounted for interaction, year-round estimates for pollutant groups that included NO2 ranged from 27.1 [95% confidence interval (CI): 1.6, 52.7; traffic pollutants] to 55.4 (95% CI: 41.8, 69.0; oxidants) avoided pediatric asthma ED visits. Year-round results using multipollutant risk estimates with interaction were comparable to the sum of the single-pollutant results corresponding to most multipollutant groups [e.g., 52.9 (95% CI: 43.6, 62.2) for oxidants] but were notably lower than the sum of the single-pollutant results for some pollutant groups [e.g., 77.5 (95% CI: 66.0, 89.0) for traffic pollutants].

Discussion:

Performing a multipollutant health impact assessment is technically feasible but computationally complex. It requires time, resources, and detailed input parameters not commonly reported in air pollution epidemiological studies. Results estimated using the sum of single-pollutant models are comparable to those quantified using a multipollutant model. Although limited to a single study and location, assessing the trade-offs between a multipollutant and single-pollutant approach is warranted. https://doi.org/10.1289/EHP12969

Introduction

The Clean Air Act1,2 requires the US Environmental Protection Agency (US EPA) to evaluate the scientific evidence to determine the health and welfare effects posed by criteria air pollutants [current criteria pollutants are particulate matter (PM), ozone (O3), and related photochemical oxidants, oxides of nitrogen [e.g., nitrogen dioxide (NO2)]; sulfur oxides, [e.g., sulfur dioxide (SO2)]; carbon monoxide (CO); and lead (Pb)] to support the setting of National Ambient Air Quality Standards (NAAQS). Although it is well recognized that people are exposed to a complex mixture of air pollutants, the review of the scientific evidence and the subsequent establishment of each NAAQS have historically focused on conducting reviews for one pollutant at a time. The parameters of the Clean Air Act, which govern the review of each NAAQS separately, have contributed to researchers often examining the health effects of exposure to individual criteria pollutants, rather than simultaneous exposure to multiple pollutants.

The 2004 National Research Council (NRC) report “Air Quality Management in the United States” recommended that the US EPA transition from a “pollutant-by-pollutant” approach to managing air quality to a “multipollutant, risk-based approach.”3 More recent reports from the UK Committee on the Medical Effects of Air Pollutants4 and the National Academies of Sciences, Engineering and Medicine5 have similarly emphasized the need for a multipollutant approach to quantifying the health effects of air pollution exposures. Such a transition is largely predicated on the availability of epidemiological studies that account for multipollutant exposures and risk. Consistent with the NRC’s recommendation, numerous publications have provided additional calls for research aimed at understanding the health effects of multipollutant exposures while also acknowledging the many challenges of multipollutant research.611 These calls for multipollutant research have led to the proliferation of novel multipollutant statistical approaches over the last 10 y.1215 Although these innovative methods have expanded our understanding of multipollutant exposures, multipollutant methods vary in complexity in relation to both model implementation and the interpretability of results,16,17 which has complicated the comparison of results across studies.

An important downstream consideration when evaluating multipollutant epidemiological studies is the potential application of results from such studies in the quantification of the public health impacts and corresponding economic values of various air quality actions using tools such as US EPA’s Environmental Benefits and Mapping Program–Community Edition (BenMAP-CE), which is a free and open-source software program that employs user inputs to calculate air pollution-related health impacts.18 Risk assessments and regulatory impact analyses using BenMAP-CE, which quantitatively characterize air pollution risks, require knowledge of the relationship between air pollution exposure and a given health outcome, often represented by an effect estimate [also referred to as a risk estimate or beta (β) coefficient] from an epidemiological study.18 To date, although some assessments have focused on risk-based multipollutant control strategies,19 health impact analyses have relied exclusively on results from epidemiological studies that represent the estimated health effect(s) related to variation in the concentration of a single pollutant while controlling for various confounders. Conversely, a multipollutant risk assessment strategy that evaluates the health effects related to a simultaneous change in multiple air pollutants represents an important but underdeveloped component of a multipollutant air quality management framework.20 Implementation of such an approach to quantify health impacts of multiple air pollutants requires effect estimates from multipollutant epidemiological studies that are easily interpretable and able to be parameterized. However, increased dimensionality and collinearity in multipollutant studies often require more complex models to discern statistical relationships, which can decrease the interpretability of multipollutant effect estimates for the purposes of health impact analyses.21

In this case study, we estimate pediatric asthma emergency department (ED) visits attributable to multipollutant exposures using a developmental version of BenMAP-CE to demonstrate the application of a multipollutant assessment of health impacts, using effect estimates from an epidemiological study that modeled the joint effects of short-term multipollutant exposures on pediatric asthma ED visits in Atlanta, Georgia.22 In this analysis, we compare the procedures for quantifying population health impacts in a single and multipollutant context for Atlanta due to potential air quality changes between 2011 and 2025 resulting from sector specific (i.e., source-based) estimates of growth and anticipated controls.

Materials and Methods

Overview

This analysis used a developmental version of BenMAP-CE that has been modified to allow for the use of multipollutant health impact functions (HIFs) with and without interaction terms to estimate health impacts. BenMAP-CE is a US EPA tool that estimates the number and economic value of air pollution–related deaths and illnesses relying on preloaded or user-inputted datasets of air quality data, demographic data (i.e., baseline incidence and population data), concentration–response relationships for multiple individual air pollutants and numerous health outcomes, and economic values.23

In this case study, we used air quality data predicted using the US EPA Community Multiscale Air Quality (CMAQ) model24 for the years 2011 and a future year, 2025, based on sector specific (i.e., source-based) estimates of growth and anticipated controls to examine the relationship between changes in air quality in Atlanta and the estimated number of air pollution–related pediatric asthma ED visits. Health impacts were estimated in relation to predicted changes between 2011 and 2025 in pollutant concentrations using the baseline incidence of pediatric asthma ED visits in Atlanta, the corresponding population (i.e., number of children in Atlanta), and multipollutant concentration–response (C-R) functions from Winquist et al.22 relating joint exposure to groups of related air pollutants to asthma-related pediatric ED visits. Air pollutant groups identified a priori by Winquist et al.22 were also examined and included combinations of pollutants with shared properties (e.g., oxidant gases or secondary pollutants) and sources (e.g., traffic-related or coal-fired power plant pollutants) (Table 1). Finally, considering the computational burden of conducting multipollutant assessments, we compared results from the multipollutant HIFs to the sum of HIFs for the single pollutants that form the multipollutant groups to assess the utility of quantifying the health effects of air pollutants in a multipollutant context.

Table 1.

Pollutant groups and associated pollutants, as defined by Winquist et al.,22 used in the BenMAP-CE quantification of multipollutant impacts on asthma-related ED visits.

Pollutant group Pollutants
Single pollutants CO, EC, NO2, O3, PM2.5, secondary PM2.5, SO2, and sulfate
Criteria pollutants CO, NO2, O3, PM2.5, and SO2
Oxidants NO2, O3, and SO2
Power plant SO2 and sulfate
Secondary pollutants O3 and secondary PM2.5
Traffic pollutants CO, EC, and NO2

Note: BenMAP-CE, Environmental Benefits Mapping and Analysis Program–Community Edition; CO, carbon monoxide; EC, elemental carbon; ED, emergency department; NO2, nitrogen dioxide, O3, ozone; PM2.5, particulate matter with a nominal mean aerodynamic diameter less than or equal to 2.5μm; SO2, sulfur dioxide.

Defining Multipollutant HIFs

As described in Sacks et al.,18 HIFs are used in BenMAP-CE to quantify the health impacts attributable to changes in an air pollutant (Equation 1). HIFs are commonly defined as:

ΔY=(1eβ×ΔAQ)×Y0×Pop, (1)

where ΔY is the estimated health impact attributable to a change in air quality (ΔAQ) in a given population (Pop) with a known baseline incidence (Y0) for the health effect of interest. ΔY is calculated using the effect estimate or beta coefficient (β) from an epidemiological study.

Although HIFs have most commonly been used to estimate the health impacts attributable to a single air pollutant, the functional form is also able to accommodate multiple βs from a multipollutant model that simultaneously adjusts for co-varying pollutants (Equation 2). In this analysis, we modified the HIF capabilities of BenMAP-CE to support the following form:

ΔY=Y0(1e(i=1nβi×ΔAQi))×Pop, (2)

where ΔY is the estimated joint health impact attributable to a simultaneous change in a set of n air pollutants [e.g., βi and ΔAQi are the effect estimate and change in air quality for a given air pollutant (i) in a set of pollutants (n), respectively]. In addition, we extended the HIF in BenMAP-CE to support beta coefficients from multipollutant models with interaction terms (Equation 3), as follows:

ΔY=Y0(1e(i=1nβi×ΔAQi+j=1n1k=j+1nβjk×ΔAQjk))×Pop. (3)

In this multipollutant model with interaction terms, βjk represents the coefficient for the interaction terms for the given air pollutants (j and k) and ΔAQjk is the difference in the products of the corresponding air pollutant concentrations, e.g., [bj×bk][aj×ak], where b is the air pollutant concentration in 2025, and a is the air pollutant concentration in 2011.

The developmental multipollutant version of BenMAP-CE was modified to process HIFs in the forms described in Equations 2 and 3, in addition to the standard single-pollutant form highlighted in Equation 1. The data sources and preparation steps for the four HIF inputs (β, Y0, ΔAQ, and Pop) and standard error (SE) calculations are summarized in Table 2 and described in further detail in the ensuing sections.

Table 2.

Sources of input data corresponding to single and multipollutant health impact functions (as defined in Equations 1, 2, and 3) in the BenMAP-CE analysis.

Input Source Notes
Air quality (AQ) Community Multiscale Air Quality model (CMAQ) 12×12km daily predicted concentrations for eight pollutants in 2011 and 2025
Baseline incidence of ED visits (Y0) County level incidence rates of pediatric asthma ED visits for children 2–18 y of age developed using data from the Healthcare Cost and Utilization Project (HCUP)14 Disaggregated to 12×12km grid.
Population (Pop) Population data was generated for children 5–17 y of age using 2010 US census block population data. BenMAP-CE crosswalks to 12×12km grid.
Beta coefficients (β) Winquist et al.22 Single pollutant, joint effects, and joint effects with interaction

Note: BenMAP-CE, Environmental Benefits and Mapping Program–Community Edition; ED, emergency department; km, kilometer.

Epidemiological Data (β and SE)

The epidemiological data used in this analysis (Excel Table S1) were derived from a study22 that examined associations between short-term air pollution exposures, in both a single-pollutant and multipollutant context, and pediatric (i.e., children 5–17 y of age) asthma ED visits in Atlanta from 1998 to 2004. We used effect estimates from Winquist et al.22 for this case study because the statistical methodology used to examine multipollutant exposures was less computationally intensive than other multipollutant approaches in the literature and the results were more easily interpretable, because the reported joint effects represented a priori defined pollutant groups with shared properties or sources (i.e., pollutants that could be controlled simultaneously). The selected study was additionally advantageous because it included a health end point with extensive scientific evidence of a relationship with a number of pollutants and covered a limited geographic area, requiring less processing power from BenMAP-CE.

Winquist et al.22 reported associations using a multiday lag of 0–2 d (3-day moving average) for each air pollutant. With respect to multipollutant exposures, adjusted models were examined with and without first-order pollutant interactions for subsets of related air pollutants, with some groups representing source categories identified a priori22 (Table 1). Winquist et al.22 estimated rate ratios (RR) and 95% confidence intervals (CIs) from warm and cold season models for Atlanta. In addition to the multipollutant models, Winquist et al.22 also provided results from single-pollutant models for each of the air pollutants that comprise the multipollutant groups (Table 1). The single-pollutant models were not adjusted for copollutants, but otherwise included the same set of potential confounders as the multipollutant models (i.e., temporal trends, meteorologic variables, nonasthma pediatric ED visits for acute upper respiratory infections and interactions between temporal trends and meteorological variables).

Winquist et al.22 observed that joint effect estimates from the multipollutant models were typically smaller than the sum of the estimates from the single-pollutant models that comprised the respective multipollutant groups. As the authors note, this is likely due to unmeasured copollutant confounding in the single-pollutant models. There were not generally notable differences between the joint effect estimates from multipollutant models with and without interaction. The natural logarithm of the RR estimates are used as the βs in the HIFs (see Excel Table S1 for βs from all single- and multipollutant models). For each multipollutant model with interaction terms, we extracted the βs for all interaction terms regardless of statistical significance, because the interaction terms included in the models impact the βs for the noninteraction terms. We account for the uncertainty in each coefficient by using the variance-covariance matrices in the estimation of CIs.

In addition to the beta coefficient estimates, we extracted the variance-covariance matrices reported in Winquist et al.22 (Excel Table S2) and calculated SEs for the joint effect coefficients for each multipollutant group—i.e., Σi(βi×ΔAQi). SEs for joint effects were calculated as a function of the variance-covariance matrices of the β estimates and a vector of ΔAQ (Equation 4):

SEJE=LΣ^L, (4)

where SEJE is the SE of the joint effects for the pollutant group of interest, Σ^ is the estimated covariance matrix for the pollutant group (see Excel Table S2), and L is the vector of seasonal deltas for each pollutant in the pollutant group, ordered to match Σ^. The multipollutant version of BenMAP-CE was modified to import variance-covariance matrices and calculate SEs for joint effects using Equation 4. BenMAP-CE uses Monte Carlo simulation to construct CIs around the mean health impact estimates by randomly sampling an uncertainty distribution around the effect coefficients using the SE of the joint effects.

Air Quality Data

Various approaches can be used to develop an air quality delta for use in a HIF. For example, incremental or proportional rollbacks—approaches that are built into BenMAP-CE—are often applied to existing air quality data to create changes in pollutant concentrations. In this analysis, we instead used simulated 2025 air quality projections from 2011 baseline data that were previously developed by the US EPA.25 The included air quality scenarios were chosen here as an illustrative example of a complex change in emissions across a multitude of scenarios. This selection is intended to reflect a more realistic change in air quality rather than simply making incremental or proportional changes to pollutant concentrations.

Air quality data for the years 2011 and 2025 were simulated for the individual air pollutants that comprise each of the air pollutant groups (see Table 1) using the US EPA CMAQ (version 5.1; CMAQv5.1) model.24 Inputs to the model included annual 2011 gridded meteorological fields, emissions data, and boundary conditions. Gridded meteorological fields were provided with the Weather Research and Forecasting (WRF) model26 simulation. Models were applied for a domain covering the conterminous United States and parts of southern Canada and northern Mexico with a 12×12km horizontal grid with 25 vertical layers of variable thickness extending up to 50 hPa. Hourly predictions in the lowest model layer, which extended to 20m above ground, were used to calculate the mean concentrations of air pollutants (ΔAQ) in the health impact function. Time and space variant lateral boundary inflow was extracted from a hemispheric scale photochemical model simulation for the same time period.27

Anthropogenic emissions from stationary point, nonpoint stationary (area), and mobile sectors were based on the 2011 National Emissions Inventory.25 Biogenic emissions were estimated with the Biogenic Emission Inventory System (version 3.6.1).28 Daily satellite fire detections were used to generate wildland fire emissions.29 Projected future year anthropogenic emissions representing 2025 were developed using sector specific estimates of growth and anticipated controls. Sector specific economic growth factors and reductions due to specific control plans implemented between 2011 and 2025 were numerous and have been described elsewhere.25 Biogenic, wildland fire, and anthropogenic emissions outside the United States were the same for both 2011 and 2025 model simulations. Point source emissions were input to CMAQ based on coordinate location and nonpoint emissions were gridded to match the CMAQ domain. The 2011 baseline and projected 2025 emissions were developed to support policy assessments and represent a complex representation of growth and control across pollutants, sectors, and regions in the United States to challenge this approach with nonuniform emission reductions.

Hourly measurements made at routine surface monitors (epa.gov/aqs) during 2011 were paired with model predictions in space and time. Normalized mean bias was calculated for all hourly model-observation pairs. Model predictions for NO2 (15% bias), O3 (6% bias), and PM2.5 (3% bias) compared best with measurements, whereas CO (29% bias) and SO2 (22% bias) tended to be underestimated.

Baseline Incidence (Y0) and Population (Pop)

HIFs were calculated using county-level incidence rates of pediatric asthma ED visits that were developed using data from the Healthcare Cost and Utilization Project (HCUP).18 These data, which are preloaded in BenMAP-CE, include incidence rates of pediatric asthma ED visits among children 2–18 y of age, providing a close match to the epidemiological study population. To match the spatial resolution of the air quality data, incidence rates in children were disaggregated from the county level to the 12-km grid level. BenMAP-CE also has built in crosswalks to generate population estimates for 12-km grids using 2010 US census block population data.18 Population data were generated for children 5–17 y of age to match the age range of the study population from which the epidemiological data were derived.22

Analyses

All analyses were conducted using a developmental version of BenMAP-CE that recognizes multipollutant groups, accepts air quality surfaces for multiple air pollutants in a single analysis, and processes HIFs of the forms described in Equations 1, 2, and 3. We additionally modified the tool to facilitate the processing of air quality data for multiple air pollutants in a single analysis, updated the calculation of seasonal point estimates and the combination of seasonal estimates, and adjusted the algorithms for estimating uncertainty associated with combining multiple beta coefficients from a multipollutant model (Equation 4). The developmental multipollutant version of BenMAP-CE is publicly available on GitHub.30

We quantified air pollutant–attributable pediatric asthma ED visits using 10 multipollutant functions, including functions with and without interaction terms for each of the five air pollutant groups defined in Table 1. For each analysis, baseline (2011) and control (2025) air quality surfaces for each air pollutant within the air pollutant group being analyzed were loaded into BenMAP-CE. The change in air quality between baseline and control for each air pollutant within each air pollutant group (i.e., ΔAQi) was calculated as the average of the daily concentration changes from baseline. The average change in air pollutant concentrations was calculated separately for the cold season (1 November–30 April) and warm season (1 May–31 October) to account for the seasonal C-R functions used in the HIFs. The multipollutant HIFs derived from Winquist et al.22 were applied to the city of Atlanta, consistent with the geographic domain of the study, to calculate counts of pediatric asthma ED visits among children 5–17 y of age (y) attributable to the simultaneous seasonal change in concentrations of air pollutants belonging to one of the source-specific pollutant mixtures (i) from 2011 to 2025 in each 12-km grid cell (j, where J is the total number of grid cells in the city of Atlanta) as (Equation 5):

yi=jJΔyij. (5)

Δyij was estimated using Equations 2 (no interaction) and 3 (first-order interactions), as described above. In addition, yi was estimated separately for the warm and cold season, accounting for the seasonal air pollution deltas and beta coefficients, and an annual estimate was calculated by summing the seasonal results. The delta method was used to derive the variance of the summed estimates and construct 95% CIs.

To compare these results to analyses that more commonly focus on a single pollutant, we additionally analyzed single-pollutant HIFs for the individual pollutants (k; where K is the total number of pollutants in a given source-specific pollutant mixture) that constitute each of the pollutant groups and summed them to approximate the counts of pediatric asthma ED visits attributable to changes in different source-specific pollutant mixtures (Equation 6):

yi=jJkKΔykj. (6)

As a sensitivity analysis to examine the application of these approaches to a larger spatial domain, the same multipollutant and single-pollutant analyses were conducted for the entire state of Georgia.

Results

Predicted Changes in Air Quality

Based on the estimated growth and anticipated controls employed on air pollution sources, CMAQ predicted decreases in most of the modeled pollutants in 2025 in comparison with 2011 [Table 3 (Atlanta) and Table S1 (Georgia)]. The largest relative decrements in annual average pollutant concentrations in Atlanta were predicted for EC (55.1%; 0.9μg/m3), SO2 (52.5%; 1.4 ppb), NO2 (45.2%; 17.0 ppb), and secondary PM2.5 (40.0%; 1.7μg/m3). Minimal changes in concentrations were predicted for O3 (1.4%; 0.6 ppb). Notably, relative predicted changes in seasonal averages were comparable for all pollutants except O3, for which CMAQ predicted an increase in cold season average (10.7%; 3.6 ppb) and a decrease in warm season average (8.7%; 4.5 ppb) concentrations.

Table 3.

Predicted changes in seasonal and annual pollutant concentrations in Atlanta, Georgia, from 2011 to 2025, using US EPA Community Multiscale Air Quality (version 5.1; CMAQv5.1) model.

Pollutant Annual Warm season Cold season
2011 2025 Δ (%) 2011 2025 Δ (%) 2011 2025 Δ (%)
CO (ppm) 0.6 0.5 0.2 (25.9) 0.7 0.5 0.2 (23.7) 0.6 0.5 0.2 (28.1)
EC (μg/m3) 1.6 0.7 0.9 (55.1) 1.5 0.6 0.9 (58.1) 1.6 0.8 0.8 (52.1)
NO2 (ppb) 37.6 20.6 17.0 (45.2) 39.6 19.4 20.2 (50.9) 35.5 21.8 13.7 (38.6)
O3 (ppb) 43.7 43.1 0.6 (1.4) 54.0 49.3 4.7 (8.7) 33.3 36.9 3.6 (10.7)
PM2.5 (μg/m3) 12.8 10.0 2.9 (22.4) 12.5 9.3 3.2 (25.8) 13.2 10.6 2.5 (19.1)
Secondary PM2.5 (μg/m3) 4.2 2.5 1.7 (40.0) 3.8 1.9 1.9 (50.8) 4.6 3.2 1.4 (30.9)
SO2 (ppb) 2.7 1.3 1.4 (52.5) 2.9 1.2 1.7 (57.7) 2.5 1.4 1.2 (46.2)
SO4 (μg/m3) 2.2 1.4 0.8 (37.5) 2.6 1.4 1.2 (46.6) 1.8 1.4 0.4 (24.1)

Note: CO, carbon monoxide; Cold season, November–April; EC, elemental carbon; NO2, nitrogen dioxide; O3, ozone; PM2.5, particulate matter with a nominal mean aerodynamic diameter less than or equal to 2.5μm; ppb, parts per billion; ppm, parts per million; SO2, sulfur dioxide; SO4, sulfate; Warm season, May–March.

Single-Pollutant Results

Results from single-pollutant models varied considerably by pollutant and season (Figure 1; Table 4). For the following results, avoided ED visits in the warm and cold seasons represent an estimated decrease in ED visits attributable to a change in seasonal air pollution concentrations in 2025 in comparison with 2011. The estimated number of avoided pediatric asthma ED visits in Atlanta attributable to the modeled changes in single pollutants were consistently higher in the warm season in comparison with the cold season. Individual estimates ranged from 2.4 (95% CI: 1.6, 3.2; SO2) to 42.7 (95% CI: 36.3, 49.1; NO2) visits in the warm season and from 2.8 (95% CI: 6.3, 0.6; O3) to 7.0 (95% CI: 1.6, 12.5; NO2) in the cold season, where positive numbers represent avoided ED visits and negative numbers represent an estimated increase in ED visits. We estimated that predicted changes in annual NO2 concentrations were responsible for the most avoided annual pediatric asthma ED visits of any pollutant [49.7 (95% CI: 41.3, 58.2)], accounting for more than twice as many as the pollutant responsible for the second most avoided ED visits [EC: 18.3 (95% CI: 10.9, 25.8)]. The estimated numbers of avoided pediatric asthma ED visits across the entire state of Georgia were notably higher than those in Atlanta due to the increased population total, but the seasonal and between-pollutant patterns are comparable (Figure S1 and Table S2).

Figure 1.

Figure 1 is a set of six graphs titled Single pollutant, Criteria, Oxidant, Power plant, secondary, and traffic, plotting Avoided asthma emergency department visits (5 to 17 year olds), ranging from 0 to 75 in increments of 25 (left y-axis) and total, warm, and cold (right y-axis) across nitrogen dioxide, ozone, particulate matter begin subscript 2.5 end subscript, sulfur dioxide, secondary particulate matter begin subscript 2.5 end subscript, elemental carbon, criteria pollutants, and sulfate (x-axis) for health impact function model type, including joint effects, joint effects with interaction, and sum of single pollutants, respectively.

Estimated number of annual and seasonal avoided pediatric asthma emergency department visits (5–17 y of age) in 2025 due to predicted changes in air quality in Atlanta, Georgia, from 2011 to 2025, quantified using single-pollutant and multipollutant health impact functions in a developmental version of BenMAP-CE. Note: Negative numbers represent a predicted increase in asthma ED visits. In addition to being identified via color, health impact function model types are listed in the order that they appear in each pollutant group/season grid box. Quantitative summary data presented in Tables 47. Dots on figure represent point estimates for avoided asthma ED visits and lines represent 95% confidence intervals. BenMAP-CE, Environmental Benefits Mapping and Analysis Program–Community Edition; CO, carbon monoxide, Cold season, November–April; Criteria pollutants, CO, NO2, O3, PM2.5, and SO2; EC, elemental carbon; ED, emergency department; NO2, nitrogen dioxide; O3, ozone; Oxidants, NO2, O3, and SO2; PM2.5, particulate matter with a nominal mean aerodynamic diameter less than or equal to 2.5μm; Power plant, SO2 and sulfate; Secondary pollutants, O3 and secondary PM2.5; SO2, sulfur dioxide; SO4, sulfate; Traffic pollutants, CO, EC, and NO2; Warm season, May–March.

Table 4.

Estimated number of annual and seasonal avoided pediatric asthma emergency department visits (5–17 y old) in 2025 due to predicted changes in air quality in Atlanta, Georgia, from 2011 to 2025, quantified using single-pollutant health impact functions in BenMAP-CE.

Pollutant Annual Cold season Warm season
PE (95% CI) PE (95% CI) PE (95% CI)
CO 9.4 (7.1, 11.7) 1.4 (0.6, 3.4) 8.0 (6.9, 9.2)
EC 18.3 (10.9, 25.8) 1.3 (4.6, 7.2) 17.0 (12.5, 21.6)
NO2 49.7 (41.3, 58.2) 7.0 (1.6, 12.5) 42.7 (36.3, 49.1)
O3 1.4 (2.4, 5.2) 2.8 (6.3, 0.6) 4.2 (2.6, 5.9)
PM2.5 3.1 (1.7, 4.6) 0.6 (0.6, 1.8) 2.5 (1.8, 3.3)
Secondary PM2.5 2.1 (0.2, 4.4) 1.8 (3.5, 0.1) 3.8 (2.3, 5.4)
SO2 1.8 (0.8, 2.7) 0.6 (1.2, 0.0) 2.4 (1.6, 3.2)
SO4 2.8 (0.4, 5.1) 0.4 (0.9, 0.1) 3.2 (0.9, 5.4)

Note: Negative numbers represent a predicted increase in asthma emergency department visits. BenMAP-CE, Environmental Benefits and Mapping Program–Community Edition; CI, confidence interval; CO, carbon monoxide; Cold season, November–April; EC, elemental carbon; NO2, nitrogen dioxide; O3, ozone; PE, point estimate; PM2.5, particulate matter with a nominal mean aerodynamic diameter less than or equal to 2.5μm; SO2, sulfur dioxide; SO4, sulfate; Warm season, May–March.

Multipollutant and Sum of Single-Pollutant Results

Multipollutant results for Atlanta exhibit some of the same trends displayed in the single-pollutant results (Figure 1; Tables 57). Specifically, estimated changes in avoided pediatric asthma ED visits attributable to simultaneous changes in multiple pollutants, as defined by the specified pollutant groups, were driven mostly by avoided pediatric asthma ED visits in the warm season. In addition, we estimated the greatest number of avoided pediatric asthma ED visits for pollutant groups that include NO2 (i.e., criteria pollutants, oxidants, and traffic pollutants). In models that did not account for potential interaction, year-round estimates for the NO2-inclusive pollutant groups ranged from 32.4 (95% CI: 19.3, 45.5; traffic pollutants) to 42.6 (95% CI: 31.9, 53.3; oxidants) avoided pediatric asthma ED visits, in comparison with 0.1 (95% CI: 2.6, 2.8; secondary pollutants) and 3.7 (95% CI: 2.0, 5.4; power plant pollutants) for the groups that did not include NO2. In general, the estimated annual impacts on ED visits attributable to any given pollutant group were greater (i.e., farther from the null) when estimated using C-R parameters that included interaction terms. The one exception to this is the traffic pollutants group, which had interaction-based estimates that were comparable to, but less precise than, the estimates without interaction terms. Notably, this exception did not hold for the results including the entire state of Georgia, which otherwise demonstrated patterns similar to those of the Atlanta results (Figure S1 and Table S3–S5).

Table 5.

Estimated number of annual and seasonal avoided pediatric asthma emergency department visits (5–17 y old) in 2025 due to predicted changes in air quality in Atlanta, Georgia, from 2011 to 2025, quantified using multipollutant health impact functions without interaction terms in a developmental version of BenMAP-CE.

Joint effects without interaction terms
Annual Cold season Warm season
Pollutant group PE (95% CI) PE (95% CI) PE (95% CI)
Criteria 32.8 (18.9, 46.6) 5.9 (2.1, 13.8) 26.9 (15.5, 38.2)
Oxidants 42.6 (31.9, 53.3) 2.7 (3.2, 8.5) 40.0 (31.0, 48.9)
Power plant 3.7 (2.0, 5.4) 0.8 (1.6, 0.1) 4.5 (3.0, 5.9)
Secondary 0.1 (2.6, 2.8) 5.1 (7.2, 2.9) 5.2 (3.5, 6.8)
Traffic 32.4 (19.3, 45.5) 7.7 (0.4, 14.9) 24.7 (13.8, 35.6)

Note: Negative numbers represent a predicted increase in asthma emergency department visits. BenMAP-CE, Environmental Benefits and Mapping Program–Community Edition; CI, confidence interval; CO, carbon monoxide; Cold season, November–April; Criteria pollutants, CO, NO2, O3, PM2.5, and SO2; EC, elemental carbon; NO2, nitrogen dioxide; O3, ozone; Oxidants, NO2, O3, and SO2; PE, point estimate; PM2.5, particulate matter with a nominal mean aerodynamic diameter less than or equal to 2.5μm; Power plant, SO2 and sulfate; Secondary pollutants, O3 and secondary PM2.5; SO2, sulfur dioxide; SO4, sulfate; Traffic pollutants, CO, EC, and NO2; Warm season, May–March.

Table 7.

Estimated number of annual and seasonal avoided pediatric asthma emergency department visits (5–17 y old) in 2025 due to predicted changes in air quality in Atlanta, Georgia, from 2011 to 2025, quantified using summed results from single-pollutant health impact functions in BenMAP-CE.

Sum of single pollutants
Annual Cold season Warm season
Pollutant group PE (95% CI) PE (95% CI) PE (95% CI)
Criteria 65.5 (55.8, 75.2) 5.6 (1.3, 12.5) 59.9 (53.1, 66.7)
Oxidants 52.9 (43.6, 62.2) 3.6 (2.9, 10.1) 49.3 (42.6, 56.0)
Power plant 4.5 (2.0, 7.0) 1.0 (1.8, 0.3) 5.5 (3.2, 7.9)
Secondary 3.5 (1.0, 7.9) 4.6 (8.4, 0.8) 8.1 (5.8, 10.3)
Traffic 77.5 (66.0, 89.0) 9.7 (1.4, 18.0) 67.8 (59.8, 75.8)

Note: Negative numbers represent a predicted increase in asthma emergency department visits. BenMAP-CE, Environmental Benefits and Mapping Program–Community Edition; CI, confidence interval; CO, carbon monoxide; Cold season, November–April; Criteria pollutants, CO, NO2, O3, PM2.5, and SO2; EC, elemental carbon; NO2, nitrogen dioxide; O3 ozone; Oxidants, NO2, O3, and SO2; PE, point estimate; PM2.5, particulate matter with a nominal mean aerodynamic diameter less than or equal to 2.5μm; Power plant, SO2 and sulfate; Secondary pollutants, O3 and secondary PM2.5; SO2, sulfur dioxide; SO4, sulfate; Traffic pollutants, CO, EC, and NO2; Warm season, May–March.

Table 6.

Estimated number of annual and seasonal avoided pediatric asthma emergency department visits (5–17 y old) in 2025 due to predicted changes in air quality in Atlanta, Georgia, from 2011 to 2025; quantified using multipollutant health impact functions with interaction terms in a developmental version of BenMAP-CE.

Joint effects with interaction terms
Annual Cold season Warm season
Pollutant group PE (95% CI) PE (95% CI) PE (95% CI)
Criteria 45.8 (24.8, 66.7) 4.6 (7.2, 16.5) 41.1 (23.9, 58.4)
Oxidants 55.4 (41.8, 69.0) 12.4 (3.3, 21.5) 43.0 (32.9, 53.1)
Power plant 7.3 (2.9, 11.6) 2.6 (4.0, 1.1) 9.8 (5.8, 13.9)
Secondary 1.1 (4.0, 1.8) 6.3 (8.5, 4.1) 5.2 (3.3, 7.2)
Traffic 27.1 (1.6, 52.7) 9.4 (1.3, 20.1) 17.7 (5.4, 40.9)

Note: Negative numbers represent a predicted increase in asthma emergency department visits. BenMAP-CE, Environmental Benefits and Mapping Program–Community Edition; CI, confidence interval; CO, carbon monoxide; Cold season, November–April; Criteria pollutants, CO, NO2, O3, PM2.5, and SO2; EC, elemental carbon; NO2, nitrogen dioxide; O3, ozone; Oxidants, NO2, O3, and SO2; PE, point estimate; PM2.5, particulate matter with a nominal mean aerodynamic diameter less than or equal to 2.5μm; Power plant, SO2 and sulfate; Secondary pollutants, O3 and secondary PM2.5; SO2, sulfur dioxide; SO4, sulfate; Traffic pollutants, CO, EC, and NO2; Warm season, May–March.

The results from the multipollutant analyses were compared with analyses that summed the single-pollutant results for pollutants that comprised each pollutant group. A comparison of these results is presented in Figure 1 and Tables 57. Although there was some indication of variability in results between the sum of single-pollutant and multipollutant (both with and without interaction) analyses, across each category the results were relatively similar (i.e., overlapping 95% CIs) for all categories except traffic and criteria pollutants. On average, the changes in pediatric asthma ED visits in the cold season estimated from multipollutant HIFs with and without interaction terms were within one estimated ED visit of the corresponding sums of the single-pollutant results for each of the pollutant groups. For the traffic and criteria pollutant categories in the warm season, the sums of single-pollutant estimates were substantially larger than both multipollutant analyses (46%–383%).

Discussion

In this case study, we assessed the utility and feasibility of implementing a multipollutant approach to estimating the health impacts associated with changes in air quality. In the multipollutant analyses, we found that the estimated number of avoided pediatric asthma ED visits for the source categories examined were relatively similar, though the interaction model often estimated larger impacts among the source categories. The estimated multipollutant results were generally of the same magnitude as the summed single-pollutant results; the exceptions being the results for the traffic and criteria pollutants in the warm season. The relative consistency of results in the computationally intensive multipollutant approach in comparison with the simpler sum of the single-pollutant results indicates that it is worthwhile to consider the complexity of the statistical approach used to estimate multipollutant impacts along with the time and resources available to institute a multipollutant approach in the process of planning future quantitative assessments. Ultimately, the value added by the multipollutant approach in comparison with the single-pollutant approach depends on both on the shape of C-R relationships and nature of the air quality data used in the analysis. A strength of this work is that we demonstrated the capabilities of a publicly available developmental version of BenMAP-CE with multipollutant functionality. This developmental version of BenMAP-CE reduces the initial investment necessary to other researchers for further exploratory health impact analyses using multipollutant effect estimates from additive main effects models.

Although we successfully implemented a multipollutant approach to estimating health impacts within BenMAP-CE, we also identified several challenges inherent in estimating the health impacts associated with changes in air quality within a multipollutant context. Most important, there is a fundamental question as to whether there is scientific evidence to support the use of results from multipollutant models in the quantification of the health impacts associated with changes in air quality. In estimating health impacts due to changes in air quality, ideally there would be some degree of confidence in the air pollutant–health effects relationship prior to conducting such an assessment. Confidence in the air pollutant–health effects relationship directly translates to confidence in the estimated number of health impacts due to changes in air quality. Without scientific evidence supporting a relationship between an air pollutant exposure and a health effect, there is significant uncertainty in the estimated number of health impacts caused by changes in air quality. As a result, standard US EPA practice is to only quantify impacts for pollutants where the scientific evidence supports some degree of certainty regarding the causal nature of the relationship between the air pollutant exposure and health outcome of interest18 (i.e., likely to be causal relationship or causal relationship).

Although there has been limited research to date examining relationships between short-term multipollutant exposures and health effects, for the purposes of this study we applied multipollutant effect estimates from a study that focused on the outcome of asthma ED visits because there is extensive scientific evidence that supports a “likely to be causal” or “causal” relationship between short-term exposures to some of the individual criteria pollutants examined (i.e., SO2, NO2, ozone, and PM2.5) and respiratory effects, including asthma. Specifically, the most recent US EPA Integrated Science Assessments (ISAs) for the criteria pollutants concluded that the evidence for short-term exposures and respiratory effects supports a “causal relationship” for ozone,31 NO2,32 and SO233; “likely to be causal relationship” for PM2.534; and “suggestive of, but not sufficient to infer, causal relationship” for CO.35 We highlight the issue of causality, because quantifying multipollutant impacts by estimating joint effects for a group of air pollutants with strong individual evidence of causality is defensible, given that the beta coefficients used in the health impact functions represent the estimated independent effect of each of the air pollutants while controlling for the potential confounding effects of the other air pollutants in the model. However, there is more uncertainty in the interpretation of health impacts quantified using joint effects from models with interaction terms, given that systematic evaluations that are on par with ISAs have not been conducted to assess causality between two or more air pollutant exposures that interact to affect health outcomes on a nonadditive scale.

In addition to concerns about the appropriateness of quantifying the health impacts of multipollutant exposures because of uncertainties regarding the strength of the relationship between specific combinations of pollutants and health, the ability to estimate the potential health impacts of multipollutant exposures is limited by the statistical approach used. To date, although numerous epidemiological studies have employed various statistical approaches to examine associations between short-term air pollution exposures and health,17 the complexity and differences in statistical approaches employed complicates the interpretation of results across studies.16 As a result, in this case study, we chose to apply effect estimates from a study that used additive main effects models because they provide a less computationally intensive method to assess the health effects of multipollutant exposures in comparison with other methods, such as dimension reduction, nonparametric models, and novel multipollutant models.16 As we experienced developing this multipollutant version of BenMAP-CE, even a less complex method required a significant level of effort to implement in a health impact assessment. Further, some more complex models may not be directly translatable to a parameterized health impact function. Despite their relative ease of computation and interpretability, additive main effects models may produce unstable effect estimates due to multicollinearity. In addition, individual pollutant effect estimates within an additive main effects model may vary due to differential exposure measurement error. The variances of the beta coefficients used in this analysis were not severely inflated,22 suggesting that the impact of collinearity was not excessive.36 The developmental multipollutant version of BenMAP-CE could also accommodate joint effect estimates from other multipollutant modeling approaches that may more adequately estimate joint effects from highly correlated exposures, such as parametric g-computation.37 However, we recognize that we introduced uncertainty in this analysis by applying potentially unstable individual pollutant effect estimates that comprised the joint effects (see Equations 2 and 3).

Health impact analyses often use effect estimates from meta-analyses or several individual studies that represent a range of estimates from the larger literature base.38 Although literature on the relationship between multipollutant exposures and health effects is expanding, there is limited evidence for additive main effects models that evaluate the same pollutant groups over the same geographic domain. Thus, this analysis relies on multipollutant effect estimates from a single study, which raises uncertainty regarding the robustness of the selected effect estimates. Many of the effect estimates used in this analysis are imprecise, and some are indicative of protective effects (see Excel Table S1), which further highlights this uncertainty. We selected effect estimates from this particular study because it was a large time-series study conducted in a single city. The length of the time series was likely to produce more stable effect estimates,39 and the limited geographic scale reduced the processing power required by BenMAP-CE to load and manipulate air quality surfaces for multiple pollutants. To reduce uncertainties related to generalizability, the geographic domain of this case study was chosen to match the location of the epidemiological study from which we extracted effect estimates. Given the spatiotemporal variability of pollutants and their relationships to each other,40,41 as well as the population attributes specific to the epidemiological study location, the results are not likely generalizable to other locations. The analysis described in this paper demonstrates the feasibility of estimating multipollutant health impacts in BenMAP-CE and provides a novel comparison between single- and multipollutant air pollutant estimates, but the absolute health impacts estimated should be interpreted with caution due to the noted uncertainties and lack of generalizability to other geographic locations.

Conclusion

In this case study, we demonstrated that a multipollutant approach to estimating the health impacts of changes in air pollution is feasible but incurs a number of challenges unique to multipollutant assessments. Despite incorporating a less complex statistical approach to estimating the health impacts of multipollutant exposures, there was a substantial investment of time and resources to produce a functional multipollutant version of BenMAP-CE. In this analysis, the sums of the individual results were generally consistent with the multipollutant results, which raises questions about the value added relative to the time and resource investment. Notably this analysis generated results from one multipollutant model type applied in one city. Thus, further research is warranted to reach more definitive conclusions about the potential added value for any particular multipollutant methodology. However, although the state of multipollutant research has advanced substantially over the past decade, the lack of consistent and comparable methods across studies makes it difficult to confidently conduct risk assessments for multipollutant exposures. In summary, this work shows that although it is possible to use a multipollutant approach to estimate health impacts associated with changes in multiple air pollutants on a large scale (e.g., at the city and state level), the development of a multipollutant version of BenMAP-CE was computationally complex and incurred large time and resource costs. The comparability of results generated from single-pollutant and multipollutant effect estimates indicates that the trade-offs between single-pollutant and multipollutant approaches should be considered in the planning of future quantitative assessments.

Supplementary Material

ehp12969.s001.acco.pdf (492.9KB, pdf)

Acknowledgments

The authors gratefully acknowledge funding from National Institutes of Health grant K01ES032458 and thank Drs. Elizabeth Chan and Thomas Luben for input on an earlier version of this manuscript.

This document was reviewed in accordance with US EPA policy and approved for publication. Mention of trade names or commercial products does not constitute endorsement or recommendation for use. The views expressed in this article are those of the authors and do not necessarily reflect the views or policies of the US EPA.

Conclusions and opinions are those of the individual authors and do not necessarily reflect the policies or views of EHP Publishing or the National Institute of Environmental Health Sciences.

References

  • 1.US Congress. 1990. Clean Air Act, as Amended by Pub. L. No. 101–549, section 108: Air Quality Criteria and Control Techniques, 42 USC 7408 (101st Congress, 15 November 1990). https://www.congress.gov/bill/101st-congress/senate-bill/1630/text [accessed 20 March 2023].
  • 2.US Congress. 1990. Clean Air Act, as Amended by Pub. L. No. 101–549, section 109: National Primary and Secondary Ambient Air Quality Standards, 42 USC 7409 (101st Congress, 15 November 1990). https://www.congress.gov/bill/101st-congress/senate-bill/1630/text [accessed 20 March 2023].
  • 3.National Research Council. 2004. Air Quality Management in the United States. Washington, DC: National Academies Press. 10.17226/10728. [DOI] [Google Scholar]
  • 4.Committee on the Medical Effects of Air Pollutants. 2020. Summary of COMEAP Recommendations for the Quantification of Health Effects Associated with Air Pollutants. https://assets.publishing.service.gov.uk/media/64fadfdea78c5f0014265847/COMEAP_Quantification_recommendations.pdf [accessed 20 March 2023].
  • 5.National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today’s and Tomorrow’s Challenges. Washington, DC: National Academies Press. 10.17226/26602. [DOI] [PubMed] [Google Scholar]
  • 6.Greenbaum D, Shaikh R. 2010. First steps toward multipollutant science for air quality decisions. Epidemiology 21(2):195–197, PMID: , 10.1097/EDE.0b013e3181ccc52a. [DOI] [PubMed] [Google Scholar]
  • 7.Dominici F, Peng RD, Barr CD, Bell ML. 2010. Protecting human health from air pollution: shifting from a single-pollutant to a multipollutant approach. Epidemiology 21(2):187–194, PMID: , 10.1097/EDE.0b013e3181cc86e8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Johns DO, Stanek LW, Walker K, Benromdhane S, Hubbell B, Ross M, et al. 2012. Practical advancement of multipollutant scientific and risk assessment approaches for ambient air pollution. Environ Health Perspect 120(9):1238–1242, PMID: , 10.1289/ehp.1204939. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Coull BA, Bobb JF, Wellenius GA, Kioumourtzoglou M-A, Mittleman MA, Koutrakis P, et al. 2015. Part 1. Statistical learning methods for the effects of multiple air pollution constituents. Res Rep Health Eff Inst (183 pt 1-2):5–50, PMID: . [PubMed] [Google Scholar]
  • 10.Park ES, Symanski E, Han D, Spiegelman C. 2015. Part 2. Development of enhanced statistical methods for assessing health effects associated with an unknown number of major sources of multiple air pollutants. Res Rep Health Eff Inst (183 pt 1-2):51–113, PMID: . [PubMed] [Google Scholar]
  • 11.Mauderly JL, Burnett RT, Castillejos M, Ozkaynak H, Samet JM, Stieb DM, et al. 2010. Is the air pollution health research community prepared to support a multipollutant air quality management framework? Inhal Toxicol 22 Suppl 1:1–19, PMID: , 10.3109/08958371003793846. [DOI] [PubMed] [Google Scholar]
  • 12.Keil AP, Buckley JP, O’Brien KM, Ferguson KK, Zhao S, White AJ. 2020. A quantile-based g-computation approach to addressing the effects of exposure mixtures. Environ Health Perspect 128(4):47004, PMID: , 10.1289/EHP5838. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Peng RD, Liu JC, McCormack MC, Mickley LJ, Bell ML. 2022. Estimating the health effects of environmental mixtures using principal stratification. Stat Med 41(10):1815–1828, PMID: , 10.1002/sim.9330. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Keller JP, Drton M, Larson T, Kaufman JD, Sandler DP, Szpiro AA. 2017. Covariate-adaptive clustering of exposures for air pollution epidemiology cohorts. Ann Appl Stat 11(1):93–113, PMID: , 10.1214/16-AOAS992. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Traini E, Huss A, Portengen L, Rookus M, Verschuren WMM, Vermeulen RCH, et al. 2022. A multipollutant approach to estimating causal effects of air pollution mixtures on overall mortality in a large, prospective cohort. Epidemiology 33(4):514–522, PMID: , 10.1097/EDE.0000000000001492. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Davalos AD, Luben TJ, Herring AH, Sacks JD. 2017. Current approaches used in epidemiologic studies to examine short-term multipollutant air pollution exposures. Ann Epidemiol 27(2):145–153.e1, PMID: , 10.1016/j.annepidem.2016.11.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Stafoggia M, Breitner S, Hampel R, Basagaña X. 2017. Statistical approaches to address multi-pollutant mixtures and multiple exposures: the state of the science. Curr Environ Health Rep 4(4):481–490, PMID: , 10.1007/s40572-017-0162-z. [DOI] [PubMed] [Google Scholar]
  • 18.Sacks JD, Lloyd JM, Zhu Y, Anderton J, Jang CJ, Hubbell B, et al. 2018. The Environmental Benefits Mapping and Analysis Program–Community Edition (BenMAP-CE): a tool to estimate the health and economic benefits of reducing air pollution. Environ Model Softw 104:118–129, PMID: . [PMC free article] [PubMed] [Google Scholar]
  • 19.Wesson K, Fann N, Morris M, Fox T, Hubbell B. 2010. A multi-pollutant, risk-based approach to air quality management: case study for Detroit. Atmos Pollut Res 1(4):296–304, 10.5094/APR.2010.037. [DOI] [Google Scholar]
  • 20.Brook JR, Demerjian KL, Hidy G, Molina LT, Pennell WT, Scheffe R. 2009. New directions: results-oriented multi-pollutant air quality management. Atmos Environ 43(12):2091–2093, 10.1016/j.atmosenv.2008.12.041. [DOI] [Google Scholar]
  • 21.Hamra GB, Buckley JP. 2018. Environmental exposure mixtures: questions and methods to address them. Curr Epidemiol Rep 5(2):160–165, PMID: , 10.1007/s40471-018-0145-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Winquist A, Kirrane E, Klein M, Strickland M, Darrow LA, Sarnat SE, et al. 2014. Joint effects of ambient air pollutants on pediatric asthma emergency department visits in Atlanta, 1998–2004. Epidemiology 25(5):666–673, PMID: , 10.1097/EDE.0000000000000146. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.US EPA (US Environmental Protection Agency). Environmental Benefits Mapping and Analysis Program – Community Edition (BenMAP-CE). https://www.epa.gov/benmap [accessed 20 March 2023].
  • 24.US EPA Office of Research and Development. 2015. CMAQv5.1. https://zenodo.org/records/1079909 [accessed 20 March 2023].
  • 25.US EPA. 2015. 2011 National Emissions Inventory, version 2: Technical Support Document. https://www.epa.gov/sites/default/files/2015-10/documents/nei2011v2_tsd_14aug2015.pdf [accessed 20 March 2023].
  • 26.Skamarock WC, Klemp JB, Dudhia J, Gill DO, Barker D, Duda MG, et al. 2008. A Description of the Advanced Research WRF Version 3. Boulder, CO: University Corporation for Atmospheric Research/National Center for Atmospheric Research. 10.5065/d68s4mvh. http://n2t.net/ark:/85065/d72n51q1 [accessed 20 March 2023]. [DOI] [Google Scholar]
  • 27.Henderson BH, Akhtar F, Pye HOT, Napelenok SL, Hutzell WT. 2014. A database and tool for boundary conditions for regional air quality modeling: description and evaluation. Geosci Model Dev 7(1):339–360, 10.5194/gmd-7-339-2014. [DOI] [Google Scholar]
  • 28.Bash JO, Baker KR, Beaver MR. 2016. Evaluation of improved land use and canopy representation in BEIS v3.61 with biogenic VOC measurements in California. Geosci Model Dev 9(6):2191–2207, 10.5194/gmd-9-2191-2016. [DOI] [Google Scholar]
  • 29.Baker KR, Woody MC, Tonnesen GS, Hutzell W, Pye HOT, Beaver MR, et al. 2016. Contribution of regional-scale fire events to ozone and PM2.5 air quality estimated by photochemical modeling approaches. Atmos Environ 140:539–554, 10.1016/j.atmosenv.2016.06.032. [DOI] [Google Scholar]
  • 30.GitHub. BenMAPCE/BenMAP-CE. https://github.com/BenMAPCE/BenMAP-CE/tree/MultiPollutant-develop [accessed 20 March 2023].
  • 31.US EPA. 2020. Integrated Science Assessment (ISA) for Ozone and Related Photochemical Oxidants (Final Report, Apr 2020). Washington, DC: US Environmental Protection Agency. [Google Scholar]
  • 32.US EPA. 2016. Integrated Science Assessment (ISA) for Oxides of Nitrogen (Final Report, Jan 2016). Washington, DC: US Environmental Protection Agency. [Google Scholar]
  • 33.US EPA. 2017. Integrated Science Assessment (ISA) for Sulfur Oxides – Health Criteria (Final Report, Dec 2017). Washington, DC, US Environmental Protection Agency. [Google Scholar]
  • 34.US EPA. 2019. Integrated Science Assessment (ISA) for Particulate Matter (Final Report, Dec 2019). Washington, DC, US Environmental Protection Agency. [PubMed] [Google Scholar]
  • 35.US EPA. 2010. Integrated Science Assessment (ISA) for Carbon Monoxide (Final Report, Jan 2010). Washington, DC, US Environmental Protection Agency. [Google Scholar]
  • 36.Mason CH, Perreault WD. 1991. Collinearity, power, and interpretation of multiple regression analysis. J Market Res 28(3):268–280, 10.2307/3172863. [DOI] [Google Scholar]
  • 37.Keil AP, Buckley JP, Kalkbrenner AE. 2021. Bayesian g-computation for estimating impacts of interventions on exposure mixtures: demonstration with metals from coal-fired power plants and birth weight. Am J Epidemiol 190(12):2647–2657, PMID: , 10.1093/aje/kwab053. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.US EPA. 2023. Estimating PM2.5- and Ozone-Attributable Health Benefits. https://www.epa.gov/sites/default/files/2021-03/documents/estimating_pm2.5-_and_ozone-attributable_health_benefits_tsd.pdf [accessed 20 March 2023].
  • 39.Bhaskaran K, Gasparrini A, Hajat S, Smeeth L, Armstrong B. 2013. Time series regression studies in environmental epidemiology. Int J Epidemiol 42(4):1187–1195, PMID: , 10.1093/ije/dyt092. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Requia WJ, Coull BA, Koutrakis P. 2019. Regional air pollution mixtures across the continental US. Atmos Environ 213:258–272, 10.1016/j.atmosenv.2019.06.006. [DOI] [Google Scholar]
  • 41.Wu X. 2022. Tri-clustering–based exploration of spatio-temporal heterogeneity of six criteria air pollutants and their relationships in China. Front Earth Sci 10: 951510, 10.3389/feart.2022.951510. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ehp12969.s001.acco.pdf (492.9KB, pdf)

Articles from Environmental Health Perspectives are provided here courtesy of National Institute of Environmental Health Sciences

RESOURCES