Abstract
The difference method is used in mediation analysis to quantify the extent to which a mediator explains the mechanisms underlying the pathway between an exposure and an outcome. In many health science studies, the exposures are almost never measured without error, which can result in biased effect estimates. This article investigates methods for mediation analysis when a continuous exposure is mismeasured. Under a linear exposure measurement error model, we prove that the bias of indirect effect and mediation proportion can go in either direction but the mediation proportion is usually be less biased when the associations between the exposure and its error-prone counterpart are similar with and without adjustment for the mediator. We further propose methods to adjust for exposure measurement error with continuous and binary outcomes. The proposed approaches require a main study/validation study design where in the validation study, data are available for characterizing the relationship between the true exposure and its error-prone counterpart. The proposed approaches are then applied to the Health Professional Follow-up Study, 1986–2016, to investigate the impact of body mass index (BMI) as a mediator for mediating the effect of physical activity on the risk of cardiovascular diseases. Our results reveal that physical activity is significantly associated with a lower risk of cardiovascular disease incidence, and approximately half of the total effect of physical activity is mediated by BMI after accounting for exposure measurement error. Extensive simulation studies are conducted to demonstrate the validity and efficiency of the proposed approaches in finite samples.
Keywords: mediation analysis, mediation proportion, mismeasured continuous exposure, natural indirect effect, regression calibration, validation study
1 |. INTRODUCTION
Mediation analysis1–3 is widely-used in public health research. In mediation analysis, the primary focus lies in the decomposition of the total effect (TE) of the exposure on the outcome into the natural indirect effect (NIE) through the mediator and the natural direct effect (NDE) whose impact is due solely to the exposure and possibly other mediators. In addition, the mediation proportion (MP; sometimes also referred as the proportion mediated or attributable risk percent) has been defined as the ratio of the NIE and the TE to quantify the relative importance of the mediator in explaining the exposure-outcome mechanism. Throughout, we shall refer to NIE, NDE, and MP as mediation measures of potential interest. The product method and difference method are two regression-based approaches to estimate the mediation measures, which were first developed outside of the counterfactual outcome framework commonly used for causal inference;1 under certain assumptions, regression-based mediation analyses have since been shown to have causal interpretations under the counterfactual outcome framework.3–5 The product method fits one regression for the outcome and another regression for the mediator, whereas the difference method evaluates two regression models for the outcome, one with and the other without adjusting for the mediator. A detailed comparison of both methods and their pros and cons are provided in Cheng et al.6
Measurement error is a common problem in mediation analysis from observational studies, and standard mediation estimators can be biased if the measurement error is not appropriately addressed. Table 1 provides a full summary of the existing literature addressing measurement error/misclassification issues in mediation analysis (typically measurement error refers to an error-prone continuous variable, whereas misclassification refers to an error-prone binary or categorical variable, and we follow that tradition here). There have been a few previous efforts to investigate the estimation bias in NIE and NDE due to an error-prone binary or continuous mediator and to develop bias correction approaches for mediation analysis. Others have studied the impact of misclassification of a binary exposure or a binary outcome on estimation of the NIE and NDE. However, there are no methods currently available to address measurement error with a continuous exposure, although exposure measurement error in continuous variables is a major source of bias in epidemiologic studies.7
TABLE 1.
A summary of the existing literature addressing mediation analysis in the presence of mismeasured or misclassified variables, classified by the variable subject to measurement error (outcome, mediator, exposure) and the variable type (continuous, binary)
| Variable | Type | Reference |
|---|---|---|
| Outcome | Continuous | Null. There is no bias in standard statistical inference when outcome follows classic additive measurement error model. |
| Binary | Jiang and VanderWeele.4 | |
| Mediator | Continuous | Cessie et al;8 VanderWeele et al;9 Valeri et al;10 Zhao and Prentice;11 Ssenkusu;12 Fulcher et al;13 Gaynor et al14 |
| Binary | Ogburn and VanderWeele;15 Valeri and VanderWeele.16 | |
| Exposure | Continuous | Null (primary focus of this article). |
| Binary | Valeri et al;17 Jiang and VanderWeele.18 |
Note: All publications shown in this table assumed that the measurement error or misclassification process is known, except for Ssenkusu,12 who considered that repeated measurements on the mediator are available to describe the measurement error process of a mismeasured mediator. Zhao and Prentice11 also mentioned an external dataset can be used to estimate the measurement error model parameters, but they did not consider the variability of estimating measurement error models in drawing statistical inference. Zhao and Prentice11 and Valeri et al17 considered the difference method in the presence of measurement error; all other publications considered the product method when addressing measurement error/misclassification.
The objective of this article is to develop statistical approaches for valid estimation and inference of mediation measures in the presence of an error-prone continuous exposure. Specifically, we develop strategies to correct for the bias in estimation and inference when using the difference method. In contrast to most of the existing literature on measurement error and misclassification in mediation analysis which consider the product method (Table 1), we focus on the difference method as it is the method of choice in most epidemiologic studies, simple to implement, and robust to misspecification of the exposure-mediator relationship.6 Moreover, almost all prior work in Table 1 (except for Ssenkusu12) considered mediation analysis with a known measurement error process or conducted sensitivity analysis over a range of assumed parameter values that characterize the degree of measurement error. In this article, instead of assuming known measurement error model parameters, as is often done in sensitivity analysis, we work under the main study/validation study design,19 where a gold standard measurement of the exposure is obtained in a validation study that allows us to estimate the parameters of interest in the measurement error model. The main study/validation study design is commonly used in epidemiology. For instance, our motivating example investigates the effect of physical activity on the risk of cardiovascular diseases among participants in the Health Professionals Follow-up Study (HPFS)20 The exposure, physical activity, was assessed through questionnaires on frequency of common types of leisure-time physical activities during the previous year. The accuracy of the questionnaire responses were then validated with physical activity diaries in a validation study involving 238 participants.21 In the validation study, the correlation between the questionnaire-based and diary-based physical activity scores was estimated to be 0.28, indicating the questionnaire-based activity data in the main study were subject to measurement error.
To reliably assess mediation with an error-prone continuous exposure in a main study/validation study design, we develop two bias correction approaches, one based on the regression calibration22 and the other based on the expected estimating equations.23 We first explicitly derive a new set of bias formulas for estimating NIE and MP due to exposure measurement error, based on which a computationally convenient regression calibration approach is motivated. In addition, we also generalize the formulation of the expected estimation equation approach to potentially make more efficient use of the available main and validation study data. For both approaches, we also derive consistent sandwich variance estimators to quantify the uncertainty in the estimators and compare their operating characteristics through extensive simulations.
The remainder of this article is organized as follows. In Section 2, we review the difference method for mediation analysis without exposure measurement error. Section 3 introduces the measurement error model. Next, the proposed correction approaches are developed in Sections 4 and 5, where a brief discussion for the connections between the proposed approached are provided in Section 6. In Section 7, we provide extensive simulations to evaluate the empirical performance of the proposed approaches. In Section 8, we apply the proposed approaches to evaluate the extent to which the effect of vigorous physical activity on the risk of cardiovascular diseases is mediated by body mass index in the HPFS, followed by a brief discussion in Section 9.
2 |. MEDIATION ANALYSIS WITHOUT EXPOSURE MEASUREMENT ERROR: A RECAP
2.1 |. Mediation measures and assumptions
Let be an exposure, be a mediator, be an outcome, and be a vector of covariates. A directed acyclic graph describing the causal relationship between those variables is shown in Figure 1, where the exposure exerts an effect on the outcome either through its impact on the mediator or by affecting the outcome directly. The mediation measures have been previously defined under the counterfactual framework.24,25 Specifically, let be the potential values of the mediator when setting the exposure, possibly contrary to fact, to the value . We let be the potential value of the outcome when the exposure and mediator are set to and , respectively. Following Nevo et al,5 the NIE can be defined as: , where is the link function given by the outcome regression model. Common choices of include the identity and log functions when the outcome is continuous and binary, leading to the NIE defined on an identity scale and log risk ratio scale, respectively. The NIE measures the extent to which the conditional mean of the outcome on the scale of the -function would change if the mediator were changed from the level that would be observed under vs but exposure is fixed at level . The NDE, defined as , measures how much the mean of the outcome on the scale of the -function would change if the exposure is set at level vs but the mediator remaining fixed at the value it would have if the exposure was set to . The TE, defined by , is the total of NIE and NDE. Finally, the MP is given by the ratio of NIE and TE, and measure the relative importance of the mediator in explaining the observed exposure-outcome relationship. Throughout, we requires several standard assumptions applied to mediation analysis, including the consistency assumption, the composition assumption, and the following four no unmeasured confounding assumptions: , , , and . Detail explanations of these assumptions are shown in VanderWeele and Vansteelandt.26
FIGURE 1.

Mediation directed acyclic graph, where , and denote the exposure, mediator, outcome, and a vector of covariates that may confound the exposure-outcome, exposure-mediator, and mediator-outcome relationships. The pathway denotes the natural indirect and the pathways denotes the natural direct effect
2.2 |. The difference method
The difference method1,5 is a commonly used approach to evaluate mediation, which considers the following two generalized linear models for the conditional mean of outcome, both without and with inclusion of the mediator in the model:
| (1) |
| (2) |
where is the link function. These two models may be technically incompatible as they target a same response variable, . Jiang and VanderWeele27 and Nevo et al5 show that (1) is compatible with (2) under the following scenarios: (A) Scenario I: is continuous and is linear on the identity link scale (ie, ); (B) Scenario II: is binary and its conditional mean is linear on the log scale (ie, ), and (1) is a good approximation of the marginal mean induced from (2) under the following scenario, (C) Scenario III: is a rare binary outcome and its conditional mean is linear on the logistic link scale (ie, ). The mediation measures, including NIE (originally called the indirect effect), NDE (originally called the direct effect), TE, and MP, were originally defined outside of the counterfactual framework given in Section 2.1. Specifically, the NIE and NDE defined for in changing from to can be represented as functions of the regression parameters and in (1) and (2): and , as shown in Baron and Kenny.1 It follows that and . In this article, and without loss of generality and unless otherwise specified, we set such that the mediation measures are defined for one unit increase of . More recently, Jiang and VanderWeele27 and Nevo et al5 prove that, for either Scenario I, II, or III, the expressions of mediation measures shown above coincide with the mediation measures defined under the counterfactual framework described in Section 2.1, if the consistency, composition, and no unmeasured confounding assumptions hold. In other words, the results given by the difference method have a well-defined causal interpretation under these structural assumptions. Here and throughout, we shall focus on Scenarios I and II, where Scenario III can be seen as a special case of Scenario II by noticing that the logistic link function is a good approximation to the log link function when the outcome is rare.
In a study where the exposure, , is perfectly measured, the observed data consists of independent observations . Henceforth, we shall refer to this study as the main study (MS), in contrast to the validation study introduced below. As shown in Nevo et al,5 the regression coefficients in model (1) and in model (2) can be estimated by separately solving the estimating equations and , where
| (3) |
| (4) |
and are working variances for the error terms, , and , respectively. In Scenario I, we set such that (3) and (4) provide the ordinary least squares estimators. In Scenario II, we set and such that (3) and (4) will be the likelihood scores for and . Once and are obtained, one can substitute and into the expressions for the mediation measures to obtain their corresponding estimators, that is, , , , and . The variance-covariance matrix of can be estimated by the sandwich variance approach, denoted by . Then, the estimated asymptotic variance of the mediation measure estimators can be obtained by the multivariate delta method: , and , where , and . Finally, a -level asymptotic confidence interval for can be obtained as , where can be NIE, NDE, TE, and MP, and is the th quantile for a standard normal distribution.
3 |. DEMYSTIFY THE IMPACT OF EXPOSURE MEASUREMENT ERROR
3.1 |. Measurement error methods
In practice, the true exposure, , may be mismeasured in the main study and, instead, an error-prone surrogate is observed; that is, only , is available. Meanwhile, there is often a validation study for us to characterize the relationship between the true exposure and its surrogate . If the validation study is part of the primary study sample and includes outcome data , we refer to it as an internal validation study (IVS); otherwise, if the validation study is taken from a different set of participants, we refer to it as an external validation study (EVS).19 Specifically, an IVS consists of data , whereas an EVS consists of data . We make the surrogacy assumption such that and to ensure that the surrogate value is not informative for predicting once we know the true exposure . With a MS/EVS design, we further assume transportability such that the conditional distribution of given in the validation samples is same as which would have been observed in the main study to allow that key parameters estimation in the EVS can be validly transported to identify and obtain consistent estimates of the mediation measures.28 This empirically unverifiable assumption is usually reasonable for scenarios when the method of exposure assessment is similar in both study samples. To summarize, in either a MS/IVS or MS/EVS design, we have a total of participants where the first participants are from the main study. Typically, the validation study size, , is much smaller than the main study size, , because the true exposure is much more expensive to measure.
To utilize the validation study data for exposure measurement error correction, the next step is to fit an appropriate measurement error model connecting the true exposure, , with its surrogate, . We assume that the measurement error process can be characterized by the following two models for the true exposure, and , where is a subset of that are predictive of the exposure error process. Here, describes the distribution of conditional on the surrogate exposure and covariates and describes the distribution of conditional on the surrogate exposure , mediator , and covariates . We use and to account for the measurement error-induced bias in (1) and (2), respectively. The unknown parameters, and , can be estimated by solving and , which are assumed to satisfy the conditions for unbiased estimating equations, and . A convenient choice is using the likelihood scores and .
For example, we first consider and follow the linear measurement error models
| (5) |
| (6) |
where and are so called calibration coefficients,29 which measure the associations between and without and with adjustment for the mediator . We may expect and such that the true exposure and its measurement are positively associated. Spiegelman et al19 have shown that the linear measurement error models provide a good fit for the measurement error process of dietary intake data. In Section 8, we observe that the linear measurement error models also provide an adequate fit for the measurement error process for physical activity. The regression coefficients, and can be estimated using the following likelihood scores,
Comparing the above two equations to (3) and (4), we find that the construction of the estimating scores for and are identical to that for outcome regression coefficients and with an identity link function. Therefore, we use the difference method under Scenario I with the outcome and mediator variable replaced by and , respectively, to estimate the regression coefficients, and , in the linear measurement error model. The variance terms, and , can be estimated by the sample variances of the regression residuals. Note that (5) and (6) require that the the measurement error is normally distributed. One can fit measurement error models in the validation study and empirically assess the aspects of the distribution of estimated residuals to explore whether there is evidence suggesting violation of the normality assumption.
3.2 |. Bias of the mediation measure estimators under linear measurement error models
When outcome models (1) and (2) are fit with in place of , then the corresponding mediation measure estimators will be biased and inconsistent. Here, we derive the limiting values of naive mediation measure estimators when the exposure follows linear measurement error models (5) and (6). Let and be naive estimators of the regression coefficients and in (1) and (2) when is used in place of . We define as the naive estimator of NIE, and , and are similarly defined. The following theorem presents the asymptotic relative bias (RelBias) of the naive mediation measure estimators, defined as the ratio of the asymptotic bias and the true mediation measure value:
Theorem 1. For an outcome modeled with either an identity or a log link function (Scenario I or II), and if measurement error models (5) and (6) hold, where ‘ ’denotes convergence in probability. In addition, the relative bias for each mediation measure has an analytical representation given by
Proof of this theorem is given in Appendix A in the Supplementary Material. Clearly, the naive estimators will be unbiased when the calibration coefficients ( and ) are both 1. The biases in the naive estimators have a particular direction when and/or do not equal to 1. Specifically, the naive NIE estimator will converge to a negative relative bias when and , and converge to a positive relative bias when and . The naive NDE and TE estimators will be biased towards the null if and , respectively, and will be biased away from the null if and , respectively. The naive MP estimator will have a negative relative bias when and have a positive relative bias when . Interestingly, the naive MP estimator will also present small relative bias when and MP is close to 1, regardless of the magnitudes of and .
Remark 1. In some cases, the normality assumption in measurement error models (5) and (6) may not hold even though the conditional means given by (5) and (6) are correct. If only the conditional means in (5) and (6) are correct, we show in Appendix B that the probability limits for and and the asymptotic relative bias formulas for mediation measures shown in Theorem 1 still hold exactly under Scenario I and hold approximately under Scenario II when both are small and/or both in the outcome models are small. In other words, when the conditional means in (5) and (6) are true, Theorem 1 still hold in Scenario I regardless of whether the measurement error is normally distributed and Theorem 1 still approximately hold in Scenario II when the measurement error is small and/or the exposure effect on the outcome is not large.
4 |. USING REGRESSION CALIBRATION TO ADDRESS EXPOSURE MEASUREMENT ERROR
We can leverage the idea of regression calibration (more specifically the Rosner-Spiegelman-Willett-type or RSW-type regression calibration30,31) to correct for the measurement error induced bias. As suggested by Rosner, Willett, and Spiegelman,30 we can fit outcome models (1) and (2) based on the surrogate exposure and then bias-corrects the regression coefficients based on the bias formulas in Theorem 1. Specifically, one can construct consistent estimators of and by the following three steps under a MS/EVS design. In step 1, we implement the standard difference method in the main study with as the outcome, exposure, mediator, and a vector of confounders, respectively, to obtain naive estimators of , denoted by . In step 2, we implement a standard difference method in the validation study with as the outcome, exposure, mediator, and a vector of confounders in the outcome model, respectively, to estimate in the measurement error models, denoted by . In step 3, following Theorem 1, a consistent estimator for can be constructed by , where and . The following theorem clarifies the asymptotic properties of , where the proof is deferred in Appendix C of the Supplementary Material.
Theorem 2. Suppose that measurement error models (5) and (6) hold, then is a consistent and asymptotically normal estimator of , under the regularity conditions outlined in Appendix C.1 of the Supplementary Material.
The variance-covariance matrix for consists of two components: the first is the contribution to the variance due to estimating in the main study and the second is the contribution to the variance due to estimating in the validation study. As shown at the end of Appendix C.1 in the Supplementary Material, the variance-covariance matrix of can be consistently estimated by
where and are the variance and covariance estimators for and , which can be obtained from the output from fitting models (3) and (4), and (5) and (6) in a standard software supporting difference method (for example, the R package GEEmediate). Once we obtain with its variance-covariance matrix , we can substitute into the mediation measure expressions to obtain their corresponding point estimators, and finally, we can apply the multivariate delta method introduced at the end of Section 2.2 in to calculate the variance and interval estimators.
In a MS/IVS design, we can further improve the efficiency in estimating by using information on the outcome in the validation study. Similar to Spiegelman et al22 and Shu and Yi,32 we propose a more efficient estimator for through a weighted combination of the two estimators, that is, , where is the estimator for given in Step 3, is the estimator for from applying the difference method on the validation study alone, and are the weights. The following theorem shows that is consistent for any choice of and satisfying the constraint , where is a 2 × 2 identity matrix.
Theorem 3. Suppose that measurement error models (5) and (6) hold and , then is a consistent and asymptotically normal estimator of , under the regularity conditions outlined in Appendix C.2 of the Supplementary Material.
Proof of Theorem 3 is given in Appendix C.2 of the Supplementary Material. Spiegelman et al22 suggested weighting and by the inverse of their variance matrix, that is, and , where and are the estimated variance-covariance matrices for and , respectively. Since and are asymptotically uncorrelated (see Appendix C.3 in the Supplementary Material), the variance-covariance matrix for this inverse-variance weighted estimator, , can be given approximately by . Once we have with its variance-covariance matrix , we can obtain the point, variance, and interval estimators of the mediation measures by the multivariate delta method, as described above. The inverse-variance weight used in leads to the asymptotically most efficient estimator for among all linear combinations of and , as proven in Spiegelmant et al.22 Therefore, is at least as efficient as under a MS/IVS design. An empirical efficiency comparison between and is provided in Appendix C.4 in the Supplementary Material, which suggests that the efficiency loss of is usually non-negligible. Since more efficiently use the information from both the main study and validation study, in this article we shall always use to calculate the mediation measures under a MS/IVS design.
5 |. USING ESTIMATING EQUATIONS TO ADDRESS EXPOSURE MEASUREMENT ERROR
5.1 |. Expected estimating equations
In addition to regression calibration that relies upon the simple results in Theorem 1, we propose an additional method to correct for exposure measurement error using the expected estimating equations, which might improve the efficiency of the mediation measure estimators by making additional distributional assumptions such as in Scenario I we additionally assume the error terms in the outcome models following a common normal distribution. Because we observe in place of in the main study, we cannot compute the complete-data estimating estimation components (1) and (2) from the main study. Instead, Wang and Pepe23 suggested to construct the estimating estimation as the expectation of the complete-data estimating equation conditional on the observed data, referred to as expected estimating equation (EEE), which is unbiased by iterated expectation and depends only upon the observed data. In a MS/IVS design, we use the EEEs for the main study and the complete-data estimating equations for the validation study. Specifically, consider the following estimating equations for and , respectively,
| (7) |
| (8) |
where if the participants is in the validation study (ie, ), if the participants is in the main study (ie, ), and the expectation is taken with respect to the distribution of conditional on . Evaluation of the above observed-data estimating equations involves calculation of expectations of the forms, and , for some functions and . Using the Bayes’ rules and the surrogacy assumption, we can rewrite the expectations as
| (9) |
| (10) |
which are functions of the measurement error models (5) and (6), and the outcome distributions and . Generally, the above expectations do not have explicit solutions but can be numerically calculated by standard method of numerical integration. However, when follows the measurement error models (5) and (6), the above expectations have explicit expressions, which are derived in Appendix D.1 in the Supplementary Material. To calculate (9) and (10), we must fully specify and . With binary data, as in Scenario II, the conditional mean models (1) and (2) fully determine and , as can be seen by noting that and . In Scenario I, however, additional assumptions are needed to specify and . When empirically verifiable, we can set and , where and are given by (1) and (2), and and denote the conditional variances for the outcome in the two models.
Notice that Equation (7) for estimating also depends on (and if Scenario I) and the Equation (8) for estimating also depends on (and if Scenario I). Motivated by the formulation of the estimating equations for estimating and , we propose the following estimating equations for and ,
| (11) |
| (12) |
where and are the components for the complete-data estimating equations for and , respectively. Similarly, the additional parameters and used in Scenario I can be estimated by solving
| (13) |
| (14) |
where and are the complete-data likelihood scores for and , respectively. Calculation of the expected scores in (11) and (13) follow (9) and calculation of the expected scores in (12) and (14) follow (10).
Denote all the unknown parameters as , which includes and for the outcome models (1) and (2), and for the measurement error models and , and the parameters and when relevant (Scenario I). Write all the estimating Equations (7), (8), (11)–(14) as , then can be obtained by solving . We note that can be divided into two groups of estimating equations with no common parameters, where the first group includes (7), (11), and (13) which depend on and the second group includes (8), (12), and (14) which depend on . Therefore, can be consistently estimated by first solving (7), (11), and (13) simultaneously for and then solving (8), (12), and (14) simultaneously for . Typically, each group of estimating equations does not have explicit solutions. In the application and simulation studies, we employed the Newton-Raphson method to numerically find their roots. The following theorem summarizes the asymptotic properties of .
Theorem 4. Assuming that measurement error models (5) and (6) are correctly specified, and for a continuous outcome (Scenario I), further assuming that error terms in outcome models (1) and (2) are normally distributed and homoskedastic, then, is a consistent and asymptotically normal estimator of , under the regularity conditions outlined in Appendix D.2 of the Supplementary Material.
Proof of Theorem 2 is provided in Appendix D.2. The variance-covariance matrix can be consistently estimated by
where and . Once we obtain and , we can extract from and calculate the variance-covariance matrix of based on . Then, the point, variance, and interval estimators of the mediation measures can be obtained by the multivariate delta method shown at the end of Section 2.2.
5.2 |. Reduced expected estimating equations
The EEE approach uses the main and validation studies together to estimate the unknown parameters of the measurement error models, and , as shown in (11) and (8). Alternatively, we could estimate and based on the validation study only, that is, finding and by solving the following reduced estimating equations
| (15) |
| (16) |
respectively and separately. Then, the other parameters in can be estimated by solving their corresponding estimating equations evaluated at and . Specifically, we can obtain by solving (7) and (13), simultaneously, at and obtain by solving (8) and (14), simultaneously, at . We will denote this as the reduced EEE approach, in order to distinguish it with the full EEE approach introduced previous Section 5.1. Under the assumptions outlined in Theorem 4, one can also show that the reduced EEE is also a consistent and asymptotically normal estimator, following similar arguments in Appendix D.2 to prove Theorem 4. Then, the point, variance, and interval estimates of the mediation measures are similar to what we introduced in the previous subsection.
Compared with the full EEE, the reduced EEE can be substantially more computationally convenient, since now we estimate the measurement error model parameters and outcome model parameters separately, in contrast to the full EEE approach, which estimates them simultaneously. However, the statistical efficiency in estimating and might be compromised as we only use the validation study to estimate the measurement error model parameters. In fact, if the associations conditional on and are weak (ie, and ), then the expected scores in (11) and (12), that is, and , are approximately equal to (Appendix D.3 in the Supplementary Material). It follows that (11) and (15) are approximately the same, so are (12) and (16). Therefore, under these circumstances, it is likely that the efficiency loss is minimal. Our simulation studies also confirm that the reduced EEE approach has very similar finite-sample efficiency as compared to the full EEE, and therefore can be considered as a computationally convenient alternative for exposure measurement error correction in mediation analysis.
5.3 |. Extension to the MS/EVS design
The full EEE and reduced EEE can be easily adapted for the a MS/EVS design. In this design, the outcome variable is typically not available in the validation study. Therefore, the components of the complete-data estimating equations , and , which correspond to , and , cannot be evaluated in the validation study. Thus, we must remove the components contributed by the validation study from the proposed estimating equations. Specifically, for both the full and reduced EEE approaches, we remove the term in (7), the term in (8), the term in (13), and the term in (14). Because these resulting estimating equations are still unbiased, we can still use the same procedure described in the previous two sections to calculate the point, variance, and interval estimators of the mediation measures.
6 |. CONNECTIONS BETWEEN REGRESSION CALIBRATION AND EEE
Using the outcome regression (1) and its associated measurement error model (5) as an example, we show in Appendix E the connections among the full EEE, reduced EEE and regression calibration. Specifically, we show that the full EEE is the maximum likelihood estimation for parameters in (1), , and therefore maximizes the efficiency. The reduced EEE does not consider information from the main study for estimating the measurement error model parameters and thus compromises the statistical efficiency. The estimating equations of the regression calibration approach are approximately equal to the estimating equations of the reduced EEE approach when the measurement error is small () and/or the exposure effect on the outcome is small (). Therefore, we can treat regression calibration as an alternative to the reduced EEE that gives approximately the same estimator to the reduced EEE whenever the measurement error is small and the exposure effect is not large.
7 |. SIMULATION STUDIES
We conducted extensive simulations to evaluate the finite-sample performance of the full and reduced EEE, regression calibration, the naive approach, and a gold standard approach, when the outcome is continuous (Scenario I) and binary (Scenario II). The naive approach follows the difference method in the main study treating as the true exposure. The gold standard approach assumes is available in the main study and follows the difference method in the absence of exposure measurement errors. By comparing this estimator to those given by the correction approaches proposed, we can learn how much additional variance and bias are induced from the measurement error on estimation and how close the correction methods get to the situation where this no error at all. The study focuses on the NIE and MP estimators, as these are the most commonly using mediation measures in epidemiology.33 We denote , and to refer to the estimates obtained from the naive approach, the gold standard approach, the full EEE approach, and the reduced EEE approach, respectively, where can be NIE and MP. Also, let be the regression calibration estimator based on and be the regression calibration estimator based on with the inverse-variance weight.
The data generation process is summarized as follows. Throughout, we considered a continuous confounder . The mediator , true exposure , and confounder were generated from a multivariate normal distribution with mean and variance-covariate matrix , where the correlation between the mediator and exposure (ie, ) was chosen from 0.3 to 0.6. The correlation between the confounder and mediator and between the confounder and exposure were fixed to 0.2, which were slightly stronger than the observed correlation coefficients in our illustrative example of HPFS. Given , the surrogate exposure, , was generated from to fix the correlation between the true and surrogate exposure to . We selected to represent weak, moderate, and strong measurement error. In Scenarios I and II, we generated from the following linear and log-binomial regression models,
respectively, where the coefficient for the confounder, , was set to 0.2, and and were chosen as follows. First, we fixed TE, on the identity and log risk ratio scale for Scenarios I and II, to 0.5 and log(1.5), respectively. Then, we chose MP to represent a moderate and high mediation proportion. Finally, by definition we have and , where derivations of both formulas are given in Appendix F in the Supplementary Material. The intercept was set to 0 for Scenario I and was chosen such that the marginal outcome prevalence equaled 10% in Scenario II. We assumed the main study contained 5000 samples (); and the validation study sample size (ie, ) was chosen from 200 and 1000 to represent a moderate and large validation study. For each Scenario, MP, , and considered, we conducted 1000 simulations and compared the mean percent bias, Monte Carlo standard error, and 95% confidence interval coverage rate among the proposed approaches.
We first consider a MS/EVS design, which is also the study design for our data application. The simulation results for the with a continuous (Scenario I) and a binary outcome (Scenario II) are illustrated in Tables 2 and 3, respectively. As expected, the naive approach performs poorly, where the percent bias of is over 59% on average over all combinations of parameters in both Scenarios I and II. The gold standard approach provides approximately unbiased point estimates with confidence interval coverage rates close to the nominal 95%. Comparing across the measurement error correction methods, the full EEE approach usually has the smallest Monte Carlo standard errors, followed by the reduced EEE approach and then regression calibration. All of the proposed methods for measurement error correction substantially reduce bias compared to the naive approach. The reduced EEE and regression calibration achieve negligible bias with nominal confidence interval coverage among all combinations of parameters considered in the simulation. The full EEE approach also leads to minimal bias for a binary outcome (Scenario II), but it tends to provide biased estimates for a continuous outcome (Scenario I) when the validation study was small and measurement error is large ( and ). This result may be driven by the fact that the full EEE approach involves greater computational complexity than the other approaches, thereby requiring larger validation study sizes to provide estimates with small finite-sample bias. We further compare the performance of to other estimators with increased validation study size from 200 to 10 000 in Figure S1 of the Supplementary Material, in the scenario with a continues outcome (Scenario I) and large exposure measurement error . As expected, when the validation study size increases, the percent bias of decreases toward 0 but it does so much more slowly compared to and . For example, the absolute value of the percent bias of at and decreases from 24% at to 11% at and then further drops to 5% at . In contrast, the reduced EEE and regression calibration already produce a percent bias below 5% at . Varying the MP and mediator-exposure association () had relatively smaller influence on the bias of proposed correction approaches, but a larger MP and appears to be associated with a higher bias of NIE estimates. The simulation results of MP estimates for a continuous and binary outcome are provided in Tables S1 and S2 in the Supplementary Material, respectively. The simulation results of MP estimates are generally similar to those for the NIE estimates, but the Monte Carlo standard error for the MP estimate is generally larger as MP is defined as a ratio effect measure.
TABLE 2.
Simulation results of for a continuous outcome (Scenario I) with a MS/EVS design
| Percent bias | SE×100 | Empirical coverage rate | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MP | ||||||||||||||||||
| 200 | 0.2 | 0.3 | 0.75 | −0.5 | −0.1 | −0.1 | −37.4 | −0.3 | 2.61 | 2.71 | 2.71 | 0.90 | 1.08 | 94.6 | 94.4 | 94.4 | 0.0 | 95.2 |
| 0.50 | −8.6 | −0.2 | −0.5 | −70.5 | −0.4 | 3.32 | 5.15 | 5.23 | 0.67 | 1.06 | 95.1 | 95.1 | 95.5 | 0.0 | 95.5 | |||
| 0.25 | −24.3 | −5.4 | 5.5 | −92.4 | −0.1 | 3.51 | 6.81 | 21.30 | 0.32 | 1.07 | 94.6 | 96.5 | 96.5 | 0.0 | 96.0 | |||
| 0.6 | 0.75 | −3.5 | −0.7 | −0.7 | −3.4 | −0.1 | 3.98 | 4.13 | 4.14 | 0.78 | 1.07 | 97.5 | 97.4 | 97.4 | 86.0 | 97.3 | ||
| 0.50 | −21.7 | −1.6 | −2.5 | −48.6 | −0.2 | 5.61 | 8.77 | 9.25 | 0.54 | 1.08 | 95.6 | 96.7 | 97.1 | 0.0 | 95.3 | |||
| 0.25 | −40.0 | −6.3 | 7.1 | −86.1 | 0.0 | 6.15 | 11.17 | 48.90 | 0.28 | 1.17 | 92.6 | 99.5 | 99.9 | 0.0 | 93.7 | |||
| 0.5 | 0.6 | 0.75 | −0.9 | 0.2 | 0.3 | −34.3 | 0.1 | 4.57 | 4.71 | 4.71 | 1.11 | 1.39 | 93.8 | 94.6 | 94.7 | 0.0 | 95.6 | |
| 0.50 | −11.6 | 1.1 | 1.2 | −69.0 | −0.0 | 6.05 | 8.81 | 8.92 | 0.73 | 1.39 | 89.8 | 94.9 | 95.0 | 0.0 | 95.5 | |||
| 0.25 | −31.8 | −6.8 | −1.3 | −92.0 | 0.0 | 7.43 | 12.79 | 46.71 | 0.39 | 1.44 | 66.2 | 94.3 | 94.9 | 0.0 | 94.4 | |||
| 1000 | 0.2 | 0.3 | 0.75 | 0.8 | 0.9 | 0.9 | −36.9 | 0.3 | 1.85 | 1.86 | 1.86 | 0.89 | 1.07 | 95.2 | 95.0 | 95.1 | 0.0 | 95.3 |
| 0.50 | −0.4 | −0.1 | −0.3 | −70.4 | 0.0 | 3.02 | 3.17 | 3.17 | 0.64 | 1.10 | 94.7 | 94.1 | 94.0 | 0.0 | 94.3 | |||
| 0.25 | −10.7 | −2.9 | 0.4 | −92.3 | 0.1 | 4.15 | 5.53 | 7.05 | 0.34 | 1.15 | 97.3 | 96.8 | 96.1 | 0.0 | 93.2 | |||
| 0.6 | 0.75 | −0.3 | 0.0 | 0.0 | −3.4 | 0.2 | 2.53 | 2.54 | 2.54 | 0.85 | 1.15 | 94.6 | 94.5 | 94.4 | 84.4 | 94.8 | ||
| 0.50 | −2.6 | 0.3 | 0.0 | −48.4 | −0.1 | 4.19 | 4.42 | 4.45 | 0.54 | 1.11 | 95.9 | 95.3 | 95.2 | 0.0 | 95.0 | |||
| 0.25 | −22.2 | −5.3 | −2.7 | −86.1 | −0.1 | 5.64 | 7.25 | 10.66 | 0.29 | 1.11 | 96.0 | 98.5 | 97.3 | 0.0 | 94.7 | |||
| 0.5 | 0.6 | 0.75 | −0.2 | 0.0 | 0.0 | −34.3 | 0.1 | 2.85 | 2.86 | 2.86 | 1.10 | 1.46 | 95.1 | 95.1 | 95.1 | 0.0 | 94.3 | |
| 0.50 | −0.9 | −0.0 | 0.0 | −69.0 | −0.1 | 4.81 | 5.03 | 5.04 | 0.79 | 1.39 | 94.6 | 94.5 | 94.4 | 0.0 | 95.8 | |||
| 0.25 | −15.5 | −4.6 | 1.6 | −92.0 | 0.1 | 7.14 | 8.60 | 11.41 | 0.40 | 1.42 | 88.2 | 95.7 | 95.6 | 0.0 | 95.7 | |||
Note: Here, , , , , and denote the NIE estimators given by the full EEE approach, reduced EEE approach, regression calibration approach based on naive approach, and gold standard approach, respectively. , and denote the validation study size, mediation proportion, the correlation between the mediator and exposure, and the correlation between the exposure and its surrogate value, respectively. The percent bias was calculated as the median of the ratio of bias to the true value over 1000 replications, that is, . The standard error (SE) is defined as the square root of empirical variance of mediation measure estimates from the 1000 replications.
TABLE 3.
Simulation results of for a binary outcome (Scenario II) with a MS/EVS design
| Percent bias | SE×100 | Empirical coverage rate | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MP | ||||||||||||||||||
| 200 | 0.2 | 0.3 | 0.75 | −0.5 | −0.3 | −0.4 | −38.0 | −0.2 | 1.73 | 1.72 | 1.73 | 0.79 | 1.34 | 95.1 | 95.1 | 94.8 | 3.6 | 94.1 |
| 0.50 | −2.3 | −2.2 | −2.1 | −70.7 | −0.2 | 2.57 | 2.53 | 2.55 | 0.41 | 1.30 | 96.8 | 96.9 | 96.8 | 0.0 | 94.8 | |||
| 0.25 | −2.9 | −1.8 | −2.2 | −92.4 | −0.7 | 5.24 | 14.81 | 9.14 | 0.16 | 1.29 | 97.5 | 97.2 | 97.4 | 0.0 | 95.7 | |||
| 0.6 | 0.75 | −1.8 | −1.4 | −1.6 | −2.9 | −0.6 | 4.07 | 4.07 | 4.07 | 1.51 | 2.97 | 95.8 | 95.8 | 95.8 | 94.6 | 95.3 | ||
| 0.50 | 3.0 | 3.1 | 4.4 | −48.4 | 1.0 | 6.27 | 6.27 | 6.34 | 0.68 | 3.00 | 96.8 | 96.9 | 97.0 | 0.0 | 95.9 | |||
| 0.25 | −2.2 | −0.8 | 5.6 | −86.4 | −2.6 | 13.07 | 30.46 | 100.22 | 0.19 | 3.09 | 95.3 | 96.0 | 99.9 | 0.0 | 93.7 | |||
| 0.5 | 0.6 | 0.75 | −0.3 | −0.4 | −0.2 | −34.4 | −1.1 | 4.10 | 4.11 | 4.12 | 1.59 | 3.04 | 95.5 | 95.4 | 95.5 | 0.7 | 95.0 | |
| 0.50 | 2.1 | 1.7 | 1.7 | −68.9 | −0.2 | 6.19 | 6.18 | 6.22 | 0.69 | 2.98 | 97.1 | 96.8 | 96.7 | 0.0 | 95.7 | |||
| 0.25 | −1.9 | 0.2 | 3.1 | −92.0 | −0.1 | 14.65 | 21.64 | 28.35 | 0.23 | 3.12 | 95.2 | 95.9 | 98.5 | 0.0 | 94.1 | |||
| 1000 | 0.2 | 0.3 | 0.75 | 1.8 | 1.9 | 1.4 | −36.6 | 1.0 | 1.44 | 1.44 | 1.44 | 0.75 | 1.28 | 95.4 | 95.3 | 95.5 | 4.8 | 94.8 |
| 0.50 | −1.5 | −1.5 | −1.9 | −70.6 | −1.3 | 1.91 | 1.91 | 1.90 | 0.39 | 1.27 | 95.1 | 94.9 | 94.9 | 0.0 | 95.5 | |||
| 0.25 | 1.8 | 1.8 | −0.5 | −92.4 | 0.9 | 3.58 | 3.55 | 3.68 | 0.16 | 1.29 | 97.8 | 97.4 | 97.1 | 0.0 | 95.6 | |||
| 0.6 | 0.75 | −1.0 | −1.0 | −1.0 | −4.4 | −2.4 | 3.81 | 3.81 | 3.81 | 1.53 | 3.04 | 94.0 | 93.9 | 93.8 | 94.1 | 95.3 | ||
| 0.50 | −1.0 | −1.0 | −1.0 | −49.2 | −1.8 | 5.41 | 5.40 | 5.40 | 0.67 | 3.08 | 94.3 | 94.4 | 94.5 | 0.0 | 95.1 | |||
| 0.25 | 1.9 | 1.9 | 4.4 | −86.2 | −1.8 | 9.54 | 9.55 | 10.34 | 0.20 | 3.17 | 93.0 | 93.2 | 97.7 | 0.0 | 93.8 | |||
| 0.5 | 0.6 | 0.75 | −0.6 | −0.7 | −0.7 | −34.8 | −0.5 | 3.82 | 3.83 | 3.83 | 1.58 | 3.13 | 95.1 | 95.0 | 95.1 | 1.0 | 94.7 | |
| 0.50 | 1.6 | 1.6 | 1.4 | −68.9 | 1.4 | 5.50 | 5.50 | 5.53 | 0.72 | 2.98 | 95.4 | 95.3 | 94.9 | 0.0 | 95.5 | |||
| 0.25 | 2.5 | 2.5 | 2.9 | −92.0 | −0.2 | 10.55 | 10.49 | 11.24 | 0.23 | 3.10 | 94.8 | 95.2 | 97.6 | 0.0 | 95.3 | |||
Note: Here, , , , , and denote the MP estimators given by the full EEE approach, reduced EEE approach, regression calibration approach based on , naive approach, and gold standard approach, respectively. , and denote the validation study size, mediation proportion, the correlation between the mediator and exposure, and the correlation between the exposure and its surrogate value, respectively. The percent bias was calculated as the median of the ratio of bias to the true value over 1000 replications, that is, . The standard error (SE) is defined as the square root of empirical variance of mediation measure estimates from the 1000 replications.
Then, we investigate the proposed approaches under a MS/IVS design. The data generation process is almost identical to that under a MS/EVS design, but we assumed the outcome information was available in the validation study. Since is more efficient than under a MS/IVS design as we demonstrate in Section 4 and Appendix C.4, we only present the results of here. The results are shown in Tables S3 and S4 in the Supplementary Material for a continuous and binary outcome, respectively. All of the full EEE, the reduced EEE and the regression calibration provide small bias with nominal coverage, even with a small validation study size .
The previous simulation studies consider measurement error models (5) and (6) with homoscedastic normal error terms. Additional simulation studies show that all of the proposed measurement error correction approaches have relatively robust performance when either the normality assumption or homoscedasticity assumption in the measurement error models are moderately violated. Full details of these additional simulations can be found in Appendix G in the Supplementary Material.
Theorems 2–4 require that, for the full and reduced EEE approaches, the error terms of the outcome model in Scenario I are normally distributed and homoskedastic, whereas regression calibration does not place any distributional assumptions on these error terms. Additional simulations described in Appendix H of the Supplementary Material suggest that the EEE approaches are relatively insensitive to the violation of either the normality or homoskedasticity assumptions in the outcome models in Scenario I, although these assumptions are required to construct the expected estimating equations.
8 |. APPLICATION TO THE THE HEALTH PROFESSIONALS FOLLOW-UP STUDY (HPFS) DATA
We applied the proposed approaches to an analysis of a large prospective cohort of US men, the HPFS.34 The HPFS began in 1986, when 51 529 male health professionals, aged 40 to 75 years, completed a baseline questionnaire providing information about physical activity, diet, lifestyle, and medical history. Biannual follow-up questionnaires have been retrieved by more than 90% of the participants. Chomistek et al20 showed that physical activity was associated with decreased risk of cardiovascular diseases (CVD) in HPFS. Here, we investigated the extent to which the effect of physical activity on CVD risk is direct and to what extent that effect is mediated by body mass index (BMI).
Starting from 1986, physical activity was assessed in biannual questionnaires on average time per week spent on 10 common activities, including walking, jogging, bicycling and so forth during the past year. Then, the total MET-hours per week (MET h wk−1)) was calculated to measure total physical activity, which is defined as the time spent at each activity in hours per week multiplied by its MET score and then summed over the 10 activities.21 In our analysis, the exposure and mediator were defined as physical activity (MET h wk−1)) and BMI (kg/m2) at baseline, where both were treated as continuous. After excluding men with a history of CVD or whose physical activity or BMI data were missing at baseline, a total 43 547 individuals were included in this analysis, among whom 6330 (14.5%) of them developed CVD between 1986 to 2016. We adjusted for all baseline covariates considered by Chomistek et al20 as potential confounders, where a list of confounders are shown in Table 4.
TABLE 4.
The extent to which the effect of physical activity on cardiovascular diseases incidence is mediated by body mass index, , 1986–2016
| Method | TE | NIE | MP |
|---|---|---|---|
| Naive | −0.018 (0.005) | −0.007 (0.001) | 0.408 (0.099) |
| Full EEE | −0.084 (0.013) | −0.044 (0.017) | 0.520 (0.273) |
| Reduced EEE | −0.062 (0.026) | −0.028 (0.009) | 0.450 (0.125) |
| Regression calibration | −0.062 (0.025) | −0.027 (0.009) | 0.448 (0.121) |
Note: The NIE and TE were defined in a log risk ratio scale for a 10 METs h wk−1 increase. The numbers in the brackets denote the standard errors of the point estimator. The confounders considered in the mediation analysis include age (years), smoking status (current/past/never), parental history of myocardial infarction and cancer at or before 60 years old (yes/no), aspirin use (yes/no), vitamin E supplement use (yes/no), intake of polyunsaturated fat, trans fat, eicosapentaenoic acid and docosahexaenoic acid (g/day), alcohol intake (yes/no), and diabetes (yes/no), and hypertension (yes/no).
The questionnaire measured physical activity with some degree of error and was validated by physical activity diaries. In the HPFS validation study,21 physical activity data from 238 participants were measured using both the questionnaires and the more accurate diaries, which served as an EVS in this example. We considered using measurement error models (5) and (6) to describe the physical activity measurement error process. As a preliminary step, we assessed the validity of the measurement error models by fitting them in the validation study, adjusting for the aforementioned covariates. An empirical check on QQ-plots (Figure S2 in the Supplementary Material) for the regression residuals indicated little evidence for violation of the normality assumption. The calibration coefficients were and . Since , we expect that the naive NIE, NDE, and TE estimates will be biased toward the null, given the results in Section 3.2. In addition, because and are similar, bias in the MP naive estimator may be small.
Next, we proceed to the mediation analysis. Tables S5 and S6 in the Supplementary Material present the point estimates with their standard errors of the outcome regression coefficients given by the full and reduced EEE, regression calibration, and the naive approach as a benchmark, which implemented the difference method in the HPFS main study treating the questionnaire-based physical activity variable as the true exposure. Table 4 presents results of , and . The and were given in a log risk ratio scale for 10 METs h wk−1) increase. All methods indicated that physical activity exerted a protective effect against CVD incidence, but the and given by the naive approach appeared to be severely attenuated towards null. For example, the given by the naive approach was −0.007, corresponding to a risk ratio of 0.993 for 10 MET h wk−1) increase in physical activity. In the full and reduced EEE approaches and regression calibration approach, stronger NIEs were observed, with risk ratios at 0.956, 0.972, and 0.973, respectively. The MP given by the naive approach was also found to be slightly underestimated. The naive approach indicated that about 41% of the effect of physical activity on CVD risk was mediated by BMI. The proposed correction approaches provided slightly higher ; the full EEE, reduced EEE, and regression calibration approaches show that , and 45%, respectively.
9 |. DISCUSSION
In this article, we propose approaches to correct for exposure measurement error for estimating mediation measures using the difference method, a commonly used regression-based approach for mediation analysis that also bears a causal interpretation under the structural assumptions outlined in Section 2.1. We assume a main study/validation study framework where the validation study enables us to estimate, rather than assuming model parameter values, for the relationships between the true exposure and mismeasured measurements. Under measurement error models (5) and (6), we derive formulas for the bias of naive estimators of the mediation measures in the presence of exposure measurement error. The formulas show that the bias of naive estimators depends on the calibration coefficients and , where and are associations between the true exposure and its error-prone counterpart without and with conditional on the mediator level, respectively. We show that NIE, NDE, and TE estimators are typically biased when and but the MP estimator can provide minimal relative bias when and MP is not small regardless of the extent of the measurement error.
Measurement error models (5) and (6) describe the distributions of the true exposure conditional on its surrogate and other variables, which is a Berkson-type measurement error model.35 Another class of measurement error model is the classic measurement error models (see, for example, Chapter 2 in Carroll35), which includes the commonly-used classic additive measurement error model as a special case. Below we show that the Berkson-type measurement error model used in this article is equivalent to the classic additive measurement error model under certain parametric assumptions. Specifically, the classic additive measurement error model assumes , where is a zero-mean error term due to imperfect measurement. If we assume that follows a normal distribution with a common variance and the mediator-exposure relationship follows a linear regression with a normal error term such that , then one can verify that measurement error models (5) and (6) still hold. Thus, under the aforementioned assumptions, the proposed correction methods are still valid even if the true data generating mechanism follows the classic additive measurement error model.
Among the proposed approaches, the full EEE is most efficient but is computationally more intensive as the parameters in the outcome model and measurement error models are estimated simultaneously. The proposed reduced EEE approach improves the computational efficiency by solving for the outcome model parameters and measurement error model parameters, separately. In practice, alternative reduced EEE approaches can be developed to reduce the computational complexity. For example, in the outcome model EEEs, (7) and (8), one can take the expectations of over and , respectively, without conditional on the outcome variable . The resulting estimating equations are still unbiased but we will simplify calculation for the conditional expectations in (9) and (10) since now the outcome densities are no longer included in the integrals. We shall evaluate the performance of this new reduced EEE approach in the future. Example R code for implementing the proposed approaches is available at https://github.com/chaochengstat/mediate_error.
We evaluated the empirical performance of the proposed methods via Monte Carlo simulations. We found that the full EEE approach maximized efficiency compared to the reduced EEE and regression calibration methods, but the efficiency difference was usually moderate to minimal when the measurement error was not too large. The reduced EEE and regression calibration approaches provide small bias and nominal coverage among all scenarios considered in the simulation study. The full EEE also provides asymptotically unbiased estimates under a MS/IVS design; however, under a MS/EVS design with a continuous outcome, the full EEE approach can require unrealistic large validation study sizes ( if measurement error is large) to ensure small finite-sample bias. This is somewhat expected because prior work in measurement error correction (developed for association analysis rather mediation analysis) indicated that more sophisticated approaches may lead to larger finite-sample bias or variance compared to simpler approach such like regression calibration under a MS/EVS design. For example, simulations in Spiegelman et al19 showed that the maximum likelihood estimator performed poorly with large bias under a MS/EVS design and therefore suggested regression calibration as a computationally simpler alternative under the MS/EVS design. Our simulation results reinforced that recommendation for mediation analysis, where the reduced EEE and regression calibration methods are preferable under a MS/EVS design and when the measurement error is expected to be non-trivial. For the MP estimates, we observed that regression calibration, reduced EEE, and full EEE approaches sometimes provide large Monte Carlo standard errors when the measurement error was large (). This is because the MP is defined as the ratio of NIE and TE and therefore can have more uncertainty as compared to other mediation measures estimated on the additive or difference scale. When the measurement error was large, we observed that the occasionally had very close to 0 values in several Monte Carlo replicates, leading to large Monte Carlo variances for estimating MP since in those replicates. Therefore, the large Monte Carlo standard error was driven by several extreme simulation replicates. Therefore, we interpret the large empirical variance for estimating MP with caution.
We introduced two assumptions in Section 3.1 regarding the measurement error process, including (i) the transportability assumption in a MS/EVS design such that relevant parameters in the validation study and used for bias correction can reasonably be assumed to be the same as those that produced the surrogate exposure in the main study, and (ii) surrogacy assumption such that the is independent of the outcome conditional on the true exposure and covariates. In our analysis of the HPFS, the transportability assumption is considered plausible because validation study participants are members draw from the same target population with HPFS and both studies shared the same method of physical activity assessment. The surrogacy assumption cannot be empirically verified in the HPFS dataset, although this is a common assumption in the measurement error correction literature. If the surrogacy assumption is violated, then one may need to conduct sensitivity analysis and assess the impact under certain departures from surrogacy assumption. Developing such sensitivity analysis strategy under the context of mediation analysis is beyond the scope of this article but remains a fruitful direction for future research.
Regression calibration can be easily implemented, where its point estimators can be obtained by any standard software supporting a difference method. This article provides closed-form formulas on how to calculate consistent variance estimators for the regression calibration in Section 4. Comparing to EEE approaches that requires full distribution assumptions in the outcome models and measurement error models, the regression calibration requires fewer parametric assumptions (not requiring the full distributional assumptions in the outcome models) and appears to be fairly robust; furthermore it is also approximately consistent even if the the normality assumptions in the measurement error models are violated (see Remark 1).
Supplementary Material
ACKNOWLEDGEMENTS
This work is funded by the NIH Grant DP1ES025459. Chao Cheng is grateful to the American Statistical Association, Section on Statistics in Epidemiology Student Paper Award Committee for receiving a 2022 JSM Young Investigator Award based on an earlier version of this article.
Funding information
National Institute of Environmental Health Sciences, Grant/Award Number: DP1ES025459
Footnotes
SUPPORTING INFORMATION
Additional supporting information can be found online in the Supporting Information section at the end of this article.
DATA AVAILABILITY STATEMENT
The HPFS is not publicly available due to ethical restrictions. Data requests may be directed to the first author.
REFERENCES
- 1.Baron RM, Kenny DA. The moderator–mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol. 1986;51(6):1173–1182. [DOI] [PubMed] [Google Scholar]
- 2.MacKinnon DP. Introduction to Statistical Mediation Analysis. New York: Routledge; 2012. [Google Scholar]
- 3.VanderWeele T. Explanation in Causal Inference: Methods for Mediation and Interaction. Oxford: Oxford University Press; 2015 [Google Scholar]
- 4.Jiang Z, VanderWeele TJ. Causal mediation analysis in the presence of a mismeasured outcome. Epidemiology. 2015;26(1):e8–e9. [DOI] [PubMed] [Google Scholar]
- 5.Nevo D, Liao X, Spiegelman D. Estimation and inference for the mediation proportion. Int J Biostat. 2017;13(2):20170006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cheng C, Spiegelman D, Li F. Is the product method more efficient than the difference method for assessing mediation? Am J Epidemiol. 2022;192:84–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Thomas D, Stram D, Dwyer J. Exposure measurement error: influence on exposure-disease relationships and methods of correction. Annu Rev Public Health. 1993;14(1):69–93. [DOI] [PubMed] [Google Scholar]
- 8.Cessie IS, Debeij J, Rosendaal FR, Cannegieter SC, Vandenbrouckea JP. Quantification of bias in direct effects estimates due to different types of measurement error in the mediator. Epidemiology. 2012;23:551–560. [DOI] [PubMed] [Google Scholar]
- 9.VanderWeele TJ, Valeri L, Ogburn EL. The role of measurement error and misclassification in mediation analysis: mediation and measurement error. Epidemiology. 2012;23(4):561–564. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Valeri L, Lin X, VanderWeele TJ. Mediation analysis when a continuous mediator is measured with error and the outcome follows a generalized linear model. Stat Med. 2014;33(28):4875–4890. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Zhao S, Prentice RL. Covariate measurement error correction methods in mediation analysis with failure time data. Biometrics. 2014;70(4):835–844. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Ssenkusu JM. Mediation Analysis in Longitudinal Studies in the Presence of Measurement Error and Missing Data [Ph.D. thesis]. Minneapolis: University of Minnesota; 2018. [Google Scholar]
- 13.Fulcher IR, Shi X, Tchetgen EJT. Estimation of natural indirect effects robust to unmeasured confounding and mediator measurement error. Epidemiology. 2019;30(6):825–834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Gaynor SM, Schwartz J, Lin X. Mediation analysis for common binary outcomes. Stat Med. 2019;38(4):512–529. [DOI] [PubMed] [Google Scholar]
- 15.Ogburn EL, VanderWeele TJ. Analytic results on the bias due to nondifferential misclassification of a binary mediator. Am J Epidemiol. 2012;176(6):555–561. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Valeri L, Vanderweele TJ. The estimation of direct and indirect causal effects in the presence of misclassified binary mediator. Biostatistics. 2014;15(3):498–512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Valeri L, Reese SL, Zhao S, et al. Misclassified exposure in epigenetic mediation analyses. Does DNA methylation mediate effects of smoking on birthweight? Epigenomics. 2017;9(3):253–265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Jiang Z, VanderWeele T. Causal mediation analysis in the presence of a misclassified binary exposure. Epidemiol Methods. 2019;8(1):20160006. [Google Scholar]
- 19.Spiegelman D, Rosner B, Logan R. Estimation and inference for logistic regression with covariate misclassification and measurement error in main study/validation study designs. J Am Stat Assoc. 2000;95(449):51–61. [Google Scholar]
- 20.Chomistek AK, Cook NR, Flint AJ, Rimm EB. Vigorous-intensity leisure-time physical activity and risk of major chronic disease in men. Med Sci Sports Exerc. 2012;44(10):1898–1905. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Chasan-Taber S, Rimm EB, Stampfer MJ, et al. Reproducibility and validity of a self-administered physical activity questionnaire for male health professionals. Epidemiology. 1996;7:81–86. [DOI] [PubMed] [Google Scholar]
- 22.Spiegelman D, Carroll RJ, Kipnis V. Efficient regression calibration for logistic regression in main study/internal validation study designs with an imperfect reference instrument. Stat Med. 2001;20(1):139–160. [DOI] [PubMed] [Google Scholar]
- 23.Wang CY, Pepe MS. Expected estimating equations to accommodate covariate measurement error. J R Stat Soc B Stat Methodol. 2000;62(3):509–524. [Google Scholar]
- 24.Pearl J. Direct and Indirect Effects. Burlington: Morgan Kaufmann; 2001:411–420. [Google Scholar]
- 25.Robins JM, Greenland S. Identifiability and exchangeability for direct and indirect effects. Epidemiology. 1992;3:143–155. [DOI] [PubMed] [Google Scholar]
- 26.VanderWeele TJ, Vansteelandt S. Conceptual issues concerning mediation, interventions and composition. Stat Interface. 2009;2(4):457–468. [Google Scholar]
- 27.Jiang Z, VanderWeele TJ. When is the difference method conservative for assessing mediation? Am J Epidemiol. 2015;182(2):105–108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Yi GY, Ma Y, Spiegelman D, Carroll RJ. Functional and structural methods with mixed measurement error and misclassification in covariates. J Am Stat Assoc. 2015;110(510):681–696. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Kioumourtzoglou MA, Spiegelman D, Szpiro AA, et al. Exposure measurement error in PM2.5 health effects studies: a pooled analysis of eight personal exposure validation studies. Environ Health. 2014;13(1):1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Rosner B, Willett W, Spiegelman D. Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. Stat Med. 1989;8(9):1051–1069. [DOI] [PubMed] [Google Scholar]
- 31.Rosner B, Spiegelman D, Willett WC. Correction of logistic regression relative risk estimates and confidence intervals for measurement error: the case of multiple covariates measured with error. Am J Epidemiol. 1990;132(4):734–745. [DOI] [PubMed] [Google Scholar]
- 32.Shu D, Yi GY. Causal inference with measurement error in outcomes: bias analysis and estimation methods. Stat Methods Med Res. 2019;28(7):2049–2068. [DOI] [PubMed] [Google Scholar]
- 33.Cheng C, Spiegelman D, Li F. Estimating the natural indirect effect and the mediation proportion via the product method. BMC Med Res Methodol. 2021;21(1):1–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Choi HK, Atkinson K, Karlson EW, Curhan G. Obesity, weight change, hypertension, diuretic use, and risk of gout in men: the health professionals follow-up study. Arch Intern Med. 2005;165(7):742–748. [DOI] [PubMed] [Google Scholar]
- 35.Carroll RJ, Ruppert D, Stefanski LA, Crainiceanu CM. Measurement Error in Nonlinear Models: A Modern Perspective. Boca Raton: Chapman and Hall/CRC; 2006. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The HPFS is not publicly available due to ethical restrictions. Data requests may be directed to the first author.
