Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 Apr 23.
Published in final edited form as: Multivariate Behav Res. 2012 Oct 20;47(5):697–716. doi: 10.1080/00273171.2012.715557

Modeling Time-Dependent Association in Longitudinal Data: A Lag as Moderator Approach

James P Selig 1, Kristopher J Preacher 2, Todd D Little 3
PMCID: PMC3997054  NIHMSID: NIHMS530097  PMID: 24771950

Abstract

We describe a straightforward, yet novel, approach to examine time-dependent association between variables. The approach relies on a measurement-lag research design in conjunction with statistical interaction models. We base arguments in favor of this approach on the potential for better understanding the associations between variables by describing how the association changes with time. We introduce a number of different functional forms for describing these lag-moderated associations, each with a different substantive meaning. Finally, we use empirical data to demonstrate methods for exploring functional forms and model fitting based on this approach.


Whenever variables are measured at different times, it is possible to examine how individual differences on a variable measured at one occasion are related to individual differences on another variable (or perhaps the same variable) measured at a later occasion. Such examinations are at the heart of longitudinal studies utilizing panel designs (Little, Preacher, Selig & Card, 2007; Little, in press). The magnitude of a relationship between variables measured at different occasions will often depend upon the amount of time that elapses between measurement occasions (i.e., the lag between occasions). Our goal is to promote an approach to analyzing longitudinal data that focuses on change in the degree of association between two variables as a function of the time between measurement occasions. In this approach, a time-dependent association is modeled using a regression model with a statistical interaction term describing how association changes as a function of the lag between occasions.

We refer to such functional relationships as time-dependent associations; to illustrate, consider the following multiple regression equation:

Y^i=b0+b1Xi+b2Lagi+b3Lagi×Xi. (1)

In this equation the variables X and Lag, and the product of X and Lag, are used to predict Y. Lag represents the amount of time that passes between the first and second measurement occasions. Both X and Lag are free to vary between persons. The regression coefficients can be interpreted as: b0 is the expected value for Y when both X and Lag equal zero; b1 is the expected change in Y for a one unit change in X when Lag = 0; b2 is the expected change in Y for a one unit change in Lag when X = 0; and b3 is the expected change in the linear relationship between X and Y for a one unit change of Lag. If there is theory supporting a particular lag as being important, the Lag variable can be centered so that the b1 coefficient can be interpreted as expected change in Y for a one unit change in X at that lag.

This regression model (Equation 1) and the other models we present to illustrate the lag as moderator (LAM) approach fall under the broad heading of longitudinal regression models. For simplicity, we focus on two variables measured at two occasions. Our goal is to illustrate a novel approach to modeling time-dependent associations. The research design necessary for these models assumes the amount of time passing between occasions of measurement varies between persons. We will refer to this as a variable-lag design and contrast it with the fixed-lag design, in which the amount of time that elapses between occasions of measurement is the same for all participants. The LAM approach carries the same assumptions as longitudinal panel models, which focus on the analysis of individual differences. Among the assumptions required for these models are that the lag moderation of any associations is constant for all persons.

We believe the LAM approach is a useful tool for describing how the strength of an association changes as a function of lag. In this regard, the LAM approach is mute about the causal influence of one variable on another and how that causal influence may change over time. The assumptions needed for causal inference and the possibility of using the LAM approach in this context will be addressed briefly in the discussion.

Previous Relevant Work

The idea of studying time-dependent association, or lag moderated associations between two or more variables, rests on the assumption that an association changes as a function of the time between measurements. Such lag dependent associations have long been of interest to methodologists. Early descriptions of panel models (both path and structural models) address the importance of lag choice (Heise, 1970; Shingles, 1985; Wright, 1960). Pelz and Lew (1970) report a simulation showing that the estimated effect of one variable on another fluctuates with the choice of time lag. In one example, they show that not only will the magnitude of an effect vary with choice of time lag, but the estimated direction of influence can also vary such that an effect that is simulated to be positive will be estimated as a negative effect for some time lags. Gollob and Reichardt (1987, 1991; Reichardt & Gollob, 1986) examine this issue as it relates to causal models and mediation models. Gollob and Reichardt emphasize the importance of choosing a particular lag and how this choice can affect one’s results. Cohen (1991) highlights this issue by noting that poorly choosing a lag for an important covariate in a study could serve to bias estimates of other focal parameters in a model. Collins and Graham (2002) provide a description of the effects of the choice of time lag in the context of a study on alcohol and drug use. Cole and Maxwell (2003; Maxwell & Cole, 2007) offer a thorough description of the importance of lag choice in studies of mediation. More recently, the importance of choosing lags has been re-emphasized in planning longitudinal studies to detect the relation between risk factors and outcomes (Cole & Maxwell, 2009) and when either cross-sectional data, or longitudinal data collected at an incorrect lag are used to model a longitudinal mediation process (Maxwell, Cole, & Mitchell, 2011; Reichardt, 2011).

The most common response to the issue of lag dependent association has been the recommendation that investigators carefully choose lags when designing a study – lag choice should be informed by theory and prior findings. Others have moved beyond these admonitions, however, and pursued paths closer to those we will endorse (e.g., use of variable lag designs, or explicitly modeling change in effects that are due to lag). McArdle and Woodcock (1997) used a variable lag design in the context of latent growth modeling to model trajectories of change using only two data points from each participant. Econometricians sometimes address the issue of time-dependent covariation by using the Distributed Lag Model (see, e.g., Hsiao, 1986). This model uses time series data to examine change in the effect of one variable on another across different lag lengths. Finally, Wang, Zhang, and Estabrook (2010) describe an approach that uses fixed lag panel data and an assumption of stationary effects to examine changing effects over time. Our unique proposal is to use longitudinal regression models in conjunction with variable lag panel data to explicitly model how an association changes with increasing time between measurements.

LAM Perspective

Studies describing the potential for lag dependent associations usually alert researchers to the possibility that a poor choice of lag may lead to biased results. This bias is based on an assumption that some true effect exists at a particular lag and using a lag other than the one associated with the true effect will result in an incorrect estimate of the effect. Analyses based on the LAM approach could be used to better choose an optimal lag for a study using fixed lags; however, such use of the LAM approach rests on the assumptions that the model is properly specified both in terms of the variables included and the chosen functional form.

When there is no support for the assumptions required for causal inference, we believe there remains much to be learned from adopting the LAM approach in a descriptive fashion. For example, if the goal is to understand how and when variables are related, the idea of bias due to choosing the wrong lag is not as useful. Instead, any estimated association may be a useful description of the association at a particular lag. Gollob and Reichardt (1987, p. 82) constructively argue that, “Because different time lags have different effects, one must study many different lags to understand causal effects fully.” Reichardt (2011, p. 850) further argues against the idea of “correct or incorrect time lags for estimating effects.” Explicitly modeling the lag-dependency of longitudinal associations is a means to better understand them. Although the LAM approach alone cannot insure proper causal inference, examining how a bivariate relation changes as a function of the lag between measurements may offer new insight into how one variable covaries with another—an insight that could not be gained using a single fixed lag.

Models Utilizing the LAM Approach

We introduced a multiple regression model (Equation 1) as a first illustration of the LAM approach. Such a model, of course, will not be useful for many longitudinal studies in which multiple predictors and criteria are measured, but it serves here as an introduction. In general, the LAM approach can be adapted for use in any statistical model that can accommodate a moderator variable. A key difference between the proposed model and many other models for the analysis of panel data is that lags are free to vary between persons and not fixed to a value that is assumed to be the same for each individual.

When treating lag as a variable, the possible values for lag can range from very small values that indicate only a short amount of time passed after the initial assessment, to a value that is equal to the total duration of the study. By necessity the researcher will choose lower and upper bounds for the lag variable, but in principle all values within those bounds can be used. For practical purposes and due to the potential difficulty of collecting data from individuals at any possible lag between the beginning and end of a study, it may be necessary to use a limited set of such lag values that well represents the range of possible lags, but limits data collection to a reasonable number of occasions. In many instances, randomly assigning lags to participants will be advantageous. Here, the bounds for the longest and shortest possible lags are controlled and the probability of receiving any particular lag is the same across all participants. This strategy would minimize a correlation between lag and the focal predictor or potential confounding lag length with other background characteristics.

Functional Forms for Lag Moderation

Thus far we have focused on linear change in the XY relationship; however, many associations may change in a nonlinear fashion. For example, Wright (1960, p. 423) hypothesized that the effect of one variable on another is not static and such an effect “…in most cases rises gradually to a peak and then gradually falls off…” Analysis of changing effects from specific types of models for panel data by Cole and Maxwell (2003) and Pelz and Lew (1970) also suggest that nonlinear forms may be expected when modeling change in effects due to lag. Many authors have used graphics to illustrate hypothetical patterns of change in effects over time, which are often nonlinear in nature (e.g., Kelly & McGrath, 1988; Mitchell & James, 2001). Despite the fact that these nonlinear forms were based on conjecture or the analysis of hypothetical models, it is clear that nonlinear forms are expected. Of course many nonlinear forms can be well approximated by straight lines when the span of lags is small.

Given that nonlinear moderation is possible, it would be useful to find models capable of describing such moderation. Our goal in the following section is to begin an examination of different statistical models that could be used to represent such patterns of changing associations. Nonlinear change can be modeled using polynomial regression models such as:

Y^i=b0+b1Xi+b2Lagi+b3Lagi2+b4Lagi×Xi+b5Lagi2×Xi. (2)

The moderating effect of Lag in this model may be best understood by rearranging the equation to highlight the simple effect of X on Y. Equation 3 is arranged to show two compound coefficients representing the simple intercept and simple slope for the XY relationship.

Y^i=[b0+b2Lagi+b3Lagi2]+[b1+b4Lagi+b5Lagi2]Xi. (3)

The three simple coefficients composing the compound simple slope can be interpreted as: b1 is the expected relation between X and Y when Lag is zero; b4 describes the expected linear change in the effect of X on Y for a one-unit increase in Lag where Lag = 0; and b5 describes the expected quadratic change in the effect of X on Y for a one-unit increase in Lag. Additional polynomial regression models could be used to describe even more complex functional forms for moderation by lag. In practice, however, the number of estimated parameters and the interpretability of those parameters become problematic. Cudeck and du Toit (2002) discuss the potential difficulty of interpreting parameters from the quadratic model and suggest an alternative parameterization that has more interpretable parameters:

Y^i=αY-(αY-α0)(XiαX-1)2. (4)

In this model, α0 represents the value of Yi when Xi is 0, αX represents the value of Xi at which Yi reaches its maximum (or minimum, depending upon the particular quadratic form), and αY represents the maximum (minimum) value of Yi. Through substitution into a simple regression model, the moderating effect of lag can be expressed using this reparameterized model. For example, if we describe the simple relationship between X and Y as:

Y^i=b0+b1Xi, (5)

the dependence of the b1 coefficient on values of Lagi can be expressed with the following adaptation of Cudeck and du Toit’s model:

b1=αYX-(αYX-α0)(LagiαLag-1)2. (6)

Now α0 is the expected effect of Xi on Yi when Lagi is 0, αLag is the value of Lagi at which the maximum (or minimum) effect of Xi on Yi is obtained, and αYX is the maximum (minimum) effect of Xi on Yi. The changes in subscripts are meant to highlight the fact that the quadratic model is now used to describe the effect of Lag on the complex simple slope rather the effect of X on Y. By substituting Equation 6 into Equation 5 we have:

Y^i=b0+[αYX-(αYX-α0)(LagiαLag-1)2]Xi. (7)

As pointed out by Cudeck and du Toit (2002), this form of the quadratic model is nonlinear in its parameters and must be estimated using nonlinear regression methods, which are readily available in most standard software suites (e.g., SPSS, SAS, and R).

A possible limitation of a quadratic model is that it implies that an effect will either increase to a maximum and then decline, or decrease to a minimum then increase. For some applications this functional form may not be reasonable. For example, if we examine the effect of years of education on future earnings, it could make sense to have the effect increase with the passage of time, meaning that the earnings gap between those with more education and those with less education widens with time. It would be odd if, with the passage of sufficient time, this gap reached a maximum and then began to close. In such situations, an exponential function, that increases or decreases to an asymptote, may be profitably used. The previous method of substitution to create a model where lag moderates the focal relationship can also be used for the exponential model. This model could be based on an exponential function like the following described by Sit and Poulin-Costello (1994):

Y=aebX. (8)

In this expression, a is the effect of X on Y when X = 0, and b describes the shape of the exponential relationship between X and Y. When b > 0, the curve approaches the horizontal asymptote as X decreases, and when b < 0, the curve approaches the horizontal asymptote as X increases. The horizontal asymptote occurs when Y = 0. The functional form in Equation 8 may be introduced into a nonlinear regression model by defining b1, the effect of X on Y from a simple regression model, to be a function of lag, so that:

b1=aebLagi. (9)

By substitution, the regression model for Yi would be:

Y^=b0+(aebLagi)X. (10)

Although the parameters of the LAM exponential model are not as readily interpretable as those from Cudeck and du Toit’s (2002) quadratic model, this model may be preferred if it describes the moderating effect of lag better than the quadratic model.

Other functional forms

The four LAM regression models in equations 1, 2, 7, and 10 allow the effect of X on Y to change in a variety of ways. These models are not meant to constitute an exhaustive list. The context of lag-moderated associations and future investigations of the performance of different models for lag moderation should determine the most appropriate model. For example, the effect of an intervention on an outcome may follow an S-shaped or sigmoidal functional form, such that the intervention effect is minimal at very short lags and increases to a maximum value as lag increases. Such a form could be captured by expressing the b1 coefficient from Equation 5 as function of lag using either a logistic or Gompertz function. We can assume that the effect of some interventions may fade even within the window of observation of a particular study; therefore, functional forms that increase to a maximum and then decrease could be useful. Ratkowsky (1990) and Sit and Poulin-Costello (1994) describe several such models. The goals of selecting a functional form would be first to find one or more models that best describe the theoretically expected, or empirically explored, change in a lag association and then to choose a model whose parameters are most meaningful.

Choosing a functional form

When possible, theory and previous findings should guide the choice of a functional form. The idea of explicitly modeling change in an association will be new to many areas of research. In such cases, an exploratory approach to describing the change in association may be desirable. One potentially informative approach is to create conditional scatter plots, also called conditioning plots or co-plots (Cleveland & Devlin, 1988), showing the relation between X and Y at different ranges of the moderator. These co-plots can give a clear picture of whether lag moderates a focal effect. The number of plots to inspect, however, is based on an arbitrary division of the entire range of the continuous moderator into segments. As a result, the pattern of change can look different depending upon the number of co-plots created.

LAM Approach Analyses

Next we present applications of the LAM approach using empirical data. We note that these examples use observational data and lags were not randomly assigned. For this reason, we are very circumspect in our interpretations of the results and emphasize that results cannot be interpreted as causal effects. Our goal is to use these data examples as a means to exemplify the LAM approach. Although these are exploratory analyses, the results have the potential to further our understanding of the associations among the variables.

We first examine the functional forms of the relationships using conditional scatter plots and then use the results and analytical expectations to choose and fit LAM regression models. For all analyses, we used data from a large, multi-site, longitudinal study in which lags were planned to be the same for each individual, but varied considerably due to practical issues related to collecting data on a fixed-lag schedule (the Early Head Start Research and Evaluation study; Department of Health and Human Services: Administration for Children and Families, 1996–2001; found at Inter-university Consortium for Political and Social Research website: http://www.icpsr.org/). The intent of this study was to examine the impact of the Early Head Start Program on young children and their families. We used two waves of data timed to coincide with the age of the focal child in each family (14 and 24 months of age). The actual age ranges of the children at the two waves of data collection were, respectively: 11 to 22 months and 20 to 32 months. Figure 1 shows a histogram of the observed lag values in months for the first data example. It is clear that there is considerable variation in lag values, however, the average lag (10.26 m) is close to the intended fixed lag (10 m). Lag values range from 5.90 to 16.98 months, but 50% of values fall between 9.21 and 11.08 months. There were 3,001 families in the study. Of these, 1,260 had complete data for the variables used in the first example and 1,440 had complete data for the variables used in the second analysis. We used listwise deletion to simplify the analyses. We used SPSS for the linear and non-linear regression analyses.

Figure 1.

Figure 1

Histogram of lag values in months.

Measures and Variables

Home Observation for the Measurement of the Environment (HOME)

The HOME (Caldwell & Bradley, 1984) is a semi-structured observational instrument that assesses the quality of stimulation provided to a child in his/her home. The HOME has a total score assessing the overall quality of stimulation in the home, as well as subscales designed to assess specific aspects of the home environment. For the present analyses, only the total HOME score was used.

Bayley Scales of Infant Development – Mental Development Index (MDI)

The MDI (Bayley, 1969) measures the cognitive, language, and social development of children under the age of 42 months. Standardized scores, computed based on the child’s age, are used in all of the following analyses. The Bayley was administered to children at approximately 14 and 24 months of age.

Analyses

MDI at 14 months predicting MDI at 24 months

We first examined an autoregressive association between the MDI at 14 months and the MDI at 24 months. As a first step to visualizing possible lag moderation, we examined conditional scatter plots of the 24 month MDI scores plotted against the 14 month MDI scores. Plots were created in the R software package using the coplot function. When using this function, the user chooses: two variables for the scatterplots; a conditioning (moderator) variable used to define the groups represented by each plot; the number of conditional plots to generate; and the degree of overlap in group membership. We examined several sets of conditional plots. For illustration, Figure 2 shows 12 of these scatter plots. For each of the 12 plots, 14 month MDI scores are on the horizontal axis and 24 month MDI scores are on the vertical axis. The plot on the bottom left of the panel contains points for the participants with the shortest lag values. Lag values of the 12 groups increase from left to right and from top to bottom with the group having the highest lag values being in the top right panel. The membership of consecutive groups overlaps by approximately 25%. The slope of the fitted regression line is displayed in the top left corner of each plot. A general pattern can be seen such that the regression slopes begin higher and decrease for groups with longer lags. This pattern suggests moderation by lag, however, it is difficult to assess the possible functional form. As an extension, we recorded each of the 12 regression slopes at the conditional values of lag. We plotted these slopes against each corresponding group’s mean lag to create a visual representation of the relation between lag and the slope. The gray squares in Figure 3 show these slopes for the twelve groups.

Figure 2.

Figure 2

Conditional scatter plots for the Mental Development Index measured at 14m predicting the Mental Development Index measured at 24m for 12 groups defined by average lag. Average lags increase from left to right and from bottom to top. Average lag (months) for each plot: 7.20, 8.62, 9.07, 9.41, 9.72, 10.00, 10.25, 10.52, 10.87, 11.33, 12.08, and 14.62.

Figure 3.

Figure 3

Linear (dashed-line) and exponential (solid-line) regression lines for Mental Development Index measured at 14m predicting the Mental Development Index measured at 24m. Squares are the slopes from the co-plots in Figure 2.

Based on the empirical evidence and our expectation that an autoregressive association may show a nonlinear decline with increasing lag, we chose to fit the linear and exponential models to these data. The results from both models, shown in Table 2, indicated significant lag moderation. The regression lines from both models are shown in Figure 3. In terms of substantive interpretations, from Figure 3 we see that these two models result in similar predicted values.

HOME at 14 months predicting MDI at 24 months

To complement the results from the previous autoregressive analysis, we next examined the cross-lagged association between the HOME at 14 months on the MDI at 24 months. As before, we first examined conditional scatter plots. Figure 4 shows 12 such scatter plots. The gray squares in Figure 5 show these 12 slopes plotted against mean lag for each group. While there is some fluctuation of the slopes with increasing lags, it is clear that there is an overall pattern of decline in the slope. Based on the empirical evidence and the previous analytical results showing that cross-lagged associations could show non-linear decline, we again fit the linear and exponential models to these data. The results from these two models are shown in the bottom half of Table 2. Both the linear and exponential models showed statistically significant lag moderation. The regression lines from these two models are shown in Figure 5. In contrast to the previous results, the substantive implications of the two models are different in that the linear model implies steady decline in the slope that will eventually become negative, whereas the exponential model implies decay that will asymptote near a slope of zero.

Figure 4.

Figure 4

Conditional scatter plots for the Home Observation for the Measurement of the Environment measured at 14m predicting the Mental Development Index measured at 24m for 12 groups defined by average lag. Average lags increase from left to right and from bottom to top. Average lag (months) for each plot: 5.52, 8.28, 8.85, 9.25, 9.61, 9.89, 10.16, 10.46, 10.80, 11.28, 11.98, and 14.57.

Figure 5.

Figure 5

Linear (dashed-line) and exponential (solid-line) regression lines for the Home Observation for the Measurement of the Environment measured at 14m predicting the Mental Development Index measured at 24m. Squares are the slopes from the plots in Figure 4.

Table 2.

Results from Analyses of MDI 14 Predicting MDI 24 and HOME 14 Predicting MDI 24

Linear Model Estimates Exponential Model Estimates
MDI 14 Predicting MDI 24:
  b0 102.519  b0 89.672
  b1 1.193  b1 1.607
  b2 −1.253  b2 −0.108
  b3 −0.062
 ;SSResid. 184806.031 SSResid. 189972.448
HOME 14 predicting MDI 24:
  b0 96.454  b0 89.366
  b1 3.036  b1 3.837
  b2 −0.704  b2 −0.107
  b3 −0.171
 SSResid. 236641.031 SSResid. 238968.956

Note: All p < .05

Overall, the results from these two sets of analyses support lag moderation. The first analyses showed a clear pattern of decline in an autoregressive association, which is consistent with a study by Thorndike (1933), who found a similar decline in test-retest correlations for intelligence tests. Also similar to Thorndike, we found that a linear model adequately described the interaction. The second set of analyses showed systematic decline in a cross-lagged association. These results suggest a positive association between stimulation in the home and child development that diminishes over time. Although stimulation in the home was measured only once, it is likely to be stable and continuing over time. The present results are consistent with a situation in which proximal stimulation is the most important predictor and as lags increase, the association with more distal stimulation declines.

Discussion

Our goal has been to present a new perspective on modeling time-dependent covariation by employing a LAM approach. In contrast to fixed-lag approaches for modeling longitudinal data, the LAM perspective is designed to emphasize the lag-dependent nature of longitudinal associations and explicitly model change in associations as a function of lag. This approach is useful in addressing the perennial issue of the importance of lags in the analysis of panel data. This approach is also consistent with our view that there is not a single correct lag for examining a longitudinal association and the complementary view that lag choice is a fundamental issue in the generalizability of results. To further elaborate the LAM approach, we demonstrated a few functional forms using empirical data that are potentially useful for lag moderation models and suggested methods for exploring functional forms.

Limitations and Future Directions

In general, the LAM approach has great potential for exploring and better understanding longitudinal relations. Limitations include increases in model complexity and the need for larger sample sizes. Additionally, it is most useful when the functional form of the interaction is properly specified. These limitations are not so much flaws of the approach as they are coincident with the fact that the approach involves modeling statistical interactions. Another potential limitation of this approach is that results are best understood when an independent variable occurs only once, such as in a time-delimited intervention. Although the models presented can be used to model time-dependent associations of predictors that continue beyond an occasion of measurement, the interpretations of them is less straightforward.

Causal Inference

As we noted in the introduction, the LAM approach should not be used to examine how the causal influence on one variable on another changes with lag unless several assumptions are supported. In simplest form, a regression model incorporating the LAM approach would have three independent variables: a focal predictor (x), the lag variable (Lag), and the product of the focal predictor and the lag variable that predict a dependent variable (y). Here we assume the goal is to accurately estimate a causal effect of the focal predictor on the outcome. Proper inference in this situation requires that the model be properly specified both in terms of the predictors included and in terms of the functional relationships between the predictors and the criterion.

Using the LAM approach to estimate a causal effect assumes all the important predictors have been included in the model. Similar to any regression analysis, a LAM analysis can yield biased estimates of an effect if, for example, an omitted predictor (z) causes y and is correlated with x. Complications can also arise when the Lag variable serves as a proxy for an omitted predictor as this too could obscure the effect of x on y. One way to address some of these difficulties is to randomly assign lags to participants. Such random assignment should insure that the Lag variable is independent of the focal predictor and does not serve as a proxy for an important omitted predictor. However, random assignment of lags cannot insure that the focal variable, and not some other correlated variable, has a causal influence on y.

A LAM based analysis also complicates the issue of properly specifying the functional form of the relationship between the predictors and the criterion because the analyst must specify the functional form of the lag by focal variable interaction. Based on our experience, there is often little to support the a priori specification of this functional form. In addition, the ability to accurately detect a non-linear functional form may be hindered by the quality and characteristics of the data.

When causal inference is needed, the LAM approach may have some utility in examining how causal effects evolve over time, given that all the proper design elements are in place and assumptions hold outside the model. The LAM approach is by no means a special tool to enhance causal inference. In contrast, many features of the LAM approach (e.g., making every treatment effect a conditional effect and the need to make additional assumptions about a covariate) can make the difficult task of causal inference even harder.

Functional Forms

Another key issue in the use of the LAM approach is the choice of functional form for the interaction. Beyond the previous analytical descriptions of changing effects over time and a handful of empirical investigations such as that by Thorndike (1933), there is very little to suggest appropriate forms. Much work needs to be done in this area to learn about the best methods for exploring time-moderated associations.

Once a functional form is chosen, one must decide how best to assign lags in a variable-lag design. McClelland and Judd (1993) discuss how sampling affects the ability to detect a moderation effect when the functional form of the moderation is known beforehand. They suggest that an efficient way to find significant linear moderation effects is to oversample extreme values of the interacting variables. Following this guideline, the LAM approach may benefit from disproportionately assigning very long and very short lags to participants in order to enhance the ability to detect moderation by lag. However, curvilinear effects of Lag on the XY relationship will require a different design to maximize efficiency for detecting interactions (McClelland, 1997). Therefore, further work must be done to identify lag-sampling strategies that would maximize the probability of detecting an interaction while also maximizing the ability to accurately describe a nonlinear interaction.

Inter- vs. intra-individual effects

Finally, the regression models we’ve used are focused exclusively on interindividual variability. Change is modeled by examining covariation of individual standing on variables at different occasions. In this way, it is similar to many other applications of regression models for longitudinal data. Critics of such models argue that when researchers use models based on individual differences, the true goal is often to draw inference about within-person change. Strong arguments have been presented showing that results from interindividual models do not readily generalize to intraindividual variation (Molenaar, 2004; Molenaar & Campbell, 2009).

Regression models following the LAM approach may be particularly open to this criticism because the time-dependent effects modeled are often best understood as within-person effects. Even the thought experiments used by authors to illustrate time dependent effects in individual differences models are often based on within-person change. Gollob and Reichardt’s (1987) aspirin example, in which time-varying effects are illustrated by the example of the effect of taking an aspirin on headache pain, is a good case in point as the models in that article are based on inter-individual differences yet the illustration describes how the effect of an aspirin on headache pain will vary for an individual depending on the time elapsed since taking the medicine. There is good reason to be skeptical of using inter-individual models to draw inference about intra-individual change. Models of between-person variation cannot yield definitive answers regarding within-person processes. It is premature to suggest, however, that models of inter-individual differences cannot contribute to our understanding of change.

Summary and Conclusions

The analyses presented here provide evidence of time-dependent associations. The fact that we were able to demonstrate lag moderation using data from a study not designed to capture such effects supports the potential utility of the LAM approach. The findings are limited because the data are observational and lags were not randomly assigned or uniformly distributed. Therefore, it is unlikely that all important predictors were used in the model, and it is possible that lag may be confounded with some other important variables for which we are unable to control. Clearly, more work is needed using studies designed to utilize a variable lag approach in order to draw sound conclusions about LAM associations.

The purpose of this work was to promote an approach for addressing the important role of time lags in models for longitudinal data. The LAM approach offers a useful strategy for addressing the perennial problem of choosing lags for a longitudinal study. The LAM approach could be used for many existing data sets in which lags vary to some degree and the lag variable can be constructed (i.e., if the dates of data collection are recorded, lags can be computed). Such secondary analyses may show that previous conclusions regarding relationships were either incorrect or incomplete. These secondary analyses could potentially form the foundation for a growing body of knowledge regarding the characteristic ways in which associations change with lag.

The true appeal of the LAM approach, however, is that it provides a straightforward means of extending and enhancing our current understanding of associations in the social sciences. A LAM analysis can provide a useful description of lag dependent association that cannot be seen from a fixed-lag analysis.

Table 1.

Descriptive Statistics for Variables Used in Example 1a and Example 2b.

Variable N Min. Mean Max. SD
MDI 14ma 1260 49.00 98.79 130.00 11.11
MDI 24ma 1260 49.00 89.83 134.00 13.68
Lag 14m–24ma 1260 5.90 10.26 16.98 1.61
HOME 14mb 1404 6.46 26.24 31.00 3.44
MDI 24mb 1404 49.00 89.72 134.00 13.87
Lag 14m–24mb 1404 2.95 10.08 16.98 1.74

Contributor Information

James P. Selig, University of New Mexico

Kristopher J. Preacher, Vanderbilt University

Todd D. Little, University of Kansas

References

  1. Bayley N. The Bayley Scales of Infant Development. New York: Psychological Corp; 1969. [Google Scholar]
  2. Caldwell B, Bradley R. Unpublished manuscript. University of Arkansas; 1984. Home Observation for the Measurement of the Environment. [Google Scholar]
  3. Cleveland WS, Devlin SJ. Locally-weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association. 1988;83:596–610. [Google Scholar]
  4. Cohen P. A source of bias in longitudinal investigations of change. In: Collins LM, Horn JL, editors. Best methods for the analysis of change: Recent advances, unanswered questions, future directions. Washington, DC: American Psychological Association; 1991. pp. 18–25. [Google Scholar]
  5. Cole DA, Maxwell SE. Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology. 2003;112:558–577. doi: 10.1037/0021-843X.112.4.558. [DOI] [PubMed] [Google Scholar]
  6. Cole DA, Maxwell SE. Statistical methods for risk-outcome research: Being sensitive to longitudinal structure. Annual Review of Clinical Psychology. 2009;5:71–96. doi: 10.1146/annurev-clinpsy-060508-130357. [DOI] [PubMed] [Google Scholar]
  7. Collins LM, Graham JW. The effect of the timing and spacing of observations in longitudinal studies of tobacco and other drug use: Temporal and design considerations. Drug and Alcohol Dependence. 2002;68:S85–S96. doi: 10.1016/s0376-8716(02)00217-x. [DOI] [PubMed] [Google Scholar]
  8. Cudeck R, du Toit SHC. A version of quadratic regression with interpretable parameters. Multivariate Behavioral Research. 2002;37:501–519. doi: 10.1207/S15327906MBR3704_04. [DOI] [PubMed] [Google Scholar]
  9. Department of Health and Human Services, Administration for Children and Families. Early Head Start Research and Evaluation Study. 1996–2001 [Computer File]. Available from Inter-university Consortium for Political and Social Research Web site, http://www.icpsr.org.
  10. Gollob HF, Reichardt CS. Taking account of time lags in causal models. Child Development. 1987;58:80–92. [PubMed] [Google Scholar]
  11. Gollob HF, Reichardt CS. Interpreting and estimating indirect effects assuming time lags really matter. In: Collins LM, Horn JL, editors. Best methods for the analysis of change: Recent advances, unanswered questions, future directions. Washington D. C: American Psychological Association; 1991. pp. 243–259. [Google Scholar]
  12. Heise DR. Causal inference from panel data. Sociological Methodology. 1970;2:3–27. [Google Scholar]
  13. Hsiao C. Analysis of panel data. Cambridge: Cambridge University Press; 1986. [Google Scholar]
  14. Kelly JR, McGrath JE. On time and method. Newbury Park: Sage; 1988. [Google Scholar]
  15. Little TD. Longitudinal structural equation modeling. New York, NY: Guilford; (in press) [Google Scholar]
  16. Little TD, Preacher KJ, Selig JP, Card NA. New developments in SEM panel analyses of longitudinal data. International Journal of Behavioral Development. 2007;31:357–365. [Google Scholar]
  17. Maxwell SE, Cole DA. Bias in cross-sectional analyses of longitudinal mediation. Psychological Methods. 2007;12:23–44. doi: 10.1037/1082-989X.12.1.23. [DOI] [PubMed] [Google Scholar]
  18. Maxwell SE, Cole DA, Mitchell MA. Bias in cross-sectional analyses of longitudinal mediation: Partial and complete mediation under an autoregressive model. Multivariate Behavioral Research. 2011;46:816–841. doi: 10.1080/00273171.2011.606716. [DOI] [PubMed] [Google Scholar]
  19. McArdle JJ, Woodcock RW. Expanding test-retest designs to include developmental time-lag components. Psychological Methods. 1997;2:403–435. [Google Scholar]
  20. McClelland GH. Optimal design in psychological research. Psychological Methods. 1997;2:3–19. [Google Scholar]
  21. McClelland GH, Judd CM. Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin. 1993;114:376–390. doi: 10.1037/0033-2909.114.2.376. [DOI] [PubMed] [Google Scholar]
  22. Mitchell TR, James LR. Building better theory: Time and the specification of when things happen. Academy of Management Review. 2001;26:530–547. [Google Scholar]
  23. Molenaar PCM. A manifesto on Psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement. 2004;2(4):201–218. [Google Scholar]
  24. Molenaar PCM, Campbell CG. The new person-specific paradigm in psychology. Current Directions in Psychology. 2009;18(2):112–117. [Google Scholar]
  25. Pelz DC, Lew RA. Heise’s causal model applied. In: Borgatta EF, Bohrnstedt G, editors. Sociological Methodology. San Francisco, CA: Jossey-Bass; 1970. pp. 28–37. [Google Scholar]
  26. R Development Core Team. R: A language and environment for statistical computing, reference index version 2.9.1. R Foundation for Statistical Computing; Vienna, Austria: 2005. URL http://www.R-project.org. [Google Scholar]
  27. Ratkowsky DD. Handbook of nonlinear regression models. New York: Dekker; 1990. [Google Scholar]
  28. Reichardt CS. Commentary: Are three waves of data sufficient for assessing mediation? Multivariate Behavioral Research. 2011;46:842–851. doi: 10.1080/00273171.2011.606740. [DOI] [PubMed] [Google Scholar]
  29. Reichardt CS, Gollob HF. Satisfying the constraints of causal modeling. New Directions for Program Evaluation. 1986;31:91–107. [Google Scholar]
  30. Shingles RD. Causal inference in cross-lagged panel analysis. In: Blalock HM, et al., editors. Causal models in panel and experimental designs. New York: Aldine; 1985. [Google Scholar]
  31. Sit V, Poulin-Costello M. Biometrics Information, Handbook no 4. B.C. Ministry of Forests; Victoria, BC: 1994. Catalog of curves for curve fitting. [Google Scholar]
  32. Thorndike RL. The effect of the interval between test and retest on the constancy of the IQ. Journal of Educational Psychology. 1933;24:543–549. [Google Scholar]
  33. Wang L, Zhang Z, Estabrook R. Longitudinal mediation analysis of training intervention effects. In: Chow S-M, Ferrer E, Hsieh F, editors. Statistical methods for modeling human dynamics: An interdisciplinary dialogue. New Jersey: Lawrence Erlbaum Associates; 2010. [Google Scholar]
  34. Wright S. The treatment of reciprocal interaction, with or without lag, in path analysis. Biometrics. 1960;16:189–202. [Google Scholar]

RESOURCES