Abstract
Sterba and Bauer's Keynote Article discusses the blurred distinction between theoretical principles and analytical methods in the person-oriented approach as problematic and review which of the person-oriented principles are testable under the four types of latent variable models for longitudinal data. Although the issue is important, some arbitrariness exists in determining whether a given principle can be tested within each analytic approach. To close the gap between person-oriented theory and methods and to extend the person-oriented approach more generally, it is necessary to embrace both variable-oriented and person-oriented methods because it is not the individual analytic methods but how studies are implemented as a whole that defines the person-oriented approach. Three areas in developmental psychopathology are discussed in which variable-oriented and person-oriented methods can be complementary. The need to better understand the target system using an appropriate person-specific tool is graphically illustrated. Several concepts of dynamic systems such as attractors, phase transitions, and control parameters are illustrated using experimentally perturbed cardiac rhythms (heart rate variability) as an example in the context of translational alcohol research.
The Keynote Article by Sterba and Bauer (2010 [this issue]) has brought attention to a distinction between theory and methods in a person-oriented approach (Bergman & Magnusson,1997) and raised an interesting question whether several latent variable models for longitudinal data can empirically evaluate principles of the person-oriented theory. To answer this question, Sterba and Bauer contrast several latent variable models for longitudinal data that differ in the way that intraindividual change over time and interindividual differences in intraindividual change are conceptualized along the quantitative and qualitative dimension. In addition, Sterba and Bauer describe two single-subject methods (p-technique and dynamic factor analysis) as underutilized methods of choice for person-oriented research. Their article extends the existing efforts to better match analytical tools with theoretical concepts, especially regarding the concept of qualitative versus quantitative individual differences in intraindividual change (see also Feldman, Masyn, & Conger, 2009; Muthén, 2001) and raises cautions about inferences made from analysis that examines latent class, population heterogeneity, or mixture distribution (see also Bauer & Curran, 2003, 2004; Sampson & Laub, 2005; von Eye & Bergman, 2003).
Sterba and Bauer's article prompted a few observations. Although Sterba and Bauer provide some clarity regarding match and lack of match between person-oriented methods and theory, it still remains arbitrary to determine which of the person-oriented principles are testable and which are not because there can be many variations that defy a simple distinction within each analytic approach. One consideration is the role of a priori known information in the form of variables in person-oriented methods. For example, as Sterba and Bauer point out, the principle of complex interactions may conditionally be testable by including these complex interaction terms in the fitted models, assuming that a researcher knows which interaction terms to include. Similarly, one can argue that the pattern-parsimony principle may be evaluated by including a priori defined grouping variables in the fitted models and then examining parameters and comparing fit statistics. One can ask, for example, whether patterns of intraindividual change differ across different groups of individuals that are a priori defined.
Consideration of the individual specificity principle, also presents a dilemma: how does one determine if the individual specificity principle is met when there exist other equivalent and well-fitting structural equation models (see Tomarken & Waller, 2003) or when higher order slope variance elements (e.g., quadratic slope variance) are constrained to be nonexistent to stabilize the estimation? In actuality, typical long-term longitudinal data exhibit great individual differences; a nonzero intercept variance element (individual specificity) is, in all practicality, not falsifiable. Similarly, a significant linear slope variance (interindividual differences/intraindividual change) is more a norm than an exception.
With regard to the assumption of population heterogeneity, analytic models utilizing latent classes or statuses only approximate the observed data and the true population state is never known in reality (Cudeck & Henly, 2003). Thus, rather than focusing on whether a population is really or really not composed of heterogeneous subpopulations with different developmental pathways, it may be important to ask, instead, whether data driven, hypothesis-generating analysis has brought any new useful understanding into light. This criterion may be difficult to evaluate immediately, and an affirmative answer may be warranted for some but not all such studies. Given that a majority of person-oriented methods are geared toward discovering unknown causal structures in data more effortlessly compared to variable-oriented methods, deciding one's analytic approach may depend on the judgmental outcome of weighing relative risk and potential gain in a trade-off between false positive (i.e., finding unhelpful [or nonexistent] subgroups) and false negative (i.e., erroneously not looking at potentially useful subgroups) risk.
Therefore, the field may become more knowledgeable by pursuing what is unknown above and beyond what is known (or could be tested based on what is known) and by attempting to find novel solutions to a problem that remain elusive. To close the gap between person-oriented theory and methods, it may be more fruitful to move beyond the methodological dualism between person-oriented and variable-oriented methods and instead embrace methodological pluralism and discovery-oriented methods as originally advocated by Richters (1997). We now discuss how the person-oriented and the variable-oriented perspectives could be complementary for research in developmental psychopathology.
Challenges and Opportunities for Research in Developmental Psychopathology
Developmental psychopathology is an integrative discipline that is concerned with both normal and abnormal developmental processes. It transcends disciplinary boundaries by focusing on integrated analysis of multilevel influences across systems including biological and contextual influences, and translates new scientific findings into clinical practices (Cicchetti, 2006; Cicchetti & Toth, 2009). This “big tent” approach (Cicchetti, 2006) to research in developmental psychopathology presents considerable challenges, including a multiple levels of analysis approach that goes across scales across multiple systems (Cicchetti & Toth, 2009).
Integration
Emerging behavioral data collection approaches (e.g., Web-based daily diary, ecological momentary assessment) offer both an opportunity and a challenge to examine rhythmical nonlinear dynamic processes of continuity and change over time, and to connect dots between interconnected systems across multiple levels. For example, Chow, Ram, Boker, Fujita, and Clore (2005) utilized a damped oscillator model (a fourth-order latent differential structural equation modeling approach) to approximate an individual's daily self-reports of emotions over 52 days. Dynamic parameters such as intensity, frequency, and damping of weekly oscillatory cycles for six emotions (love, joy, sadness, fear, shame, and anger) were estimated separately for each emotion over time and then individual differences in these estimates were examined in relation to gender and personality characteristics. They found that all six emotions had approximately weekly cycles without much damping and, on average, women reported a shorter frequency of sadness compared to men.
For multivariate time-series data, a nonlinear dynamic analytic tool such as recurrence quantification analysis that examines repeating patterns of the dynamical signals for complexity, can be combined with principal component analysis to examine the complex relationships of an aggregated pattern (see Webber & Zbilut, 2005). For example, one may successfully reduce the dimension of highly correlated multivariate time series data observed in kicking behavior among infants before studying its dynamic system and qualitatively different phase transitions. These examples illustrate the point that high dimensional, intraindividual data such as neuroimaging and genomic DNA are increasingly accessible, and will require integrated analysis across different measurement and time scales. This will require both person-oriented methods and variable-oriented methods. Thus, a two-stage approach based on person-specific ideographic analysis, followed by analysis of different individuals as advocated by Molenaar (2008) may be a promising direction for a multiple levels of analysis approach. A data example will be presented to illustrate some of these concepts later in this Commentary.
Mechanisms of change
In providing evidence of efficacy of prevention or intervention programs, it is increasingly important to identify mechanisms of change, not only treatment versus control group differences in a randomized clinical trial. To identify mechanisms of change, a person-oriented perspective is needed to conceptualize mediators and moderators within appropriate study designs. To demonstrate support for a mediator, it needs to be established that (a) a change mechanism can be manipulated in principle, (b) a change in a mediator can be attributed specifically to an intervention (e.g., reduced positive alcohol expectancies among intervention students but not control students), and (c) a change in an outcome variable can be attributed specifically to change in a mediating variable. Thus, mediation is a malleable change process within an individual that is a target intervention mechanism. In contrast, a moderator is a variable related to differences in the change process that (a) could not be manipulated (e.g., age or ethnicity) or (b) could be potentially susceptible to change but is independent of an intervention. In other words, mediation can be viewed as a process related to intraindividual change before, during or following an intervention, whereas moderation can be viewed as interindividual differences in the intraindividual change process that are known to be salient across subgroups and settings, or empirically identified using pattern-oriented classification methods. These concepts can be applied also to nonrandomized longitudinal studies where a quasi-experimental treatment effect is the target of an investigation. A person-oriented perspective in searching for mechanisms of change is needed to accompany the advances made in analytic methods for testing mediation from a more variable-oriented perspective (e.g., Bauer, Preacher, & Gil, 2006; MacKinnon, 2008; Preacher & Hayes, 2008).
As pointed out by others (e.g., Magnusson, 1998), evidence of the relationships between variables in a cross-sectional study using regression analysis or structural equation modeling analysis is conceptually inadequate for demonstrating mechanisms of change (or any mediation). Well-planned longitudinal analysis offers some safeguards to assure that empirical evidence of mediation effects is because of change within an individual not to individual differences. Latent growth curve modeling or its extension such as growth mixture modeling can be a very useful tool to identify whether intraindividual change occurs during and following an intervention, whether some individuals change more than others, or whether some individuals traverse pathways that are distinctively different not only in trajectories of the targeted behavior, but also in other domains of life. Other more discovery-oriented analytic tools such as configural frequency analysis (see von Eye, 2010 [this issue]), tree models (classification/regression trees), and cluster analysis (Mun, von Eye, Bates, & Vaschillo, 2008; Mun, Windle, & Schainker, 2008) are available tools to uncover hidden patterns that may not be easily detected using more variable-oriented methods.
Evaluation
Another challenge involved in translating new scientific knowledge to clinical practices is how to assess whether the cost of interventions outweighs benefits, and how to communicate practical and economical implications to policy makers and the public. McCartney and Rosenthal (2000) illustrated that the practical importance of a finding can be very different from a statistical effect size estimate such as Cohen's d (1988) that is assessed in units of a variable. A statistically significant finding and its effect size are important for researchers to consider, but they suggested that the binomial effect size display (BESD) originally developed by Rosenthal and Rubin (1982), may be more accessible for the public to understand the effect size of a given finding. The BESD is a 2 × 2 table to display an effect size that dichotomizes individuals (i.e., treatment cases) based on their predictor (or treatment exposure levels; below average vs. above average) and outcome (below average vs. above average outcome) values, and displays their differential outcome patterns. Thus, an outcome finding (e.g., treatment success) is defined at the level of individuals. For clinicians in the field, policy makers, and the public who deal with persons not variables, this approach may be more intuitive than an effect size defined at the level of variables.
For example, after a 4-week cognitive behavioral treatment for children refusing to go to school, a treatment success was evaluated in terms of how many treated children reported school attendance within the normal, nonclinical range (defined as 90% attendance), compared to nontreated wait-listed children (King et al., 1998). Based on the reported data, we reconstructed Table 1 as a BESD example. The effect size shown in Table 1 is large with r = .60 (r = .1, .3, and .5 for small, medium, and large effect sizes, respectively; Cohen, 1988) and one can easily see the difference in success rates for the treated versus wait-listed groups. This person-oriented approach to an effect size can easily be extended to include different treatment success rates across different settings in a 2 × 2 × k BESD.
Table 1.
Normal School Attendance | Clinical Range School Attendance | Total | |
---|---|---|---|
CBT treated children | 15 | 2 | 17 |
Wait-listed control children | 5 | 12 | 17 |
Total | 20 | 14 | 34 |
Similarly, Foster, Dodge, and Jones (2003) observed that many prevention and treatment studies are conducted from a variable-oriented perspective (i.e., group differences measured in d or r). Although this approach allows one to measure cost-effectiveness per one unit improvement in a single outcome measure; this approach is disadvantageous when outcome variables are related in complex and nonlinear ways and when not all outcome measures are accessible for evaluation. Given that many problem behaviors tend to co-occur, Foster and colleagues suggested that a person-oriented outcome may be useful as a global measure of cost-effectiveness for prevention research. In other words, a global measure of cost-effectiveness may be determined at the level of individuals (e.g., individuals with adaptive pathways vs. individuals with compromised adaptation), not at the level of variable units.
In sum, both variable-oriented and person-oriented methods have unique roles in developmental psychopathology as discussed in relation to the three important issues. The gap that exists between person-oriented theory and the methods is more likely to become narrow with a clearer conceptual and analytical focus. Given this backdrop, Sterba and Bauer (2010) have done a service to the field by highlighting the distinction between theoretical concepts and analytical methods, and by critically evaluating the fit between the principles and methods of the person-oriented approach. In what follows, we return to the issue of integration for a multiple-levels-of-analysis approach.
Discovery-Oriented Translational Alcohol Research: A Data Example
Here we illustrate how graphic and descriptive dynamic data analysis of rhythmical nonlinear processes over short time series (data series) might be used to propel new understanding of the systems implicated in drinking behavior control mechanisms. The goal is to inform translational research on efficacious treatment strategies to change unhealthy drinking behavior. The data came from an experiment examining intraindividual regulatory adaptability and flexibility in response to external and internal stimuli under conditions in which central cognitive control is intact (control), degraded by pharmacological challenge (alcohol), and cognitively manipulated (placebo). Heart rate variability (HRV) was measured as a noninvasive index of the cardiovascular system's dynamic adjustment (i.e., autonomic regulation) of sympathetic (excitatory) and parasympathetic (inhibitory) influences on heart rate (HR; Appelhans & Luecken, 2006). HRV is thought to reflect the adaptive capacity and flexibility of an individual to self-regulate in response to internal and external stimulation (e.g., stressors).
Experimental procedures
Healthy participants between the ages of 21 and 25 were randomly assigned to one of three conditions and each condition consisted of completing two sessions that were 1 week apart: alcohol/placebo, alcohol/control and placebo/control conditions. All participants consumed three volume-controlled drinks in each session that were either 100% mixer (told no alcohol=control), placebo (mixer with 100μl ethanol float per each cup and other olfactory cues), or mixer plus 95% ethanol dose to produce a target blood alcohol concentration of 80 mg/dl. Participants completed a low cognitive demand task (“plain vanilla”; Jennings, Kamarck, Stewart, Eddy, & Johnson, 1992) for pre and postdrinking baselines (B1 and B2, respectively), and then began cue exposure when a blood alcohol concentration of ~ 60 mg/dl was reached (or after 10 min in placebo and control sessions). Emotionally valenced picture cue stimuli (i.e., positive-emotional, negative-emotional, neutral) were from the International Affective Picture System (Lang, Bradley, & Cuthbert, 1999). Alcohol cues were from the Normative Appetitive Picture System (Stritzke, Patrick, & Lang, 2004) and additional stimuli developed for this study. Emotionally-valenced and alcohol picture cues were presented in five-min blocks in which each cue appeared for 5 s then disappeared for 5 s. In addition, all participants completed a 5 min paced breathing task wherein they completed every breath (inhalation--exhalation cycle) for 10 s with the use of a visual pacer.
Descriptive graphic illustration of intraindividual dynamic HRV responses
Figure 1 shows a sequence of beat-to-beat R--R intervals (RRIs) of the electrocardiogram (ECG) observed from a single individual following the placebo condition. RRI data in response to the low-cognitive-demand baseline task (B1) are overlaid with RRI data in response to the negative-emotional cues and the paced breathing task. Higher numbers on the Y-axis indicate longer RRI (slower HR) while lower numbers indicate shorter RRI (faster HR). Note that the RRI oscillation patterns in response to the negative-emotional cues and paced breathing look different from the B1 responses and from one another in terms of regularity (highs and lows) and frequency of oscillations. The temporal RRI oscillations in response to the paced breathing procedure show a typical relaxation oscillatory pattern, while the RRI oscillations in response to the baseline and negative-emotional cues manifest the characteristics of a self-organizing system and strong affinity for approximately a 0.8 s interbeat interval during perturbation.
Figure 2 shows the RRI data from the same subject in reconstructed phase space during both placebo and alcohol conditions. This graphical approach is used to understand the nature of the nonlinear dynamic system by unfolding the system into the higher and appropriate number of dimensions using time-delayed copies of the series (Shockley, 2005). A few interesting observations from this illustration: first, the dynamic attractor state during paced breathing may be different from the one in response to baseline or emotionally-valenced negative picture cues. Although the RRI oscillation patterns during B1, B2, and negative picture cue presentation appear to show noisy fluctuations around a fixed point, the RRI oscillations during paced breathing appear to have a limit cycle attractor (e.g., a swinging pendulum) that sets an orbit through the state space. Second, acute alcohol consumption degraded RRI responses to both low cognitive demand baselines and to negative emotional cues. Reduced variability in RRI oscillations indicates decreased capacity of neurocardiologic systems to cope with disturbance during intoxication. Third, compared to the RRI responses to baseline, the RRI oscillations to emotionally-negative picture cues were relatively unstable because of perturbing the system through strongly valenced visual stimuli. Although the moment-to-moment RRI oscillations during both baseline and negative picture cue presentation exhibited noisy fluctuations around their mean or preferred state reflecting the noisiness of the components, the RRI oscillations during negative picture cue presentation were more variable and unstable than the RRI oscillations during baseline.
The graphical approach tentatively suggests that the beverage and emotional cue manipulations successfully perturbed the cardiovascular system, yet this individual had a highly stable self-regulating control system. These perturbations might have been within the ranges of the control parameter and consequently the system maintained its preferred state despite increased noisy fluctuations. In contrast, the system appeared to generate qualitatively different patterns during paced breathing in a phase shift or phase transition. The source of this new form in reconstructed phase space was controlled breathing in which the subject inhaled (accelerated HR) and exhaled (decelerated HR) at 0.1 Hz through the use of a visual pacer, resulting in strongly synchronized respiratory sinus arrhythmia at the cardiovascular system's resonance frequency (i.e., six breaths per min or 0.1 Hz; see Vaschillo, Vaschillo, & Lehrer, 2006). This insight, if shown repeatedly from different individuals with diverse health backgrounds, may play a key role in gauging clinical treatment implications for paced breathing and paced picture cue presentation paradigms, as they are closely related to HRV biofeedback which has been associated with chronic therapeutic actions in clinical populations (e.g., Lehrer et al., 2003).
Interindividual differences in intraindividual dynamic HRV responses
Figure 3 shows RRI oscillations in reconstructed phase space observed from a different individual during the control (no alcohol) session. This individual, like the other individual whose data are shown in Figures 1 and 2, was generally healthy and exhibited RRI oscillations that were slightly more elevated (lower mean HR) and more variable (greater HRV) when plotted. We then examined the data more quantitatively using recurrence quantification analysis to quantify the properties of the repeating patterns without requiring the stationary assumption (no increasing or decreasing trend in means and standard deviations over time; see Webber & Zbilut, 2005).
Figure 4 illustrates the data from two individuals A and B during the placebo and control sessions, respectively, in recurrence plots. The percentage of recurrent points falling within the specified radius is measured by percentage of recurrence and the deterministic characteristic in the observed dynamic is quantified by percentage of determinism. Given that more complex systems tend to exhibit less frequent recurrences, Figure 4 and quantitative parameters suggest that the RRI oscillations during cue exposure had less repeating patterns and were less deterministic than the ones during paced breathing for both individuals. Figure 4 also shows that Individual A appeared to exhibit more repeating response patterns, indicating less complexity, compared to Individual B during negative cue exposure. Such person-specific analysis could be the first stage of investigations aimed to identify mechanisms of behavior change by assessing whether different patterns in physiological control systems signal greater risk for unhealthy alcohol use, and to introduce change in systems that may be related to motivation to change and change in drinking behavior.
Conclusion
It may be helpful to bring attention to the six research strategies that have been identified for developmental psychologists interested in analysis of dynamic systems (Thelen & Smith, 1994) as summarized in Granic and Hollenstein (2003) – (a) identify the collective variable of interest; (b) describe the attractors for that system; (c) map the individual developmental trajectories of the collective variables; (d) identify phase transitions in development; (e) identify control parameters (for an example, see Molenaar's Commentary, 2010 [this issue]); and (f) manipulate control parameters to experimentally generate phase transitions. In this present Commentary, we illustrated concepts of attractors, phase transitions, and control parameters using perturbed cardiac rhythms as an example of nonlinear dynamics in the context of translational alcohol research.
There is an unmet need to better understand the systems being investigated using appropriate person-specific tools prior to studying differences across individuals. Pattern-oriented and person-oriented methods can be useful analytic tools for discovery-oriented research that often requires integrated knowledge across multiple levels within an individual and across different individuals. Likewise, variable-oriented methods such as regression analysis or structural equation modeling can be useful tools in sorting out different dynamic or nondynamic patterns across different individuals (e.g., alcohol abusers or social drinkers). Thus, we argue that variable-oriented and person-oriented methods, when thoughtfully used within appropriate study designs, have complementary roles in pursuit of new understanding from a multiple-levels-of-analysis approach for research in developmental psychopathology. It is not the individual analytic methods per se, but how studies are implemented as a whole, from design to analysis and discussion, that constitutes the person-oriented approach and its significance.
Acknowledgments
This paper was supported in part by the National Institute on Drug Abuse (P20 DA17552 and DA17552-05S1) as part of the Rutgers Transdisciplinary Prevention Research Center and by grants from the National Institute of Alcohol Abuse and Alcoholism (R01 AA015248 and K02 AA00325). The authors are indebted to Alexander von Eye and Michael Riley for helpful comments on an earlier draft.
Contributor Information
Eun Young Mun, Center of Alcohol Studies, Rutgers, The State University of New Jersey.
Marsha E. Bates, Center of Alcohol Studies, Rutgers, The State University of New Jersey and Department of Psychiatry, University of Medicine and Dentistry of New Jersey
Evgeny Vaschillo, Center of Alcohol Studies, Rutgers, The State University of New Jersey..
References
- Appelhans BM, Luecken LJ. Heart rate variability as an index of regulated emotional responding. Review of General Psychology. 2006;10:229–240. [Google Scholar]
- Bauer DJ, Curran PJ. Distributional assumptions of growth mixture models: Implications for overextraction of latent trajectory classes. Psychological Methods. 2003;8:338–363. doi: 10.1037/1082-989X.8.3.338. [DOI] [PubMed] [Google Scholar]
- Bauer DJ, Curran PJ. The integration of continuous and discrete latent variable models: Potential problems and promising opportunities. Psychological Methods. 2004;9:3–29. doi: 10.1037/1082-989X.9.1.3. [DOI] [PubMed] [Google Scholar]
- Bauer DJ, Preacher KJ, Gil KM. Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: New procedures and recommendations. Psychological Methods. 2006;11:142–163. doi: 10.1037/1082-989X.11.2.142. [DOI] [PubMed] [Google Scholar]
- Bergman LR, Magnusson D. A person-oriented approach in research on developmental psychopathology. Development and Psychopathology. 1997;9:291–319. doi: 10.1017/s095457949700206x. [DOI] [PubMed] [Google Scholar]
- Chow S-M, Ram N, Boker SM, Fujita F, Clore G. Emotion as a thermostat: Representing emotion regulation using a damped oscillator model. Emotion. 2005;5:208–225. doi: 10.1037/1528-3542.5.2.208. [DOI] [PubMed] [Google Scholar]
- Cicchetti D. Development and psychopathology. In: Cicchetti D, Cohen D, editors. Developmental psychopathology. 2nd ed. Vol. 1. Wiley; New York: 2006. pp. 1–23. [Google Scholar]
- Cicchetti D, Toth SL. The past achievements and future promises of developmental psychopathology: The coming of age of a discipline. Journal of Child Psychology and Psychiatry. 2009;50:16–25. doi: 10.1111/j.1469-7610.2008.01979.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed Erlbaum; Hillsdale, NJ: 1988. [Google Scholar]
- Cudeck R, Henly SJ. A realistic perspective on pattern representation in growth data: Comment on Bauer and Curran (2003). Psychological Methods. 2003;8:378–383. doi: 10.1037/1082-989X.8.3.378. [DOI] [PubMed] [Google Scholar]
- Feldman BJ, Masyn KE, Conger RD. New approaches to studying problem behaviors: A comparison of methods for modeling longitudinal, categorical adolescent drinking data. Developmental Psychology. 2009;45:652–676. doi: 10.1037/a0014851. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foster EM, Dodge KA, Jones D. Issues in the economic evaluation of prevention programs. Applied Developmental Science. 2003;7:76–86. doi: 10.1207/S1532480XADS0702_4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Granic I, Hollenstein T. Dynamic systems methods for models of developmental psychopathology. Development and Psychopathology. 2003;15:641–669. doi: 10.1017/s0954579403000324. [DOI] [PubMed] [Google Scholar]
- Jennings JR, Kamarck T, Stewart C, Eddy M, Johnson P. Alternate cardiovascular baseline assessment techniques: Vanilla or resting baseline. Psychophysiology. 1992;29:742–750. doi: 10.1111/j.1469-8986.1992.tb02052.x. [DOI] [PubMed] [Google Scholar]
- King NJ, Tonge BJ, Heyne D, Pritchard M, Rollings S, Young D, et al. Cognitive-behavioral treatment of school-refusing children: A controlled evaluation. Journal of American Academy of Child & Adolescent Psychiatry. 1998;37:395–403. doi: 10.1097/00004583-199804000-00017. [DOI] [PubMed] [Google Scholar]
- Lang PJ, Bradley MM, Cuthbert BN. Technical Report A-4. University of Florida, Center for Research in Psychophysiology; Miami: 1999. International Affective Picture System (IAPS): Instruction manual and affective ratings. [Google Scholar]
- Lehrer PM, Vaschillo E, Vaschillo B, Lu S-E, Eckberg DL, Edelberg E, et al. Heart rate variability biofeedback increases baroreflex gain and peak expiratory flow. Psychosomatic Medicine. 2003;65:796–805. doi: 10.1097/01.psy.0000089200.81962.19. [DOI] [PubMed] [Google Scholar]
- MacKinnon DP. Introduction to statistical mediation analysis. Erlbaum; New York: 2008. [Google Scholar]
- Magnusson D. The logic and implications of a person-oriented approach. In: Cairns RB, Bergman LR, Kagan J, editors. Methods and models for studying the individual. Sage; Thousand Oaks, CA: 1998. pp. 33–62. [Google Scholar]
- McCartney K, Rosenthal R. Effect size, practical importance, and social policy for children. Child Development. 2000;71:173–180. doi: 10.1111/1467-8624.00131. [DOI] [PubMed] [Google Scholar]
- Molenaar PCM. On the implications of the classical ergodic theorems: Analysis of developmental processes has to focus on intraindividual variation. Developmental Psychobiology. 2008;50:60–69. doi: 10.1002/dev.20262. [DOI] [PubMed] [Google Scholar]
- Molenaar PCM. Testing all six person-oriented principles in dynamic factor analysis. Development and Psychopathology. 2010;22:255–259. doi: 10.1017/S0954579410000027. [DOI] [PubMed] [Google Scholar]
- Mun EY, von Eye A, Bates ME, Vaschillo EG. Finding groups using model-based cluster analysis: Heterogeneous emotional self-regulatory processes and heavy alcohol use risk. Developmental Psychology. 2008;44:481–495. doi: 10.1037/0012-1649.44.2.481. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mun EY, Windle M, Schainker LM. A model-based cluster analysis approach to adolescent problem behaviors and young adult outcomes. Development and Psychopathology. 2008;20:291–318. doi: 10.1017/S095457940800014X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muthén B. Second-generation structural equation modeling with a combination of categorical and continuous latent variables. In: Collins LM, Sayer AG, editors. New methods for the analysis of change. American Psychological Association; Washington, DC: 2001. pp. 289–322. [Google Scholar]
- Preacher KJ, Hayes AF. Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods. 2008;40:879–891. doi: 10.3758/brm.40.3.879. [DOI] [PubMed] [Google Scholar]
- Richters JE. The Hubble hypothesis and the developmentalist's dilemma. Development and Psychopathology. 1997;9:193–229. doi: 10.1017/s0954579497002022. [DOI] [PubMed] [Google Scholar]
- Rosenthal R, Rubin DB. A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology. 1982;74:166–169. [Google Scholar]
- Sampson RJ, Laub JH. Seductions of method: Rejoinder to Nagin and Tremblay's “Developmental trajectory groups: Fact or a useful statistical fiction?”. Criminology. 2005;43:905–913. [Google Scholar]
- Shockley K. Cross recurrence quantification of interpersonal postural activity. In: Riley MA, Van Orden GC, editors. Tutorials in contemporary nonlinear methods for the behavioral sciences. NSF.; Washington, DC: 2005. [April 16, 2009]. pp. 143–177. from http://www.nsf.gov/sbe/bcs/nmbs/nmbs.jsp. [Google Scholar]
- Sterba SK, Bauer DJ. Matching method with theory in person-oriented developmental psychopathology research. Development and Psychopathology. 2010;22:239–254. doi: 10.1017/S0954579410000015. [DOI] [PubMed] [Google Scholar]
- Stritzke WGK, Patrick CJ, Lang AR. Alcohol and human emotion: A multidimensional analysis incorporating startle-probe methodology. Journal of Abnormal Psychology. 1995;104:114–122. doi: 10.1037//0021-843x.104.1.114. [DOI] [PubMed] [Google Scholar]
- Thelen E, Smith LB. A dynamic systems approach to the development of cognition and action. MIT Press; Cambridge, MA: 1994. [Google Scholar]
- Tomarken AJ, Waller NG. Potential problems with well fitting models. Journal of Abnormal Psychology. 2003;112:578–598. doi: 10.1037/0021-843X.112.4.578. [DOI] [PubMed] [Google Scholar]
- Vaschillo EG, Vaschillo B, Lehrer PM. Characteristics of resonance in heart rate variability stimulated by biofeedback. Applied Psychophysiology and Biofeedback. 2006;31:129–142. doi: 10.1007/s10484-006-9009-3. [DOI] [PubMed] [Google Scholar]
- von Eye A. Developing the person-oriented approach: Theory and methods of analysis. Development and Psychopathology. 2010;22:277–285. doi: 10.1017/S0954579410000052. [DOI] [PubMed] [Google Scholar]
- von Eye A, Bergman LR. Research strategies in developmental psychopathology: Dimensional identity and the person-oriented approach. Development and Psychopathology. 2003;15:553–580. doi: 10.1017/s0954579403000294. [DOI] [PubMed] [Google Scholar]
- Webber CL, Jr., Zbilut JP. Recurrence quantification analysis of nonlinear dynamical systems. In: Riley MA, Van Orden GC, editors. Tutorials in contemporary nonlinear methods for the behavioral sciences. NSF.; Washington, DC: 2005. [April 16, 2009]. pp. 26–83. [Google Scholar]