Abstract
The conventional view on interventions as mechanistically causing interchangeable clients to get better has come under attack. Group-based and linear approaches fall short in adequately describing the idiosyncratic and dynamic nature of treatment processes. Non-linear dynamic system theories in contrast hold great potential to better conceptualize and understand the generalities and idiosyncrasies of psychotherapeutic change processes. The aim of this study was to examine whether we can detect markers of complex dynamical systems behavior in two single-case therapies. All sessions from both therapies were coded with sequential plan analysis using a 10s sampling frequency. The coding system incorporates verbal and non-verbal behaviors and allows for the representation of contextualized interactive behaviors. The high sampling frequency results in long time series, which allowed us to apply non-linear analysis techniques. We found strong support for complex behavior and the existence of a butterfly effect, i.e., a relatively short prediction horizon in which reliable predictions about the system’s future behavior could be made. Further, critical fluctuations as a marker for phase-transitions were detected that were accompanied with different interactional patterns in both therapies. Finally, there was strong support for self-organized pattern formation, with a few interactional patterns dominating the interaction. Considering that we are intervening on complex dynamical systems means that we have to (1) acknowledge the principal individuality of change processes, (2) accept the fundamental limitations of the mechanistic input-output model of treatment effects and (3) appreciate the impossibility of long-term predictions of treatment responses.
Keywords: non-linear dynamic system theories, process research, client-therapist interaction, complexity, self-organization, critical fluctuations
Introduction
Since 1995 empirically supported therapies (ESTs) has become the buzzword for evidence-based practice (Task Force on Psychological Intervention Guidelines, 1995). It is hard to argue against the fact that finding out what may work or not work for any given client at any given time is of crucial importance for clinical practice. The question of what counts as good evidence, however, is the source of ongoing and heated debate ever since the inception of the term empirically supported therapies (Carey & Stiles, 2016; Chambless & Ollendick, 2001; Duncan & Reese, 2012; Shedler, 2018; Westen, Novotny, & Thompson-Brenner, 2004). Influenced by evidence-based medicine and rooted in a medical view on mental disorders and interventions, the dominating approach of evaluating ESTs has been group-based and symptom-reduction focused (van Os et al., 2019). From this perspective treatment is understood as one uniform process, as if it were a type of prescribed pill that works the same for everyone (Stiles & Shapiro, 1989). The underlying claim of causality is one of intervention causality (Carey & Stiles, 2016; Van Geert & Steenbeek, 2014). That is to say, when we find an effect, which takes the form of differences between group averages, this is seen as an intrinsic property of the manipulated variable (i.e., the intervention). The reasoning continues that if the effect ‘force’ lies in the intervention itself, the effect should apply to every single subject in the group. From this point of view the goal is to optimize and to control interventions. Manualized treatment programs are thought to guarantee the quality of interventions and to avoid unintended variability of effects caused by client or therapist factors, or arbitrary environmental inputs. Within this tradition, randomized controlled trials are seen as the gold standard to test the effectiveness of interventions, because it is thought that through randomization and experimental or statistical control of error variance, the influence of unintended factors is eliminated.
This view on psychological interventions “…as comprising active ingredients, supplied by the therapist to the client…” (Stiles & Shapiro, 1989, p. 522) has come under serious attack, not the least by advocates of common or non-specific factors research. The idea of active ingredients has been challenged by various meta-analyses demonstrating that the effect of treatment-specific elements and intervention manuals is actually smaller than non-specific factors such as therapeutic alliance, treatment expectation or allegiance, and resources or stressors in the client’s everyday environment (Luborsky & Singer, 1975; Orlinsky et al., 2004; Wampold, 2015; Wampold & Imel, 2015). Several studies have demonstrated that clinical improvement is not necessarily ‘triggered’ by certain specific interventions (Bozog & Bühler, 1988; Orlinsky & Howard, 1987) and significant changes in symptoms often occur before specific interventions are being applied (Heinzel et al., 2014; Kelly et al., 2007; Kelly et al., 2005). Moreover, adherence to treatment protocols does not seem to matter much and in fact produces only small effect sizes (Owen & Hilsenroth, 2014; Wampold, 2015). Similarly, so-called component studies (dismantling or additive studies) show that components of treatment programs can be rearranged or even eliminated without affecting the overall effectiveness of the treatment (Ahn & Wampold, 2001; Bell et al., 2013; Bozog & Bühler, 1988; Wampold, 2015; Wampold & Imel, 2015).
Further, the primary focus on the therapist and his or her techniques as the causal mechanism of change has been fundamentally questioned by more humanistic accounts of clinical change, which state that “it is the client who makes therapy work” (Bohart & Tallman, 2010; p. 94; but also Duncan et al., 2011; Orlinsky & Howard, 1987). Client factors in fact account for the largest proportion of variance in therapeutic outcome, varying from 40% (Asay & Lambert, 1999) up to 87% (Wampold, 2013). Additionally, empirical findings on self-generated care, spontaneous recovery, placebo effects and posttraumatic growth further support the role of the client as an active agent in his or her personal change process (for an overview, see Bohart & Tallman, 2010). Against this background it is hard to assume that clients are passive, inert and interchangeable objects upon which techniques are administered that mechanistically cause them to get better.
Recently, a renewed emphasis on non-linear dynamic systems accounts of psychopathology can be observed in the field of psychiatry and clinical psychology (Cramer et al., 2016; Granic & Patterson, 2006; Hayes & Strauss, 1998; Hayes et al., 2015; Nelson et al., 2017; Schiepek, 2003; Schiepek et al., 1997; Schiepek & Strunk, 1994b; Strunk & Schiepek, 2006, 2014; Tschacher et al., 1992; Walter et al., 2010). This view is not new to psychology (e.g. Koffka, 1922; Lewin, 1935, 1951), but empirical work based on non-linear dynamic systems is still scarce (see Schiepek, Heinzel, et al., 2016).
In contrast to the medical disease model, which (implicitly) conceptualizes psychopathology as some sort of static and discrete entity, these approaches share the assumption that psychopathology is an emergent state, a dynamically stable higher-order (macro) state, that evolves over the course of time through self-organization processes of lower-order (micro) elements (Haken, 1977). From this perspective it follows that we have to reconsider the mechanistic perspective on intervention effects and move beyond simple one-way cause effect models (such as the well-known Stimulus-Response-Consequence model; for an excellent discussion of this point see Miller et al., 1960) and linear change models. Linear systems, regardless of how complicated they are, can only produce simple behavioral patterns (i.e., monotonic increase/decrease and simple cycles). Psychological processes including treatment processes, however, are erratic (an der Heiden, 1992; Hayes et al., 2007; Mackey & an der Heiden, 1982), unpredictable and non-trivial (von Foerster, 1970). Non-linear dynamical systems theory and applications thereof have proven their merit in understanding a host of phenomena observed in living systems (an der Heiden, 1992; Babloyantz & Destexhe, 1987; Deutsch, 1994; Freeman, 2000; Haken, 1977; Lotka, 1925; Mackey & an der Heiden, 1982; Olsen et al., 1988; Paluš et al., 2001; Scheffer et al., 2009; Scheffer et al., 2012; Thelen & Smith, 1994, 2006; Thelen & Ullrich, 1991). We therefore suppose that a non-linear dynamic systems approach holds great potential to better understand the generalities and idiosyncrasies of psychotherapeutic change processes. Key properties of non-linear dynamic systems that are relevant to the study of psychotherapeutic change processes are complexity, self-organization and phase transitions.
Complexity
The most prominent property of a non-linear dynamical system is self-organized complexity. It came as a big surprise when for certain mathematical systems, which today are referred to as non-linear dynamical systems, it was discovered that these systems on the one hand exhibit orderly and patterned behavior and at the same time also show behavior that is highly erratic and unpredictable (Strunk, 2019; Strunk & Schiepek, 2006, 2014). The basic nature of non-linear dynamical systems is that variables are dynamically related, which means that variables act upon one another and by doing so change their properties. The very fact that elements are dynamically related creates positive and negative feedback1 processes among those elements. In non-linear dynamical systems, we have a very peculiar situation, in which we can observe positive and negative feedback processes occurring simultaneously (i.e., mixed feedback, an der Heiden & Mackey, 1987), and it is precisely this mixture of positive and negative feedback processes that makes the behavior of non-linear dynamic systems complex (see the discussion in Strunk, 2019).
An essential feature of complexity is that even if we know all the elements of the system and the rules that govern the interactions of those elements, our (long-term) prognosis of future behavior of the system will be poor (Lorenz, 1963, 1972; Poincaré, 1890, 1904; Ruelle & Takens, 1971; Strunk & Schiepek, 2014). Take for example the weather, a well-known non-linear dynamical system (Lorenz, 1963), where a forecast is reliable for two days ahead but prediction after that time window becomes highly uncertain and unreliable. One of the reasons for the fundamental long-term unpredictability is the sensitive dependency of the dynamics on its initial conditions and on small fluctuations during the process (the so-called ‘butterfly effect’, Lorenz, 1963, 1972).
Non-linear dynamical systems are thus often exhibiting highly complex dynamical patterns, which are generated by the interplay of the variables within the system. This means that complexity is the result of self-organizational processes and therefore also shows characteristics of well-organized order. Hence, order and complexity are two sides of the same coin in non-linear dynamical systems.
Self-organization
Complexity and order in non-linear dynamical systems theories are not explained as the result of external causes (like a stimulus that triggers conditioned behavior) but as a result of processes in which the system organizes itself. Key to self-organization is that there is no ‘master plan’ or internal prescription that dictates the possible states of the system (Haken, 1977). Rather, self-organization processes among micro elements lead to the emergence of certain temporal, spatial and functional macroscopic structures (i.e., order parameters), which in their turn constrain and enslave the interactions among the micro elements (Haken, 1977). Although potentially there is an infinite number of possible states, self-organization predicts that a number of dominant states will emerge due to the internal dynamics of the system (Haken, 1977; Prigogine, 1955; Prigogine & Stengers, 1984). Therefore, the result of a self-organization process of a system can be viewed as an equilibrium state such as in Piaget’s model of a “schema” (Bartlett, 1932; Piaget, 1977) or a “gestalt” with respect to gestalt-theory (e.g. Koffka, 1922; Lewin, 1935, 1951). A system develops a self-organized pattern (schema, gestalt), also called an attractor state, and is able to protect this pattern against external and internal disturbances. Such an attractor can be a beneficial and positive state but also a problematic and hindering pattern. Consequently, psychotherapy can be seen as changing self-organized patterns by a process called phase-transition.
Phase transition as a model for therapeutic change
Non-linear dynamical systems are multi-stable, that is, they have the property to show very different behavioral patterns. The self-organization process described above can produce qualitatively different attractor states depending on the influences of the internal or external system environment (so called control-parameters). In addition, such systems can switch between different attractor states, which is called a ‘phase transition’. During a phase transition the system first loses its ability to defend its pattern against external influences (critical slowing down, Haken, 1977, p. 110; Haken, 1990, p. 9), after which a new self-organizing process kicks in. At the micro level the system searches for a new attractor state by exhibiting numerous possible patterns (critical fluctuations, Haken, 1990, p. 9, Haken & Schiepek, 2006; Schiepek & Strunk, 2010). This increased variability allows for new configurations to emerge or to be discovered (for a similar argument see Thelen & Smith, 1994; Van Geert & Van Dijk, 2002). After a short while negative feedback loops are setting in and stabilizing the system in a newly developed dominant macroscopic structure. The occurrence of critical fluctuations is therefore a marker of a system undergoing a phase transition, which in the case of a psychotherapeutic process is a necessary condition for a positive change. This conception resonates well with theories from the psychotherapy literature, in which the general goal of therapy is often described as breaking down a rigid psychopathological state and shaking loose old patterns, to trigger a qualitative shift towards more healthy and flexible patterns of functioning (Carey, 2011; Hayes & Strauss, 1998; Hayes et al., 2015; Mahoney, 1991).
Based on these characteristic properties of non-linear dynamical systems behavior the aim of the current study was to demonstrate that therapeutic processes indeed exhibit characteristics of complex behavior generated by a non-linear dynamical system. In particular we focused on one specific therapeutic process: the therapeutic relationship between client and therapist. We have chosen this particular process because it is widely accepted that the therapeutic relationship (also referred to as alliance) is one of the key processes within treatment across different theoretical orientations. The therapeutic relationship is not separate from any specific intervention, rather the relationship is “an essential and inseparable part of everything that happens in therapy” (Horvath et al., 2011, p. 15). Psychotherapy can be understood as a special interpersonal relationship that takes place under certain professional conditions (cf. Czogalik, 1989, 1991). The effort of therapists to establish a fruitful relationship, on the basis of which psychotherapy can take place, thus becomes a means which itself generates therapeutic changes and provides the foundation for further change to occur (cf. already Bordin, 1979; Horvath & Luborsky, 1993; Rogers, 1957).
In the current study we have taken a micro perspective on the therapeutic relationship, that is, we were interested in the dynamics of the therapeutic relationship as it unfolds within the interaction between client and therapist across the entire course of a treatment trajectory. More specifically, micro-coded therapy sessions (10s intervals) of two client therapist dyads were analyzed to investigate if we can detect markers of complex dynamical systems behavior in those therapeutic interactions. We expected to find the following generic markers of non-linear dynamical systems: (1) complex behavior and limited long-term predictability (i.e., butterfly effect), (2) the occurrence of critical fluctuations as a marker for phase-transitions and a necessary condition for therapeutic change, and (3) self-organized pattern formation. The results presented here are an excerpt and new compilation of results that were earlier published in German only by Strunk (2004; see also Strunk, 2006;Strunk et al., 2006).
Methods
Case Descriptions
In this study two therapies were selected, provided by an experienced male therapist (age = 40), working with systemic solution-oriented brief therapy (de Shazer, 1985) at the Psychological Research and Counselling Centre of the University of Bamberg, Germany.
Therapy I
This therapy lasted 13 sessions. The client was female, in her late 20s, married and mother of a 2-year-old son. She came into therapy because she wanted to become more assertive, being better able to defend and protect herself against the demands of her husband, family, and parents-in-law. She felt rejected by her mother-in-law, which undermined her confidence in being a good mother. In conflict situations with her family, she felt overwhelmed and helpless and reacted with physical complaints (stomach problems, tachycardia, sweating, circulatory disorders). From the 9th session onwards improvements became visible. She started to regularly take some time for herself, payed more attention to her diet, got involved in a mothers’ initiative and started following courses for professional development. Nevertheless, according to the client the therapy was only partly successful because she still suffered from several complaints at the end of treatment.
Therapy II
This therapy lasted 9 sessions. The client was female, in her mid 30s, living in a second marriage with her son (age unknown) from the first marriage. Her primary concern was the conflictual relationship with her husband. Her stance towards the recurring conflicts was very ambivalent. On the one hand she had a high need for harmony, but at the same time she felt helpless and incompetent. Next to the relationship problems, other problems (i.e., agoraphobic behavior patterns) were also the focus of therapy. She further wanted to clarify her goals and gain a better sense of what she wanted to accomplish in life. Improvements were visible from the 7th session onwards and intensified in the 8th session. At the end of therapy her personal goals were reached and her life satisfaction had improved substantially.
Coding
All therapy sessions were video-recorded and transcribed. The transcripts not only included verbal information but also non-verbal (gestures, posture, gaze direction) and para-verbal aspects (pitch, volume, intonation). The raw data (video-recordings and transcripts) was coded with a method called sequential plan analysis (first published in Richter et al., 1994; Schiepek, Schütz, et al., 1995; Schiepek & Strunk, 1994a, 1994b; Schiepek, Strunk, et al., 1995), which is based on Caspar’s static plan analysis (Caspar, 1986, 1995). The plan concept was first introduced by Miller et al. (1960) who defined a plan as a unit that includes a goal and the means chosen in order to reach the goal. Thus, an interactional plan is one used to reach interactional goals like the search for help from others or to give advice to others. In the context of the current study the sequential plan analysis was used to describe the client’s and therapist’s aims and means of shaping the therapeutic relationship.
Naturally, interactional goals and the means to reach them are person-specific, that is they differ from person to person, and they are contextualized, that is they are embedded within a specific relational context. Thus, accordingly and in contrast to many other quantitative coding systems there are no predefined categories that are used for everyone, but a plan analysis is developed inductively from the raw data for each individual case, which makes it more similar to qualitative content analysis. Categories are first treated as hypotheses about the goals and means a person is trying to achieve. These hypotheses are then continuously tested and validated in an iterative process.
Next to being person-specific, the sequential plan analysis is also hierarchical. At the lowest level are the so-called operators in which all aspects of the conversation, verbal, non-verbal, and para-verbal, of client and therapist, are considered. These operators are thus the concrete behaviors of client and therapist and form the foundation of the sequential plan analysis, which are coded in – in our case – 10s intervals. Inductively these operators are then interpreted as concrete means for the first-level plans. For example: client behaviors such as looking at the therapist, leaning back, and asking “how should I behave?”, and on another occasion asking “is this normal?”, were interpreted as concrete means for the first-level plan ‘Request advice’. Other concrete operators such as “I am afraid of getting sick” and “I worry about the future” were grouped into another first-level plan ‘Express your fears’. As we move up in the hierarchy of the plans these two first-level plans are aggregated into more abstract second-level plans, in this case: ‘Ask for help’. The highest level of the hierarchy represents categories of more superordinate goals of how one wants to present oneself as a social being within the interactional context. In this particular case the two second-level plans ‘Ask for help’ and ‘Refer to external causes for your problems’ were grouped into the self-presentation category ‘Demonstrate helplessness’. The levels are thus becoming increasingly abstract, whereas the low levels are strongly connected to the concrete behaviors (i.e., the operators).
Importantly, each of the operators is exclusively attached to one particular first-level plan, as are first-level plans exclusively assigned to one of the second-level plans. In sum, the plan analysis results in a hierarchy of (1) operators as behavioral indicators for (2) first-level plans, and (3) second-level plans, which consist of a set of first-level plans. Finally, (4) second-level plans are aggregated into general self-presentation categories (Friedlander & Schwartz, 1985) as top-level plans. See Figure 1 for the schematic structure and an example of a sequential plan analysis.
Sequential plan analysis extends the static plan analysis developed by Caspar (1986, 1995) with a temporal dimension, that is, one indicates which interactional plan is activated at any given time point. In the current study, therapy sessions were coded in 10s intervals, in each of which the operators were coded based on the hierarchical structure outlined above, such that each interval received a 0 or 1 for each plan to indicate whether it was activated within that interval or not. This results in dichotomous (activated, not activated) and multi-dimensional (several plans can be activated at the same time) time series, one for the therapist and one for the client (see Figure 2). Note that whether several operators, serving the same plan, are active simultaneously is not visible here. A plan is considered activated (and thus receives a 1) as soon as one operator is coded within the time frame. In order to generate a more fine-graded time series, the active behavioral operators were counted and weighted on the basis of a 5-step rating scale. A cautious look for instance was rated with a 1 for the plan ‘Request advice’ whereas a clear verbal statement asking for advice was rated as a 5 for the plan ‘Request advice’. At the top-level (i.e., the self-representation categories), the behavioral operators and their weightings were added (weighted sum of activated operators) to produce finely graduated time series (for illustration see figure 3a and 3b).
Strategy of Analysis
Explorative descriptive representations include time activation patterns of plans (so-called plan scores, similar to music scores) and time series of the self-presentation categories (top-level plans) as well as product moment correlations between the therapist’s and client’s self-presentation categories. All data coding, data processing and analyses were performed with software programmed by Guido Strunk, especially GChaos (www.complexity-research.com), a software for non-linear time series analysis.
(1) Identification of complex behavior and limited long-term predictability
Several ways exist to determine the degree of complexity in a given data set. The presence of a butterfly effect, which is – mathematically speaking – an exponential divergence of trajectories, is the gold standard in order to demonstrate the complexity of a time series. The butterfly effect can be estimated using several methods (e.g., Kantz, 1994; Rosenstein et al., 1993; Wolf et al., 1985). But the common ground is that one starts by searching for two points within the time series that are maximally similar to each other. From those two starting points the system’s behavior is closely monitored to see whether the trajectories converge (conservative system with no complexity) or diverge exponentially (butterfly effect, a sign of complexity). In the case of a random process the divergence is instantaneously at its maximum. So the method is able to distinguish between order, complexity and randomness (see also Strunk, 2009) by modeling the convergence or divergence of trajectories with an exponential function. The value of the exponent (i.e., the largest Lyapunov Exponent, LLE) is a measure of the complexity of the system.
Since exponential growth is characterized by very little change in the beginning and then a rapid divergence, like an avalanche, the time period until the avalanche starts is the predictive horizon of the system – that is, the time window in which we can make accurate predictions about the system’s future behavior. The algorithm of Rosenstein, Collins and de Luca (1993) as implemented in GChaos was used to estimate the LLE and the predictive horizon. The therapist’s and client’s time series were analyzed separately and changes in LLE over time were estimated in a moving window of 500 data points. Surrogate data analysis was used to test whether the butterfly effect was the result of the temporal organization of the data. The main idea behind surrogate data analysis is that we want to compare our particular non-linear metric (i.e., LLE) estimated from the available time series to the distribution of the same metric obtained from a large number of time series (i.e., surrogate data) that satisfy the null hypothesis of a random process with the same statistical moments as the original time series (Schreiber & Schmitz, 2000).
(2) Critical fluctuations and structural changes
The strength of the butterfly effect (i.e., the LLE) can change over the course of a time series. The standard deviation of the LLE within a given time point can be used as an indicator for the presence of critical fluctuations (i.e., a peak in the standard deviation of the LLE indicates critical fluctuations). We used a 50 data point moving window to calculate the changes in the standard deviation of the LLE. These changes were then correlated with changes in the self-representation categories in order to examine the structural changes in interactional plans that were associated with critical fluctuations.
(3) Self-organized pattern formation
In order to investigate if the plan activations follow a self-organized pattern formation we looked at the frequency distributions of the on-off patterns of second-level plans. As we have explained earlier several (second-level) plans can be activated (and not activated) at the same time. This means that at any given time in the therapy many different patterns are possible, each representing a specific combination of activated plans. We can then use the simple logic of combinatorics to estimate what the expected likelihood of any given combination would be and test this expected likelihood against the observed frequency distribution of the combinations. If the observed patterns (combinations of activated second-level plans) are indeed the result of self-organized pattern formation we expect to find a frequency distribution that follows a power-law function, with some patterns occurring extremely often and some occurring only rarely.
It is important to emphasize that the methodological approach that we have chosen should be considered as just an example. It is one way of analyzing psychotherapeutic processes against the background of non-linear dynamic systems theories and principles. There may be other methods and analytical approaches that are equally suited to address similar or related research questions. Additionally, individual case analyses are unsuited to prove the existence of certain phenomenon once and for all. They can show, however, whether a phenomenon exists at all and whether the existence in the given individual cases gives reason to assume that similar phenomena should at least be expected in other cases.
Results
Descriptive Results
The time series of Therapy I (13 sessions) comprised 3450 time points and Therapy II (9 sessions) contained 2030 time points, sampled at 10s intervals. Both therapies were coded with a total of 17 second-level plans (10 therapist, 7 client) and 7 self-representation categories (top-level plans, 4 therapist and 3 client). The therapist’s plans – both second-and top-level – were identical across both therapies. Both clients also had identical self-representation categories (top-level) but three of the seven second-level plans were of different content. A plan score of the second-level plans for a section of both therapies are shown in Figure 2. The time series of the self-representation categories are shown in Figure 3a and 3b.
When we look at the evolution of the self-representation categories over time (see Figures 3a and 3b) we can immediately see that there are no clear trends or patterns in the time series. They look erratic.
Also the association between the client’s and therapist’s self-representation categories over time does not reveal any clear pattern. In Figure 4 the correlation, calculated in a moving window of 50 data points, between the therapist's self-representation category ‘I. Encourage trust / create secure atmosphere’ and the client’s self-representation cat-egory ‘III. Problem-oriented work (self-relatedness vs. avoidance)’ is displayed. The average correlation is r=.03 (n.s.) but varies dramatically between -.44 (p= .001) and .60 (p< .001)
Identification of Complex Behavior and Limited Long-term Predictability
The separate analysis of client and therapist as well as the analysis of the entire therapy time series revealed clear signs of a positive LLE, which indicates the presence of a butterfly effect. The median LLE (the median is given here because the LLE changes in time) for Therapy I was 0.2 bit/sample (min = .03 bit/sample, max = .4 bit/sample) and for Therapy II the median was 0.3 bit/sample (min = .1 bit/sample, max = .4 bit/sample). This means that after 10 to 15 time steps, the maximum divergence of closely located starting points is reached and hence, after 150 seconds (2.5 minutes) at the latest, due to the butterfly effect a prediction of the system behavior is no longer possible. The results of the surrogate test showed that no LLE could be determined for the shuffled data sets which means that the LLE results for both therapies are indeed due to the temporal and non-linear structure of the data and are not based on random processes.
Critical Fluctuations and Structural Change
The strength of the butterfly effect changes abruptly during the course of both therapies. Plotting the standard deviation of the LLE, calculated in a 50 data point moving window, across the therapies reveals sudden increases of critical fluctuations several times over the course of the therapies. These sudden increases of critical fluctuations occur partly synchronously and partly independently between client and therapist. If the four largest rashes are marked, two of them occur simultaneously in the therapist and client time series, meaning that therapist and client are critically fluctuating at the same time (see Figure 5).
In Table 1 correlations between the increase in critical fluctuations and the seven self-representation categories is presented. In Therapy I critical fluctuations in the client’s time series were accompanied by increases in confrontation by the therapist. At the same time the client’s problem solving went down and helplessness increased. The therapist increasingly refrained from demanding her personal responsibility and instead tried to convey security. Overall, correlations between the client’s critical fluctuations and the self-representation categories are not that high in Therapy I, but it seems that in times of critical fluctuations the client in Therapy I feels overwhelmed, being drawn towards a behavioral pattern that is not very helpful for her therapeutic progress.
Table 1.
Therapy I | Therapy II | |||
---|---|---|---|---|
Client | I. Search for sympathy / appreciation /good relationship | Correlation P (2-tailed) N |
-.094 .000 2846 |
-.377 .000 1476 |
II. Externalization / demonstration of helplessness | Correlation P (2-tailed) N |
.104 .000 2846 |
-.217 .000 1476 |
|
III. Problem-oriented work(self-relatedness vs. avoidance) | Correlation P (2-tailed) N |
-.245 .000 2846 |
-.282 .000 1476 |
|
Therapist | I. Encourage trust / create secure atmosphere | Correlation P (2-tailed) N |
.117 .000 2846 |
-.299 .000 1476 |
II. Confrontation / exposing to insecurity | Correlation P (2-tailed) N |
.249 .000 2846 |
.537 .000 1476 |
|
III. Encourage self-responsibility of the client | Correlation P (2-tailed) N |
-.127 .000 2846 |
.585 .000 1476 |
|
IV. Active structuring work | Correlation P (2-tailed) N |
-.047 .011 2846 |
.580 .000 1476 |
In Therapy II we can observe a quite different pattern. Again, increases in critical fluctuations of the client were associated with increases in confrontation by the therapist, but also increases in the therapist’s promotion of the client’s personal responsibility and active structuring of the therapeutic work. At the same time the therapist’s provision of trust and security went down. The client on the other hand, similar to Therapy I showed decreases in problem solving but also reductions in seeking approval and demonstrating helplessness. Overall, correlations were substantially higher in Therapy II and the pattern seems to suggest that this client is not overwhelmed in times of critical fluctuations, and that client and therapist fall into a behavioral pattern that promotes client empowerment and constructive therapeutic work.
Self-Organized Pattern Formation
In addition to indicators of chaos and complexity, the data also clearly demonstrate self-organized pattern formation. In both therapies, therapist and client deviate significantly from a random on-off pattern and show a characteristic profile of pattern occurrence. That is, there are very few patterns that occur with a very high frequency after which the frequency of patterns decreases based on a power-law function, meaning that there are numerous patterns that occur only very rarely, i.e., once or twice over the entire therapy sessions (see Figure 6).
In Therapy I the most frequent pattern (n = 418, 12% of overall time samples) shown by the client was a combination of the following second-level plans: ‘Make it clear that you had a hard time’, ‘Be a good client’, ‘Demand help from the therapist’ and ‘Show interest in solving your problems’. This pattern characterizes her as a committed client who is willing to work and at the same time demands support. In five of her therapy sessions (session 6, 8-10, 12) this pattern was the most frequent state and in all other sessions this pattern was among the seven most frequent observed states. Only the last session (session 13) forms an exception in that this particular pattern was rarely observed.
The most common therapist behavior in Therapy I is characterized solely by the second-level plan ‘Activate her’ (n = 405; 12%), which belongs to the self-representation category ‘Promoting the client’s personal responsibility’. All other frequently occurring patterns also center around this second-level plan (i.e., active her). Up until the 12th session it is the most frequently observed second-level plan, being present in every constellation. The therapist-client interaction seems to center around a theme of the client being cooperative but at the same time being afraid, and resistant. The therapist tries to activate her and encourages her to cooperate. Many of his interactional efforts are grouped around this goal.
In Therapy II the most frequently observed client pattern (n = 647; 32%) is made up of the two second-level plans: ‘Demonstrate helplessness/search for compassion/support’ and ‘Show interest and willingness to solve your problems’. This combination presents her as a committed client seeking help and being willing to actively participate in the therapy. This plan constellation was the dominating pattern across all sessions. The most common therapist behavior is characterized by the second-level plan ‘Motivate her’ (n = 306; 15%), which nicely fits with her willingness to cooperate.
Discussion
In this article we presented data of two single cases of therapeutic processes which in fact share key characteristics of non-linear dynamical systems: First and as expected, the interactional process between client and therapist showed clear signs of complexity. At first sight, when looking at the evolution of the self-representation categories and the association between therapist and client categories over time, no clear patterns and trends could be detected. It is evident that aggregating across time and/or subjects and applying linear analysis techniques would not reveal any meaningful information about this complex process (see also Fisher et al., 2018; Molenaar, 2004; Strunk, 2005 for a similar argument).
Analysis of the butterfly effect showed that the predictive horizon in which reliable predictions about the system’s future behavior could be made was relatively short.After 2.5 minutes the trajectories of closely located starting points were totally divergent. The analyses presented here were based on two single cases and the predictive horizon within those cases. A related question with high clinical relevance is the relative divergence (i.e., butterfly effect) across clients with similar starting points. In other words, do clients with for example the same diagnosis show similar change trajectories? The answer seems to be no, they do not. An initial investigation by Strunk and Schiepek (2014) based on client’s daily self-ratings of the therapeutic process and analyzed with a method called Cross-LLE showed that after 5-6 days a maximum divergence was reached. Thus, trajectories of clients with the same diagnoses started to diverge after only a few iterations. This finding is in line with a recent study by Rubel and colleagues (2019) who used the nearest neighborhood approach to identify clients with similar pretreatment characteristics to improve predictions of individual clients. Results showed that the approach did not improve predictions, which we think is due to the butterfly effect. Only slight differences in starting conditions can lead to totally divergent trajectories.
Second, we found evidence of the presence of critical fluctuations and found that these periods were associated with distinct interactional patterns in both therapies. In both cases critical fluctuations were associated with confrontation from the therapist. In Therapy I, however, the client responded with increased helplessness and reduced problem solving, and the therapist increased his provision of security and refrained from demanding her responsibility. This was the therapy that was deemed less successful. In Therapy II a different pattern was observed. In times of critical fluctuations, the client showed decreases in problem solving but also reductions in seeking approval and demonstrating helplessness. The therapist on the other hand increased active structuring of the therapeutic work and promotion of responsibility. This pattern might suggest a more constructive therapeutic interaction resulting in a better treatment outcome. The finding of the existence of critical fluctuations is in line with previous work using different time scales and analytical techniques (e.g., Fartacek et al., 2016; Haken & Schiepek, 2006; Hayes & Strauss, 1998; Hayes et al., 2015; Leemput et al., 2014; Lichtwarck-Aschoff et al., 2012; Olthof et al., 2019; Schiepek, Eckert, et al., 2016; Wichers et al., 2016). These studies moreover suggest that periods of critical fluctuations and destabilization are associated with better treatment outcomes, which supports the claim that successful therapy indeed involves a (cascade) of phase transitions.
Finally, the frequency distribution of the various plan activation combinations showed clear signs of self-organized pattern formation. In both therapies frequency distributions clearly deviated from a random pattern and instead showed a power-law function, with a few plan activation combinations dominating the interaction. In sum, this unprecedented data set of two cases with high-quality and high-density data allowed us to test formal predictions of non-linear dynamic systems theories and we found clear markers of complex dynamic behavior.
It is important to note that single case studies by definition are unsuited to tell us how frequent a certain phenomenon is and whether the phenomenon can be generalized to other cases. Rather single case studies are designed to demonstrate the existence of a phenomenon in the cases investigated. This represents sort of an opposite to the classical discussion between Popper (1959) and the logical empiricists; hypotheses concerning the existence of something are never completely falsifiable, but can be verified by a few proofs (cf. Groeben & Westmeyer, 1975).
Against the background of our results and similar findings in the literature (e.g., Fartacek et al., 2016; Olthof et al., 2019; Wichers et al., 2016), we advocate that at least the possibility of chaos in psychotherapeutic processes should be considered. This does not mean that we can assume that every therapy necessarily shows characteristics of chaos, non-linearity and phase-transitions, but that at least the possibility of chaos exists. In that sense our two case studies should be considered as convincing ‘counterexamples’ to falsify the simplified one-way cause effect and linear change models now dominating the field of intervention science. Our case studies demonstrate that this framework does not hold given the observed data and that we should expand our theoretical conception of intervention effects and the (long-term) predictability of treatment trajectories.
First, under conditions of non-linearity treatment can no longer be seen as a separate causal factor mechanistically producing (linear) relations between input (e.g., dosage, technique) and output (e.g., improvements in symptoms), but a factor whose functional role is dynamically embedded in an idiosyncratic network of multiple components. In that sense, causality is placed within the system rather than outside, independent of the system’s dynamic. Consequently, applying interventions with expectable outcomes and ‘controlling’ treatment processes becomes impossible and hence an attitude of modesty and humility towards the feasibility of goal-directed change is warranted. Rather than pushing interventions on clients, non-linear dynamic systems theories imply that psychotherapy has to provide conditions for self-organization to occur (Gelo & Salvatore, 2016; Haken & Schiepek, 2006; Hayes et al., 2015; Pincus, 2009; Schiepek & Strunk, 1994b; Strunk & Schiepek, 2002).
A detailed description of these conditions is beyond the scope of this article, and descriptions with much greater detail can be found elsewhere (see Haken & Schiepek, 2006; Hayes et al., 2015; Strunk & Schiepek, 2014). But it may be worthwhile for future research to learn from physical systems and experiments about how change is brought about in these systems. Basically, these conditions have to do with the activation of control parameters, creating stable boundary conditions, destabilization and amplification of deviating feedback and stabilization of new attractors (Strunk & Schiepek, 2014). A crucial point in the understanding of interventions from a nonlinear dynamic system perspective – and especially when it comes to personalization of treatment – is their sensitivity to the process. In other words, equally important as the question of what kind of treatment approach is realized is the question of when certain interventions take place (process-sensitivity) (see Nahum-Shani et al., 2015 for a similar argument). From this point of view, manualized and pre-defined treatments may be contra-productive.
Second, our results suggest that a client’s behaviour and response to treatment is unpredictable, at least in the long run. Certain starting values and conditions (e.g. pre-treatment conditions such as diagnosis) lose their predictive power only after a short period of time. Consequently, navigating a client’s treatment process becomes like driving a car in heavy fog: go very slowly, with maximum attention, ready to stop at any moment (Strunk & Schiepek, 2014). One important implication of this long-term unpredictability is the critical need of high frequency data on a client’s change process, that is (almost) real-time monitoring, to be able to navigate a client’s treatment process under these ‘foggy’ conditions.
In our case we had 10s interval data, a sampling frequency which we realize is hard to implement in everyday clinical practice. In the current study, however, we were interested in the interactional dynamics underlying the therapeutic relationship. If that is the phenomenon one is interested in, such a dense sampling frequency, which allows a capture of the interactional dynamics is what is required (see the work of Ramseyer & Tschacher, 2011 with similar high-frequency data). It is important that the sampling frequency matches the phenomenon of interest (see also Strunk, 1996; Thelen & Ullrich, 1991; Van Geert, 2006 for a similar argument).
There are other therapeutic processes that take place on slower time-scales and hence require fewer data to capture their dynamics. The analytic approaches that we presented here require extremely long time series (e.g., the LLE for instance can only be calculated with time series > 500 data points) but if the focus lies on other – slower – processes one can use different analytical approaches for shorter time series that can still be used to search for markers of complexity. For instance, we have recently conducted a study with daily self-ratings (median 59 days) in a mood disordered sample and have used a complexity algorithm (developed by Schiepek & Strunk, 2010) calculated in a 7-day moving window, which enabled us to detect critical fluctuations that were indicative of phase transitions (Olthof et al., 2019).
Thus, although some of the analytical strategies in the non-linear dynamic systems tool box may require lengths of time series not typically available in the clinical context, we are excited about the methodological advancements for shorter time series and the technological innovations to collect the type of intensive longitudinal data that will eventually lead to converging evidence for the notion of therapeutic processes as complex dynamical processes.
There are now increasingly more studies using experience sampling (i.e., several measurements within a day) or daily sampling procedures to collect intensive longitudinal data (Fisher & Boswell, 2016; Myin-Germeys et al., 2009; Nelson et al., 2017; Schiepek, 2009; van Os et al., 2013; Wichers, 2014; Wigman et al., 2013). Studies in clinical settings demonstrate the clinical feasibility and utility of those personalized, contextualized and dynamic assessments (e.g., M. Bak et al., 2016; Kramer et al., 2014; Palmier-Claus et al., 2013; Schiepek, Aichhorn, et al., 2016). Consideration and close monitoring of the actual system dynamics, based on process-sensitive feedback will allow clinicians to tailor their interventions, that is, to dynamically adjust their intervention efforts to the state that a client is in (see also Nahum-Shani et al., 2015; van Os et al., 2013; van Os et al., 2019).
One of these considerations of the dynamic state that the client is in concerns the identification of critical fluctuations periods that may function as windows of opportunities or sensitive periods in a client’s change process (see the concept of cairos by Haken & Schiepek, 2006; Schiepek, Schütz, et al., 1995 and Granic et al., 2006 for similar argument). An interesting avenue for future research would be to test whether clients are more susceptible to intervention efforts during these destabilization periods compared to more stable periods in the change process. Increased sensitivity to influences during destabilization periods have been demonstrated in other fields (motor science, Haken et al., 1985; Schöner et al., 1986; cognitive performance, Stephen et al., 2009; Kruse et al., 1992; Stadler & Kruse, 1990, learning and didactics Sender, 2017). Also simulation studies of Schiepek and colleagues (Schiepek et al., 2017) illustrate the sensitive dependencies of intervention effects. Thus, rather than assuming that specific therapeutic techniques trigger goal-directed change irrespective of the dynamic state a client is in, non-linear dynamic systems theories predict that it is the stability of a system that determines if inputs will elicit change or not.
To conclude, we here presented two clinical case studies analyzed from a non-linear systems perspective. Although there is a growing interest for a complex dynamic systems perspective in the field, we feel that the radical implications of this approach are not always well appreciated. If we consider that we are intervening on complex dynamical systems it means that we have to (1) acknowledge the principal individuality of change processes, (2) accept the fundamental limitations of the mechanistic input-output model of treatment effects and (3) appreciate the impossibility of long-term predictions of treatment responses (see also Hawe, 2015). Consequently, professionals need to work under consideration and close monitoring of the actual system dynamics. For this, clinicians need process-sensitive feedback on the ongoing dynamics, especially on the stability or instability of the client system. If those dynamic and personalized assessment approaches become integrated in clinical care we can use insights from non-linear dynamical systems theories to identify the optimal timing of interventions, based on generic markers in the change process (i.e., critical fluctuations), and navigate a client’s treatment process under those ‘foggy’ conditions.
Acknowledgements
The coding of therapies was done by Monika Köhler, Klaus Richter, Petra Gruhl, Cornelia Schardt, and Jürgen Kraft.
Footnotes
Positive feedback interactions among system elements amplify particular variations, which leads to the emergence of novelty. Negative feedback causes elements to be linked and minimizes deviation through which the system converges to its attractor, the preferred state of the system.
Author contributions
Contributions to conception and design ( GST, AL-A), acquisition of data (GST), programming of database and analysis/graphic tools (GST), analysis of data (GST), and interpretation of data (GST, AL-A).
Drafting the article (AL-A, GST).
Final approval of the version to be published (AL-A, GST).
Action editor
Lars-Gunnar Lundh served as action editor for this article.
References
- Ahn H., & Wampold B. E. (2001). Where oh where are the specific ingredients? A meta-analysis of component studies in counselling and psychotherapy. Journal of Counseling Psychology , 48, 251-257. 10.1037/0022-0167.48.3.251 [DOI] [Google Scholar]
- an der Heiden U. (1992). Chaos in Health and Disease – Phenomenology and Theory. In Tschacher W, Schiepek G & Brunner E. J (Eds.), Self-Organization and Clinical Psychology.Empirical Approaches to Synergetics in Psychology(pp. 55-87). Berlin: Springer. [Google Scholar]
- an der Heiden U., & Mackey M. C. (1987). Mixed Feedback: A Paradigm for Regular and Irregular Oscillation. In Rensing L, Heiden U. a. d & Mackey M. C (Eds.), Temporal Disorders in Human Oscillatory Systems (pp. 30-46) . Berlin: Springer. [Google Scholar]
- Asay T. P., & Lambert M. J. (1999). The empirical case for the common factors in therapy: Quantitative findings. In Hubble M. A, Duncan B. L & Miller S. D (Eds.), The heart and soul of change: Delivering what works in therapy(pp. 23-55). Washington, DC: American Psychological Association. [Google Scholar]
- Babloyantz A., & Destexhe A. (1987). Strange Attractors in Human Cortex. In Rensing L, Heiden U. a. d & Mackey M. C (Eds.), Temporal Disorders in Human Oscillatory Systems(pp. 48-57) . Berlin: Springer. [Google Scholar]
- Bak M., Drukker M., Hasmi L., & van Os J. (2016). An n= 1 clinical network analysis of symptoms and treatment in psychosis. Plos One, 11(9), e0162811 10.1371/journal.pone.0162811 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bak P., & Chen K. (1991). Self-organized Criticality. Scientific American (January), 26-33. [Google Scholar]
- Bak P., Chen K., & Creutz M. (1989) Self-organized Criticality and the 'Game of Life'. Nature, 342, 780-782. 10.1038/342780a0 [DOI] [Google Scholar]
- Bartlett F. C. (1932). Remembering, a Study in Experimental and Social Psychology. Cambridge: Cambridge University Press. [Google Scholar]
- Bell E. C., Marcus D. K., & Goodlad J. K. (2013). Are the parts as good as the whole? A meta-analysis of component treatment studies. Journal of Consulting and Clinical Psychology, 81, 722-736. 10.1037/a0033004 [DOI] [PubMed] [Google Scholar]
- Bohart A. C., & Tallman K. (2010). Clients: The neglected common factor in psychotherapy. In Duncan B. L, Miller S. D, Wampold B. E & Hubble M. A (Eds.), The heart and soul of change: Delivering what works in therapy (pp. 83-111). Washington, DC: American Psychological Association. [Google Scholar]
- Bordin E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16(3), 252-260. 10.1037/h0085885 [DOI] [Google Scholar]
- Bozog B., & Bühler K. E. (1988). Wirkfaktoren der Psychotherapie. Spezifische und unspezifische Einflüsse. Fortschritte der Neurologie und Psychiatrie, 56, 119-132. [DOI] [PubMed] [Google Scholar]
- Carey T. A. (2011). Exposure and reorganization: The what and how of effective psychotherapy. Clinical Psychology Review,31(4), 236-248. 10.1016/j.cpr.2010.04.004 [DOI] [PubMed] [Google Scholar]
- Carey T. A., & Stiles W. B. (2016). Some problems with randomized controlled trials and some viable alternatives. Clinical Psychology & Psychotherapy, 23(1), 87-95. 10.1016/j.cpr.2010.04.004 [DOI] [PubMed] [Google Scholar]
- Caspar F. (1986). Die Plananalyse als Konzept und Methode. Verhaltensmodifikation, 4, 235-256. [Google Scholar]
- Caspar F. (1995). Plan analysis: Towards optimizing psychotherapy. Seattle, WA: Hogrefe. [Google Scholar]
- Chambless D. L., & Ollendick T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52(1), 685-716. 10.1146/annurev.psych.52.1.685 [DOI] [PubMed] [Google Scholar]
- Cramer A. O. J., van Borkulo C. D., Giltay E. J., van der Maas H. L. J., Kendler K. S., Scheffer M., et al. (2016). Major Depression as a Complex Dynamic System. Plos One, 11(12), e0167490 10.1371/journal.pone.0167490 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Czogalik D. (1989). Psychotherapie als Prozeß: Mehrebenenanalytische Untersuchung zu Struktur und Verlauf psychotherapeutischer Interaktion. Habilitationsschrift, Universität Ulm. [Google Scholar]
- Czogalik D. (1991). Eine Strategie der Interaktions-Verhaltenstherapie und Psychosoziale Praxis, 2, 173-186. [Google Scholar]
- de Shazer S. (1985). Keys to Solution in Brief Therapy. New York: Norton. [Google Scholar]
- Deutsch A. (Ed.). (1994). Muster des Lebendigen. Faszination ihrer Entstehung und Simulation. Braunschweig: Vieweg Verlag. [Google Scholar]
- Duncan B. L., Miller S. D., & Sparks J. A. (2011). The heroic client: A revolutionary way to improve effectiveness through client-directed, outcome-informed therapy. John Wiley & Sons. [Google Scholar]
- Duncan B. L., & Reese R. J. (2012). Empirically Supported Treatments, Evidence-Based Treatments, and Evidence‐ Based Practice. Handbook of Psychology, Second Edition, Volume 8. Clinical Psychology. II. Psychotherapy. 10.1002/9781118133880.hop208021 [DOI] [Google Scholar]
- Fartacek C., Schiepek G., Kunrath S., Fartacek R., & Plöderl M. (2016). Real-Time Monitoring of Non-linear Suicidal Dynamics: Methodology and a Demonstrative Case Report. Frontiers in Psychology, 7(2), 1-14. 10.3389/fpsyg.2016.00130 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fisher A. J., & Boswell J. F. (2016). Enhancing the personalization of psychotherapy with dynamic assessment and modeling. Assessment, 23, 496-506. 10.1177/1073191116638735. [DOI] [PubMed] [Google Scholar]
- Fisher A. J., Medaglia J. D., & Jeronimus B. F. (2018). Lack of group-to-individual generalizability is a threat to human subjects research. Proceedings of the National Academy of Sciences 115(27), E6106-E6115. 10.1073/pnas.1711978115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freeman W. J. (2000). A Proposed Name for Aperiodic Brain Activity: Stochastic Chaos. Neural Networks, 13, 11-13. 10.1016/S0893-6080(99)00093-3 [DOI] [PubMed] [Google Scholar]
- Friedlander M. L., & Schwartz G. S. (1985). Toward a Theory of Strategic Self-Presentation in Counseling and Psychotherapy. Journal of Counseling Psychology, 32, 483-501. 10.1037/0022-0167.32.4.483 [DOI] [Google Scholar]
- Gelo O. C. G., & Salvatore S. (2016). A dynamic systems approach to psychotherapy: a meta-theoretical framework for explaining psychotherapy change processes. Journal of Counseling Psychology, 63, 379-395. 10.1037/cou0000150. [DOI] [PubMed] [Google Scholar]
- Granic I., & Patterson G. R. (2006). Toward a comprehensive model of antisocial development: A dynamic systems approach. Psychological Review, 113(1), 101-131. 10.1037/0033-295X.113.1.101 [DOI] [PubMed] [Google Scholar]
- Groeben N., & Westmeyer H. (1975). Kriterien psychologischer Forschung. München: Juventa. [Google Scholar]
- Haken H. (1977). Synergetics. An Introduction. Nonequilibrium Phase Transitions and Self-Organization in Physics, Chemistry and Biology. Berlin, Heidelberg, New York: Springer. [Google Scholar]
- Haken H. (1990). Synergetics. An Introduction. Berlin: Springer. [Google Scholar]
- Haken H., Kelso J. A. S., & Bunz H. (1985). A Theoretical Model of Phase Transitions in Human Hand Movements. Biological Cybernetics, 51, 347-356. 10.1007/BF00336922 [DOI] [PubMed] [Google Scholar]
- Haken H., & Schiepek G. (2006). Synergetik in der Psychologie.Selbstorganisation verstehen und gestalten. Göttingen: Hogrefe. [Google Scholar]
- Hawe P. (2015). Lessons from complex interventions to improve health. Annual Review of Public Health, 36, 307-323. 10.1146/annurev-publhealth-031912-114421 [DOI] [PubMed] [Google Scholar]
- Hayes A. M., Laurenceau J.-P., Feldman G., Strauss J. L., & Cardaciotto L. (2007). Change is Not Always Linear: The Study of Nonlinear and Discontinuous Patterns of Change in Psychotherapy. Clinical Psychology Review, 27, 715-723. 10.1016/j.cpr.2007.01.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hayes A. M., & Strauss J. L. (1998). Dynamic systems theory as a paradigm for the study of change in psychotherapy: an application to cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 66, 939-947. 10.1037/0022-006X.66.6.939 [DOI] [PubMed] [Google Scholar]
- Hayes A. M., Yasinski C., Ben Barnes J., & Bockting C. L. H. (2015). Network destabilization and transition in depression: New methods for studying the dynamics of therapeutic change. Clinical Psychology Review, 41, 27-39. 10.1016/j.cpr.2015.06.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heinzel S., Tominschek I., & Schiepek G. (2014). Dynamic patterns in psychotherapy - discontinuous changes and critical instabilities during the treatment of obsessive compulsive disorder. Nonlinear Dynamics, Psychology, and Life Sciences,18(2), 155-176. [PubMed] [Google Scholar]
- Horvath A. O., Del Re A. C., Flückiger C., & Symonds D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48(1), 9-16. 10.1037/a0022186. [DOI] [PubMed] [Google Scholar]
- Horvath A. O., & Luborsky L. (1993). The role of the therapeutic alliance in psychotherapy. Journal of Consulting and Clinical Psychology, 61(4), 561-573. 10.1037/0022-006X.61.4.561 [DOI] [PubMed] [Google Scholar]
- Kantz H. (1994). A Robust Method to Estimate Maximal Lyapunov Exponents of a Time Series. Physical Letters A, 185,77-87. 10.1016/0375-9601(94)90991-1 [DOI] [Google Scholar]
- Kelly M., Roberts J., & Bottonari K. (2007). Non-treatment-related sudden gains in depression: the role of self-evaluation. Behaviour Research and Therapy 45, 737-747. 10.1016/j.brat.2006.06.008 [DOI] [PubMed] [Google Scholar]
- Kelly M., Roberts J., & Ciesla J. (2005). Sudden gains in cognitive behavioral treatment for depression: when do they occur and do they matter? Behaviour Research and Therapy, 43, 703-714. 10.1016/j.brat.2004.06.002 [DOI] [PubMed] [Google Scholar]
- Koffka K. (1922). Perception: An Introduction to Gestalt-theorie. Psychological Bulletin, 19, 531-585. 10.1037/h0072422 [DOI] [Google Scholar]
- Kramer I., Simons C. J., Hartmann J. A., Menne-Lothmann C., Viechtbauer W., Peeters F., et al. (2014). A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry, 13(1), 68-77. 10.1002/wps.20090. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kruse P., Stadler M., Pavlekovic B., & Gheorgiu V. (1992). Instability and Cognitive Order Formation: Self-Organization Principles, Psychological Experiments and Psychotherapeutic Interventions. In Tschacher W, Schiepek G & Brunner E. J (Eds.), Self-Organization and Clinical Psychology. Empirical Approaches to Synergetics in Psychology (pp. 102-117). Berlin: Springer. [Google Scholar]
- Leemput I. A. v. d., Wichers M., Cramer A. O. J., Borsboom D., Tuerlinckx F., Kuppens P., et al. (2014). Critical slowing down as early warning for the onset and termination of depression. Proceedings of the National Academy of Sciences, 111, 87-92. 10.1073/pnas.1312114110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lewin K. (1935). A Dynamic Theory of Personality. Selected Papers. New York: McGraw-Hill. [Google Scholar]
- Lewin K. (1951). Field Theory in Social Sciences. New York, NY: Harper & Row. [Google Scholar]
- Lichtwarck-Aschoff A., Hasselman F., Cox R. F. A., Pepler D., & Granic I. (2012). A characteristic destabilization profile in parent-child interactions associated with treatment efficacy for aggressive children. Nonlinear Dynamics, Psychology, and Life Sciences, 16, 353-379. 10.1177/2167702619865969 [DOI] [PubMed] [Google Scholar]
- Lorenz E. N. (1963). Deterministic Non-Periodic Flow. Journal of Atmosphere Science, 20, 130-141. [Google Scholar]
- Lorenz E. N. (1972, 29.12.1972). Predictability: Does the flap of a butterfly’s wings in Brazil set off a tornado in Texas? Paper presented at the AAAS Conference, Section on Environmental Sciences. New Approaches to Global Weather: GARP (The Global Atmospheric Research Program, Washington. [Google Scholar]
- Lotka A. J. (1925). Elements of Physical Biology. Baltimore: Wiliam and Wilkins. [Google Scholar]
- Luborsky L., & Singer B. (1975). Comparative Studies of Psychotherapy: Is It True that “Everyone has Won and All Must Have Prizes?” Archives of General Psychiatry, 32, 995-1008. 10.1001/archpsyc.1975.01760260059004 [DOI] [PubMed] [Google Scholar]
- Mackey M. C., & an der Heiden U. (1982). Dynamical Diseases and Bifurcations. Funktionelle Biologie & Medizin, 1, 156-164. [Google Scholar]
- Mahoney M. J. (1991). Human Change Processes: the scientific foundations of psychotherapy. BasicBooks. [Google Scholar]
- Miller G. A., Galanter E., & Pribram K. H. (1960). Plans and the Structure of Behavior. New York: Holt, Rinehart & Winston. [Google Scholar]
- Molenaar P. C. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement 2(4), 201-218. 10.1207/s15366359mea0204_1 [DOI] [Google Scholar]
- Myin-Germeys I., Oorschot M., Collip D., Lataster J., Delespaul P., & Van Os J. (2009). Experience sampling research in psychopathology: opening the black box of daily life. Psychological Medicine, 39(9), 1533-1547. 10.1017/S0033291708004947 [DOI] [PubMed] [Google Scholar]
- Nahum-Shani I., Hekler E. B., & Spruijt-Metz D. (2015). Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychology, 34(S), 1209 10.1037/hea0000306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nelson B., McGorry P. D., Wichers M., Wigman J. T. W., & Hartmann J. A. (2017). Moving From Static to Dynamic Models of the Onset of Mental Disorder. JAMA Psychiatry, 71, 528-534. 10.1001/jamapsychiatry.2017.0001. [DOI] [PubMed] [Google Scholar]
- Olsen L. F., Truty G., & Schaffer W. M. (1988). Oscillations and Chaos in Epidemics. A Non-linear Dynamic Study of six Childhood Diseases in Copenhagen, Denmark. Theoretical Population Biology 33, 444-449. [DOI] [PubMed] [Google Scholar]
- Olthof M., Hasselman F., Strunk G., van Rooij M., Aas B., Helmich M. A., et al. (2019). Critical Fluctuations as an Early-Warning Signal for Sudden Gains and Losses in Patients receiving Psychotherapy for Mood Disorders. Clinical Psychological Science, 10.1177/2167702619865969. [DOI] [Google Scholar]
- Orlinsky D. E., & Howard K. I. (1987). A generic model of psychotherapy. Journal of Integrative and Eclectic Psychotherapy 6, 6-27. [Google Scholar]
- Orlinsky D. E., Ronnestad M. H., & Willutzki U. (2004). Fifty years of psychotherapy process-outcome research: Continuity and change. In Lambert M. J. (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change (5th Ed.) (pp. 307-389). New York: Wiley. [Google Scholar]
- Owen J., & Hilsenroth M. J. (2014). Treatment adherence: the importance of therapist flexibility in relation to therapy outcomes. Journal of Counseling Psychology, 61, 280-288. 10.1037/a0035753 [DOI] [PubMed] [Google Scholar]
- Palmier-Claus J. E., Rogers A., Ainsworth J., Machin M., Barrowclough C., Laverty L., et al. (2013). Integrating mobile-phone based assessment for psychosis into people’s everyday lives and clinical care: a qualitative study. BMC Psychiatry,13(1), 34 10.1186/1471-244X-13-34 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paluš M., Komárek V., Procházka T., Hrncír Z., & Sterbová K. (2001). Synchronization and Information Flow in EEGs of Epileptic Patients. IEEE Engineering in Medicine and Biology Magazine, 20(5), 65-71. 10.1109/51.956821 [DOI] [PubMed] [Google Scholar]
- Piaget J. (1977). The development of thought: Equilibration of cognitive structures. (Originally published in French, 1975) New York: The Viking Press. [Google Scholar]
- Pincus D. (2009). Coherence, complexity, and information flow: a self-organizing processes in psychotherapy. In Guastello S, Koopmans M & Pincus D (Eds.), Chaos and Complexity in Psychology. The Theory of Nonlinear Dynamical Systems(pp. 335-369). New York: Cambridge University Press. [Google Scholar]
- Poincaré H. (1890). Sur le problème des trois corps et les équations de dynamique. Acta Mathematica, 13, 5-256. [Google Scholar]
- Poincaré H. (1904). Wissenschaft und Hypothese (La science et l'hypothèse). Leipzig: Teubner. [Google Scholar]
- Popper K. R. (1959). The logic of scientific discovery. New York: Basic Books. [Google Scholar]
- Prigogine I. (1955). Thermodynamics of Irreversible Processes. New York: Wiley. [Google Scholar]
- Prigogine I., & Stengers I. (1984) Order out of Chaos: Man’s New Dialogue with Nature. New York: Bantam Books. [Google Scholar]
- Ramseyer F., & Tschacher W. (2011). Nonverbal synchrony in psychotherapy: coordinated body movement reflects relationship quality and outcome. Journal of Consulting and Clinical Psychology, 79(3), 284 10.1037/a0023419. [DOI] [PubMed] [Google Scholar]
- Richter K., Köhler M., Schütz A., Schiepek G., & Strunk G. (1994, 20. - 25.02.1994). Mikroanalyse der therapeutischen Beziehungsgestaltung mittels sequentieller Plananalyse: Eine empirische Fallstudie. Paper presented at the 10. Kongreß für Klinische Psychologie und Psychotherapie: “Ausgrenzen, Eingrenzen, Entgrenzen. Wechselnde Perspektiven im psychosozialen Feld”, Berlin. [Google Scholar]
- Rogers C. R. (1957). The Necessary and Sufficient Conditions of Therapeutic Personality Change. Journal of Consulting Psychology, 21, 95-103. 10.1037/h0045357 [DOI] [PubMed] [Google Scholar]
- Rosenstein M. T., Collins J. J., & De Luca C. J. (1993). A Practical Method for Calculating Largest Lyapunov Exponents from Small Data Sets. Physica D 65, 117. [Google Scholar]
- Rubel J. A., Zilcha-Mano S., Giesemann J., Prinz J., & Lutz W. (2019). Predicting personalized process-outcome associations in psychotherapy using machine learning approaches—A demonstration. Psychotherapy Research, 1-10. 10.1080/10503307.2019.1597994 [DOI] [PubMed] [Google Scholar]
- Ruelle D., & Takens F. (1971). On the Nature of Turbulence. Communications in Mathematical Physics 20, 167-192. 10.1007/BF01646553 [DOI] [Google Scholar]
- Scheffer M., Bascompte J., Brock W. A., Brovkin V., Carpenter S. R., Dakos V., et al. (2009). Early-warning signals for critical transitions. Nature, 461(7260), 53-59. 10.1038/nature08227. [DOI] [PubMed] [Google Scholar]
- Scheffer M., Carpenter S. R., Lenton T. M., Bascompte J., Brock W., Dakos V., et al. (2012). Anticipating critical transitions. Science, 338(6105), 344-348. 10.1126/science.1225244. [DOI] [PubMed] [Google Scholar]
- Schiepek G. (2003). A dynamic systems approach to clinical case formulation. European Journal of Psychological Assessment, 19, 175-184. 10.1027//1015-5759.19.3.175 [DOI] [Google Scholar]
- Schiepek G. (2009). Complexity and Nonlinear Dynamics in Psychotherapy. European Review, 17(2), 331-356. 10.1017/S1062798709000763 [DOI] [Google Scholar]
- Schiepek G., Aichhorn W., Gruber M., Strunk G., Bachler E., & Aas B. (2016). Real-Time Monitoring of Psychotherapeutic Processes: Concept and Compliance. Frontiers in Psychology, 7, 604 10.3389/fpsyg.2016.00604 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schiepek G., Eckert H., Aas B., Wallot S., & Wallot A. (2016). Integrative Psychotherapy: A Feedback-Driven Dynamic Systems Approach. Göttingen: Hogrefe. [Google Scholar]
- Schiepek G., Heinzel S., Karch S., Plöderl M., & Strunk G. (2016). Synergetics in psychology: patterns and pattern transitions in human change process. In Pelster A & Wunner G (Eds.), Selforganization in Complex Systems: The Past, Present, and Future of Synergetics. Proceedings of the International Symposium, Hanse Institute of Advanced Studies, Delmenhorst, Germany, November 13–16, 2012 Springer Series Understanding Complex Systems (pp. 181-208). Berlin Heidelberg: Springer. [Google Scholar]
- Schiepek G., Kowalik Z. J., Schütz A., Köhler M., Richter K., Strunk G., et al. (1997). Psychotherapy as a Chaotic Process. Part I: Coding the Client-Therapist Interaction by Means of Sequential Plan Analysis and the Search for Chaos: A Stationary Approach. Psychotherapy Research, 7(2), 173-194. 10.1080/10503309712331331953 [DOI] [Google Scholar]
- Schiepek G., Schütz A., Köhler M., Richter K., & Strunk G. (1995). Die Mikroanalyse der Therapeut-Klient-Interaktion mittels Sequentieller Plananalyse. Teil I: Grundlagen, Methodenentwicklung und erste Ergebnisse. Psychotherapie Forum, 3(1), 1-17. [Google Scholar]
- Schiepek G., & Strunk G. (1994a, 20. - 25.02.1994) Dynamische Problemanalyse. Paper presented at the 10. Kongreß für Klinische Psychologie und Psychotherapie: “Ausgrenzen, Eingrenzen, Entgrenzen. Wechselnde Perspektiven im psychosozialen Feld”, Berlin. [Google Scholar]
- Schiepek G., & Strunk G. (1994b). Dynamische Systeme. Grundlagen und Analysemethoden für Psychologen und Psychiater. Heidelberg: Asanger. [Google Scholar]
- Schiepek G., & Strunk G. (2010). The identification of critical fluctuations and phase transitions in short term and coarse-grained time series. A method for the real-time monitoring of human change processes. Biological Cybernetics, 102(3), 197-207. 10.1007/s00422-009-0362-1. [DOI] [PubMed] [Google Scholar]
- Schiepek G., Strunk G., & Kowalik Z. J. (1995). Die Mikroanalyse der Therapeut-Klient-Interaktion mittels Sequentieller Plananalyse. Teil II: Die Ordnung des Chaos. Psychotherapie Forum, 3(2), 87-109. [Google Scholar]
- Schiepek G., Viol K., Aichhorn W., Hütt M. T., Sungler K., Pincus D., et al. (2017). Psychotherapy is chaotic—(Not only) in a computational world. Frontiers in Psychology, 8, 379 10.3389/fpsyg.2017.00379 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schöner G., Haken H., & Kelso J. A. S. (1986). A stochastic theory of phase transitions in human hand movement. Biological Cybernetics, 53, 247-257. 10.1007/BF00336995 [DOI] [PubMed] [Google Scholar]
- Schreiber T., & Schmitz A. (2000) Surrogate Time Series. Physica D, 142, 346-382. 10.1016/S0167-2789(00)00043-9 [DOI] [Google Scholar]
- Sender T. (2017). Wirtschaftsdidaktische Lerndiagnostik und Komplexität. Lokalisierung liminaler Unsicherheitsphasen im Hinblick auf Schwellenübergänge. Wiesbaden: Springer Gabler. [Google Scholar]
- Shedler J. (2018). Where Is the Evidence for “Evidence-Based” Therapy? Psychiatric Clinics 42(2), 319-329. 10.1016/j.psc.2018.02.001 [DOI] [PubMed] [Google Scholar]
- Stadler M., & Kruse P. (1990). The Self-Organization Perspective in Cognition Research: Historical Remarks and New Experimental Approaches. In Haken H & Stadler M (Eds.), Synergetics of Cognition (pp. 32-52). Berlin: Springer. [Google Scholar]
- Stiles W. B., & Shapiro D. A. (1989). Abuse of the Drug Metaphor in Psychotherapy Process-Outcome Research. Clinical Psychology Review, 9, 521-543. 10.1016/0272-7358(89)90007-X [DOI] [PubMed] [Google Scholar]
- Strunk G. (1996. Die Sequentielle Plananalyse als systemwissenschaftliche Methode der Psychotherapieprozeßforschung. Münster: Westfälische Wilhelms Universität. [Google Scholar]
- Strunk G. (2004). Organisierte Komplexität. Mikroprozess-Analysen der Interaktionsdynamik zweier Psychotherapien mit den Methoden der nichtlinearen Zeitreihenanalyse. Otto-Friedrich-Universität Bamberg; Online publiziert 2005: http://www.opus-bayern.de/uni-bamberg/volltexte/2005/64/pdf/Strunk_Dissertation.pdf, Bamberg. [Google Scholar]
- Strunk G. (2005). Karrieren zwischen Chaos und Ordnung. In Mayrhofer W, Meyer M & Steyrer J (Eds.), Macht? Erfolg? Reich? Glücklich? Einflussfaktoren auf Karrieren(pp. 243-277). Wien: Linde. [Google Scholar]
- Strunk G. (2006). Animation 47. Darstellung der empirischen SPA-Zeitreihen (Selbstdarstellungskategorien) von Therapeut und Klientin (Therapie I) und ihre Einbettung im Phasenraum (Animationen auf der DVD zum Buch). In Haken H & Schiepek G (Eds.), Synergetik in der Psychologie. Selbstorganisation verstehen und gestalten. Göttingen: Hogrefe. [Google Scholar]
- Strunk G. (2009. Operationalizing Career Complexity. Management Revue, 20(3), 294-311. http://dx.doi.org/10.1688/1861-9908_mrev_2009_03_Strunkhttp://www.hampp-verlag.de/hampp [Google Scholar]
- Strunk G. (2019). Leben wir in einer immer komplexer werdenden Welt? Methoden der Komplexitätsmessung für die Wirtschaftswissenschaft. Wien: Complexity-Research. [Google Scholar]
- Strunk G., Haken H., & Schiepek G. (2006). Ordnung und Ordnungswandel in der therapeutischen Kommunikation. In Haken H & Schiepek G (Eds.), Synergetik in der Psychologie. Selbstorganisation verstehen und gestalten(pp. 462-517). Göttingen: Hogrefe. [Google Scholar]
- Strunk G., & Schiepek G. (2002). Dynamische Komplexität in der Therapeut-Klient-Interaktion. Therapieforschung aus dem Geiste der Musik. Psychotherapeut, 47(5), 291-300. 10.1007/s00278-002-0242-9 [DOI] [Google Scholar]
- Strunk G., & Schiepek G. (2006). Systemische Psychologie. Eine Einführung in die komplexen Grundlagen menschlichen Verhaltens. München: Spektrum Akademischer Verlag. [Google Scholar]
- Strunk G., & Schiepek G. (2014). Therapeutisches Chaos. Eine Einführung in die Welt der Chaostheorie und der Komplexitätswissenschaften. Göttingen: Hogrefe. [Google Scholar]
- Thelen E., & Smith L. B. (1994). A Dynamic Systems Approach to the Development of Cognition and Action. Cambridge, Massachusetts: The MIT Press. [Google Scholar]
- Thelen E., & Smith L. B. (2006). Dynamic System Theories. In Damon W & Lerner R. M (Eds.), Handbook of Child Psychology. Volume One: Theoretical Models of Human Development (6th ed.) (pp. 258–313): John Wiley & Sons. [Google Scholar]
- Thelen E., & Ullrich B. D. (1991). Hidden Skills: A Dynamic Systems Analysis of Treadmill Stepping During The First Year. Monographs of the Society for Research in Child Development 56(1), 1-103. [PubMed] [Google Scholar]
- Tschacher W., Schiepek G., & Brunner E. J. (Eds.). (1992) Self-Organization and Clinical Psychology. Empirical Approaches to Synergetics in Psychology. Berlin: Springer. [Google Scholar]
- Van Geert P. (2006). Time, models and narratives: Towards understanding the dynamics of life. Culture and Psychology, 12 ,487-507. 10.1177/1354067X06069952 [DOI] [Google Scholar]
- Van Geert P., & Steenbeek H. (2014). The good, the bad and the ugly? The dynamic interplay between educational practice, policy and research. Complicity: An International Journal of Complexity and Education, 11(2), 22-39. [Google Scholar]
- Van Geert P., & Van Dijk M. (2002). Focus on variability: New tools to study intra-individual variability in developmental data. Infant Behavior and Development, 25(4), 340-374. 10.1016/S0163-6383(02)00140-6 [DOI] [Google Scholar]
- van Os J., Delespaul P., Wigman J., Myin-Germeys I., & Wichers M. (2013). Beyond DSM and ICD: introducing “precision diagnosis” for psychiatry using momentary assessment technology. World Psychiatry, 12(2), 113 10.1002/wps.20046 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Os J., Guloksuz S., Vijn T. W., Hafkenscheid A., & Delespaul P. (2019). The evidence‐based group‐level symptom‐reduction model as the organizing principle for mental health care: time for change? World Psychiatry, 18(1), 88-96. 10.1002/wps.20609. [DOI] [PMC free article] [PubMed] [Google Scholar]
- von Foerster H. (1970). Molecular Ethology, an Immodest Proposal for Semantic Clarification. In Ungar G. (Ed.), Molecular Mechanisms in Memory and Learning (pp. 213-248). New York: Plenum Press. [Google Scholar]
- Walter S., Schiepek G. K., Schneider S., Strunk G., Kaimer P., & Mergenthaler E. (2010). The synchronization of plan activations and emotion-abstraction patterns in the psychotherapeutic process: a single-case study. Psychotherapy Research, 20(2), 214-223. 10.1080/10503300903277437. [DOI] [PubMed] [Google Scholar]
- Wampold B. E. (2013). The great psychotherapy debate: Models, methods, and findings. Routledge. [Google Scholar]
- Wampold B. E. (2015). How important are the common factors in psychotherapy? An update. World Psychiatry 14(3), 270-277. 10.1002/wps.20238 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wampold B. E., & Imel Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. Routledge. [Google Scholar]
- Westen D., Novotny C. M., & Thompson-Brenner H. (2004). The empirical status of empirically supported psychotherapies: assumptions, findings, and reporting in controlled clinical trials. Psychological Bulletin 130(4), 631-663. 10.1037/0033-2909.130.4.631 [DOI] [PubMed] [Google Scholar]
- Wichers M. (2014). The dynamic nature of depression: a new micro-level perspective of mental disorder that meets current challenges. Psychological Medicine, 44(7), 1349-1360. 10.1017/S0033291713001979 [DOI] [PubMed] [Google Scholar]
- Wichers M., Groot P. C., Psychosystems ESM Group, & EWS Group (2016). Critical Slowing Down as a Personalized Early Warning Signal for Depression. Psychotherapy and Psychosomatics, 85(2), 114-116. 10.1159/000441458 [DOI] [PubMed] [Google Scholar]
- Wigman J. T., van Os J., Thiery E., Derom C., Collip D., Jacobs N., et al. (2013) Psychiatric diagnosis revisited: towards a system of staging and profiling combining nomothetic and idiographic parameters of momentary mental states. Plos One, 8(3), e59559 10.1371/journal.pone.0059559 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wolf A., Swift J. B., Swinney H. L., & Vastano J. A. (1985). Determining Lyapunov Exponents from a Time Series. Physica D, 16, 285-317. 10.1016/0167-2789(85)90011-9 [DOI] [Google Scholar]