Abstract
Pain perception temporarily exaggerates abrupt thermal stimulus changes revealing a mechanism for nociceptive temporal contrast enhancement (TCE). Although the mechanism is unknown, a non-linear model with perceptual feedback accurately simulates the phenomenon. Here we test if a mechanism in the central nervous system underlies thermal TCE. Our model successfully predicted an optimal stimulus, incorporating a transient temperature offset (step-up/step-down), with maximal TCE, resulting in psychophysically verified large decrements in pain response (“offset-analgesia”; mean analgesia: 85%, n = 20 subjects). Next, this stimulus was delivered using two thermodes, one delivering the longer duration baseline temperature pulse and the other superimposing a short higher temperature pulse. The two stimuli were applied simultaneously either near or far on the same arm, or on opposite arms. Spatial separation across multiple peripheral receptive fields ensures the composite stimulus timecourse is first reconstituted in the central nervous system. Following ipsilateral stimulus cessation on the high temperature thermode, but before cessation of the low temperature stimulus properties of TCE were observed both for individual subjects and in group-mean responses. This demonstrates a central integration mechanism is sufficient to evoke painful thermal TCE, an essential step in transforming transient afferent nociceptive signals into a stable pain perception.
Introduction
Attention and behavioral response to important stimulus features is the culmination of a cascade of filtering and amplification mechanisms in the nervous system. In the early stages of vision for instance edges are enhanced first by retinal ganglion cells and again by simple cells of the primary visual cortex1, 2, and in audition temporal and context filtering facilitates stimulus binding for recognition of complex sounds like species-specific vocalizations3–6. The understanding of analogous processes in pain perception is comparatively primitive, especially for processing of time varying stimuli. Rapidly changing step-wise thermal stimuli applied to the skin are perceptually salient due to disproportionate but transient change in pain intensity. Although initially observed as the familiar but disproportionate relief following stimulus decrements (“offset analgesia”)7, 8 temporal contrast enhancement (TCE) is more general and also occurs after noxious stimulus increments9.
Pain promotes defensive action and future avoidance behavior, which requires associating defensive behavior with resultant changes in pain10. A complete characterization of this process must incorporate an understanding of stimulus response dynamics, and in particular how stimulus changes are detected and interpreted. A temporal contrast enhancement mechanism must retain a memory trace of stimulus history and alter perceived stimulus intensity, and can occur at many levels of the neuraxis, whether as a consequence of adaptation in peripheral neurons, or more complex mechanisms in the central nervous system (CNS).
Several unsuccessful attempts have been made to link TCE to established CNS mechanisms of spatial and context dependent nociceptive filtering. Context dependent nociceptive filters like placebo analgesia operate through an opioidergic circuit located in the periaqueductal gray matter (PAG)11. While fMRI studies show the offset analgesia TCE phenomenon also correlates with metabolic activity in the PAG12, 13 opiate agonists and antagonists fail to alter TCE dynamics14. Likewise, spatial contrast enhancement, in the form of conditioned pain modulation (CPM), has been dissociated from offset analgesia by ketamine antagonism of NMDA receptors, which selectively inhibits CPM15.
Nevertheless, there are reasons to suspect some other CNS mechanism underlies nociceptive TCE. Across modalities contrast enhancement constructs behaviorally relevant perceptual features late in sensory processing, allowing for signal convergence and modulation by feedback projections16, 17, and, in the temporal domain, for longer information retention6, 18, 19. Additionally, asymmetric spatial interactions have been observed between time varying painful stimuli and simultaneous but remote noxious stimulation7. This at least reveals events in the CNS can interfere with pain dynamics because peripheral nociceptive neurons have receptive fields on the order of centimeters and are unaffected by remote stimulus changes20, 21. Consequently, we hypothesize a central mechanism underlies nociceptive TCE.
Responses to step-wise noxious stimuli cannot be reduced to a linear combination, or superposition, of responses to constituent boxcar stimuli, so this TCE is a nonlinear response. Here we leverage this property to probe for a central mechanism using psychophysics, theoretical modeling, and painful thermal stimuli. An optimal step-wise low-high-low stimulus paradigm is identified by exploring a recurrent feedback model trained on a preliminary dataset22. The complex stimulus is then fractured in two: a short high intensity boxcar stimulus bounded by a longer low intensity boxcar stimulus. Delivered simultaneously, their composite reproduces the low-high-low stimulus profile. A nonlinear response to the low-high-low stimulus is confirmed by comparison with responses to individual boxcars. We then bypass the ability of primary afferent fibers to detect changes in the overall stimulus profile by simultaneously delivering each boxcar stimulus to remote locations using two thermodes, and test if the response matches a superposition of constituent stimulus responses or is nonlinear. Nonlinear integration across peripheral receptive fields is sufficient to demonstrate a central mechanism for nociceptive TCE.
Results
Model exploration and stimulus design
A nonlinear stimulus-response function with perceptual feedback was fit to evoked pain ratings averaged across 11 naïve subjects (Eq. 1, Fig. 1A). The model fit performs well in capturing pain response features, sharing a greater proportion of variance with VAS ratings than does the stimulus (pain vs. stimulus: r 2 = 0.656; pain vs. model fit: r 2 = 0.855; forced timeseries data is not independent or identically distributed, but Pearson correlations serve as a similarity measure). The fit also shows a prominent nonlinearity following stimulus offsets which resolves within 15 s, matching the pain response during the first low-high-low stimulus epoch, but not later epochs, consistent with published reports on offset analgesia7. Model fitting was performed blind to model exploration or subsequent testing.
Model exploration was used to design a boxcar stimulus and a low-high-low complex stimulus which would evoke prominent and distinct nonlinearities in pain response. To find a candidate boxcar stimulus we first examined step functions that crossed the pain threshold (θ; initial temperature, T i; final temperature, T f; T i < θ < T f; Fig. 2A, top left). Peak response was predicted 14–15 s after stimulus onset regardless of T i and with magnitude proportional to T f. Time to peak and subsequent adaptation dynamics were independent of T f. For the complex stimulus we examined positive and negative steps taken from suprathreshold holding stimuli (θ < T i < T f and θ < T f < T i). These also showed approximately temperature invariant dynamics. They were distinguished by a shorter 3–4 s time to peak (or trough), followed by prominent damped oscillations which stabilized within about 40 s after stimulus onset (Fig. 2A, top right, bottom left).
In typical fashion23 predicted ratios of pain intensity were proportional to ratios of stimulus intensity, but with a time and T i dependent proportionality constant (Fig. 2A, insert). In other words,
1 |
In the range of experimentally tractable stimulus intensities (T i ∈ [45 °C, 49 °C]), the dependence on T i is trivial (Fig. 2A, insert, shaded gray area). Thus, as a practical consequence of this relationship, an approximately 25% decrease in temperature relative to threshold (~2.5 °C for 45–49 °C stimuli) was predicted to transiently abolish pain. These predictions were unambiguously confirmed by preliminary testing in one subject (Pearson correlation, VAS vs. stimulus: r2 = 0.570; VAS vs. model: r2 = 0.755; Fig. 2A).
We applied these lessons in the design of a new low-high-low complex stimulus (15 s–15 s–45 s at T 1-T 2-T 1, T 1 > θ, T 2 = T 1 + 2 °C) and also designed corresponding decompositions of this stimulus into two constituent boxcars (15 s–15 s–45 s at either T 1-T 1-T 1 or baseline-T 2-baseline, hereon ‘T 1 stimulus’ and ‘T 2 stimulus’, respectively, baseline ≪θ; Fig. 3). 15 s stimulation periods ensure peak response is achieved, the final 45 s period resolves the full time course of perceptual enhancement and 2 °C offsets (96% predicted pain reduction) avoid the ceiling effects in VAS ratings seen during preliminary testing of the larger 2.5 °C steps (Fig. 2B).
Complex stimulus paradigm maximizes nonlinear response
Nonlinear dynamics were tested using boxcar and complex stimuli in a novel group of 20 subjects. Results are consistent with model predictions (Fig. 3, Table 1). For boxcar stimuli, mean T 1 stimulus response showed a time to peak of 15.3 s (bootstrapped CI.95 = [11.5, 18.3], n = 50000 samples; times taken from start of response which lags the stimulus), and the T 2 stimulus response also follow this trajectory only truncated by the shorter stimulus duration (time to peak pain: 12.7 s, CI.95 = [9.3, 13.2]). The complex stimulus is a linear combination of T 1 and T 2 stimuli, but the mean pain response is not a linear combination of evoked responses to boxcar stimuli. Although T 2 stimulation occurs on top of a preexisting T 1 stimulation, the T 2 evoked response features a shorter time to peak pain (t2 maximum: 5.4 s, CI.95 = [5.0, 8.2]) than occurs with the T 2 boxcar stimulus (bootstrap p < 0.001). The model predicts this kind of TCE for supra-threshold step responses (3.6 s for supra-threshold vs. 14.6 s for threshold crossing steps). Additionally, the complex stimulus intensity returns to T 1 after the 2 °C stimulus offset, at which point another prominent nonlinearity is visible in the form of an “offset analgesia” type transient downward deflection (t3 minimum predicted at 4.5 s; observed at 9.8 s, CI.95 = [6.6, 10.8]; predicted amplitude: 0.96, observed amplitude: 0.85 ± 0.067, mean ± SE; VAS amplitude calculated at t3 minimum with respect to mean of t1 max and t3 max). This demonstrates the intrinsic contrast enhancing nonlinearities predicted by the model can be captured in the group level pain responses.
Table 1.
T1 alone | T2 alone | Complex | Near T 1 + T 2 | Far T 1 + T 2 | Opposite arm T 1 + T 2 | |
---|---|---|---|---|---|---|
t 1 max | 15.3 [11.5, 18.3] | — | — | — | — | — |
t 2 max | — | 12.7 [9.3, 13.2] | 5.4 [5.0, 8.2] | 11.5 [9.6, 12.9] | 11.7 [7.0, 13.4] | 10.1 [7.2, 10.9] |
t 3 min | — | — | 9.8 [6.6, 10.8] | 11.5 [7, 15.6] | 13.3 [4.7, 16.8] | 19.5 [8.5, 36.0] |
t 3 max | — | — | 40.1 [39.8, 44.2] | 42.6 [31.3, 44.1] | 37.5 [32.8, 44.1] | 28.8 [11.0, 43.7] |
Subject level responses to dual thermode stimuli are nonlinear
Simultaneous dual thermode stimulation tested if central mechanisms are sufficient to evoke nonlinear contrast enhancing (TCE) pain dynamics. Only simple boxcar stimuli were used, but stimulus epochs featured coincident delivery of the T 1 and T 2 stimuli at different sites (Fig. 4). By design T 1 stimulation began 15 s before -and ended 45 s after- T 2 stimulation. Thus, the superposition of these two stimuli reproduces the optimal timeseries of the single thermode complex stimulus (Figs 3 and 4). Critically, spatial separation between thermodes during dual thermode stimulation exceeded single peripheral receptive field sizes. In order to potentially disambiguate the level of the neuraxis at which the prospective CNS mechanism might act, stimuli were delivered at three distances: near and far on the same arm, or on opposite arms (Fig. 4).
In order to distinguish monotonic site specific sensitization and habituation from intrinsic nonlinear dynamics (TCE), responses were first evaluated according to a simple on-off-on criterion. At the single subject level, many responses reflect transient absence of pain during the final 45 s of stimulus epochs (e.g. Fig. 5). However, if a pain free period interrupts distinct periods of unambiguous T 1 evoked pain, then neither habituation (a continuous decay process) nor sensitization (a continuous rise process) offers adequate explanation. Instead, a nonlinear TCE response provides the most parsimonious explanation (e.g. Fig. 5, gray dashed boxes).
This rudimentary on-off-on criterion for nonlinearity demonstrates the dual thermode stimuli evoke nonlinear dynamics which can be discerned within individual subject responses. The complex single thermode stimulus acts as a positive control, and evokes significantly more frequent nonlinear responses (69% non-linear, n = 52) than the simple T 1 boxcar stimulus which in turn serves as a negative control for random VAS variance (4% non-linear, n = 55; = 48.5, p < 1e-05; Cochran-Mantel-Haenszel Chi-squared test, accounting for stratification by stimulus intensity which was adjusted according to pain tolerance). The greatest incidence of nonlinearities among dual thermode stimuli occurs with delivery of both to the same forearm, either near each other or far apart (50% non-linear, n = 32, = 26.3, p < 1e-05; 48% non-linear, n = 31, = 21.5, p < 1e-05; resp). Delivery of T 2 on the opposite arm shows less frequent nonlinear responses, but still more than from the single thermode T 1 stimulus (19% nonlinear, = 4.44, p = 0.035, n = 27; all tests taken with respect to the negative control and significant after Holm-Sidak correction for multiple comparisons; Table 2). Thus, dual thermode stimuli can produce nonlinear stimulus response dynamics, clearly discernable at the level of individual subjects, although there may be a distance or laterality dependence.
Table 2.
Complex | Near T 1 + T 2 | Far T 1 + T 2 | Opposite arm T 1 + T 2 | T 1 alone | |
---|---|---|---|---|---|
Trials with transient VAS = 0 | 36 [0,9,13,14] | 16 [0,5,7,4] | 15 [0,5,5,5] | 5 [1,2,2,0] | 2 [0,2,0,0] |
VAS > 0 trials | 16 [3,8,0,5] | 16 [2,3,1,10] | 16 [1,5,3,7] | 23 [0,6,4,13] | 53 [3,17,13,20] |
Rate of nonlinear pain abolition | 0.69** | 0.50** | 0.48** | 0.18* | 0.04 |
Group level dual thermode responses match the nonlinear complex stimulus response dynamics
Dual thermode stimuli evoke nonlinear responses, but single thermode complex stimuli show rich and predictable dynamics not captured by the simple on-off-on criterion. For instance, the psychophysical model exploration and single thermode stimuli highlight characteristic maxima and minima of group mean TCE responses (Figs 2 and 3), while individual subject responses are discontinuous, resembling a random jump process with indistinct maxima and minima (e.g. Fig. 5), obscuring this precise temporal information. Employing group mean responses thus allows for further comparison between the precise dynamics of different stimulus responses.
Using group mean responses, time of (a) t 1 peak pain, (b) t 3 minimum pain, and (c) t 3 peak pain were identified for the complex stimulus, and used as reference points for evaluating TCE in dual thermode stimulus responses (Fig. 6A). Differences in stimulus intensity between subjects did not affect reported pain or moderate TCE (p > 0.4 for T1 and TCE*T1 interactions, Table 3), so these terms were dropped from the model. However, the TCE reference points show significantly different pain ratings in near dual thermode stimuli, with pain at (a) and (c) significantly higher than (b) (planned comparison mean (a, c) – (b): 7.86 ± 2.75 VAS difference, mean ± SE., 47% pain reduction, p = 0.01). The same pattern occurs with far dual thermode stimuli responses (planned comparison: 7.15 ± 1.99 VAS difference, 50% pain reduction, p = 0.002), but not for opposite arm dual thermode stimuli (planned comparison: −0.39 ± 2.29 difference, 2% pain increase, p = 0.87; Table 4). Similarly, timing of t 3 extrema observed with near and far stimuli compare favorably with extrema of the single thermode complex stimulus (bootstrapped contrast of local minima timing, near vs. complex: p = 0.24, far vs. complex p = 0.18, opposite vs. complex: p < 0.001; Table 1). Therefore, during a stimulus of invariant intensity, nonlinear dynamics are evoked across near and far dual thermode stimuli at the same timepoints which characterize the single thermode complex stimulus response.
Table 3.
Coef. | SE | df | t-stat | p | ||||
---|---|---|---|---|---|---|---|---|
Near (preliminary) | F | df | p | |||||
Intercept | 14.09 | 2.10 | 17 | 6.71 | 3.64e-06* | |||
TCEac-b | 7.86 | 2.83 | 17 | 2.78 | 0.0128* | 4.20 | 2,17 | 0.0329NS |
TCEa-c | −1.72 | 2.72 | 17 | −0.63 | 0.537 | |||
S (demeaned) | 6.42 | 2.21 | 17 | 2.90 | 9.93e-3* | |||
T 1 (demeaned) | 0.403 | 2.34 | 17 | 0.17 | 0.865 | |||
TCEac-b *T 1 | −0.16 | 3.16 | 17 | −0.05 | 0.960 | 0.30 | 2,17 | 0.745 |
TCEa-c *T 1 | 2.13 | 3.04 | 17 | 0.70 | 0.493 | |||
S*T 1 | −7.70 | 2.47 | 17 | −3.11 | 6.27e-03* | |||
Far (preliminary) | F | df | p | |||||
Intercept | 11.81 | 1.29 | 16.28 | 9.17 | 7.83e-08* | |||
TCEac-b | 7.16 | 2.04 | 17.72 | 3.52 | 2.52e-03* | 6.69 | 2,17.95 | 6.75e-03* |
TCEa-c | 2.42 | 3.38 | 16.14 | 0.72 | 0.48 | |||
S (demeaned) | 5.75 | 1.89 | 15.87 | 3.05 | 7.68e-03* | |||
T 1 (demeaned) | −0.79 | 1.40 | 14.40 | −0.56 | 0.58 | |||
TCEac-b *T 1 | −0.39 | 2.22 | 17.84 | −0.18 | 0.86 | 0.02 | 2,18.06 | 0.98 |
TCEa-c *T 1 | −0.03 | 3.68 | 16.23 | −0.02 | 0.98 | |||
S*T 1 | 0.03 | 2.06 | 16.01 | 0.013 | 0.99 | |||
Opposite arms (preliminary) | F | df | P | |||||
Intercept | 14.76 | 3.00 | 16.28 | 4.90 | 1.56e-04 | |||
TCEac-b | −0.50 | 2.35 | 17.83 | −0.21 | 0.834 | 0.07 | 2,16.22 | 0.94 |
TCEa-c | −1.15 | 3.42 | 15.08 | −0.34 | 0.740 | |||
S (demeaned) | 4.59 | 3.30 | 16.74 | 1.39 | 0.183 | |||
T 1 (demeaned) | 2.23 | 2.58 | 14.62 | 0.87 | 0.401 | |||
TCEac-b *T 1 | −0.83 | 2.59 | 18.64 | −0.32 | 0.751 | 0.05 | 2,16.95 | 0.88 |
TCEa-c *T 1 | −0.39 | 3.76 | 15.68 | −0.10 | 0.919 | |||
S*T 1 | −0.97 | 2.94 | 15.30 | −0.33 | 0.745 |
Table 4.
Coef. | SE | df | t-stat | p | ||||
---|---|---|---|---|---|---|---|---|
Near (final) | F | df | p | |||||
Intercept | 14.09 | 2.09 | 17.31 | 6.75 | 3.11e-06* | |||
TCEac-b | 7.86 | 2.75 | 18 | 2.86 | 0.0104* | 4.44 | 2,18 | 0.0271NS |
TCEa-c | −1.72 | 2.68 | 18 | −0.64 | 0.531 | |||
S (demeaned) | 6.42 | 2.21 | 17.02 | 2.90 | 9.90e-3* | |||
T 1 (demeaned) | 0.30 | 2.12 | 17 | 0.14 | 0.888 | |||
S*T 1 | −7.44 | 2.45 | 17 | −3.04 | 7.35e-03* | |||
Far (final) | F | df | p | |||||
Intercept | 11.81 | 1.26 | 17.35 | 9.35 | 3.44e-08* | |||
TCEac-b | 7.15 | 1.99 | 19.00 | 3.59 | 1.95e-03* | 6.94 | 2,19.2 | 5.39e-03* |
TCEa-c | 2.42 | 3.28 | 17.17 | 0.74 | 0.477 | |||
S (demeaned) | 5.79 | 1.82 | 16.98 | 3.17 | 5.55e-03* | |||
Opposites (final) | F | df | p | |||||
Intercept | 14.62 | 3.09 | 17.19 | 4.74 | 1.86e-04* | |||
TCEac-b | −0.39 | 2.29 | 19.20 | −1.7 | 0.865 | 0.06 | 2,17.61 | 0.946 |
TCEa-c | −1.08 | 3.34 | 16.02 | −0.32 | 0.750 | |||
S (demeaned) | 2.40 | 2.49 | 16.49 | 0.97 | 0.349 |
Although local maxima and minima reflect characteristic stimulus dynamics and edge enhancement, trajectories between extrema also characterize pain dynamics. However, most group mean stimulus responses were too abrupt to robustly model. Changes in pain in response to stimulus changes affect the statistical properties of the VAS timeseries (e.g. mean and variance) in a complicated way. These changes effectively introduce heterogeneity in the probability distribution of the timeseries from one stimulation period to the next (i.e. timeseries structure is “non-stationary”). This problem is compounded by the relatively short duration between stimulus changes (e.g. t1 and t2 pain ratings only span 214 frames each), which limits the number of effective degrees of freedom available to model these statistical properties. This confounds linear timeseries modelling of complete stimulus responses. Nevertheless, the pain return during t 3 is sustained during a period of constant stimulation, which simplifies modelling. Dual thermode responses between timepoints (b) and (c) were therefore modeled as a linear combination of two independent variables, each representing a competing hypothesis: (1) the single thermode complex stimulus response (nonlinear hypothesis) and (2) the single thermode T 1 stimulus response (linear hypothesis). Although competing, these hypotheses are not necessarily mutually exclusive, and combining both together in a single model recognizes the possibility that responses to dual thermode stimuli may be a hybrid of single thermode stimulus-response patterns.
Regression models of near and far dual thermode responses support the nonlinear hypothesis (multiple regression with ARIMA(1, 1, 0) errors; near β complex = 0.167, t = 4.54, p < 1e-05; far β complex = 0.083, t = 2.03, p = 0.043; df = 437). The psychophysical model predicts the overall shape of the nonlinear trajectory should be the same regardless of how much pain is reported (i.e. dynamics show amplitude invariance) (Fig. 2A), a property clearly illustrated when comparing amplitude (i.e. variance) normalized responses to the complex stimulus with responses to ipsilateral dual stimuli. Conversely, neither linear nor nonlinear hypothesis offered a consistent explanation when modeling responses to the opposite arm stimulus, suggesting it may have unique dynamical properties (Fig. 6B, Table 5).
Table 5.
Coef. | SE | t-stat | P-value | |
---|---|---|---|---|
Near | ||||
AR(1) | 0.570 | 0.033 | 17.500 | — |
β Complex Resp. | 0.167 | 0.037 | 4.537 | 7.38e-06* |
β T 1 Resp. | 0.061 | 0.061 | 1.009 | 0.314 |
Variance | 0.002 | 0.000 | 22.739 | — |
Far | ||||
AR(1) | 0.388 | 0.037 | 10.393 | — |
β Complex Resp. | 0.083 | 0.042 | 1.999 | 0.047* |
β T 1 Resp. | 0.041 | 0.067 | 0.614 | 0.5395 |
Variance | 0.002 | 0.000 | 22.007 | — |
Opposite arms | ||||
AR(1) | 0.373 | 0.038 | 9.692 | — |
β Complex Resp. | −0.038 | 0.038 | −0.994 | 0.321 |
β T 1 Resp. | −0.003 | 0.066 | −0.046 | 0.963 |
Variance | 0.002 | 0.000 | 19.009 | — |
Discussion
Temporal contrast enhancement in pain has thus far mainly been explored in the context of “offset analgesia” and a single stimulus pattern. Here we formally generalize this process to an entire class of stimuli with a nonlinear recurrent feedback model of temporal integration, and identify an invariance relationship underlying responses to step-wise dynamic stimuli. This enables simple and accurate construction of a highly effective novel stimulus paradigm for studying TCE in pain. Using simultaneous stimulation of different skin sites, we show the CNS is sufficient to perform nonlinear spatiotemporal integration of pain, and that resulting TCE pain dynamics are shared with nonlinear temporal integration of single stimuli.
Model extrapolations predict three distinct nonlinear stimulus-response motifs, two of which are contrast enhancing, and all are confirmed by single thermode stimuli. TCE responses to incremental stimulus increases and decreases are symmetric, peak around five seconds after stimulus onset and rapidly rebound. These dynamics enhance saliency of stimulus changes, and are absent in responses to initial stimulus onset. Critically, the stimulus features of the model training dataset are mainly 5 s long, too short to fully resolve stimulus-response motifs which show characteristic extrema and relaxation dynamics over 15–45 s of constant stimulation. Nevertheless, modeling successfully predicts the magnitude of downward deflecting nonlinearities, and peak and rebound dynamics of their upward deflecting counterparts. Although each of these motifs has been shown in some form before8, 9, this is the first time to our knowledge that they are systematically characterized and unified under a single theoretical framework. This shows that TCE pain dynamics behave as if there is an underlying recurrent feedback process.
The model’s ability to successfully extrapolate stimulus-responses outside of its training space lends credence to its use for mechanistic insight and as an interpretive lens, but limitations must also be recognized. Because our usage intent was primarily instrumental other models were not considered for comparison, but alternatives have been proposed which successfully predict response dynamics like adaptation and habituation24, processes our model was not designed to accommodate. Perhaps as a result our model overestimates the rate of pain rebound for the complex stimulus. Additionally, the predicted response symmetry between stimulus increases and decreases contradicts recent findings using painful laser stimuli9, which suggest more abrupt contrast enhancement for stimulus increments. However, it should be noted our model breaks symmetry in a similar manner as stimuli deviate from idealized steps, e.g. by using finite stimulus ramp rates. Any mechanistic insights gained from this model must undoubtedly be interpreted in the context of supplemental mechanisms affecting stimulus response properties. In fact, continuous rating of subjective states could be influenced by many factors such as attention, expectations, prior experience, and even trust in the experimenter. We imposed minimal control on such factors. Most importantly, the instructions of what to rate are critical, and subtle changes in the latter may lead to different outcomes. Finally, our model parameters were derived based on data collected mainly in males, while dual thermode experiments were conducted primarily in females. Although the robust extrapolation of model outcomes to the dual thermode results suggests that sex may not be an important contributor to pain TCE mechanisms, this remains to be systematically studied, as sex is an important factor in pain psychophysics. The small dynamical range of our thermodes limited the number of subjects that we could study; it remains unclear whether this introduced bias in our model fit. Further studies are needed to clarify the limits of the model’s extrapolations and dependence on stimulation apparatus and modality, task conditions and demographic composition.
The role of peripheral nociceptive neurons in TCE has not been systematically explored. Different classes of first order afferents contribute to stimulus dynamics by conveying unique stimulus information depending on response thresholds, latencies and adaptation dynamics. For instance, low threshold nociceptive C-fibers begin responding at 39–41 °C25, are unmyelinated and relatively slow to transmit afferent signals26 and rapidly adapt to stimulation27, properties conducive to detecting slow stimulus changes. Type-II Aδ fibers also rapidly adapt to stimulation but are much faster acting28 providing a second complementary method through which to detect fast stimulus changes29, while type-I Aδ fibers27 are slow adapting and might signal persistent stimulation. However, activity of first order afferents does not correlate with experimental tonic pain sensations27. Although we cannot a priori preclude that mechanisms in the periphery contribute to TCE dynamics, pain sensations appear more likely to be indirectly constructed from stimulation of the sensory epithelium, just as in vision, where a crisp and stable sensory representation is indirectly constructed from the radically different retinal image that is subject to constant saccadic jitter and optic distortions by ocular tissues and fluids.
Nevertheless, this study’s primary finding shows central mechanisms are sufficient for temporal contrast enhancement in thermal pain perception. When complex stimuli are deconstructed into constituent boxcars and delivered to the same arm either near or far apart, the subject’s response is not merely a superposition of responses to the constituent stimuli. Instead, a characteristic nonlinear, group mean response is observed with unambiguous subject level incidence. Receptive fields of first order nociceptive afferents are on the order of centimeters, while distances between thermodes exceed these and are up to an order of magnitude larger in the ‘far’ configuration. Therefore, subjects must integrate information from different peripheral afferent receptive fields to experience a TCE pain response. This entails nonlinear spatiotemporal integration of these stimuli at a higher level in the CNS.
Although we don’t distinguish between pain ratings and pain experience, there are undoubtedly differences due to reporting errors and the interpretive decisions inherent in self report. As we illustrate with single subject data, self report is discontinuous and is frequently a succession of abruptly changing steps, while (subjectively speaking) experience is continuous. Much of this error variance cancels out when averaging across subjects. We mitigate the risk of an interpretive confound by using an optimal stimulus paradigm. Identifying a nonlinear response depends on the temporal contrast of experienced pain, and our optimized stimulus paradigm ensures this contrast is maximized and highly salient, as shown by single thermode stimuli (85% pain decrease) and ipsilateral dual stimuli (50% pain decrease). This improves on all existing studies of offset analgesia since gross changes in pain intensity are much easier to identify and report than subtle ones.
Our experimental design precludes peripheral temporal integration of dual thermode stimuli, but the results do not provide further insight regarding the level of the neuraxis at which integration occurs. It may occur anywhere there are neurons with receptive fields large enough to circumscribe both thermodes, but candidates already exist at the level of the spinal dorsal horn (e.g. wide dynamic range neurons30). Thermodes were positioned on different sides of the radial midline of the arm, so it is likely different dermatomes were stimulated and spatial integration occurred across spinal segments. It was further hoped responses to opposite arm stimuli might identify a supraspinal mechanism with a bilateral receptive field. While the incidence of complete transient abolition of opposite arm pain remains statistically significant, the group dynamics during the prospective pain return period (t3) do not match the boxcar stimulus (as required by the superposition principle), the complex stimulus, nor a linear combination of the two. An additional nonlinear spatiotemporal integration process may yet be involved. Therefore, our findings do not distinguish between prospective segmental, intersegmental or supraspinal mechanisms.
Inhibition of pain after painful stimulation of a remote site might be achieved by spatial filtering acting in parallel with temporal contrast enhancement. For instance, in CPM one painful stimulus suppresses responses to additional painful stimuli elsewhere on the body. Although CPM and TCE in pain are mediated by distinct mechanisms15, dual thermode stimuli are both spatially and temporally integrated. However, transient pain reduction during our dual thermode stimuli follows the same dynamics as a single thermode complex stimulus, supporting the conclusion that nonlinear responses to dual thermode stimuli are the result of a mechanism shared with nonlinear responses to single thermode stimuli rather than any additional mechanism of spatial filtering.
The construction of sensory representation through successive levels of spatiotemporal filtering and amplification is a fundamental principle underlying the organization of the nervous system. By matching dynamics elicited by spatially localized or dispersed time-varying noxious stimuli we demonstrate the existence of a CNS mechanism for temporal contrast enhancement of thermal painful stimulus changes in pain perception.
Methods
Subjects
Data were collected from 20 individuals recruited from the Northwestern University community. All provided informed consent for all experiments, were right handed, at least 18 years old (age: 26 ± 3 years, mean ± SD; 6 males), and had no history of chronic pain, depression, dementia or other psychiatric conditions. A model training dataset was also obtained from 11 subjects recruited from the Chicago area (age: 23 ± 2 years, mean ± SD; 8 males). An additional 9 subjects were excluded from the training dataset due to equipment malfunction (3 subjects) or due to failure of a subset of training stimuli to evoke pain (6 subjects). All experiments were approved by and conducted in accordance with the ethical principles set forth by the Northwestern University institutional review board.
Equipment
Stimuli were delivered by two Medoc PATHWAY ATS thermodes (30 × 30mm) controlled by two separate PCs, but were calibrated using a common external reference thermometer to protect against unintended stimulus mismatches. Temperature and event related data was sampled at 200 Hz. Real-time pain ratings were obtained using a finger device with VAS feedback, and sampled at 14.3 Hz using in house LabView software. Visual feedback was rendered as a moveable yellow bar alongside a number scale (0–100)31. The LabVIEW software also controlled a digital input/output device (National Instruments NI USB-6501) which delivered a 0.4 Hz heartbeat (synchronization) signal to each Medoc device during trial runs. These reference signals synchronously triggered stimulus delivery and facilitated alignment of stimuli and rating data during preprocessing.
Experiments were conducted in a purpose built space consisting of two adjacent rooms to minimize contact between experimenter and subject. The experimenter, PCs and Medoc systems were in one, while the subject, stimulating thermodes, feedback monitor and finger span device were in the other. Subjects were provided with and instructed in the use of an emergency stop button which would terminate stimuli if they became intolerable.
Modeling
Pain was modeled using a nonlinear second order differential equation which has been previously described22.
2 |
The model was fit to a training dataset which was not used further in this study. Five stimuli were delivered consisting of 5s–5s–15s or a 5s–5s–30s stimulation, following a T 1-T 2-T 1 temperature profile, where T 1 ∈ [44 °C, 48 °C] and T 2 = T 1 + 1 °C. Stimulus timing profiles and 15 s or 45 s interstimulus intervals were pseudorandomly selected and preprogrammed into the stimulator, but delivered identically to all participants (Fig. 1). Mean stimulus-response data was used to obtain the model fit with a random walk over the parameter space. The obtained model fit was used throughout the rest of this study: (θ, α, β, γ, λ) = (37.1913, 2.4932, 36.7552, 0.0204, 0.0169).
Experimental Task
Subjects were instructed to rate their overall pain from thermal stimulation using the finger device. The experimental task at times involved rating pain during delivery of two simultaneous stimuli of different intensity, but our a priori hypothesis only requires examining the periods flanking this period. Rather than introducing superfluous task demands by asking the subject to attend to a specific thermode, instructions were deliberately vague with respect to the source of the stimulus. Thus subjects were allowed to freely choose how to reconcile the two potentially competing stimuli in their rating.
Before experimental trials, subject pain thresholds and tolerance were evaluated. Six 10 s thermal stimuli were delivered at differing intensities to the right volar forearm. Stimuli differed in 1 °C increments, and each was used twice in random order. The procedure was repeated until (1) all stimuli used were painful but tolerated, (2) subject rated stimuli of equal intensity the same (±10 VAS units). Between repetitions stimuli were adjusted as needed to accommodate tolerances and pain thresholds of subjects. The least tolerant individuals completed training using 44 °C, 45 °C and 46 °C stimuli, while those with highest pain threshold completed training with 47 °C, 48 °C and 49 °C stimuli.
Experimental stimulation involved 2 noxious stimulus intensities (T 1 and T 2, where T 1 + 2 °C = T 2; baseline = T 1 − 16 °C), used in 3 stimulation sequences, each with six stimulation epochs (Fig. 5). Overall, these thermal pulses were either a complex, low-high-low sequence as used in “offset-analgesia” studies, or its component low and high pulses, presented either on the same skin site, or at different skin locations. Sequences had identical stimulus programming: 15 s of T 2, a dual thermode stimulus (75 s T 1, 15 s T 2), a second dual thermode stimulus (temperatures swapped), a 15s–15s–45s T 1-T 2-T 1 complex stimulus, a 75 s T 1 stimulus and finally another 15 s T 2 stimulus. The dual thermode stimuli were timed such that their superposition would match the profile of the complex stimulus. Relative stimulus intensities were fixed, but absolute intensities were adjusted for pain thresholds and tolerances (T 1 = [44.5 °C, 45 °C, 46 °C, 47 °C], N = [1, 5, 7, 7], resp.). Spatial configurations of thermodes (near, far or opposite arms, Fig. 4) were changed between sequences, and the order of sequences was randomized across subjects. Stimuli were delivered to the left ventral forearm, except for the opposite arm stimulus, which was delivered to a site on the right ventral forearm unaffected by the training task. 6 °C/s temperature ramp rates were used.
Data analysis
Preprocessing
Matlab was used to resample thermode data to match the finger device sampling rate using heartbeat signals to determine appropriate timestamps. Stimulus-response lag was determined by the maximal cross correlation of stimulus and response for single thermode boxcar stimuli (average lag: 3.36 ± 1.6 s, mean ± SD). Finally, onset and offset times for responses to specific stimulus features of interest (i.e. t 1, t 2 and t 3) were projected by discounting the temperature rise and fall rates and incorporating the average stimulus-response lag.
Hierarchical Linear Modelling
Inference on mean TCE was drawn using hierarchical linear models in order to control for between subject covariates (e.g. stimulus intensity) while also modelling variability within subject. Pain intensity (VAS) served as the dependent variable, measured at three timepoints per stimulus epoch (Fig. 6A, insert). Several considerations informed model selection. First, the study’s a priori hypothesis calls for a non-monotonic response characterized by two periods of high pain interrupted by a period of lower pain. This suggests a specific planned contrast (a and c vs. b in Fig. 6A). Second, the relationship between stimulus intensity and TCE (if any) is unknown and is modeled. Third, previous studies have shown site specific and nonspecific sensitization depend on stimulus intensity24, but neither affect magnitude of offset analgesia32 (a special case of TCE), therefore sensitization and its interaction with stimulus intensity, but not with TCE, are modeled. Finally, within subject stimulus intensity is constant across all timepoints of interest (a, b, c), therefore stimulus intensity and its higher order effects are only modeled at the group level. At the subject level the only random effects modeled are TCE and sensitization. The full model is summarized by the following equations,
3 |
where X is the higher level design matrix, and Z is a block diagonal design matrix composed of Z i, the subject level design matrices. S is the stimulus number, since we delivered two, and models sensitization effects. TCEab-c is the planned contrast. The model was fit using restricted maximum likelihood estimation as implemented in the LME4 package in R. The lmerTest package was used for inference with Satterthwaite’s approximation for effective second level degrees of freedom. Because TCE is tested in three different thermode configurations (near, far and opposite arms), Holm-Sidak correction for multiple comparisons is employed to control the 0.05 false positive rate.
The higher level design matrix fits are reported in (Table 3). Although plausible a priori, many of these higher order parameter estimates are not statistically significant. Stepwise regression strategies would argue for their removal, but such methods can be problematic in hierarchical models due to the effect of higher level terms on lower level parameter estimates. Terms that are present at the first level of the model are not considered for removal due to the difficulty of correctly quantifying the effective reduction in model complexity, and such terms are also retained at the second level, but Bayes information criteria is used to determine which temperature terms to remove, since these are only present at the second level (Table 4). Nevertheless, because the correct approach to such model selection problems remains an open question in the statistical literature33, and different approaches might have justified a different final model selection we also present the preliminary models.
Dynamics of nonlinearity
Timeseries data was analyzed using an autoregressive integrated moving average (ARIMA) model34.
4 |
5 |
ARIMA models capture linear relationships between points within timeseries (u(t)), producing a modified error term (ε) against which the statistical significance of parameter estimates between timeseries (B) can be evaluated (L i, lag operator; φ i, autocorrelation weight of u(t) vs u(t-i); θ i, moving average weights).
To determine the error model order (p, d, q) we regress independent variables from the dependent variables and inspect the autocorrelation and partial autocorrelation plots of the residuals. These revealed a parsimonious solution with timeseries dominated by lag 1 autocorrelation at the level of the first difference and no moving average component, an ARIMA(1, 1, 0) model. Analysis of Bayesian information criteria for models with autoregressive and moving average terms within 2 orders of an ARIMA(1, 1, 0) model supports this conclusion. Thus all effect sizes for parameters of interest are evaluated while controlling for ARIMA(1, 1, 0) errors. This yields more conservative inferences than would result from a standard regression model.
Data availability
Raw and preprocessed data used in this study are available from the corresponding author upon request.
Acknowledgements
The study was partly funded by NIH NINDS NS035115, by NIDCR DE022746 and by NIH R21NS074017-01A1. We thank Etienne Vachon-Presseau, Mariam Ghantos, Qiyuan Bao, Don Davis, Dorainne Levy, and Sara E Berger for help in data collection. Also, we thank all members of Apkarian lab for reading and commenting on earlier versions of the manuscript.
Author Contributions
B.P. and A.V.A. conceived of this study and its design and prepared the manuscript. B.P. recruited subjects, evaluated eligibility, and together with P.T. collected questionnaire and psychophysical data. B.P. performed all data analysis except for model fitting. L.H. fit the psychophysical model parameters to the training dataset. The training dataset was obtained from a separate study designed by A.V.A. and J.Y.C. V.A.M. and M.W.S. recruited subjects for the latter and collected the training dataset together with B.P. Illustrations drawn by B.P. All authors reviewed and approved of the manuscript before submission.
Competing Interests
The authors declare that they have no competing interests.
Footnotes
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Jones JP, Palmer LA. An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. J Neurophysiol. 1987;58:1233–1258. doi: 10.1152/jn.1987.58.6.1233. [DOI] [PubMed] [Google Scholar]
- 2.Meister M, Berry MJ., 2nd The neural code of the retina. Neuron. 1999;22:435–450. doi: 10.1016/S0896-6273(00)80700-X. [DOI] [PubMed] [Google Scholar]
- 3.Razak KA, Fuzessery ZM. Facilitatory mechanisms underlying selectivity for the direction and rate of frequency modulated sweeps in the auditory cortex. J Neurosci. 2008;28:9806–9816. doi: 10.1523/JNEUROSCI.1293-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ulanovsky N, Las L, Farkas D, Nelken I. Multiple time scales of adaptation in auditory cortex neurons. J Neurosci. 2004;24:10440–10453. doi: 10.1523/JNEUROSCI.1905-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Atiani S, Elhilali M, David SV, Fritz JB, Shamma SA. Task difficulty and performance induce diverse adaptive patterns in gain and shape of primary auditory cortical receptive fields. Neuron. 2009;61:467–480. doi: 10.1016/j.neuron.2008.12.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Stephens GJ, Honey CJ, Hasson U. A place for time: the spatiotemporal structure of neural dynamics during natural audition. J Neurophysiol. 2013;110:2019–2026. doi: 10.1152/jn.00268.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Yelle MD, Rogers JM, Coghill RC. Offset analgesia: a temporal contrast mechanism for nociceptive information. Pain. 2008;134:174–186. doi: 10.1016/j.pain.2007.04.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Grill JD, Coghill RC. Transient analgesia evoked by noxious stimulus offset. J Neurophysiol. 2002;87:2205–2208. doi: 10.1152/jn.00730.2001. [DOI] [PubMed] [Google Scholar]
- 9.Morch CD, Frahm KS, Coghill RC, Arendt-Nielsen L, Andersen OK. Distinct temporal filtering mechanisms are engaged during dynamic increases and decreases of noxious stimulus intensity. Pain. 2015;156:1906–1912. doi: 10.1097/j.pain.0000000000000250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Baliki MN, Apkarian AV. Nociception, Pain, Negative Moods, and Behavior Selection. Neuron. 2015;87:474–491. doi: 10.1016/j.neuron.2015.06.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Fields HL. Pain modulation: expectation, opioid analgesia and virtual pain. Prog Brain Res. 2000;122:245–253. doi: 10.1016/S0079-6123(08)62143-3. [DOI] [PubMed] [Google Scholar]
- 12.Yelle MD, Oshiro Y, Kraft RA, Coghill RC. Temporal filtering of nociceptive information by dynamic activation of endogenous pain modulatory systems. J Neurosci. 2009;29:10264–10271. doi: 10.1523/JNEUROSCI.4648-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Derbyshire SW, Osborn J. Offset analgesia is mediated by activation in the region of the periaqueductal grey and rostral ventromedial medulla. Neuroimage. 2009;47:1002–1006. doi: 10.1016/j.neuroimage.2009.04.032. [DOI] [PubMed] [Google Scholar]
- 14.Martucci KT, Eisenach JC, Tong C, Coghill RC. Opioid-independent mechanisms supporting offset analgesia and temporal sharpening of nociceptive information. Pain. 2012;153:1232–1243. doi: 10.1016/j.pain.2012.02.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Niesters M, et al. Effect of ketamine on endogenous pain modulation in healthy volunteers. Pain. 2011;152:656–663. doi: 10.1016/j.pain.2010.12.015. [DOI] [PubMed] [Google Scholar]
- 16.Chong E, Familiar AM, Shim WM. Reconstructing representations of dynamic visual objects in early visual cortex. Proc Natl Acad Sci USA. 2016;113:1453–1458. doi: 10.1073/pnas.1512144113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Tang J, Suga N. Modulation of auditory processing by cortico-cortical feed-forward and feedback projections. Proc Natl Acad Sci USA. 2008;105:7600–7605. doi: 10.1073/pnas.0802961105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hasson U, Yang E, Vallines I, Heeger DJ, Rubin N. A hierarchy of temporal receptive windows in human cortex. J Neurosci. 2008;28:2539–2550. doi: 10.1523/JNEUROSCI.5487-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Gauthier B, Eger E, Hesselmann G, Giraud AL, Kleinschmidt A. Temporal tuning properties along the human ventral visual stream. J Neurosci. 2012;32:14433–14441. doi: 10.1523/JNEUROSCI.2467-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Schmidt R, Schmelz M, Ringkamp M, Handwerker HO, Torebjork HE. Innervation territories of mechanically activated C nociceptor units in human skin. J Neurophysiol. 1997;78:2641–2648. doi: 10.1152/jn.1997.78.5.2641. [DOI] [PubMed] [Google Scholar]
- 21.Campbell JN, Meyer RA, LaMotte RH. Sensitization of myelinated nociceptive afferents that innervate monkey hand. J Neurophysiol. 1979;42:1669–1679. doi: 10.1152/jn.1979.42.6.1669. [DOI] [PubMed] [Google Scholar]
- 22.Cecchi GA, et al. Predictive dynamics of human pain perception. PLoS computational biology. 2012;8:e1002719. doi: 10.1371/journal.pcbi.1002719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Stevens SS. To Honor Fechner and Repeal His Law: A power function, not a log function, describes the operating characteristic of a sensory system. Science. 1961;133:80–86. doi: 10.1126/science.133.3446.80. [DOI] [PubMed] [Google Scholar]
- 24.Jepma M, Jones M, Wager TD. The dynamics of pain: evidence for simultaneous site-specific habituation and site-nonspecific sensitization in thermal pain. J Pain. 2014;15:734–746. doi: 10.1016/j.jpain.2014.02.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Churyukanov M, Plaghki L, Legrain V, Mouraux A. Thermal detection thresholds of Adelta- and C-fibre afferents activated by brief CO2 laser pulses applied onto the human hairy skin. PloS one. 2012;7:e35817. doi: 10.1371/journal.pone.0035817. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.LaMotte RH, Campbell JN. Comparison of responses of warm and nociceptive C-fiber afferents in monkey with human judgments of thermal pain. J Neurophysiol. 1978;41:509–528. doi: 10.1152/jn.1978.41.2.509. [DOI] [PubMed] [Google Scholar]
- 27.Meyer RA, Campbell JN. Myelinated nociceptive afferents account for the hyperalgesia that follows a burn to the hand. Science. 1981;213:1527–1529. doi: 10.1126/science.7280675. [DOI] [PubMed] [Google Scholar]
- 28.Treede RD, Meyer RA, Raja SN, Campbell JN. Evidence for two different heat transduction mechanisms in nociceptive primary afferents innervating monkey skin. The Journal of physiology. 1995;483(Pt 3):747–758. doi: 10.1113/jphysiol.1995.sp020619. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Yeomans DC, Proudfit HK. Nociceptive responses to high and low rates of noxious cutaneous heating are mediated by different nociceptors in the rat: electrophysiological evidence. Pain. 1996;68:141–150. doi: 10.1016/S0304-3959(96)03177-6. [DOI] [PubMed] [Google Scholar]
- 30.Gillette RG, Kramis RC, Roberts WJ. Characterization of spinal somatosensory neurons having receptive fields in lumbar tissues of cats. Pain. 1993;54:85–98. doi: 10.1016/0304-3959(93)90103-V. [DOI] [PubMed] [Google Scholar]
- 31.Apkarian AV, Krauss BR, Fredrickson BE, Szeverenyi NM. Imaging the pain of low back pain: functional magnetic resonance imaging in combination with monitoring subjective pain perception allows the study of clinical pain states. Neuroscience letters. 2001;299:57–60. doi: 10.1016/S0304-3940(01)01504-X. [DOI] [PubMed] [Google Scholar]
- 32.Martucci KT, Yelle MD, Coghill RC. Differential effects of experimental central sensitization on the time-course and magnitude of offset analgesia. Pain. 2012;153:463–472. doi: 10.1016/j.pain.2011.11.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Müller S, Scealy JL, Welsh AH. Model Selection in Linear Mixed Models. Statistical Science. 2013;28:34. doi: 10.1214/12-STS410. [DOI] [Google Scholar]
- 34.Box, G. E. P., Jenkins, G. M. & Reinsel, G. C. Time series analysis: forecasting and control 4th edn, (John Wiley, 2008).
- 35.da Vinci, L. (Gallerie dell’Accademia, Venice, c 1492).
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Raw and preprocessed data used in this study are available from the corresponding author upon request.