Skip to main content
PLOS Computational Biology logoLink to PLOS Computational Biology
. 2023 May 25;19(5):e1011105. doi: 10.1371/journal.pcbi.1011105

Canonical Response Parameterization: Quantifying the structure of responses to single-pulse intracranial electrical brain stimulation

Kai J Miller 1,2,*, Klaus-Robert Müller 3,4,5,6, Gabriela Ojeda Valencia 2, Harvey Huang 7, Nicholas M Gregg 8, Gregory A Worrell 2,8, Dora Hermes 2
Editor: Hayriye Cagnan9
PMCID: PMC10246848  PMID: 37228169

Abstract

Single-pulse electrical stimulation in the nervous system, often called cortico-cortical evoked potential (CCEP) measurement, is an important technique to understand how brain regions interact with one another. Voltages are measured from implanted electrodes in one brain area while stimulating another with brief current impulses separated by several seconds. Historically, researchers have tried to understand the significance of evoked voltage polyphasic deflections by visual inspection, but no general-purpose tool has emerged to understand their shapes or describe them mathematically. We describe and illustrate a new technique to parameterize brain stimulation data, where voltage response traces are projected into one another using a semi-normalized dot product. The length of timepoints from stimulation included in the dot product is varied to obtain a temporal profile of structural significance, and the peak of the profile uniquely identifies the duration of the response. Using linear kernel PCA, a canonical response shape is obtained over this duration, and then single-trial traces are parameterized as a projection of this canonical shape with a residual term. Such parameterization allows for dissimilar trace shapes from different brain areas to be directly compared by quantifying cross-projection magnitudes, response duration, canonical shape projection amplitudes, signal-to-noise ratios, explained variance, and statistical significance. Artifactual trials are automatically identified by outliers in sub-distributions of cross-projection magnitude, and rejected. This technique, which we call “Canonical Response Parameterization” (CRP) dramatically simplifies the study of CCEP shapes, and may also be applied in a wide range of other settings involving event-triggered data.

Author summary

We introduce a new machine learning technique for quantifying the structure of responses to single-pulse intracranial electrical brain stimulation. This approach allows voltage response traces of very different shape to be compared with one another. A tool like this has been needed to replace the status quo, where researchers may understand their data in terms of discovered structure rather than in terms of a pre-assigned, hand-picked, feature. The method compares single-trial responses pairwise to understand if there is a reproducible shape and how long it lasts. When significant structure is identified, the shape underlying it is isolated and each trial is parameterized in terms of this shape. This simple parameterization enables quantification of statistical significance, signal-to-noise ratio, explained variance, and average voltage of the response. Differently-shaped voltage traces from any setting can be compared with any other in a succinct mathematical framework. This versatile tool to quantify single-pulse stimulation data should facilitate a blossoming in the study of brain connectivity using implanted electrodes.


This is a PLOS Computational Biology Methods paper.

Introduction

Electrical stimulation of the brain can be used for a variety of diagnostic, therapeutic, and scientific purposes. Interactions between brain regions may be studied by applying or inducing pulses of electrical stimulation to a particular site, while measuring the electrophysiological response at the same place or elsewhere [13]. In particular, the averaging of measured voltages from implanted electrodes following brief (several millisecond) pulses of current produces widespread but sparse deflections from baseline (Fig 1). These voltage traces are typically called “single-pulse electrical stimulation” responses or “cortico-cortical evoked potentials” (CCEPs) [46]. We make measurements of these types with recordings of the convexity brain surface electrocorticography (ECoG) or in deeper structures from stereoelectroencephalography (stereoEEG; sEEG) and deep brain stimulation (DBS) electrodes with our neurosurgical patients [7]. Despite the “CCEP” name, these stimulation-evoked potential changes are seen with stimulation and recording of non-cortical structures such as white matter, basal ganglia, thalamus, and others [8, 9]. Contemporary analysis of these CCEP responses has suffered from reliance on pre-defined assumptions about the shape that the response should have and quantification of effect only by the voltage at a particular time. This manuscript describes an algorithmic approach to formalize and simplify CCEP analysis so that responses of different shape, duration, and magnitude may be quantitatively compared with one another.

Fig 1. Single-pulse electrical stimulation with stereoelectroencephalography (sEEG).

Fig 1

A. A cartoon schematic of an axial MRI with two sEEG leads. B. Single-pulse biphasic electrical stimulation is delivered through adjacent sEEG electrode contacts (200μs, 6mA), separated by 3–7s between pulses. C. Cartoon voltage traces that might be elicited at two different sites in response to stimulation at a third site (i.e. with a stimulation artifact followed by a characteristic evoked potential deflection). D. An example set of actual evoked potentials showing the stimulation-locked evoked potential matrix V, with columns Vk(t)) shown as individual traces. E. Average stimulation-evoked potential from (D). F. Examples of some of the different measured average response shapes seen in these studies (as in E). These selected responses were produced from 5 different stimulation sites across two patients (over the interval 15ms-1s post-stimulation, where the gray line indicates 0 μV). The variety of different shapes seen in just this small subset shows that there is no one typical form of stimulation evoked potential shape.

Because stimulation studies often involve a very large number of stimulated-at and measured-from brain sites, the potential set of interactions to study can become very large and make it difficult to examine data to discover simplifying principles. To address this, we recently introduced a conceptual framework formalizing four basic paradigms for interpreting CCEP data [10]:

  • The hypothesis-preselected paradigm—Two brain sites are chosen based upon a pre-defined anatomical or functional hypothesis, and a 1-way or 2-way interaction between them is characterized.

  • The divergent paradigm—Stimulation is performed at one brain site and measured responses at all sites are examined and compared. For N brain sites, this characterizes N interactions.

  • The convergent paradigm—One brain site is measured from, and the effects of stimulations at all brain sites are compared versus one another based upon the response shapes at the measured-from site. For N brain sites, this characterizes N interactions.

  • The all-to-all paradigm—All brain sites are stimulated at, and responses are measured at all sites. For N brain sites, this characterizes N2 interactions.

We previously addressed the convergent paradigm [10], which allows one to uncover “Basis Profile Curves” (BPCs) whose shapes characterize different types of responses at a measured-from brain site that can be intuitively mapped back anatomically to the stimulated brain sites. However, for many studies, what is needed is a simple way to characterize the structure of an evoked response at a single measured-from brain site produced by stimulating at one brain site (the hypothesis-preselected paradigm). This manuscript addresses this need with a new technique for identifying structure in an evoked timeseries and parameterizing single trials in terms of it.

Previous quantifications of voltage deflections in single-pulse responses (CCEPs) have typically assumed a single canonical shape consisting of characteristic negative deflections between ∼10–100 ms from stimulation called the “N1” response and a later second negative deflection (called the “N2”) [4, 11, 12]. However, there are a wide variety of evoked potential shapes in CCEP responses, and the N1/N2 description is insufficient to describe most of them, as seen in Fig 1. There has not been an alternate, generic, way of approaching these data in the time domain (though some have proposed generic frequency-domain approaches [13]). A formulation is needed that studies a set of repeated trials of stimulation and extracts a canonical structure in the response (if one exists), without a pre-set assumption of the response shape. Our proposed method, which we call “canonical response parameterization” (CRP) provides a recipe for examining structural similarity between trials to a) identify whether there is a significant reproducible response shape (and over what time interval), b) characterize what this shape is, and c) parameterize single trials by the weight of the discovered shape and the residual (after the discovered shape has been regressed out). Equipped with our novel CRP parameterization, researchers can quantify the magnitude, duration, and significance of response to stimulation between pairs of brain sites in a generic framework.

Materials and methods

Ethics statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of the Mayo Clinic IRB# 15–006530, which also authorizes sharing of the data. Each patient / representative voluntarily provided independent written informed consent to participate in this study as specifically described in the IRB review (with the consent form independently approved by the IRB).

Measurement of cortico-cortical evoked potentials

Two patients with epilepsy (19 and 63 years old, both male) participated in the study while undergoing monitoring to localize their seizure onset zone. Patient 1 was implanted with 15 bilateral sEEG leads and patient 2 was implanted with 13 left sided sEEG leads plus several scalp EEG electrodes (in canonical 10/20 locations). Each sEEG leads consisted of 10–18 contacts, composed of cylindrical platinum-iridium electrodes of 2 mm length, with 1.5 mm between (3.5mm center-to-center separation). The diameter of the lead is 0.8 mm, giving each contact has an exposed surface area of 5.0 mm2 (Fig 1). Electrode recordings were excluded if they were: 1) in seizure onset zone, 2) not stimulated, 3) artifactual, or 4) not in the brain (i.e. not extended past the bolt, etc). Voltage data were recorded at 2048Hz with a Natus Quantum amplifier. Electrode pairs were stimulated 10 times with a single biphasic pulse of 200 microseconds duration and 6 mA amplitude every 3–7 seconds using a Nicolet Cortical Stimulator. Data first were notch filtered to remove 60Hz line noise and then re-referenced to a modified common average on a trial-by-trial manner to exclude stimulated channels and channels with large variance, as described in prior work [14]. Electrodes were localized on post-operative CT scans and coregistered to preoperative MRI using the sEEG View package [15], available on github [16]. All code to implement this technique along with the sample data to reproduce the illustrations are publicly available for use without restriction (other than attribution) at: https://osf.io/tx3yq and https://github.com/kaijmiller/crp_scripts.

Our illustration of this technique is limited to data from two patients. However, the reader interested in applying this technique with a wider set of example data than that included here can access further illustrative recordings released with our other emerging work by van Blooijs et. al. [17], Ojeda Valencia et. al. [18] and Huang et. al. [14].

Data structure

The quantification of interaction between a stimulated brain site and a recorded brain site begins with a matrix of single-trial voltage responses. Matrix Vk(t) is drawn from the voltage data from the measured brain site, selecting epochs of time t over the naïvely chosen interval t1 to t2 following the time τk of the kth stimulation from the stimulated electrode pair, where t denotes the time from the kth electrical stimulation at brain site m, τk: (τk + t1) ≤ t ≤ (τk + t2). The dimensions of V are T × K, with T total timepoints (over the interval t1tt2) by K total stimulation events (Fig 1D). This fragment is an error. In this manuscript, t1 of 15ms was chosen to reduce the likelihood of contamination by stimulation artifact, and t2 of 1s was chosen because (anecdotally) the vast majority of sEEG CCEPs we have observed return to baseline well before then. We anticipate that researchers will adjust t1 and t2 based upon their own circumstances. Before data are analyzed and parameterized, one should evaluate the preprocessed data for baseline fidelity. Issues with inappropriate referencing or lack of a baseline around zero can be avoided by visual inspection or calculation of the mean and/or median values at far from stimulation times.

Single-trial cross-projections

In order to understand shared structure between stimulation trials, we first obtain a matrix of unit-normalized single trials: V˜k(t)=Vk(t)/|Vk(t)|. Each V˜k(t) is then projected into all other trials, P=V˜TV:

P(k,l)=tV˜k(t)Vl(t)

Note that P(k, l) ≠ P(l, k). The full matrix P is subsequently sorted into a combined set S, with self-projections (k = l) omitted, and a total of K2K elements (Fig 2). Each element (initially with units μV·#samples) is then scaled by 1/samplerate so that it carries the units μV·s. The average over the set of cross-projections, S¯, summarizes the interaction from stimulation to response.

Fig 2. Quantifying single-trial cross-projections.

Fig 2

A. Stimulation and recording sites for this example, shown in an axial MRI section. B. 15 single trials of stimulation response (gray) produced the averaged evoked potential shape (black). C. Trial #1 (light blue) was unit-normalized and projected into the other 14 trials, omitting self-projection. D. As in (C), but for normalized trial #10 (orange). E. All 210 projections are shown sorted, note the obvious sub-sets corresponding to the projections of unit-normalized single trials. The projections of each trial into the others can reflect how representative each trial is of the canonical evoked potential response shape. F. The projections from (E), aggregated into a single column (i.e. imposing the assumption that the order of trials doesn’t matter, which will be false under some circumstances).

Response duration

In order to quantify how long there is a significant effect after stimulation, the set S can be constructed over different time periods to determine the duration of most statistically-meaningful response. We do this by determining projection weights S and S¯ as a function of time, SSt, and quantify a temporal profile, S¯t, as illustrated in Fig 3. Because S¯ may be thought of as a reflection of mutual information between responses (i.e. their correlated deviation from 0V), the peak of S¯t represents the time past which further information is not reliably contained in the response—when the distribution of voltages across responses drifts to be indistinguishable from 0μV. We define this peak time as the “response duration”, or τR. It is important to note that this CRP approach is very sensitive to baselining, as the sign of the voltage in cross-projections around zero determines when the profile of S¯t begins to decrease. The uncertainty of τR could be estimated in many ways, but, for the illustrations in this manuscript, we place error bars where S¯(t2) exceeds 98% of S¯(τR). The truncated voltage matrix representing just the times in the response to stimulation up to this duration τR is henceforth denoted V, with dimensions τRt1 (“TR”) timepoints and K trials. The initial voltage matrix (over the naïvely-chosen time interval) will be specifically designated as such when discussed further in the text.

Fig 3. Using time-resolved projection weight to quantify response duration, τR.

Fig 3

A. Stimulation and recording sites for this example, shown in a sagittal MRI section. B. 10 single trials of stimulation response (gray) produced the averaged evoked potential shape (black). C. Abbreviated timeseries are calculated from t1 to a range of t2s to obtain time-resolved projection weights (individual dots). The traces above indicate a subset of the projections (for the normalized trace of 9th trial) at times t2 = 20ms, t2 = 80ms = τR, t2 = .5s, and t2 = 1s, with distributions of St2 at each of these timepoints highlighted in the light red background. In this example, the blue dots are projection of the normalized trace of 9th trial (illustrated in traces above). The thick black line is S¯(t2). Calculated response duration, τR, is indicated by a red circle. Small vertical red lines indicate thresholds where S¯(t2) exceeds 98% of S¯(τR) (providing an estimate of the error in calculating τR). Note that blue dots in bottom portion are the projections illustrated for the 9th trial from the traces on the top. D. The projection weight temporal profile, from the black line in the lower portion of (C), is shown with a gray line. The averaged voltage response, from the black line in (B), is shown with a black line, and the significant portion of the response is highlighted (i.e. up to τR). E. As in (D), but for the example response from Fig 2.

Extraction significance: Quantifying reliability of response structure and identifying anomalous single trials

The set of projection magnitudes SτR can be tested against zero for significance, which we call the “extraction significance”. Note that one cannot use the full distribution of SτR—this creates artificial significance since a pair-wise interaction between two trials is counted twice. Once when the once when the first trial is normalized & the second trial is raw, and once in the inverse case. Therefore, only half of projections are considered for p-value and t-value analysis. These are selected such that 1) each trial is the normalized trial half of the time and raw half of the time, and 2) pair-wise interactions are counted only once. Sub-distributions of SτR corresponding to the projection magnitudes involving single trials can be used to identify the “most anomalous and most normal” single trials—(with comparison against the same selection of half of the projection magnitudes). This can be used as a simple technique for artifact rejection.

Identification of canonical CCEP shape using Linear Kernel PCA

We would like to identify a characteristic shape of the canonical CCEP, C(t), determined from V, that characterizes a stimulation-induced interaction between brain regions. The most common way to do this is to take the simple average trace (i.e. C(t)V(t)¯). However, we prefer a quantity that represents the “principal direction” (1st principal component) of V, which captures the variance of the data and is more robust than the average against outlier trials. A standard principal component decomposition (PCA, [19]) is generally not possible in these data because of the practical fact that the number of timepoints, TR, generally far exceeds the number of trials, K, in these data (i.e. TRK), which would require K>TR2 to characterize the TR-by-TR matrix of interdependencies between timepoints in PCA. As in prior work [10], we address this issue by inverting the decomposition using the Linear Kernel PCA technique [2022]. This method allows for the interchange of an eigenvalue decomposition of the matrix VVT (TR2 elements) with VTV (K2 elements). Following this approach, we obtain a matrix F, whose columns are the eigenvectors of VTV, with associated eigenvalues contained in the diagonal matrix ξ2, satisfying (VTV)F=Fξ2. We can then solve for the eigenvectors of VVT, contained in the columns of X: Xξ=VFT. We keep the first column of X as our canonical CCEP shape C(t) (Fig 4).

Fig 4. Parameterizing the evoked response for single trials.

Fig 4

A. An example evoked response, as in Figs 2B and 3B. B. The voltage response Vk(t) from trial k (black) is parameterized by how strongly the canonical response shape (C(t), red trace, time interval t1 to τR) is represented (scaling factor αk) plus the “residual” εk(t) (green): Vk(t) = αkC(t) + εk(t). C. Overlaid Vk(t), αkC(t), and εk(t) for example trial #6. D. As in (C), for all 10 trials.

Parameterizing single trials in terms of the canonical response shapes

We utilize the formalism from functional data analysis to parameterize our data [23, 24]. Each individual trial is represented as a projection of a canonical CCEP form C(t), scaled by a scalar αk, with residual ε(t) (note that ε(t) reflects combined measurement noise and uncorrelated brain activity):

Vk(t)=αkC(t)+εk(t)

We assert that the expectation values related to ε(t) are E(ε) = 0 and E(εk2)E(εl2), for all k and l. This allows us to estimate the projection of C(t) into each individual trial as follows. First, we expand our single-trial formalism above by application of ∑t C(t) to both sides, i.e.:

tC(t)Vk(t)=tC(t)αkC(t)+tC(t)εk(t)

However, ∑t C(t)εk(t) = 0 since E(ε) = 0, and ∑t C(t)αkC(t) = αkt C(t)C(t), which is just αk, since ∑t C(t)C(t) = 1. This allows us to calculate αk for each trial:

αk=tC(t)Vk(t)

Knowing αk, we can quantify the residual signal after regressing out the shape of C(t):

εk(t)=Vk(t)-αkC(t)

With the description Vk(t) = αkC(t) + εk(t), several useful quantities for each trial Vk can be described: a “projection weight” αk; a scaled version of projection weight, αk that is normalized by the square root of the number of samples in C(t) (i.e. in t1 to τR interval) and carries intuitive units of μV (analogous to root-mean-squared response); a scalar “noise” summary term εkTεk (magnitude of the residual); a “signal-to-noise” ratio αk/εkTεk; the “explained variance” by the canonical stimulation response (CCEP shape) is 1-εkTεkVkTVk. Table 1 summarizes these discovered parameters, with some examples illustrated in Fig 5. Note that canonical response extraction and parameter discovery can be highly sensitive to baselining appropriately (Fig 6). The distributions of single trial parameters can be used to quantify the significance of the canonical shape to explain variation in the data, and we call these measures “parameterization significance” to distinguish them from the extraction significance that is described above.

Table 1. Discovered parameters for single stimulation-recording pair.

Parameter Units Interpretation
τ R s Response duration
S¯τR μV·s Averaged1 cross-projection magnitude at time τR
C(t) 1/#samples Canonical CCEP form (unit norm vector, length τR)
Single-trial parameters (for trial k)
α k μV·#samples Projection weight (how strong C(t) is represented in trial k).
αk μV αk normalized by #samples in t1 to τR interval.
εk(t) μV Residual data after regressing out the shape of C(t).
εkTεk μV·#samples A scalar single trial summary term quantifying the magnitude of the residual.
αk/εkTεk dimensionless “Signal-to-noise” ratio of projection weight to residual.
1-εkTεkVkTVk dimensionless “Explained variance” by the stimulation response C(t).

1 Averaged over all non-self stimulation trial cross-projections.

Fig 5. Examples of shapes, durations, projections, and parameterizations.

Fig 5

Five example responses illustrate projection magnitude profiles, parameterization values, and significance metrics. Note that the bottom response does not meet signficance at any time. The four top examples all met extraction significance at τR of p≪ 10−16 (t-test of S¯(τR) vs 0). The bottom example is not significant (p = 0.37). Single trial parameters are averaged across trials for the 3 right-most columns. Note that the second trace might be called the classic N1/N2 response.

Fig 6. Illustrative examples of extraction significance.

Fig 6

A. An example of a high noise, but highly significant voltage response. B. An example of no significant response to stimulation. C. Early significance is detected in an apparently insignificant response. D. Examination of the voltages prior to t1 shows a clear (presumably artifactual) offset, explaining the observation in (C). E. An example of significance throughout a response that appears to be insignificant, though does have a non-zero offset. F. Correcting (E) for the 20μV offset in baseline removes the artifactual significance. Note that p-values determined by t-test of S¯(τR) vs 0.

Results and discussion

The figures in this manuscript show a wide variety of shapes in evoked voltage responses to brain stimulation. No single or several pre-defined form(s) would adequately capture the shape of these responses, with or without sign-flips, temporal scaling, or other manipulation. Therefore, we have constructed an approach to extract structure from these data that begins by calculating semi-normalized dot-product projections between single trials over increasing time intervals. From this, we can uncover a duration of significant response τR, extract a characteristic shape C(t), and then parameterize the single trials in an intuitive formalism: V(t) = αC(t) + ε(t) (Fig 4). We call this recipe “Canonical Response Parameterization” (CRP).

Projection magnitudes and response duration

Description of the voltage time series response to a stimulus typically begins by visualization of the average of many repeated stimuli (Fig 1). In practice, one then tries to infer how robust this shape is by visually observing a suppression of “roughness” in the small deviations in shape as more trials are added to averaging. Alternately, one can plot single trials in the background of the average shape to quantify trial-to-trial variability from the mean (as in Figs 2B or 3B, for example). However, it would be preferable to have a direct quantification of similarities between different trials, and our technique addresses this by performing pairwise cross-projections between trials (with one normalized) to identify structure. The distribution of these cross-projection magnitudes can be compared versus zero to determine significance, which we call extraction significance (illustrated in Fig 2). By omitting self-projections, there is no self-consistency in significance determination and no appeal to the mean across all trials.

This projection technique is then further elaborated upon by applying it to limited time epochs for comparison, as illustrated in Fig 3. A temporal profile for projection magnitude results from this and illustrates the accumulation of information as more structure is considered in the comparison. When adding further time includes data where structure is lost as individual traces trend across zero, negative contributions to the dot product produce a decrease in the overall cross-projection magnitude. The timepoint of the maximum of the temporal profile of cross-projection magnitude therefore reveals the end of the time epoch that is meaningful across trials (we call this the “response duration” τR, Figs 3 and 4).

Figs 5 and 6 show that significant vs. insignificant trials can be readily identified by applying simple statistics to the cross-projection magnitudes, S¯. Furthermore, the response durations τR obtained from the peak of the cross-projection magnitude temporal profiles S¯t clearly capture the timing of meaningful structure that is visually apparent in the CCEP traces. For present use, we plot error bars around τR representing the limits where S¯t exceeds 98% of S¯(τR).

Synthetic response traces, shown in Fig 7 (and S1 Fig) give the reader a set of simple illustrations to develop intuition for S¯t. Notably, responses that are mirrored in voltage or mirrored in time produce the same peak response magnitude, at the same duration (Fig 7G–7L). Splitting a response in two parts and separating them in time does not change the peak cross-projection response magnitude (Fig 7A–7C). Addition of noise to a response will not change the response duration, and only decreases the cross-projection magnitude at very high levels of noise (Fig 7D–7F). Note that cross-projection magnitude profile S¯t for a sustained fixed voltage offset increases by time, as seen in Fig 7. This is a consequence of the fact that the measure is semi-normalized—one of the single-trial vectors in the dot product is normalized (V˜k(t)=Vk(t)/|Vk(t)|), while the other is not. Because of this semi-normalization, the noiseless S¯t profile examples in Fig 7 plateau rather than decrease when the signals return to zero after the synthetic feature—a result of the fact that there is no anti-correlation in pairwise comparisons to reduce the value of the sum in S¯t from its peak.

Fig 7. Examples of projection magnitudes and profiles obtained with synthetic data.

Fig 7

A. A 100ms, 100μV synthetic square wave response (zero noise). B. 50ms/100μV square. C. Two 50ms/100μV square. D. 100ms/100μV square (low noise). E. 100ms/100μV square (intermediate noise). F. 100ms/100μV square (high noise). G. Ramp up to 100μV over 100ms (zero noise). H. Ramp down from 100μV over 100ms. I. Ramp up to 100μV over 50ms then down to 0μV over 50ms. J. Sinusoid (peak ±100μV) over 100ms. K. Inverted sinusoid. L. Absolute value of sinusoid.

How V(t) is normalized prior to cross-projection has a marked effect on how significance is determined, as illustrated in Fig 8. The un-normalized approach (Vk(t)Vl(t)) is sub-optimal because trials with large amplitude are relatively over-emphasized, even when their shape does not reflect the most characteristic structure. Conversely, fully-normalized projections V˜k(t)V˜l(t) are sub-optimal because they measure higher significance for shorter lengths of data (favoring early transients), and are unable to resolve sustained structure over time (as the normalization factor penalizes added datapoints). Semi-normalized projections, V˜k(t)Vl(t), nicely balance an emphasis between response amplitude and sustained structure.

Fig 8. Illustrations of different normalizations of single-trial cross projections.

Fig 8

As discussed in the manuscript, different trials Vk(t) and Vl(t) may be compared with each other directly, or after normalization with V˜k(t)=Vk(t)/|Vk(t)|. A. Un-normalized projections Vk(t)Vl(t) are sub-optimal because trials with large amplitude are over-emphasized in comparison with trials of lower amplitude but more characteristic structure. B. The time-resolved structure of fully-normalized projections V˜k(t)V˜l(t) are sub-optimal because they dramatically favor early transients and cannot resolve temporally-sustained structure. C. Semi-normalized projections are optimal in that they balance emphasis of amplitude and sustained structure between trials. Panels D-F show the same sample data as A-C, and illustrate the effect of extracting the canonical response from different epochs of time. In the “standard” extraction approach we have illustrated so far, C(t) is discovered using linear kernel PCA from V(t) over the isolated time interval from t1 to τR (black line with yellow highlight). We can also unit normalize the average voltage V(t)¯ over the t1 to τR interval, though the explained variance and signal-to-noise are slightly worse. D. If a C(t) is extracted using linear kernel PCA from t1 to t2 = 3 s (blue+red compound trace), the explained variance and signal-to-noise is very poor due to the introduction into the algorithmic process of a large amount of unnecessary noise from the time following τR, even if the extracted form is truncated at τR for parameterization (red trace). E and F. As in (D), but for t2 = 2 s (E) and t2 = 1 s (F). Note how the shapes converge as t2 decreases.

Response duration τR captures the point in time where the signal produced from stimulation becomes indistinguishable from zero (Fig 3). Automated quantification of response duration, rather than visual identification, is important because there is wide variation in duration across pairs of stimulated-at and measured-from brain sites (i.e. Fig 1E). It is also very important because it enables further discovery and robust parameterization of structure in the data: by taking only the segment of data up to the response duration when performing parameterization, unnecessary noise that follows this time does not confuse or diminish the algorithmic process (as illustrated in Fig 8D–8F).

In principle, a response onset/beginning time, τB, could be calculated moving backward from the discovered response duration, e.g. search through a profile of τBτR once τR has been discovered. For the present application, that is felt to be unproductive since conduction times between stimulated electrode pairs and measured responses is of the same order as the initial τB (∼15ms). However, calculation of onset/beginning time would be useful in other, future, contexts, where there is a clear delay between the stimulation and response onset. For example, application of CRP and calculation of τB may be useful in the study of visual or auditory evoked responses, where we know that there is a lag between visual presentation and physiological response that can change in the context of disease (e.g. visual evoked potentials increasing in latency in the context of optic neuritis [25]).

Parameterization of single trials by canonical CRP shapes, C(t), magnitude of the voltage response, αk, and the residual, εk

The discovery of response duration defines the information-rich epoch of data following stimulation, and allows for isolation of the characteristic induced response shape C(t), by using linear kernel PCA on V(t) over the isolated time interval from t1 to τR. Our data-driven CRP approach is an important tool to move analysis of these brain stimulation data past the level of characterization by eye, discovering C(t) empirically (rather than assuming a pre-defined shape). With CRP, researchers can identify and compare different response shapes across stimulation and recording brain sites in different patients using a unified quantification. The formalism is adopted from the field of functional data analysis [23, 24] and allows us to express single trials of the voltage response as Vk(t) = αkC(t) + εk(t) (Fig 4). This representation allows single trials to be summarily characterized by normalized projection weight (α′, in units voltage), signal-to-noise ratio, and explained variance (Fig 5). Importantly, the CRP technique is quite robust and performs well with diminishing signal in the presence of constant noise (which we have found explicitly, using synthetically-generated responses—illustrated in S1 Fig). Quantifying effect size and statistical significance in this way helps to compare many different response shapes (whether short or long) within one framework, and opens up the possibility to explore data in the hypothesis-preselected and divergent paradigms [10]. While our illustrations consist of a low number of trials (10–15), the technique works easily and is associated with higher statistical significance when a much higher number of trials are obtained (S2 Fig). Seemingly dissimilar responses may be statistically compared with one another without difficulty, as illustrated in Fig 5. Of note, the N1/N2 shape, when present, is clearly and effectively captured (e.g. second row of Fig 5).

While the numerical values of α are not intuitive, α′ is normalized by the square root of the number of samples in C(t) (i.e. in t1 to τR interval) and roughly captures the average voltage deflection from zero during the significant response interval. α′ is comparable to the root-mean-squared metric that has been shown to be useful in this context [26], but is weighted only by the empirically-discovered significant interval of the response, rather than a pre-selected epoch defined by the researcher.

The different metrics to quantify and compare response size and significance will be most useful depending on the context. Normalized projection weight α′ is useful to compare whether one stimulation-response pair has a larger average voltage. However, one brain site might have less baseline activity (as quantified by voltage) than some other site, due to a different cellular milieu or organization; in this case the magnitude of the voltage deflection compared to residual or the explained variance in the signal by the stimulation (i.e.αk/εkTεkor1-εkTεkVkTVk) are more meaningful comparators.

Canonical shapes C(t) can be compared across brain sites and patients by taking the dot products to compare similarity. As such comparisons mature, one might account for variations in anatomy and physiology that preserve overall response shape but not conduction speed by performing scaling in time (i.e. by “stretching” C(t) with established techniques [27, 28]).

Note that the ability of C(t) to capture the signal in, and explain the variance of, the voltage responses is diminished if one applies the PCA extraction on longer segments of data, or uses a unit-normalized version of the averaged trace (CCEP), as seen in Fig 8D–8F.

Although this manuscript has concentrated on exploring interactions between stimulated-at and measured-from brain sites, one need not measure at a different site than was stimulated to apply our methodology. One may stimulate and measure the evoked response at the same site, applying this parameterization to the measurement, but ensuring that the beginning time of analysis, t1 is chosen to be well after the stimulation artifact and volume conduction effects have passed [29].

The residual term, εk(t), is a signal that reflects all local brain activity not directly linked to stimulation timing, combined with measurement noise (i.e. from amplifiers and the environment). For example, if a researcher wishes to examine non-phase-locked oscillatory (rhythmic) activity resulting from the stimulation, they should calculate this from εk(t) rather than Vk(t), since the shape of the deflections of the evoked potential C(t) will have corresponding power in the Fourier domain. For example, a positive deflection in a component of C(t) lasting 100ms will have power at 1/(2 ⋅ 0.1s) = 5Hz, but not be an oscillation. Extracts of broadband spectral activity (spread across all frequencies according to a power-law form, but often captured at high frequency by researchers) that capture local brain activity [30] might be best extracted from εk(t) rather than Vk(t).

The εk(t) term can be used as a tool to understand changes in the shape of the response after external conditions have been applied to perturb brain state. After performing a set of stimulations and parameterizing the responses, one might administer a pharmacologic agent, perform a behavioral analysis, apply therapeutic stimulation, or observe a global state change (e.g. transition from waking to sleep, etc). Stimulations may then be re-performed with the brain in the perturbed state, but the responses are parameterized according to the original C(t), obtaining a new set of residuals εkn(t). Then, the extraction and parameterization described in this manuscript is applied to εkn(t) rather than V(t): If any significance is identified, then the resulting new Cn(t) that emerges reveals the structure introduced by the perturbation to brain function (pharmacologic, stimulation therapy, awake/asleep, etc).

Characterizing significance, anomalous trials, and artifact

When considering whether a set of N trials have a significant response to stimulation, the extraction significance defined above reveals how robust the shape is, providing a distribution of N2N cross-projection magnitudes that may be tested versus zero for significance (e.g. 90 datapoints for a 10 trial set). It should be noted that there is some relationship between conjugate cross-projection magnitudes tV˜k(t)Vl(t) and tV˜l(t)Vk(t), but they are not the same (as seen clearly by the difference between red and green datapoints in Fig 9D. This relationship is addressed by a balanced downsampling so that trial-pairs of projections are only included once (as described above). The distribution of p-values obtained from many iterations of null data are evenly distributed on the 0-to-1 interval, indicating that the extracted significances are statistically appropriate (S3 Fig).

Fig 9. Voltage deflections in the scalp EEG from intracranial sEEG electrical stimulation pulses, and automated artifactual trial identification.

Fig 9

A. Schematic, showing sEEG stimulation and EEG recording. B. Ten single-pulse EEG trials (gray) and average trace across trials (black). Note the clearly artifactual trial. C. Time-resolved projection magnitudes for trials from (B). D. Projection magnitudes at τR = 0.23s, suggesting that trial #6 is artifactual (p = 1.8⋅10−6, unpaired t-test comparing red+green vs black). Green dots indicate projections of normalized trial #6 into other trials, and red dots indicate normalized projections of other trials into trial #6. E and F. As in (B and C), with trial #6 removed. Note the change in τR from 0.23 to 0.28s and S¯τR from 8.5 to 14.5μV·s.

As an alternative to the extraction significance, one may calculate the parameterization significance based upon the single trial parameters noted in Table 1, of which there are N datapoints for each parameter (e.g. 10 datapoints for a 10 trial set). For test of significant response (versus no response) αk is the most useful, because it would be expected to be distributed around zero (insignificant) for spurious discovered structure C(t).

When comparing different stimulation-response sets that have very different shapes, it can be quite useful to compare the distributions of parameters between the two. One might say that a response is “significantly larger” than another by comparing one distribution of α′ to another or a response is “more robust” by comparing 1-εkTεkVkTVk distributions (i.e. comparing their explained variance).

We may use the tools of this extraction and parameterization to characterize single trials within a set of stimulation-response measurements—anomalous single trials can be identified by individual comparison of the distribution of cross-projection magnitudes involving one trial to the all of the cross-projection magnitudes involving other trials. Trials with larger-than-average cross-projections may be interpreted as the “most representative” of the shape of the response. Conversely, as illustrated in Fig 9, trials with cross-projections that are far below the others can reveal artifactual trials for automatic rejection from the dataset (for automated artifact rejection, one can use projections at τR or at full duration T sent for analysis). Note that there is a large and rich literature for identifying anomalous data [31], and it will be an interesting future direction to explore more comprehensively with data and methodology of this type.

Biological interpretation of sEEG CCEP

Fig 1 shows that there are a wide variety of stimulation response shapes in the sEEG stimulation-evoked-potential responses, and the durations of these responses may be less than 100ms or last up to 600–700ms. This would be expected from brain surface ECoG measurements, where very different response shapes and durations could be evoked at the same measurement site depending on what site was stimulated [10]. One might hypothesize that the systematic study of waveform shapes C(t) may provide understanding about the biology underlying these responses:

Could each C(t) morphology type reflect a set of projections to different aspects of laminar architecture (e.g. different cell classes, or unique synaptic subtypes on pyramidal neurons) [32]? For example, in primary visual neocortex, differences in laminar pattern separate feedforward and feedback connections across the 6 layers, allowing for the characterization of a visual hierarchy [33]. Feedforward connections preferentially terminate in the middle layer (layer 4), feedback connections preferentially avoid layer 4, while lateral connections terminate in roughly equal density across all layers. A different primary brain area, the motor neocortex, completely lacks a distinct layer 4. The hippocampus, which is archicortex rather than neocortex, only has 3 layers. One would therefore expect that a homologous input type, even if originating from the same source, would produce very different C(t) in visual, motor, and hippocampal cortex. Therefore, consistent differences in C(t) across these regions could inform new models of how intralaminar dynamics generate characteristic voltage responses.

Will future work find that specific shapes of C(t) imply specific biology, such as pro-dromic versus anti-dromic propagation, long-track versus u-fiber white matter transmission, intracortical excitation (via axons that project laterally and remain within the gray matter), or thalamocortical relays [34]? We know for example that, for the divergent paradigm, evoked potentials may arrive with smoothly varying latency, duration, or polarity along adjacent sites in an sEEG lead traversing a natural axis in a brain structure (e.g. the body of the hippocampus in response to stimulation [18]).

The amplitude, width, and overall shape of voltage deflections are influenced by factors relating to the synchronous electrical activity produced in these neuronal populations. At the microelectrode scale, local field potentials have been shown to predominantly reflect coordinated synaptic inputs [35, 36]. For example, negative deflections in LFP recorded at the cortical surface can often represent current sinks generated by synchronized excitatory postsynaptic potentials (EPSPs) at apical dendrites of superficial pyramidal cells. In contrast, EPSPs at deeper cortical layers result in positive deflections in the same surface LFP. The width of an LFP deflection may therefore reflect the coherence of synaptic inputs, or may reflect the timescale of charge influx, which is specific to the neurotransmitter type, signal transduction cascade, and channel dynamics that characterize each synapse [37].

Applications in other scientific and medical contexts

Although we have illustrated this parameterization to the case of single-pulse electrical stimulation through sEEG electrodes, the approach might be applied in many other settings where one wants to characterize a reliable response structure of unknown duration. A few such possibilities are:

  • Evoked electrical and magnetic changes in the brain in response to visual or auditory stimuli are typically called event-related potentials (ERPs) (cf. [38, 39]). ERPs have been studied exhaustively in EEG, ECoG, and MEG, to study sensation, perception, cognition, memory, and other aspects of brain function [38, 4044]. Event-related potentials have been studied to understand injuries and diseases of the brain and spinal cord [4547], and are also used intraoperatively to dynamically to study the function of the spinal cord and brainstem (e.g. somatosensory evoked potentials—SSEPs [48] and brainstem evoked auditory responses—BAERs [49]). Much as in the case of the N1/N2 formulation described above, these ERP data typically focus on identification of a feature by the voltage at hand-picked latencies after the stimulus. The CRP approach detailed here would automate and simplify identification of structure and relative significance in the ERP. For the example case of ERPs in EEG, it is often said anecdotally that single trial signal is very low compared to the residual “noise”—application of CRP would allow one to quantify this explicitly.

  • Early work with a similar formulation has been also useful for colleagues in neuroscience examining the EEG response to deep brain stimulation [50]. Our specific extraction and parameterization may fit nicely into their work, expanding on it by allowing for identification of the salient duration τR and single-trial parameterizations noted in Table 1.

  • The hemodynamic response functions (HRFs) measured with fMRI have different shapes across different regions and laminae (cf. [51, 52]), and CRP might simplify the comparison of these in different voxels.

  • A parameterization could be performed by replacing stimulation times with “discovered events” in ongoing brain data may be useful in examining electrophysiology studies such as action potential characterization and sorting in high-impedance microelectrode recordings.

  • Brain state under anesthesia can affect CCEP shape [11]. One might apply CRP to a set of stimulations performed under one state of anesthesia, and apply the initial parameterization to a new set of stimulations performed during a different subsequent anesthesia state. Changes in α′ or repeated CRP applied to the residual ε(t) of this subsequent parameterization would reveal change in response structure that accompanies change in anesthesia.

  • Somatosensory evoked potentials (SSEPs) are measured from the brain or spinal cord in response to electrical stimulation of the peripheral nervous system for medical diagnostics in the operating room and the clinic. In the operating room, these are a realtime diagnostic electrophysiology that can dynamically reveal impending injury so the surgeon can stop an action before causing permanent injury. In the clinic and hospital setting, these can be used to diagnose brain function in coma (diminished level of consciousness) after anoxia or traumatic brain injury [46, 53, 54]. Parameterization would dramatically simplify the nuance required by the electrophysiological technician who assists in these surgical procedures.

  • Single-pulse electrical stimulation of the white and gray matter has been used for intraoperative connectivity mapping during surgery for tumor and epileptic focus resection [55, 56]. The utility of these diagnostics is still being explored [57], and CRP could help to simplify and standardize the interpretation of the CCEPs (the shape of which, as shown here, will vary dramatically), helping to identify the optimal approach for assistance during resection.

  • Our ongoing work—as well as those of many colleagues [58]—is focused on the exploration of epileptic networks. With the advent of stimulation devices that can record and perform open- or closed-loop stimulation [5961], and can stimulate through 4 leads [62], brain stimulation for epilepsy is rapidly evolving. As we learn to stimulate networks in tandem at different cortical and thalamic sites, the ability to quantify connectivity during sEEG implants will help to drive better DBS and RNS system implantations [63].

Limitations, alternative considerations, and future technical strategies

There are important limitations to consider when implementing CRP. By construction, this method cannot parameterize the timing of particular features. An example of this is the case where one wishes to quantify the propagation time between two areas (i.e. the latency). This is typically done by finding the first extrema (peak or trough) in the averaged response as an important time [6, 17, 64]. While this could be performed on C(t), it is not explicitly built into the parameterization process. A change in output can have forms that are not easily tracked by the CRP technique, such as perturbations in the overall brain state affecting the amplitude of a specific deflection within the CCEP (while sparing other deflections) in subsequent stimulation trials; alternatively, timescales can change and the duration may get longer. CRP may not be useful in those settings (though the change would be quantified in correlated structure across the residual ε(t)).

By taking the peak magnitude of S¯t as the duration, a late resurgence of structure (“blip”) following a period of relative insignificance will only contribute if it can overcome any intervening loss in cross-correlation to create a higher peak in the projection profile. Notably, we have not yet observed this in our studies, but it remains an important possibility to be aware of.

The reader should be aware of two frequent artifactual conditions, illustrated in Fig 6. In the first of these (Fig 6C and 6D), a seemingly insignificant response has a very significant brief structure at the beginning of the examined period. This situation may arise when a latent effect of stimulation artifact “carries forward” into the window being considered. Determining what is stimulation artifact and what is brief evoked neural activity is a nuanced topic that we defer to future study. The second artifactual condition to consider (Fig 6E and 6F) is the case where a set of responses appear to be complete noise, but the time-resolved projection magnitude S¯t grows steadily in time. Inappropriate baselining of the data produces this—we also defer comprehensive exploration of this to future treatment.

As opposed to quantifying time-domain (i.e. raw voltage) changes, one might instead study responses to single pulse electrical stimulation in the frequency domain. Broadband changes in the frequency domain are of particular appeal since their shapes may be interpreted generically as increases in firing rate [30, 6567], without the need to interpret polyphasic shapes as we do in this manuscript. Crowther, et. al. and Kundu et. al. [13, 68] showed that broadband changes can effectively identify interactions between brain areas, and it is very likely that broadband changes and raw voltage changes have complementary information, which has been shown for ECoG responses to visual stimuli [41]. Frequency-domain changes that are peaked at a particular frequency (rather than broadband) can reveal stimulation-evoked brain rhythms (oscillations), and are a topic of future study. As noted above, one must be careful when inferring the presence of a rhythm purely from examining responses in the frequency domain, since a simple voltage deflection (like many of those seen in Fig 1), will have power at a frequency that is the inverse of the width of the voltage deflection.

Future exploration might expand this parameterization approach in a number of different directions:

  • C(t) could be chosen in different manners than we have, such as: using the simple average trace (i.e. C(t)V(t)¯—we have anecdotally found that using the simple mean as the canonical form, rather than the PCA-based extraction, increases α′, while reducing the SNR, as seen in S4 Fig); using the “most representative” single trial, identified by the trial that has the largest average cross-projection when compared with other trials (e.g. the first trial, indicated by blue dots, in Fig 6E and 6F), truncated to τR; a globally-defined average shape, such as one chosen from the average in a corresponding brain site over many patients [14]; or canonically-defined shape, like the “N1/N2” shape.

  • As noted above, a beginning time τB could be calculated by moving backward from the optimal duration and recalculating the S¯t profile, but over τBτR once τR is known.

  • It is possible to calculate the “significance of the leftover”, by performing projections on the leftover matrix Vk(τRtoT), and defining the new τR as the value for which “leftover” cross-projection magnitude drops below a particular significance level. There are problems with this, because choice of T is somewhat arbitrary without further constraint, so the threshold will also be arbitrary.

  • In our present application, error bars (uncertainty) around τR represent the limits where S¯t exceeds 98% of S¯(τR) (since S¯t reflects a distribution). Future approaches might employ a more nuanced approach to quantify this.

  • There is very little jitter in the response onsets of these CCEPs. In other contexts, such as ERP research, there is known variation in response onset, and expanded approaches will be needed in order to align trials temporally prior to parameterization.

  • It is possible to calculate cross-projections using an alternative approach: Instead of normalizing one trial by its norm, and not normalizing the other, one can normalize both trials by the square root of their respective norms. This has the effect of tightening the distribution of projections—generating higher extraction significance, but also de-emphasizing anomalous trials (i.e. those that are most representative, or those that are most likely to be artifactual).

  • It may be useful in future studies to keep additional columns of X in the linear kernel PCA to study variation across trials (i.e. the second-order moment in the data), rather than the first column alone which is our canonical CCEP shape C(t) (a robust approximation of the mean).

  • Future treatments might examine the effect of temporal dilation in a response—where the shape of the physiologic response is prolonged or contracted due to disease, medication, etc. The field of functional data analysis has developed “time warping” approaches [27, 28] for just this purpose, and they can be applied directly to the CRP parameterization.

  • It will be interesting to explore an optimal CRP parametrization for multimodal brain data (e.g. [6971]). Here the parametrization may further reflect cross-modal spatial and temporal dependencies.

Supporting information

S1 Fig. Artificially-generated evoked responses with variation in signal to noise.

A. An artificial signal trace, normalized to variance of 1. B. 10 trials of brown-noise (i.e. random walk) timeseries, with each normalized to z-score of 1. Brown noise generated by cumulative sum of random data on -0.5 to 0.5 interval and subtracting off of running mean. C. Response duration (left) and timecourse of projection weights (right) extracted from synthetic traces with noise traces from (B) added to signal trace at ratio of 3-to-1. D. Response duration (left) and timecourse of projection weights (right) extracted from synthetic traces with noise traces from (B) added to signal trace at “mild” variable ratios of 1.2 to 3.0 in 0.2 intervals. E. Response duration (left) and timecourse of projection weights (right) extracted from synthetic traces with noise traces from (B) added to signal trace at “extreme” variable ratios of {0.38; 0.47; 0.59; 0.74; 0.94; 1.18; 1.48; 1.86; 2.34; 2.94}. F. Parameterization of the artificial evoked responses of constant signal-to-noise ratio of 3-to-1 (from (C)). G. Parameterization of the artificial evoked responses of the “mild” variable signal-to-noise ratios of 1.2 to 3.0 in 0.2 intervals (from (D)). H. Parameterization of the artificial evoked responses of the “extreme” variable ratios of {0.38; 0.47; 0.59; 0.74; 0.94; 1.18; 1.48; 1.86; 2.34; 2.94} (from (E)). I. Extracted C(t) for different noise levels overlaid on top of original artificial form. J. Single-trial noise residuals for different noise levels. K. Single-trial α′ to noise residual (SNR) for different noise levels. L. Single-trial explained variance for different noise levels. M. Single-trial ratio of coefficient α′ to input SNR for different noise levels. Differences between extreme variable traces (yellow) in (J) and (M) are due to shorter C(t). This shorter C(t) may be related to added correlated deviation toward zero by the brown noise statistics disproportionally contributing at higher noise levels.

(TIF)

S2 Fig. Example of parameterization with a large number of trials.

Measurement is from a dorsal insular contact in response to stimulation of white matter in the orbitofrontal cortex. A. Stimulation was performed 69 times. Artifact rejection was at a threshold of p <10−10, resulting in rejection of 6 trials. The extraction was robust with an associated t-value of 149. B. The first 10 trials from (A) were parameterized in an identical fashion. No trials were identified as artifactual, and the associated t-value for extraction was 23. Note that the response duration (τR), mean projection at response duration (S¯), and scaling coefficient (α′) were all nearly identical. However, the statistics of the parametrization were much more robust for 69 trials. The averaged explained variance and SNR were slightly higher for 10 trials (as might be expected).

(TIF)

S3 Fig. Generation of many artificially-generated sets of pure-noise data to validate statistics.

A. Top: An example of a single brown-noise (i.e. random walk) timecourse. Bottom: A 10-trial set of brown noise timecourses. B. A histogram of extraction significances from 20,000 surrogate sets of brown-noise timecourses. C. Top: An example of a single white-noise timecourse. Bottom: A 10-trial set of white-noise timecourses. D. A histogram of extraction significances from 20,000 surrogate sets of white-noise timecourses. Because histograms of p-values show a flat distribution over the 0-to-1 interval in (B) and (D), we may infer the statistical method is well calibrated for null models.

(TIF)

S4 Fig. An illustration of calculating the canonical shape from linear kernel PCA or from the simple mean.

(A-C) are from the example in the middle row of Fig 5 and (D-F) are from Fig 8. A. The averaged voltage response, is shown with a black line, and the significant portion of the response is highlighted (i.e. up to τR). B. C(t) calculated from linear kernel PCA (blue) and from the simple mean (red). C. Parameterizations calculated from linear PCA vs mean voltage extractions. D-F. As in (A-C), for the example from Fig 8.

(TIF)

Acknowledgments

We are grateful to the patients who volunteered their time to participate in this research and to the staff at St. Marys hospital. Oliver Unke provided valuable comments on the manuscript. We would also like to thank a reviewer from the manuscript “Basis profile curve identification to understand electrical stimulation effects in human brain networks” who suggested inquiry along these lines, the exploration of which lead to this present work.

Data Availability

All code to implement this technique along with the sample data to reproduce the illustrations are publicly available for use without restriction (other than attribution) at: https://osf.io/tx3yq and https://github.com/kaijmiller/crp_scripts.

Funding Statement

KJM was supported by the Van Wagenen Fellowship, the Brain Research Foundation with a Fay/Frank Seed Grant, the Brain & Behavior Research Foundation with a NARSAD Young Investigator Grant, and the Foundation For OCD Research. KRM was supported in part by the Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea Government: No. 2019-0-00079, Artificial Intelligence Graduate School Program, Korea University; and No. 2022-0-00984, Development of Artificial Intelligence Technology for Personalized Plug-and-Play Explanation and Verification of Explanation. KRM was also supported by the German Ministry for Education and Research (BMBF) under Grants 01IS14013A-E, 01GQ1115, 01GQ0850, 01IS18025A, 031L0207D, 01IS18037A as well as Berlin Institute for the Foundations of Learning and Data (BIFOLD). DH & KJM were supported by the Mayo Clinic Center for Biomedical Discovery with a DERIVE grant. This work was also supported by the National Institutes of Health (NIH) NCATS CTSA KL2 TR002379 (KJM), NINDS U01-NS128612 (KJM, GAW), NIMH CRCNS R01MH122258 (DH), NIH UH2/UH3-NS95495 (GAW), and R01-NS09288203 (GAW). Manuscript contents are solely the responsibility of the authors and do not necessarily represent the official views of the NIH. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1. Adrian ED. The spread of activity in the cerebral cortex. The Journal of physiology. 1936;88(2):127. doi: 10.1113/jphysiol.1936.sp003427 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Purpura DP, Pool J, Frumin M, Housepian E, et al. Observations on evoked dendritic potentials of human cortex. Electroencephalography and clinical neurophysiology. 1957;9(3):453–459. doi: 10.1016/0013-4694(57)90034-2 [DOI] [PubMed] [Google Scholar]
  • 3. Ilmoniemi RJ, Virtanen J, Ruohonen J, Karhu J, Aronen HJ, Näätänen R, et al. Neuronal responses to magnetic stimulation reveal cortical reactivity and connectivity. Neuroreport. 1997;8(16):3537–3540. doi: 10.1097/00001756-199711100-00024 [DOI] [PubMed] [Google Scholar]
  • 4. Matsumoto R, Nair DR, LaPresto E, Najm I, Bingaman W, Shibasaki H, et al. Functional connectivity in the human language system: a cortico-cortical evoked potential study. Brain. 2004;127(10):2316–2330. doi: 10.1093/brain/awh246 [DOI] [PubMed] [Google Scholar]
  • 5. Valentin A, Anderson M, Alarcon G, Seoane JG, Selway R, Binnie C, et al. Responses to single pulse electrical stimulation identify epileptogenesis in the human brain in vivo. Brain. 2002;125(8):1709–1718. doi: 10.1093/brain/awf187 [DOI] [PubMed] [Google Scholar]
  • 6. Enatsu R, Gonzalez-Martinez J, Bulacio J, Kubota Y, Mosher J, Burgess RC, et al. Connections of the limbic network: a corticocortical evoked potentials study. Cortex. 2015;62:20–33. doi: 10.1016/j.cortex.2014.06.018 [DOI] [PubMed] [Google Scholar]
  • 7. Miller KJ, Fine AL. Decision-making in stereotactic epilepsy surgery. Epilepsia. 2022;63(11):2782–2801. doi: 10.1111/epi.17381 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Romeo A, Issa Roach AT, Toth E, Chaitanya G, Ilyas A, Riley KO, et al. Early ictal recruitment of midline thalamus in mesial temporal lobe epilepsy. Annals of clinical and translational neurology. 2019;6(8):1552–1558. doi: 10.1002/acn3.50835 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Dionisio S, Mayoglou L, Cho SM, Prime D, Flanigan PM, Lega B, et al. Connectivity of the human insula: a cortico-cortical evoked potential (CCEP) study. Cortex. 2019;120:419–442. doi: 10.1016/j.cortex.2019.05.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Miller KJ, Müller KR, Hermes D. Basis profile curve identification to understand electrical stimulation effects in human brain networks. PLoS Computational Biology. 2021;17(9):e1008710. doi: 10.1371/journal.pcbi.1008710 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Yamao Y, Matsumoto R, Kunieda T, Nakae T, Nishida S, Inano R, et al. Effects of propofol on cortico-cortical evoked potentials in the dorsal language white matter pathway. Clinical Neurophysiology. 2021;132(8):1919–1926. doi: 10.1016/j.clinph.2021.04.021 [DOI] [PubMed] [Google Scholar]
  • 12. Keller CJ, Honey CJ, Entz L, Bickel S, Groppe DM, Toth E, et al. Corticocortical evoked potentials reveal projectors and integrators in human brain networks. Journal of Neuroscience. 2014;34(27):9152–9163. doi: 10.1523/JNEUROSCI.4289-13.2014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Crowther LJ, Brunner P, Kapeller C, Guger C, Kamada K, Bunch ME, et al. A quantitative method for evaluating cortical responses to electrical stimulation. Journal of neuroscience methods. 2019;311:67–75. doi: 10.1016/j.jneumeth.2018.09.034 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Huang H, Gregg NM, Valencia GO, Brinkmann BH, Lundstrom BN, Worrell GA, et al. Electrical stimulation of temporal and limbic circuitry produces distinct responses in human ventral temporal cortex. bioRxiv. 2022;. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Huang H, Valencia GO, Hermes D, Miller KJ. A canonical visualization tool for SEEG electrodes. In: 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE; 2021. p. 6175–6178. [DOI] [PMC free article] [PubMed]
  • 16.Huang H, Valencia GO, Hermes D, Miller KJ. The SEEGView package: SEEG plotting tools in canonical AC-PC slices Available from: https://github.com/MultimodalNeuroimagingLab/mnl_seegview.
  • 17. van Blooijs D, van den Boom MA, van der Aar JF, Huiskamp GM, Castegnaro G, Demuru M, et al. Developmental trajectory of transmission speed in the human brain. Nature Neuroscience. 2023; p. 1–5. doi: 10.1038/s41593-023-01272-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Ojeda Valencia G, Gregg NM, Worrell GA, Huang H, Lundstrom B, Brinkmann B, et al. Signatures of electrical stimulation driven network interactions in the human limbic system. bioRxiv. 2022; p. 2022–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Bishop CM. Pattern recognition and machine learning. springer; 2006. [Google Scholar]
  • 20.Schölkopf B, Mika S, Smola A, Rätsch G, Müller KR. Kernel PCA pattern reconstruction via approximate pre-images. In: International Conference on Artificial Neural Networks. Springer; 1998. p. 147–152.
  • 21. Schölkopf B, Smola A, Müller KR. Nonlinear component analysis as a kernel eigenvalue problem. Neural computation. 1998;10(5):1299–1319. doi: 10.1162/089976698300017467 [DOI] [Google Scholar]
  • 22. Schölkopf B, Mika S, Burges CJ, Knirsch P, Müller KR, Rätsch G, et al. Input space versus feature space in kernel-based methods. IEEE transactions on neural networks. 1999;10(5):1000–1017. doi: 10.1109/72.788641 [DOI] [PubMed] [Google Scholar]
  • 23. Chiou JM. Dynamical functional prediction and classification, with application to traffic flow prediction. The Annals of Applied Statistics. 2012;6(4):1588–1614. doi: 10.1214/12-AOAS595 [DOI] [Google Scholar]
  • 24. Li PL, Chiou JM. Identifying cluster number for subspace projected functional data clustering. Computational Statistics & Data Analysis. 2011;55(6):2090–2103. doi: 10.1016/j.csda.2011.01.001 [DOI] [Google Scholar]
  • 25. Halliday A, McDonald W, Mushin J. Delayed visual evoked response in optic neuritis. The Lancet. 1972;299(7758):982–985. doi: 10.1016/S0140-6736(72)91155-5 [DOI] [PubMed] [Google Scholar]
  • 26. Prime D, Woolfe M, Rowlands D, O’Keefe S, Dionisio S. Comparing connectivity metrics in cortico-cortical evoked potentials using synthetic cortical response patterns. Journal of Neuroscience Methods. 2020;334:108559. doi: 10.1016/j.jneumeth.2019.108559 [DOI] [PubMed] [Google Scholar]
  • 27.Wang JL, Chiou JM, Müller HG. Review of functional data analysis. arXiv preprint arXiv:150705135. 2015;.
  • 28. Liu X, Müller HG. Functional convex averaging and synchronization for time-warped random curves. Journal of the American Statistical Association. 2004;99(467):687–699. doi: 10.1198/016214504000000999 [DOI] [Google Scholar]
  • 29. Prime D, Woolfe M, O’Keefe S, Rowlands D, Dionisio S. Quantifying volume conducted potential using stimulation artefact in cortico-cortical evoked potentials. Journal of neuroscience methods. 2020;337:108639. doi: 10.1016/j.jneumeth.2020.108639 [DOI] [PubMed] [Google Scholar]
  • 30. Miller KJ, Sorensen LB, Ojemann JG, Den Nijs M. Power-law scaling in the brain surface electric potential. PLoS computational biology. 2009;5(12):e1000609. doi: 10.1371/journal.pcbi.1000609 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Ruff L, Kauffmann JR, Vandermeulen RA, Montavon G, Samek W, Kloft M, et al. A unifying review of deep and shallow anomaly detection. Proceedings of the IEEE. 2021;109(5):756–795. doi: 10.1109/JPROC.2021.3052449 [DOI] [Google Scholar]
  • 32. Mitzdorf U. Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena. Physiological reviews. 1985;65(1):37–100. doi: 10.1152/physrev.1985.65.1.37 [DOI] [PubMed] [Google Scholar]
  • 33. Felleman DJ, Van Essen DC. Distributed hierarchical processing in the primate cerebral cortex. Cerebral cortex (New York, NY: 1991). 1991;1(1):1–47. [DOI] [PubMed] [Google Scholar]
  • 34.Miller KJ, Huiskamp G, van Blooijs D, Hermes D, Gebbink TA, Ferrier CH, et al. An observation of anatomical clustering in inputs to primary motor cortex in cortico-cortical brain surface evoked potentials. In: 2019 7th International Winter Conference on Brain-Computer Interface (BCI). IEEE; 2019. p. 1–2.
  • 35. Eccles J. Interpretation of action potentials evoked in the cerebral cortex. Electroencephalography and clinical neurophysiology. 1951;3(4):449–464. doi: 10.1016/0013-4694(51)90033-8 [DOI] [PubMed] [Google Scholar]
  • 36. Mitzdorf U, Singer W. Prominent excitatory pathways in the cat visual cortex (A 17 and A 18): a current source density analysis of electrically evoked potentials. Experimental Brain Research. 1978;33(3):371–394. [DOI] [PubMed] [Google Scholar]
  • 37. Shepherd GM. The synaptic organization of the brain. Oxford university press; 2004. [Google Scholar]
  • 38. Luck SJ. An introduction to the event-related potential technique. MIT press; 2014. [Google Scholar]
  • 39. Blankertz B, Lemm S, Treder M, Haufe S, Müller KR. Single-trial analysis and classification of ERP components—a tutorial. NeuroImage. 2011;56(2):814–825. doi: 10.1016/j.neuroimage.2010.06.048 [DOI] [PubMed] [Google Scholar]
  • 40. Helfrich RF, Knight RT. Cognitive neurophysiology: event-related potentials. Handbook of clinical neurology. 2019;160:543–558. doi: 10.1016/B978-0-444-64032-1.00036-9 [DOI] [PubMed] [Google Scholar]
  • 41. Miller KJ, Schalk G, Hermes D, Ojemann JG, Rao RP. Spontaneous decoding of the timing and content of human object perception from cortical surface recordings reveals complementary information in the event-related potential and broadband spectral change. PLoS computational biology. 2016;12(1):e1004660. doi: 10.1371/journal.pcbi.1004660 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Picton TW. The P300 wave of the human event-related potential. Journal of clinical neurophysiology. 1992;9(4):456–479. doi: 10.1097/00004691-199210000-00002 [DOI] [PubMed] [Google Scholar]
  • 43. Alho K, Winkler I, Escera C, Huotilainen M, Virtanen J, Jääskeläinen IP, et al. Processing of novel sounds and frequency changes in the human auditory cortex: magnetoencephalographic recordings. Psychophysiology. 1998;35(2):211–224. doi: 10.1111/1469-8986.3520211 [DOI] [PubMed] [Google Scholar]
  • 44. Lu S, Hämäläinen M, Hari R, Ilmoniemi R, Lounasmaa O, Sams M, et al. Seeing faces activates three separate areas outside the occipital visual cortex in man. Neuroscience. 1991;43(2-3):287–290. doi: 10.1016/0306-4522(91)90293-W [DOI] [PubMed] [Google Scholar]
  • 45. Cohen M, Schandler S, Vulpe M. Event-related brain potentials during orienting to auditory and visual stimulation in spinal cord injured humans. Spinal Cord. 1992;30(12):864–871. doi: 10.1038/sc.1992.163 [DOI] [PubMed] [Google Scholar]
  • 46. Pruvost-Robieux E, Marchi A, Martinelli I, Bouchereau E, Gavaret M. Evoked and Event-Related Potentials as Biomarkers of Consciousness State and Recovery. Journal of Clinical Neurophysiology. 2022;39(1):22–31. doi: 10.1097/WNP.0000000000000762 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Roberts TP, Khan SY, Rey M, Monroe JF, Cannon K, Blaskey L, et al. MEG detection of delayed auditory evoked responses in autism spectrum disorders: towards an imaging biomarker for autism. Autism Research. 2010;3(1):8–18. doi: 10.1002/aur.111 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Robinson PA, Chen Pc, Yang L. Physiologically based calculation of steady-state evoked potentials and cortical wave velocities. Biological cybernetics. 2008;98(1):1–10. doi: 10.1007/s00422-007-0191-z [DOI] [PubMed] [Google Scholar]
  • 49. Stone JL, Calderon-Arnulphi M, Watson KS, Patel K, Mander NS, Suss N, et al. Brainstem auditory evoked potentials–a review and modified studies in healthy subjects. Journal of Clinical Neurophysiology. 2009;26(3):167–175. doi: 10.1097/WNP.0b013e3181a76a6e [DOI] [PubMed] [Google Scholar]
  • 50. Kibleur A, Polosan M, Favre P, Rudrauf D, Bougerol T, Chabardès S, et al. Stimulation of subgenual cingulate area decreases limbic top-down effect on ventral visual stream: A DBS-EEG pilot study. NeuroImage. 2017;146:544–553. doi: 10.1016/j.neuroimage.2016.10.018 [DOI] [PubMed] [Google Scholar]
  • 51. Kay K, Jamison KW, Vizioli L, Zhang R, Margalit E, Ugurbil K. A critical assessment of data quality and venous effects in sub-millimeter fMRI. Neuroimage. 2019;189:847–869. doi: 10.1016/j.neuroimage.2019.02.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Bießmann F, Murayama Y, Logothetis NK, Müller KR, Meinecke FC. Improved decoding of neural activity from fMRI signals using non-separable spatiotemporal deconvolutions. NeuroImage. 2012;61(4):1031–1042. doi: 10.1016/j.neuroimage.2012.04.015 [DOI] [PubMed] [Google Scholar]
  • 53. Zandbergen EG, de Haan RJ, Stoutenbeek CP, Koelman JH, Hijdra A. Systematic review of early prediction of poor outcome in anoxicischaemic coma. The Lancet. 1998;352(9143):1808–1812. doi: 10.1016/S0140-6736(98)04076-8 [DOI] [PubMed] [Google Scholar]
  • 54. Anderson DC, Bundlie S, Rockswold GL. Multimodality evoked potentials in closed head trauma. Archives of neurology. 1984;41(4):369–374. doi: 10.1001/archneur.1984.04050160031011 [DOI] [PubMed] [Google Scholar]
  • 55. Boyer A, Ramdani S, Duffau H, Dali M, Vincent MA, Mandonnet E, et al. Electrophysiological Mapping During Brain Tumor Surgery: Recording Cortical Potentials Evoked Locally, Subcortically and Remotely by Electrical Stimulation to Assess the Brain Connectivity On-line. Brain topography. 2021;34(2):221–233. doi: 10.1007/s10548-020-00814-0 [DOI] [PubMed] [Google Scholar]
  • 56. Kamada K, Kapeller C, Takeuchi F, Gruenwald J, Guger C. Tailor-made surgery based on functional networks for intractable epilepsy. Frontiers in Neurology. 2020;11:73. doi: 10.3389/fneur.2020.00073 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Lega B, Dionisio S, Flanigan P, Bingaman W, Najm I, Nair D, et al. Cortico-cortical evoked potentials for sites of early versus late seizure spread in stereoelectroencephalography. Epilepsy research. 2015;115:17–29. doi: 10.1016/j.eplepsyres.2015.04.009 [DOI] [PubMed] [Google Scholar]
  • 58. Boido D, Kapetis D, Gnatkovsky V, Pastori C, Galbardi B, Sartori I, et al. Stimulus-evoked potentials contribute to map the epileptogenic zone during stereo-EEG presurgical monitoring. Wiley Online Library; 2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Goyal A, Goetz S, Stanslaski S, Oh Y, Rusheen AE, Klassen B, et al. The development of an implantable deep brain stimulation device with simultaneous chronic electrophysiological recording and stimulation in humans. Biosensors and Bioelectronics. 2021;176:112888. doi: 10.1016/j.bios.2020.112888 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60. Gregg NM, Marks VS, Sladky V, Lundstrom BN, Klassen B, Messina SA, et al. Anterior nucleus of the thalamus seizure detection in ambulatory humans. Epilepsia. 2021;62(10):e158–e164. doi: 10.1111/epi.17047 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Bergey GK, Morrell MJ, Mizrahi EM, Goldman A, King-Stephens D, Nair D, et al. Long-term treatment with responsive brain stimulation in adults with refractory partial seizures. Neurology. 2015;84(8):810–817. doi: 10.1212/WNL.0000000000001280 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Rusheen AE, Jensen MA, Gregg NM, Kaufmann T, Van Gompel JJ, et al. Preliminary Experience with a Four-Lead Implantable Pulse Generator for Deep Brain Stimulation. Stereotactic and Functional Neurosurgery. 2023; in print. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63. Wong JK, Deuschl G, Wolke R, Bergman H, Muthuraman M, Groppa S, et al. Proceedings of the Ninth Annual Deep Brain Stimulation Think Tank: Advances in Cutting Edge Technologies, Artificial Intelligence, Neuromodulation, Neuroethics, Pain, Interventional Psychiatry, Epilepsy, and Traumatic Brain Injury. Frontiers in Human Neuroscience. 2022; p. 25. doi: 10.3389/fnhum.2022.813387 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64. Conner CR, Ellmore TM, DiSano MA, Pieters TA, Potter AW, Tandon N. Anatomic and electro-physiologic connectivity of the language system: a combined DTI-CCEP study. Computers in biology and medicine. 2011;41(12):1100–1109. doi: 10.1016/j.compbiomed.2011.07.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65. Miller KJ, Honey CJ, Hermes D, Rao RP, denNijs M, Ojemann JG. Broadband changes in the cortical surface potential track activation of functionally diverse neuronal populations. Neuroimage. 2014;85:711–720. doi: 10.1016/j.neuroimage.2013.08.070 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66. Jensen MA, Huang H, Ojeda Valencia G, Klassen B, van den Boom M, et al. A motor association area in the depths of the central sulcus. Nature Neuroscience. 2023;p. 1–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67. Manning JR, Jacobs J, Fried I, Kahana MJ. Broadband shifts in local field potential power spectra are correlated with single-neuron spiking in humans. Journal of Neuroscience. 2009;29(43):13613–13620. doi: 10.1523/JNEUROSCI.2041-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68. Kundu B, Davis TS, Philip B, Smith EH, Arain A, Peters A, et al. A systematic exploration of parameters affecting evoked intracranial potentials in patients with epilepsy. Brain Stimulation. 2020;13(5): 1232–1244. doi: 10.1016/j.brs.2020.06.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69. Sui J, Adali T, Yu Q, Chen J, Calhoun VD. A review of multivariate methods for multimodal fusion of brain imaging data. Journal of neuroscience methods. 2012;204(1):68–81. doi: 10.1016/j.jneumeth.2011.10.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70. Dähne S, Biessmann F, Samek W, Haufe S, Goltz D, Gundlach C, et al. Multivariate machine learning methods for fusing multimodal functional neuroimaging data. Proceedings of the IEEE. 2015;103(9):1507–1530. doi: 10.1109/JPROC.2015.2425807 [DOI] [Google Scholar]
  • 71. Bießmann F, Meinecke FC, Gretton A, Rauch A, Rainer G, Logothetis NK, et al. Temporal kernel CCA and its application in multimodal neuronal data analysis. Machine Learning. 2010;79(1-2):5–27. doi: 10.1007/s10994-009-5153-3 [DOI] [Google Scholar]
PLoS Comput Biol. doi: 10.1371/journal.pcbi.1011105.r001

Decision Letter 0

Lyle J Graham, Hayriye Cagnan

10 Nov 2022

Dear Dr Miller,

Thank you very much for submitting your manuscript "Canonical Response Parameterization: Quantifying the structure of responses to single-pulse intracranial electrical brain stimulation" for consideration at PLOS Computational Biology.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

While both reviewers agreed that the approach is novel and valuable, they have raised concerns regarding 1) quantification of algorithm performance, in particular critical factors influencing performance including the number of trials 2) validation and clarification regarding the domain of application

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Hayriye Cagnan

Academic Editor

PLOS Computational Biology

Lyle Graham

Section Editor

PLOS Computational Biology

***********************

While both reviewers agreed that the approach is novel and valuable, they have raised concerns regarding 1) quantification of algorithm performance, in particular critical factors influencing performance including the number of trials 2) validation and clarification regarding the domain of application

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The authors introduced a new method for quantifying the structure of the response to SPES. This method does not need a predetermined waveforms such as N1 or N2 by the examiner. Instead it employs semi-normalized dot-product projection to extract non-artifactual true response, determine the response duration, and then extract a characteristic shape for each recording contact using the Canonical Response Parameterization (CRP). They applied this methodology to the 2 patients with SEEG investigation, who underwent CCEP recording (10 stimulation per stimulus site). The concept is interesting in that we do not need a priori waveform as the previous SPES/CCEP literatures have defined, and that the method produces the canonical waveform and gets rid of the residual activities. The attempt is novel and interesting, but this new method needs some clarification for publication in the PLOS Computational Biology.

#1 Impact on artifact reduction

It is interesting to note that this method can find the outlier waveform (out of 10 waveforms obtained by 10 trials of stimulation). This is of clinical use when only the number of stimulation trials is small (10) as in this study. This may not be so effective for the stimulation trials over 50 trials. It would be nice if you have actual CCEP dataset of >50 trials and compare the effect of this method upon artifact reduction (or do some sort of simulation).

It is also interesting to know how this method can get rid of the epileptic activity (usually larger than CCEP) that overrode (superimpose) on the CCEP response (which may occur only in some trials).

#2 Significance of the method for clinical evaluation

As the authors pointed out typical N1/N2 waveforms are not always available especially in the case of SEEG recording. It would be nice to show more examples (CCEP findings form all the electrode contact (grey matter) for each stimulus site, and if possible, CCEP findings for more stimulus sites), since only a part of the CCEP waveforms is shown. It would be nice to see the effect of this method on the adjacent large CCEP response as well as the remote, relatively small CCEP responses. In addition, it is recommended to show these results together with their anatomical locations so that readers can compare the findings with the previous literatures.

From clinical point of view, if the authors can compare 1) mere averaging and 2) the results of their method (showing only C(t)) by showing their waveforms, then the readers from the clinical field can understand the utility of this method.

#3 Limitations

While the authors do acknowledge the timing issue of the CRP in limitations, the authors did not mention the small number of patients they studied (N = 2). The authors had better mention this since the application in the larger patient group may reveal some other important features of this new methodology.

Reviewer #2: Miller et al. present a new method for data-driven characterization of single-trial electrophysiological responses to neural stimulation. This method is developed in the context of “cortico-cortical evoked potentials” (CCEPs) in the human brain. These CCEPs are shifts in the (usually bulk) electrical field at site X induced by (usually bulk) electrical stimulation at site Y. In order to understand how electrical drive at one site (X) affects the response at another site (Y), a conventional approach has been to characterize CCEPs (evoked at site Y) via the timing and of their “peaks”, especially the so-called N1/N2 maxima of the mean stimulation-evoked potential, which occur around 100 and 200ms post-stimulus. However, the authors argue that, for many pairs of cortical sites, the CCEPs do not exhibit (or are not well-characterized by) the N1/N2 components, so that a more general and flexible technique is required. The authors further argue that their approach (via linear kernel PCA) also allows the characterization of the duration of the evoked response, the computation of explained variance, as well as single trial response “magnitudes” and other features of the neural response.

This work is well illustrated and well argued, and it addresses a cornerstone methodological need for answering empirical questions around brain stimulation. This is valuable science, which certainly will make a contribution to the literature and to analytic practices of electrophysiological data.

The main drawback of this manuscript is that, although this method is clearly valuable and an advance on standard practice in human CCEP work, the manuscript does not provide the reader with (i) sufficient information about the conditions under which the method will work best and worst; and (ii) sufficiently detailed validation of the basic approach and statistical analysis methods. To be clear: my concern here is not that the method is invalid, but rather that its limits and domain of application are not clearly specified; this valuable work will be more immediately useful to other scientists if the limitations and assumptions are made clearer.

### Main Points ###

* 1 * There appear to be several assumptions made in applying the linear kernel PCA method and using it to characterize the single-trial parameters and associates statistics. Please provide the reader with more information about these, and their justification. For example, does the model make assumptions about (i) the consistency of the timing of peaks and troughs across trials and (ii) the consistency of the magnitude of the signal waveform across trials?

Related to consistency of timing of peaks across trials: If the true underlying signal is a sharply ramping function (e.g. ramping from -1 to 1 in 20 milliseconds), will this not appear as a temporally “blurred” slowly ramping component (e.g. ramping from -1 to 1 in 80 milliseconds) if there is 50 ms of timing jitter from trial to trial? If the peak of a CCEP became later and later across stimulations (e.g. due to some kind of circuit adaptation effects), how would this affect the extracted C(t) curve.

Related to consistency of magnitude over trials: suppose that the neural circuits exhibit a form of adaptation in its response to stimulations, so that responses decay in magnitude over trials (i.e. the noise retains constant variance but the signal variance decreases over trials, while the signal waveform maintains the same shape). How would this affects the performance of the linear kernel PCA method?

* 2 * Are the statistical methods well-calibrated? When data are generated from a null model, do they indeed produce 5% false positive rates in simulated data, when the alpha value is set to 5%? Does the statistical approach control the false-positive rate (nominally 5%) at the level of each individual time point within a trial, or does the statistical approach control the false positive rate at the level of the whole trial, or the whole dataset?

When testing the calibration of the statistics, it is important to be clear about the assumptions about the nature of the noise on each trial. Are there assumptions about (i) the distributional form of the noise, (ii) the independence of noise samples across time-points and (iii) the consistency of noise-variance across trials? Generally, we expect that the performance of the method may be sensitive to violations of some of these assumptions, and robust to violations of others, but which are which? It should be possible to explore some of these points in simulation, as in Figure 7.

* 3 * Regarding the method for determining the duration of the response, the tests in Figure 7A-C are a simple and beauitful self-consistency demonstration for the proposed method. However, does this self-consistency effect persist in the presence of noise? If not, it would be helpful to give the reader some sense of which kinds of noise levels are most likely to lead the method to lose this self-consistency. Is there a way for the end-user to know what level of noise they are dealing with in empirical data?

* 4 * When normalizing the single-trial cross-projections (Figure 8), the authors emphasize that a semi-normalized approach is best. In this approach, we compute the dot product between one unit-normalized vector and another unnormalized vector. I wonder if there is an alternative that is superior: instead of normalizing by the length of the V_k vector (|V_k|), normalize by the geometric mean of the lengths of the V_k vector and the V_l vector (sqrt(|V_k||V_l|)? The advantage of this approach, as far as I can tell, is that it would give less weight to outlier trials, and would be less susceptible to the influence of individual low-amplitude trials, because it combines information from both the row and the column in the P(k,l) matrix.

* 5 * Line 467: “ In the first of these (Figs. 6C and D), a seemingly insignificant response has a very significant brief structure at the beginning of the examined period. This situation may arise when a latent effect of stimulation artifact “carries forward” into the window being considered. Determining what is stimulation artifact and what is brief evoked neural activity is a nuanced topic that we defer to future study.”

Since cortico-cortical axonal conduction latencies are typically 10ms or longer, why not exclude (by default) the first 10ms post-stimulation from the process used to extract C(t) and measure the response duration? This may not fully address the issue, but it should reduce its influence?

* 6 * Line 472: “The second artifactual condition to consider (Figs. 6E and F) is the case where a set of responses appear to be complete noise, but the time-resolved projection magnitude S ¯t grows steadily in time. Inappropriate baselining of the data produces this - we also defer comprehensive 475 exploration of this to future treatment.”

I understand that there is not space for a full treatment of this point, but it seems important to add a couple of sentences here, elaborating on how inappropriate baselining can be avoided and / or how the end-user can detect when the baseline is incorrect.

Furthermore, it seems important to emphasize the importance of baselining for the success of this method. In many dimensionality reduction methods, the results are invariant to the centering approach (i.e. you get the same results if you z-score the data and if you don’t), but with this method, it appears that the absolute magnitude and sign of the voltage time-courses are being (successfully) exploited to determine which trials are more important and contain more signal. Maybe it would be worth emphasizing, around line 93, that the data are not zero-centered on each trial, but they should instead be centered relative to an independently-measured baseline reference.

* 7 * The Introduction of the manuscript would be more compelling if it stated, earlier on, the scientific gap or need that is filled by the present work. It would be nice if the manuscript stated very early on, both: (i) the shortcomings of current approaches, and (ii) the top reason(s) why this new method is important and useful. There is plenty of text making these points in the manuscript, but this motivational info is spread across the Intro, Results, and Discussion.

### Typos / Minor Points ###

** The method proposed here assumes that there is a single consistent response (the C(t)) which we wish to extract. Are there conditions under which it would make sense to extract multiple responses, i.e. additional columns of the matrix X, line 139, and would these additional responses need to be orthogonal?)

Line 18: “To address this, we recently introduced a set of four basic paradigms for interpreting CCEP data” — I think that it would be more accurate to say that terminology was recently introduced, or a conceptual framework was introduced, as these paradigms are many years old?

Line 36: “stimulated-at” can be “stimulated”

Line 107: “Because S^bar may be thought of as a measure of mutual information between responses…” — Please justify or elaborate on this point.

Tiny p-values: In some place, e.g. in the caption of Figure 5, the manuscript reports p-values of the form p << 10^{-34}, but such numbers are so vast (or tiny) that they are almost meaningless. I am not sure of the best way to handle this, but maybe something like “p approximately 0”, or “p-value negligible” or “p << 0.001” is better?

Figure 6A: What is “extraction significance” in the title?

Line 365: “How the recorded C(t) curves isolated in these regions of the brain differ from one another, if similar input types/regions can be approximated, might serve as an informative model to understand how intralaminar dynamics result in characteristic voltage responses.”

… Perhaps this would read better as: “Therefore, consistent differences in C(t) across these regions could inform new models of how intralaminar dynamics generate characteristic voltage responses.”

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1011105.r003

Decision Letter 1

Lyle J Graham, Hayriye Cagnan

14 Apr 2023

Dear Prof Miller,

We are pleased to inform you that your manuscript 'Canonical Response Parameterization: Quantifying the structure of responses to single-pulse intracranial electrical brain stimulation' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Hayriye Cagnan

Academic Editor

PLOS Computational Biology

Lyle Graham

Section Editor

PLOS Computational Biology

***********************************************************

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The author generally responded to the concerns raised by the reviewer. I hope this method is of use for those who would like to evaluate CCEPs in the SEEG circumstances.

Reviewer #2: The authors have addressed all of my concerns. I congratulate them on developing this impactful contribution to science and to neurological practice.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1011105.r004

Acceptance letter

Lyle J Graham, Hayriye Cagnan

22 May 2023

PCOMPBIOL-D-22-01199R1

Canonical Response Parameterization: Quantifying the structure of responses to single-pulse intracranial electrical brain stimulation

Dear Dr Miller,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Livia Horvath

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Artificially-generated evoked responses with variation in signal to noise.

    A. An artificial signal trace, normalized to variance of 1. B. 10 trials of brown-noise (i.e. random walk) timeseries, with each normalized to z-score of 1. Brown noise generated by cumulative sum of random data on -0.5 to 0.5 interval and subtracting off of running mean. C. Response duration (left) and timecourse of projection weights (right) extracted from synthetic traces with noise traces from (B) added to signal trace at ratio of 3-to-1. D. Response duration (left) and timecourse of projection weights (right) extracted from synthetic traces with noise traces from (B) added to signal trace at “mild” variable ratios of 1.2 to 3.0 in 0.2 intervals. E. Response duration (left) and timecourse of projection weights (right) extracted from synthetic traces with noise traces from (B) added to signal trace at “extreme” variable ratios of {0.38; 0.47; 0.59; 0.74; 0.94; 1.18; 1.48; 1.86; 2.34; 2.94}. F. Parameterization of the artificial evoked responses of constant signal-to-noise ratio of 3-to-1 (from (C)). G. Parameterization of the artificial evoked responses of the “mild” variable signal-to-noise ratios of 1.2 to 3.0 in 0.2 intervals (from (D)). H. Parameterization of the artificial evoked responses of the “extreme” variable ratios of {0.38; 0.47; 0.59; 0.74; 0.94; 1.18; 1.48; 1.86; 2.34; 2.94} (from (E)). I. Extracted C(t) for different noise levels overlaid on top of original artificial form. J. Single-trial noise residuals for different noise levels. K. Single-trial α′ to noise residual (SNR) for different noise levels. L. Single-trial explained variance for different noise levels. M. Single-trial ratio of coefficient α′ to input SNR for different noise levels. Differences between extreme variable traces (yellow) in (J) and (M) are due to shorter C(t). This shorter C(t) may be related to added correlated deviation toward zero by the brown noise statistics disproportionally contributing at higher noise levels.

    (TIF)

    S2 Fig. Example of parameterization with a large number of trials.

    Measurement is from a dorsal insular contact in response to stimulation of white matter in the orbitofrontal cortex. A. Stimulation was performed 69 times. Artifact rejection was at a threshold of p <10−10, resulting in rejection of 6 trials. The extraction was robust with an associated t-value of 149. B. The first 10 trials from (A) were parameterized in an identical fashion. No trials were identified as artifactual, and the associated t-value for extraction was 23. Note that the response duration (τR), mean projection at response duration (S¯), and scaling coefficient (α′) were all nearly identical. However, the statistics of the parametrization were much more robust for 69 trials. The averaged explained variance and SNR were slightly higher for 10 trials (as might be expected).

    (TIF)

    S3 Fig. Generation of many artificially-generated sets of pure-noise data to validate statistics.

    A. Top: An example of a single brown-noise (i.e. random walk) timecourse. Bottom: A 10-trial set of brown noise timecourses. B. A histogram of extraction significances from 20,000 surrogate sets of brown-noise timecourses. C. Top: An example of a single white-noise timecourse. Bottom: A 10-trial set of white-noise timecourses. D. A histogram of extraction significances from 20,000 surrogate sets of white-noise timecourses. Because histograms of p-values show a flat distribution over the 0-to-1 interval in (B) and (D), we may infer the statistical method is well calibrated for null models.

    (TIF)

    S4 Fig. An illustration of calculating the canonical shape from linear kernel PCA or from the simple mean.

    (A-C) are from the example in the middle row of Fig 5 and (D-F) are from Fig 8. A. The averaged voltage response, is shown with a black line, and the significant portion of the response is highlighted (i.e. up to τR). B. C(t) calculated from linear kernel PCA (blue) and from the simple mean (red). C. Parameterizations calculated from linear PCA vs mean voltage extractions. D-F. As in (A-C), for the example from Fig 8.

    (TIF)

    Attachment

    Submitted filename: kjm_CRP_reply_to_reviewers_R1.pdf

    Data Availability Statement

    All code to implement this technique along with the sample data to reproduce the illustrations are publicly available for use without restriction (other than attribution) at: https://osf.io/tx3yq and https://github.com/kaijmiller/crp_scripts.


    Articles from PLOS Computational Biology are provided here courtesy of PLOS

    RESOURCES