Skip to main content
eLife logoLink to eLife
. 2016 Dec 7;5:e20515. doi: 10.7554/eLife.20515

On cross-frequency phase-phase coupling between theta and gamma oscillations in the hippocampus

Robson Scheffer-Teixeira 1, Adriano BL Tort 1,*
Editor: Frances K Skinner2
PMCID: PMC5199196  PMID: 27925581

Abstract

Phase-amplitude coupling between theta and multiple gamma sub-bands is a hallmark of hippocampal activity and believed to take part in information routing. More recently, theta and gamma oscillations were also reported to exhibit phase-phase coupling, or n:m phase-locking, suggesting an important mechanism of neuronal coding that has long received theoretical support. However, by analyzing simulated and actual LFPs, here we question the existence of theta-gamma phase-phase coupling in the rat hippocampus. We show that the quasi-linear phase shifts introduced by filtering lead to spurious coupling levels in both white noise and hippocampal LFPs, which highly depend on epoch length, and that significant coupling may be falsely detected when employing improper surrogate methods. We also show that waveform asymmetry and frequency harmonics may generate artifactual n:m phase-locking. Studies investigating phase-phase coupling should rely on appropriate statistical controls and be aware of confounding factors; otherwise, they could easily fall into analysis pitfalls.

DOI: http://dx.doi.org/10.7554/eLife.20515.001

Research Organism: Rat

eLife digest

Neuroscientists have long sought to understand how the brain works by analyzing its electrical activity. Placing electrodes on the scalp or lowering them into the brain itself reveals rhythmic waves of activity known as oscillations. These arise when large numbers of neurons fire in synchrony. Recordings reveal that the frequency of these oscillations – the number of cycles of a wave per second, measured in Hertz – can vary between brain regions, and within a single region over time. Moreover, oscillations with different frequencies can co-exist and interact with one another.

Within the hippocampus, an area of the brain involved in memory, two types of oscillations dominate: theta waves and gamma waves. Theta waves are relatively slow waves, with a frequency between 5 and 10 Hertz. Gamma waves are faster, with a frequency of up to 100 Hertz. Recent work has suggested that gamma waves and theta waves show a phenomenon called phase-phase coupling. Since gamma waves are faster than theta waves, multiple cycles of gamma can occur during a single cycle of theta. Phase-phase coupling is the idea that gamma and theta waves align themselves, such that gamma waves always begin at the same relative position within a theta wave. This was thought to help the hippocampus to encode memories.

Using computer simulations and recordings from the rat hippocampus, Scheffer-Teixeira and Tort have now reexamined the evidence for theta-gamma phase-phase coupling. The new results suggest that previous reports describing the phenomenon may have relied on inadequate statistical techniques. Using stringent control analyses, Scheffer-Teixeira and Tort find no evidence for prominent theta-gamma phase-phase coupling in the hippocampus. Instead, the simulations suggest that what appeared to be statistically significant coupling may in reality be an artifact of the previous analysis.

Phase-phase coupling of theta and gamma waves has also been reported in the human hippocampus. The next step therefore is to apply these more robust analysis techniques to data from the human brain. While revisiting previously accepted findings may not always be popular, it will likely be essential if neuroscientists want to accurately understand how new memories are formed.

DOI: http://dx.doi.org/10.7554/eLife.20515.002

Introduction

Local field potentials (LFPs) exhibit oscillations of different frequencies, which may co-occur and also interact with one another (Jensen and Colgin, 2007; Tort et al., 2010; Hyafil et al., 2015). Cross-frequency phase-amplitude coupling between theta and gamma oscillations has been well described in the hippocampus, whereby the instantaneous amplitude of gamma oscillations depends on the instantaneous phase of theta (Scheffer-Teixeira et al., 2012; Schomburg et al., 2014). More recently, hippocampal theta and gamma oscillations were also reported to exhibit n:m phase-phase coupling, in which multiple gamma cycles are consistently entrained within one cycle of theta (Belluscio et al., 2012; Zheng and Zhang, 2013; Xu et al., 2013, 2015; Zheng et al., 2016). The existence of different types of cross-frequency coupling suggests that the brain may use different coding strategies to transfer multiplexed information.

Coherent oscillations are believed to take part in network communication by allowing opportunity windows for the exchange of information (Varela et al., 2001; Fries, 2005). Standard phase coherence measures the constancy of the phase difference between two oscillations of the same frequency (Lachaux et al., 1999; Hurtado et al., 2004), and has been associated with cognitive processes such as decision-making (DeCoteau et al., 2007; Montgomery and Buzsáki, 2007; Nácher et al., 2013). Similarly to coherence, cross-frequency phase–phase coupling, or n:m phase-locking, also relies on assessing the constancy of the difference between two phase time series (Tass et al., 1998). However, in this case the original phase time series are accelerated, so that their instantaneous frequencies can match. Formally, n:m phase-locking occurs when Δφnm(t)=nφB(t)mφA(t) is non-uniform but centered around a preferred value, where n*φB (m*φA) denotes the phase of oscillation B (A) accelerated n (m) times (Tass et al., 1998). For example, the instantaneous phase of theta oscillations at 8 Hz needs to be accelerated five times to match in frequency a 40 Hz gamma. A 1:5 phase-phase coupling is then said to occur if theta accelerated five times has a preferred phase lag (i.e., a non-uniform phase difference) in relation to gamma; or, in other words, if five gamma cycles have a consistent phase relationship to one theta cycle.

Cross-frequency phase-phase coupling has previously been hypothesized to take part in memory processes (Lisman and Idiart, 1995; Jensen and Lisman, 2005; Lisman, 2005; Schack and Weiss, 2005; Sauseng et al., 2008, 2009Holz et al., 2010; Fell and Axmacher, 2011). Recent findings suggest that the hippocampus indeed uses such a mechanism (Belluscio et al., 2012; Zheng and Zhang, 2013; Xu et al., 2013, 2015; Zheng et al., 2016). However, by analyzing simulated and actual hippocampal LFPs, in the present work we question the existence of theta-gamma phase-phase coupling.

Results

Measuring n:m phase-locking

We first certified that we could reliably detect n:m phase-locking when present. To that end, we simulated a system of two Kuramoto oscillators – a ‘theta’ and a ‘gamma’ oscillator – exhibiting variability in instantaneous frequency (see Materials and methods). The mean natural frequency of the theta oscillator was set to 8 Hz, while the mean natural frequency of the gamma oscillator was set to 43 Hz (Figure 1A). When coupled, the mean frequencies aligned to a 1:5 factor by changing to 8.5 Hz and 42.5 Hz, respectively (see Guevara and Glass, 1982; García-Alvarez et al., 2008; Canavier et al., 2009). Figure 1B depicts three versions of accelerated theta phases (m = 3, 5 and 7) along with the instantaneous gamma phase (n = 1) of the coupled oscillators (see Figure 1—figure supplement 1 for the uncoupled case). Also shown are the time series of the difference between gamma and accelerated theta phases (Δφnm). The instantaneous phase difference has a preferred lag only for m = 5; when m = 3 or 7, Δφnmchanges over time, precessing forwards (m = 3) or backwards (m = 7) at an average rate of 17 Hz. Consequently, Δφnm distribution is uniform over 0 and 2π for m = 3 or 7, but highly concentrated for m = 5 (Figure 1C). The concentration (or ‘constancy’) of the phase difference distribution is used as a metric of n:m phase-locking. This metric is defined as the length of the mean resultant vector (Rn:m) over unitary vectors whose angle is the instantaneous phase difference (eiΔφnm(t)), and thereby it varies between 0 and 1. For any pair of phase time series, an Rn:m‘curve’ can be calculated by varying m for n = 1 fixed. As shown in Figure 1D, the coupled – but not uncoupled – oscillators exhibited a prominent peak for n:m = 1:5, which shows that Rn:m successfully detects n:m phase-locking.

Figure 1. Measuring cross-frequency phase-phase coupling.

(A) Traces show 500 ms of the instantaneous phase time series of two Kuramoto oscillators (see Materials and methods). When uncoupled (top panels), the mean natural frequencies of the ‘theta’ and ‘gamma’ oscillator are 8 Hz (blue) and 43 Hz (red), respectively. When coupled (bottom panels), the oscillators have mean frequencies of 8.5 Hz and 42.5 Hz. (B) Top blue traces show the instantaneous phase of the coupled theta oscillator for the same period as in A but accelerated m times, where m = 3 (left), 5 (middle) and 7 (right). Middle red traces reproduce the instantaneous phase of the coupled gamma oscillator (i.e., n = 1). Bottom black traces show the instantaneous phase difference between gamma and accelerated theta phases (Δφnm). Notice roughly constant Δφnm only when theta is accelerated m = 5 times, which indicates 1:5 phase-locking. See Figure 1—figure supplement 1 for the uncoupled case. (C) Δφnm distributions for the coupled case (epoch length = 100 s). Notice uniform distributions for n:m = 1:3 and 1:7, and a highly concentrated distribution for n:m = 1:5. The black arrow represents the mean resultant vector for each case (see Materials and methods). The length of this vector (Rn:m) measures the level of n:m phase-locking. See Figure 1—figure supplement 1 for the uncoupled case. (D) Phase-locking levels for a range of n:m ratios for the uncoupled (left) and coupled (right) oscillators (epoch length = 100 s).

DOI: http://dx.doi.org/10.7554/eLife.20515.003

Figure 1.

Figure 1—figure supplement 1. Uncoupled oscillators display uniform Δφnm distribution.

Figure 1—figure supplement 1.

(A,B) Panels show the same as in Figure 1B,C, but for the uncoupled oscillators. Notice roughly uniform Δφnm distributions.

Filtering-induced n:m phase-locking in white noise

We next analyzed white-noise signals, in which by definition there is no structured activity; in particular, the spectrum is flat and there is no true n:m phase-locking. Rn:m values measured from white noise should be regarded as chance levels. We band-pass filtered white-noise signals to extract the instantaneous phase of theta (θ: 4–12 Hz) and of multiple gamma bands (Figure 2A): slow gamma (γS: 30–50 Hz), middle gamma (γM: 50–90 Hz), and fast gamma (γF: 90–150 Hz). For each frequency pair, we constructed n:m phase-locking curves for epochs of 1 and 10 s, with n = 1 fixed and m varying from 1 to 25 (Figure 2B). In each case, phase-phase coupling was high within the ratio of the analyzed frequency ranges: Rn:m peaked at m = 4–6 for θ−γS, at m = 7–11 for θ−γM, and at m = 12–20 for θ−γF. Therefore, the existence of a ‘bump’ in the Rn:m curve may merely reflect the ratio of the filtered bands and should not be considered as evidence for cross-frequency phase-phase coupling: even filtered white-noise signals exhibit such a pattern.

Figure 2. Detection of spurious n:m phase-locking in white-noise signals due to inappropriate surrogate-based statistical testing.

(A) Example white-noise signal (black) along with its theta- (blue) and gamma- (red) filtered components. The corresponding instantaneous phases are also shown. (B) n:m phase-locking levels for 1- (left) and 10 s (right) epochs, computed for noise filtered at theta (θ; 4–12 Hz) and at three gamma bands: slow gamma (γS; 30–50 Hz), middle gamma (γM; 50–90 Hz) and fast gamma (γF; 90–150 Hz). Notice Rn:m peaks in each case. (C) Boxplot distributions of θ−γS R1:5 values for different epoch lengths (n = 2100 simulations per epoch length). The inset shows representative Δφnm distributions for 0.3- and 100 s epochs. (D) Overview of surrogate techniques. See text for details. (E) Top panels show representative Δφnm distributions for single surrogate runs (Time Shift; 10 runs of 1 s epochs), along with the corresponding Rn:m values. The bottom panel shows the pooled Δφnm distribution; the Rn:m of the pooled distribution is lower than the Rn:m of single runs (compare with values for 1- and 10 s epochs in panel C). (F) Top, n:m phase-locking levels computed for 1- (left) or 10 s (right) epochs using either the Original or five surrogate methods (insets are a zoomed view of Rn:m peaks). Bottom, R1:5 values for white noise filtered at θ and γS. Original Rn:m values are not different from Rn:m values obtained from single surrogate runs of Random Permutation and Time Shift procedures. Less conservative surrogate techniques provide lower Rn:m values and lead to the spurious detection of θ−γS phase-phase coupling in white noise. *p<0.01, n = 2100 per distribution, one-way ANOVA with Bonferroni post-hoc test.

DOI: http://dx.doi.org/10.7554/eLife.20515.005

Figure 2.

Figure 2—figure supplement 1. Filtering induces quasi-linear phase shifts in white-noise signals.

Figure 2—figure supplement 1.

(A) Distribution of the phase difference between two consecutive samples for white noise band-pass filtered at theta (4–12 Hz, top) and slow gamma (30–50 Hz, bottom). Epoch length = 100 s; sampling rate = 1000 Hz (dt = 0.001 s). Notice that the top histogram peaks at ~0.05, which corresponds to 2*3.14*8*0.001 (i.e., 2*π*fc*dt, where fc is the center frequency), and the bottom histogram peaks at ~0.25 =2*3.14*40*0.001. (B) Rn:m curves computed for theta- and slow gamma-filtered white-noise signals. The black curve was obtained using continuous 1 s long time series sampled at 1000 Hz. The red curve was obtained by also analyzing 1000 data points, but which were subsampled at 20 Hz (subsampling was performed after filtering). Notice Rn:m peak at n:m = 1:5 only for the former case. See also Figure 5—figure supplement 7 for similar results in hippocampal LFPs.
Figure 2—figure supplement 2. Filter bandwidth influences n:m phase-locking levels in white-noise signals.

Figure 2—figure supplement 2.

(A) Mean Rn:m curves computed for 1 s long white-noise signals filtered into different bands (same color labels as in B; n = 2100). Notice that the narrower the filter bandwidth, the higher the Rn:m peak. (B) Mean Rn:m peak values for different filter bandwidths and epoch lengths (n = 2100 simulations per filter setting and epoch length).
Figure 2—figure supplement 3. Uniform p-value distributions upon multiple testing of Original Rn:m values against Single Run Rn:m surrogates.

Figure 2—figure supplement 3.

The histograms show the distribution of p-values (bin width = 0.02) for 10000 t-tests of Original Rn:m vs Single Run surrogate values (n = 30 samples per group; epoch length = 1 s). The red dashed line marks p=0.05. The p-value distributions do not statistically differ from the uniform distribution (Kolmogorov-Smirnov test).

The bump in the Rn:m curve of filtered white noise is explained by the fact that neighboring data points are not independent. In fact, the phase shift between two consecutive data points follows a probability distribution highly concentrated around 2*π*fc*dt, where fc is the filter center frequency and dt the sampling period (Figure 2—figure supplement 1). For instance, for dt = 1 ms (1000 Hz sampling rate), consecutive samples of white noise filtered between 4 and 12 Hz are likely to exhibit phase difference of 0.05 rad (8 Hz center frequency); likewise, signals filtered between 30 and 50 Hz are likely to exhibit phase differences of 0.25 rad (40 Hz center frequency). In turn, the ‘sinusoidality’ imposed by filtering leads to non-zero Rn:m values, which peak at the ratio of the center frequencies, akin to the fact that perfect 8 Hz and 40 Hz sine waves have Rn:m = 1 at n:m = 1:5. In accordance to this explanation, no Rn:m bump occurs when data points of the gamma phase time series are made independent by sub-sampling with a period longer than a gamma cycle (Figure 2—figure supplement 1), or when extracting phase values from different trials (not shown). As expected, the effect of filtering-induced sinusoidality on Rn:m values is stronger for narrower frequency bands (Figure 2—figure supplement 2).

Qualitatively similar results were found for 1- and 10 s epochs; however, Rn:m values were considerably lower for the latter (Figure 2B). In fact, for any fixed n:m ratio and frequency pair, Rn:m decreased as a function of epoch length (see Figure 2C for θ−γS and R1:5): the longer the white-noise epoch the more the phase difference distribution becomes uniform. In other words, as standard phase coherence (Vinck et al., 2010) and phase-amplitude coupling (Tort et al., 2010), phase-phase coupling has positive bias for shorter epochs. As a corollary, notice that false-positive coupling may be detected if control (surrogate) epochs are longer than the original epoch.

Statistical testing of n:m phase-locking

We next investigated the reliability of surrogate methods for detecting n:m phase-locking (Figure 2D). The ‘Original’ Rn:m value uses the same time window for extracting theta and gamma phases (Figure 2D, upper panel). A ‘Time Shift’ procedure for creating surrogate epochs has been previously employed (Belluscio et al., 2012; Zheng et al., 2016), in which the time window for gamma phase is randomly shifted between 1 to 200 ms from the time window for theta phase (Figure 2D, upper middle panel). A variant of this procedure is the ‘Random Permutation’, in which the time window for gamma phase is randomly chosen (Figure 2D, lower middle panel). Finally, in the ‘Phase Scramble’ procedure, the timestamps of the gamma phase time series are shuffled (Figure 2D, lower panel); clearly, the latter is the least conservative. For each surrogate procedure, Rn:m values were obtained by two approaches: ‘Single Run’ and ‘Pooled’ (Figure 2E). In the first approach, each surrogate run (e.g., a time shift or a random selection of time windows) produces one Rn:m value (Figure 2E, top panels). In the second, Δφnm from several surrogate runs are first pooled, then a single Rn:m value is computed from the pooled distribution (Figure 2E, bottom panel). As illustrated in Figure 2E, Rn:m computed from a pool of surrogate runs is much smaller than when computed for each individual run. This is due to the dependence of Rn:m on the epoch length: pooling instantaneous phase differences across 10 runs of 1 s surrogate epochs is equivalent to analyzing a single surrogate epoch of 10 s. And the longer the analyzed epoch, the more the noise is averaged out and the lower the Rn:m. Therefore, pooled surrogate epochs summing up to 10 s of total data have lower Rn:m than any individual 1 s surrogate epoch.

No phase-phase coupling should be detected in white noise, and therefore Original Rn:m values should not differ from properly constructed surrogates. However, as shown in Figure 2F for θ−γS as an illustrative case (similar results hold for any frequency pair), θ−γS phase-phase coupling in white noise was statistically significantly larger than in phase-scrambled surrogates (for either Single Run or Pooled distributions). This was true for surrogate epochs of any length, although the longer the epoch, the lower the actual and the surrogate Rn:m values, as expected (compare right and left panels of Figure 2F). Pooled R1:5 distributions derived from either time-shifted (Figure 2F) or randomly permutated epochs (not shown) also led to the detection of false positive θ−γS phase-phase coupling. On the other hand, Original Rn:m values were not statistically different from chance distributions when these were constructed from Single Run Rn:m values for either Time Shift and Random Permutation surrogate procedures (Figure 2F; see also Figure 2—figure supplement 3). We conclude that neither scrambling phases nor pooling individual surrogate epochs should be employed for statistically evaluating n:m phase-locking. Chance distributions should be derived from surrogate epochs of the same length as the original epoch and which preserve phase continuity.

To check if Single Run surrogate distributions are capable of statistically detecting true n:m phase-locking, we next simulated noisy Kuramoto oscillators as in Figure 1, but of mean natural frequencies set to 8 and 40 Hz. Original R1:5 values were much greater than the surrogate distribution for coupled – but not uncoupled – oscillators (Figure 3A). This result illustrates that variability in the instantaneous frequency leads to low n:m phase-locking levels for independent oscillators even when their mean frequencies are perfect integer multiples. On the other hand, coupled oscillators have high Rn:m because variations of their instantaneous frequencies are mutually dependent. We then proceeded to analyze simulated LFPs from a previously published model network (Kopell et al., 2010). The network has two inhibitory interneurons, called O and I cells, which spike at theta and gamma frequency, respectively (for a motivation of this model, see Tort et al., 2007). Compared to Single Run surrogate distributions, the model LFP exhibited significant n:m phase-locking only when the interneurons were coupled; Rn:m levels did not differ from the surrogate distribution for the uncoupled network (Figure 3B). (Note that the Rn:m curve also exhibited a peak for both the uncoupled network and Single Run surrogate data, which is due to the low variability in the instantaneous spike frequency of the model cells; without this variability, however, all networks would display perfect n:m phase-locking).

Figure 3. True n:m phase-locking leads to significant Rn:m values.

Figure 3.

(A) The left panels show mean Rn:m curves and distributions of R1:5 values for original and surrogate (Random Permutation/Single Run) data obtained from the simulation of two coupled Kuramoto oscillators (n = 300; epoch length = 30 s; *p<0.001, t-test). The right panels show the same, but for uncoupled oscillators. In these simulations, each oscillator has instantaneous peak frequency determined by a Gaussian distribution; the mean natural frequencies of the theta and gamma oscillators were set to 8 Hz and 40 Hz, respectively (coupling does not alter the mean frequencies since they already exhibit a 1:5 ratio; compare with Figure 1). (B) Top panels show results from a simulation of a model network composed of two mutually connected interneurons, O and I cells, which emit spikes at theta and gamma frequency, respectively (Tort et al., 2007; Kopell et al., 2010). Original n:m phase-locking levels are significantly higher than chance (n = 300; epoch length = 30 s; *p<0.001, t-test). The bottom panels show the same, but for unconnected interneurons. In this case, n:m phase-locking levels are not greater than chance.

DOI: http://dx.doi.org/10.7554/eLife.20515.009

Spurious n:m phase-locking due to non-sinusoidal waveforms

The simulations above show that Single Run surrogates can properly detect n:m phase-locking for oscillators exhibiting variable instantaneous frequency, which is the case of hippocampal theta and gamma oscillations. However, it should be noted that high asymmetry of the theta waveform may also lead to statistically significant Rn:m values per se. As illustrated in Figure 4A, a non-sinusoidal oscillation such as a theta sawtooth wave can be decomposed into a sum of sine waves at the fundamental and harmonic frequencies, which have decreasing amplitude (i.e., the higher the harmonic frequency, the lower the amplitude). Importantly, the harmonic frequency components are n:m phase-locked to each other: the first harmonic exhibits a fixed 1:2 phase relationship to the fundamental frequency, the second harmonic a 1:3 relationship, and so on (Figure 4B). Of note, the higher frequency harmonics not only exhibit cross-frequency phase-phase coupling to the fundamental theta frequency but also phase-amplitude coupling, since they have higher amplitude at the theta phases where the sharp deflection occurs (Figure 4C left and Figure 4—figure supplement 1; see also Kramer et al., 2008 and Tort et al., 2013).

Figure 4. Waveform asymmetry may lead to artifactual n:m phase-locking.

(A) The top traces show a theta sawtooth wave along with its decomposition into a sum of sinusoids at the fundamental (7 Hz) and harmonic (14 Hz, 21 Hz, 28 Hz, 35 Hz, etc) frequencies. The bottom panel shows the power spectrum of the sawtooth wave. Notice power peaks at the fundamental and harmonic frequencies. (B) Phase-phase plots (2D histograms of phase counts) for the sawooth wave in A filtered at theta (7 Hz; x-axis phases) and harmonic frequencies (14, 21, 28 and 35 Hz; y-axis phases). (C) The left traces show 500 ms of a sawtooth wave along with its theta- and gamma-filtered components and corresponding phase time series. The sawtooth wave was set to have a variable peak frequency, with mean = 8 Hz; no gamma oscillation was added to the signal. Notice that the sharp deflections of the sawtooth wave give rise to artifactual gamma oscillations in the filtered signal (Kramer et al., 2008), which have a consistent phase relationship to the theta cycle. The right panels show that artifactual n:m phase-coupling levels induced by the sharp deflections are significantly higher than the chance distribution (n = 300; epoch length = 30 s; *p<0.001, t-test).

DOI: http://dx.doi.org/10.7554/eLife.20515.010

Figure 4.

Figure 4—figure supplement 1. Waveform asymmetry may lead to spurious phase-amplitude coupling.

Figure 4—figure supplement 1.

(A) A theta sawtooth wave along with its theta- (7 Hz) and gamma-filtered (35 Hz) components. Notice that no gamma oscillations exist in the original sawtooth wave, but they spuriously appear when filtering sharp deflections (Kramer et al., 2008). The amplitude of the spurious gamma waxes and wanes within theta cycles. (B) Mean gamma amplitude as a function of theta phase.
Figure 4—figure supplement 2. The statistical significance of artifactual n:m phase-locking levels induced by waveform asymmetry depends on epoch length and peak frequency variability.

Figure 4—figure supplement 2.

Shown are the median R1:5 computed between theta and slow gamma for sawtooth waves simulated as in Figure 4C, but of different epoch lengths and peak frequency variability. Dashed area corresponds to the interquartile range (n = 300). Surrogate data were obtained either by Radom Permutation (top row) or Time Shift (bottom row) procedures. Notice that the longer the epoch or the peak frequency variability, the larger the difference between original and surrogate data, and that this difference is greater for randomly permutated than time-shifted surrogates.

The gamma-filtered component of a theta sawtooth wave of variable peak frequency thus displays spurious gamma oscillations (i.e., theta harmonics) that have a consistent phase relationship to the theta cycle irrespective of variations in cycle length. In randomly permutated data, however, the theta phases associated with spurious gamma differ from cycle to cycle due to the variability in instantaneous theta frequency. As a result, the spurious n:m phase-coupling induced by sharp signal deflections is significantly higher than the Random Permutation/Single Run surrogate distribution (Figure 4C right and Figure 4—figure supplement 2 top row). Interestingly, the significance of this spurious effect is much lower when using the Time Shift procedure (Figure 4—figure supplement 2 bottom row), probably due to the proximity between the original and the time-shifted time series (200 ms maximum distance).

Assessing n:m phase-locking in actual LFPs

We next proceeded to analyze hippocampal CA1 recordings from seven rats, focusing on the periods of prominent theta activity (active waking and REM sleep). We found similar results between white noise and actual LFP data. Namely, Rn:m curves peaked at n:m ratios according to the filtered bands, and Rn:m values were lower for longer epochs (Figure 5A; compare with Figure 2B). As shown in Figure 5B, Original Rn:m values were not statistically different from a proper surrogate distribution (Random Permutation/Single Run) in epochs of up to 100 s (but see Figure 10). Noteworthy, as with white-noise data (Figure 2F), false positive phase-phase coupling would be inferred if an inadequate surrogate method were employed (Time Shift/Pooled) (Figure 5B).

Figure 5. Spurious detection of theta-gamma phase-phase coupling in the hippocampus.

(A) n:m phase-locking levels for actual hippocampal LFPs. Compare with Figure 2B. (B) Original and surrogate distributions of Rn:m values for slow (R1:5; left) and middle gamma (R1:8; right) for different epoch lengths. The original data is significantly higher than the pooled surrogate distribution, but indistinguishable from the distribution of surrogate values computed using single runs. Similar results hold for fast gamma. *p<0.01, n = 7 animals, Friedman’s test with Nemenyi post-hoc test.

DOI: http://dx.doi.org/10.7554/eLife.20515.013

Figure 5.

Figure 5—figure supplement 1. Lack of evidence for cross-frequency phase-phase coupling between theta and gamma oscillations using alternative phase-locking metrics.

Figure 5—figure supplement 1.

(A) The left plots show the mean radial distance (R) computed for gamma phases in different theta phase bins, as described in Sauseng et al. (2009). The lines denote the mean ± SD over all channels across animals (n = 16 channels per rat x seven rats); 300 1 s long epochs were analyzed for each channel. Note that original and surrogate R values overlap. The variations of R values within a theta cycle are explained by the different number of theta phase bins (right bar plot), which leads to different number of analyzed samples; the higher the number of analyzed samples, the lower the R (see also Figure 2C). (B) The first column shows the mean pairwise phase consistency (PPC) between gamma and accelerated theta phases as a function of the number of Δφnm samples (dashed lines denote SD over individual PPC estimates; n = 112 channels x 1000 PPC estimates per channel). Since PPC requires independent observations (Vinck et al., 2010), Δφnm was randomly sampled to avoid the statistical dependence among neighboring data points imposed by the filter (Figure 2—figure supplement 1; see also Figure 5—figure supplement 7). The second column shows mean PPC as function of n:m ratio (individual PPC estimates were computed using 1000 Δφnm samples); the boxplot distributions show PPC values at selected n:m ratios, as labeled. PPC values are very low for all analyzed frequency pairs and not statistically different from zero.
Figure 5—figure supplement 2. Spurious detection of theta-gamma phase-phase coupling when theta phase is estimated by interpolation.

Figure 5—figure supplement 2.

(A) n:m phase-locking levels for actual hippocampal LFPs (same dataset as in Figure 5). Theta phase was estimated by the interpolation method described in Belluscio et al. (2012). (B) Original and surrogate distributions of Rn:m values. The original data are significantly higher than surrogate values obtained from pooled Δφnm, but indistinguishable from single run surrogates. *p<0.01, n = 7 animals, Friedman’s test with Nemenyi post-hoc test.
Figure 5—figure supplement 3. Spurious detection of theta-gamma phase-phase coupling (second dataset).

Figure 5—figure supplement 3.

(A) n:m phase-locking levels for actual hippocampal LFPs. (B) Original and surrogate distributions of Rn:m values. Results obtained for three rats recorded in an independent laboratory (see Materials and methods).
Figure 5—figure supplement 4. Lack of evidence for theta-gamma phase-phase coupling in all hippocampal layers.

Figure 5—figure supplement 4.

(Left) Example estimation of the anatomical location of a 16-channel silicon probe by the characteristic depth profile of sharp-wave ripples (inter-electrode distance = 100 μm). (Middle) Original and surrogate (Random Permutation/Single Run) distributions of Rn:m values computed between theta phase and the phase of three gamma sub-bands (1 s long epochs). Different rows show results for different layers. (Right) Distribution of original and surrogate Rn:m values computed for current-source density (CSD) signals (1 s long epochs) in three hippocampal layers: s. pyramidale (top), s. radiatum (middle), and s. lacunosum-moleculare (bottom). Notice no difference between original and surrogate values. Similar results were found in all animals.
Figure 5—figure supplement 5. Lack of theta-gamma phase-phase coupling in independent components of gamma activity.

Figure 5—figure supplement 5.

(Left) Average phase-amplitude comodulograms for three independent components (IC) that maximize coupling between theta phase and the amplitude of slow gamma (top row), middle gamma (middle row) and fast gamma (bottom row) oscillations (n = 4 animals). Each IC is a weighted sum of LFPs recorded in different hippocampal layers (see Schomburg et al., 2014). (Middle) n:m phase-locking levels for theta phase and the phase of ICs filtered at the gamma band maximally coupled to theta in the phase-amplitude comodulogram. (Right) Original and surrogate distributions of Rn:m values. Rn:m values were computed for 1 s long epochs (n = 4 animals); surrogate gamma phases were obtained by Random Permutation/Single Run.
Figure 5—figure supplement 6. Lack of theta-gamma phase-phase coupling during transient gamma bursts.

Figure 5—figure supplement 6.

(A) Examples of slow-gamma bursts. Top panels show raw LFPs, along with theta- (thick blue line) and slow gamma-filtered (thin red line) signals. The amplitude envelope of slow gamma is also shown (thick red line). The bottom rows show gamma and accelerated theta phases (m = 5), along with their instantaneous phase difference (Δφ1:5). For each gamma sub-band, a ‘gamma burst’ was defined to occur when the gamma amplitude envelope was 2SD above the mean. In these examples, periods identified as slow-gamma bursts are marked with yellow in the amplitude envelope and phase difference time series. Notice variable φ1:5 across different burst events. (B) The left panel shows n:m phase-locking levels for theta phase and the phase of different gamma sub-bands (1 s epochs); for each gamma sub-band, Rn:m values were computed using only theta and gamma phases during periods of gamma bursts. The right panels show original and surrogate (Random Permutation/Single Run) distributions of Rn:m values (n = 4 animals).
Figure 5—figure supplement 7. The bump in the Rn:m curve of hippocampal LFPs highly depends on analyzing contiguous phase time series data.

Figure 5—figure supplement 7.

Average Rn:m curves computed for theta- and gamma-filtered hippocampal LFPs. The green curves were obtained using 1 s (top) or 10 s (bottom) continuous epochs of the phase time series, sampled at 1000 Hz (same analysis as in Figure 5A). The blue curves were obtained by analyzing 1000 data points subsampled from the phase time series at 20 Hz (i.e., 50 ms sampling period, longer than a gamma cycle). The red curves were obtained by analyzing 1000 (top) or 10000 (bottom) data points randomly sampled from the phase time series. These plots show that the prominent bump in the Rn:m curve of actual LFPs only occurs for continuously sampled data (1000 Hz sampling rate), and therefore probably reflects the ‘sinusoidality’ imposed by the filter (see also Figure 2—figure supplement 1). But notice that a small Rn:m bump remains for θ−γS (see Figure 10—figure supplement 2). Due to limitation of total epoch length, we could not perform the 20 Hz subsampling analysis for 10000 points, but notice that the blue and red curves coincide for 1000 points.
Figure 5—figure supplement 8. Different filter types give rise to similar results.

Figure 5—figure supplement 8.

(A) Original (green) and surrogate (red) n:m phase-locking levels for actual hippocampal LFPs (same dataset as in Figure 5) filtered at theta and slow gamma (1 s epochs). Different rows show results for different types of filters. FIR corresponds to the same finite impulse response filter employed in all other figures. For the infinite impulse response filters (Butterworth and Bessel), the digit on the right denotes the filter order. Wavelet filtering was achieved by convolution with a complex Morlet wavelet with a center frequency of 7 Hz. (B) Original and surrogate distributions of R1:5 values. For each filter type, the original data is significantly higher than surrogate values obtained from pooled Δφnm, but indistinguishable from single run surrogates. *p<0.01, n = 7 animals, Friedman’s test with Nemenyi post-hoc test.

We also found no difference between original and surrogate n:m phase-locking levels when employing the metric described in Sauseng et al. (2009) (Figure 5—figure supplement 1), and when estimating theta phase by interpolating phase values between 4 points of the theta cycle (trough, ascending, peak and descending points) as performed in Belluscio et al. (2012) (Figure 5—figure supplement 2). The latter was somewhat expected since the phase-phase coupling results in Belluscio et al. (2012) did not depend on this particular method of phase estimation (see their Figure 6Ce). Moreover, coupling levels did not statistically differ from zero when using the pairwise phase consistency metric described in Vinck et al. (2010) (Figure 5—figure supplement 1).

We further confirmed our results by analyzing data from three additional rats recorded in an independent laboratory (Figure 5—figure supplement 3; see Materials and methods). In addition, we also found similar results in LFPs from other hippocampal layers than s. pyramidale (Figure 5—figure supplement 4), in neocortical LFPs (not shown), in current-source density (CSD) signals (Figure 5—figure supplement 4), in independent components that isolate activity of specific gamma sub-bands (Schomburg et al., 2014) (Figure 5—figure supplement 5), and in transient gamma bursts (Figure 5—figure supplement 6).

On diagonal stripes in phase-phase plots

Since Original Rn:m values were not greater than Single Run surrogate distributions, we concluded that there is lack of convincing evidence for n:m phase-locking in the hippocampal LFPs analyzed here. However, as in previous reports (Belluscio et al., 2012; Zheng et al., 2016), phase-phase plots (2D histograms of theta phase vs gamma phase) of actual LFPs displayed diagonal stripes (Figure 6), which seem to suggest phase-phase coupling. We next sought to investigate what causes the diagonal stripes in phase-phase plots.

Figure 6. Phase-phase plots of hippocampal LFPs display diagonal stripes.

Figure 6.

Phase-phase plot for theta and slow gamma (average over animals; n = 7 rats). Notice diagonal stripes suggesting phase-phase coupling.

DOI: http://dx.doi.org/10.7554/eLife.20515.022

In Figure 7 we analyze a representative LFP with prominent theta oscillations at ~7 Hz recorded during REM sleep. Due to the non-sinusoidal shape of theta (Belluscio et al., 2012; Sheremet et al., 2016), the LFP also exhibited spectral peaks at harmonic frequencies (Figure 7A). We constructed phase–phase plots using LFP components narrowly filtered at theta and its harmonics: 14, 21, 28 and 35 Hz. Similarly to the sawtooth wave (Figure 4B), the phase-phase plots exhibited diagonal stripes whose number was determined by the harmonic order (i.e., the 1st harmonic exhibited two stripes, the second harmonic three stripes, the third, four stripes and the fourth, five stripes; Figure 7Bi–iv). Interestingly, when the LFP was filtered at a broad gamma band (30–90 Hz), we observed five diagonal stripes, the same number as when narrowly filtering at 35 Hz; moreover, both gamma and 35 Hz filtered signals exhibited the exact same phase lag (Figure 7Biv–v). Therefore, these results indicate that the diagonal stripes in phase-phase plots may be influenced by theta harmonics. Under this interpretation, signals filtered at the gamma band would be likely to exhibit as many stripes as expected for the first theta harmonic falling within the filtered band. Consistent with this possibility, we found that the peak frequency of theta relates to the number of stripes (Figure 8).

Figure 7. Phase–phase coupling between theta and gamma oscillations may be confounded by theta harmonics.

(A) Top, representative LFP epoch exhibiting prominent theta activity (~7 Hz) during REM sleep. Bottom, power spectral density. The inset shows power in dB scale. (B) Phase–phase plots for theta and LFP band-pass filtered at harmonic frequencies (14, 21, 28 and 35 Hz), computed using 20 min of concatenated REM sleep. Also shown are phase-phase plots for the conventional gamma band (30–90 Hz) and for the average over individual surrogate runs. Notice that the former mirrors the phase-phase plot of the fourth theta harmonics (35 Hz).

DOI: http://dx.doi.org/10.7554/eLife.20515.023

Figure 7.

Figure 7—figure supplement 1. Histogram counts leading to diagonal stripes in phase-phase plots are statistically significant when compared to the distribution of surrogate counts.

Figure 7—figure supplement 1.

Panels show the significance of the phase-phase plots in Figure 7 when compared to the mean and standard deviation of pooled surrogate counts.

Figure 8. The number of stripes in phase-phase plots is determined by the frequency of the first theta harmonic within the filtered gamma range.

(A) Representative example in which theta has peak frequency of 7.1 Hz. The phase-phase plot between theta and slow gamma (30–50 Hz) exhibits five stripes, since the fourth theta harmonic (35.5 Hz) is the first to fall within 30 and 50 Hz. The rightmost panels show the average phase-phase plot computed over all time-shifted surrogate runs (n = 1000) and the significance of the original plot when compared to the mean and standard deviation over individual surrogate counts, respectively. (B) Example in which theta has peak frequency of 8.4 Hz and the phase-phase plot exhibits four stripes, which correspond to the third theta harmonic (33.6 Hz).

DOI: http://dx.doi.org/10.7554/eLife.20515.025

Figure 8.

Figure 8—figure supplement 1. Individual time-shifted surrogate runs exhibit diagonal stripes in phase-phase plots.

Figure 8—figure supplement 1.

(A) The middle panels show phase-phase plots for theta and slow gamma computed for different time shifts of the example epoch analyzed in Figure 8A. Notice diagonal stripes in individual surrogate runs. The left- and the rightmost panels show the original and average surrogate phase-phase plots, respectively (same panels as in Figure 8A). (B) Same as above, but for the example epoch analyzed in Figure 8B.

As in previous studies (Belluscio et al., 2012; Zheng et al., 2016), phase-phase plots constructed using data averaged from individual time-shifted epochs exhibited no diagonal stripes (Figure 7Bvi and Figure 8). This is because different time shifts lead to different phase lags; the diagonal stripes of individual surrogate runs that could otherwise be apparent cancel each other out when combining data across multiple runs of different lags (Figure 8—figure supplement 1). Moreover, as in Belluscio et al. (2012), the histogram counts that give rise to the diagonal stripes were deemed statistically significant when compared to the mean and standard deviation over individual counts from time-shifted surrogates (Figure 7—figure supplement 1 and Figure 8).

To gain further insight into what generates the diagonal stripes, we next analyzed white-noise signals. As shown in Figure 9A, phase-phase plots constructed from filtered white-noise signals also displayed diagonal stripes. Since white noise has no harmonics, these results show that the sinusoidality induced by the filter can by itself lead to diagonal stripes in phase-phase plots, in the same way that it leads to a bump in the Rn:m curve (Figure 2 and Figure 2—figure supplement 1). Importantly, as in actual LFPs, bin counts in phase-phase plots of white-noise signals were also deemed statistically significant when compared to the distribution of bin counts from time-shifted surrogates (Figure 9A). Since by definition white noise has no n:m phase-locking, we concluded that the statistical analysis of phase-phase plots as originally introduced in Belluscio et al. (2012) is too liberal. Nevertheless, we found that phase-phase plots of white noise were no longer statistically significant when using the same approach as in Belluscio et al. (2012) but corrected for multiple comparisons (i.e., the number of bins) by the Holm-Bonferroni method (the FDR correction still led to significant bins; not shown). This result was true for different epoch lengths and also when computing surrogate phase-phase plots using the Random Permutation procedure (Figure 9A). Consistently, for all epoch lengths, Original Rn:m values fell inside the distribution of Single Run surrogate Rn:m values computed using either Time Shift and Random Permutation procedures (Figure 9B).

Figure 9. Phase-phase plots of white-noise signals display diagonal stripes.

Figure 9.

(A) Representative phase-phase plots computed for white-noise signals. Notice the presence of diagonal stripes for both 100 s (left) and 1200 s (right) epochs. The colormaps underneath show the p-values of the original bin counts when compared to the mean and standard deviation over bin counts of single time-shifted surrogate runs. Also shown are significance maps after correcting for multiple comparisons (Holm-Bonferroni) using either time-shifted (top) or randomly permutated (bottom) surrogate runs. No bin count was considered statistically significant after the correction. (B) The top panels show original Rn:m curves (green) plotted along with Single Run distributions of Rn:m curves of time-shifted (orange) and randomly permutated (red) surrogates for different epoch lengths (shades denote the 2.5th–97.5th percentile interval; n = 2100 per distribution). The bottom panels show the same in a zoomed scale.

DOI: http://dx.doi.org/10.7554/eLife.20515.027

The observations above suggest that the diagonal stripes in phase-phase plots of hippocampal LFPs may actually be caused by filtering-induced sinusoidality, as opposed to being an effect of theta harmonics as we first interpreted. To test this possibility, we next revisited the significance of phase-phase plots of actual LFPs. For epochs of up to 100 s, we found similar results as in white noise, namely, bin counts were no longer statistically significant after correcting for multiple comparisons (Holm-Bonferroni method); this was true when using either the Time Shift or Random Permutation procedures (Figure 10A). Surprisingly, however, when analyzing much longer time series (10 or 20 min of concatenated periods of REM sleep), several bin counts became statistically significant when compared to randomly permutated, but not time-shifted, surrogates (Figure 10A). Moreover, this result reflected in the Rn:m curves: the Original Rn:m curve fell within the distribution of Time Shift/Single Run surrogate Rn:m values for all analyzed lengths, but outside the distribution of Random Permutation/Single Run surrogates for the longer time series (Figure 10B). We believe such a finding relates to what we observed for synthetic sawtooth waves, in which Random Permutation was more sensitive than Time Shift to detect the significance of the artifactual coupling caused by waveform asymmetry (Figure 4—figure supplement 2). In this sense, the n:m phase-locking between fundamental and harmonic frequencies would persist for small time shifts (±200 ms), albeit in different phase relations, while it would not resist the much larger time shifts obtained through random permutations. However, irrespective of this explanation, it should be noted that since the n:m phase-locking metrics cannot separate artifactual from true coupling, the possibility of the latter cannot be discarded. But if this is the case, we consider unlikely that the very low coupling level (~0.03) would have any physiological significance.

Figure 10. Weak but statistically significant n:m phase-locking can be detected when analyzing long LFP epochs (>100 s).

(A) Panels show the same as in Figure 9A but for a representative hippocampal LFP. Notice that several bin counts of the 1200 s epoch remain statistically significant after correction for multiple comparisons (Holm-Bonferroni) when compared to randomly permutated, but not time-shifted, surrogates (bottom right plot). (B) As in Figure 9B, but for actual LFPs (n = 300 samples per animal; the number of analyzed animals is stated in each panel). For the very long epochs, notice that the original Rn:m curve falls within the distribution of time-shifted surrogates but outside the distribution of randomly permutated ones.

DOI: http://dx.doi.org/10.7554/eLife.20515.028

Figure 10.

Figure 10—figure supplement 1. Random Permutation leads to less visible diagonal stripes than Time Shift in phase-phase plots of long LFP epochs.

Figure 10—figure supplement 1.

Examples of phase-phase plots computed for single Time Shift (top) and Random Permutation (bottom) surrogate runs of 100 (left) and 1200 s (right) for the same hippocampal LFP as in Figure 10A. Notice that, for the longer LFP epoch, the randomly permutated surrogate exhibits less discernible stripes than the time-shifted one.
Figure 10—figure supplement 2. Diagonal stripes in phase-phase plots depend on analyzing contiguous phase time series data.

Figure 10—figure supplement 2.

Phase-phase plots of a white noise (left) and an actual LFP (right) computed using 100 s of total data, but subsampled at 83.3 Hz (we used a subsampling period of 12 ms because the total data length of the actual LFP was 1200 s). Notice no diagonal stripes in the phase-phase plot of white noise, while some striped-like pattern persists for the actual LFP data.

We conclude that the diagonal stripes in phase-phase plots of both white noise and actual LFPs are mainly caused by a temporary n:m alignment of the phase time-series secondary to the filtering-induced sinusoidality, and as such they are also apparent in surrogate data (Figure 8—figure supplement 1 and Figure 10—figure supplement 1). However, for actual LFPs there is a second influence, which can only be detected when analyzing very long epoch lengths, and which we believe is due to theta harmonics.

Discussion

Theta and gamma oscillations are hallmarks of hippocampal activity during active exploration and REM sleep (Buzsáki et al., 2003; Csicsvari et al., 2003; Montgomery et al., 2008). Theta and gamma are well known to interact by means of phase-amplitude coupling, in which the instantaneous gamma amplitude waxes and wanes as a function of theta phase (Bragin et al., 1995; Scheffer-Teixeira et al., 2012; Caixeta et al., 2013). This particular type of cross-frequency coupling has been receiving large attention and related to functional roles (Canolty and Knight, 2010; Hyafil et al., 2015). In addition to phase-amplitude coupling, theta and gamma oscillations can potentially interact in many other ways (Jensen and Colgin, 2007; Hyafil et al., 2015). For example, the power of slow gamma oscillations may be inversely related to theta power (Tort et al., 2008), suggesting amplitude-amplitude coupling. Recently, it has been reported that theta and gamma in hippocampal LFPs would also couple by means of n:m phase-locking (Belluscio et al., 2012; Zheng and Zhang, 2013; Xu et al., 2013, 2015; Zheng et al., 2016). Among other implications, this finding was taken as evidence for network models of working memory (Lisman and Idiart, 1995; Jensen and Lisman, 2005; Lisman, 2005) and for a role of basket cells in generating cross-frequency coupling (Belluscio et al., 2012; Buzsáki and Wang, 2012). However, our results show a lack of convincing evidence for n:m phase-locking in the two hippocampal datasets analyzed here, and further suggest that previous work may have spuriously detected phase-phase coupling due to an improper use of surrogate methods, a concern also raised for phase-amplitude coupling (Aru et al., 2015).

Statistical inference of phase-phase coupling

When searching for phase-phase coupling between theta and gamma, we noticed that our Rn:m values differed from those reported in previous studies (Belluscio et al., 2012; Xu et al., 2013, 2015; Zheng et al., 2016). We suspected that this could be due to differences in the duration of the analyzed epochs. We then investigated the dependence of Rn:m on epoch length, and found a strong positive bias for shorter epochs. In addition, Rn:m values exhibit greater variability across samples as epoch length decreases for both white noise and actual data (e.g., compare in Figure 5B the data dispersion in Original R1:5 or R1:8 boxplots for different epoch lengths). Since theta and gamma peak frequencies are not constant in these signals, the longer the epoch, the more the theta and gamma peak frequencies are allowed to fluctuate and the more apparent the lack of coupling. On the other hand, Δφnm distribution becomes less uniform for shorter epochs. The dependence of n:m phase-coupling metrics on epoch length has important implications in designing surrogate epochs for testing the statistical significance of actual Rn:m values. Of note, methodological studies on 1:1 phase-synchrony have properly used single surrogate runs of the same length as the original signal (Le Van Quyen et al., 2001; Hurtado et al., 2004). As demonstrated here, spurious detection of phase-phase coupling may occur if surrogate epochs are longer than the original epoch. This is the case when one lumps together several surrogate epochs before computing Rn:m. When employing proper controls, our results show that Rn:m values of real data do not differ from surrogate values in theta epochs of up to 100 s. Moreover, the prominent bump in the Rn:m curve disappears when subsampling data at a lower frequency than gamma for both white noise and hippocampal LFPs (see Figure 2—figure supplement 1 and Figure 5—figure supplement 7), which suggests that it is due to the statistical dependence among contiguous data points introduced by the filter (which we referred to as ‘filtering-induced sinusoidality’).

Therefore, even though the n:m phase-locking metric Rn:m is theoretically well-defined and varies between 0 and 1, an estimated Rn:m value in isolation does not inform if two oscillations exhibit true phase-coupling or not. This can only be inferred after testing the statistical significance of the estimated Rn:m value against a proper surrogate distribution (but notice that false-positive cases may occur due to waveform asymmetry; Figure 4C). While constructing surrogate data renders the metric computationally more expensive, such an issue is not specific for measuring n:m phase-locking but also happens for other metrics commonly used in the analysis of neurophysiological data, such as coherence, spike-field coupling, phase-amplitude coupling, mutual information and directionality measures, among many others (Le Van Quyen et al., 2001; Hurtado et al., 2004; Pereda et al., 2005; Tort et al., 2010).

The recent studies assessing theta-gamma phase-phase coupling in hippocampal LFPs have not tested the significance of individual Rn:m values against chance (Belluscio et al., 2012; Zheng and Zhang, 2013; Xu et al., 2013, 2015; Zheng et al., 2016). Two studies (Belluscio et al., 2012; Zheng et al., 2016) statistically inferred the existence of n:m phase-locking by comparing empirical phase-phase plots with those obtained from the average of 1000 time-shifted surrogate runs. Specifically, Belluscio et al. (2012) established a significance threshold for each phase-phase bin based on the mean and standard deviation of individual surrogate counts in that bin, and showed that the bin counts leading to diagonal stripes were statistically significant. Here we were able to replicate these results (Figure 7—figure supplement 1 and Figure 8). However, we note that a phase-phase bin count is not a metric of n:m phase-locking; it does not inform coupling strength and even coupled oscillators have bins with non-significant counts. A bin count would be analogous to a phase difference vector (eiΔφnm(t)), which is also not a metric of n:m phase-locking per se, but used to compute one. That is, in the same way that the Rn:m considers all phase difference vectors, n:m phase-locking can only be inferred when considering all bin counts in a phase-phase plot. In this sense, by analyzing the phase-phase plot as a whole, it was assumed that the appearance diagonal stripes was due to theta-gamma coupling; no such stripes were apparent in phase-phase plots constructed from the average over all surrogate runs (see Figure 6A in Belluscio et al., 2012). However, here we showed that single time-shifted surrogate runs do exhibit diagonal stripes (Figure 8—figure supplement 1 and Figure 10—figure supplement 1), that is, similar stripes exist at the level of a Single Run surrogate analysis, in the same way that Single Run surrogates also exhibit a bump in the Rn:m curve. Averaging 1000 surrogate phase-phase plots destroys the diagonal stripes since different time shifts lead to different phase lags. Moreover, since the average is the sum divided by a scaling factor (the sample size), computing the average phase-phase plot is equivalent to computing a single phase-phase plot using the pool of all surrogate runs, which is akin to the issue of computing a single Rn:m value from a pooled surrogate distribution (Figure 2). Note that even bin counts in phase-phase plots of white noise are considered significant under the statistical analysis introduced in Belluscio et al. (2012) (Figure 9A). Nevertheless, this was no longer the case when adapting their original framework to include a Holm-Bonferroni correction for multiple comparisons (Figure 9A).

Here we showed that the presence of diagonal stripes in phase-phase plots is not sufficient to conclude the existence of phase-phase coupling. The diagonal stripes are simply a visual manifestation of a maintained phase relationship, and as such they essentially reflect what Rn:m measures: that is, the ‘clearer’ the stripes, the higher the Rn:m. Therefore, in addition to true coupling, the same confounding factors that influence Rn:m also influence phase-phase plots, such as filtering-induced sinusoidality and frequency harmonics. Our results suggest that the former is a main factor, because white-noise signals have no harmonics but nevertheless display stripes in phase-phase plots (Figure 9A). In accordance, no stripes are observed in phase-phase plots of white noise when subsampling the time series (Figure 10—figure supplement 2; see also Figure 2—figure supplement 1). However, in actual LFPs filtering is not the only influence: (1) for the same filtered gamma band (30–50 Hz), the number of stripes relates to theta frequency (Figure 8); (2) for very long time series (i.e., 10–20 min of concatenated data), the stripes in phase-phase plots of actual data – but not of white noise – persist after correcting for multiple comparisons when employing Random Permutation/Single Run surrogates (Figure 10A); (3) a striped-like pattern remains in phase-phase plots of actual LFPs after subsampling the time series (Figure 10—figure supplement 2). Consistently, Rn:m values of actual LFPs are greater than those of white noise in 1200 s epochs (~0.03 vs ~0.005, compare the bottom right panels of Figures 9B and 10B). Interestingly, Original Rn:m values of actual LFPs are not statistically different from the distribution of Time Shift/Single Run surrogates even for the very long epochs (Figure 10B), which suggests that Random Permutation is more powerful than Time Shift and should therefore be preferred. Though a very weak but true coupling effect cannot be discarded, based on our analysis of sawtooth waves (Figure 4 and Figure 4—figure supplement 2), we believe these results can be explained by theta harmonics, which would remain phase-locked to the fundamental frequency under small time shifts. Sharp signal deflections have been previously recognized to generate artifactual phase-amplitude coupling (Kramer et al., 2008; Scheffer-Teixeira et al., 2013; Tort et al., 2013; Aru et al., 2015; Lozano-Soldevilla et al., 2016). Interestingly, Hyafil (2015) recently suggested that the non-sinusoidality of alpha waves could underlie the 1:2 phase-locking between alpha and beta observed in human EEG (Nikulin and Brismar, 2006; see also Palva et al., 2005). To the best of our knowledge, there is currently no metric capable of automatically distinguishing true cross-frequency coupling from waveform-induced artifacts in collective signals such as LFP, EEG and MEG signals. Ideally, learning how the signal is generated from the activity of different neuronal populations would answer whether true cross-frequency coupling exists or not (Hyafil et al., 2015), but unfortunately this is methodologically challenging.

Lack of evidence vs evidence of non-existence

One could argue that we did not analyze a proper dataset, or else that prominent phase-phase coupling would only occur during certain behavioral states not investigated here. We disagree with these arguments for the following reasons: (1) we could reproduce our results using a second dataset from an independent laboratory (Figure 5—figure supplement 3), and (2) we examined the same behavioral states in which n:m phase-locking was reported to occur (active waking and REM sleep). One could also argue that there exists multiple gammas, and that different gamma types are most prominent in different hippocampal layers (Colgin et al., 2009; Scheffer-Teixeira et al., 2012; Tort et al., 2013; Schomburg et al., 2014; Lasztóczi and Klausberger, 2014); therefore, prominent theta-gamma phase-phase coupling could exist in other hippocampal layers not investigated here. We also disagree with this possibility because: (1) we examined the same hippocampal layer in which theta-gamma phase-phase coupling was reported to occur (Belluscio et al., 2012); moreover, (2) we found similar results in all hippocampal layers (we recorded LFPs using 16-channel silicon probes, see Materials and methods) (Figure 5—figure supplement 4) and (3) in parietal and entorhinal cortex recordings (not shown). Furthermore, similar results hold when (4) filtering LFPs within any gamma sub-band (Figure 5 and Figure 5—figure supplement 1 to 6), (5) analyzing CSD signals (Figure 5—figure supplement 4), or (6) analyzing independent components that maximize activity within particular gamma sub-bands (Schomburg et al., 2014) (Figure 5—figure supplement 5). Finally, one could argue that gamma oscillations are not continuous but transient, and that assessing phase-phase coupling between theta and transient gamma bursts would require a different type of analysis than employed here. Regarding this argument, we once again stress that we used the exact same methodology as originally used to detect theta-gamma phase-phase coupling (Belluscio et al., 2012). Nevertheless, we also ran analysis only taking into account periods in which gamma amplitude was >2 SD above the mean (‘gamma bursts’) and found no statistically significant phase-phase coupling (Figure 5—figure supplement 6).

Following Belluscio et al. (2012), other studies also reported theta-gamma phase-phase coupling in the rodent hippocampus (Zheng and Zhang, 2013; Xu et al., 2013, 2015; Zheng et al., 2016) and amygdala (Stujenske et al., 2014). In addition, human studies had previously reported theta-gamma phase-phase coupling in scalp EEG (Sauseng et al., 2008, 2009; Holz et al., 2010). Most of these studies, however, have not tested the statistical significance of coupling levels against chance (Sauseng et al., 2008, 2009; Holz et al., 2010; Zheng and Zhang, 2013; Xu et al., 2013, 2015; Stujenske et al., 2014), while Zheng et al. (2016) based their statistical inferences on the inspection of diagonal stripes in phase-phase plots as originally introduced in Belluscio et al. (2012). We further note that epoch length was often not informed in the animal studies. Based on our results, we believe that differences in analyzed epoch length are likely to explain the high variability of Rn:m values across different studies, from ~0.4 (Zheng et al., 2016) down to 0.02 (Xu et al., 2013).

Since it is philosophically impossible to prove the absence of an effect, the burden of proof should be placed on demonstrating that a true effect exists. In this sense, and to the best of our knowledge, none of previous research investigating theta-gamma phase-phase coupling has properly tested Rn:m against chance. Many studies have focused on comparing changes in n:m phase-locking levels, but we believe these can be influenced by other variables such as changes in power, which affect the signal-to-noise ratio and consequently also the estimation of the phase time series. Interestingly, in their pioneer work, Tass and colleagues used filtered white noise to construct surrogate distributions and did not find significant n:m phase-locking among brain oscillations (Tass et al., 1998, 2003). On the other hand, it is theoretically possible that n:m phase-locking exists but can only be detected by other types of metrics yet to be devised. In any case, our work shows that there is currently no convincing evidence for genuine theta-gamma phase-phase coupling using the same phase-locking metric (Rn:m) as employed in previous studies (Belluscio et al., 2012; Zheng and Zhang, 2013Xu et al., 2013, 2015; Stujenske et al., 2014; Zheng et al., 2016), at least when examining LFP epochs of up to 100 s of prominent theta activity. For longer epoch lengths, though, we did find that Rn:m values of hippocampal LFPs may actually differ from those of randomly permuted, but not time-shifted, surrogates (Figure 10B). While we tend to ascribe such result to the effect of theta harmonics, we note that the possibility of true coupling cannot be discarded. But we are particularly skeptical that the very low levels of coupling strength observed in long LFP epochs would be physiologically meaningful.

Implications for models of neural coding by theta-gamma coupling

Lisman and Idiart (1995) proposed an influential model in which theta and gamma oscillations would interact to produce a neural code. The theta-gamma coding model has since been improved (Jensen and Lisman, 2005; Lisman, 2005; Lisman and Buzsáki, 2008), but its essence remains the same (Lisman and Jensen, 2013): nested gamma cycles would constitute memory slots, which are parsed at each theta cycle. Accordingly, Lisman and Idiart (1995) hypothesized that working memory capacity (7 ± 2) is determined by the number of gamma cycles per theta cycle.

Both phase-amplitude and phase-phase coupling between theta and gamma have been considered experimental evidence for such coding scheme (Lisman and Buzsáki, 2008; Sauseng et al., 2009; Axmacher et al., 2010; Belluscio et al., 2012; Lisman and Jensen, 2013; Hyafil et al., 2015; Rajji et al., 2016). In the case of phase-amplitude coupling, the modulation of gamma amplitude within theta cycles would instruct a reader network when the string of items represented in different gamma cycles starts and terminates. On the other hand, the precise ordering of gamma cycles within theta cycles that is consistent across theta cycles would imply phase-phase coupling; indeed, n:m phase-locking is a main feature of computational models of sequence coding by theta-gamma coupling (Lisman and Idiart, 1995; Jensen and Lisman, 1996; Jensen et al., 1996). In contrast to these models, however, our results show that the theta phases in which gamma cycles begin/end are not fixed across theta cycles, which is to say that gamma cycles are not precisely timed but rather drift; in other words, gamma is not a clock (Burns et al., 2011).

If theta-gamma neural coding exists, our results suggest that the precise location of gamma memory slots within a theta cycle is not required for such a code, and that the ordering of the represented items would be more important than the exact spike timing of the cell assemblies that represent the items (Lisman and Jensen, 2013).

Conclusion

In summary, while absence of evidence is not evidence of absence, our results challenge the hypothesis that theta-gamma phase-phase coupling exists in the hippocampus. At best, we only found significant Rn:m values when examining long LFP epochs (>100 s), but these had very low magnitude (and we particularly attribute their statistical significance to the effects of harmonics). We believe that the evidence in favor of n:m phase-locking in other brain regions and signals could potentially also be explained by simpler effects (e.g., filtering-induced sinusoidality, asymmetrical waveform, and improper statistical tests). While no current technique can differentiate spurious from true phase-phase coupling, previous findings should be revisited and, whenever suitable, checked against the confounding factors and the more conservative surrogate procedures outlined here.

Materials and methods

Animals and surgery

All procedures were approved by our local institutional ethics committee (Comissão de Ética no Uso de Animais - CEUA/UFRN, protocol number 060/2011) and were in accordance with the National Institutes of Health guidelines. We used seven male Wistar rats (2–3 months; 300–400 g) from our breeding colony, kept under 12 hr/12 hr dark-light cycle. We recorded from the dorsal hippocampus through either multi-site linear probes (n = 6 animals; 4 probes had 16 4320 μm2 contacts spaced by 100 μm; 1 probe had 16 703 μm2 contacts spaced by 100 μm; 1 probe had 16 177 μm2 contacts spaced by 50 μm; all probes from NeuroNexus) or single wires (n = 1 animal; 50 μm diameter) inserted at AP −3.6 mm and ML 2.5 mm. Results shown in the main figures were obtained for LFP recordings from the CA1 pyramidal cell layer, identified by depth coordinate and characteristic electrophysiological benchmarks such as highest ripple power (see Figure 5—figure supplement 4 for an example). Similar results were obtained for recordings from other hippocampal layers (Figure 5—figure supplement 4).

We also analyzed data from three additional rats downloaded from the Collaborative Research in Computational Neuroscience data sharing website (www.crcns.org) (Figure 5—figure supplement 3). These recordings are a generous contribution by György Buzsáki’s laboratory (HC3 dataset, Mizuseki et al., 20132014).

Data collection

Recording sessions were performed in an open field (1 m x 1 m) and lasted 4–5 hr. Raw signals were amplified (200x), filtered between 1 Hz and 7.5 kHz (third order Butterworth filter), and digitized at 25 kHz (RHA2116, IntanTech). The LFP was obtained by further filtering between 1–500 Hz and downsampling to 1000 Hz.

Data analysis

Active waking and REM sleep periods were identified from spectral content (high theta/delta power ratio) and video recordings (movements during active waking; clear sleep posture and preceding slow-wave sleep for REM). The results were identical for active waking and REM epochs; throughout this work we only show the latter. The analyzed REM sleep dataset is available at http://dx.doi.org/10.5061/dryad.12t21. MATLAB codes for reproducing our analyses are available at https://github.com/tortlab/phase_phase .

We used built-in and custom-written MATLAB routines. Band-pass filtering was obtained using a least squares finite impulse response (FIR) filter by means of the ‘eegfilt’ function from the EEGLAB Toolbox (Delorme and Makeig, 2004). The filter order was three times the sampling rate divided by the low cutoff frequency. The eegfilt function calls the MATLAB ‘filtfilt’ function, which applies the filter forward and then again backwards to ensure no distortion of phase values. Similar results were obtained when employing other types of filters (Figure 5—figure supplement 8).

The phase time series was estimated through the Hilbert transform. To estimate the instantaneous theta phase of actual data, we filtered the LFP between 4–20 Hz, a bandwidth large enough to capture theta wave asymmetry (Belluscio et al., 2012). Estimating theta phase by the interpolation method described in Belluscio et al. (2012) led to similar results (Figure 5—figure supplement 2).

The CSD signals analyzed in Figure 5—figure supplement 4 were obtained as −A +2B −C, where A, B and C denote LFP signals recorded from adjacent probe sites. In Figure 5—figure supplement 5, the independent components were obtained as described in Schomburg et al. (2014); phase-amplitude comodulograms were computed as described in Tort et al. (2010).

n:m phase-locking

We measured the consistency of the phase difference between accelerated time series (Δφnm(tj)=nφγ(tj)mφθ(tj)). To that end, we created unitary vectors whose angle is the instantaneous phase difference (eiΔφnm(tj)), where j indexes the time sample, and then computed the length of the mean vector: Rn:m=1Nj=1NeiΔφnm(tj), where N is the total number of time samples (epoch length in seconds x sampling frequency in Hz). Rn:m equals 1 when Δφnm is constant for all time samples tj, and 0 when Δφnm is uniformly distributed. This metric is also commonly referred to as ‘mean resultant length’ or ‘mean radial distance’ (Belluscio et al., 2012; Stujenske et al., 2014; Zheng et al., 2016). Qualitatively similar results were obtained when employing the framework introduced in Sauseng et al. (2009), which computes the mean radial distance using gamma phases in separated theta phase bins, or the pairwise phase consistency metric described in Vinck et al. (2010) (Figure 5—figure supplement 1). Phase-phase plots were obtained by first binning theta and gamma phases into 120 bins and next constructing 2D histograms of phase counts, which were smoothed using a Gaussian kernel of σ = 10 bins.

Surrogates

In all cases, theta phase was kept intact while gamma phase was mocked in three different ways: (1) Time Shift: the gamma phase time series is randomly shifted between 1 and 200 ms; (2) Random Permutation: a contiguous gamma phase time series of the same length as the original is randomly extracted from the same session. (3) Phase Scrambling: the timestamps of the gamma phase time series are randomly shuffled (thus not preserving phase continuity). For each case, Rn:m values were computed using either Δφnm distribution for single surrogate runs (Single Run Distribution) or the pooled distribution of Δφnm over 100 surrogate runs (Pooled Distribution).

For each animal, behavioral state (active waking or REM sleep) and epoch length, we computed 300 Original Rn:m values using different time windows along with 300 mock Rn:m values per surrogate method. Therefore, in all figures each boxplot was constructed using the same number of samples (=300 x number of animals). For instance, in Figure 5B we used n = 7 animals x 300 samples per animal = 2100 samples (but see Statistics below). In Figure 2, boxplot distributions for the white-noise data were constructed using n = 2100.

Simulations

Kuramoto oscillators displaying n:m phase-locking were modeled as described in Osipov et al. (2007):

φθ˙= ωθ+ εsin(nφγmφθ)φγ˙= ωγ+ εsin(mφθnφγ),

where ε is the coupling strength and ωθ and ωγ are the natural frequencies of theta and gamma, respectively, which followed a Gaussian probability (σ = 5 Hz) at each time step. We used ε = 10, n = 1, m = 5, and dt = 0.001 s. The mean theta and gamma frequencies of each simulation are stated in the main text. For uncoupled oscillators, we set ε = 0.

For implementing the O-I cell network (Figure 3B), we simulated the model previously described in Kopell et al. (2010). We used the same parameters as in Figure 3A of Kopell et al. (2010), with white noise (σ = 0.001) added to the I cell drive to create variations in spike frequency. NEURON (https://www.neuron.yale.edu/) codes for the model are available at ModelDB (https://senselab.med.yale.edu/).

The sawtooth wave in Figure 4C was simulated using dt = 0.001 s. Its instantaneous frequency followed a Gaussian distribution with mean = 8 Hz and σ = 5 Hz; white noise (σ = 0.1) was added to the signal.

In Figures 3 and 4C, boxplot distributions for simulated data were constructed using n = 300.

Statistics

For white noise data (Figure 2F), given the large sample size (n = 2100) and independence among samples, we used one-way ANOVA with Bonferroni post-hoc test. For statistical analysis of real data (Figure 5B), we avoided nested design and inflation of power and used the mean Rn:m value per animal. In this case, due to the reduced sample size (n = 7) and lack of evidence of normal distribution (Shapiro-Wilk normality test), we used the Friedman’s test and Nemenyi post-hoc test. In Figures 3 and 4C, we tested if Rn:m values of simulated data were greater than the distribution of surrogate values using one-tailed t-tests.

Acknowledgements

The authors are indebted to the reviewers for many constructive comments and helpful suggestions. The authors are grateful to Jurij Brankačk and Andreas Draguhn for donation of NeuroNexus probes. Supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) and Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES). The authors declare no competing financial interests.

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Funding Information

This paper was supported by the following grants:

  • Conselho Nacional de Desenvolvimento Científico e Tecnológico to Robson Scheffer-Teixeira, Adriano BL Tort.

  • Coordenação de Aperfeiçoamento de Pessoal de Nível Superior to Robson Scheffer-Teixeira, Adriano BL Tort.

Additional information

Competing interests

The authors declare that no competing interests exist.

Author contributions

RS-T, Acquisition of data, Analysis and interpretation of data, Drafting or revising the article.

ABLT, Conception and design, Analysis and interpretation of data, Drafting or revising the article.

Ethics

Animal experimentation: All procedures were approved by the institutional ethics committee of Federal University of Rio Grande do Norte (Comissão de Ética no Uso de Animais - CEUA/UFRN, protocol number 060/2011) and were in accordance with the National Institutes of Health guidelines.

Additional files

Major datasets

The following dataset was generated:

Scheffer-Teixeira R,Tort A,2016,Multisite LFP recordings from the rat hippocampus during REM sleep,http://dx.doi.org/10.5061/dryad.12t21,Available at Dryad Digital Repository under a CC0 Public Domain Dedication

The following previously published dataset was used:

Mizuseki K,Sirota A,Pastalkova E,Diba K,Buzsáki G,2013,Multiple single unit recordings from different rat hippocampal and entorhinal regions while the animals were performing multiple behavioral tasks,http://dx.doi.org/10.6080/K09G5JRZ,Publicly available at the Collaborative Research in Computational Neuroscience (http://crcns.org/)

References

  1. Aru J, Aru J, Priesemann V, Wibral M, Lana L, Pipa G, Singer W, Vicente R. Untangling cross-frequency coupling in neuroscience. Current Opinion in Neurobiology. 2015;31:51–61. doi: 10.1016/j.conb.2014.08.002. [DOI] [PubMed] [Google Scholar]
  2. Axmacher N, Henseler MM, Jensen O, Weinreich I, Elger CE, Fell J. Cross-frequency coupling supports multi-item working memory in the human hippocampus. PNAS. 2010;107:3228–3233. doi: 10.1073/pnas.0911531107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Belluscio MA, Mizuseki K, Schmidt R, Kempter R, Buzsáki G. Cross-frequency phase-phase coupling between θ and γ oscillations in the hippocampus. Journal of Neuroscience. 2012;32:423–435. doi: 10.1523/JNEUROSCI.4122-11.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bragin A, Jandó G, Nádasdy Z, Hetke J, Wise K, Buzsáki G. Gamma (40-100 Hz) oscillation in the hippocampus of the behaving rat. Journal of Neuroscience. 1995;15:47–60. doi: 10.1523/JNEUROSCI.15-01-00047.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Burns SP, Xing D, Shapley RM. Is gamma-band activity in the local field potential of V1 cortex a "clock" or filtered noise? Journal of Neuroscience. 2011;31:9658–9664. doi: 10.1523/JNEUROSCI.0660-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Buzsáki G, Buhl DL, Harris KD, Csicsvari J, Czéh B, Morozov A. Hippocampal network patterns of activity in the mouse. Neuroscience. 2003;116:201–211. doi: 10.1016/S0306-4522(02)00669-3. [DOI] [PubMed] [Google Scholar]
  7. Buzsáki G, Wang XJ. Mechanisms of gamma oscillations. Annual Review of Neuroscience. 2012;35:203–225. doi: 10.1146/annurev-neuro-062111-150444. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Caixeta FV, Cornélio AM, Scheffer-Teixeira R, Ribeiro S, Tort AB. Ketamine alters oscillatory coupling in the hippocampus. Scientific Reports. 2013;3:2348. doi: 10.1038/srep02348. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Canavier CC, Kazanci FG, Prinz AA. Phase resetting curves allow for simple and accurate prediction of robust N:1 phase locking for strongly coupled neural oscillators. Biophysical Journal. 2009;97:59–73. doi: 10.1016/j.bpj.2009.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Canolty RT, Knight RT. The functional role of cross-frequency coupling. Trends in Cognitive Sciences. 2010;14:506–515. doi: 10.1016/j.tics.2010.09.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Colgin LL, Denninger T, Fyhn M, Hafting T, Bonnevie T, Jensen O, Moser MB, Moser EI. Frequency of gamma oscillations routes flow of information in the hippocampus. Nature. 2009;462:353–457. doi: 10.1038/nature08573. [DOI] [PubMed] [Google Scholar]
  12. Csicsvari J, Jamieson B, Wise KD, Buzsáki G. Mechanisms of gamma oscillations in the hippocampus of the behaving rat. Neuron. 2003;37:311–322. doi: 10.1016/S0896-6273(02)01169-8. [DOI] [PubMed] [Google Scholar]
  13. DeCoteau WE, Thorn C, Gibson DJ, Courtemanche R, Mitra P, Kubota Y, Graybiel AM. Learning-related coordination of striatal and hippocampal theta rhythms during acquisition of a procedural maze task. PNAS. 2007;104:5644–5649. doi: 10.1073/pnas.0700818104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods. 2004;134:9–21. doi: 10.1016/j.jneumeth.2003.10.009. [DOI] [PubMed] [Google Scholar]
  15. Fell J, Axmacher N. The role of phase synchronization in memory processes. Nature Reviews Neuroscience. 2011;12:105–118. doi: 10.1038/nrn2979. [DOI] [PubMed] [Google Scholar]
  16. Fries P. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends in Cognitive Sciences. 2005;9:474–480. doi: 10.1016/j.tics.2005.08.011. [DOI] [PubMed] [Google Scholar]
  17. García-Álvarez D, Stefanovska A, McClintock PVE. High-order synchronization, transitions, and competition among Arnold tongues in a rotator under harmonic forcing. Physical Review E. 2008;77:056203. doi: 10.1103/PhysRevE.77.056203. [DOI] [PubMed] [Google Scholar]
  18. Guevara MR, Glass L. Phase locking, period doubling bifurcations and chaos in a mathematical model of a periodically driven oscillator: a theory for the entrainment of biological oscillators and the generation of cardiac dysrhythmias. Journal of Mathematical Biology. 1982;14:1–23. doi: 10.1007/BF02154750. [DOI] [PubMed] [Google Scholar]
  19. Holz EM, Glennon M, Prendergast K, Sauseng P. Theta-gamma phase synchronization during memory matching in visual working memory. NeuroImage. 2010;52:326–335. doi: 10.1016/j.neuroimage.2010.04.003. [DOI] [PubMed] [Google Scholar]
  20. Hurtado JM, Rubchinsky LL, Sigvardt KA. Statistical method for detection of phase-locking episodes in neural oscillations. Journal of Neurophysiology. 2004;91:1883–1898. doi: 10.1152/jn.00853.2003. [DOI] [PubMed] [Google Scholar]
  21. Hyafil A, Giraud AL, Fontolan L, Gutkin B. Neural cross-frequency coupling: connecting architectures, mechanisms, and functions. Trends in Neurosciences. 2015;38:725–740. doi: 10.1016/j.tins.2015.09.001. [DOI] [PubMed] [Google Scholar]
  22. Hyafil A. Misidentifications of specific forms of cross-frequency coupling: three warnings. Frontiers in Neuroscience. 2015;9:370. doi: 10.3389/fnins.2015.00370. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Jensen O, Idiart MA, Lisman JE. Physiologically realistic formation of autoassociative memory in networks with theta/gamma oscillations: role of fast NMDA channels. Learning & Memory. 1996;3:243–256. doi: 10.1101/lm.3.2-3.243. [DOI] [PubMed] [Google Scholar]
  24. Jensen O, Lisman JE. Theta/gamma networks with slow NMDA channels learn sequences and encode episodic memory: role of NMDA channels in recall. Learning & Memory. 1996;3:264–278. doi: 10.1101/lm.3.2-3.264. [DOI] [PubMed] [Google Scholar]
  25. Jensen O, Lisman JE. Hippocampal sequence-encoding driven by a cortical multi-item working memory buffer. Trends in Neurosciences. 2005;28:67–72. doi: 10.1016/j.tins.2004.12.001. [DOI] [PubMed] [Google Scholar]
  26. Jensen O, Colgin LL. Cross-frequency coupling between neuronal oscillations. Trends in Cognitive Sciences. 2007;11:267–269. doi: 10.1016/j.tics.2007.05.003. [DOI] [PubMed] [Google Scholar]
  27. Kopell N, Borgers C, Prevouchine D, Malerba P, Tort AB. Gamma and theta rhythms in biophysical models of hippocampal circuits. In: Cutsuridis V, Graham B, Cobb S, Vida I, editors. Hippocampal Microcircuits: A Computational Modeler S Resource Book. Vol. 5. New York: Springer-Verlag; 2010. pp. 423–457. [DOI] [Google Scholar]
  28. Kramer MA, Tort AB, Kopell NJ. Sharp edge artifacts and spurious coupling in EEG frequency comodulation measures. Journal of Neuroscience Methods. 2008;170:352–357. doi: 10.1016/j.jneumeth.2008.01.020. [DOI] [PubMed] [Google Scholar]
  29. Lachaux JP, Rodriguez E, Martinerie J, Varela FJ. Measuring phase synchrony in brain signals. Human Brain Mapping. 1999;8:194–208. doi: 10.1002/(SICI)1097-0193(1999)8:4&#x0003c;194::AID-HBM4&#x0003e;3.0.CO;2-C. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Lasztóczi B, Klausberger T. Layer-specific GABAergic control of distinct gamma oscillations in the CA1 hippocampus. Neuron. 2014;81:1126–1139. doi: 10.1016/j.neuron.2014.01.021. [DOI] [PubMed] [Google Scholar]
  31. Le Van Quyen M, Foucher J, Lachaux J, Rodriguez E, Lutz A, Martinerie J, Varela FJ. Comparison of Hilbert transform and wavelet methods for the analysis of neuronal synchrony. Journal of Neuroscience Methods. 2001;111:83–98. doi: 10.1016/S0165-0270(01)00372-7. [DOI] [PubMed] [Google Scholar]
  32. Lisman JE, Idiart MA. Storage of 7 +/- 2 short-term memories in oscillatory subcycles. Science. 1995;267:1512–1515. doi: 10.1126/science.7878473. [DOI] [PubMed] [Google Scholar]
  33. Lisman J. The theta/gamma discrete phase code occuring during the hippocampal phase precession may be a more general brain coding scheme. Hippocampus. 2005;15:913–922. doi: 10.1002/hipo.20121. [DOI] [PubMed] [Google Scholar]
  34. Lisman J, Buzsáki G. A neural coding scheme formed by the combined function of gamma and theta oscillations. Schizophrenia Bulletin. 2008;34:974–980. doi: 10.1093/schbul/sbn060. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Lisman JE, Jensen O. The θ-γ neural code. Neuron. 2013;77:1002–1016. doi: 10.1016/j.neuron.2013.03.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Lozano-Soldevilla D, Ter Huurne N, Oostenveld R. Neuronal oscillations with non-sinusoidal morphology produce spurious phase-to-amplitude coupling and directionality. Frontiers in Computational Neuroscience. 2016;10:87. doi: 10.3389/fncom.2016.00087. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Mizuseki K, Sirota A, Pastalkova E, Diba K, Buzsáki G. 2013. Multiple single unit recordings from different rat hippocampal and entorhinal regions while the animals were performing multiple behavioral tasks. CRCNS.org. [DOI]
  38. Mizuseki K, Diba K, Pastalkova E, Teeters J, Sirota A, Buzsáki G. Neurosharing: large-scale data sets (spike, LFP) recorded from the hippocampal-entorhinal system in behaving rats. F1000Research. 2014;3:98. doi: 10.12688/f1000research.3895.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Montgomery SM, Buzsáki G. Gamma oscillations dynamically couple hippocampal CA3 and CA1 regions during memory task performance. PNAS. 2007;104:14495–14500. doi: 10.1073/pnas.0701826104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Montgomery SM, Sirota A, Buzsáki G. Theta and gamma coordination of hippocampal networks during waking and rapid eye movement sleep. Journal of Neuroscience. 2008;28:6731–6741. doi: 10.1523/JNEUROSCI.1227-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Nikulin VV, Brismar T. Phase synchronization between alpha and beta oscillations in the human electroencephalogram. Neuroscience. 2006;137:647–657. doi: 10.1016/j.neuroscience.2005.10.031. [DOI] [PubMed] [Google Scholar]
  42. Nácher V, Ledberg A, Deco G, Romo R. Coherent delta-band oscillations between cortical areas correlate with decision making. PNAS. 2013;110:15085–15090. doi: 10.1073/pnas.1314681110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Osipov GV, Kurths J, Zhou C. Synchronization in Oscillatory Networks. Springer Science & Business Media; 2007. [DOI] [Google Scholar]
  44. Palva JM, Palva S, Kaila K. Phase synchrony among neuronal oscillations in the human cortex. Journal of Neuroscience. 2005;25:3962–3972. doi: 10.1523/JNEUROSCI.4250-04.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Pereda E, Quiroga RQ, Bhattacharya J. Nonlinear multivariate analysis of neurophysiological signals. Progress in Neurobiology. 2005;77:1–37. doi: 10.1016/j.pneurobio.2005.10.003. [DOI] [PubMed] [Google Scholar]
  46. Rajji TK, Zomorrodi R, Barr MS, Blumberger DM, Mulsant BH, Daskalakis ZJ. Ordering information in working memory and modulation of gamma by theta oscillations in humans. Cerebral Cortex. 2016 doi: 10.1093/cercor/bhv326. [DOI] [PubMed] [Google Scholar]
  47. Sauseng P, Klimesch W, Gruber WR, Birbaumer N. Cross-frequency phase synchronization: a brain mechanism of memory matching and attention. NeuroImage. 2008;40:308–317. doi: 10.1016/j.neuroimage.2007.11.032. [DOI] [PubMed] [Google Scholar]
  48. Sauseng P, Klimesch W, Heise KF, Gruber WR, Holz E, Karim AA, Glennon M, Gerloff C, Birbaumer N, Hummel FC. Brain oscillatory substrates of visual short-term memory capacity. Current Biology. 2009;19:1846–1852. doi: 10.1016/j.cub.2009.08.062. [DOI] [PubMed] [Google Scholar]
  49. Schack B, Weiss S. Quantification of phase synchronization phenomena and their importance for verbal memory processes. Biological Cybernetics. 2005;92:275–287. doi: 10.1007/s00422-005-0555-1. [DOI] [PubMed] [Google Scholar]
  50. Scheffer-Teixeira R, Belchior H, Caixeta FV, Souza BC, Ribeiro S, Tort AB. Theta phase modulates multiple layer-specific oscillations in the CA1 region. Cerebral Cortex. 2012;22:2404–2414. doi: 10.1093/cercor/bhr319. [DOI] [PubMed] [Google Scholar]
  51. Scheffer-Teixeira R, Belchior H, Leão RN, Ribeiro S, Tort AB. On high-frequency field oscillations (>100 Hz) and the spectral leakage of spiking activity. Journal of Neuroscience. 2013;33:1535–1539. doi: 10.1523/JNEUROSCI.4217-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Schomburg EW, Fernández-Ruiz A, Mizuseki K, Berényi A, Anastassiou CA, Koch C, Buzsáki G. Theta phase segregation of input-specific gamma patterns in entorhinal-hippocampal networks. Neuron. 2014;84:470–485. doi: 10.1016/j.neuron.2014.08.051. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Sheremet A, Burke SN, Maurer AP. Movement enhances the nonlinearity of hippocampal theta. Journal of Neuroscience. 2016;36:4218–4230. doi: 10.1523/JNEUROSCI.3564-15.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Stujenske JM, Likhtik E, Topiwala MA, Gordon JA. Fear and safety engage competing patterns of theta-gamma coupling in the basolateral amygdala. Neuron. 2014;83:919–933. doi: 10.1016/j.neuron.2014.07.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Tass P, Rosenblum MG, Weule J, Kurths J, Pikovsky A, Volkmann J, Schnitzler A, Freund HJ. Detection of N:m phase locking from noisy data: application to magnetoencephalography. Physical Review Letters. 1998;81:3291–3294. doi: 10.1103/physrevlett.81.3291. [DOI] [Google Scholar]
  56. Tass PA, Fieseler T, Dammers J, Dolan K, Morosan P, Majtanik M, Boers F, Muren A, Zilles K, Fink GR. Synchronization tomography: a method for three-dimensional localization of phase synchronized neuronal populations in the human brain using magnetoencephalography. Physical Review Letters. 2003;90:088101. doi: 10.1103/PhysRevLett.90.088101. [DOI] [PubMed] [Google Scholar]
  57. Tort AB, Rotstein HG, Dugladze T, Gloveli T, Kopell NJ. On the formation of gamma-coherent cell assemblies by oriens lacunosum-moleculare interneurons in the hippocampus. PNAS. 2007;104:13490–13495. doi: 10.1073/pnas.0705708104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Tort AB, Kramer MA, Thorn C, Gibson DJ, Kubota Y, Graybiel AM, Kopell NJ. Dynamic cross-frequency couplings of local field potential oscillations in rat striatum and hippocampus during performance of a T-maze task. PNAS. 2008;105:20517–20522. doi: 10.1073/pnas.0810524105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Tort AB, Komorowski R, Eichenbaum H, Kopell N. Measuring phase-amplitude coupling between neuronal oscillations of different frequencies. Journal of Neurophysiology. 2010;104:1195–1210. doi: 10.1152/jn.00106.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Tort AB, Scheffer-Teixeira R, Souza BC, Draguhn A, Brankačk J. Theta-associated high-frequency oscillations (110-160Hz) in the hippocampus and neocortex. Progress in Neurobiology. 2013;100:1–14. doi: 10.1016/j.pneurobio.2012.09.002. [DOI] [PubMed] [Google Scholar]
  61. Varela F, Lachaux JP, Rodriguez E, Martinerie J. The brainweb: phase synchronization and large-scale integration. Nature reviews. Neuroscience. 2001;2:229–239. doi: 10.1038/35067550. [DOI] [PubMed] [Google Scholar]
  62. Vinck M, van Wingerden M, Womelsdorf T, Fries P, Pennartz CM. The pairwise phase consistency: a bias-free measure of rhythmic neuronal synchronization. NeuroImage. 2010;51:112–122. doi: 10.1016/j.neuroimage.2010.01.073. [DOI] [PubMed] [Google Scholar]
  63. Xu X, Zheng C, Zhang T. Reduction in LFP cross-frequency coupling between theta and gamma rhythms associated with impaired STP and LTP in a rat model of brain ischemia. Frontiers in Computational Neuroscience. 2013;7:27. doi: 10.3389/fncom.2013.00027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Xu X, Liu C, Li Z, Zhang T. Effects of hydrogen sulfide on modulation of theta-gamma coupling in hippocampus in vascular dementia rats. Brain Topography. 2015;28:879–894. doi: 10.1007/s10548-015-0430-x. [DOI] [PubMed] [Google Scholar]
  65. Zheng C, Zhang T. Alteration of phase-phase coupling between theta and gamma rhythms in a depression-model of rats. Cognitive Neurodynamics. 2013;7:167–172. doi: 10.1007/s11571-012-9225-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Zheng C, Bieri KW, Hsiao YT, Colgin LL. Spatial sequence coding differs during slow and fast gamma rhythms in the hippocampus. Neuron. 2016;89:398–408. doi: 10.1016/j.neuron.2015.12.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
eLife. 2016 Dec 7;5:e20515. doi: 10.7554/eLife.20515.036

Decision letter

Editor: Frances K Skinner1

In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.

[Editors’ note: a previous version of this study was rejected after peer review, but the authors submitted for reconsideration. The first decision letter after peer review is shown below.]

Thank you for submitting your work entitled "Lack of evidence for cross-frequency phase-phase coupling between theta and gamma oscillations in the hippocampus" for consideration by eLife. Your article has been favorably evaluated by Timothy Behrens (Senior Editor) and four reviewers, one of whom is a member of our Board of Reviewing Editors.

Our decision has been reached after consultation between the reviewers. Based on these discussions and the individual reviews, we regret to inform you that your work will not be considered further for publication in eLife at this time. Below we provide detailed feedback for your consideration if you choose to re-submit, and we encourage this possibility.

While all of the reviewers felt that this was an important and interesting paper, they also thought that it was presented in a confusing manner, was limited, and could lead to confusion rather than clarification for the field. Given the contrarian nature of the manuscript as presented, this would not be helpful. The reviewers' overall comments are provided here:

1) The paper presentation should be changed to be less confrontational and completely clear on what is being said and done. A well-crafted manuscript with clarity and sufficient explanations is lacking in the present submission.

A) Specifically, a more detailed review of the literature, a more careful presentation and discussion of the simulation results, and a more careful comparison with the procedures utilized in [Belluscio et al. 2012] is needed.

B) We note that phase-coupling is well defined theoretically from the tools of dynamical systems, but what is not clear is a selective measure of cross-frequency phase coupling. Defining an improved phase-phase coupling measure that detects true coupling and ignores artifactual coupling might be possible. Such a measure – even if it's not the optimal measure – might serve as a "patch" to existing approaches.

C) Finding the optimal phase-phase coupling measure (and assessing its statistical properties) would be a challenge. That is, a consistent and operational way to define how cross-frequency phase coupling can be measured (such that white noise or asymmetrical oscillation would not qualify). Clearly stating the lack of a clear measure as an open problem formally would be of value. In essence, the manuscript would need to make these aspects clear (i.e., present limitations of their work and others, possible fixes/challenges associated with having phase-phase coupling measures), and in this way can identify a methodological issue that's driving incorrect conclusions in the literature, and so be of service to the field.

2) Given that a clear measure of cross-frequency phase-coupling does not exist, a change of title should be considered.

3) A repository (of data and algorithms) should complement the work, and would be beneficial for the community moving forth as analyses, clear understanding and interpretation of artificial and biological data would be available.

[Editors’ note: what now follows is the decision letter after the authors submitted for further consideration.]

Thank you for submitting your article "On cross-frequency phase-phase coupling between theta and gamma oscillations in the hippocampus" for consideration by eLife. Your article has been favorably evaluated by Timothy Behrens (Senior Editor) and four reviewers, one of whom is a member of our Board of Reviewing Editors.

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

In this resubmitted paper on phase-phase coupling, all of the reviewers thought that several concerns had been addressed and suggestions implemented (such as the title change). The reviewers agreed that this is an important article that highlights a methodological issue impacting our understanding of the brain's activity and function. The authors are commended for sharing their analysis methods (on GitHub) and data.

The authors address three points in their paper: a statistical issue (using appropriates surrogate to detect n:m coupling), a conceptual issue (whether n:m coupling can be dissociated from asymmetrical oscillations), and an experimental one (whether n:m coupling is present in hippocampus). The first and last points are well made. However, this is not the case for the second, and other aspects remain unclear as presented. The authors are encouraged to revise and edit their paper to clarify all of the following issues.

1) A clear distinction between true phase versus estimated phase needs to be made as it is confusing as presented. Specifically:

A) As the authors' state, the theoretical quantity of n:m phase locking is well-defined. However, the estimated quantity of n:m phase locking as deduced from noisy neural data is fraught with difficulty. The authors show here that simply applying the theoretical n:m phase locking equation to data produces estimates that – without appropriate statistical tests – lead to spurious results. This is an important conclusion. Future work might seek to improve or correct (somehow) the estimation of the theoretical quantity, or propose a new theoretical quantity that is more easily estimated.

B) The point in the Discussion (subsection “Statistical inference of phase-phase coupling”, last paragraph) that true n:m coupling can be disentangled from asymmetrical oscillation by visual inspection of the LFP or EEG trace, precisely because they will look very much alike does not seem appropriate. This distinction may be hard to make at the macroscopic level (LFP/EEG) and could rather be searched for in how this signal is generated from the activity of distinct neural subpopulations. If the same gamma oscillations that are shown to phase-lock to theta oscillations can be dissociated neurally from theta oscillations (and indeed the authors did a tremendous job in previous publications at showing that hippocampal theta and gamma rely on distinct interconnected networks), then the evidence is rather of favor of genuine n:m locking. In the converse case, if no population selectively engaged in the faster oscillation can be identified, I would say that the asymmetrical oscillation is the most plausible explanation.

2) More detail of why the stripes in phase-phase plot can be produced by asymmetry of the theta waves needs to be provided.

It is not clear how the authors can conclude for the dataset at hand that stripes in phase-phase plot are due to the asymmetry of the theta waves and not to genuine gamma activity (Results, eighth paragraph). The authors seem to somehow tie this possible caveat to the stripes in phase-phase plots. However, stripes are just a visual inspection for maintained relationship between the two phases, just as (properly controlled) Rnm should measure.

3) The discussion about the caveat of asymmetrical oscillations is unsatisfying for the following reasons:

A) This point is made in the middle of the analysis of experimental data. Since this has nothing to do with the data at hand, in which no evidence for phase coupling was found, this obscures the message. A separate section should be devoted to the caveat of the asymmetrical oscillations, possibly before the analysis of experimental data.

B) The point should be clarified, by not only focussing on the presence of stripes for asymmetrical oscillations, but by explaining conceptually why this dissociation emerges. Possibly it could be illustrated by showing how an asymmetrical wave resembles the sum of multiples sinusoids at the fundamental and harmonics frequencies n:m locked to each other (and possibly with also some phase-amplitude coupling, see Kramer et al.).

4) Any differences between the measure of the authors and that of Belluscio's needs to be made clear. As specified by one of the reviewers:

It is not quite clear whether the methods used are exactly the same. In Belluscio et al., I think the counts were performed first for each surrogate (corresponding to a specific time-shift), and then the distribution of counts over the distinct time-shift was computed for each bin (i.e. Single Run analysis, which should be the correct method). By contrast, it seems that here – not quite clear in the text – surrogates for distinct time shifts were merged before counts were done in Figure 5 and Figure 4—figure supplement 1 (i.e. Pooled analysis, which of course averages the count and creates many false positives). [Note that I use Single Run vs. Pooled terminology to refer to whether the metrics was computed for each surrogate independently (Single Run) or for merged data, the metrics applying yo either Rnm or counts.] I hope that I am being wrong here. Otherwise that would seriously limit the conclusions of the author about invalidating Belluscio's findings.

Note that there is still a statistical problem with the Single Run analysis of phase-phase counts, which relates to the absence of a correction for the number of tested bins (either for a given theta phase or across all theta phases). In any case, the p-value in Belluscio et al. reaches very low value (some p<10^-10), which would probably resist proper corrections. If this is the case, that would provide statistically sound evidence for n:m coupling (asymmetrical theta being still a possible confound). Do the authors observe such low values in their own dataset? Could they remove statistical significance in the stripes in white noise using an appropriate correction? Or does this deceiving statistical significance come from yet another explanation?

[Editors' note: further revisions were requested prior to acceptance, as described below.]

Thank you for resubmitting your work entitled "On cross-frequency phase-phase coupling between theta and gamma oscillations in the hippocampus" for further consideration at eLife. Your revised article has been favorably evaluated by Timothy Behrens (Senior editor), a Reviewing editor, and three reviewers.

The manuscript has been improved but there are remaining issues that need to be addressed. All of the reviewers appreciated the authors' revisions and thought that this work could serve as a useful cautionary tale for neuroscientists as well as a useful starting point for continuing work. Even though it was felt that the results were not completely satisfying, it was also felt that it would be of great benefit in preventing researchers from wandering down the wrong analysis path. It was further noted that if this paper were presented as a statistics paper it could be improved more but then it would probably be less read and absorbed by the neuroscience community for some time.

An overall suggestion is that the authors should be more cautious in their interpretation and clearer about there being room for further progress in editing their manuscript.

Specific issues to address are:

1) The Abstract would benefit from significant revisions considering the various changes already done, and ones to be done. Sentences that should be targeted are: "filtered white noise has similar n:m phase-locking levels as actual data", and "the diagonal stripes in theta-gamma phase-phase histograms of actual data can be explained by theta harmonics".

2) Validity of Belluscio's analysis – overall conclusion:

A) In the rebuttal, the authors consider that the analysis by Belluscio is intrinsically flawed rather than being simply not well controlled statistically. I tend to defend the alternative option (clearly here I do not refer to the analysis of Mean Phase-Phase Plot, which the authors have convincingly showed that is flawed, but to the tests on phase counts; I also want to reassure the authors that I really do not have any personal motivation to go one way or the other). My intuition is that the presence of one single significant count in the phase-phase plot, if appropriately controlled for multiple comparisons, would provide a valid statistical measure. In essence it would not simply detect the presence of stripes (which surrogate run also feature) but measure whether their amplitude is larger than those of surrogates. This could be shown in a quite straightforward way by looking whether significant points in phase-phase plots obtained from white noise persist when a correction for multiple comparisons is applied. The authors seem to agree that they would not. (As for the type of correction, the Bonferroni method that the authors refer to looks too conservative as the bin counts clearly are non-independent; less stringent correction such as FDR or Holm-Bonferroni may be preferred). A count is not a metric for n:m coupling for sure, but it can inform of the particular concentration of the high frequency phase at one specific phase of the high frequency phase. More importantly, what matters here is not a metric of the coupling strength, but a reliable statistical test that selectively detects coupling, and my intuition is that counts in the phase-phase plot may provide one. If a simple correction can be applied to give a sound statistical test, this could allow Belluscio and colleagues to look back at their data and see whether the significant counts indeed resist correction for multiple comparisons.

B) About the very low p-values in Belluscio's data, the authors suggest that "it is possible that, by analyzing a longer epoch length, the influence of theta harmonics becomes more apparent and would lead to lower p-values, while the effect of the filtering-induced sinusoidality is washed out for both actual and surrogate epochs (of the same length)."

Well the manuscript previously demonstrates that n:m coupling measures as well as phase-phase plots cannot tear apart asymmetrical waves from true cross-frequency coupling. Thus, if indeed p-values remain lower than threshold when controlled appropriately, it could equally be due to asymmetrical theta or true theta-gamma phase coupling, but the latter could not be dismissed.

3) The reason for stripes in the phase-phase plot of hippocampal data:

A) In the manuscript authors state that "the diagonal stripes in phase-phase plots are due to theta harmonics and not to genuine gamma activity." If it were true harmonics, that would imply a consistent phase relationship between theta and gamma over sustained periods (not just over small periods as for white noise), i.e. would test positive for n:m coupling. So in my opinion here the effect is rather due to the temporary n:m alignment of phases, just as for white noise. In other words, stripes emerge also when analyzing white noise despite there being no harmonics in the signal.

B) In the rebuttal, the authors defend that "Believing in two different and genuine gamma activities – one coupled at 5 cycles per theta, the other at 4 cycles per theta – would go against the parsimonious principle." (this is when theta frequency evolves). However, as established by theoretical studies of coupled oscillators, n:m coupling is not a fixed property of the network but emerges as a combination of oscillator intrinsic dynamics and the characteristics of the connectivity pattern. See for example Arnold tongue: if we assume there is just one fixed gamma, a fluctuating theta and fixed connectivity, it is perfectly normal that n:m coupling will shift from 1:5 to 1:4 if the lower oscillator accelerates and the ratio of frequency goes from around 5 to around 4.

4) Asymmetrical theta vs. phase-coupled theta-gamma in general

I am coming back to the authors' comment on this in the rebuttal, although this is no longer present in the manuscript. This is a comment for the authors benefit and speaks to the overall comment mentioned above. Sharp edges in LFP/EEG are not by itself an indication that we are measuring a single asymmetrical oscillation as the superposition of a slow and a fast n:m coupled oscillation can also give rise to sharp edges (Figure 4C; note that this can even be obtained with just two oscillations). Thus, sharp edges is no more a selective feature of asymmetrical oscillations than n:m coherence is selective of phase-coupled oscillators. In other words, visual inspection cannot tell us more than statistics.

5) It looks like "Random Perm" is more powerful test than "Time Shift", as mentioned in the first paragraph of the subsection “Lack of evidence for n:m phase-locking in actual LFPs”. If this is the case then it could be stated as a conclusion of the work that "Random perm" should be preferred over "Time Shift" (and of course of the "Scrambling" procedure), as it is less likely to miss existing effects (lower False Rejections rate).

6) Conclusion: the very new paper by Lozano-Soldevilla and colleagues (Frontiers Comp Neuro) provides another example of spurious cross-frequency coupling measures due to asymmetrical oscillations, could be worth referencing.

eLife. 2016 Dec 7;5:e20515. doi: 10.7554/eLife.20515.037

Author response


[Editors’ note: the author responses to the first round of peer review follow.]

While all of the reviewers felt that this was an important and interesting paper, they also thought that it was presented in a confusing manner, was limited, and could lead to confusion rather than clarification for the field. Given the contrarian nature of the manuscript as presented, this would not be helpful. The reviewers' overall comments are provided here:

1) The paper presentation should be changed to be less confrontational and completely clear on what is being said and done. A well-crafted manuscript with clarity and sufficient explanations is lacking in the present submission.

We have made several modifications in our manuscript to let it less confrontational, including a change in the title. We have also edited our Results section to clarify points raised by reviewer 3.

A) Specifically, a more detailed review of the literature, a more careful presentation and discussion of the simulation results, and a more careful comparison with the procedures utilized in [Belluscio et al. 2012] is needed.

We have included new references mentioned by the reviewers, and performed new analyses and simulations to address important comments by reviewer 3; this led to the elaboration of new figures and text. To further conform to the reviewer’s comments, we have deleted former Figure 1 and related text, and restructured the way we present and discuss our results. Finally, we now provide p- value maps to allow straight comparison with the procedure performed in Belluscio et al. (2012).

B) We note that phase-coupling is well defined theoretically from the tools of dynamical systems, but what is not clear is a selective measure of cross-frequency phase coupling. Defining an improved phase-phase coupling measure that detects true coupling and ignores artifactual coupling might be possible. Such a measure – even if it's not the optimal measure – might serve as a "patch" to existing approaches.

C) Finding the optimal phase-phase coupling measure (and assessing its statistical properties) would be a challenge. That is, a consistent and operational way to define how cross-frequency phase coupling can be measured (such that white noise or asymmetrical oscillation would not qualify). Clearly stating the lack of a clear measure as an open problem formally would be of value. In essence, the manuscript would need to make these aspects clear (i.e., present limitations of their work and others, possible fixes/challenges associated with having phase-phase coupling measures), and in this way can identify a methodological issue that's driving incorrect conclusions in the literature, and so be of service to the field.

We will answer to points B and C together:

The definition of cross-frequency phase coupling follows the exact same rationale as the definition of phase-coupling, and the n:m phase-coupling metric is the natural expansion of the 1:1 phase- coupling metric. We believe both metrics are well defined. The current concept of n:m phase-locking reflected in the metric’s definition (i.e., the concentration of the phase difference distribution) is used not only by experimentalists but also by theoretical groups. Please note that we did not create the n:m phase-locking metric in this work but studied the exact same metric in current widespread use in the literature, which led influential conclusions about how the brain might work. In our paper, we identify the lack of proper control/surrogate analyses as the methodological issue driving incorrect conclusions, which should prompt other groups to revisittheir findings. We believe these results are of enough importance to many neuroscientists working with brain rhythms and their interactions (e.g., Schack et al., 2002; Schack et al., 2005; Schack and Weiss, 2005; Palva et al., 2005; Holz et al., 2010; Sauseng et al., 2008; Sauseng et al., 2009; Zheng et al., 2013; Xu et al., 2013; Stujenske et al., 2014; Xu et al., 2015; Aru et al., 2015; Hyafill et al., 2015; Chaieb et al., 2015; Zheng et al., 2016, among many others).

The points above seem to implicitly assume that n:m phase-phase coupling would exist in the brain but the current metric is not able to detect it. While we have difficulties in imagining how this would exactly happen (since the metric and the definition of n:m phase coupling are intrinsically related), we do not disagree with such possibility and have edited our text to discuss it. In addition, we performed new simulations to show that cases of significant coupling may reflect not only true coupling but also artifactual coupling. We tried but were unable to devise a way to separate these cases; in the revised version, we have expanded our Results and Discussion sections to comment on these limitations.

But please note that our results point to lack of statistically significant coupling in actual LFPs upon proper surrogate procedures, and therefore such issues do not interfere with the main conclusion of our paper.

2) Given that a clear measure of cross-frequency phase-coupling does not exist, a change of title should be considered.

We have changed our title to “On cross-frequency phase-phase coupling between theta and gamma oscillations in the hippocampus”. But please note that above and in our answers below we defend that there exists a current, well-defined measure of n:m phase-locking, and that the lack of evidence for n:m phase-coupling reported in our work may not be due to a “fault” of this metric but simply to lack of existence of such effect.

3) A repository (of data and algorithms) should complement the work, and would be beneficial for the community moving forth as analyses, clear understanding and interpretation of artificial and biological data would be available.

We have made our codes available at https://github.com/tortlab/phase_phase. In addition, we also made the analyzed data available at Dryad (http://datadryad.org/). If the manuscript is accepted for publication, the dataset will have the doi: 10.5061/dryad.12t21.

[Editors' note: the author responses to the re-review follow.]

In this resubmitted paper on phase-phase coupling, all of the reviewers thought that several concerns had been addressed and suggestions implemented (such as the title change). The reviewers agreed that this is an important article that highlights a methodological issue impacting our understanding of the brain's activity and function. The authors are commended for sharing their analysis methods (on GitHub) and data.

The authors address three points in their paper: a statistical issue (using appropriates surrogate to detect n:m coupling), a conceptual issue (whether n:m coupling can be dissociated from asymmetrical oscillations), and an experimental one (whether n:m coupling is present in hippocampus). The first and last points are well made. However, this is not the case for the second, and other aspects remain unclear as presented. The authors are encouraged to revise and edit their paper to clarify all of the following issues.

1) A clear distinction between true phase versus estimated phase needs to be made as it is confusing as presented. Specifically:

A) As the authors' state, the theoretical quantity of n:m phase locking is well-defined. However, the estimated quantity of n:m phase locking as deduced from noisy neural data is fraught with difficulty. The authors show here that simply applying the theoretical n:m phase locking equation to data produces estimates that – without appropriate statistical tests – lead to spurious results. This is an important conclusion. Future work might seek to improve or correct (somehow) the estimation of the theoretical quantity, or propose a new theoretical quantity that is more easily estimated.

We understand the reviewer’s point: for any given signal the n:m phase-locking metric will provide an estimated value irrespective of the existence of true phase-phase coupling or not; the former can only be inferred when comparing the estimated value with a chance/surrogate distribution. But we note that this issue is not specific for n:m phase-locking estimates, as it also occurs for other metrics commonly used in Neuroscience. For instance, estimates of mutual information, coherence, spike-field coupling, phase-amplitude coupling, directionally measures – to mention a few – all suffer from short sample bias. In the re-revised manuscript, we now devote a paragraph to discuss such issue and highlight the difference between estimated and true phase-phase coupling (please see subsection “Statistical inference of phase-phase coupling”, second paragraph).

B) The point in the Discussion (subsection “Statistical inference of phase-phase coupling”, last paragraph) that true n:m coupling can be disentangled from asymmetrical oscillation by visual inspection of the LFP or EEG trace, precisely because they will look very much alike does not seem appropriate. This distinction may be hard to make at the macroscopic level (LFP/EEG) and could rather be searched for in how this signal is generated from the activity of distinct neural subpopulations. If the same gamma oscillations that are shown to phase-lock to theta oscillations can be dissociated neurally from theta oscillations (and indeed the authors did a tremendous job in previous publications at showing that hippocampal theta and gamma rely on distinct interconnected networks), then the evidence is rather of favor of genuine n:m locking. In the converse case, if no population selectively engaged in the faster oscillation can be identified, I would say that the asymmetrical oscillation is the most plausible explanation.

The passage of our Discussion mentioned by the reviewer reads, former version):

“To the best of our knowledge, there is currently no metric capable of automatically distinguishing true cross-frequency coupling from waveform-induced artifacts in collective signals such as LFP, EEG and MEG signals. Until one is developed, we believe the best practice is to judge statistically significant coupling levels on a case-by-case basis by visual inspection of raw signals.”

We meant that if theta and gamma oscillations genuinely n:m phase-couple, one should be able to observe this effect in the unfiltered LFP (i.e., one should see the actual gamma cycles coupled to theta upon visual inspection); on the other hand, if n:m coupling is spurious and due to an asymmetric theta wave, one would observe sharp deflections in the unfiltered LFP instead of genuine gamma cycles. We have previously discussed such “manual” solution in Kramer et al. (2008) for the cases of spurious phase-amplitude coupling. On page 356 of that paper, we wrote:

“To ameliorate the potential problem of spurious frequency comodulation, we recommend careful inspection of the unfiltered data to distinguish between sharp edges and true high frequency oscillations.” And later: “First, we recommend visual inspection of the unfiltered data at times corresponding to increases in the amplitude envelope of the high frequency activity. At these times, do the unfiltered data exhibit high frequency oscillations or sharp edges?”

But we acknowledge that a problem arises when the signal has both gamma oscillations and sharp deflections, in which case it is very difficult – if not impossible – to realize by visual inspection which effect is at play, and therefore we agree with the reviewer that the sentence may not be appropriate.

We further agree with the reviewer that understanding how the signal is generated by the activity of distinct neural subpopulations would be ideal to sort apart true from artifactual coupling. But this constitutes a huge problem in Neuroscience by itself: after all, what gives rise to LFP oscillations? After decades of research, we still debate about what generates theta and gamma at the circuitry and neuronal levels; we currently have models but not a complete understanding of oscillatory genesis; the available experimental data are not yet fully conclusive. Computer simulations – as the ones mentioned by the reviewer – are useful tools to generate insights into potential mechanisms, but they cannot be considered ultimate proofs. Thus, the gold standard solution referred to by the reviewer (of searching how the signal is generated by the activity of neural subpopulations) is unfortunately not a practical one but methodologically very challenging.

To address this issue, in the re-revised version we removed the sentence the reviewer did not find appropriate, and instead we now spell out the ideal suggestion put forward by the reviewer (subsection “Statistical inference of phase-phase coupling”, last paragraph).

2) More detail of why the stripes in phase-phase plot can be produced by asymmetry of the theta waves needs to be provided.

It is not clear how the authors can conclude for the dataset at hand that stripes in phase-phase plot are due to the asymmetry of the theta waves and not to genuine gamma activity (Results, eighth paragraph). The authors seem to somehow tie this possible caveat to the stripes in phase-phase plots. However, stripes are just a visual inspection for maintained relationship between the two phases, just as (properly controlled) Rnm should measure.

We agree with the reviewer that stripes in phase-phase plots are only a visual manifestation of a maintained phase relationship, and in essence the stripes reflect what Rn:m measures. The stripes may be due to (1) theta harmonics (i.e., theta asymmetry), due to (2) genuinely coupled gamma activity, or even due to (3) the sinusoidality imposed by the filter. Similarly, all these 3 effects can lead to a bump in the Rn:m curve (see Figure 3 for genuine coupling, Figure 4 for theta asymmetry, and Figures 2 and Figure 2—figure supplement 1 for the filtering-imposed sinusoidality in white noise).

Therefore, the reviewer is right in that it is not possible to differentiate genuinely coupled gamma from theta harmonics (or filtering effects) solely based on visual inspection of phase-phase plots, and the same is also true for the visual inspection of a bump in the Rn:m curve. But please note that we did not mean to imply that the presence of stripes per se was a proof of theta harmonics and absence of genuine coupling. Rather, our conclusion of absence of genuine coupling stemmed from a conjunction of observations, along with the Occam's principle of parsimony:

1) As correctly pointed out by the reviewer, the Rn:m metric and the stripes are essentially related: the more prominent the stripes are in phase-phase plots, the higher the Rn:m. Therefore, were the stripes due to genuinely coupled gamma activity, they should be associated with Rn:m values different from chance, which was not the case (Figure 5 and its figure supplements).

2) As shown in Figure 7, the number of stripes perfectly relates to the order of the first theta harmonics falling within the filtered bandwidth. That is, instead of assuming the existence of multiple types of gamma activities coupled to theta, we deemed more parsimonious to attribute the different number of stripes shown in Figure 7 to different orders of the theta harmonics.

3) Please notice in Figure 8 that the filter bandwidth for gamma is the same (30-50 Hz). Yet, the phase-phase plot of the LFP in 8A has 5 stripes while the phase-phase plot of the LFP in 8B has 4 stripes. Instead of assuming that theta would couple to a genuine 1:5 gamma (i.e., 5 gamma cycles per theta cycle) and to a genuine 1:4 gamma (4 gamma cycles per theta cycle), we believe the stripes are straightforwardly explained by the fact that theta frequency in 8A example is 7.1 Hz while in 8B theta frequency is 8.4 Hz; therefore, it takes a factor of 5 and 4, respectively, to make these theta frequencies larger than the low cutoff frequency of the gamma filter (i.e., 7.1 Hz x 5 = 35.5 Hz > 30 Hz and 8.4 x 4 = 33.6 Hz > 30 Hz), which would explain why we see 5 and 4 stripes, respectively. Believing in two different and genuine gamma activities – one coupled at 5 cycles per theta, the other at 4 cycles per theta – would go against the parsimonious principle.

But while our observations argue against genuine gamma coupling, the distinction between the contribution of theta harmonics and of filtering-induced sinusoidality is trickier, and actually both effects may be at play. In brief, though, the effect of filtering-induced sinusoidality is short lived and would not account for the stripes seen in very long epochs such as the 20-min long signal analyzed in Figure 7.

In the re-revised manuscript, we elaborated new text to clarify these points (subsection “Statistical inference of phase-phase coupling”, fourth paragraph).

3) The discussion about the caveat of asymmetrical oscillations is unsatisfying for the following reasons:

A) This point is made in the middle of the analysis of experimental data. Since this has nothing to do with the data at hand, in which no evidence for phase coupling was found, this obscures the message. A separate section should be devoted to the caveat of the asymmetrical oscillations, possibly before the analysis of experimental data.

We thank the reviewer for the nice suggestion, which we have followed in the re-revised version. Namely, we now divide our Results section into subsections (in the former version we had a single text), and devote one subsection – before we present the experimental results – to show the caveat of asymmetrical/non-sinusoidal oscillations. This has led to major changes throughout the manuscript, such as the elaboration of a new figure and associated text (see below), and re-ordering of previous figures and text. For convenience, we submitted as “related manuscript file” a PDF version of our manuscript with all changes highlighted.

B) The point should be clarified, by not only focussing on the presence of stripes for asymmetrical oscillations, but by explaining conceptually why this dissociation emerges. Possibly it could be illustrated by showing how an asymmetrical wave resembles the sum of multiples sinusoids at the fundamental and harmonics frequencies n:m locked to each other (and possibly with also some phase-amplitude coupling, see Kramer et al.).

To address this point, we have elaborated a new figure in which we illustrate that the Fourier decomposition of a non-sinusoidal wave is characterized by the sum of multiple sinusoids at harmonic frequencies that are n:m phase-locked to each other; please see new Figure 4 and new subsection of the Results section (c.f. our answer above). We mention that an asymmetric wave shape may also lead to spurious phase-amplitude coupling in the first paragraph of the subsection “Spurious n:m phase-locking due to non-sinusoidal waveforms” and in the last paragraph of the subsection “Statistical inference of phase-phase coupling”, and explicitly show this effect in new Figure 4—figure supplement 1.

4) Any differences between the measure of the authors and that of Belluscio's needs to be made clear. As specified by one of the reviewers:

It is not quite clear whether the methods used are exactly the same. In Belluscio et al., I think the counts were performed first for each surrogate (corresponding to a specific time-shift), and then the distribution of counts over the distinct time-shift was computed for each bin (i.e. Single Run analysis, which should be the correct method). By contrast, it seems that here – not quite clear in the text – surrogates for distinct time shifts were merged before counts were done in Figure 5 and Figure 4—figure supplement 1 (i.e. Pooled analysis, which of course averages the count and creates many false positives). [Note that I use Single Run vs. Pooled terminology to refer to whether the metrics was computed for each surrogate independently (Single Run) or for merged data, the metrics applying yo either Rnm or counts.] I hope that I am being wrong here. Otherwise that would seriously limit the conclusions of the author about invalidating Belluscio's findings.

The statistical analysis of the phase-phase plots was done exactly as described in Belluscio et al. and correctly summarized by the reviewer. Namely, for each phase-phase bin, each single surrogate run contributed with one count (please note that we did not merge single surrogates before counting). Then, for each phase-phase bin we constructed a distribution of counts, and, based on the mean and standard deviation of this distribution, we inferred the statistical significance of the actual count for that bin in the phase-phase plot.

In the re-revised version, we have edited the legend and panel labels of Figure 7, Figure 7—figure supplement 1, Figure 8, Figure 8—figure supplement 1 (current numeration) and subsection “Lack of evidence for n:m phase-locking in actual LFPs”, second paragraph and subsection “Statistical inference of phase-phase coupling”, third paragraph to let it clearer that the mean and SD are computed over individual bin counts, and not over pooled counts.

Importantly, please note that we do not consider the framework employed in Belluscio et al. as a Single Run analysis. We reserve the term “Single Run” to denote an analysis in which each single surrogate run generates a single measure of n:m phase-locking. In this sense, we don’t see a single histogram count as a metric of n:m phase-locking, in the same way that we don’t see a single vector of phase difference (eiφnm(t)) as a metric of n:m phase-locking, simply because neither a single histogram count nor a single phase difference vector measures the level of n:m phase-locking between the time series. Rather, for each single surrogate run, a metric of n:m phase-locking is obtained by computing the length of the mean vector over all phase difference vectors (Rn:m). Therefore, sticking to this analogy, the counts in phase-phase plots would correspond to the phase difference vectors used to compute the Rn:m, but not to the Rn:m metric itself. Again, a count is not an n:m phase-locking metric. In the case of the phase-phase plot, a Single Run surrogate would be an entire phase-phase plot constructed from a single surrogate (i.e., time-shifted) time series, because it is at this level that we infer the existence of n:m phase-locking – and not at the level of a single bin count. In other words, Belluscio et al. inferred the existence of n:m phase-locking by the visual inspection of stripes. And, as shown in Figure 8—figure supplement 1, phase-phase plots from single surrogate runs do exhibit stripes similar to the original phase-phase plot. This relates to the fact that single surrogate Rn:m values are similar to original Rn:m values, that is, there is no difference between actual and surrogate data at the level of an n:m phase-locking metric, which justifies our conclusions.

In the re-revised version, we substantially edited a previous Discussion paragraph to clarify these points (please see subsection “Statistical inference of phase-phase coupling”, third paragraph).

Supplementary remarks: In the right panel of Figure 6A, Belluscio et al. show the mean phase-phase plot over all surrogate runs. In our paper we note that plotting the mean number of counts across all surrogates is qualitatively identical to plotting the pool of counts over all surrogate runs, up to a scaling factor, as shown in Author response image 1.

Author response image 1.

Author response image 1.

DOI: http://dx.doi.org/10.7554/eLife.20515.031

Clearly, the scaling factor is the number of surrogates (n=1000). The equivalence above motivated us to state that the procedure in Belluscio et al. is akin to what we call as a pooled surrogate analysis: there is no visual inspection of phase-phase plots for single surrogate runs but only the inspection of their average, which is equivalent to the visual inspection of their pool (of note, this improper visual analysis was also performed in Zheng et al. 2016). At any event, we stress that there is no proper Single Run surrogate analysis performed at the level of an n:m phase-locking metric such as the Rn:m in Belluscio et al.

Note that there is still a statistical problem with the Single Run analysis of phase-phase counts, which relates to the absence of a correction for the number of tested bins (either for a given theta phase or across all theta phases). In any case, the p-value in Belluscio et al. reaches very low value (some p<10^-10), which would probably resist proper corrections. If this is the case, that would provide statistically sound evidence for n:m coupling (asymmetrical theta being still a possible confound). Do the authors observe such low values in their own dataset? Could they remove statistical significance in the stripes in white noise using an appropriate correction? Or does this deceiving statistical significance come from yet another explanation?

Indeed, in most phase-phase bins the counts would not survive a Bonferroni correction. (Since we used 120x120 phase-phase bins, a correction would bring the significance threshold down to 10-6; we don’t know how many phase-phase bins Belluscio et al. employed and whether their counts would survive a Bonferroni correction). But please notice that this is actually one more argument against the existence of phase-phase coupling. Forgetting for the moment the issues with this framework mentioned above, were the described effect robust, we should have been able to replicate it.

We suspect the p-values in Belluscio et al. are lower than ours due to differences in epoch length; they stated they analyzed 11 sessions in three rats, but the total analyzed length is not informed. Intuitively, we believe it is possible that, by analyzing a longer epoch length, the influence of theta harmonics becomes more apparent and would lead to lower p-values, while the effect of the filtering-induced sinusoidality is washed out for both actual and surrogate epochs (of the same length).

As for this statement: “If this is the case, that would provide statistically sound evidence for n:m coupling (asymmetrical theta being still a possible confound).”

As reviewers ourselves, we appreciate the voluntary and time-consuming work of the reviewer, and thank him/her for the relevant suggestions that helped us improving our paper. But while we respect the reviewer’s opinion, we feel compelled to disagree with this particular statement. Based on arguments provided above, we do not think that a proper statistical procedure was performed in Belluscio et al. After all, what is the n:m phase-locking metric being measured in Belluscio et al. framework? A single phase-phase bin count is not a metric, it does not inform how coupled the time series are, and even coupled oscillators have non-significant bin counts. Please note that Belluscio et al. state “The diagonal stripes in the phase–phase plots indicate a statistically reliable relationship between the respective phases of theta and gamma oscillations during both RUN and REM”.Thus, the “metric” in Belluscio et al. is in essence the visual inspection of stripes. But single run surrogates also exhibit stripes (Figure 8—figure supplement 1), in the same way that single run surrogates also exhibit a bump in the Rn:m curve. The stripes are trivially averaged out when one computes the mean over time-shifted phase-phase plots, which relates to a pooled analysis (c.f. Author response image 1); it is not too surprising that actual counts of some phase-phase bins are deemed statistically significant under this framework. Please note that a single surrogate phase-phase plot – which has stripes – would also be deemed statistically significant if one were to apply this very same framework. Therefore, we do not consider this framework a proper one. Instead, Belluscio et al. should have inferred the statistical significance of coupling at the Rn:m level, which is an actual metric of n:m phase-locking.

In the re-revised version, we have substantially edited a previous Discussion paragraph to explain why an histogram count would not constitute an n:m phase-locking metric, and why we do not consider the analysis framework in Belluscio et al. a proper one. Please see subsection “Statistical inference of phase-phase coupling”, third paragraph.

[Editors' note: further revisions were requested prior to acceptance, as described below.]

[…] An overall suggestion is that the authors should be more cautious in their interpretation and clearer about there being room for further progress in editing their manuscript.

Specific issues to address are:

1) The Abstract would benefit from significant revisions considering the various changes already done, and ones to be done. Sentences that should be targeted are: "filtered white noise has similar n:m phase-locking levels as actual data", and "the diagonal stripes in theta-gamma phase-phase histograms of actual datacan be explained by theta harmonics".

We thank the reviewer for calling attention to this issue. In the revised version we have edited the Abstract to reflect changes done in the previous and current version. The two mentioned sentences no longer appear in the revised version.

2) Validity of Belluscio's analysis – overall conclusion:

A) In the rebuttal, the authors consider that the analysis by Belluscio is intrinsically flawed rather than being simply not well controlled statistically. I tend to defend the alternative option (clearly here I do not refer to the analysis of Mean Phase-Phase Plot, which the authors have convincingly showed that is flawed, but to the tests on phase counts; I also want to reassure the authors that I really do not have any personal motivation to go one way or the other). My intuition is that the presence of one single significant count in the phase-phase plot, if appropriately controlled for multiple comparisons, would provide a valid statistical measure. In essence it would not simply detect the presence of stripes (which surrogate run also feature) but measure whether their amplitude is larger than those of surrogates. This could be shown in a quite straightforward way by looking whether significant points in phase-phase plots obtained from white noise persist when a correction for multiple comparisons is applied. The authors seem to agree that they would not. (As for the type of correction, the Bonferroni method that the authors refer to looks too conservative as the bin counts clearly are non-independent; less stringent correction such as FDR or Holm-Bonferroni may be preferred). A count is not a metric for n:m coupling for sure, but it can inform of the particular concentration of the high frequency phase at one specific phase of the high frequency phase. More importantly, what matters here is not a metric of the coupling strength, but a reliable statistical test that selectively detects coupling, and my intuition is that counts in the phase-phase plot may provide one. If a simple correction can be applied to give a sound statistical test, this could allow Belluscio and colleagues to look back at their data and see whether the significant counts indeed resist correction for multiple comparisons.

Indeed, we tended not to consider Belluscio et al. analysis a proper one; despite a bin count not being a metric of n:m coupling strength (c.f. our previous answers and acknowledged by the reviewer), we predicted difficulties in interpreting significant bin counts. For instance, a phase-phase plot of 120 x 120 bins (i.e., 3o bins) has 14400 bin counts. If a single bin count out of these 14400 bins is deemed statistically significant (after an appropriate correction), should we consider the time series n:m phase-coupled? We particularly did not consider that having only one bin deemed statistically significant would suffice. But then, what would be the minimal number of significant bins for assuming n:m phase-coupling? And would the appearance of striped patterns be necessary? Or would a few significant bins scattered at random locations suffice? Again, especially considering that there is a well-defined metric of n:m phase-coupling (Rn:m), we had particular difficulty in considering the bin count analysis a proper one. That said, though, we do respect the opposite opinion manifested by the reviewer, and have followed the suggestion of subjecting the p-values of phase-phase bin counts to a correction for multiple comparisons. These analyses show that the statistically significant bins in phase-phase plots of white noise under the original framework of Belluscio et al. do not persist after correcting for multiple comparisons using Holm-Bonferroni (we considered the FDR correction too liberal since it led to significant bins in white noise). The results were true when building surrogate distribution using both Time Shift and Random Permutation procedures. This is now shown in new Figure 9A and stated/discussed in the fourth paragraph of the subsection “On diagonal stripes in phase-phase plots” and in the third paragraph of the subsection “Statistical inference of phase-phase coupling”. Please note that we created a new Results subsection to discuss the origin of stripes in phase-phase plots (“On diagonal stripes in phase-phase plots”), which led to editions and rearrangement of previous paragraphs and figures (in specific, former Figures 5B, 6 and 7 are now new Figures 6, 7 and 8, respectively).

In actual LFP data, we also found no significant bins after correcting for multiple comparisons when employing the same ± 200 ms time-shift surrogate procedure as in Belluscio et al. Interestingly, however, for very long epochs (5-10 minutes of concatenated data) we did find significant bins even after Holm-Bonferroni correction when employing randomly permutated – but not time-shifted – surrogates. We believe this is because small time-shifts as performed in Belluscio et al. ( ± 200 ms) would preserve phase-locking between the fundamental and harmonic frequencies (albeit in different phase relations) while the larger time shifts obtained through random permutations would not. These results are now shown in new Figure 10 stated/discussed in the last two paragraphs of the subsection “On diagonal stripes in phase-phase plots” and in the last paragraph of the subsection “Statistical inference of phase-phase coupling”. Please note that in the revised manuscript we leave room for this result being due to a weak but true coupling effect (subsection “On diagonal stripes in phase-phase plots”, fifth paragraph, subsection “Statistical inference of phase-phase coupling”, last paragraph, and subsection “Lack of evidence vs evidence of non-existence”, last paragraph). Please see also our answers below.

B) About the very low p-values in Belluscio's data, the authors suggest that "it is possible that, by analyzing a longer epoch length, the influence of theta harmonics becomes more apparent and would lead to lower p-values, while the effect of the filtering-induced sinusoidality is washed out for both actual and surrogate epochs (of the same length)."

Well the manuscript previously demonstrates that n:m coupling measures as well as phase-phase plots cannot tear apart asymmetrical waves from true cross-frequency coupling. Thus, if indeed p-values remain lower than threshold when controlled appropriately, it could equally be due to asymmetrical theta or true theta-gamma phase coupling, but the latter could not be dismissed.

As stated above and shown in new Figure 10, p-values in phase-phase plots of actual data are no longer considered statistically significant after appropriate correction for multiple comparisons when employing the surrogate procedure introduced in Belluscio et al. ( ± 200 ms time shifts), which in principle would settle this issue. However, we note that bin counts are deemed statistically significant even after correction when employing randomly permutated surrogates, especially for very long epochs (Figure 10A). We agree with the reviewer that n:m coupling measures cannot separate true coupling from asymmetrical waves; while we indeed tend to ascribe these results to harmonic influences, in the revised manuscript we now state our interpretation more cautiously and leave open the possibility of true theta-gamma phase coupling (subsection “On diagonal stripes in phase-phase plots”, fifth paragraph, and the Conclusion).

3) The reason for stripes in the phase-phase plot of hippocampal data:

A) In the manuscript authors state that "the diagonal stripes in phase-phase plots are due to theta harmonics and not to genuine gamma activity." If it were true harmonics, that would imply a consistent phase relationship between theta and gamma over sustained periods (not just over small periods as for white noise), i.e. would test positive for n:m coupling. So in my opinion here the effect is rather due to the temporary n:m alignment of phases, just as for white noise. In other words, stripes emerge also when analyzing white noise despite there being no harmonics in the signal.

We thank the reviewer for the insightful comment. Indeed, after performing new analyses on white noise and actual LFPs (which led to new Figure 9, Figure 10, Figure 10—figure supplement 1 and Figure 10—figure supplement 2), we came to agree with the reviewer that the temporary n:m phase alignment due to the sinusoidality induced by filtering is a main factor in determining the diagonal stripes in phase-phase plots. These conclusions are backed by data shown in our new figures and explicitly stated in subsection “On diagonal stripes in phase-phase plots”, last three paragraphs and subsection “Statistical inference of phase-phase coupling”, last paragraph. However, our new analyses now reveal that in actual LFP signals there is a second influence, which is not accounted for solely by filtering. This effect is only statistically detected when analyzing very long epoch lengths (>100 s) and when contrasting original results (either phase-phase plots or Rnm curves) against randomly permutated data (please see new Figure 10). Based on our analysis of sawtooth wave (in which random permutation was more sensitive to detect coupling than time-shifted surrogates, Figure 4—figure supplement 2), and given that the effect of filtering-induced sinusoidality is controlled for in surrogate data, we particularly believe that the weak (Rnm=0.03) but significant coupling detected in very long time series is due to theta harmonics (discussed in subsection “Statistical inference of phase-phase coupling”, last paragraph). But in the revised manuscript we leave open the possibility of this low level of coupling as denoting true coupling (subsection “On diagonal stripes in phase-phase plots”, fifth paragraph, subsection “Statistical inference of phase-phase coupling”, last paragraph, subsection “Lack of evidence vs. evidence of non-existence”, last paragraph, and the Conclusion).

B) In the rebuttal, the authors defend that "Believing in two different and genuine gamma activities – one coupled at 5 cycles per theta, the other at 4 cycles per theta – would go against the parsimonious principle." (this is when theta frequency evolves). However, as established by theoretical studies of coupled oscillators, n:m coupling is not a fixed property of the network but emerges as a combination of oscillator intrinsic dynamics and the characteristics of the connectivity pattern. See for example Arnold tongue: if we assume there is just one fixed gamma, a fluctuating theta and fixed connectivity, it is perfectly normal that n:m coupling will shift from 1:5 to 1:4 if the lower oscillator accelerates and the ratio of frequency goes from around 5 to around 4.

We thank the reviewer for calling our attention to these facts, point taken. We just note that the “parsimony argument” properly criticized by the reviewer was not present in the manuscript text but only stated in the rebuttal letter.

4) Asymmetrical theta vs. phase-coupled theta-gamma in general

I am coming back to the authors' comment on this in the rebuttal, although this is no longer present in the manuscript. This is a comment for the authors benefit and speaks to the overall comment mentioned above. Sharp edges in LFP/EEG are not by itself an indication that we are measuring a single asymmetrical oscillation as the superposition of a slow and a fast n:m coupled oscillation can also give rise to sharp edges (Figure 4C; note that this can even be obtained with just two oscillations). Thus, sharp edges is no more a selective feature of asymmetrical oscillations than n:m coherence is selective of phase-coupled oscillators. In other words, visual inspection cannot tell us more than statistics.

We appreciate the thoughtful comments by the reviewer. (As stated by the reviewer, this issue is no longer present in our manuscript.)

5) It looks like "Random Perm" is more powerful test than "Time Shift", as mentioned in the first paragraph of the subsection “Lack of evidence for n:m phase-locking in actual LFPs”. If this is the case then it could be stated as a conclusion of the work that "Random perm" should be preferred over "Time Shift" (and of course of the "Scrambling" procedure), as it is less likely to miss existing effects (lower False Rejections rate).

We agree (and actually our new analyses of very long LFP epochs support such conclusion). This conclusion is now explicitly stated in the last paragraph of the subsection “Statistical inference of phase-phase coupling”.

6) Conclusion: the very new paper by Lozano-Soldevilla and colleagues (Frontiers Comp Neuro) provides another example of spurious cross-frequency coupling measures due to asymmetrical oscillations, could be worth referencing.

We now cite Lozano-Soldevilla et al. et al. at the passage mentioned by the reviewer (currently in the last paragraph of the subsection “Statistical inference of phase-phase coupling”).

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Citations

    1. Mizuseki K, Sirota A, Pastalkova E, Diba K, Buzsáki G. 2013. Multiple single unit recordings from different rat hippocampal and entorhinal regions while the animals were performing multiple behavioral tasks. CRCNS.org. [DOI]

    Articles from eLife are provided here courtesy of eLife Sciences Publications, Ltd

    RESOURCES