Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Jun 1.
Published in final edited form as: Cerebellum. 2019 Jun;18(3):489–499. doi: 10.1007/s12311-019-01013-9

Cerebellar theta-frequency transcranial pulsed stimulation increases frontal theta oscillations in patients with schizophrenia

Arun Singh 1,*, Nicholas T Trapp 2,*, Benjamin De Corte 3, Scarlett Cao 4, Johnathon Kingyon 4, Aaron D Boes 5, Krystal L Parker 2,6
PMCID: PMC6818969  NIHMSID: NIHMS1522836  PMID: 30825131

Abstract

Cognitive dysfunction is a pervasive and disabling aspect of schizophrenia without adequate treatments. A recognized correlate to cognitive dysfunction in schizophrenia is attenuated frontal theta oscillations. Neuromodulation to normalize these frontal rhythms represents a potential novel therapeutic strategy. Here, we evaluate whether noninvasive neuromodulation of the cerebellum in patients with schizophrenia can enhance frontal theta oscillations, with the future goal of targeting the cerebellum as a possible therapy for cognitive dysfunction in schizophrenia. We stimulated the midline cerebellum using transcranial pulsed current stimulation (tPCS), a non-invasive transcranial direct current that can be delivered in a frequency specific manner. A single 20-minute session of theta frequency stimulation was delivered in 9 patients with schizophrenia (cathode on right shoulder). Delta frequency tPCS was also delivered as a control to evaluate for frequency specific effects. EEG signals from midfrontal electrode Cz were analyzed before and after cerebellar tPCS while patients estimated the passage of 3 and 12 second intervals. Theta oscillations were significantly larger following theta frequency cerebellar tPCS in the midfrontal region, which was not seen with delta frequency stimulation. As previously reported, patients with schizophrenia showed a baseline reduction in accuracy estimating 3 and 12 second intervals relative to control subjects, which did not significantly improve following a single session theta or delta frequency cerebellar tPCS. These preliminary results suggest that single session theta frequency cerebellar tPCS may modulate task-related oscillatory activity in the frontal cortex in a frequency-specific manner. These preliminary findings warrant further investigation to evaluate whether multiple sessions delivered daily may have an impact on cognitive performance and have therapeutic implications for schizophrenia.

Keywords: Cerebellum, neuromodulation, non-invasive stimulation, cognitive task, schizophrenia

Introduction

Schizophrenia is a severe, chronic, and disabling mental illness that affects 1% of the U.S. population (McGrath et al., 2008). Deficits in cognitive and executive function include impairments in working memory, attention, planning and timing, which are currently untreatable and significantly decrease quality of life (Andreasen et al., 1998; Carroll et al., 2009; Green and Harvey, 2014; Ho et al., 1998; Ward et al., 2011). A biological correlate to the cognitive impairment seen in schizophrenia is electroencephalographic (EEG) abnormalities in the frontal cortex (Andreasen et al., 1997; Carter et al., 2014; Parker et al., 2017). Previous work demonstrated dysfunctional working memory and executive function in subjects with schizophrenia is associated with abnormal activity within a functionally connected network including the temporal lobe and cerebellum (Andreasen and Pierson, 2008; Repovs et al., 2011).

Work from our lab has shown that patients with schizophrenia have attenuated frontal low-frequency rhythms concurrent with impaired interval timing performance and the two are correlated, such that greater attenuation of theta rhythms corresponds with worse task performance (Parker et al., 2017). A similar profile of underestimating the passage of time and attenuated theta oscillations follows D1 dopamine antagonist infusions in a region of the rodent frontal cortex (Parker et al., 2017). This parallels a finding in human schizophrenia patients: there is a homologous area in the frontal cortex of patients with schizophrenia reported to have a decreased binding potential for D1 dopamine (Abi-Dargham et al., 2002), lending support to the importance of this mechanism for timing performance. Further, we showed that optogenetic stimulation of another node in the network recruited for timing performance, the cerebellum, could rescue theta frequency oscillations in the frontal cortex and normalize timing performance (Parker et al., 2017).

Currently, there are no therapies that reliably improve cognitive dysfunction in schizophrenia; new therapeutic options are desperately needed to mitigate the disabling burden of this disease. Although traditionally associated with motor function, there is also a prominent role of the cerebellum in cognitive function (Koziol et al., 2013; Schmahmann, 1996, 1998; Schutter and van Honk, 2006; Stoodley, 2011; Strick et al., 2009). Previous clinical and neuroimaging reports have provided evidence of cerebellar pathology in schizophrenia patients with cognitive deficits and psychosis (Jurjus et al., 1994; Nopoulos et al., 1999; Sandyk, 1993; Tavano et al., 2007), which may be involved in abnormal cerebello-thalamo-cortical circuitry concurrent with cognitive and motor deficits (Andreasen et al., 1996; Rüsch et al., 2007). According to the traditional view, discrete circuits between the basal ganglia and cerebellum with motor areas of the cerebral cortex underlie motor performance, while other circuits between the basal ganglia and cerebellum functionally linked with prefrontal cortices associate more strongly with cognitive functions (Middleton and Strick, 2000). There is emerging evidence that the cerebellum can be a neuromodulation target not only for motor control but also for cognitive abnormalities in patients (Ferrucci et al., 2016; Grimaldi et al., 2014).

Although neuromodulation (such as transcranial direct current stimulation; tDCS) of frontal cortical areas in healthy participants and patients may enhance cognition, stimulation of the cerebellum has received less attention (Fregni et al., 2005; Jo et al., 2009). In 2008, however, Ferrucci et al., reported changes in cognitive performance in healthy individuals after cerebellar tDCS (Ferrucci et al., 2008). Based on these findings, one could hypothesize that cerebellar stimulation may be able to rescue frontal theta brain rhythms essential for normal cognition, thus correcting physiologic abnormalities that impair function and performance. Indeed, emerging evidence suggests that cerebellar stimulation may hold promise for improving cognitive problems in schizophrenia (Demirtas-Tatlidede et al., 2010; Garg et al., 2016), though it is not known whether this is mediated by enhanced frontal theta rhythms. We aim to extend this work by evaluating whether noninvasive approaches of cerebellar neuromodulation can enhance cognitive function by modifying frontal brain oscillations in patients with schizophrenia.

Here, we investigate whether noninvasive transcranial cerebellar stimulation, specifically transcranial pulsed current stimulation (tPCS), influences frontal cortex theta oscillations. TPCS is a relatively safe and inexpensive way to pass electrical current non-invasively through the skull in a frequency specific manner that may influence neuronal activity and connected brain circuitry (Vasquez et al., 2016). Using this methodology, we tested the hypothesis that theta-frequency cerebellar tPCS stimulation would 1) augment midfrontal theta frequency oscillations in patients with schizophrenia and 2) influence timing performance. We also tested the effect of delta frequency cerebellar tPCS to evaluate whether any changes in frontal oscillations were frequency-specific relative to the stimulation. Results showed that theta but not delta frequency cerebellar tPCS rescued low-frequency activity in the midfrontal region, yet neither frequency of stimulation improved timing performance.

Materials and Methods

Human Subjects

Nine patients with a DSM-IV diagnosis of schizophrenia (7 men, 2 women) were recruited from the Iowa Longitudinal Database. Subjects were recruited from a database of patients that had diagnoses confirmed by a board-certified psychiatrist at the University of Iowa. Data from the nine age-, sex-, and education-matched healthy control subjects performing the interval timing task without stimulation, were included for comparison (Parker et al., 2017). All participants were determined to have the decisional capacity to provide informed consent, resided within 100 miles of Iowa City and were able to independently travel to the University of Iowa Hospitals and Clinics. Written informed consent was obtained from every subject and all research protocols were approved by the University of Iowa Human Subjects Review Board. Medication status was not altered for any of the patients. Subject demographics and scores on cognitive tasks are described in Table 1.

Table 1.

Demographics and cognitive scores for patients with schizophrenia and controls.

Control Schizophrenia
Pre-tPCS Post-delta tPCS# Post-theta tPCS#

Sex 9 (3 F) 9 (3 F); 8 (3 F) 9 (3 F)
Age 47.9 (6.8) 45.8 (2.9) 45.2 (3.1) 46.1 (2.2)
Education (Years) 15 (0.6) 12.8 (0.9) 12.9 (0.76) 12.9 (0.7)
MOCA 28 (0.6) 23.8 (1.5)* 24.7 (0.8) 24.4 (1.2)
TMT 26.9 (3.4) 81.9 (28.7)* 90.0 (20.1) 59.2 (15.1)
VF 45.6 (3.1) 29.2 (4.9)* 29.9 (4.4) 29.6 (2.6)
Digit 20.4 (1.1) 14.7 (1.4)* 15.2 (1.1) 14.3 (0.8)

The data are presented as mean +/− SEM.

*

p<0.05 Control vs Schizophrenia Pre-tPCS.

#

Following stimulation in either delta or theta frequencies, all cognitive measures remained significantly different from controls, i.e., there was not an improvement in their cognitive function. All controls were age and sex matched to a patient.

MOCA = Montreal Cognitive Assessment, TMT = Trails Making Test, VF = Verbal Fluency.

Interval-Timing Task

Timing is a well-characterized capability of the cerebellum; however, it is typically associated with sub-second timing (Ivry and Spencer, 2004). Our lab has recently shown that the cerebellum and frontal cortex participate in supra-second processing and timing (Parker et al., 2017). Previous studies have demonstrated that estimating the passage of time is a reliable way of eliciting frontal theta activity (Parker et al., 2015). While EEG recordings were being acquired, participants performed an interval timing task before and after cerebellar tPCS. The interval timing task involved the appearance of a “3 sec” or “12 sec” text cue on the computer screen that indicated both the interval of time to estimate and the start of the trial (Fig. 1). The subject would make a motor indication of their estimation of the elapse of the specified timing duration by pressing the keyboard space bar. Participants received feedback about their response time after 20% of the trials. The task was self-paced, and the participants were instructed not to count time in their head during the task. The interval-timing task contained 80 total trials with 3 s and 12 s intervals presented in random order.

Fig. 1. Experimental Timeline.

Fig. 1.

Delta and theta stimulations were randomized in visit 1 and 2.

Each subject’s time estimates for the two intervals were fit with Gaussian distributions, using Matlab (fitdist.m), and performance was quantified two ways using the mean and standard deviation (Rakitin et al., 1998). First, we subtracted the mean from the actual instructed interval, providing a measure of timing accuracy. Larger and smaller values correspond to systematic under- and overestimation of time, respectively. While subjects can be highly accurate with respect to average response times, their estimates can vary substantially from trial-to-trial. Therefore, we also measured timing precision. Timing precision (taken as the standard deviation of response times) decreases linearly with the interval being timed, a form of Weber’s law often referred to as the ‘scalar property’ of interval timing (Gibbon et al., 1984). Therefore, we evaluated precision by dividing the standard deviation by the mean response time, defined as the ‘coefficient of variation’ (CV). Larger and smaller values correspond to lower and higher precision, respectively. Furthermore, in both humans and a variety of other species, the coefficient of variation remains constant, regardless of the interval being timed (Buhusi and Meek, 2005).

Previous findings in healthy controls indicate that midfrontal theta activity (4-8 Hz) following trial start is essential for accurate timing performance (Parker et al., 2014, 2015, 2017). This cue-locked theta activity is attenuated in patients with schizophrenia and Parkinson’s disease (Parker et al., 2015, 2017). Based on these results, a time-frequency Region of Interest (tf-ROI) was derived from our previous work and was constrained to 0 to 1.0 s following cue. In addition to this highly-implicated a priori tf-ROI, we applied cluster-based permutation correction on the full time-frequency analysis in order to identify any other consistent changes between groups. This method involved thresholding the size of the statistical cluster (for 1000 permutations of group labels) and picked the one-dimensional cluster mass (at the 95th percentile) as the threshold for chance occurrence.

Cerebellar tPCS

Figure 1 displays the experimental setup. A single session of noninvasive brain stimulation was delivered via a battery-driven stimulator (MindAlive, Inc., Oasis Pro) with anodal pulsed current stimulation of the cerebellar vermis applied via surface conductive rubber electrodes. The vermal location was defined by the location 1 cm below the external occipital protuberance or highest and point of the largest projection in the occipital bone is referred to as the inion (Gülekon and Turgut, 2003; Figure 5). The cathodal electrode was placed on the right shoulder (Bocci et al., 2015, 2018; Ferrucci et al., 2012, 2013). Stimulation duration was 20 minutes, with 1 mA peak-to-peak amplitude at either delta (n=8) or theta (n=9) frequencies. Delta frequency cerebellar tPCS was used as a control to evaluate the frequency-specific effects of cerebellar modulation of the frontal cortical oscillations during timing performance. This may be optimal as an “active sham”; stimulation causes a “buzzing” or “tingling” sensation at the stimulation site, which would be absent with a purely sham stimulation condition (van Driel et al., 2015). Additionally, using delta frequency cerebellar tPCS as a control frequency confirmed that general characteristics of physical stimulation were comparable across all conditions. Delta and theta stimulation session order was randomized and separated by 1-3 months. Although we did not test the stimulator before we applied stimulation, we did record EEG activity during stimulation and could see the artifact induced by stimulation to verify that stimulation was being delivered at the correct frequency.

Fig. 5. Cue-evoked activity at cerebellar electrodes is not modulated by cerebellar theta-frequency tPCS.

Fig. 5.

A) There was no effect on cue-related activity at the site of cerebellar stimulation as measured by the midline electrode following delta tPCS on 3 s and 12 s trials (left side). Theta tPCS significantly increased cue-related activity in theta frequencies (4-8 Hz) on 12s trials (black outlined; p<0.05) while 3 s trials only trended to increase (p>0.05) (right side). B) Similar to cerebellar midline electrode, delta frequency stimulation did alter cue-related theta frequency activity at the right cerebellar electrode. Theta-frequency tPCS significantly increased theta-frequency activity for 3 s trials (black outlined; p<0.05) while there was only a trend for 12 s trials. C) The electrode above and to the right of the site of cerebellar stimulation did not show changes in theta frequencies after delta or theta tPCS. Increased power in red with permutation-corrected statistical significance p<0.05 outlined in black lines.

EEG Recording and Analysis

EEG recording was collected before (“pre”) and after (“post”) cerebellar tPCS. EEG was recorded on a Nihon Kohden system with a sampling rate of 500 Hz (Cohen, 2014). EEG was recorded from 21 channels based on the 10-20 system (Fz, Cz, Pz, F3/4, C3/4, P3/4, F7/8, T3/4, T5/6, O1/2, M1/2), as well as left-eye vertical electrooculography (VEOG) and ground (forehead). The lead that is traditionally placed at the FP1 location was relocated to 1 cm below the inion bone on the cerebellar midline while FP2 was placed 1 cm to the right of FP1. Traditional 10 mm EEG type passive electrodes were used to collect signals from the scalp. We applied EEG conductive gel (Covidien 30806734 Ten20) to hold the electrodes in place to conduct the signal with higher signal to noise ratio. This approach was selected to match our previous EEG datasets that described differences in low-frequency rhythms between patients with Parkinson’s disease and controls (Parker et al., 2015). Impedance of all electrodes was below 5 kΩ. Continuous data were re-referenced to the mathematical average of the two mastoid channels, yielding a total of 21 scalp EEG channels. Signals were segmented on the basis of the stimulus (cue) onset (−2 to 6 s for 3 s trials; −2 to 18 s for 12 s trials), from which the cue-locked segments were isolated. Eye blinks and horizontal eye movements were removed by hand using independent component analysis and EEGLab (Delorme and Makeig, 2004). Afterwards, EEG signals were then re-referenced to an average reference. Previous studies have associated cognitive impairment with changes in midfrontal regions; therefore, we selected midfrontal Cz electrode for the main analysis (Parker et al., 2014, 2015, 2017). We also analyzed the midline cerebellar electrode, the right cerebellar electrode, and the electrode above the right cerebellar lead to evaluate how cerebellar delta\theta tPCS influenced activity at and around the site of stimulation.

Power spectral analysis of “pre” and “post” cerebellar tPCS EEG signals was computed from the “pwelch” method. Signals were transformed into the power spectrum domain (using pwelch method: 256 points window size). Furthermore, a frequency range of 1-50 Hz was selected to compute relative power spectrum to abate the inter-recording variation. Here, we exported the mean relative power at delta (1-4 Hz) and theta (4-8 Hz) frequency bands.

Time-frequency analysis was computed by multiplying the fast Fourier transformed (FFT) power spectrum of single trial EEG data with the FFT power spectrum of a set of complex Morlet wavelets. These complex Morlet wavelets are defined as a Gaussian-windowed complex sine wave: ei2πtfe−t^2/(2xσ^2), where “t” is time and “f” is frequency (which increases from 1-50 Hz in 50 logarithmically spaced steps). This equation defines the cycle of each frequency band, increasing from 3 to 8 cycles between 1 and 50 Hz and taking the inverse FFT. Ultimately, this computational method converts signal into time-domain convolution and results in estimates of instantaneous power (the magnitude of the analytic signal). The power value was normalized by conversion to a decibel (dB) scale (10*logl0(powert/powerbaseline)), allowing a direct comparison of effects across frequency bands (Cohen, 2014). The baseline for each frequency was calculated based on average power from −0.3 to −0.2 s prior to the onset of the stimulus. Each epoch was then cut in different lengths for visualization purpose (3 s full trial: −2 to 5 s; 12 s full trial: −2 to 14 s; also, around 3 s and 12 s cue: −0.5 to 1.0 s time from cue). Time-frequency plots were analyzed from electrode Cz in delta (1-4 Hz) and theta (4-8 Hz) frequency bands in accordance with well-established prior hypotheses (Parker et al., 2014, 2015).

Statistical Analyses

For binary comparisons between “pre” and “post” tPCS, we used paired t-tests with an alpha level of 0.05. Paired t-tests were performed to compute the statistical differences before (“pre”) and after (“post”) the tPCS for behavioral, clinical data measures and task-related frequency bands power. We applied repeated measure analysis of variance (ANOVA) followed by pairwise comparison using SPSS for spectral power in the targeted ROIs (tf-ROI) of 3 s and 12 s data for delta and theta tPCS separately. Spearman correlation analysis was performed to analyze the correlation between clinical scores and reaction time/tf-ROIs.

Results

Midfrontal Activity and Behavioral Response in Control Subjects

Healthy control subjects have increased delta frequency power in the midfrontal electrode Cz at the onset of cue in the interval-timing cognitive task (Fig. 2A; Parker et al., 2017a(Parker et al., 2017)). However, patients with schizophrenia have attenuated midfrontal theta frequency power around the time of cue (Fig. 2B). Patients with schizophrenia also had significantly increased variation in the time estimation (3 s and 12 s interval-timing tasks) as compared to control subjects, specifically in timing efficiency and the coefficient of variation (Fig. 2C-F). These results are previously published and are the foundation for the hypothesis that midfrontal activity is necessary for timing performance on an interval timing task (Parker et al., 2017).

Fig. 2. Spectral analysis of electrode Cz signal in healthy control and schizophrenia patients during interval-timing tasks.

Fig. 2.

A and B) Time-frequency spectrograms show increased delta frequency power around cue in the interval-timing task in control subjects as compared to schizophrenia patients. C) Quantification of response histograms reveals variations in the measurements of timing, including D) less variations in average response time, E) more variations in timing efficiency as defined by the number of responses occurring around 3 s (2-3 s) and 12 s (11-12 s), and F) a larger coefficient of variation. These data have been described previously in (Parker et al., 2017). *p<0.05.

Midfrontal Activity in Patients

Spectral analysis of delta and theta EEG data was computed before and after tPCS to examine the effect of stimulation on midfrontal region Cz during performance of the timing task in patients with schizophrenia. Over the entire 12 second interval, delta (Fig. 3A and B) and theta frequency tPCS (Fig. 3E and F) did not significantly alter the relative power of delta and theta frequency bands in the midfrontal cortex at electrode lead Cz. This is further confirmed by time-frequency analyses of the midfrontal electrode that show no significant changes in power after delta tPCS subtracted from power before, across both the short (Fig. 3C) and long (Fig. 3D) intervals. Interestingly, theta tPCS significantly increased both delta and theta oscillatory activity around the time of the cue for both 3 s and 12 second trials (Fig. 3G and H - permutation-corrected statistical significance p<0.05 outlined in bold lines).

Fig. 3. Spectral analysis of electrode Cz signal before and after cerebellar tPCS during interval-timing tasks.

Fig. 3.

There are no significant differences in relative power delta and theta frequency bands at electrode Cz in the midfrontal cortex following delta (A and B) and theta frequency tPCS (E and F). C-H) Time-frequency spectrograms after theta-frequency tPCS show significant changes in power (increased in red with permutation-corrected statistical significance p<0.05 outlined in black lines) around 3 s (G) and 12 s (H) cue events at time 0 s (note that the x-axes are scaled and shortened to 5 seconds to include only the time of the trial so that the intertrial intervals and next trial starts are not included in the image for 3 s trials). Increased power was more prominent in lower frequency bands (1-8 Hz; delta/theta frequency band). This effect was specific for theta-frequency stimulation as delta-frequency tPCS did not significantly alter power at any timepoints throughout the interval on either the 3s (C) or 12s (D) task.

Our previous work reports the importance of increased activity immediately following the onset of the cue (0-0.5 s) for accurate timing performance (Parker et al., 2014, 2017). Here we find that delta frequency tPCS did not modulate the activity at 3 s and 12 s cue-related tf-ROIs at electrode Cz in patients with schizophrenia: 1-4 Hz, 0-0.5 s from cue, (see table 2; Fig 4 A and B) and 4-8 Hz, 0.5-1.0 s from cue (see table 2; Fig 4 A and C).

Table 2.

Repeated-measure ANOVA tests (within subject variables: 3 s and 12 s tasks) were applied on tf-ROI power values to compute the difference between pre- and post-delta or theta tPCS.

tf-ROI: 0-0.5 s tf-ROI: 0.5-1.0 s
1-4 Hz 4-8 Hz 1-4 Hz 4-8 Hz
Delta tPCS F = 0.01; p=0.99 F = 0.3; p= 0.6 F = 0.25; p= 0.6 F =1.9; p= 0.2
Theta tPCS F =1.3; p= 0.3 F =1.3; p= 0.3 *F =10.9; p= 0.01 *F = 7.9; p= 0.02
*

p<0.05 represents statistical significance.

Fig. 4. Cue-evoked low-frequency activity increases significantly at tf-ROIs following theta-frequency tPCS.

Fig. 4.

A) tf-ROI 3 s and 12 s cue-related midfrontal activity (at Cz) did not modulate following delta tPCS around 3 s and 12 s cues (B) at 1-4 Hz, 0-0.5 s from cue, or (C) at 4-8 Hz, 0.5-1.0 s from cue. (D) However, tf-ROI 3 s and 12 s cue-related midfrontal activity (at Cz) increased around 3 s and 12 s cues after theta tPCS (Permutation-corrected statistical significance p<0.05 outlined in bold lines). E) Increased power was observed in delta frequencies (1-4Hz), 0-0.5 s from cue (non-significant; p>0.05), and (F) in theta frequencies (4-8 Hz), 0.5-1.0 s from cue (significant, *=p< 0.05). Although the analyses focused on electrode lead Cz, there were several significantly increased electrodes on the scalp topography of tf-ROIs following theta tPCS that could have been analyzed for both timepoints (E and F, left - Statistically significant electrodes p<0.05 indicated by large diamonds). Note, figure 4A and 4D are ‘zoom-ins’ of figure 3C, D, G and H.

Theta frequency tPCS also did not change the activity at 3 s and 12 s cue-related tf-ROIs 1-4 Hz, 0-0.5 s from cue (see table 2; Fig 4 D and E). However, theta frequency tPCS increased the activity significantly at 3 s and 12 s cue-related tf-ROIs 1-4 Hz and 4-8 Hz, 0.5-1.0 s from cue (see table 2; Fig 4 D and F). We also performed skewness tests on tf-ROIs to measure the normality. We found that the absolute values of skewness were <1m, which confirm data normality.

Notably the increased theta was not entirely consistent with that of previous reports from healthy controls as it was delayed in onset by 0.5 seconds. Although our analyses focused on electrode Cz, several electrodes showed significant power increases as indicated by the large black diamonds on the topo plots (p<0.05: Fig. 4 D and F). Interestingly, theta frequency tPCS reinstated theta oscillations (4-8 Hz) in the mid frontal region. Previous reports have confirmed the role of increased mid frontal activity at 4-8 Hz in the improvement of cognitive performance in patients with cognitive deficits (Cavanagh and Frank, 2014; Singh et al., 2018). Therefore, current results suggest the potential benefits of theta tPCS with improved stimulation parameters to induce behavioral changes in patients with schizophrenia and other diseases associated with cognitive impairment. This effect was specific to theta frequency as cerebellar delta tPCS did not induce any significant changes in frontal activity (Fig. 4 A-C).

Further, we analyzed the electrodes which were located at the site of stimulation (1cm below the inion bone), 1 cm to the right of the stimulation site, and a site to the right and superior to the stimulation location to evaluate the effects of tPCS on cue-evoked theta frequencies. Cue-evoked power at theta frequencies at the site of stimulation and 1 cm to the right of stimulation tended to increase after theta but not delta tPCS (Fig. 5A and B). Analyses of the electrode above and to the right of the stimulation site did not show any changes in power after delta\theta tPCS (Fig. 5C). These results indicate that lasting effects of theta cerebellar tPCS activity were localized only to the frontal cortex and there were no local persistent changes at the cerebellar site of stimulation.

Interval-Timing Performance in Patients

To further explore how the cerebellum may modulate the frontal cortex to support timing (and possibly cognitive function), schizophrenia patients performed an interval-timing task before and after delta (n=8) or theta (n=9) tPCS. At baseline, patients with schizophrenia underestimated the short interval (p=0.043) and overestimated the long interval, although the latter effect only had a trend towards significance (p=0.09). This resembles a pattern of regression to the mean referred to as a ‘migration effect’, which is also observed in Parkinson’s patients (Malapani et al., 2002). Further consistent with Parkinson’s data, subjects showed larger coefficients of variation (CVs = standard deviation / mean of the response times) for the short interval than the long, indicating that they did not conform to the ‘scalar property’ of interval timing. In other words, the variability of the response times did not grow linearly with mean response time, as one would expect constant CVs for both durations if this were the case. However, neither delta nor theta stimulation significantly altered these patterns (Fig. 6A-D).

Fig. 6. Single session delta or theta frequency cerebellar tPCS does not influence interval timing performance.

Fig. 6.

A) Delta frequency cerebellar stimulation did not influence interval timing on 3 s or 12 sec trials. This is indicated by similar average response histograms and overlapping standard error bands of 40 trials before (black) and 40 trials after (red) 20 minutes of stimulation. Quantification of these response histograms reveals no significant differences for measures of timing, including B) average response time, C) timing efficiency as defined by the number responses occurring around 3 s (2-3 s) and 12 s (11-12 s), and D) coefficient of variation. E) Likewise, theta stimulation did not influence interval timing performance as shown by similar average response histogram curves and as quantified by insignificant F) average response times, G) response time accuracy, and H) coefficient of variation.

Cognition in Patients

Although unlikely that a single session of tPCS could alter performance on core cognitive tasks, we compared pre-post tPCS baseline scores for cognitive measures including the Montreal Cognitive Assessment, Trail Making Task, Verbal Fluency, and Digit Span on 7 of the schizophrenia patients included in this study. There were no significant changes in cognitive function following a single session of tPCS (see Table 1).

Discussion

We demonstrate that twenty minutes of 1mA theta-range tPCS of the midline cerebellum can alter power in time-frequency spectrograms in the lower frequency (delta and theta) range during an interval timing task. This effect was not seen with delta-range tPCS, suggesting that this is a frequency-specific effect of tPCS. These changes were most notable in the Cz (mid-frontal) and prefrontal tf-ROIs, which is consistent with our hypothesis that midline cerebellar stimulation would alter frontal cortex EEG activity. This is also consistent with previous literature utilizing other forms of low-frequency cerebellar stimulation to modulate frontal EEG activity during a timing task (Parker et al., 2017). Some literature suggests that pulsed stimulation protocols are effective at entraining the dominant brain rhythm, which is often task- and region-specific. Indeed, there is some evidence that in other tasks, such as associative learning tasks, behavior is associated with theta synchronization between cerebellum and prefrontal cortex regions (Schutter and van Honk, 2006). Thus, it is possible that theta-range tPCS was effective when delta-range stimulation was not due to driving already-dominant cerebellar theta rhythms that are active and synchronized in the execution of a timing task (Parker et al., 2017). Additionally, although theta-range tPCS altered low-frequency EEG activity, why this was not specific to theta-range activity remains unclear. The localization of induced EEG changes to the midfrontal regions is promising as this is a region previously implicated in cognitive timing tasks and abnormal in patients with cognitive impairment (Parker et al., 2014, 2015, 2017).

Despite the tPCS frequency-dependent changes in time-frequency spectrograms noted in this study, there were no notable changes in task performance behavior. There are several possible explanations for the lack of behavioral modifications. First, it is possible that the stimulation parameters were not robust enough to drive a change in brain activity significant enough to modify behavior on a task that probes a core cognitive process like timing. Studies of tPCS show a duration-dependent effect of the stimulation, with 20 minutes of stimulation often leading to the longest-lasting effects (Vasquez et al., 2016). However, whether this is optimal for a clinical population of patients with schizophrenia with abnormal low-frequency frontal EEG rhythms is unknown. Although some studies will show EEG changes from a single session of stimulation lasting up to 50 minutes (Vasquez et al., 2016), other studies, especially those focusing on entrainment of specific EEG rhythms with brain stimulation, have shown that effects may last only minutes after the stimulation is stopped, or cease with stimulation offset (Ozen et al., 2010). It is possible that repeated stimulation sessions, or sessions with different stimulation parameters, could have induced longer-lasting or more robust EEG changes that may have ultimately led to behavioral changes. Future studies could explore this question with longer stimulation protocols.

The EEG findings identified in this study beg the question of the specific mechanism of action through which the cerebellar tPCS is altering frontal regions. The neurophysiologic data for cerebellar tPCS is limited. Transcranial magnetic stimulation (TMS) studies using paired associative stimulation paradigms have detected changes in motor cortex plasticity after cerebellar TMS, with pharmacological manipulations demonstrating that these effects are dependent on N-methyl-D-aspartate (NMDA) receptor activity. Transcranial direct current stimulation (tDCS) studies with similar anodal and cathodal placement to this study have modeled the electrical fields induced and suggest the posterior aspect of the cerebellum can be affected by the stimulation (Parazzini et al., 2014). Despite this evidence, some research has drawn into question whether a low electrical current, such as that utilized in this study (1mA) can actually induce electrical changes in the brain that would be clinically or physiologically relevant (Voroslakos et al., 2018). Although this remains an open question, it invites other potential physiologic explanations for the changes noted here, as well as in volumes of previous noninvasive electrical stimulation research. Another potential mechanism may include direct stimulation of peripheral nerves triggering a “bottom-up” central nervous system response to stimulation (Underwood, 2016). Whether peripheral or cranial nerve stimulation at a rhythmic frequency could entrain neuronal elements remains to be seen. Based on the organization of the cerebellum where the hemispheres slightly cover our targeted vermis, it is likely that stimulation influenced the hemispheres in addition to the vermis. The vermis was targeted based on previous reports of improvement of cognitive function using cerebellar transcranial magnetic vermal stimulation. Going forward, we will investigate the spread of stimulation and changes in the deep nuclei using electrophysiology in rodents to clarify the spread and pathways influenced by midline cerebellar stimulation.

Despite several unanswered questions, this study demonstrates that it is possible to use frequency-specific tPCS over the cerebellum to alter low-frequency brain rhythms during a timing task in a population of patients with schizophrenia. Although this did not lead to behaviorally-relevant changes in this patient sample, it should prompt future studies looking at methods for optimizing this modulatory effect. As other studies have demonstrated compromised cerebello-frontal activity in schizophrenia and that low-frequency stimulation of the cerebellum can “rescue” low-frequency deficits in the frontal cortex with associated behavioral improvements, this is a line of research worthy of further pursuit and exploration. Transcranial PCS itself is a highly understudied technology, and the research of its application to the cerebellum in healthy or diseased populations is sparse.

Future studies should include looking at different stimulation parameters (e.g. different current intensities, polarities, and/or electrode locations) or attempting to replicate these findings with other stimulation modalities, such as transcranial magnetic stimulation, which can also be pulsed in frequency-specific patterns (e.g. theta burst stimulation) and may induce a more robust neuromodulatory effect with increased spatial precision. Indeed, there have been two promising studies of using theta-range transcranial magnetic stimulation of the midline cerebellum to improve cognitive and executive functioning in populations of patients with schizophrenia, suggesting some potential clinical benefit to this technique (Demirtas-Tatlidede et al., 2010; Garg et al., 2016). This effect may be facilitated by cerebellar transcranial magnetic stimulation increasing functional connectivity between the cerebellum and non-motor cortical nodes within the default mode network, as has been previously reported (Halko et al., 2014). Schizophrenia remains a major source of morbidity worldwide, and research searching for new treatments and therapies to address the disabling cognitive impairments of the disease should be a priority for clinician scientists and mental health researchers.

Acknowledgements

K.L.P has received generous funding to complete this research from the Brain & Behavior Foundation Young Investigator NARSAD Award, The Nellie Ball Research Trust, and NIMH K01 MH106824, the University of Iowa Department of Psychiatry, and the Iowa Neuroscience Institute.

Footnotes

Competing Interests

We do not have any competing interests to report.

References

  1. Abi-Dargham A, Mawlawi O, Lombardo I, Gil R, Martinez D, Huang Y, et al. (2002). Prefrontal dopamine D1 receptors and working memory in schizophrenia. J. Neurosci 22, 3708–3719. doi:20026302. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Andreasen NC, O’Leary DS, Cizadlo T, Arndt S, Rezai K, Ponto LL, et al. (1996). Schizophrenia and cognitive dysmetria: a positron-emission tomography study of dysfunctional prefrontal-thalamic-cerebellar circuitry. Proc. Natl. Acad. Sci. U.S.A 93, 9985–9990. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Andreasen NC, O’Leary DS, Flaum M, Nopoulos P, Watkins GL, Boles Ponto LL, et al. (1997). Hypofrontality in schizophrenia: distributed dysfunctional circuits in neuroleptic-naïve patients. Lancet 349, 1730–1734. [DOI] [PubMed] [Google Scholar]
  4. Andreasen NC, Paradiso S, and O’Leary DS (1998). “Cognitive dysmetria” as an integrative theory of schizophrenia: a dysfunction in cortical-subcortical-cerebellar circuitry? Schizophr Bull 24, 203–218. [DOI] [PubMed] [Google Scholar]
  5. Andreasen NC, and Pierson R (2008). The role of the cerebellum in schizophrenia. Biol. Psychiatry 64, 81–88. doi: 10.1016/j.biopsych.2008.01.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bocci T, Ferrucci R, Barloscio D, Parenti L, Cortese F, Priori A, et al. (2018). Cerebellar direct current stimulation modulates hand blink reflex: implications for defensive behavior in humans. Physiol Rep 6. doi: 10.14814/phy2.13471. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Bocci T, Santarcangelo E, Vannini B, Torzini A, Carli G, Ferrucci R, et al. (2015). Cerebellar direct current stimulation modulates pain perception in humans. Restor. Neurol. Neurosci 33, 597–609. doi: 10.3233/RNN-140453. [DOI] [PubMed] [Google Scholar]
  8. Buhusi CV, and Meek WH (2005). What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci 6, 755–765. doi: 10.1038/nrn1764. [DOI] [PubMed] [Google Scholar]
  9. Carroll CA, O’Donnell BF, Shekhar A, and Hetrick WP (2009). Timing dysfunctions in schizophrenia span from millisecond to several-second durations. Brain and cognition 70, 181–190. [DOI] [PubMed] [Google Scholar]
  10. Carter CS, Perlstein W, Ganguli R, Brar J, Mintun M, and Cohen JD (2014). Functional hypofrontality and working memory dysfunction in schizophrenia. Available at: http://ajp.psychiatryonline.Org/doi/10.1176/ajp.155.9.1285 [Accessed March 27,2015], [DOI] [PubMed]
  11. Cohen MX (2014). Analyzing Neural Time Series Data: Theory and Practice (Issues in Clinical and Cognitive Neuropsychology). The MIT Press. [Google Scholar]
  12. Delorme A, and Makeig S (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009. [DOI] [PubMed] [Google Scholar]
  13. Demirtas-Tatlidede A, Freitas C, Cromer JR, Safar L, Ongur D, Stone WS, et al. (2010). Safety and proof of principle study of cerebellar vermal theta burst stimulation in refractory schizophrenia. Schizophr Res 124, 91–100. doi: 10.1016/j.schres.2010.08.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Ferrucci R, Brunoni AR, Parazzini M, Vergari M, Rossi E, Fumagalli M, et al. (2013). Modulating human procedural learning by cerebellar transcranial direct current stimulation. Cerebellum 12, 485–492. doi: 10.1007/s12311-012-0436-9. [DOI] [PubMed] [Google Scholar]
  15. Ferrucci R, Cortese F, Bianchi M, Pittera D, Turrone R, Bocci T, et al. (2016). Cerebellar and Motor Cortical Transcranial Stimulation Decrease Levodopa-Induced Dyskinesias in Parkinson’s Disease. Cerebellum 15, 43–47. doi: 10.1007/s12311-015-0737-x. [DOI] [PubMed] [Google Scholar]
  16. Ferrucci R, Giannicola G, Rosa M, Fumagalli M, Boggio PS, Hallett M, et al. (2012). Cerebellum and processing of negative facial emotions: cerebellar transcranial DC stimulation specifically enhances the emotional recognition of facial anger and sadness. Cogn Emot 26, 786–799. doi: 10.1080/02699931.2011.619520. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Ferrucci R, Marceglia S, Vergari M, Cogiamanian F, Mrakic-Sposta S, Mameli F, et al. (2008). Cerebellar transcranial direct current stimulation impairs the practice-dependent proficiency increase in working memory. J Cogn Neurosci 20, 1687–1697. doi: 10.1162/jocn.2008.20112. [DOI] [PubMed] [Google Scholar]
  18. Fregni F, Boggio PS, Nitsche M, Bermpohl F, Antal A, Feredoes E, et al. (2005). Anodal transcranial direct current stimulation of prefrontal cortex enhances working memory. Exp Brain Res 166, 23–30. doi: 10.1007/s00221-005-2334-6. [DOI] [PubMed] [Google Scholar]
  19. Garg S, Sinha VK, Tikka SK, Mishra P, and Goyal N (2016). The efficacy of cerebellar vermal deep high frequency (theta range) repetitive transcranial magnetic stimulation (rTMS) in schizophrenia: A randomized rater blind-sham controlled study. Psychiatry Res 243, 413–420. doi: 10.1016/j.psychres.2016.07.023. [DOI] [PubMed] [Google Scholar]
  20. Gibbon J, Church RM, and Meek WH (1984). Scalar timing in memory. Ann. N. Y. Acad. Sci 423, 52–77. [DOI] [PubMed] [Google Scholar]
  21. Green MF, and Harvey PD (2014). Cognition in schizophrenia: Past, present, and future. Schizophr Res Cogn 1, el–e9. doi: 10.1016/j.scog.2014.02.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Grimaldi G, Argyropoulos GP, Boehringer A, Celnik P, Edwards MJ, Ferrucci R, et al. (2014). Non-invasive Cerebellar Stimulation-a Consensus Paper. Cerebellum 13, 121–138. doi: 10.1007/s12311-013-0514-7. [DOI] [PubMed] [Google Scholar]
  23. Gülekon IN, and Turgut HB (2003). The external occipital protuberance: can it be used as a criterion in the determination of sex? J. Forensic Sci 48, 513–516. [PubMed] [Google Scholar]
  24. Halko MA, Farzan F, Eldaief MC, Schmahmann JD, and Pascual-Leone A (2014). Intermittent Theta-Burst Stimulation of the Lateral Cerebellum Increases Functional Connectivity of the Default Network. J Neurosci 34, 12049–12056. doi: 10.1523/JNEUROSCI.1776-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Ho BC, Nopoulos P, Flaum M, Amdt S, and Andreasen NC (1998). Two-year outcome in first-episode schizophrenia: predictive value of symptoms for quality of life. Am J Psychiatry 155, 1196–1201. [DOI] [PubMed] [Google Scholar]
  26. Ivry RB, and Spencer RM (2004). The neural representation of time. Current Opinion in Neurobiology 14, 225–232. doi: 10.1016/j.conb.2004.03.013. [DOI] [PubMed] [Google Scholar]
  27. Jo JM, Kim Y-H, Ko M-H, Ohn SH, Joen B, and Lee KH (2009). Enhancing the working memory of stroke patients using tDCS. Am J Phys Med Rehabil 88, 404–409. doi: 10.1097/PHM.0b013e3181a0e4cb. [DOI] [PubMed] [Google Scholar]
  28. Jurjus GJ, Weiss KM, and Jaskiw GE (1994). Schizophrenia-like psychosis and cerebellar degeneration. Schizophrenia Research 12, 183–184. doi: 10.1016/0920-9964(94)90076-0. [DOI] [PubMed] [Google Scholar]
  29. Koziol LF, Budding D, Andreasen N, D’Arrigo S, Bulgheroni S, Imamizu H, et al. (2013). Consensus Paper: The Cerebellum’s Role in Movement and Cognition. Cerebellum, doi: 10.1007/s12311-013-0511-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Malapani C, Deweer B, and Gibbon J (2002). Separating storage from retrieval dysfunction of temporal memory in Parkinson’s disease. J Cogn Neurosci 14, 311–322. doi: 10.1162/089892902317236920. [DOI] [PubMed] [Google Scholar]
  31. McGrath J, Saha S, Chant D, and Welham J (2008). Schizophrenia: A Concise Overview of Incidence, Prevalence, and Mortality. Epidemiologic Reviews 30, 67–76. doi: 10.1093/epirev/mxn001. [DOI] [PubMed] [Google Scholar]
  32. Middleton FA, and Strick PL (2000). Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Research Reviews 31, 236–250. doi: 10.1016/S0165-0173(99)00040-5. [DOI] [PubMed] [Google Scholar]
  33. Nopoulos PC, Ceilley JW, Gailis EA, and Andreasen NC (1999). An MRI study of cerebellar vermis morphology in patients with schizophrenia: evidence in support of the cognitive dysmetria concept. Biol. Psychiatry 46, 703–711. [DOI] [PubMed] [Google Scholar]
  34. Ozen S, Sirota A, Belluscio MA, Anastassiou CA, Stark E, Koch C, et al. (2010). Transcranial electric stimulation entrains cortical neuronal populations in rats. J. Neurosci 30, 11476–11485. doi: 10.1523/JNEUROSCI.5252-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Parazzini M, Rossi E, Ferrucci R, Liorni I, Priori A, and Ravazzani P (2014). Modelling the electric field and the current density generated by cerebellar transcranial DC stimulation in humans. Clin Neurophysiol 125, 577–584. doi: 10.1016/j.clinph.2013.09.039. [DOI] [PubMed] [Google Scholar]
  36. Parker KL, Chen K-H, Kingyon JR, Cavanagh JF, and Narayanan NS (2014). D1-Dependent 4 Hz Oscillations and Ramping Activity in Rodent Medial Frontal Cortex during Interval Timing. J. Neurosci 34, 16774–16783. doi: 10.1523/JNEUROSCI.2772-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Parker KL, Chen K-H, Kingyon JR, Cavanagh JF, andNaryanan NS (2015). Medial frontal ~4 Hz activity in humans and rodents is attenuated in PD patients and in rodents with cortical dopamine depletion. J. Neurophysiol, jn.00412.2015. doi: 10.1152/jn.00412.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Parker K,L, Kim Y, Kelley R,M, Nessler A,J, Chen K-H, Muller-Ewald V,A, et al. (2017). Delta-frequency stimulation of cerebellar projections can compensate for schizophrenia-related medial frontal dysfunction. Molecular Psychiatry, 647–655. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Rakitin BC, Gibbon J, Penney TB, Malapani C, Hinton SC, and Meek WH (1998). Scalar expectancy theory and peak-interval timing in humans. J Exp Psychol Anim Behav Process 24, 15–33. [DOI] [PubMed] [Google Scholar]
  40. Repovs G, Csemansky JG, and Barch DM (2011). Brain network connectivity in individuals with schizophrenia and their siblings. Biol. Psychiatry 69, 967–973. doi: 10.1016/j.biopsych.2010.11.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Rüsch N, Spoletini I, Wilke M, Bria P, Di Paola M, Di Iulio F, et al. (2007). Prefrontal-thalamic-cerebellar gray matter networks and executive functioning in schizophrenia. Schizophr. Res. 93, 79–89. doi: 10.1016/j.schres.2007.01.029. [DOI] [PubMed] [Google Scholar]
  42. Sandyk R (1993). Psychotic behavior associated with cerebellar pathology. Int. J. Neurosci 71, 1–7. [DOI] [PubMed] [Google Scholar]
  43. Schmahmann JD (1996). From movement to thought: anatomic substrates of the cerebellar contribution to cognitive processing. Hum Brain Mapp 4, 174–198. doi :. [DOI] [PubMed] [Google Scholar]
  44. Schmahmann JD (1998). Dysmetria of thought: clinical consequences of cerebellar dysfunction on cognition and affect. Trends Cogn. Sci. (Regul. Ed.) 2, 362–371. [DOI] [PubMed] [Google Scholar]
  45. Schutter DJLG, and van Honk J (2006). An electrophysiological link between the cerebellum, cognition and emotion: frontal theta EEG activity to single-pulse cerebellar TMS. Neuroimage 33, 1227–1231. doi: 10.1016/j.neuroimage.2006.06.055. [DOI] [PubMed] [Google Scholar]
  46. Stoodley CJ (2011). The Cerebellum and Cognition: Evidence from Functional Imaging Studies. The Cerebellum 11, 352–365. doi: 10.1007/s12311-011-0260-7. [DOI] [PubMed] [Google Scholar]
  47. Strick PL, Dum RP, and Fiez JA (2009). Cerebellum and Nonmotor Function. Annual Review of Neuroscience 32, 413–434. doi: 10.1146/annurev.neuro.31.060407.125606. [DOI] [PubMed] [Google Scholar]
  48. Tavano A, Grasso R, Gagliardi C, Triulzi F, Bresolin N, Fabbro F, et al. (2007). Disorders of cognitive and affective development in cerebellar malformations. Brain 130, 2646–2660. doi: 10.1093/brain/awm201. [DOI] [PubMed] [Google Scholar]
  49. Underwood E (2016). How the body learns to hurt. Science 354, 694. doi: 10.1126/science.354.6313.694. [DOI] [PubMed] [Google Scholar]
  50. van Driel J, Sligte IG, Linders J, Elport D, and Cohen MX (2015). Frequency Band-Specific Electrical Brain Stimulation Modulates Cognitive Control Processes. PLoS ONE 10, e0138984. doi: 10.1371/journal.pone.0138984. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Vasquez A, Malavera A, Doruk D, Morales-Quezada L, Carvalho S, Leite J, et al. (2016). Duration Dependent Effects of Transcranial Pulsed Current Stimulation (tPCS) Indexed by Electroencephalography. Neuromodulation 19, 679–688. doi: 10.1111/ner.12457. [DOI] [PubMed] [Google Scholar]
  52. Vöröslakos M, Takeuchi Y, Brinyiczki K, Zombori T, Oliva A, Fernández-Ruiz A, et al. (2018). Direct effects of transcranial electric stimulation on brain circuits in rats and humans. Nat Commun 9, 483. doi: 10.1038/s41467-018-02928-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Ward RD, Kellendonk C, Kandel ER, and Balsam PD (2011). Timing as a window on cognition in schizophrenia. Neuropharmacology. doi: 10.1016/j.neuropharm.2011.04.014. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES