Abstract
Auditory-based targeted cognitive training (TCT) is an effective and well-validated intervention for the treatment of cognitive impairment in schizophrenia patients. Improvements in higher-order cognition, reductions in symptom severity, and increases in psychosocial functioning secondary to TCT are thought to be driven by “bottom-up” enhancement of early auditory information processing (EAIP). Despite strong evidence of efficacy at the group level, there is significant variability in response to TCT, with few well-delineated biomarkers for predicting individual benefit. EEG biomarkers of EAIP are indicators of early-treatment sensitivity that predict full-course TCT outcome; however, further characterization is necessary for biomarker-guided clinical trials. The current study examined baseline and early-treatment sensitivity (i.e., change from baseline after 1hr) in theta band oscillatory activity to deviant stimuli as moderators of full course (30hr) TCT response in treatment-refractory schizophrenia patients randomly assigned to receive either treatment-as-usual (TAU; n = 22) or TAU augmented with TCT (n = 30). Theta evoked power and phase locking at baseline predicted patient improvements in global cognitive function after 30h of TCT. Decrease in theta activity to deviant stimuli after 1h of TCT predicted improvements in verbal learning after 30h. Exploratory analyses using EEG composite scores had high levels of sensitivity and specificity for identifying patients most likely to benefit from TCT. The integrity of baseline neurophysiologic activity associated with EAIP, as well as the sensitivity of the underlying circuity to change, likely reflects an intermediate therapeutic process underlying the effectiveness of TCT that can be used to predict patient response to treatment.
Keywords: Schizophrenia, targeted cognitive training, theta oscillations, early auditory information processing
1. Introduction
Cognitive impairment and psychosocial disability in schizophrenia and other psychotic disorders have been conceptualized as resulting from a core deficit in early auditory information processing (EAIP) (Braff & Light, 2004; Thomas et al., 2017). Auditory-based targeted cognitive training (TCT) is an effective treatment for improving EAIP through progressive and adaptive tuning of the underlying neural circuitry (Bell, Bryson, & Wexler, 2017; Fisher, Herman, Stephens, & Vinogradov, 2016; Fisher, Holland, Subramaniam, & Vinogradov, 2010; Thomas, Bismark, et al., 2018; Thomas, Treichler, et al., 2018). In turn, TCT-induced improvements in EAIP lead to “bottom-up” gains in higher order cognitive functioning, reductions in clinical symptoms, and improvements in psychosocial functioning (Suga, Nishimura, Kawakubo, Yumoto, & Kasai, 2016; Thomas, Bismark, et al., 2018; Thomas, Treichler, et al., 2018). Although response rates to TCT remain variable, advances in experimental therapeutics have identified several well-validated candidate biomarkers of EAIP which have shown preliminary evidence of both malleable change secondary to TCT, as well as predictive utility for patient outcomes (Biagianti et al., 2017, 2016; Hochberger et al., 2019; Jahshan et al., 2019; Medalia et al., 2019; Perez et al., 2017).
Biomarkers of EAIP reflecting neural system engagement during TCT can be separated into baseline and early-treatment (first-dose) indicators, with some measures predicting treatment outcome. For example, baseline EAIP integrity (reflected by performance on the Tone Matching Test) moderates patient gains in verbal learning, but not global cognitive function or symptoms (Medalia et al., 2019). In addition, the efficiency of baseline auditory processing predicts global and focal cognitive improvements following TCT (Biagianti et al., 2016). Event-related potential (ERP) markers of central auditory system plasticity and discriminability involved in EAIP (mismatch negativity [MMN] and P3a) demonstrate utility in predicting patient outcomes from TCT. Baseline MMN activity predicts global cognitive improvement following TCT (Biagianti et al., 2017), while our prior research has shown that MMN and P3a are malleable in response to the first-dose (1h) of TCT, and that the degree of this sensitivity predicts patient improvements in both verbal learning and reductions in positive symptom severity (Hochberger et al., 2019; Perez et al., 2017).
Deficits in the constituent oscillatory elements of the MMN-P3a response complex are also linked to EAIP in patients with schizophrenia (Hochberger et al., 2019; Javitt et al., 2016; Kaser et al., 2013). Specifically, the strength (evoked power) and inter-trial consistency (phase-locking) in theta oscillations to deviant stimuli and the mismatch difference wave, thought to reflect the integrity of deviance detection during EAIP, have strong and unique relationships to premorbid function, current cognitive ability, and key domains of clinical outcome in schizophrenia patients (Hochberger et al., 2019; Javitt et al., 2016, 2008). Decomposing EAIP into its constituent oscillatory activity offers a distinct advantage of furthering downward translation and characterization of the underlying neural circuitry hypothesized to be engaged by TCT (Javitt, 2015; Kirihara, Rissling, Swerdlow, Braff, & Light, 2012). The utility of oscillatory activity underlying EAIP in predicting TCT outcome, however, has not been examined.
We have previously reported a favorable response to TCT in this cohort (Thomas, Bismark, et al., 2018), as well as first-dose (1h) sensitivity in MMN and P3a predicting full-course (30h) treatment outcome in patients who underwent TCT (Hochberger et al., 2019). The current study therefore aimed to characterize the relationship between oscillatory EEG activity and TCT outcome. Based on our prior reports (Hochberger et al., 2019), we hypothesized that TCT would induce sensitive early-treatment (1h) change in theta-based power and phase-locking to all deviant and difference-wave stimuli, that the degree of this first-dose sensitivity in deviant-related oscillatory EEG would predict post-treatment improvements in verbal learning, and that baseline oscillatory EEG activity would predict improvements in global cognition for patients who underwent TCT. Finally, exploratory analyses were conducted in order to determine whether or not composite indices reflecting baseline and early-treatment sensitivity predictors could be developed with sufficient sensitivity and specificity to predict clinically significant benefit from TCT.
2. Methods
2.1. Participants and Design
Detailed report of the current clinical trial and outcomes is described in Thomas et al. (2018). Briefly, patients with chronic schizophrenia or schizoaffective disorder were recruited from a residential treatment program and assigned to receive either treatment-as-usual (TAU; n = 22) or TAU augmented with TCT (n = 30). Group assignment was determined stratified random sampling (based on age, gender, and ethnicity). The Institutional Review Board of University of California, San Diego approved all experimental procedures (IRB#130874).
2.2. Targeted Cognitive Training
The current training program involved 6 modules from BrainHQ by Posit Science divided over 3–5 one-hour sessions per week for an approximately total of 30 hours of training. Each module used an adaptive algorithm in order to progressively modify item difficulty – ensuring participants were being sufficiently challenged based on any baseline deficit as well as improvements. For full details, see Thomas et al. (2018).
2.3. Cognitive and Symptom Assessment
The MATRICS Consensus Cognitive Battery (MCCB) (Kern et al., 2011; Nuechterlein et al., 2008) and the Scale for the Assessment of Positive Symptoms (SAPS) (N. Andreasen, 1984) and Negative Symptoms (SANS) (N. C. Andreasen, 1989) were administered to patients at baseline (TBaseline) and upon completion of the study (TPost). Consistent with prior research on this same sample, the MCCB global cognitive composite and verbal learning t-scores (corrected for age and sex) were the primary outcomes.
2.4. EEG Recording
Details of the passive auditory oddball paradigm and EEG recording procedures are described in detail by Hochberger et al. (2019). Data was collected from a 64 channel BioSemi ActiveTwo System with a sampling rate of 1 kHz. Eye blinks and movements were recorded using four additional electrodes placed above and below the left eye and the outer canthi of both eyes. Data was collected during a passive auditory oddball paradigm consisting of a pseudorandom sequence of tones including a standard stimulus (P = 0.70, 50ms duration at 1000Hz), and five distinct types of deviant stimuli (P = 0.30). These deviant stimuli consisted of a duration deviant (125ms duration at 1000Hz) and four novel “pitch sweep deviants” designed to reflect the TCT module of the same name, and were included in order to increase ecological validity. These sweep deviants varied in terms of starting at the standard tone (1000Hz) or a deviant tone (500Hz or 1500Hz), and the direction of the change in pitch (up vs. down) across the sweep. EEG activity across each of the sweep deviants was averaged as there were no significant differences in either evoked power or phase locking across sweep type (p > 0.05). A minimum of 400 duration deviant and 200 of each type of the four distinct sweep deviant trials were collected for each participant. All patients underwent EEG recording at baseline (TBaseline), after their initial completion of either 1 hour of cognitive training (TCT) or 1 hour of computer games (TAU) (TInitial), and upon study completion (TPost).
2.5. EEG Processing
Pre-processing utilized a digital filter with a 0.5Hz low-cutoff (12dB/oct). Eye movement artifacts were removed via an ocular ICA procedure, with additional removal of segments with residual artifacts exceeding +/− 100μV. Difference waves were calculated by subtracting ERP‟s in response to standard tones from those in response to deviant tones. All measures were extracted from a frontal composite (derived from the mean activity of electrodes F1, Fz, F2, FC1, FCZ, FC2, C1, CZ, and C2) across an epoch from −100 to 500ms. Post-processing of stimulus-locked time-frequency data consisted of Morlet Complex Wavelet analyses (parameter = 7) from 1–50Hz using 50 logarithmic frequency steps. Review of grand average broadband time-frequency plots evidenced theta-band activity (4–7Hz) as the principal signal in both evoked power and phase locking with no significant activity or group differences in other frequency bands (supplemental figures 1 & 2). As such, the mean activity in the 4–7Hz frequency layer over the 125–225ms time window, where overall activity and group differences appeared the largest, was extracted for use in subsequent analyses.
2.6. Statistical Analyses
2.6.1. Sensitivity to change in evoked power and phase-locking
The sensitivity (i.e., change over time) of oscillatory EEG secondary to TCT was assessed using linear mixed-models (Hox, 2010) for each dependent variable (duration deviant evoked power and phase locking, duration deviant difference wave evoked power, all sweep deviant evoked power and phase locking, all sweep deviant difference wave evoked power). Each model was fit using the „lme4‟ package in R (Bates, Mächler, Bolker, & Walker, 2015) and included a linear effect of time (TBaseline, TInitial, and TPost) as a fixed factor with a random intercept for time. Effect sizes for linear mixed models were calculated using R2 in the „MuMIn‟ package (Bartoń, 2018) (small = 0.02, medium = 0.25, large = 0.40) (Cohen, 1988). These values consisted of both conditional R2 (R2C: variance explained by both the fixed and random factors), and marginal R2 (R2M: variance explained by the fixed factors alone).
2.6.2. Prediction of TCT outcome
To determine the predictive utility of theta-band oscillatory EEG difference scores in cognition and clinical symptoms were computed by subtracting baseline (TBaseline) from post-TCT (TPost) treatment values. Following our established methods (Hochberger et al., 2019; Perez et al., 2017), early EEG sensitivity was calculated by subtracting activity in the session recorded immediately before (TBaseline) from the recording that immediately followed the initial 1h exposure to TCT (TInitial). Regression models were used to predict change in MCCB global cognition and verbal learning t-scores, from the early sensitivity in in theta evoked power and phase locking across each waveform (duration deviant, sweep deviant, duration and sweep deviant difference waves). Consistent with our prior methods (see Hochberger et al., 2019), separate regression models were used for TCT and TAU. Effect sizes for regression analyses are reported as standardized regression coefficients (β: small = 0.02, medium = 0.25, large = 0.40) (Cohen, 1988).
3. Results
3.1. Oscillatory EEG Sensitivity Secondary to TCT
For duration deviant stimuli both evoked power (b = −37.35, SE = 18.26, t = −2.04, df = 49.88, p = 0.046, R2M = 0.015, R2C = 0.75) and phase locking (b = −0.04, SE = 0.012, t = −3.25, df = 49.72, p = 0.002, R2M = 0.035, R2C = 0.77) showed significant decreases over time (T0, TInitial, TBaseline). Evoked power to the duration deviant difference waveform also significantly decreased over time (b = −78.40, SE = 24.80, t = −3.16, df = 49.95, p = 0.003, R2M = 0.041, R2C = 0.72). Conversely, for sweep deviant stimuli, neither evoked power (b = −17.16, SE = 18.34, t = −0.94, df = 48.88, p = 0.35, R2M = 0.003, R2C = 0.86) nor phase locking (b = −0.018, SE = 0.012, t = −1.43, df = 49.08, p = 0.16, R2M = 0.008, R2C = 0.81) showed a significant linear effect of time. However, there was a significant increase evoked power to the sweep deviant difference waveform over time (b = −47.74, SE = 17.20, t = −2.78, df = 48.60, p = 0.008, R2M = 0.013, R2C = 0.89) (see Supplemental Figures 1 & 2).
3.2. Predictors of TCT Outcome
3.2.1. Baseline predictors of global cognitive change
Sweep deviant theta evoked power at baseline (TBaseline) predicted improvements in MCCB global cognition for patients who underwent TCT (R2 = 0.19, β = 0.44, F [1,20] = 4.53, p = 0.047, 95% CIB [0.00, 0.023]) but not those in TAU (R2= 0.006, β = 0.076, F [1,18] = 0.099, p = 0.76, 95% CIB [−0.14, 0.019]) (Figure 1A). Similarly, phase-locking to duration and sweep deviant stimuli at baseline (TBaseline) predicted improvements in MCCB global cognition for patients who underwent TCT (duration deviant: R2 = 0.19, β = 0.43, F [1,20] = 4.33, p = 0.05, 95% CIB [−0.16, 55.76]; sweep deviant: R2 = 0.29, β = 0.54, F [1,20] = 7.68, p = 0.012, 95% CIB [6.48, 46.48]) but not TAU (duration deviant: R2 = 0.011, β = 0.10, F [1,18] = 0.19, p = 0.67, 95% CIB [−29.77, 45.00]; sweep deviant: R2 = 0.008, β = −0.091, F [1,18] = 0.14, p = 0.71, 95% CIB [−41.57, 28.94]) (Figure 1B). All other models predicting MCCB global cognitive change were non-significant (p > 0.05).
Figure 1.
a. Baseline theta evoked power to sweep stimuli predicts improvements in global cognition for patients who underwent TCT. Shaded regions represent the standard error of the regression line.
b. Baseline theta phase-locking to duration deviant stimuli predicts improvements in global cognition for patients who underwent TCT. Shaded regions represent the standard error of the regression line.
3.2.2. Early-treatment sensitivity predicting verbal learning change
For patients who underwent TCT, sensitivity (TInitial – TBaseline) in sweep deviant theta evoked power (R2 = 0.19, β = −0.44, F [1,20] = 4.47, p = 0.048, 95% CIB [−0.053, 0.00]) and theta evoked power to the sweep deviant difference waveform (R2 = 0.21, β = −0.46, F [1,20] = 5.09, p = 0.036, 95% CIB [−0.057, −0.002) both significantly predicted improvement in MCCB verbal learning (Figure 2). This pattern was not seen in patients who underwent TAU (sweep deviant evoked power: R2 = 0.010, β = 0.10, F [1,17] = 0.16, p = 0.69, 95% CIB [−0.038, 0.056]; sweep deviant difference waveform evoked power: R2 = 0.00, β = −0.009, F [1,17] = 0.97, p = 0.001, 95% CIB [−0.054, .052]). All other models predicting change in MCCB verbal learning change were non-significant (p > 0.05).
Figure 2.
Sensitivity to change in theta evoked power to the sweep deviant stimuli difference waveform predicts improvements in verbal learning for patients who underwent TCT. Shaded regions represent the standard error of the regression line.
3.2.3. Exploratory EEG Composite Score Analyses
Across the current study and our prior work (Hochberger et al., 2019) we identified two distinct classes of EEG biomarkers that were significant predictors of TCT outcome. These included: 3 baseline predictors of global cognition improvement (duration and sweep deviant phase locking, sweep deviant evoked power), and 4 early-treatment predictors of verbal learning improvement (duration MMN latency, duration P3a amplitude, sweep deviant theta evoked power, sweep deviant difference wave evoked power). These biomarkers were entered into separate regression models (predicting MCCB global cognition and verbal learning T-score change) in patients who underwent TCT. The standardized predicted values from each model were then saved and used as regression-weighted baseline and early-treatment sensitivity indices. The baseline EEG composite score significantly predicted improvements in global cognition (R2 = 0.31, β = 0.56, F [1,20] = 8.61, p = 0.009, 95% CIB [1.21,7.23]), the early-treatment sensitivity EEG composite score significantly predicted improvements in verbal learning (R2 = 0.41, β = 0.64, F [1,14] = 9.09, p = 0.010, 95% CIB [0.88, 5.38]). Further, each composite score was able to screen for the presence of true cognitive improvements (defined as Cohen‟s d ≥ 0.2 via established methods, see Keefe et al., 2017 and Vinogradov et al, 2012) in MCCB global cognition (AUC = 80.6%, p = 0.02, 95%CIAUC [0.62, 0.99]) and verbal learning scores (AUC = 87.3%, p = 0.02, 95%CIAUC [0.66, 1.00]). For baseline activity, ROC analyses demonstrated that a cutoff of z ≥ −0.38 provided 83% sensitivity and 67% specificity in detecting positive gains in global cognition; whereas for early-treatment sensitivity a cutoff of z ≥ −0.55 provided 91% sensitivity and 80% specificity in detecting positive gains in verbal learning secondary to TCT. Full estimates of specificity and sensitivity based on specific composite score cutoffs can be found in Figure 3.
Figure 3.
ROC curve for EEG composite z-scores (baseline and sensitivity to change) cutoffs that can be used to detect true cognitive improvements (Cohen’s d ≥ 0.2; ≥ 2 t-score) in global cognition and verbal learning for patients who underwent TCT.
4. Discussion
Advances in procognitive therapeutics have identified baseline and early-treatment neurophysiologic measures of EAIP target engagement that can be used to predict and monitor patient response to TCT (Biagianti et al., 2017, 2016; Hochberger et al., 2019; Medalia et al., 2019; Perez et al., 2017). The current study extends our previous findings of EAIP biomarkers by decomposing event-related potential components into their constituent oscillatory dynamics. Our results demonstrate that theta oscillations underlying the mismatch negativity-P3a auditory deviance response complex (Rissling et al., 2014) measured at the outset of TCT treatment predict patient gains in both global and focal cognitive domains after a full course (30h) of treatment. Baseline theta evoked power and phase locking predicted global cognitive change, while the sensitivity of theta evoked power after the first exposure to the auditory training exercises predicted focal cognitive change in verbal learning. Composite indices accounted for 31.2% of the variance in global cognition improvements and 41.2% of the variance in verbal learning improvements, both with excellent sensitivity and specificity in predicting clinically significant gains from TCT.
4.1. Oscillatory EEG and TCT
Both event-related (MMN, P3a) and oscillatory (theta-band) EEG activity elicited during passive auditory oddball paradigms are robust, reliable, and valid biomarkers of EAIP target engagement (Hochberger et al., 2019; Light et al., 2015; Light and Näätänen, 2013a). Further, these EAIP-related EEG deficits are core endophenotypes of schizophrenia with well-documented relationships to cognitive and clinical function (Green et al., 2004; Hochberger et al., 2019; Javitt et al., 2016; Kawakubo et al., 2007; Lavoie et al., 2017; Light et al., 2012; Light and Näätänen, 2013b; Rissling et al., 2014; Salisbury and McCathern, 2016; Thomas et al., 2017). Consistent with recent research suggesting that EAIP-related EEG activity reflects an intermediate therapeutic process in TCT, theta oscillatory activity evidenced significant sensitivity in both evoked power and phase-locking across the full course of treatment, with the greatest changes occurring after the first 1h “dose” of TCT. Taken together with our prior findings showing a similar pattern of MMN and P3a sensitivity (Hochberger et al., 2019; Perez et al., 2017), and recent findings of source redistribution in EEG-associated EAIP neurocircuitry (Perez, Miyakoshi, Makeig, & Light, 2019), it is possible that the neuroplastic effects of TCT reflect an enhancement and dynamic reorganization of the underlying EAIP neurocircuitry, resulting in improvements in cognitive function (Fisher et al., 2010; Hochberger et al., 2019; Javitt et al., 1996; Kaser et al., 2013; Perez et al., 2019, 2014; Todd et al., 2013).
The sensitivity of theta evoked power after the first-dose (1h) of TCT significantly predicted patient gains in verbal learning from full-course (30h) treatment. These findings highlight the potential to use neurophysiologic biomarkers to identify individuals who are both acutely sensitive and initially responsive to an intervention and carrying them forward to receive longer-term, therapeutic doses of the intervention in biomarker guided clinical trial designs (Hochberger et al., 2019; Perez et al., 2017). Interestingly, despite no marginal effect of TCT on global cognition at the group level (Thomas, Bismark, et al., 2018), the current data found that baseline theta evoked power and phase-locking predicted individual changes in global cognitive functioning secondary to TCT. Thus, patient responsivity to sensory stimuli also has a trait-like utility for predicting global cognitive improvement. Although baseline (trait) MMN activity has been demonstrated to predict global cognitive improvement following TCT (Biagianti et al., 2017), these data are the first to extend these findings to the constituent oscillatory dynamics underlying EAIP, as well as assess both baseline and early-treatment sensitivity measures as predictors of a full course of TCT.
4.2. Implications for gauging patient response to TCT
Patient improvements in cognitive functioning, symptom severity, and functional outcome at the group level are well-documented (Fisher et al., 2016; Mcgurk, Twamley, Sitzer, Mchugo, & Mueser, 2007; Thomas, Bismark, et al., 2018; Thomas, Treichler, et al., 2018; Wykes et al., 2011) despite the high variability in individual responses (Murthy et al., 2012). Biomarker-guided clinical trials have identified several neurophysiologic measures of EAIP target engagement that can be used as individualized predictors of TCT outcome (Biagianti et al., 2017; Hochberger et al., 2019; Perez et al., 2017). Our results support the use of multiple neurophysiologic features at baseline and following initial exposure to TCT as an effective means of determining, at the outset of treatment, individuals who are most likely to benefit from therapeutic “doses” of TCT. Baseline evaluation would serve the role of establishing the general propensity for patient cognitive change secondary to the intervention, while assessment of early-treatment sensitivity would directly evaluate a patient‟s individual neural system engagement in response to the specific modality of TCT. Further, this stage-based model would allow for multiple points of triage for future research examining points of enhancement in patient treatment response (e.g., pharmacologic augmentation, adjunct psychosocial interventions, etc.) (Swerdlow, Bhakta, & Light, 2018).
Combined with our prior work (see Hochberger et al., 2019), a total of 3 separate baseline EEG biomarkers, 4 separate early-treatment EEG biomarkers, were derived that could be used to predict patient improvements in global cognition and verbal learning respectively. Exploratory analyses using a standardized regression-weighted “sensitivity index” for monitoring the likelihood of improvements secondary to TCT was able to account for approximately 31.2% of the variance in TCT-related global cognition gains, and 41.2% of the variance in TCT-related verbal learning gains. When used as a screening measure to determine the likelihood of a patient benefiting from TCT, these indices presented with high levels of sensitivity and specificity (see Figure 3). It is possible that these composite scores could thus be used to screen patients at baseline and after the first dose of TCT as a gauge of full course TCT response, informing the appropriateness of continued treatment. However, results from these exploratory analyses are tentative pending validation and refinement in a more robust sample combined with additional demographic, clinical, cognitive, or neurophysiologic variables.
4.3. Limitations
The current findings should be interpreted in the context of some limitations. First, symptom acuity and severity have been suggested as possible moderators of TCT outcome (Lindenmayer et al., 2017), and are particularly relevant to the current study given the cohort of treatment refractory patients recruited from a community-based inpatient care facility. However, prior report on this same sample did not find that symptom severity significantly moderated TCT outcome (Thomas, Bismark, et al., 2018). Findings from this current study, while important in demonstrating significant TCT benefit among impaired cohorts of patients who need cognitive training the most, might not apply to early illness or less impaired patient populations, particularly given the heterogeneity and complexity of patients and possible secondary impacts on TCT. Nonetheless, the use of combining multiple neurophysiologic features at baseline and following initial exposure to TCT, presents a promising model for ongoing evaluation of patient outcomes. Second, as noted in our prior reports, attrition was higher in patients who underwent TCT compared to TAU; however, no significant clinical or demographic predictors of attrition could be identified. Thus, it is likely that the higher attrition rate was secondary to the higher time demands required for daily participation in TCT, rather than the intervention itself (Thomas, Bismark, et al., 2018; Thomas, Treichler, et al., 2018).
4.4. Future Directions
Although no dose-dependent TCT response was observed in the current study (Thomas, Bismark, et al., 2018) other studies have suggested that more intensive and comprehensive dosing of TCT yields greater stability of long-term gains (Fisher, Holland, Merzenich, & Vinogradov, 2009; Fisher et al., 2010; Vinogradov, Fisher, & De Villers-Sidani, 2012). In addition, although several biomarkers have been proposed to moderate TCT outcome, none of this research has been examined continuously across TCT training sessions, and there is little research examining the long-term stability of the malleability in these EEG biomarkers. Future research would thus benefit from continuous examination of the dose-response relationship to TCT, its intersection with EEG biomarkers predictive of TCT, and the potential stability of the observed sensitivity in EEG activity. Preliminary research examining changes in the EAIP-associated EEG neural substrates have also suggested that TCT induces a dynamic reorganization of the neural architecture and associated resource allocation (Perez et al., 2019) which holds notable benefit for further refinement of potential EEG profiles that can be used to accurately and efficiently gauge patient response to TCT and other procognitive interventions. Finally, validation of the “TCT sensitivity indices” proposed in the current study, particularly regarding the calculation of clinically relevant change thresholds (i.e.: sensitivity and specificity), remains a key step in advancing the clinical application of TCT and improving patient outcomes.
4.5. Conclusion
The advent and refinement of valid and reliable biomarkers that can be used to predict and gauge patient response to procognitive interventions has brought with it the start of a veritable “golden age” of procognitive therapeutics (Vinogradov, Fisher, & Nagarajan, 2013). Both event-related and oscillatory EEG activity underlying EAIP have been shown to undergo malleable change secondary to TCT. These EEG biomarkers have been demonstrated to predict full-course treatment gains in focal and global cognitive ability in patients with treatment refractory schizophrenia. A tentative optimization of these biomarkers in the form of regression-weighted EEG composite scores also demonstrated utility with high levels of specificity and sensitivity in detecting improvements in global cognition and verbal learning in patients; however, these findings were merely exploratory – replication and validation on a more robust sample is needed before any firm conclusions can be drawn. Despite this, the present results provide an important foundation for the development of clinically relevant neurophysiologic biomarkers that can be applied to refine clinical practice and patient outcomes.
Supplementary Material
Table 1.
Comparison of clinical and demographic variables across patient groups.
Treatment-As-Usual (TAU) n=22 |
Targeted Cognitive Training (TCT) n=30 |
Significance | Effect Size | |
---|---|---|---|---|
Mean (SD) | Mean (SD) | |||
Age (years) | 35.73 (13.00) | 33.90 (11.50) | n.s. | 0.0007 |
Education (years) | 11.95 (2.17) | 11.83 (1.91) | n.s. | 0.017 |
WRAT: Reading SS | 91.95 (13.34) | 91.37 (13.60) | n.s. | 0.005 |
Gender | ||||
Male | 40.9% | 50.0% | n.s. | 0.045 |
Female | 59.1% | 50.0% | ||
Race | ||||
Caucasian | 54.5% | 50.0% | n.s. | 0.102 |
African-American | 13.6% | 13.3% | ||
Other | 31.8% | 36.7% | ||
Clinical Diagnosis | ||||
Schizophrenia | 54.5% | 53.3% | n.s. | 0.012 |
Schizoaffective | 45.5% | 46.7% | ||
Disorder | ||||
Age of Onset (years) | 20.5 (4.96) | 18.07 (5.09) | n.s. | 0.061 |
Illness Duration (years) | 15.23 (12.79) | 16.32 (12.89) | n.s. | 0.002 |
SAPS Global Score | 4.45 (5.14) | 5.04 (4.07) | n.s. | 0.002 |
SANS Global Score | 6.18 (3.79) | 7.43 (4.33) | n.s. | 0.035 |
WRAT: Reading = Wide-Range Achievement Test, 4th Edition, Reading Subtest SAPS = Scale for the Assessment of Positive Symptoms
SANS = Scale for the Assessment of Negative Symptoms
Effect size reported is partial eta-squared for continuous variables, Cramer’s phi for categorical variables
Table 2.
Regression coefficients (R2) for all regression models predicting change (TInitial – TBaseline) in cognitive outcomes across groups.
Treatment-As-Usual (TAU) | Targeted Cognitive Training (TCT) | ||
---|---|---|---|
Outcome | Predictor | ||
Global Cognition | Baseline Sweep Deviant Evoked Power | 0.01 | 0.19* |
Baseline Sweep Deviant Phase Locking | 0.01 | 0.29* | |
Baseline Sweep Deviant Difference Wave Power | 0.02 | 0.12 | |
Baseline Duration Deviant Evoked Power | 0.01 | 0.14 | |
Baseline Duration Deviant Phase Locking | 0.01 | 0.19* | |
Baseline Duration Deviant Difference Wave Evoked Power | 0.01 | 0.12 | |
Verbal Learning | Sweep Deviant Evoked Power Sensitivity | 0.01 | 0.19* |
Sweep Deviant Phase Locking Sensitivity | < 0.01 | 0.01 | |
Sweep Deviant Difference Wave Power Sensitivity | < 0.01 | 0.21* | |
Duration Deviant Evoked Power Sensitivity | 0.12 | 0.02 | |
Duration Deviant Phase Locking Sensitivity | 0.01 | < 0.01 | |
Duration Deviant Difference Wave Evoked Power Sensitivity | 0.04 | < 0.01 |
p < 0.05
Acknowledgements
Research reported in this publication was supported by the Department of Veterans Affairs Office of Academic Affiliations Advanced Fellowship Program in Mental Illness Research and Treatment, the Medical Research Service of the Veterans Affairs San Diego Health Care System, the Department of Veterans Affairs Desert-Pacific Mental Illness Research, Education, and Clinical Center (MIRECC), the Sidney R. Baer, Jr. Foundation, the Brain and Behavior Research Foundation, and the National Institute of Mental Health of the National Institutes of Health (K23 MH102420). The authors also wish to thank George B. Handran and the Sidney R. Baer, Jr. Foundation for their generous support of this research. We also wish to thank all of the participants and non-author support staff that made this study possible, including the following key personnel: Sean Pianka, Marlena Pela, Sonia Rackelmann, and Alexandra L. Shiluk.
Role of the funding source
Other than providing support, funding sources for the current manuscript and study did not have any further role in the writing of this manuscript.
Research reported in this publication was supported by the Sidney R. Baer, Jr. Foundation, the Brain and Behavior Research Foundation, VISN-22 Mental Illness Research Education and Clinical Center (MIRECC), and National Institute of Mental Health of the National Institutes of Health (K23 MH102420). Dr. Light reports having been a consultant to Astellas, Boehringer-Ingelheim, Dart Neuroscience, Heptares, Lundbeck, Merck, NeuroSig, Neuroverse, Takeda, and the National Aeronautics and Space Administration (NASA). The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Conflicts of Interest
There are no competing financial interests in relation to the work described, and the authors have no conflicts of interest to declare.
References
- Andreasen N (1984). The Scale for the Assessment of Positive Symptoms (SAPS). The University of Iowa, 1–2.
- Andreasen NC (1989). Scale for the Assessment of Negative Symptoms (SANS). British Journal of Psychiatry, 155(NOV. SUPPL. 7), 53–58. [PubMed] [Google Scholar]
- Bartoń K (2018). Package “MuMIn”: Multi-Model Inference. Cran-R https://doi.org/Available at www.cran.r-project.org/web/packages
- Bates D, Mächler M, Bolker B, & Walker S (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software. 10.18637/jss.v067.i01 [DOI] [Google Scholar]
- Bell M, Bryson G, & Wexler BE (2017). Cognitive remediation of working memory deficits: durability of training effects in severely impaired and less severely impaired schizophrenia. Schizophrenia Research, 57(1), 805–811. [DOI] [PubMed] [Google Scholar]
- Biagianti B, Fisher M, Neilands TB, Loewy R, & Vinogradov S (2016). Engagement with the auditory processing system during targeted auditory cognitive training mediates changes in cognitive outcomes in individuals with schizophrenia. Neuropsychology, 30(8), 998–1008. 10.1037/neu0000311 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Biagianti B, Roach BJ, Fisher M, Loewy R, Ford JM, Vinogradov S, & Mathalon DH (2017). Trait aspects of auditory mismatch negativity predict response to auditory training in individuals with early illness schizophrenia. Neuropsychiatric Electrophysiology, 3(2). 10.1186/s40810-017-0024-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Braff DL, & Light GA (2004). Preattentional and attentional cognitive deficits as targets for treating schizophrenia. Psychopharmacology. 10.1007/s00213-004-1848-0 [DOI] [PubMed] [Google Scholar]
- Cohen J (1988). Statistical power for the social sciences. Hillsdale, NJ: Laurence Erlbaum and Associates. [Google Scholar]
- Fisher M, Herman A, Stephens DB, & Vinogradov S (2016). Neuroscience-informed computer-assisted cognitive training in schizophrenia. Annals of the New York Academy of Sciences, 1366(1), 90–114. 10.1111/nyas.13042 [DOI] [PubMed] [Google Scholar]
- Fisher M, Holland C, Merzenich MM, & Vinogradov S (2009). Using Neuroplasticity-Based Auditory Training to Improve Verbal Memory in Schizophrenia. American Journal of Psychiatry, 166(7), 805–811. 10.1176/appi.ajp.2009.08050757.Using [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fisher M, Holland C, Subramaniam K, & Vinogradov S (2010). Neuroplasticity-based cognitive training in schizophrenia: An interim report on the effects 6 months later. Schizophrenia Bulletin, 36(4), 869–879. 10.1093/schbul/sbn170 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green MF, Kern RS, & Heaton RK (2004). Longitudinal studies of cognition and functional outcome in schizophrenia: Implications for MATRICS. Schizophrenia Research, 72(1), 41–51. 10.1016/j.schres.2004.09.009 [DOI] [PubMed] [Google Scholar]
- Hochberger WC, Joshi YB, Thomas ML, Zhang W, Bismark AW, Treichler EBH, … Light GA (2019). Neurophysiologic measures of target engagement predict response to auditory-based cognitive training in treatment refractory schizophrenia. Neuropsychopharmacology, 44(2), 606–612. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hochberger WC, Joshi YB, Zhang W, Thomas ML, Braff DL, Swerdlow NR, & Light GA (2019). Decomposing the constituent oscillatory dynamics underlying mismatch negativity generation in schizophrenia: Distinct relationships to clinical and cognitive functioning. International Journal of Psychophysiology. 10.1016/j.ijpsycho.2018.12.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hox J (2010). Multilevel analysis - Techniques and applications. Multilevel analysis techniques and applications.
- Jahshan C, Vinogradov S, Wynn JK, Hellemann G, & Green MF (2019). A randomized controlled trial comparing a “bottom-up” and “top-down” approach to cognitive training in schizophrenia. Journal of Psychiatric Research. 10.1016/j.jpsychires.2018.11.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Javitt DC (2015). Neurophysiological models for new treatment development in schizophrenia: Early sensory approaches. Annals of the New York Academy of Sciences. 10.1111/nyas.12689 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Javitt DC, Lee M, Kantrowitz JT, & Martinez A (2016). Mismatch negativity as a biomarker of theta band oscillatory dysfunction in schizophrenia. Schizophrenia Research, 191, 51–60. 10.1016/j.schres.2017.06.023 [DOI] [PubMed] [Google Scholar]
- Javitt DC, Spencer KM, Thaker GK, Winterer G, & Hajos M (2008). Neurophysiological biomarkers for drug development in schizophrenia. Nature Reviews Drug Discovery, 7, 68–83. 10.1038/nrd2463 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Javitt DC, Steinschneider M, Schroeder CE, & Arezzo JC (1996). Role of cortical N-methyl-D-aspartate receptors in auditory sensory memory and mismatch negativity generation: implications for schizophrenia. Proceedings of the National Academy of Sciences of the United States of America, 93(21), 11962–11967. 10.1073/pnas.93.21.11962 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaser M, Soltesz F, Lawrence P, Miller S, Dodds C, Croft R, … Nathan PJ (2013). Oscillatory underpinnings of mismatch negativity and their relationship with cognitive function in patients with schizophrenia. PLoS ONE, 8(12), 1–11. 10.1371/journal.pone.0083255 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kawakubo Y, Kamio S, Nose T, Iwanami A, Nakagome K, Fukuda M, … Kasai K (2007). Phonetic mismatch negativity predicts social skills acquisition in schizophrenia. Psychiatry Research. 10.1016/j.psychres.2006.02.010 [DOI] [PubMed] [Google Scholar]
- Kern RS, Gold JM, Dickinson D, Green MF, Nuechterlein KH, Baade LE, … Marder SR (2011). The MCCB impairment profile for schizophrenia outpatients: Results from the MATRICS psychometric and standardization study. Schizophrenia Research, 126(1–3), 124–131. 10.1016/j.schres.2010.11.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kirihara K, Rissling AJ, Swerdlow NR, Braff DL, & Light GA (2012). Hierarchical organization of gamma and theta oscillatory dynamics in schizophrenia. Biological Psychiatry. 10.1016/j.biopsych.2012.01.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lavoie S, Jack BN, Griffiths O, Ando A, Amminger P, Couroupis A, … Whitford TJ (2017). Impaired mismatch negativity to frequency deviants in individuals at ultra-high risk for psychosis, and preliminary evidence for further impairment with transition to psychosis. Schizophrenia Research, 191, 95–100. 10.1016/j.schres.2017.11.005 [DOI] [PubMed] [Google Scholar]
- Light GA, & Näätänen R (2013a). Mismatch negativity is a breakthrough biomarker for understanding and treating psychotic disorders. Proceedings of the National Academy of Sciences, 110(38), 15175–15176. 10.1073/pnas.1313287110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Light GA, & Näätänen R (2013b). Mismatch negativity is a breakthrough biomarker for understanding and treating psychotic disorders. Proceedings of the National Academy of Sciences, 110(38), 15175–15176. 10.1073/pnas.1313287110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Light GA, Swerdlow NR, Thomas ML, Calkins ME, Green MF, Greenwood TA, … Turetsky BI (2015). Validation of mismatch negativity and P3a for use in multi-site studies of schizophrenia: Characterization of demographic, clinical, cognitive, and functional correlates in COGS-2. Schizophrenia Research, 163(1–3), 63–72. 10.1016/j.schres.2014.09.042 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Light Gregory A., Swerdlow NR, Rissling AJ, Radant A, Sugar CA, Sprock J, … Braff DL (2012). Characterization of neurophysiologic and neurocognitive biomarkers for use in genomic and clinical outcome studies of schizophrenia. PLoS ONE, 7(7). 10.1371/journal.pone.0039434 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lindenmayer J-P, Ozog VA, Khan A, Ljuri I, Fregenti S, & McGurk SR (2017). Predictors of response to cognitive remediation in service recipients with severe mental illness. Psychiatric Rehabilitation Journal, 40(1), 61–69. 10.1037/prj0000252 [DOI] [PubMed] [Google Scholar]
- Mcgurk S, Twamley E, Sitzer D, Mchugo G, & Mueser K (2007). A Meta-Analysis of Cognitive Remediation in Schizophrenia. American Journal of Psychiatry, 164(December), 1791–1802. 10.1176/appi.ajp.2007.07060906 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Medalia A, Saperstein AM, Qian M, & Javitt DC (2019). Impact of baseline early auditory processing on response to cognitive remediation for schizophrenia. Schizophrenia Research. 10.1016/j.schres.2019.01.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murthy NV, Mahncke H, Wexler BE, Maruff P, Inamdar A, Zucchetto M, … Alexander R (2012). Computerized cognitive remediation training for schizophrenia: An open label, multi-site, multinational methodology study. Schizophrenia Research, 139(1–3), 87–91. 10.1016/j.schres.2012.01.042 [DOI] [PubMed] [Google Scholar]
- Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen JD, … Marder SR (2008). The MATRICS consensus cognitive battery, part 1: Test selection, reliability, and validity. American Journal of Psychiatry, 165(2), 203–213. 10.1176/appi.ajp.2007.07010042 [DOI] [PubMed] [Google Scholar]
- Perez VB, Swerdlow NR, Braff DL, Näätänen R, & Light GA (2014). Using biomarkers to inform diagnosis, guide treatments and track response to interventions in psychotic illnesses. Biomarkers in Medicine, 8(1), 9–14. 10.2217/bmm.13.133 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perez VB, Tarasenko M, Miyakoshi M, Pianka ST, Makeig SD, Braff DL, … Light GA (2017). Mismatch Negativity is a Sensitive and Predictive Biomarker of Perceptual Learning during Auditory Cognitive Training in Schizophrenia. Neuropsychopharmacology, 42(11), 2206–2213. 10.1038/npp.2017.25 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perez V, Miyakoshi M, Makeig S, & Light G (2019). Mismatch Negativity Reveals Plasticity in Cortical Dynamics After 1-Hour of Auditory Training Exercises. International Journal of Psychophysiology. [DOI] [PubMed]
- Rissling AJ, Miyakoshi M, Sugar CA, Braff DL, Makeig S, & Light GA (2014). Cortical substrates and functional correlates of auditory deviance processing deficits in schizophrenia. NeuroImage: Clinical, 6, 424–437. 10.1016/j.nicl.2014.09.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salisbury DF, & McCathern AG (2016). Abnormal Complex Auditory Pattern Analysis in Schizophrenia Reflected in an Absent Missing Stimulus Mismatch Negativity. Brain Topography. 10.1007/s10548-016-0514-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Suga M, Nishimura Y, Kawakubo Y, Yumoto M, & Kasai K (2016). Magnetoencephalographic recording of auditory mismatch negativity in response to duration and frequency deviants in a single session in patients with schizophrenia. Psychiatry and Clinical Neurosciences, 70(7), 295–302. [DOI] [PubMed] [Google Scholar]
- Swerdlow NR, Bhakta S, & Light GA (2018). Room to move: Plasticity in early auditory information processing and auditory learning in schizophrenia revealed by acute pharmacological challenge. Schizophrenia Research, 199, 285–291. 10.1016/j.schres.2018.03.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas ML, Bismark AW, Joshi YB, Tarasenko M, Treichler EBH, Hochberger WC, … Light GA (2018). Targeted cognitive training improves auditory and verbal outcomes among treatment refractory schizophrenia patients mandated to residential care. Schizophrenia Research, 202, 378–384. 10.1016/j.schres.2018.07.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas ML, Green MF, Hellemann G, Sugar CA, Tarasenko M, Calkins ME, … Light GA (2017). Modeling Deficits From Early Auditory Information Processing to Psychosocial Functioning in Schizophrenia. JAMA Psychiatry, 74(1), 37 10.1001/jamapsychiatry.2016.2980 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas ML, Treichler EBH, Bismark A, Shiluk AL, Tarasenko M, Zhang W, … Light GA (2018). Computerized cognitive training is associated with improved psychosocial treatment engagement in schizophrenia. Schizophrenia Research, 202, 341–346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todd J, Harms L, Schall U, & Michie PT (2013). Mismatch negativity: Translating the potential. Frontiers in Psychiatry, 4, 171 10.3389/fpsyt.2013.00171 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vinogradov S, Fisher M, & De Villers-Sidani E (2012). Cognitive training for impaired neural systems in neuropsychiatric illness. Neuropsychopharmacology, 37(1), 43–76. 10.1038/npp.2011.251 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vinogradov S, Fisher M, & Nagarajan S (2013). Cognitive Training in Schizophrenia: Golden Age or Wild West? Biological Psychiatry, 73(10), 935–937. 10.1016/j.biopsych.2013.03.015 [DOI] [PubMed] [Google Scholar]
- Wykes T, Huddy V, Cellard C, McGurk SR, Czobor P, Craufurd D, … Paulsen JS (2011). A Meta-Analysis of Cognitive Remediation for Schizophrenia: Methodology and Effect Sizes. American Journal of Psychiatry, 168(5), 472–485. 10.1176/appi.ajp.2010.10060855 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.