Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 May 4;18(5):e0277158. doi: 10.1371/journal.pone.0277158

Associations between resting state functional brain connectivity and childhood anhedonia: A reproduction and replication study

Yi Zhou 1,*, Narun Pat 2, Michael C Neale 1
Editor: Melissa A Brotman3
PMCID: PMC10159190  PMID: 37141274

Abstract

Background

Previously, a study using a sample of the Adolescent Brain Cognitive Development (ABCD)® study from the earlier 1.0 release found differences in several resting state functional MRI (rsfMRI) brain connectivity measures associated with children reporting anhedonia. Here, we aim to reproduce, replicate, and extend the previous findings using data from the later ABCD study 4.0 release, which includes a significantly larger sample.

Methods

To reproduce and replicate the previous authors’ findings, we analyzed data from the ABCD 1.0 release (n = 2437), from an independent subsample from the newer ABCD 4.0 release (excluding individuals from the 1.0 release) (n = 6456), and from the full ABCD 4.0 release sample (n = 8866). Additionally, we assessed whether using a multiple linear regression approach could improve replicability by controlling for the effects of comorbid psychiatric conditions and sociodemographic covariates.

Results

While the previously reported associations were reproducible, effect sizes for most rsfMRI measures were drastically reduced in replication analyses (including for both t-tests and multiple linear regressions) using the ABCD 4.0 (excluding 1.0) sample. However, 2 new rsfMRI measures (the Auditory vs. Right Putamen and the Retrosplenial-Temporal vs. Right-Thalamus-Proper measures) exhibited replicable associations with anhedonia and stable, albeit small, effect sizes across the ABCD samples, even after accounting for sociodemographic covariates and comorbid psychiatric conditions using a multiple linear regression approach.

Conclusion

The most statistically significant associations between anhedonia and rsfMRI connectivity measures found in the ABCD 1.0 sample tended to be non-replicable and inflated. Contrastingly, replicable associations exhibited smaller effects with less statistical significance in the ABCD 1.0 sample. Multiple linear regressions helped assess the specificity of these findings and control the effects of confounding covariates.

Introduction

Anhedonia is defined as a markedly diminished interest or pleasure in previously enjoyable activities and is a transdiagnostic symptom that is a core component of major depressive disorders (MDD) [1] and schizophrenia (SZN) [2]. Symptoms of anhedonia are also present in substance use disorders [3], PTSD [4], bipolar depression [5], and ADHD [6]. In cross-sectional studies, anhedonia in children and adolescents has been shown to be associated with greater depression severity and suicidality [7, 8]. Furthermore, in a randomized clinical trial, anhedonia was found to be a significant predictor of a longer time to remission in adolescents with treatment resistant depression [9].

Functional neuroimaging approaches have been widely used to explore the neurocircuitry of anhedonia [10]. Functional brain connectivity is a measure of the degree of synchrony between the blood oxygen level dependent (BOLD) signals across time between regions in the brain [11]. In other words, functional connectivity allows for the characterization of networks of brain activity rather than activity in single brain regions. Importantly, functional connectivity can be measured at rest which facilitates the ease by which data can be collected, as opposed to task-fMRI which typically involves the presence of a stimulus or task [11]. While task-fMRI focuses on patterns of brain activation during a specific task, resting-state functional MRI (rsfMRI) connectivity focuses on the organization of brain networks that may specialize in specific functions. As such, both task-fMRI and rsfMRI represent important brain processes that may contribute to the development of mental disorders.

While there have been many studies of brain activity and connectivity in adults with anhedonia, fewer have been conducted in children and adolescents. However, findings from these studies generally converge on the significance of disruptions in the reward, default mode, and salience networks [1214]. A recent study using the early 1.0 release of the Adolescent Brain Cognitive Development (ABCD)® study data found several rsfMRI brain network connectivity measures associated with anhedonia in children aged 9–10 years old [15]. Importantly, it was one of the largest studies of anhedonia in children with a sample size of ~2,500 participants including 215 children reporting past and/or present anhedonia. Presently, the latest 4.0 release of the ABCD study, which includes a significantly larger sample of participants with neuroimaging and behavioral data (n = 11,878), has been made available. Given the public availability of the data and its different versions, there is a significant opportunity to both reproduce and replicate these findings.

We define reproducibility as the ability to achieve exactly the same results as a previous study by using the same data and analytical approach, and replicability as the ability to achieve the same (or similar) results as a previous study in a different dataset [16]. By our definition, reproducibility is better able to assess the consistency of results while replicability is better able to assess the generalizability of those results. The aims of this present study are to reproduce the previously reported associations between rsfMRI connectivity and childhood anhedonia using the ABCD 1.0 release sample, and to replicate those findings using an independent subset of the larger ABCD 4.0 release sample, excluding participants from the ABCD 1.0 release.

Importantly, in depressive disorders, anhedonia is characterized as the loss of pleasure and interest that is distinct from feelings of sadness or other dysphoric moods [17]. Thus, there is great need to elucidate the specific neurobiological underpinnings associated with anhedonia, distinct from other comorbid symptoms, to better understand the underlying brain dysfunction. Thus, we also aim to extend our analyses and evaluate the specificity of rsfMRI connectivity associations with anhedonia by evaluating the effects of significantly comorbid psychiatric symptoms and diagnoses.

Anhedonia is a transdiagnostic symptom impacting some of the most prevalent and debilitating mental disorders in both children and adults. By Identifying brain dysfunction underlying anhedonia, we may be able to more accurately characterize patient symptomatology, refine diagnostic categories, and potentially identify specific brain-based therapeutic targets. Furthermore, by characterizing brain dysfunction in children and adolescents, we may help elucidate important dysregulated developmental processes that may be targeted by preventative interventions.

Methods and materials

All of our analyses were performed in R (version 4.0.3) and Rstudio. We used several scripts, including the utils.R and combat.R [18] scripts for data harmonization, which were provided by the previous authors immediately upon request. The code and data structures used for our study can be accessed from the associated NDA study. The code we used can also be found at our Open Science Framework repository (https://osf.io/vy85h/?view_only=0497385708874a6a9cce2bbfc5c30600).

ABCD study data

The ABCD® study is the largest longitudinal study of brain development in children in the United States (https://abcdstudy.org/). The study has collected structural and functional brain imaging measures as well as detailed psychiatric and behavioral data from almost 12,000 children starting from when they were 9–10 years old. Notably, data is released on a continuous basis. For this study, we used baseline data from the ABCD 1.0 and ABCD 4.0 releases.

rsfMRI connectivity measures and quality control (QC)

Neuroimaging processing pipelines and analyses for the ABCD study are reviewed elsewhere [19]. Briefly, the functional scans include twenty minutes of resting-state data acquired with eyes open and passive viewing of a crosshair [20]. From the ABCD Data Repository, we obtained rsfMRI connectivity measures which were constructed using a seed-based correlational approach where regions of interest (ROIs) within Gordon parcellations [21] were grouped together into predefined cortical networks. Briefly, correlations between unique pairs of ROIs were obtained and Fisher transformed into z-statistics. Connectivity measures represent the averaged Fisher-transformed correlations of all the unique pairs of ROIs either within a cortical network, between cortical networks, or between cortical networks and subcortical regions. From the ABCD Data Repository, we obtained rsfMRI connectivity measures between 19 subcortical regions and 12 cortical networks (data structure: mrirscor02), as well as rsfMRI connectivity measures from within and between the 12 cortical networks (data structure: abcd_betnet02). Thus, there were 228 (12 x 19) subcortical ROI vs. cortical network rsfMRI connectivity measures and 78 (12C2 network pairs + 12 within network) within/between cortical network rsfMRI variables, for a total of 306 rsfMRI connectivity measures.

For QC, we used the IQC_RSFMRI_GOOD_SER variable, which represents the number of rsfMRI runs that were complete, passed protocol compliance and QC, and had field maps acquired within 2 scans prior to the run that were complete and passed QC and protocol compliance. Like the previous authors’, we retained subjects who had IQC_RSFMRI_GOOD_SER values greater than or equal to four.

For analyses using only the ABCD 1.0 release sample, like the previous authors, we also removed individuals who were scanned by “Philips Medical Systems” MRI machines because of a post-processing issue in the ABCD 1.0 release, which was resolved in later releases. When working with the ABCD 4.0 release sample, we retained all the subjects who were scanned by Philips Medical Systems scanners because the post-processing errors identified in the ABCD 1.0 release had been fixed for the ABCD 4.0 release.

Data harmonization

Different MRI scanners were used across the 21 sites in the ABCD study. The original authors harmonized the data across MRI scanners by using the ComBat tool (combat.R) to adjust for batch effects due to the different scanners used. Here, we do the same and harmonize the data separately for the subcortical ROI vs. cortical network and within/between cortical network rsfMRI measures as it is possible these two variable types may be affected by scanners differently [22]. Note, before the harmonization step, listwise deletion of subjects with any missing rsfMRI data was done as data harmonization requires complete data. There were 23 different scanners used in the study for the ABCD 1.0 release and 29 different scanners for the ABCD 4.0 release. Thus 23 and 29 batch effects were used to adjust the ABCD 1.0 and 4.0 releases, respectively.

Psychiatric symptoms and diagnoses

The focus of this study were past/present symptoms of anhedonia. However, we were also interested in other psychiatric conditions that may be comorbid with anhedonia. Psychiatric data were obtained from the youth (data structure: abcd_ksad501) and parent (data structure: abcd_ksad01) Kiddie Schedule for Affective Disorders and Schizophrenia (KSADS) data structures from the ABCD study which are composed of binary (yes/no) questionnaire items for various psychiatric diagnoses or symptoms. Separately for youth and parent KSADS questionnaire items, we combined past and present items for the same symptom or diagnosis and consolidated some items into a single variable. For example, we consolidated 18 youth-reported past and present suicide related diagnosis items into one single youth-reported suicide thoughts and behavior variable, which was similarly done in another study [23]. A separate parent-reported suicide thoughts and behaviors variable was constructed using parent-reported KDADS questionnaire items.

For psychiatric conditions besides anhedonia, we first selected the KSADS items representing psychiatric diagnoses and not individual symptoms. However, in both the youth and parents KSADS data, no diagnosis variables for major depressive disorder (MDD) were available. Thus, we selected two MDD related symptoms (besides anhedonia), irritability and depressed mood, from both the youth and parent data to be used in our analyses. Similarly, no diagnostic variable was available for ADHD. Thus, we created a representative variable, inattention_distracted_p, which is a combination of two prevalent ADHD related symptom items (Symptom—Difficulty sustaining attention since elementary school and/or Symptom—Easily distracted since elementary school) from the parent KSADS data.

Statistical analyses

Student’s and Bayes Factor T-Tests

Prior to statistical analyses, participants with missing data for psychiatric symptoms/diagnoses were removed. We then proceeded to identify and remove outliers for each rsfMRI connectivity measure as values 1.5 times greater than the interquartile range (IQR) of values. The number and the percentage of the total sample removed as outliers for each t-test were reported in S1S3 Tables. For independent sample t-tests, assumptions of normality were assessed with the Shapiro-Wilk test and with the visual inspection of the distributions of a representative sample of rsfMRI variables. Assumptions of equal variances across groups were assessed with the F-test. To assess the potential bias introduced by unequal variances, we performed Welch’s t-tests for those rsfMRI measures with significant F-tests and then correlated the Welch’s t-statistics with Student’s t-statistics. We then correlated the p-values from the two tests as well.

We performed Student’s T-tests for each of the 306 rsfMRI measures between controls and individuals with past and/or present psychiatric symptoms/diagnoses of interest (the reference group consisted of individuals endorsing psychiatric symptoms/diagnoses, such as anhedonia) in the ABCD 1.0, ABCD 4.0 (excluding 1.0), and full ABCD 4.0 samples. We applied the Benjamini-Hochberg adjustment for multiple testing corrections. Finally, we performed Bayes Factor T-Tests for each of the rsfMRI measures and reported natural logarithms of the Bayes Factors (lnBF). As with the previous authors’, lnBF values greater than 1.1 were considered significant.

Tetrachoric correlations

Tetrachoric correlations are suitable for use with binary or categorical variables as it assumes responses arise from an underlying normal distribution with thresholds that delineate response categories. The tetrachoric() function from the psych R package was used in our analyses. Tetrachoric correlations were used to estimate the correlations between pairs of 34 binary psychiatric variables using the full ABCD 4.0 release sample.

Multiple linear regressions

For multiple linear regression analyses, the ABCD rsfMRI data (from both 1.0 and 4.0 releases) were harmonized for MRI scanner using the ComBat tool as previously described, except we also adjusted for batch effects with covariates [22]. The covariates included during data harmonization were: age, sex, race/ethnicity, anhedonia, bipolar II, irritability, and depressed mood.

Similar to the t-tests, prior to statistical analyses, participants with missing data for psychiatric symptoms/diagnoses, as well as demographic covariates, were removed. We then proceeded to identify and remove outliers for each rsfMRI connectivity measure as values 1.5 times greater than the interquartile range (IQR) of dataopoints. The number and the percentage of the total sample removed as outliers for each multiple linear regression were reported in S4S9 Tables. All rsfMRI measures, and participant age, were mean-centered and standardized. Thus, partial regression coefficient estimates represent changes in the rsfMRI measure in standard deviation units from the mean, per unit change in the predictor variables.

We performed linear mixed effects modeling using the lmer4 package in R, a form of multiple linear regression, on the harmonized data. Individual rsfMRI connectivity measures were modeled as outcome variables while age, sex, race/ethnicity, anhedonia (reference group was the control group), depressed mood, irritability, and bipolar II disorder were modeled as independent explanatory variables. Age, sex, and race/ethnicity were considered potential confounding variables. The independent effects of anhedonia, bipolar II, irritability, and depressed mood symptoms on rsfMRI connectivity measures were assessed by identifying corresponding statistically significant partial regression coefficients, after multiple testing corrections. Family ID was included as a random effect to control for the non-independence of values from participants who belonged to the same family. We adjusted for multiple comparisons with the Benjamini-Hochberg method to control for a False Discovery Rate of 0.05, for all estimated parameters across regressions for the 306 rsfMRI connectivity measures.

Several assumptions for multiple linear regression were assessed. Multicollinearity was assessed with the variance inflation factor (VIF) using the vif() function in R from the car package. Auto-correlation of the model residuals was assessed with the Durbin-Watson test using the durbinWatsonTest() function in R from the car package. Homoskedasticity of model residuals were assessed using the Breusch-Pagan (BP) test (using the ols_test_breusch_pagan() function in R from the olsrr package) and also visually inspected by plotting model residuals against marginal model fitted-values. For regressions with significant BP tests, we also performed weighted-least-squares (WLS) regression, which is able to account for differences in variance in the residuals, and then correlated the t-statistics from the WLS and the original ordinary-least squares (OLS) regressions to assess the impact of potential heteroscedasticity on the results. Finally, we performed a visual inspection of density plots of the residuals from regressions for 3 representative rsfMRI measures for each set of linear regression analyses, and their Quantile-Quantile (QQ) plots, to detect any patterns of non-normality.

Assessing patterns of missingness

For t-test analyses, consistent with the previous authors, study participants with missing rsfMRI measures were removed prior to adjustments for site using the ComBat tool. Additionally, participants with missing data for youth-reported anhedonia were also excluded. To assess if there were any patterns of missingness, we compared participants who were removed with participants who were retained. We assessed whether there were differences in proportions for sex (assigned at birth), race/ethnicity, youth-reported anhedonia, depressed mood, irritability, and bipolar II disorder symptoms between the two groups using Chi-Square tests of independence. We compared differences in age (in weeks) using t-tests.

For the multiple linear regression analyses, in addition to participants with missing rsfMRI and anhedonia responses, those with missing sociodemographic covariate and psychiatric comorbidity data were also excluded. Similar comparisons were made between participants who were removed and those who were retained.

Results

Reproduction of previous findings

To reproduce the previous authors’ results, we used the ABCD 1.0 release sample. Sociodemographic characteristics for this sample can be found in Table 1. Note that although the two groups exhibit differences in a few of these characteristics, they were not controlled for statistically when we performed our t-tests in order to remain consistent with the previous authors’ approach.

Table 1. Comparison of demographic measures between controls and those with anhedonia in the ABCD 1.0 sample.

Measures Control (N = 2209) Anhedonia (N = 215) Statistic p-value
% Male 51.8 54 0.286 0.593
Mean Age (months) 120.6 119.9 1.183a 0.238
% Asian 1.8 0.9 0.45 0.502
% Black 8.2 18.1 22.296 <0.001
% Hispanic 20 26.5 4.753 0.029
% Other 9.3 9.8 0.012 0.911
% White 60.8 44.7 20.386 <0.001
% Bipolar II 0.8 7.9 64.358 <0.001
% Depressed Mood 8.1 28.4 87.975 <0.001
% Irritability 4.7 26.5 148.192 <0.001

The proportion (%) of participants in each group for each measure are shown. Student’s t-test was done to compare age (in months) between control and anhedonia groups. Chi-square tests of independence were done for all other measures. Note there is a slightly lower number of controls here than reported in our reproduction analysis due to the exclusion of participants with missing demographic and/or comorbid psychiatric symptom and diagnosis measures.

a Student’s t-statistic.

Like the previous authors, we identified 215 individuals who endorsed past and/or present anhedonia and 2,222 controls who reported neither past nor present anhedonia at the baseline timepoint, indicating the samples were exactly the same. In line with the previous authors’ findings, we reproduced significant differences in 11 rsfMRI connectivity measures between those with and without anhedonia indicated by the lnBF statistic, though the effect sizes were small (Table 2, left) [15]. To be consistent with the previous authors, individuals with anhedonia were the reference group for all t-test analyses.

Table 2. Reproduction and replication t-test results comparing controls and those with anhedonia across ABCD study samples.

ABCD 1.0 Sample (n = 2437) ABCD 4.0 (excluding 1.0) Sample (n = 6456) Full ABCD 4.0 Sample (n = 8866)
rsfMRI Connectivity Cohen’s d (95% CI) p p.adj lnBF Cohen’s d (95% CI) p p.adj lnBF Cohen’s d (95% CI) p p.adj lnBF
CinguloOpercular-BrainStem 0.203 (0.058, 0.347) 0.006 0.167 1.204 0.096 (0.011, 0.181) 0.028 0.144 -0.611 0.125 (0.052, 0.199) 0.001 0.013 2.436
CinguloParietal-BrainStem -0.258 (-0.404, -0.112) 0.001 0.045 3.366 -0.019 (-0.104, 0.067) 0.672 0.878 -2.924 -0.032 (-0.106, 0.041) 0.389 0.591 -2.793
CinguloParietal-RightPallidum 0.222 (0.078, 0.366) 0.003 0.086 1.974 0.112 (0.027, 0.197) 0.010 0.096 0.262 0.097 (0.023, 0.17) 0.010 0.062 0.151
Default-DorsalAttention -0.253 (-0.397, -0.109) 0.001 0.045 3.290 -0.071 (-0.156, 0.015) 0.104 0.335 -1.709 -0.134 (-0.207, -0.061) 0.000 0.007 3.284
DorsalAttention-LeftHippocampus -0.291 (-0.436, -0.146) 0.000 0.027 5.060 -0.037 (-0.123, 0.048) 0.391 0.650 -2.651 -0.08 (-0.154, -0.007) 0.032 0.124 -0.884
RetrosplenialTemporal-RightCerebellumCortex 0.226 (0.082, 0.369) 0.002 0.079 2.151 0.119 (0.033, 0.204) 0.007 0.082 0.640 0.132 (0.058, 0.205) 0.000 0.009 2.993
Salience-LeftVentraldc -0.242 (-0.386, -0.098) 0.001 0.051 2.809 -0.084 (-0.169, 0.001) 0.053 0.222 -1.159 -0.121 (-0.195, -0.048) 0.001 0.015 2.070
SensorimotorHand-BrainStem 0.247 (0.1, 0.393) 0.001 0.051 2.854 0.096 (0.011, 0.181) 0.027 0.144 -0.595 0.122 (0.049, 0.195) 0.001 0.015 2.136
SensorimotorHand-RightHippocampus 0.22 (0.074, 0.365) 0.003 0.094 1.809 -0.01 (-0.095, 0.075) 0.820 0.940 -2.992 0.038 (-0.035, 0.112) 0.303 0.509 -2.642
Within CinguloOpercular 0.229 (0.086, 0.372) 0.002 0.074 2.323 0.129 (0.044, 0.214) 0.003 0.048 1.350 0.144 (0.071, 0.217) 0.000 0.004 4.254
Within RetrosplenialTemporal 0.266 (0.123, 0.409) 0.000 0.042 3.989 0.034 (-0.051, 0.119) 0.434 0.692 -2.715 0.086 (0.013, 0.159) 0.021 0.093 -0.533

Student’s and Bayes Factor T-tests were performed to compare controls with those with anhedonia. Student’s t-statistic nominal p-values (p), conservative Benjamini-Hochberg adjusted p-values (p.adj) for 306 comparisons, and natural logarithms of Bayes Factors (lnBF) are reported. lnBF values greater than 1.1 were considered statistically significant. Note that the sum of the participants from the ABCD 1.0 and ABCD 4.0 (excluding) 1.0 samples exceeds the number of participants from the full ABCD 4.0 sample due to additional participants from the ABCD 1.0 sample being excluded from the full ABCD 4.0 sample during the quality control (QC) steps. Differences between processing pipelines between the data releases may account for these discrepancies in QC measures.

In addition to the lnBF statistic, we provide a more conservative adjustment for multiple comparisons using the Benjamini-Hochberg correction for 306 comparisons. Alternatively, since we were predominantly interested in reproducing the 11 rsfMRI associations reported by the previous authors, we could have adjusted for only 11 comparisons and arrived at a more liberal adjusted p-value for each comparison. However, we decided to report the former since we did indeed perform 306 t-tests in our analyses. This reflects the somewhat arbitrary nature of statistical thresholding as the number of outcome measures considered in family-wise hypotheses can be difficult to clearly define [24].

To assess how well we reproduced the previous authors’ results, we correlated our t-statistic values with those reported by the previous authors for the t-tests comparing individuals with or without anhedonia (S1A Fig—left). Similarly, we also correlated our lnBF statistics with those reported by the previous authors (S1A Fig—right). Of note, the previous authors also analyzed the associations between rsfMRI connectivity and depressed mood and anxiety in order to assess the specificity of their anhedonia results. We have also reproduced those same associations and have obtained correlations between our statistics and the previous authors’ statistics for those analyses (S1B and S1C Fig). We note that although we used a more recent version of the R statistical software than the previous authors, the correlations between the statistics from our analyses and those from the previous authors were all equal to 1, indicating no differences in the results.

To check the assumptions for independent measures t-tests, we performed Shapiro-Wilk normality tests for rsfMRI measures from the ABCD 1.0 sample and found that all of the tests were significant, indicating non-normality (S1 Table). However, for large samples, such as in the ABCD study, statistical tests for normality are very sensitive to small deviations from normality which do not end up affecting the results of parametric tests. Furthermore, the central limit theorem states that for samples with n > 40, the means of random samples from any distribution tends to be normal, regardless of the distribution of the underlying data [25]. A visual inspection of the distributions, as well as the quantile-quantile (QQ) plots, for a representative sample of 3 of the rsfMRI measures significantly associated with anhedonia revealed no significant deviations from normality (S2 Fig).

We also performed F-tests to compare variances across the anhedonia and control groups for our t-tests in order to assess the assumptions of homoscedasticity. We note that there were 11 rsfMRI measures that exhibited significant F-tests in the ABCD 1.0 sample (S1 Table). To assess the potential bias introduced by unequal variances, we performed Welch’s t-tests for those rsfMRI measures with significant F-tests and then correlated the Welch’s t-statistics with Student’s t-statistics. We then correlated the p-values from the two tests as well. We found significantly high correlations (r > = 0.99) for t-statistics and p-values, indicating minimal differences between the two types of tests and thus minimal impact of unequal variances on the results (S3A Fig).

For t-tests using the ABCD 1.0 sample, 288 participants with either missing rsfMRI data or missing youth-reported anhedonia responses were removed and 2437 were retained. Participants who were removed were on average 1 week younger than those who were retained (S10 Table). Such a difference was deemed to be negligible.

Replication of previous findings

At the time of writing, the ABCD 4.0 release has been made available. We wanted to replicate the previous findings by using the full cohort, excluding the subjects used in the previous analyses, which is similar to replication in an independent sample. In this sub-sample of the ABCD 4.0 release (which excludes participants from ABCD 1.0 release), we found 591 participants who endorsed past and/or present anhedonia and 5,865 controls who did not. Demographic characteristics for this sample can be found in Table 3.

Table 3. Comparison of sociodemographic measures between controls and those with anhedonia in the ABCD 4.0 release, excluding ABCD 1.0 release, sub-sample.

Measures Control (N = 5863) Anhedonia (N = 591) Statistic p-value
% Male 51.2 56.7 6.202 0.013
Mean Age (months)a 118.5 119.1 -1.705 0.089
% Asian 2.3 0.8 4.703 0.03
% Black 15.2 20.8 12.449 <0.001
% Hispanic 20.5 26.4 11.087 0.001
% Other 10.4 12.9 3.055 0.08
% White 51.6 39.1 33.287 <0.001
% Bipolar II 0.3 8.3 313.34 <0.001
% Depressed Mood 6.4 31.8 431.052 <0.001
% Irritability 4.4 27.9 484.563 <0.001

The proportion (%) of participants in each group for each measure are shown. Student’s t-test was done to compare age (in months) between control and anhedonia groups. Chi-square tests of independence were done for all other measures. Note there is a slightly lower number of controls here than reported above due to the exclusion of participants with missing sociodemographic and/or comorbid psychiatric syndrome and diagnoses measures.

a Student’s t-statistic.

When using the ABCD 4.0 (excluding 1.0) sample, we found large reductions in effect sizes for all 11 rsfMRI measures previously found to be associated with anhedonia using the ABCD 1.0 sample (Table 2, center). Only one measure, the Within-Cingulo-Opercular connectivity measure, exhibited a statistically significant association as indicated by the adjusted p-value and lnBF statistics. However, as noted earlier, we applied fairly conservative corrections to the nominal p-values to adjust for multiple comparisons. At the nominal p-value level, 4 additional rsfMRI measures (the Retrosplenial-Temporal vs. Right-Cerebellum-Cortex, Cingulo-Parietal vs. Right-Pallidum, Sensorimotor-Hand vs. BrainStem, and Cingulo-Opercular vs. BrainStem connectivity measures) were also significantly associated with anhedonia.

For these t-tests using the ABCD 4.0 (excluding 1.0) sample, 124 participants with either missing rsfMRI or youth-reported anhedonia responses were excluded and 6456 participants were retained. Notably, those that were removed exhibited significantly higher proportions of individuals identifying as African Americans (27.4% vs 15.7%) and individuals endorsing depressed mood (12.9% vs. 8.7%) (S10 Table). While significant patterns of missingness suggest Missingness At Random (MAR), the proportion of missing participants was ~2% and thus would not benefit from approaches such as multiple imputation (typically requiring missingness >5%) and are unlikely to lead to significant bias in the results [26].

To increase our power to detect genuine associations with smaller effect sizes, we next performed our analyses using the full ABCD 4.0 release sample, including all participants from the ABCD 1.0 release. Since we are including the participants used in the original analyses, our analyses using the full ABCD 4.0 sample would not be an independent replication of the previous results. Nevertheless, the results will help with the assessment of the stability of the effect sizes and associations. In the full ABCD 4.0 sample, there were 800 participants who endorsed past and/or present anhedonia and 8066 controls who did not. Demographic characteristics for this sample can be found in Table 4.

Table 4. Comparison of sociodemographic measures between controls and those with anhedonia in the Full ABCD 4.0 release sample.

Measures Control (N = 8064) Anhedonia (N = 800) Statistic p-value
% Malea 51.3 55.8 5.589 0.018
Mean Age (months) 119.1 119.3 -0.845 0.398
% Asiana 2.2 0.9 5.363 0.021
% Blacka 13.3 19.8 25.19 <0.001
% Hispanica 20.4 26.6 16.579 <0.001
% Other 10.1 12.1 2.916 0.088
% Whitea 54 40.6 52.043 <0.001
% Bipolar IIa 0.5 7.9 347.62 <0.001
% Depressed Mooda 6.9 30.9 507.29 <0.001
% Irritabilitya 4.4 27.4 627.02 <0.001

The proportion (%) of participants in each group for each measure are shown. Student’s t-test was done to compare age (in weeks) between control and anhedonia groups. Chi-square tests of independence were done for all other measures. Note there is a slightly lower number of controls here than reported below due to the exclusion of participants with missing sociodemographic and/or comorbid psychiatric syndrome and diagnoses measures.

a Student’s t-statistic.

When using the full ABCD 4.0 sample, 6 of the original 11 rsfMRI measures exhibited statistically significant associations with anhedonia as indicated by the adjusted p-values and lnBF statistics, including the previously reproduced and replicated association for the Within-Cingulo-Opercular connectivity measure. Of note, associations for 3 out of the 4 rsfMRI measures (Retrosplenial-Temporal vs. Right-Cerebellum-Cortex, Cingulo-Opercular vs. Brain-Stem, Sensorimotor-Hand vs. Brain-Stem connectivity measures) replicated at the nominal p-value level using the ABCD 4.0 (excluding 1.0) sample were among the 6 significant rsfMRI measures found in the full ABCD sample. Effect sizes were intermediary between those found in the prior analyses but were much closer to the smaller effect sizes from the replication analyses using the ABCD 4.0 (excluding 1.0) sample.

For the t-tests using the full ABCD 4.0 sample, 139 participants with either missing rsfMRI measures or youth-reported anhedonia responses were removed and 8866 participants were retained. Similar to the other ABCD samples, there were higher proportions of individuals identifying as African American and those endorsing depressed mood in the participants who were removed. However, the proportion of participants removed was ~ 1.5% of the total sample and thus unlikely to contribute to significant bias to the analyses or receive benefit from multiple imputation.

To check the assumptions for independent samples t-tests performed using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, we visually inspected the distributions of a representative sample of 3 rsfMRI measures significantly associated with anhedonia in each ABCD sample, which revealed no significant deviations from normality (S4 and S5 Figs). However, there were 17 rsfMRI measures in the ABCD 4.0 (excluding 1.0) sample, and 21 rsfMRI measures in the full ABCD 4.0 sample that exhibited significant F-tests, suggesting the presence of unequal variances. We performed Welch’s t-tests for those rsfMRI measures with significant F-tests and then correlated the Welch’s t-statistics with Student’s t-statistics. We then correlated the p-values from the two tests as well. We found significantly high correlations (r > = 0.99) for all the correlations, indicating minimal differences between the two types of tests and thus minimal impact of any unequal variances on the results (S3B and S3C Fig).

Psychiatric co-morbidities and the specificity of findings

It is important to note that individuals reporting anhedonia may also report other symptoms or psychiatric diagnoses. Thus, it is important to evaluate the specificity of the associations between rsfMRI connectivity and anhedonia. In order to identify psychiatric conditions significantly comorbid in individuals reporting anhedonia, we performed tetrachoric correlations between anhedonia and 33 additional psychiatric diagnoses and symptoms collected at baseline (Fig 1).

Fig 1. Correlation matrix for 34 psychiatric symptoms and diagnoses based on youth and parent reports at baseline.

Fig 1

Tetrachoric correlation values are represented by the shaded proportion of the pie-charts in each cell of the correlation matrix as well as by the intensity of the shading on a divergent red and blue color-scale. Measures based on youths’ self-reports end in the suffix “_y” while measures based on parent reports of their child end with the suffix “_p”. Variables are ordered by hierarchical clustering.

Three psychiatric conditions exhibited correlation coefficients greater than or equal to 0.5 with anhedonia (S11 Table): irritability, depressed mood, and bipolar II disorder. Thus, these were considered significantly co-morbid conditions that may potentially confound the associations between rsfMRI connectivity and anhedonia. In the full ABCD 4.0 sample, 32%, 28%, and 8% of the participants reporting anhedonia also reported depressed mood, irritability, and bipolar II disorder (S12 Table).

In line with the previous authors’ approach, in order to assess the specificity of the associations found for anhedonia, we next performed t-tests to compare rsfMRI connectivity measures separately between those with and without symptoms of depressed mood, irritability, and bipolar II disorder using the full ABCD 4.0 sample. The presence of a psychiatric condition was the reference group.

We found that 2 rsfMRI measures significantly associated with anhedonia using the full ABCD 4.0 sample were also significantly associated with depressed mood (ndepressedMood = 801, ncontrols = 8065). These were the Default vs. Dorsal-Attention (Cohen’s d = -0.118, 95%CI [-0.191, -0.045], lnBF = 1.807) and Within-Cingulo-Opercular (Cohen’s d = 0.117, 95%CI [0.043, 0.19], lnBF = 1.646) connectivity networks (S13 Table). Similarly, 2 rsfMRI measures associated with anhedonia were also significantly associated with irritability (nirritability = 576, ncontrol = 8290). These were the Salience vs. Left-Ventraldc (Cohen’ d = -0.139, 95%CI [-0.224, -0.054], lnBF = 2.075) and Default vs. Dorsal-Attention (Cohen’s d = -0.138, 95% CI [-0.223, -0.053], lnBF = 2.004) connectivity measures (S13 Table). None of the rsfMRI measures associated with anhedonia were also associated with bipolar II disorder (nbipolarII = 101, ncontrol = 8765).

Altogether, the results of the t-test comparisons using the full ABCD 4.0 sample suggest the Cingulo-Opercular vs. BrainStem, Retrosplenial-Temporal vs. Right-Cerebellum-Cortex, and the Sensorimotor-Hand vs. BrainStem connectivity measures may be more specifically associated with anhedonia. Contrastingly, the Within-Cingulo-Opercular connectivity measure, whose association with anhedonia was the only one replicated at the more conservative adjusted p-value and lnBF statistic levels, was associated with both depressed mood and irritability.

Multiple linear regression approach

While we were able to characterize which rsfMRI connectivity measures were more likely to be specifically associated with anhedonia compared to other psychiatric conditions, simple t-tests were not able to estimate the independent effects of each psychiatric condition on rsfMRI connectivity. For rsfMRI measures like the Within-Cingulo-Opercular connectivity measure, it would be important to disentangle its associations with anhedonia, depressed-mood, and irritability symptoms. Furthermore, t-tests are not able to control for potentially confounding sociodemographic variables such age, sex, and race/ethnicity. Indeed, Chi-square tests of independence showed significant differences in race/ethnicity and sex between individuals reporting anhedonia and those who do not across the different ABCD samples (Tables 1, 3, and 4).

By using a multiple linear regression approach where a rsfMRI connectivity measure is modeled as the response (or outcome) variable, comorbid psychiatric conditions as well as confounding factors can be included as explanatory (or predictor) variables. Thus, multiple linear regression allows for the estimation of the main effects of anhedonia on rsfMRI connectivity, independent of the effects of depressed mood, irritability, and bipolar II disorder (and vice versa), and the effects of confounding covariates. We hypothesized that controlling for potential sociodemographic confounders and accounting for the effects of co-morbid psychiatric conditions may improve replicability.

We took a step-wise approach and first only included the socio-demographic covariates (sex, age, race/ethnicity) in our regression models along with youth-reported anhedonia. Then, we added the comorbid psychiatric conditions (depressed mood, irritability, and bipolar II) to the models in order to evaluate their impact on the regression estimates and the replicability of any significant associations with anhedonia. We limited the inclusion of comorbid psychiatric conditions to these three measures in order to preserve the statistical power of our regression analyses and to account for comorbidities that are more likely to exhibit potential confounding effects based on their higher correlations with anhedonia (S11 Table).

Similar to the approach taken for replication analyses with t-statistics, we performed multiple linear regression in the ABCD 1.0 sample first to identify rsfMRI measures associated with anhedonia and then in the ABCD 4.0 (excluding 1.0) sample to replicate the results. For these analyses, the control group without symptoms of anhedonia was the reference group. We note that participants with missing covariate data were excluded from these analyses. Thus, the sample sizes will differ slightly from those used in the previous t-tests.

In the ABCD 1.0 release sample, there were 215 individuals who endorsed anhedonia and 2209 controls who did not. When we performed multiple linear regression with sex, age, and race/ethnicity as covariates, 4 rsfMRI measures were significantly associated with anhedonia at the conservative adjusted p-value level and were among the 11 rsfMRI measures identified by the previous authors (Table 5, left). At the nominal p-value level, an additional 23 rsfMRI measures were found to be associated with anhedonia, including the remaining 7 rsfMRI measures identified by the previous authors. We note that the effect sizes were extremely small, with anhedonia accounting for less than 1% of the total variance in each rsfMRI measure.

Table 5. Effects of anhedonia from multiple linear regressions controlling for sociodemographic factors only across the ABCD study samples.

ABCD 1.0 Sample (n = 2424) ABCD 4.0 (excluding 1.0) Sample (n = 6454) Full ABCD 4.0 Sample (n = 8864)
rsfMRI Connectivity Effect Size (%variance) (95%CI) Estimate Std.Err p p.adj Effect size (% variance) (95%CI) Estimate Std.Err p p.adj Effect size (% variance) (95% CI) Estimate Std.Err p p.adj
Auditory-LeftAmygdala 0.21 (0.01, 0.71) 0.146 0.074 0.049 0.228 0.02 (0, 0.12) 0.038 0.044 0.385 0.527 0.04 (0, 0.18) 0.066 0.038 0.080 0.147
Auditory-RightPutamen 0.22 (0.01, 0.79) -0.143 0.073 0.050 0.228 0.21 (0.04, 0.5) -0.122 0.043 0.004 0.013 0.19 (0.06, 0.44) -0.120 0.037 0.001 0.003
CinguloOpercular-BrainStem 0.35 (0.03, 1.02) -0.191 0.073 0.009 0.076 0.06 (0, 0.22) -0.060 0.043 0.163 0.275 0.11 (0.02, 0.29) -0.092 0.037 0.012 0.029
CinguloOpercular-LeftAccumbensArea 0.24 (0.01, 0.79) -0.160 0.074 0.031 0.169 0.03 (0, 0.16) -0.047 0.043 0.275 0.413 0.1 (0.01, 0.26) -0.095 0.037 0.010 0.024
CinguloOpercular-RightVentraldc 0.27 (0.02, 0.85) -0.166 0.075 0.026 0.157 0.02 (0, 0.16) -0.027 0.043 0.524 0.659 0.05 (0.01, 0.19) -0.055 0.037 0.134 0.225
CinguloParietal-BrainStem 0.41 (0.05, 1.13) 0.219 0.075 0.003 0.037 0 (0, 0.09) 0.003 0.044 0.946 0.972 0.01 (0, 0.09) 0.019 0.038 0.614 0.729
CinguloParietal-RightPallidum 0.36 (0.03, 1.01) -0.193 0.074 0.009 0.074 0.08 (0.01, 0.27) -0.071 0.043 0.096 0.180 0.06 (0.01, 0.21) -0.054 0.037 0.141 0.234
Default-DorsalAttention 0.44 (0.07, 1.16) 0.217 0.073 0.003 0.034 0.03 (0, 0.17) 0.041 0.043 0.342 0.486 0.11 (0.02, 0.29) 0.096 0.037 0.009 0.021
Default-LeftHippocampus 0.28 (0.01, 0.85) -0.173 0.075 0.021 0.136 0.02 (0, 0.14) -0.030 0.043 0.480 0.618 0.06 (0, 0.2) -0.068 0.037 0.067 0.126
Default-LeftVentraldc 0.19 (0, 0.67) -0.152 0.075 0.043 0.208 0.03 (0, 0.17) -0.042 0.044 0.331 0.473 0.06 (0, 0.22) -0.074 0.037 0.048 0.093
DorsalAttention-LeftAccumbensArea 0.25 (0.02, 0.77) -0.161 0.074 0.029 0.166 0 (0, 0.09) 0.019 0.043 0.658 0.773 0.01 (0, 0.11) -0.019 0.037 0.603 0.721
DorsalAttention-LeftHippocampus 0.54 (0.1, 1.36) 0.251 0.074 0.001 0.013 0.01 (0, 0.1) 0.004 0.043 0.921 0.956 0.04 (0, 0.18) 0.049 0.037 0.188 0.294
DorsalAttention-LeftVentraldc 0.24 (0.01, 0.81) -0.155 0.074 0.036 0.186 0.07 (0, 0.27) -0.082 0.044 0.058 0.120 0.1 (0.01, 0.27) -0.097 0.037 0.009 0.022
FrontoParietalLeftVentraldc 0.21 (0.01, 0.73) -0.157 0.076 0.039 0.195 0 (0, 0.09) 0.010 0.044 0.827 0.893 0.01 (0, 0.09) -0.014 0.038 0.715 0.809
FrontoParietal-RightVentraldc 0.3 (0.01, 1.04) -0.192 0.076 0.012 0.090 0 (0, 0.09) 0.002 0.044 0.968 0.983 0.01 (0, 0.1) -0.033 0.038 0.378 0.511
FrontoParietal-SensorimotorMouth 0.32 (0.02, 0.95) -0.195 0.074 0.009 0.074 0.03 (0, 0.17) -0.054 0.043 0.212 0.338 0.02 (0, 0.12) -0.037 0.037 0.326 0.460
RetrosplenialTemporal-RightCerebellumCortex 0.34 (0.04, 0.91) -0.180 0.073 0.014 0.100 0.09 (0.01, 0.29) -0.072 0.043 0.091 0.174 0.13 (0.03, 0.31) -0.093 0.037 0.012 0.027
RetrosplenialTemporal-RightThalamusProper 0.26 (0.01, 0.93) -0.162 0.073 0.027 0.160 0.21 (0.04, 0.52) -0.133 0.043 0.002 0.006 0.25 (0.08, 0.54) -0.152 0.037 0.000 0.000
Salience-LeftAccumbensArea 0.22 (0.01, 0.7) -0.153 0.074 0.038 0.192 0.05 (0, 0.22) -0.057 0.043 0.188 0.306 0.07 (0.01, 0.22) -0.067 0.037 0.071 0.131
Salience-LeftVentraldc 0.33 (0.02, 0.97) 0.188 0.074 0.011 0.087 0.05 (0, 0.23) 0.060 0.043 0.165 0.278 0.1 (0.02, 0.3) 0.091 0.037 0.015 0.033
Salience-RightAmygdala 0.18 (0, 0.73) -0.146 0.074 0.047 0.225 0.12 (0.01, 0.38) 0.126 0.044 0.004 0.011 0.08 (0.01, 0.24) 0.105 0.037 0.005 0.012
SensorimotorHand-BrainStem 0.32 (0.04, 0.87) -0.186 0.074 0.012 0.094 0.07 (0, 0.25) -0.064 0.043 0.133 0.235 0.11 (0.02, 0.3) -0.088 0.037 0.017 0.038
SensorimotorHand-RightHippocampus 0.32 (0.02, 0.89) -0.179 0.074 0.016 0.114 0.01 (0, 0.14) 0.047 0.043 0.273 0.413 0.01 (0, 0.09) -0.006 0.037 0.874 0.924
SensorimotorHand-RightThalamusProper 0.2 (0, 0.74) 0.162 0.075 0.030 0.167 0 (0, 0.09) -0.008 0.043 0.855 0.913 0.03 (0, 0.15) 0.054 0.037 0.146 0.242
SensorimotorMouth-LeftVentraldc 0.25 (0.01, 0.87) -0.158 0.073 0.031 0.171 0.01 (0, 0.09) 0.005 0.042 0.905 0.946 0.05 (0, 0.18) -0.054 0.037 0.141 0.234
Within-CinguloOpercular 0.39 (0.05, 1.06) -0.183 0.072 0.011 0.088 0.1 (0.01, 0.31) -0.081 0.043 0.057 0.117 0.13 (0.03, 0.32) -0.093 0.036 0.011 0.026
Within-RetrosplenialTemporal 0.57 (0.17, 1.34) -0.255 0.073 0.000 0.009 0.01 (0, 0.09) 0.007 0.043 0.863 0.919 0.05 (0, 0.17) -0.048 0.037 0.188 0.294

Effect size represents the percentage of the total variance (proportion of variance * 100%) in a rsfMRI connectivity measure accounted for by anhedonia. The partial regression coefficient (Estimate), standard error (Std.Err), nominal p-value (p), and conservative Benjamini-Hochberg adjusted p-value (p.adj) for anhedonia are also shown for each rsfMRI regression model. Partial regression coefficient estimates represent changes in the rsfMRI measure, in standard deviation units from the mean, associated with the presence of anhedonia. Bolded results were significant at the adjusted p-value level (p.adj < 0.05). Note that the sum of the participants from the ABCD 1.0 and ABCD 4.0 (excluding) 1.0 samples exceeds the number of participants from the full ABCD 4.0 sample due to additional participants from the ABCD 1.0 sample being excluded from the full ABCD 4.0 sample during the quality control (QC) steps. Differences between processing pipelines between the data releases may account for these discrepancies in QC measures.

We next attempted to replicate the associations using the ABCD 4.0 (excluding 1.0) sample where we identified 591 individuals with anhedonia and 5863 controls without. After performing the regressions, none of the 11 rsfMRI measures identified by the previous authors were significantly associated with anhedonia at either the adjusted or nominal p-value levels. However, 3 of the other rsfMRI measures that were significantly associated with anhedonia at the nominal p-value level using the ABCD 1.0 sample, were also found to be associated with anhedonia in the ABCD 4.0 (excluding 1.0) sample at the conservative adjusted p-value level (Table 5, center). The 3 replicated rsfMRI measures were the Auditory vs. Right Putamen, Retrosplenial-Temporal vs. Right-Thalamus-Proper, and Salience vs. Right-Amygdala connectivity measures.

Interestingly, while the effect sizes for the majority of rsfMRI measures reduced significantly after replication using the ABCD 4.0 (excluding 1.0) sample (most notably for rsfMRI measures with the largest effect sizes in the ABCD 1.0 sample analyses), the effect sizes for the 3 replicated rsfMRI measures remained roughly the same. However, the sign of the anhedonia partial regression coefficient for the Salience vs. Right-Amygdala measure flipped from being negative to positive. Since the regression model independent variables were not found to be significantly multicollinear (S14 and S15 Tables), it is more likely that this flip was driven by sample specific characteristics or random measurement error.

Finally, we performed regressions using the full ABCD 4.0 sample in order to increase our statistical power and to assess the stability of the effect sizes and associations. Note that the results cannot be considered an independent replication of the initial associations since we are including the participants from the ABCD 1.0 sample. When performing regressions in the full ABCD 4.0 sample, 11 of the 27 rsfMRI measures found to be associated with anhedonia in the ABCD 1.0 sample, were also associated with anhedonia at the adjusted p-value level, including the 3 rsfMRI measures replicated in the ABCD 4.0 (excluding 1.0) sample (Table 5, right). We note that the effect sizes were intermediary between those estimated from analyses using the ABCD 1.0 and ABCD 4.0 (excluding 1.0) samples, although most were closer to those from the latter.

Next, we added depressed-mood, irritability, and bipolar II disorder measures to the regression analyses across the ABCD samples in order to assess the impact of accounting for comorbid pyschiatric conditions on the specificity and stability of the effect sizes and significance of the associations between rsfMRI measures and anhedonia that were previously identified.

For the Auditory vs. Right-Putamen and Retrosplenial-Temporal vs. Right-Thalamus-Proper measures, we found that their significant associations with anhedonia were preserved in the regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, even after accounting for psychiatric comorbidities (Table 6, center and right). Furthermore, their effect sizes remained relatively consistent across the analyses using the different ABCD samples. Importantly, depressed-mood, irritability, and bipolar II disorder were not found to be significant predictors of these two rsfMRI measures in any of the multiple linear regression analyses, suggesting these associations are specific to anhedonia (S17 Table).

Table 6. Effects of anhedonia from multiple linear regressions controlling for sociodemographic factors and clinical comorbidities across the ABCD study samples.

ABCD 1.0 Sample (n = 2424) ABCD 4.0 (excluding 1.0) Sample (n = 6454) Full ABCD 4.0 Sample (n = 8864)
rsfMRI connectivity Effect size (%variance) (95%CI) Estimate Std.Err P p.adj Effect size (%variance) (95%CI) Estimate Std.Err p p.adj Effect size (%variance) (95%CI) Estimate Std.Err p-value p.adj
Auditory-LeftAmygdala 0.19 (0.01, 0.65) 0.144 0.078 0.066 0.339 0.01 (0, 0.13) 0.031 0.047 0.514 0.723 0.03 (0, 0.16) 0.052 0.040 0.189 0.365
Auditory-RightPutamen 0.21 (0.01, 0.79) -0.144 0.076 0.059 0.325 0.18 (0.04, 0.49) -0.118 0.046 0.010 0.037 0.18 (0.05, 0.38) -0.119 0.039 0.002 0.009
CinguloOpercular-BrainStem 0.37 (0.04, 1.02) -0.211 0.077 0.006 0.075 0.06 (0, 0.21) -0.070 0.046 0.125 0.283 0.1 (0.02, 0.25) -0.095 0.039 0.015 0.047
CinguloOpercular-LeftAccumbensArea 0.19 (0.01, 0.72) -0.127 0.078 0.104 0.436 0.02 (0, 0.14) -0.038 0.046 0.407 0.628 0.08 (0.01, 0.22) -0.084 0.039 0.034 0.094
CinguloOpercular-RightVentraldc 0.23 (0.02, 0.77) -0.142 0.078 0.070 0.352 0.02 (0, 0.13) -0.023 0.046 0.620 0.798 0.04 (0.01, 0.15) -0.040 0.039 0.308 0.510
CinguloParietal-BrainStem 0.41 (0.05, 1.16) 0.232 0.078 0.003 0.049 0 (0, 0.1) -0.008 0.047 0.865 0.939 0.01 (0, 0.09) 0.023 0.040 0.561 0.746
CinguloParietal-RightPallidum 0.28 (0.03, 0.9) -0.154 0.077 0.046 0.283 0.07 (0.01, 0.24) -0.068 0.046 0.136 0.302 0.05 (0.01, 0.18) -0.049 0.039 0.207 0.390
Default-DorsalAttention 0.4 (0.06, 1.06) 0.204 0.076 0.007 0.086 0.01 (0, 0.12) -0.001 0.046 0.978 0.993 0.07 (0.01, 0.22) 0.054 0.039 0.166 0.334
Default-LeftHippocampus 0.3 (0.03, 0.93) -0.195 0.078 0.013 0.129 0.01 (0, 0.12) -0.020 0.046 0.661 0.821 0.05 (0, 0.17) -0.061 0.039 0.117 0.258
Default-LeftVentraldc 0.17 (0.01, 0.6) -0.136 0.078 0.083 0.389 0.03 (0, 0.18) -0.059 0.047 0.209 0.410 0.06 (0, 0.21) -0.074 0.040 0.063 0.157
DorsalAttention-LeftAccumbensArea 0.31 (0.02, 0.91) -0.210 0.077 0.007 0.083 0 (0, 0.08) 0.021 0.046 0.651 0.818 0.01 (0, 0.09) -0.012 0.039 0.765 0.879
DorsalAttention-LeftHippocampus 0.51 (0.07, 1.23) 0.250 0.078 0.001 0.028 0.01 (0, 0.08) -0.033 0.046 0.476 0.689 0.03 (0, 0.13) 0.022 0.039 0.573 0.757
DorsalAttention-LeftVentraldc 0.25 (0.02, 0.87) -0.171 0.077 0.027 0.210 0.06 (0, 0.25) -0.067 0.047 0.149 0.321 0.08 (0.01, 0.26) -0.082 0.040 0.038 0.105
FrontoParietal-LeftVentraldc 0.22 (0.01, 0.78) -0.168 0.079 0.034 0.236 0 (0, 0.08) 0.004 0.047 0.941 0.973 0 (0, 0.08) -0.011 0.040 0.783 0.888
FrontoParietal-RightVentraldc 0.32 (0.02, 1) -0.210 0.080 0.008 0.095 0 (0, 0.08) 0.004 0.047 0.937 0.972 0.01 (0, 0.1) -0.034 0.040 0.398 0.601
FrontoParietal-SensorimotorMouth 0.29 (0.02, 0.81) -0.189 0.078 0.015 0.144 0.03 (0, 0.17) -0.067 0.047 0.150 0.323 0.03 (0, 0.13) -0.056 0.040 0.160 0.326
RetrosplenialTemporal-RightCerebellumCortex 0.28 (0.04, 0.85) -0.154 0.077 0.044 0.277 0.08 (0.01, 0.28) -0.075 0.046 0.104 0.247 0.12 (0.03, 0.28) -0.094 0.039 0.016 0.050
RetrosplenialTemporal-RightThalamusProper 0.21 (0.01, 0.75) -0.135 0.077 0.079 0.377 0.17 (0.03, 0.44) -0.122 0.046 0.008 0.029 0.21 (0.07, 0.44) -0.140 0.039 0.000 0.002
Salience-LeftAccumbensArea 0.19 (0.01, 0.69) -0.134 0.077 0.082 0.386 0.04 (0, 0.18) -0.039 0.046 0.403 0.624 0.06 (0.01, 0.2) -0.055 0.039 0.163 0.330
Salience-LeftVentraldc 0.33 (0.03, 1) 0.199 0.077 0.010 0.113 0.03 (0, 0.18) 0.032 0.046 0.493 0.703 0.07 (0.01, 0.23) 0.062 0.039 0.114 0.251
Salience-RightAmygdala 0.21 (0.01, 0.77) -0.173 0.077 0.026 0.203 0.1 (0, 0.3) 0.111 0.047 0.017 0.058 0.07 (0, 0.23) 0.095 0.040 0.017 0.052
SensorimotorHand-BrainStem 0.25 (0.02, 0.78) -0.147 0.077 0.058 0.321 0.05 (0.01, 0.21) -0.048 0.046 0.298 0.518 0.08 (0.01, 0.23) -0.068 0.039 0.082 0.195
SensorimotorHand-RightHippocampus 0.29 (0.03, 0.88) -0.174 0.078 0.026 0.204 0.01 (0, 0.12) 0.044 0.046 0.339 0.561 0.01 (0, 0.08) 0.002 0.039 0.957 0.981
SensorimotorHand-RightThalamusProper 0.19 (0.01, 0.67) 0.157 0.078 0.045 0.280 0.01 (0, 0.11) -0.045 0.047 0.337 0.561 0.02 (0, 0.14) 0.024 0.040 0.538 0.728
SensorimotorMouth-LeftVentraldc 0.22 (0.01, 0.8) -0.140 0.076 0.068 0.347 0.01 (0, 0.09) -0.016 0.046 0.726 0.864 0.04 (0, 0.15) -0.060 0.039 0.126 0.273
Within-CinguloOpercular 0.3 (0.03, 0.86) -0.141 0.076 0.062 0.332 0.08 (0.01, 0.25) -0.056 0.046 0.217 0.420 0.1 (0.02, 0.26) -0.068 0.039 0.078 0.188
Within-RetrosplenialTemporal 0.44 (0.08, 1.07) -0.204 0.076 0.008 0.088 0 (0, 0.08) 0.038 0.046 0.406 0.627 0.03 (0.01, 0.14) -0.014 0.039 0.728 0.857

Effect size represents the percentage of the total variance (proportion of variance * 100%) in a rsfMRI connectivity measure accounted for by anhedonia. The partial regression coefficient (Estimate), standard error (Std.Err), nominal p-value (p), and conservative Benjamini-Hochberg adjusted p-value (p.adj) for anhedonia are also shown for each rsfMRI regression model. Partial regression coefficient estimates represent changes in the rsfMRI measure, in standard deviation units from the mean, associated with the presence of anhedonia. Bolded results were significant at the adjusted p-value level (p.adj < 0.05). Note that the sum of the participants from the ABCD 1.0 and ABCD 4.0 (excluding) 1.0 samples exceeds the number of participants from the full ABCD 4.0 sample due to additional participants from the ABCD 1.0 sample being excluded from the full ABCD 4.0 sample during the quality control (QC) steps. Differences between processing pipelines between the data releases may account for these discrepancies in QC measures.

We note that the Auditory vs. Right Putamen and Retrosplenial-Temporal vs. Right-Thalamus-Proper measures were not found to be associated with anhedonia in the ABCD 1.0 sample (Table 6, left) at the adjusted or nominal p-value levels (although there was a trend). However, we see that the effect sizes and partial regression coefficients were similar in magnitude and sign to those estimated in the corresponding regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, albeit with wider confidence intervals and larger standard errors. These patterns suggest that the ABCD 1.0 sample size was not well-powered enough, after including the additional psychiatric comorbidity measures, to detect these associations.

Anhedonia was also found to be significantly associated with the CinguloOpercular-Brainstem connectivity measure at the adjusted p-value level when using the full ABCD 4.0 sample (Table 6, right). However, as with most of the other rsfMRI measures, its effect size was significantly decreased in the replication analyses using the ABCD 4.0 (excluding 1.0) sample. The instability in effect size suggests that the association found using the full ABCD 4.0 sample is likely driven by the inflated effect size found in the ABCD 1.0 sample which, in turn, may be due to sample-specific characteristics (ie. other confounding factors) or random measurement error.

The remaining rsfMRI measures exhibited extremely small effect sizes that did not survive statistical thresholding. However, larger samples with more statistical power may be able to detect them, though whether these effects, along with the ones we detected in this study, are clinically meaningful remains to be determined.

We note that there were 2163 families in the ABCD 1.0 sample, 5754 families in the ABCD 4.0 (excluding 1.0) sample, and 7688 families in the ABCD 4.0 sample. The average Intra-Class-Correlation (ICC) across the regressions using the ABCD 1.0 sample was 0.09 (sd = 0.07) indicating that the random effects of family structure accounted for about 9% of the variability in rsfMRI connectivity measures (S4 and S5 Tables). However, the standard deviation was fairly large, indicating significant variability across regressions. Similarly, for regressions using the ABCD 4.0 (excluding 1.0) sample and the full ABCD 4.0 sample, the average ICC across regressions was 0.10 (SD = 0.05) and 0.11 (SD = 0.05), respectively (S6S9 Tables).

For the multiple linear regression analyses, patterns of missingness closely resembled those reported for the samples used in the t-tests. Notably, individuals removed due to missingness exhibited higher proportions of those identifying as African American and those endorsing depressed mood (S16 Table). However, the proportion of participants removed was less than 5% of the total sample for each set of analyses and thus, were unlikely to bias the results.

Several assumptions for multiple linear regression were assessed across all the analyses. Multicollinearity between predictors was assessed with the variance inflation factor (VIF) where generalized VIF (GVIF) values greater than 5 indicate significant multicollinearity between predictors in a multiple linear regression model. For the regressions performed across the ABCD 1.0, ABCD 4.0 (excluding 1.0), and full ABCD 4.0 samples, we obtained GVIF values for predictors in each regression and then found their average values across all regressions, separately for each ABCD sample (S14 and S15 Tables). No regressions exhibited significant multicollinearity between predictors. We performed Durbin-Watson tests to detect auto-correlation between the residuals from each of the regressions and found all test statistics were between 1.5–2.5, and thus within the acceptable range for auto-correlations (S4S9 Tables).

We performed the Breusch-Pagan (BP) test to the assumption of homoscedasticity for the model residuals from all the regressions (S4S9 Tables). For the regressions using the ABCD 1.0 sample, one rsfMRI measure associated with anhedonia exhibited a significant BP test. For the regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, 4 rsfMRI measures associated with anhedonia exhibited significant BP tests, each. For the rsfMRI measures with significant BP tests, we plotted their model residuals against marginal model fitted values and did not detect any significant patterns of heteroskedasticity, visually (S6S11 Figs (left)). To be sure, we performed weighted-least-squares (WLS) regressions, which is able to account for differences in variance in the residuals, for these rsfMRI measures, and then correlated the t-statistics from the WLS and the original ordinary-least squares (OLS) regressions. The correlations were all equal to 1, indicating little effect of potential unequal variances on the results (S6S11 Figs (right)).

Finally, we performed a visual inspection of density plots of the residuals from regressions for 3 representative rsfMRI measures significantly associated with anhedonia and their Quantile-Quantile (QQ) plots for each set of regressions across the ABCD samples. All appeared normally distributed (S12S17 Figs.).

Discussion

Reproduction and replication of previous findings

While we were able to successfully reproduce the previous authors’ findings, we were mostly unable to replicate them using a larger independent subset of the full ABCD 4.0 release sample. Using t-tests, only the Within-Cingulo-Opercular rsfMRI measure was consistently associated with anhedonia across the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples. However, when we controlled for demographic covariates (sex, age, and race/ethnicity) using a linear regression approach, the association was no longer replicable in the ABCD 4.0 (excluding 1.0) sample. Like the other associations identified by the previous authors, we observed a significant decrease in effect size in the replication analysis after controlling for these additional covariates suggesting the presence of significant confounding effects that were not accounted for with t-tests. Furthermore, large decreases in effect size in replication analyses have been reported to occur more frequently when the initial discovery sample is small, such that the most inflated and statistically significant findings are the most likely to be identified and reported [27]. Unfortunately, these inflated findings are the least replicable as regression towards the mean leads to reductions in both effect size and significance in subsequent replications. Of note, Marek et al., 2022 found that controlling for sociodemographic covariates generally reduced effect sizes, and thus may help reduce effect size inflation.

Interestingly, when we considered rsfMRI measures associated with anhedonia at the nominal p-value level in our multiple linear regressions using the ABCD 1.0 sample, we were able to identify 2 new rsfMRI measures (the Auditory vs. Right Putamen and the Retrosplenial-Temporal vs. Right-Thalamus-Proper measures) associated with anhedonia that were replicable. Notably, these 2 rsfMRI measures exhibited smaller, and less statistically significant, effect sizes in the ABCD 1.0 sample that remained relatively consistent across the regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples. Thus, these findings suggest that replicability may be improved if less emphasis was placed on associations with the most statistical significance but rather on identifying those with the most stable effects across analyses, even if they are less statistically significant.

Of note, a recent study exploring the replicability of brain-behavior association studies using simulations and parametric bootstrapping methods found that relatively small sample sizes (n<500) produced results with significantly inflated effect sizes, low precision, and low replicability and it was only when the sample sizes were increased to the high hundreds or thousands were they able to produce stable effects that were significantly more replicable [27]. To maximize statistical power and to reduce the likelihood of selecting inflated associations, future discovery analyses should be conducted using larger samples, such as in the full ABCD 4.0 release sample.

Although we found 2 rsfMRI measures with replicable associations, the actual effect sizes were extremely small, with anhedonia accounting for about 0.2% of the total variance for each rsfMRI measure. By themselves, these findings are unlikely to be clinically meaningful. However, combining the small effects of many brain-based measures together may produce signals with significant clinical utility in either diagnostic prediction or monitoring disease progression [28, 29]. An analogous approach has been taken in genetic research whereby many genetic variants, which individually exhibit miniscule amounts of association, can be combined to produce genetic risk scores [30] that altogether contribute meaningfully to the prediction of the course of complex neuropsychiatric disorders [31].

By including the other predictors, the multiple linear regression models accounted for about 4.5% of the total variance in the Auditory vs. Right Putamen rsfMRI measure and about 3% of the total variance for the Retrosplenial-Temporal vs. Right-Thalmaus-Proper rsfMRI measure (Fig 2). For both regression models, the race/ethnicity predictor accounted for the vast majority of the explained variance. Upon inspection of the partial regression coefficients for each model, Black, Hispanic, and Other race/ethnicity exhibited the largest and most significant partial regression coefficients for both rsfMRI measures (S9 Table).

Fig 2. Relative importance of independent variables in multiple linear regressions.

Fig 2

The proportion of the total variance in the Auditory vs. Right-Putamen (top) and Retrosplenial-Temporal vs. Right-Thalamus-Proper (bottom) rsfMRI measures accounted for by each of the independent variables in the regression models are shown. R2 is the proportion of the total variance explained by each regression model. Race represents the race/ethnicity factor, Anhe represents anhedonia, Age represents age (in weeks), Sex represents participant sex, Bipo represents bipolar II disorder, Irri represents irritability, and Depr represents depressed mood.

Importantly, we also found there were significantly higher proportions of Black and Hispanic participants in the anhedonia group compared to controls without anhedonia in the ABCD samples. Race and ethnicity are social constructs representing complex social and cultural factors [32] deserving careful consideration. Several previous studies have reported significantly higher risk of anhedonia in Black and Hispanic compared to non-Hispanic White adults [33, 34] and that these associations may, in part, be accounted for by socioeconomic factors, such as household income and education, as well as other social determinants of health [35], such as disparities in access to healthcare [33]. In the ABCD sample, racial discrimination may be an important factor contributing to risk of anhedonia as well as differences in brain-based measures. For example, several recent studies have found that racial discrimination is associated with lower total brain volume [36] and alterations in prefrontal white matter tracts in adults [37, 38]. While out of the scope of this study, it will be critical to investigate how social determinants of health and other environmental factors, such as trauma [4, 39], contribute to differences in health and brain-based outcomes between different racial and ethnic groups during child and adolescent development.

Specificity of associations

We found depressed mood, irritability, and bipolar II disorder to be significantly comorbid with anhedonia. Using a multiple linear regression approach in the full ABCD 4.0 dataset, we were able to estimate the effects of anhedonia on rsfMRI connectivity measures independent of those comorbid conditions. For the two rsfMRI measures with replicable associations with anhedonia, inclusion of the comorbid psychiatric conditions in the multiple linear regressions resulted in only a slight decrease in effect size and estimate of the partial regression coefficient for anhedonia. Together with the finding that none the partial regression coefficients for the comorbid psychiatric conditions were significantly associated with these two rsfMRI measures, the results suggest that the associations are specific to anhedonia.

The presence of anhedonia was associated with a decrease in the Auditory vs. Right-Putamen connectivity measure. Previous functional neuroimaging studies have found that functional activation between regions of the auditory cortex and putamen occurs during speech learning [40]. Specifically, higher coactivation was associated with incorrect categorization of auditory stimuli. The authors proposed that the putamen may act to “tune” activity in the auditory cortices to help facilitate learning how to correctly categorize tones that lead to positive feedback. In the context of anhedonia, reduced connectivity between auditory and the putamen may reflect a more general impairment in reward based learning [41]. For example, individuals with high levels of anhedonia have been shown to exhibit diminished ability to learn to modify their behavior during certain tasks in order to obtain larger rewards [42]. Decreased connectivity between the striatal reward regions, such as the putamen, and cortical networks may disrupt the processes that drive behavioral and motivational adaptations that, in part, characterize anhedonia.

Anhedonia was also associated with decreases in the Retrosplenial-Temporal vs. Right-Thalamus-Proper connectivity measure. Few studies have reported on this connectivity measure in the context of anhedonia. The retrosplenial cortex has been associated with many cognitive processes, notably with impaired memory [43]. Interestingly, one study showed that individuals with social anhedonia exhibited increased functional connectivity between the retrosplenial cortex and several other brain regions, which were also correlated with lower anticipated pleasure in social situations that may point to the role of the retrosplenial cortex in future-oriented thinking [44]. As the thalamus has important functions in emotion and arousal [45], we speculate that a disrupted connectivity between retrosplenial networks and the thalamus may be associated with impaired future-oriented thinking about emotionally rewarding things or situations that may underlie the decreased motivational aspects of anhedonia. Interestingly, a recent study found significant anatomical connectivity between the restrosplenial cortex and fronto-striatal reward regions, suggesting a more direct involvement of the retrosplenial cortex in reward and decision making processes [46]. Altogether, our findings suggest that disrupted brain connectivity may underlie impairments in learning, emotional, and motivational processes associated with anhedonia. If brain dysfunction is a causal factor in the development of dysregulated processes associated with anhedonia, then they may become significant targets of preventative interventions and therapeutic treatments, including pharmacological or psychotherapies.

Our findings suggest that we have identified rsfMRI connectivity measures specifically associated with anhedonia that are independent from comorbid conditions, such as depressed mood. As such, the interpretation of anhedonia requires careful consideration and reflection. As mentioned previously, while anhedonia and depressed mood are core symptoms of major depressive disorders, they are considered distinct processes [17]. Alternatively, the hierarchical Taxonomy of Psychopathology (HiTOP) [47], a recently developed dimensional framework for psychopathology, has classified anhedonia as a symptom belonging to two high level sepctra of psychopathology; the internalizing and detachment spectra. Interestingly, low/depressed mood and irritability also fall under the internalizing spectrum whereas bipolar II falls under the thought disorder spectrum. Thus, when estimating the effects of anhedonia independent of other internalizing and thought disorder related symptoms, we could interpret the remaining effect to emphasize detachment processes. As detachment is a component of the psychosis super-spectrum [48] our findings may represent anhedonic neurocircuitry that may, in part, be related to schizophrenia, schizotypal personality, or other psychotic disorder processes. Further work is required to assess the extent to which differences in rsfMRI connectivity specific to anhedonia better associates with or even predicts dimensional measures of internalizing or detachment related psychopathology.

Limitations

We acknowledge that while we referred to our analyses using the ABCD 4.0 (excluding 1.0) sample as analogous to replication in an independent sample, the participants do come from the same ABCD study and thus, our analyses do not conform to the strictest definition of a replication study. As such, shared aspects of data collection and processing, as well as other uncharacterized factors unique to the ABCD study may potentially impact our results. Future studies using a completely independent dataset will be required to assess the validity of our findings.

Another limitation of our study was the use of seed-based correlational methods to compute network connectivity measures in functionally-defined networks. As such, these network connectivity measures are averages over large and distributed networks where signals from sub-regions potentially highly associated with anhedonia may be drowned out by signals from sub-regions with low levels of association. Another concern is that the Gordon brain parcellations were produced using a boundary-mapping approach in adult brains [21] so whether they are generalizable to the brains of developing children is important to consider. For example, one study found that the functional topography of connectivity networks does change with age which was predictive of individual differences in executive function [49]. One alternative method is to use a decomposition-based method, such as independent components analysis (ICA), to define functional connectivity measures [50]. ICA is a data driven approach that extracts components that maximally explain the data and thus, may enhance predictive performance. One study took such an approach and found that using a decomposition-based, compared to a seed-based, extraction of functional networks during a social cognition task achieved significantly greater performance in predicting the degree of social anhedonia in around 70 adolescents/young adults with varying levels of schizotypy [51]. Since the raw neuroimaging data from the ABCD data are publicly available, this may be a feasible approach to implement in a future study.

In our study, we use a binary classifier for childhood anhedonia. However, several studies have reported greater predictive performance of neuroimaging measures on anhedonia symptom scores [51, 52] which suggests that functional neuroimaging measures may be more useful for predicting symptom severity rather than for disorder classification. Thus, it may be more reliable to investigate the associations between functional neuroimaging measures and clinical scales for assessing behavioral problems (such as the Child Behavior Checklist) or neurocognitive performance in individuals with anhedonia.

Finally, the DSM-V definition of anhedonia conflates two distinct reward processes: motivational (interest/wanting) and consummatory (pleasurable/liking) behaviors. These behaviors have been shown to have distinct neurobiological and behavioral components [10, 53]. We are limited in our study because we do not distinguish between these processes. However, the ABCD study data does include task-based functional neuroimaging of participants completing the monetary incentive delay task, which is able to assess the anticipatory, consummatory, and learning aspects of reward [54]. These processes were studied previously by Pornpattananangkul et al., but exceeded the scope of this study. Nevertheless, exploration of brain connectivity specific to each of these reward-based components in subjects with anhedonia may help elucidate the underlying circuitry underlying this complex psychiatric condition.

Supporting information

S1 Fig. Correlations between statistics from the current analyses and those reported by the previous authors.

Pearson correlations for student’s t-statistics (left) and lnBF statistics (right) derived from the previous author’s analyses and those derived from our reproduction analyses for A) anhedonia, B) depressed mood, and C) anxiety. LnBF are natural logarithm of Bayes Factors.

(DOCX)

S2 Fig. Visual inspection of normality for rsfMRI connectivity measures from the ABCD 1.0 sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures.

(DOCX)

S3 Fig. Comparing Welch’s t-tests to Student’s t-tests.

To assess the potential bias introduced by unequal variances across anhedonia and control groups, we performed Welch’s t-tests for those rsfMRI measures with significant F-tests in the A) ABCD 1.0, B) ABCD 4.0 (excluding 1.0), and C) full ABCD 4.0 samples and then correlated the Welch’s t-statistics with Student’s t-statistics (left) and the Welch’s p-values with Student’s p-values (right).

(DOCX)

S4 Fig. Visual inspection of normality for rsfMRI connectivity measures from the ABCD 4.0 (excluding ABCD 1.0) sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures.

(DOCX)

S5 Fig. Visual inspection of normality for rsfMRI connectivity measures from the full ABCD 4.0 sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures.

(DOCX)

S6 Fig. Visual inspection of residuals from the regression (controlling for sociodemographic covariates) for the FrontoParietalRightVentraldc rsfMRI connectivity measure using the ABCD 1.0 and correlations between OLS and WLS t-statistics.

Here, we visualize the residuals plotted against marginal fitted values of the linear regression model for the FrontoParietalRightVentraldc rsfMRI measure using the ABCD 1.0 sample (left), which exhibited a significant BP test for heteroskedasticity. We also performed weighted-least-squares regression (WLS) and correlated the t-statistics for each model predictor with those from the original ordinary-least-squares (OLS) regression (right).

(DOCX)

S7 Fig. Visual inspection of residuals from the regression for FrontoParietalRightVentraldc rsfMRI measure (controlling for sociodemographic and psychiatric comorbidities) using the ABCD 1.0 sample and correlations between OLS and WLS t-statistics.

Here, we visualize the residuals plotted against marginal fitted values of the linear regression model for the FrontoParietalRightVentraldc rsfMRI measure using the ABCD 1.0 sample (left), which exhibited a significant BP test for heteroskedasticity. We also performed weighted-least-squares regression (WLS) and correlated the t-statistics for each of the model predictors with those from the original ordinary-least-squares (OLS) regressions (right).

(DOCX)

S8 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic covariates only) using the ABCD 4.0 (excluding 1.0) sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for each of the model predictors with those from the original ordinary-least-squares (OLS) regressions. Note that some plots present a more discrete distribution of residuals along the fitted-values axis. These patterns occur when categorical predictors (such as race/ethnicity) exhibit greater effects in the model, compared to more continuous predictors (such as age), and thus are weighted more when producing predicted values.

(DOCX)

S9 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic and psychiatric comorbidities) using the ABCD 4.0 (excluding 1.0) sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for the model predictors with those from the original ordinary-least-squares (OLS) regressions.

(DOCX)

S10 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic covariates only) using the full ABCD 4.0 sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for the model predictors with those from the original ordinary-least-squares (OLS) regressions.

(DOCX)

S11 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic covariates and psychiatric comorbidities) using the full ABCD 4.0 sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for the model predictors with those from the original ordinary-least-squares (OLS) regressions.

(DOCX)

S12 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models controlling for sociodemographic covariates using the ABCD 1.0 sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

(DOCX)

S13 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic and psychiatric comorbidities using the ABCD 1.0 sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

(DOCX)

S14 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates using the ABCD 4.0 (excluding 1.0) sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

(DOCX)

S15 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates and psychiatric comorbidities using the ABCD 4.0 (excluding 1.0) sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

(DOCX)

S16 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates using the full ABCD 4.0 sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

(DOCX)

S17 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates and psychiatric comorbidities using the full ABCD 4.0 sample.

Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

(DOCX)

S1 Table. T-test results comparing those with anhedonia from controls using the ABCD 1.0 sample.

Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, ln(Bayes Factor) (lnBF), group means with standard deviations (SD), Shapiro-Wilk statistics (W-statistic), and F-statistics are reported.

(XLSX)

S2 Table. T-test results comparing those with anhedonia from controls using the ABCD 4.0 (excluding 1.0) sample.

Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, ln(Bayes Factor) (lnBF), group means with standard deviations (SD), Shapiro-Wilk statistics (W-statistic), and F-statistics are reported.

(XLSX)

S3 Table. T-test results comparing those with anhedonia from controls using the full ABCD 4.0 sample.

Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, ln(Bayes Factor) (lnBF), group means with standard deviations (SD), Shapiro-Wilk statistics (W-statistic), and F-statistics are reported.

(XLSX)

S4 Table. Multiple linear regression results in the ABCD 1.0 sample, controlling for sociodemographic covariates.

The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

(XLSX)

S5 Table. Multiple linear regression results in ABCD 1.0 sample, controlling for sociodemographic covariates and psychiatric comorbidities.

The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

(XLSX)

S6 Table. Multiple linear regression results in ABCD 4.0 (excluding 1.0) sample, controlling for sociodemographic covariates.

The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

(XLSX)

S7 Table. Multiple linear regression results in ABCD 4.0 (excluding 1.0) sample, controlling for sociodemographic covariates and psychiatric comorbidities.

The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

(XLSX)

S8 Table. Multiple linear regression results in the full ABCD 4.0 sample, controlling for sociodemographic covariates.

The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

(XLSX)

S9 Table. Multiple linear regression results in the full ABCD 4.0 sample, controlling for sociodemographic covariates and psychiatric comorbidities.

The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

(XLSX)

S10 Table. Comparison of participants removed due to missing data with participants who were retained for the t-test analyses.

The proportion (%) of participants in each group for each measure are shown. Student’s t-test was done to compare age (in months) between the “removed” and “retained” groups. Chi-square tests of independence were done for all other measures. P-values < 0.05 are bolded.

(XLSX)

S11 Table. Tetrachoric correlations between youth reported anhedonia and other psychiatric conditions reproted by parents or youths.

Items ending in "_y" are youth reported measures, and items ending in "_p" are parent reported measures.

(XLSX)

S12 Table. Prevalence of significantly comorbid psychiatric symptoms and diagnoses in those reporting anhedonia at baseline.

The frequencies of three psychiatric symptoms and diagnoses, in individuals reporting anhedonia, significantly correlated (tetrachoric correlation r > = 0.5) with youth reported anhedonia are shown. Note that before filtering out participants with low-quality functional MRI scans, 1104 participants at baseline reported past and/or present anhedonia. The suffix “_y” indicate measures based on youths’ self-reports.

(XLSX)

S13 Table. T-tests results for comparisons between those with depressed mood, irritability, and bipolar II disorder and controls using the full ABCD 4.0 sample.

Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, and ln(Bayes Factor) (lnBF) statistics are reported. Bolded values represent statistically significant results, as indicated by lnBF values > 1.1.

(XLSX)

S14 Table. Average Generalized Variance Inflation Factor (GVIF) values for predictors from multiple linear regressions controlling for sociodemographic covariates across the ABCD samples.

(XLSX)

S15 Table. Average Generalized Variance Inflation Factor (GVIF) values for predictors from multiple linear regressions controlling for sociodemographic covariates and psychiatric comorbidities across the ABCD samples.

(XLSX)

S16 Table. Comparison of participants removed due to missing data with participants who were retained for the multiple linear regression analyses.

The proportion (%) of participants in each group for each measure are shown. Student’s t-test was done to compare age (in months) between the "removed" and "retained" groups. Chi-square tests of independence were done for all other measures. p-values < 0.05 are bolded.

(XLSX)

S17 Table. Effects of bipolar II disorder, irritability, and depressed mood from multiple linear regression analyses across the ABCD study samples for 27 rsfMRI measures associated with anhedonia.

Effect size (effect_CIs) with 95% confidence intervals represents the percentage of the total variance (proportion of variance * 100%) in a rsfMRI connectivity measure accounted for by each predictor (psychiatric symptom or diagnosis). Total model R^2 (total_R2), partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, and Benjamini-Hochberg corrected p-values (BH_adjustment) values are reported.

(XLSX)

Acknowledgments

Data used in the preparation of this article were obtained from the Adolescent Brain Cognitive DevelopmentSM (ABCD) Study (https://abcdstudy.org), held in the NIMH Data Archive (NDA). This is a multisite, longitudinal study designed to recruit more than 10,000 children age 9–10 and follow them over 10 years into early adulthood. The ABCD Study® is supported by the National Institutes of Health and additional federal partners under award numbers U01DA041048, U01DA050989, U01DA051016, U01DA041022, U01DA051018, U01DA051037, U01DA050987, U01DA041174, U01DA041106, U01DA041117, U01DA041028, U01DA041134, U01DA050988, U01DA051039, U01DA041156, U01DA041025, U01DA041120, U01DA051038, U01DA041148, U01DA041093, U01DA041089, U24DA041123, U24DA041147. A full list of supporters is available at https://abcdstudy.org/federal-partners.html. A listing of participating sites and a complete listing of the study investigators can be found at https://abcdstudy.org/consortium_members/. ABCD consortium investigators designed and implemented the study and/or provided data but did not necessarily participate in the analysis or writing of this report. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or ABCD consortium investigators.

The ABCD data repository grows and changes over time. The ABCD data used in this report came from http://dx.doi.org/10.15154/1523041.

This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or ABCD consortium investigators.

This study received no external funding. Yi Zhou was supported by the department of Psychiatry at Virginia Commonwealth University.

Data Availability

All data files are available from the ABCD Study Data Repository from the NIMH Data Archive (https://nda.nih.gov/abcd). The DOI for this NDA Study is 10.15154/1526460.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.American Psychiatric Association, American Psychiatric Association, editors. Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Washington, D.C: American Psychiatric Association; 2013. [Google Scholar]
  • 2.Gutkovich Z, Morrissey RF, Espaillat RK, Dicker R. Anhedonia and pessimism in hospitalized depressed adolescents. Depress Res Treat 2011;2011:795173. doi: 10.1155/2011/795173 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Garfield JBB, Lubman DI, Yücel M. Anhedonia in substance use disorders: a systematic review of its nature, course and clinical correlates. Aust N Z J Psychiatry 2014;48:36–51. doi: 10.1177/0004867413508455 [DOI] [PubMed] [Google Scholar]
  • 4.Frewen PA, Dozois DJA, Lanius RA. Assessment of anhedonia in psychological trauma: psychometric and neuroimaging perspectives. Eur J Psychotraumatology 2012;3:10.3402/ejpt.v3i0.8587. doi: 10.3402/ejpt.v3i0.8587 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Gałuszko-Węgielnik M, Wiglusz MS, Słupski J, Szałach Ł, Włodarczk A, Górska N, et al. Efficacy of Ketamine in bipolar depression: focus on anhedonia. Psychiatr Danub 2019;31:554–60. [PubMed] [Google Scholar]
  • 6.Sternat T, Fotinos K, Fine A, Epstein I, Katzman MA. Low hedonic tone and attention-deficit hyperactivity disorder: risk factors for treatment resistance in depressed adults. Neuropsychiatr Dis Treat 2018;14:2379–87. doi: 10.2147/NDT.S170645 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Gabbay V, Johnson AR, Alonso CM, Evans LK, Babb JS, Klein RG. Anhedonia, but not Irritability, Is Associated with Illness Severity Outcomes in Adolescent Major Depression. J Child Adolesc Psychopharmacol 2015;25:194–200. doi: 10.1089/cap.2014.0105 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Robbins DR, Alessi NE. Depressive symptoms and suicidal behavior in adolescents. Am J Psychiatry 1985;142:588–92. doi: 10.1176/ajp.142.5.588 [DOI] [PubMed] [Google Scholar]
  • 9.McMakin DL, Olino TM, Porta G, Dietz LJ, Emslie G, Clarke G, et al. Anhedonia predicts poorer recovery among youth with selective serotonin reuptake inhibitor treatment-resistant depression. J Am Acad Child Adolesc Psychiatry 2012;51:404–11. doi: 10.1016/j.jaac.2012.01.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Treadway MT, Zald DH. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci Biobehav Rev 2011;35:537–55. doi: 10.1016/j.neubiorev.2010.06.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lv H, Wang Z, Tong E, Williams LM, Zaharchuk G, Zeineh M, et al. Resting-State Functional MRI: Everything That Nonexperts Have Always Wanted to Know. AJNR Am J Neuroradiol 2018;39:1390–9. doi: 10.3174/ajnr.A5527 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Gabbay V, Ely BA, Li Q, Bangaru SD, Panzer AM, Alonso CM, et al. Striatum-based circuitry of adolescent depression and anhedonia. J Am Acad Child Adolesc Psychiatry 2013;52:628–641.e13. doi: 10.1016/j.jaac.2013.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Rzepa E, McCabe C. Decreased anticipated pleasure correlates with increased salience network resting state functional connectivity in adolescents with depressive symptomatology. J Psychiatr Res 2016;82:40–7. doi: 10.1016/j.jpsychires.2016.07.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Rzepa E, McCabe C. Anhedonia and depression severity dissociated by dmPFC resting-state functional connectivity in adolescents. J Psychopharmacol Oxf Engl 2018;32:1067–74. doi: 10.1177/0269881118799935 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Pornpattananangkul N, Leibenluft E, Pine DS, Stringaris A. Notice of Retraction and Replacement. Pornpattananangkul et al. Association between childhood anhedonia and alterations in large-scale resting-state networks and task-evoked activation. JAMA Psychiatry. 2019;76(6):624–633. JAMA Psychiatry 2020;77:1085–6. 10.1001/jamapsychiatry.2020.1367. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Stevens JR. Replicability and Reproducibility in Comparative Psychology. Front Psychol 2017;8:862. doi: 10.3389/fpsyg.2017.00862 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.De Fruyt J, Sabbe B, Demyttenaere K. Anhedonia in Depressive Disorder: A Narrative Review. Psychopathology 2020;53:274–81. doi: 10.1159/000508773 [DOI] [PubMed] [Google Scholar]
  • 18.Johnson WE, Li C, Rabinovic A. Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics 2007;8:118–27. doi: 10.1093/biostatistics/kxj037 [DOI] [PubMed] [Google Scholar]
  • 19.Hagler DJ, Hatton S, Cornejo MD, Makowski C, Fair DA, Dick AS, et al. Image processing and analysis methods for the Adolescent Brain Cognitive Development Study. NeuroImage 2019;202:116091. doi: 10.1016/j.neuroimage.2019.116091 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Casey BJ, Cannonier T, Conley MI, Cohen AO, Barch DM, Heitzeg MM, et al. The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites. Dev Cogn Neurosci 2018;32:43–54. doi: 10.1016/j.dcn.2018.03.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Gordon EM, Laumann TO, Adeyemo B, Huckins JF, Kelley WM, Petersen SE. Generation and Evaluation of a Cortical Area Parcellation from Resting-State Correlations. Cereb Cortex N Y NY 2016;26:288–303. doi: 10.1093/cercor/bhu239 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Orlhac F, Eertink JJ, Cottereau A-S, Zijlstra JM, Thieblemont C, Meignan M, et al. A Guide to ComBat Harmonization of Imaging Biomarkers in Multicenter Studies. J Nucl Med Off Publ Soc Nucl Med 2022;63:172–9. doi: 10.2967/jnumed.121.262464 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Vidal-Ribas P, Janiri D, Doucet GE, Pornpattananangkul N, Nielson DM, Frangou S, et al. Multimodal neuroimaging of suicidal thoughts and behaviors in a US population-based sample of school-aged children. Am J Psychiatry 2021;178:321–32. 10.1176/appi.ajp.2020.20020120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Feise RJ. Do multiple outcome measures require p-value adjustment? BMC Med Res Methodol 2002;2:8. doi: 10.1186/1471-2288-2-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Ghasemi A, Zahediasl S. Normality Tests for Statistical Analysis: A Guide for Non-Statisticians. Int J Endocrinol Metab 2012;10:486–9. doi: 10.5812/ijem.3505 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Jakobsen JC, Gluud C, Wetterslev J, Winkel P. When and how should multiple imputation be used for handling missing data in randomised clinical trials–a practical guide with flowcharts. BMC Med Res Methodol 2017;17:162. doi: 10.1186/s12874-017-0442-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Marek S, Tervo-Clemmens B, Calabro FJ, Montez DF, Kay BP, Hatoum AS, et al. Reproducible brain-wide association studies require thousands of individuals. Nature 2022;603:654–60. doi: 10.1038/s41586-022-04492-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Zhu Y, Qi S, Zhang B, He D, Teng Y, Hu J, et al. Connectome-Based Biomarkers Predict Subclinical Depression and Identify Abnormal Brain Connections With the Lateral Habenula and Thalamus. Front Psychiatry 2019;10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Chin Fatt CR, Jha MK, Cooper CM, Fonzo G, South C, Grannemann B, et al. Effect of Intrinsic Patterns of Functional Brain Connectivity in Moderating Antidepressant Treatment Response in Major Depression. Am J Psychiatry 2020;177:143–54. doi: 10.1176/appi.ajp.2019.18070870 [DOI] [PubMed] [Google Scholar]
  • 30.Torkamani A, Wineinger NE, Topol EJ. The personal and clinical utility of polygenic risk scores. Nat Rev Genet 2018;19:581–90. doi: 10.1038/s41576-018-0018-x [DOI] [PubMed] [Google Scholar]
  • 31.Jonas KG, Lencz T, Li K, Malhotra AK, Perlman G, Fochtmann LJ, et al. Schizophrenia polygenic risk score and 20-year course of illness in psychotic disorders. Transl Psychiatry 2019;9:1–8. 10.1038/s41398-019-0612-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.LaVeist TA. Beyond dummy variables and sample selection: what health services researchers ought to know about race as a variable. Health Serv Res 1994;29:1–16. [PMC free article] [PubMed] [Google Scholar]
  • 33.Vyas CM, Donneyong M, Mischoulon D, Chang G, Gibson H, Cook NR, et al. Association of Race and Ethnicity With Late-Life Depression Severity, Symptom Burden, and Care. JAMA Netw Open 2020;3:e201606. doi: 10.1001/jamanetworkopen.2020.1606 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Liu CH, Tronick E. Prevalence and predictors of maternal postpartum depressed mood and anhedonia by race and ethnicity. Epidemiol Psychiatr Sci 2014;23:201–9. doi: 10.1017/S2045796013000413 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Braveman PA, Cubbin C, Egerter S, Williams DR, Pamuk E. Socioeconomic disparities in health in the United States: what the patterns tell us. Am J Public Health 2010;100 Suppl 1:S186–196. doi: 10.2105/AJPH.2009.166082 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Meyer CS, Schreiner PJ, Lim K, Battapady H, Launer LJ. Depressive Symptomatology, Racial Discrimination Experience, and Brain Tissue Volumes Observed on Magnetic Resonance Imaging: The CARDIA Study. Am J Epidemiol 2019;188:656–63. 10.1093/aje/kwy282. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Okeke O, Elbasheir A, Carter SE, Powers A, Mekawi Y, Gillespie CF, et al. Indirect Effects of Racial Discrimination on Health Outcomes Through Prefrontal Cortical White Matter Integrity. Biol Psychiatry Cogn Neurosci Neuroimaging 2022. doi: 10.1016/j.bpsc.2022.05.004 [DOI] [PubMed] [Google Scholar]
  • 38.Fani N, Harnett NG, Bradley B, Mekawi Y, Powers A, Stevens JS, et al. Racial Discrimination and White Matter Microstructure in Trauma-Exposed Black Women. Biol Psychiatry 2022;91:254–61. doi: 10.1016/j.biopsych.2021.08.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Olson EA, Kaiser RH, Pizzagalli DA, Rauch SL, Rosso IM. Anhedonia in trauma-exposed individuals: functional connectivity and decision-making correlates. Biol Psychiatry Cogn Neurosci Neuroimaging 2018;3:959–67. doi: 10.1016/j.bpsc.2017.10.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Feng G, Yi HG, Chandrasekaran B. The Role of the Human Auditory Corticostriatal Network in Speech Learning. Cereb Cortex N Y NY 2019;29:4077–89. doi: 10.1093/cercor/bhy289 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Rømer Thomsen K. Measuring anhedonia: impaired ability to pursue, experience, and learn about reward. Front Psychol 2015;6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Vrieze E, Pizzagalli DA, Demyttenaere K, Hompes T, Sienaert P, de Boer P, et al. Reduced Reward Learning predicts outcome in Major Depressive Disorder. Biol Psychiatry 2013;73:639–45. doi: 10.1016/j.biopsych.2012.10.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Vann SD, Aggleton JP, Maguire EA. What does the retrosplenial cortex do? Nat Rev Neurosci 2009;10:792–802. 10.1038/nrn2733. [DOI] [PubMed] [Google Scholar]
  • 44.Zhang R, Yang Z, Wang Y, Wang Y, Yang T-X, Cheung EFC, et al. Affective forecasting in individuals with social anhedonia: The role of social components in anticipated emotion, prospection and neural activation. Schizophr Res 2020;215:322–9. doi: 10.1016/j.schres.2019.10.006 [DOI] [PubMed] [Google Scholar]
  • 45.Taber KH, Wen C, Khan A, Hurley RA. The Limbic Thalamus. J Neuropsychiatry Clin Neurosci 2004;16:127–32. doi: 10.1176/jnp.16.2.127 [DOI] [PubMed] [Google Scholar]
  • 46.Monko ME, Heilbronner SR. Retrosplenial Cortical Connectivity with Frontal Basal Ganglia Networks. J Cogn Neurosci 2021;33:1096–105. doi: 10.1162/jocn_a_01699 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Conway CC, Forbes MK, South SC. A Hierarchical Taxonomy of Psychopathology (HiTOP) Primer for Mental Health Researchers. Clin Psychol Sci 2022;10:236–58. doi: 10.1177/21677026211017834 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Kotov R, Jonas KG, Carpenter WT, Dretsch MN, Eaton NR, Forbes MK, et al. Validity and utility of Hierarchical Taxonomy of Psychopathology (HiTOP): I. Psychosis superspectrum. World Psychiatry 2020;19:151–72. doi: 10.1002/wps.20730 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Cui Z, Li H, Xia CH, Larsen B, Adebimpe A, Baum GL, et al. Individual Variation in Functional Topography of Association Networks in Youth. Neuron 2020;106:340–353.e8. 10.1016/j.neuron.2020.01.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.McKeown MJ, Hansen LK, Sejnowsk TJ. Independent component analysis of functional MRI: what is signal and what is noise? Curr Opin Neurobiol 2003;13:620–9. doi: 10.1016/j.conb.2003.09.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Krohne LG, Wang Y, Hinrich JL, Moerup M, Chan RCK, Madsen KH. Classification of social anhedonia using temporal and spatial network features from a social cognition fMRI task. Hum Brain Mapp 2019;40:4965–81. doi: 10.1002/hbm.24751 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Mellem MS, Liu Y, Gonzalez H, Kollada M, Martin WJ, Ahammad P. Machine Learning Models Identify Multimodal Measurements Highly Predictive of Transdiagnostic Symptom Severity for Mood, Anhedonia, and Anxiety. Biol Psychiatry Cogn Neurosci Neuroimaging 2020;5:56–67. doi: 10.1016/j.bpsc.2019.07.007 [DOI] [PubMed] [Google Scholar]
  • 53.Der-Avakian A, Markou A. The Neurobiology of Anhedonia and Other Reward-Related Deficits. Trends Neurosci 2012;35:68–77. doi: 10.1016/j.tins.2011.11.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Wilson RP, Colizzi M, Bossong MG, Allen P, Kempton M, Abe N, et al. The Neural Substrate of Reward Anticipation in Health: A Meta-Analysis of fMRI Findings in the Monetary Incentive Delay Task. Neuropsychol Rev 2018;28:496–506. doi: 10.1007/s11065-018-9385-5 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Melissa A Brotman

19 Dec 2022

PONE-D-22-28899Associations Between Resting State Functional Brain Connectivity and Childhood Anhedonia: A Reproduction and Replication StudyPLOS ONE

Dear Dr. Zhou,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Feb 02 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Melissa A Brotman, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Our internal editors have looked over your manuscript and determined that it is within the scope of our Reproducibility and Replicability in Neuroscience and Mental Health Research Call for Papers. The Collection will encompass a diverse and interdisciplinary set of protocols and research articles adhering to transparent and reproducible reporting practices in the areas of clinical psychology, psychiatry, mental health, and neuroscience. Additional information can be found on our announcement page: https://collections.plos.org/call-for-papers/reproducibility-and-replicability-in-neuroscience-and-mental-health-research/. If you would like your manuscript to be considered for this collection, please let us know in your cover letter and we will ensure that your paper is treated as if you were responding to this call. If you would prefer to remove your manuscript from collection consideration, please specify this in the cover letter.

3. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The present study sought to test reproducibility and replicability of findings regarding relations between anhedonia and resting state functional connectivity in 9 and 10 year olds. Leveraging data from two releases of the ABCD study, the authors replicate a limited subset of findings from previously published work. Reproducibility and replicability studies are necessary in the fields of psychology and neuroscience, yet they often go unpublished highlighting the merit of dissemination of these findings. The manuscript would be strengthened by further elaboration on the potential implications for assessment and treatment of anhedonia and depression which is missing from the discussion. Additional suggestions and questions are detailed:

Introduction

1. In the abstract, the phrase 'children reporting anhedonia' is used to describe the sample. Further reading of the manuscript clarifies that a binary variable was used to classify children as endorsing or not endorsing anhedonia. Additionally, the methods seem to imply that both parent and child report was used to define whether or not youth had anhedonia. This should be stated more clearly in the abstract, perhaps as 'measured associated with presence of anhedonia based on parent and child reports.'

2. In the introduction, can the authors please clarify whether anhedonia in children and adolescents is a significant predictor of greater depression severity, treatment resistant depression, and suicidal behaviors cross-sectionally, longitudinally, or both?

3. Functional connectivity may also reflect co-deactivation or deactivation/activation that occurs simultaneously in brain regions. Therefore, the section 'the coactivation of different brain regions, which measures' should be cut from lines 72-73 of the introduction.

4. The authors remark the importance of functional connectivity being able to be measured at rest in the introduction. Why is this important and in the context of the present study, what would be the benefit of looking at resting state functional connectivity as opposed to task based?

5. Per the definition of replicability in lines 92-94, I don't think this study would constitute as full/true reproducibility given that this is not really a different dataset--just different participants in the same dataset. This should be noted in the limitations.

6. Study aims are lacking the why--why do we need to understand brain dysfunction underlying anhedonia?

Methods

7. The authors used a recent version of R--is this the same version that was used in the original manuscript they are reproducing/replicating? Different versions of statistical softwares and even computer softwares have been shown to yield different results. The authors should note whether there were software differences, and perhaps consider re-running the analyses on the same version(s) to compare.

8. Were the individuals scanned by the Philips Medical Systems MRI machines in ABCD 1.0 release included in the original manuscript that is being replicated/reproduced? Please clarify, and please clarify if this resulted in a difference in sample sizes between the two papers.

9. How were the parent and child reports combined for use in analyses?

10. How were variables quantified? Were the items for depressed mood, irritability, and anhedonia yes/no response items, or was a threshold set to define presence of the symptom based on a continuous response?

11. How many participants with missing data were removed? What was the pattern of missing data? Were there any significant differences in study variables or demographic individuals in those with/without missing data?

12. What was the amount of outliers corrected?

13. How was normality examined and, if necessary, were any data transformations performed?

14. Please report on model assumptions for multiple linear regression and how any violations were handled.

15. How many families were in the study? ICC values for the nesting factor?

Results

16. Line 237--what findings?

17. Lines 247-249: only 4 connectivity measures survived correction for multiple comparisons. How does this map onto the findings of the original study after correcting for multiple comparisons?

18. Tables 2-4 are cut off. Do the tables include effect sizes and confidence intervals? If not, please include.

19. Given the number of comparisons made and the sample size, the risk of false positives is high, and only findings that survive multiple comparisons should be interpreted.

20. The authors make a number of comments about statistical power. Given the sample size, there is sufficient power to detect significant effects if they exist, and in fact the risk of false positives is increased in this larger sample. Rather, the more informative measure in such a large sample would be the magnitude of that effect. Effect sizes should be reported and interpreted for all findings, as well as confidence intervals.

21. In table 4, is 'Effect of Anhedonia' supposed to be the B value?

22. R2 values are quite small--effects are extremely small. Authors should note this as a limitation--effect does not seem to be meaningful.

23. What was the n for the multiple regression analyses? I don't think a sample of thousands can be considered 'relatively small' as stated in lines 378 and 447.

Discussion

24. The meaning of the networks identified are not really elaborated on in the discussion, nor are clinical implications at least speculated. I might recommend the authors putting the knowledge expanded on in this study into clinical context.

Minor:

- One citation in the introduction (line 68) is in a different format compared to all other citations

- 'prognostic predictor' in line 69 of the introduction is redundant

- In line 128, ROIs should be plural, not possessive (ROI's)

- Line 225, the two groups don't' appear to exhibit', they DO statistically exhibit differences.

Reviewer #2: The authors report on reproducibility and replicability of the Pornpattananangkul 2019 JAMA results on associations between alterations in rsfMRI connectivity measures and anhedonia in youth.

This is important work that I would like to see published, provided some significant revisions to the manuscript.

My main concern is that I didn’t feel like I got a good understanding what was and what was not reproduced/replicated. Part of the issue is that the results were worded much differently in the original paper, with a focus on directionality of differences. I would very much like to see a summary table that provides a summary of sets of findings directly compared. It’s an arduous process to go through and double check that indeed all differences are reproduced/replicated. I feel particularly strong about this point in that statistical thresholding is always to some extent arbitrary – seeing results with p values displayed in parallel may help illustrate what does and what does not replicate.

It was not clear to me that all analyses from the original rsfMRI paper were reproduced. What about the analyses showing specificity?

I find it curious that the paper seems to suggest that the analyses were run by a team of independent researchers when the first author of the initial paper is the second author of the current paper if I'm not mistaken. It’s not an issue per se, but I want to make sure that all coding for the reproducibility analyses was done from scratch, otherwise it may just carry forward errors.

May be worth presenting the correlations between covariates and anhedonia in the supplements. How were covariates decided on? Why was trauma or anxiety not included for example?

Partial regression coefficients of all significant predictors should be displayed, not just the rsFMRI measures.

The results from the new specificity analyses were not nearly discussed enough in the discussion section nor was the effect of controlling for additional covariates on the 1.0 sample.

The result section in the abstract should explicitly state that the larger full sample that replicated 6/11 associations included the data from the initial study and is therefore not an independent replication. In the same vein, the wording “replication of previous findings was limited” maybe overly optimistic given that in the independent sample only 1/11 was replicated, and, once controlled for covariates, a lot of the associations in the initial sample were no longer significant, too.

Generally, the writing was clear, and I appreciate the effort that goes into this kind of work – it really serves the field.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 May 4;18(5):e0277158. doi: 10.1371/journal.pone.0277158.r002

Author response to Decision Letter 0


7 Feb 2023

Reviewer #1

Introduction

1. In the abstract, the phrase 'children reporting anhedonia' is used to describe the sample. Further reading of the manuscript clarifies that a binary variable was used to classify children as endorsing or not endorsing anhedonia. Additionally, the methods seem to imply that both parent and child report was used to define whether or not youth had anhedonia. This should be stated more clearly in the abstract, perhaps as 'measured associated with presence of anhedonia based on parent and child reports.'

[Response] Participants with anhedonia were indeed classified based on the youth reports only, which is the same as the approach the previous authors took. Parent-reported measures were shown to cluster very distinctly from the youth-reported measures in our correlation matrix of youth and parent measures (Figure. 1), indicating a high level of discordance between youth and parent reported measures. We clarified in the methods how we used the youth and parent reported measures (see response to reviewer 1, comment 9).

2. In the introduction, can the authors please clarify whether anhedonia in children and adolescents is a significant predictor of greater depression severity, treatment resistant depression, and suicidal behaviors cross-sectionally, longitudinally, or both?

[Response] We have revised our introduction which now reads:

“In cross-sectional studies, anhedonia in children and adolescents has been shown to be associated with greater depression severity and suicidality (7,8). Furthermore, in a randomized clinical trial, anhedonia was found to be a significant predictor of a longer time to remission in adolescents with treatment resistant depression (9).” (lines 70-37)

3. Functional connectivity may also reflect co-deactivation or deactivation/activation that occurs simultaneously in brain regions. Therefore, the section 'the coactivation of different brain regions, which measures' should be cut from lines 72-73 of the introduction.

[Response] We have removed the specified lines from the introduction which now reads:

“Functional brain connectivity is a measure of the degree of synchrony between the blood oxygen level dependent (BOLD) signals across time between regions in the brain (Lv et al., 2018).” (lines 76-78)

4. The authors remark the importance of functional connectivity being able to be measured at rest in the introduction. Why is this important and in the context of the present study, what would be the benefit of looking at resting state functional connectivity as opposed to task based?

[Response] We have revised the introduction which now reads:

“Importantly, functional connectivity can be measured at rest which facilitates the ease by which data can be collected, as opposed to task-fMRI which typically involves the presence of a stimulus or task (11). While task-fMRI focuses on patterns of brain activation associated with a specific task, resting-state functional MRI (rsfMRI) connectivity focuses on the organization of brain networks that may specialize in specific functions. As such, both task-fMRI and rsfMRI represent important brain processes that may contribute to the development of mental disorders” (lines 80-86)

5. Per the definition of replicability in lines 92-94, I don't think this study would constitute as full/true reproducibility given that this is not really a different dataset--just different participants in the same dataset. This should be noted in the limitations.

[Response] We acknowledge this limitation and have included the following lines in the limitations section of the discussion:

“We acknowledge that while we referred to our analyses using the ABCD 4.0 (excluding 1.0) sample as analogous to replication in an independent sample, the participants do come from the same ABCD study and thus, our analyses do not conform to the strictest definition of a replication study. As such, shared aspects of data collection and processing, as well as other uncharacterized factors unique to the ABCD study may potentially impact our results. Future studies using a completely independent dataset will be required to assess the validity of our findings.” (lines 825-831)

6. Study aims are lacking the why--why do we need to understand brain dysfunction underlying anhedonia?

[Response] We have revised the introduction which now reads:

“Anhedonia is a transdiagnostic symptom impacting some of the most prevalent and debilitating mental disorders in both children and adults. By Identifying brain dysfunction underlying anhedonia, we may be able to more accurately characterize patient symptomatology, refine diagnostic categories, and potentially identify specific brain-based therapeutic targets. Furthermore, by characterizing brain dysfunction in children and adolescents, we may help elucidate important dysregulated developmental processes that may be targeted by preventative interventions.” (lines 116-122)

Methods

7. The authors used a recent version of R--is this the same version that was used in the original manuscript they are reproducing/replicating? Different versions of statistical softwares and even computer softwares have been shown to yield different results. The authors should note whether there were software differences, and perhaps consider re-running the analyses on the same version(s) to compare.

[Response] For our manuscript, we used R version 4.0.3 (2020-10-10) while the previous authors used R version 3.4.3 (November 2017). However, there were no differences between our results and the previous authors’. We previously demonstrated this by correlating the t-statistics (as well as lnBF statistics) from our reproduced associations between rsfMRI connectivity and anhedonia and those from the previous authors’ analyses and show a correlation r = 1 (previously Figure 1A and 1B), indicating the results were exactly the same. Of note, the previous authors’ also analyzed the association between rsfMRI connectivity and depressed mood, as well as with anxiety, to assess the specificity of their anhedonia results. Thus, we have now also reproduced those same associations and include the correlations between the t-statistics (and lnBF statistics) from our results and the previous authors’ to further demonstrate the equivalence of our results. The correlations were all r = 1, indicating the results were exactly the same. Plots of those correlations can now be found in Supplementary Figure 1. Furthermore, we have revised our manuscript to include the following lines:

“We note that although we used a more recent version of the R statistical software than the previous authors, the correlations between the statistics from our analyses and those from the previous authors’ were all equal to 1, indicating no differences in the results.” (lines 341-344)

8. Were the individuals scanned by the Philips Medical Systems MRI machines in ABCD 1.0 release included in the original manuscript that is being replicated/reproduced? Please clarify, and please clarify if this resulted in a difference in sample sizes between the two papers.

[Response] Individuals scanned by Philips Medical Systems MRI machines were also excluded from the previous authors’ manuscript. Thus, there were no differences in the sample sizes used in our analyses to reproduce the previous authors findings using data from the ABCD 1.0 data release. We have edited our manuscript which now reads:

“For analyses using only the ABCD 1.0 release sample, like the previous authors, we also removed individuals who were scanned by “Philips Medical Systems” MRI machines because of a post-processing issue in the ABCD 1.0 release, which was resolved in later releases.” (lines 160-163)

“Like the previous authors, we identified 215 individuals who endorsed past and/or present anhedonia and 2,222 controls who reported neither past nor present anhedonia at the baseline timepoint, indicating the samples were exactly the same.” (lines 306-308)

However, we also used ABCD 1.0 data (excluding Philips Medical Systems participants) in our first multiple linear regression analysis that controlled for demographic covariates. Due to listwise deletion of missing data that included these new covariates, 13 participants were removed from the control group due to missingness in these new covariates. As such, the sample size differed from our reproduction t-test analysis. These differences were originally noted in the table legends for tables comparing demographic variables. However, we have edited our manuscript that now reads:

“We note that participants with missing covariate data were excluded from these analyses. Thus, the sample sizes will differ slightly from those used in the previous t-tests. In the ABCD 1.0 release sample, there were 215 individuals who endorsed anhedonia and 2209 controls who did not.” (lines 535-539)

9. How were the parent and child reports combined for use in analyses?

[Response] Parent and child reported questionnaire items were combined separately. We have clarified this in the manuscript which now reads:

“Separately for youth and parent KSADS questionnaire items, we combined past and present items for the same symptom or diagnosis and consolidated some items into a single variable. For example, we consolidated 18 youth-reported past and present suicide related diagnosis items into one single youth-reported suicide thoughts and behavior variable, which was similarly done in another study (21). A separate parent-reported suicide thoughts and behaviors variable was constructed using parent-reported KDADS questionnaire items.” (lines 186-192)

10. How were variables quantified? Were the items for depressed mood, irritability, and anhedonia yes/no response items, or was a threshold set to define presence of the symptom based on a continuous response?

[Response] All the psychiatric variables from the KSADS youth and parent questionnaires were binary yes/no variables. We have clarified this in the manuscript which now reads:

“Psychiatric data were obtained from the youth (data structure: abcd_ksad501) and parent (data structure: abcd_ksad01) Kiddie Schedule for Affective Disorders and Schizophrenia (KSADS) data structures from the ABCD study which are composed of binary (yes/no) questionnaire items for various psychiatric diagnoses or symptoms.” (lines 182-186)

11. How many participants with missing data were removed? What was the pattern of missing data? Were there any significant differences in study variables or demographic individuals in those with/without missing data?

[Response] For t-test analyses, consistent with the previous authors, study participants with missing rsfMRI were removed prior to adjustments for site using the ComBat tool. Additionally, participants with missing data for anhedonia were also removed. For the t-test analyses in the ABCD 1.0 sample, 288 participants were removed and 2437 were retained. The only statistically significant difference was that the participants who were removed were on average 1 week younger than those who were retained (Supplementary Table. 10). Such a difference was deemed to be negligible.

For the t-test analyses in the ABCD 4.0 (excluding 1.0) sample, 126 participants were removed and 6454 participants were retained. We believe less participants were removed than in the ABCD 1.0 sample because the ABCD 4.0 sample was a later release with more complete rsfMRI data. However, the participants who were removed had a significantly higher proportion of African American individuals (27% vs 16%) and a higher proportion of individuals with depressed mood (13% vs 9%) (Supplementary Table. 10). While significant patterns of missingness suggest Missingness At Random (MAR), the proportion of missing participants was ~2% and would not benefit from multiple imputation (missingness >5% would warrant multiple imputation) and are unlikely to lead to significant bias in results (1). Similarly, for the t-test analyses in the full ABCD 4.0 sample, 139 participants were removed and 8866 were retained (Supplementary Table. 10). Again, there were higher proportions of African American individuals and those with depressed mood in the participants who were removed. However, the proportion of participants removed was ~ 1.5% of the total sample and thus unlikely to contribute to significant bias to the analyses or receive benefit from multiple imputation.

For the multiple linear regression analyses, participants with missing demographic covariate data were also removed. However, this only led to a few more participants being excluded for each analysis (Supplementary Table. 16). Patterns of missingness were also compared and closely resembled those identified above.

To reflect these important considerations, we have added the following additional section to the methods:

“Assessing Patterns of Missingness

For t-test analyses, consistent with the previous authors, study participants with missing rsfMRI measures were removed prior to adjustments for site using the ComBat tool. Additionally, participants with missing data for youth-reported anhedonia were also excluded. To assess if there were any patterns of missingness, we compared participants who were removed with participants who were retained. We assessed whether there were differences in proportions for sex (assigned at birth), race/ethnicity, youth-reported anhedonia, depressed mood, irritability, and bipolar II disorder symptoms between the two groups using Chi-Square tests of independence. We compared differences in age (in weeks) using t-tests.

For the multiple linear regression analyses, in addition to participants with missing rsfMRI and anhedonia responses, those with missing demographic covariate data were also excluded. Similar comparisons were made between participants who were removed and those who were retained as those reported above.” (lines 276-285)

Additionally we have added the following lines to the results section of the manuscript:

“For these t-tests using the ABCD 1.0 sample, 288 participants with either missing rsfMRI data or youth-reported anhedonia responses were removed and 2437 were retained. Participants who were removed were on average 1 week younger than those who were retained (Supplementary Table. 10). Such a difference was deemed to be negligible.” (lines 366-370)

“For these t-tests using the ABCD 4.0 (excluding ABCD 1.0) sample, 124 participants with either missing rsfMRI or youth-reported anhedonia responses were excluded and 6456 participants were retained. Notably, those that were removed exhibited significantly higher proportions of individuals identifying as African Americans (27.4% vs 15.7%) and individuals endorsing depressed mood (12.9% vs. 8.7%) (Supplementary Table. 10). While significant patterns of missingness suggest Missingness At Random (MAR), the proportion of missing participants was ~2% and thus would not benefit from multiple imputation (typically requiring missingness >5%) and are unlikely to lead to significant bias in the results (22).” (lines 400-408)

“For these t-tests using the full ABCD 4.0 sample, 139 participants with either missing rsfMRI or youth-reported anhedonia responses were removed and 8866 participants were retained. Similarly, there were higher proportions of individuals identifying as African American and those endorsing depressed mood in the participants who were removed. However, the proportion of participants removed was ~ 1.5% of the total sample and thus unlikely to contribute to significant bias to the analyses or receive benefit from multiple imputation.” (lines 438-444).

“For multiple linear regression analyses, patterns of missingness closely resembled those reported for the samples used in the t-tests. Notably, individuals removed due to missingness exhibited higher proportions of those identifying as African American and those endorsing depressed mood (Supplementary Table. 16). However, the proportion of participants removed was less than 5% of the total sample for each set of analyses and thus, were unlikely to bias the results.” (lines 643-648)

12. What was the amount of outliers corrected?

[Response] We have now included the number of outliers removed for each of the analyses in the corresponding supplementary tables (ex. Supplementary Table 1-9). On average, the proportion of the total sample removed as outliers was around 5% in the ABCD 1.0 sample, around 1.8% in the ABCD 4.0 (excluding 1.0) sample, and 1.6% in the full ABCD 4.0 sample. We have no included the following lines in the methods of our manuscript:

“The number and the percentage of the total sample removed as outliers for each t-test were reported in Supplementary Tables. 1-3)” (lines 208-209)

“Similar to the t-tests, prior to statistical analyses, participants with missing data for psychiatric symptoms/diagnoses, as well as demographic covariates, were removed. We then proceeded to identify and remove outliers for each rsfMRI connectivity measure as values 1.5 times greater than the interquartile range (IQR) of values. The number and the percentage of the total sample removed as outliers for each multiple linear regression were reported in Supplementary Tables. 4-9.” (lines 238-243)

13. How was normality examined and, if necessary, were any data transformations performed?

[Response] For large samples, such as in the ABCD study, statistical tests for normality (such as the Shapiro-Wilk test) are very sensitive to small deviations from normality which do not end up affecting the results of parametric tests. Furthermore, the central limit theorem states that for samples with n > 40, the means of random samples from any distribution tends to be normal, regardless of the distribution of the underlying data (2). As such, visual inspection of the distribution of variables is sufficient to detect any major deviations from normality. Nevertheless, we have now included normality tests for rsfMRI measures from the ABCD samples using the Shapiro-Wilk test and have included their results in corresponding supplementary tables for the t-test results (Supplementary Table 1-3). We have added the following lines to the manuscript:

“To check the assumptions for independent measures t-tests, we performed Shapiro-Wilk normality tests for rsfMRI measures from the ABCD 1.0 sample and found that all of the tests were significant, indicating non-normality (Supplementary Table. 1). However, for large samples, such as in the ABCD study, statistical tests for normality are very sensitive to small deviations from normality which do not end up affecting the results of parametric tests. Furthermore, the central limit theorem states that for samples with n > 40, the means of random samples from any distribution tends to be normal, regardless of the distribution of the underlying data (25). A visual inspection of the distributions, as well as the quantile-quantile (QQ) plots, for a representative sample of 3 of the rsfMRI measures significantly associated with anhedonia revealed no significant deviations from normality (Supplementary Figure 2).” (lines 345-355)

Shapiro-Wilk normality tests for rsfMRI measures from the ABCD 4.0 (excluding 1.0) sample and the full ABCD 4.0 sample could not be performed as the shapiro.test() function in R cannot be applied to samples > 5000, which are large enough such that the assumption of normality is not required due to the central limit theorem. Nevertheless, we visually inspected a representative sample of 3 rsfMRI measures significantly associated with anhedonia which revealed no significant deviations from normality (Supplementary Figures 4-5). We have included the following lines in the manuscript:

“To check the assumptions for independent samples t-tests performed using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, we visually inspected the distributions of a representative sample of 3 rsfMRI measures significantly associated with anhedonia in each ABCD sample, which revealed no significant deviations from normality (Supplementary Figures 4 and 5).” (lines 445-449)

Another assumption of independent samples t-tests is that of homogeneity of variance. Thus, we have performed F-tests to compare variances across the anhedonia and control groups for our t-tests in order to assess the assumptions of homoscedasticity. We note that there were 11 rsfMRI measures that exhibited significant F-tests in the ABCD 1.0 sample, indicating we cannot assume equal variances across groups for those measures (Supplementary Table 1.). For these measures, non-parametric tests that do not assume homoscedasticity, such as Welch’s t-test, could be used to obtain more reliable results. Similarly, there were 17 rsfMRI measures in the ABCD 4.0 (excluding ABCD 1.0) sample, and 21 rsfMRI measures in the full ABCD 4.0 sample that also exhibited significant F-tests. To assess the potential bias introduced by unequal variances, we performed Welch’s t-tests for those rsfMRI measures with significant F-tests and then correlated the Welch’s t-statistics with Student’s t-statistics. We then correlated the p-values from the two tests as well. We found significantly high correlations (r >= 0.99) for all the correlations, indicating minimal differences between the two types of tests and thus minimal impact of unequal variances on the results (Supplementary Figure. 3). We have added the following lines to the manuscript:

“We also performed F-tests to compare variances across the anhedonia and control groups for our t-tests in order to assess the assumptions of homoscedasticity. We note that there were 11 rsfMRI measures that exhibited significant F-tests in the ABCD 1.0 sample (Supplementary Table. 1.). To assess the potential bias introduced by unequal variances, we performed Welch’s t-tests for those rsfMRI measures with significant F-tests and then correlated the Welch’s t-statistics with Student’s t-statistics. We then correlated the p-values from the two tests as well. We found significantly high correlations (r >= 0.99) for t-statistics and p-values, indicating minimal differences between the two types of tests and thus minimal impact of unequal variances on the results (Supplementary Figure. 3A).” (lines 356-365)

Finally, we have made the following revisions to the methods which now reads:

“Assumptions of normality were assessed with the Shapiro-Wilk test and with the visual inspection of the distributions of a representative sample of rsfMRI variables. Assumptions of equal variances across groups were assessed with the F-test. To assess the potential bias introduced by unequal variances, we performed Welch’s t-tests for those rsfMRI measures with significant F-tests and then correlated the Welch’s t-statistics with Student’s t-statistics. We then correlated the p-values from the two tests as well.” (lines 210-216)

14. Please report on model assumptions for multiple linear regression and how any violations were handled.

[Response] There are several model assumptions for multiple linear regression which we tested: no multicollinearity between predictor variables, no autocorrelation between the residuals of the data, homoscedasticity of the residuals, and the normality of the residuals.

The following lines were added to the methods section of our manuscript:

“Several assumptions for multiple linear regression were assessed. Multicollinearity was assessed with the variance inflation factor (VIF) using the vif() function in R from the car package. Auto-correlation of the model residuals was assessed with the Durbin-Watson test using the durbinWatsonTest() function in R from the car package. Homoskedasticity of model residuals were assessed using the Breusch-Pagan (BP) test (using the ols_test_breusch_pagan() function in R from the olsrr package) and also visually inspected by plotting model residuals against marginal model fitted-values. For regressions with significant BP tests, we also performed weighted-least-squares (WLS) regression, which is able to account for differences in variance in the residuals, and then correlated the t-statistics from the WLS and the original ordinary-least squares (OLS) regressions to assess the impact of potential heteroscedasticity on the results. Finally, we performed a visual inspection of density plots of the residuals from regressions for 3 representative rsfMRI measures for each set of linear regression analyses, and their Quantile-Quantile (QQ) plots to detect any patterns of non-normality.” (lines 261-275)

Additionally, we have now included these lines in the results section of our manuscript:

“Several assumptions for multiple linear regression were assessed across all the analyses. Multicollinearity between predictors was assessed using the variance inflation factor (VIF) where GVIF values greater than 5 indicate significant multicollinearity between predictors in a multiple linear regression model. For the regressions performed across the ABCD 1.0, ABCD 4.0 (excluding 1.0), and full ABCD 4.0 samples, we obtained GVIF values for predictors in each regression and then found their average values across all regressions (Supplementary Table. F and G). No regressions exhibited significant multicollinearity between predictors. We performed Durbin-Watson tests to detect auto-correlation between the residuals from each of the regressions and found all test statistics were between 1.5 - 2.5, and thus within the acceptable range for auto-correlations (Supplementary Tables. 4-9).

We performed the Breusch-Pagan (BP) test to the assumption of homoscedasticity for the model residuals from all the regressions (Supplementary Tables. 4-9). For the regressions using the ABCD 1.0 sample, one rsfMRI measure associated with anhedonia exhibited a significant BP test. For the regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, 4 rsfMRI measures associated with anhedonia exhibited significant BP tests, each. For the rsfMRI measures with significant BP tests, we plotted their model residuals against marginal model fitted values and did not detect any significant patterns of heteroskedasticity, visually (Supplementary Figures. 6-11 (left)). To be sure, we performed weighted-least-squares (WLS) regressions, which is able to account for differences in variance in the residuals, for these rsfMIR measures, and then correlated the t-statistics from the WLS and the original ordinary-least squares (OLS) regressions. The correlations were all equal to 1, indicating little effect of potential unequal variances on the results (Supplementary Figures. 6-11 (right)).

Finally, we performed a visual inspection of density plots of the residuals from regressions for 3 representative rsfMRI measures significantly associated with anhedonia and their qq-plots for each set of regressions across the ABCD samples. All appeared normally distributed (Supplementary Figures 12-17).” (lines 649-677)

15. How many families were in the study? ICC values for the nesting factor?

[Response] For the ABCD 1.0 sample, there were 2163 families. For the ABCD 4.0 (excluding ABCD 1.0) sample, there were 5754 families. For the full ABCD 4.0 sample, there were 7688 families. We have now included the ICC values for each of the mixed model regressions we performed in the corresponding supplementary tables (Supplementary Tables. 4-9 ). We have included the following lines in our manuscript:

“We note that there were 2163 families in the ABCD 1.0 sample, 5754 families in the ABCD 4.0 (excluding 1.0) sample, and 7688 families in the ABCD 4.0 sample. The average Intra-Class-Correlation (ICC) across the regressions using the ABCD 1.0 sample was 0.09 (sd = 0.07) indicating that the random effects of family structure accounted for about 9% of the variability in rsfMRI connectivity measures (Supplementary Tables. 4 and 5). However, the standard deviation was fairly large, indicating significant variability across regressions. Similarly, for regressions using the ABCD 4.0 (excluding 1.0) sample and the full ABCD 4.0 sample, the average ICC across regressions was 0.10 (SD = 0.05) and ICC was 0.11 (SD = 0.05), respectively (Supplementary Tables. 6-9).” (lines 633-642)

Results

16. Line 237--what findings?

[Response] We agree the sentence was not clear and have edited the manuscript which now reads:

“In line with the previous authors’ findings, we reproduced significant differences in 11 rsfMRI connectivity measures between those with and without anhedonia, indicated by the lnBF(10) statistic, though the effect sizes were small (Table. 2, left)(13).” (lines 309-311)

17. Lines 247-249: only 4 connectivity measures survived correction for multiple comparisons. How does this map onto the findings of the original study after correcting for multiple comparisons?

[Response] For our t-tests, we provided fairly conservative Benjamini-Hochberg (BH) adjusted p-values as we corrected for 306 comparisons (since there were 306 rsfMRI measures in total). The previous authors reported similar adjusted p-values as well as the log(Bayes Factor) (lnBF) statistic, which is a less conservative approach to assessing statistical significance. As such, although only 4 connectivity measures appeared to survive the more conservative BH adjusted p-value threshold, all 11 measures exhibited lnBF values > 1.1, which was interpreted as indicating significant evidence for the alternative hypothesis of there being significant mean differences between the anhedonia and control groups. We have clarified this in the results section of the manuscript which now reads:

“In addition to the lnBF statistic, we provide a more conservative adjustment for multiple comparisons using the Benjamini-Hochberg correction for 306 comparisons. Alternatively, since we were predominantly interested in reproducing the 11 rsfMRI associations reported by the previous authors, we could have adjusted for only 11 comparisons and arrived at a more liberal adjusted p-value for each comparison. However, we decided to report the former since we did indeed perform 306 t-tests in our analyses. This reflects the somewhat arbitrary nature of statistical thresholding as the number of outcome measures considered in family-wise hypotheses can be difficult to clearly define (22).” (lines 324-332)

18. Tables 2-4 are cut off. Do the tables include effect sizes and confidence intervals? If not, please include.

[Response] We have made significant revisions to our tables and now include effect sizes and their confidence intervals. The effect sizes we now report are Cohen’s d for t-tests (Table. 2) and the proportion (%) of the total variance in each rsfMRI measure accounted for by each independent variable (ex. anhedonia) in the multiple linear regressions (Tables. 5 and 6).

19. Given the number of comparisons made and the sample size, the risk of false positives is high, and only findings that survive multiple comparisons should be interpreted.

[Response] We agree with the reviewers that the risk of false positives is high due to the large number of comparisons made. However, we have shown that the most statistically significant findings, such as those that survive multiple comparisons corrections, may paradoxically lead to focusing on the most inflated and thus least replicable findings if a sample is not well-powered enough. This is a major barrier in replication studies and we have included the following lines in the discussion to elaborate on this issue.

“Using t-tests, only the Within-Cingulo-Opercular rsfMRI measure was consistently associated with anhedonia across the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples. However, when we controlled for demographic covariates (sex, age, and race/ethnicity) using a linear regression approach, the association was no longer replicable in the ABCD 4.0 (excluding 1.0) sample. Like the other associations identified by the previous authors, we observed a significant decrease in effect size in the replication analysis after controlling for these additional covariates suggesting the presence of significant confounding effects that were not accounted for with t-tests. Furthermore, large decreases in effect size in replication analyses have been reported to occur more frequently when the initial discovery sample is small such that the most inflated and statistically significant findings are the most likely to be identified and reported (26). Unfortunately, these inflated findings are the least replicable as regression towards the mean leads to reductions in both effect size and significance in subsequent replications. Of note, Marek et al., 2022 found that controlling for sociodemographic covariates generally reduced effect sizes, and thus may help reduce effect size inflation.” (lines 682-697)

We found that when we included rsfMRI measures associated with anhedonia at the nominal p-value level (but not at the adjusted p-value level) in our multiple linear regressions in the ABCD 1.0 sample, we were able to identify two new rsfMRI measures associated with anhedonia which, although exhibiting smaller effect sizes, were replicable in the ABCD 4.0 (excluding 1.0) sample. We have included the following lines in the discussion regarding this point:

“Notably, these 2 rsfMRI measures exhibited smaller, and less statistically significant, effect sizes that remained relatively consistent across the regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples. Thus, these findings suggest that replicability may be improved if less emphasis was placed on associations with the most statistical significance but rather on identifying those with the most stable effects across analyses, even if they are less statistically significant.” (lines 702-708)

20. The authors make a number of comments about statistical power. Given the sample size, there is sufficient power to detect significant effects if they exist, and in fact the risk of false positives is increased in this larger sample. Rather, the more informative measure in such a large sample would be the magnitude of that effect. Effect sizes should be reported and interpreted for all findings, as well as confidence intervals.

[Response] We agree with the reviewer and have now included effect sizes and confidence intervals for all our analyses (see response to reviewer 1 comment 18).

21. In table 4, is 'Effect of Anhedonia' supposed to be the B value?

[Response] Yes, in our original table, the “effect of anhedonia” is the partial regression coefficient (beta value). We have edited our tables significantly and now all our regression results are presented in Tables. 5 and 6. We have included the following lines in the table legends to clarify the values that are presented:

“Effect size represents the percentage of the total variance (proportion of variance * 100%) in a rsfMRI connectivity measure accounted for by anhedonia. The partial regression coefficient (Estimate), standard error (Std.Err), nominal p-value (p), and conservative Benjamini-Hochberg adjusted p-value (p.adj) for anhedonia are also shown for each rsfMRI regression model. Bolded results were significant at the adjusted p-value level (p.adj < 0.05).” (lines 549-552)

22. R2 values are quite small--effects are extremely small. Authors should note this as a limitation--effect does not seem to be meaningful.

[Response] We agree with the reviewer’s comments and have added the following lines to the results section of our manuscript:

“We note that the effect sizes were extremely small, with anhedonia accounting for less than 1% of the total variance in each rsfMRI measure.”

We also added the following lines to the discussion:

“Although we found 2 rsfMRI measures with replicable associations, the actual effect sizes were extremely small, with anhedonia accounting for about 0.2% of the total variance for each rsfMRI measure. By themselves, these findings are unlikely to be clinically meaningfull. However, combining the small effects of many brain-based measures together may produce signals with significant clinical utility in applications such as in diagnostic prediction or the monitoring of disease progression (27,28). An analogous approach has been taken in genetic research whereby many genetic variants, which individually exhibit miniscule amounts of association, can be combined to produce genetic risk scores (29) that altogether contribute meaningfully to the prediction of the course of complex neuropsychiatric disorders (30).” (lines 717-726)

23. What was the n for the multiple regression analyses? I don't think a sample of thousands can be considered 'relatively small' as stated in lines 378 and 447.

[Response] For regressions using the ABCD 1.0 sample, the total n was 2424 with 215 individuals with anhedonia and 2209 controls. For regressions in the ABCD 4.0 (excluding 1.0) sample, the total n was 6454 with 591 individuals with anhedonia and 5863 controls. For regressions in the full ABCD 4.0 sample, the total n was 8864 with 800 individuals with anhedonia and 8864 controls. The n for the multiple regression analyses were reported in Tables. 1, 3 and 4. They have now also been included in Tables. 5 and 6.

We have removed lines 378 and 447 from the manuscript. We agree with the reviewers that generally speaking, the ABCD study sample size is quite large. However, we have shown that the effect sizes for anhedonia are much smaller than expected and that the sample size from the ABCD 1.0 release may not have been large enough to detect associations that were significant and replicable with larger samples, especially with the inclusion of additional covariates in the regression models. We have included the following lines to the results section to elaborate on this point:

“We note that the Auditory vs. Right Putamen and Retrosplenial-Temporal vs. Right-Thalamus-Proper measures were not found to be associated with anhedonia in the ABCD 1.0 sample (Table. 6, left) at the adjusted or nominal p-value levels (although there was a trend). However, we see that the effect sizes and partial regression coefficients were similar to those estimated in the corresponding regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, albeit with wider confidence intervals and larger standard errors. These patterns suggest that the ABCD 1.0 sample size was not well-powered enough, after including the additional psychiatric comorbidity measures, to detect these associations.” (lines 612-620)

Discussion

24. The meaning of the networks identified are not really elaborated on in the discussion, nor are clinical implications at least speculated. I might recommend the authors putting the knowledge expanded on in this study into clinical context.

[Response] We have now included the following lines in the discussion to elaborate on the meaning of the networks identified and clinical implications:

“The presence of anhedonia was associated with a decrease in the Auditory vs. Right-Putamen connectivity measure. Previous functional neuroimaging studies have found that functional activation between regions of the auditory cortex and putamen occurs during speech learning (39). Specifically, higher coactivation was associated with incorrect categorization of auditory stimuli. The authors proposed that the putamen may act to “tune” activity in the auditory cortices to help facilitate learning how to correctly categorize tones that lead to positive feedback. In the context of anhedonia, reduced connectivity between auditory and the putamen may reflect a more general impairment in reward based learning (40). For example, individuals with high levels of anhedonia have been shown to exhibit diminished ability to learn to modify their behavior during certain tasks in order to obtain larger rewards (41). Decreased connectivity between the striatal reward regions, such as the putamen, and cortical networks may disrupt the processes that drive behavioral and motivational adaptations that, in part, characterize anhedonia. , allowing us to disentangle rsfMRI connectivity measures associated with more than one condition based on t-test results.

Anhedonia was also associated with decreases in the Retrosplenial-Temporal vs. Right-Thalamus-Proper connectivity measure. Few studies have reported on this connectivity measure in the context of anhedonia. The retrosplenial cortex has been associated with many cognitive processes, notably with impaired memory (42). Interestingly, one study showed that individuals with social anhedonia exhibited increased functional connectivity between the retrosplenial cortex and several other brain regions, which were also correlated with lower anticipated pleasure in social situations that may point to the role of the retrosplenial cortex in future-oriented thinking (43). As the thalamus has important functions in emotion and arousal (44), we speculate that a disrupted connectivity between retrosplenial networks and the thalamus may be associated with impaired future-oriented thinking about emotionally rewarding things or situations that may underlie the decreased motivational aspects of anhedonia. Interestingly, a recent study found significant anatomical connectivity between the restrosplenial cortex and fronto-striatal reward regions, suggesting a more direct involvement of the retrosplenial cortex in reward and decision making processes (45).

Altogether, our findings suggest that disrupted brain connectivity associated with anhedonia may underlie impairments in learning, emotional, and motivational processes. If brain dysfunction is a causal factor in the development of these dysregulated processes, then these brain processes may become significant targets of preventative measures and therapeutic treatments, including pharmacological or psychotherapeutic interventions. ” (lines 770-804)

Minor:

- One citation in the introduction (line 68) is in a different format compared to all other citations

[Response] The citation has been edited to match the format of the other citations.

- 'prognostic predictor' in line 69 of the introduction is redundant

[Response] The word “prognostic” has been removed.

- In line 128, ROIs should be plural, not possessive (ROI's)

[Response] “ROI’s” has been changed to “ROIs”.

- Line 225, the two groups don't' appear to exhibit', they DO statistically exhibit differences.

[Response] The manuscript has been edited and now reads:

“Note that although the two groups exhibit differences in a few of these characteristics, they were not controlled for statistically when we performed our t-tests.” (lines 294-296)

Reviewer #2

1. My main concern is that I didn’t feel like I got a good understanding of what was and what was not reproduced/replicated. Part of the issue is that the results were worded much differently in the original paper, with a focus on directionality of differences. I would very much like to see a summary table that provides a summary of sets of findings directly compared. It’s an arduous process to go through and double check that indeed all differences are reproduced/replicated. I feel particularly strong about this point in that statistical thresholding is always to some extent arbitrary – seeing results with p values displayed in parallel may help illustrate what does and what does not replicate.

[Response] We have now created a summary table (Table. 2) comparing the t-test results from across the reproduction/replication sets of analyses for easier interpretation. We also acknowledge the arbitrariness of statistical thresholding and discuss the 3 types (p-value, p.adjusted, and lnBF values) of statistical thresholding values reported. We have added the following lines to the manuscript to elaborate on this point:

“In addition to the lnBF statistic, we also provide a more conservative adjustment for multiple comparisons using the Benjamini-Hochberg correction for 306 comparisons. However, since we were predominantly interested in reproducing the 11 rsfMRI associations reported by the previous authors, we could have alternatively adjusted for only 11 comparisons and arrived at a more liberal adjusted p-value for each comparison. However, we decided to report the former since we did indeed perform 306 t-tests in our analyses. This reflects the somewhat arbitrary nature of statistical thresholding as the number of outcome measures considered in family-wise hypotheses is not always easily defined (22).” (lines 324-332)

Similarly, we have created summary tables comparing our results from multiple linear regressions across the ABCD samples (Tables. 5 and 6) in order to more easily interpret which rsfMRI measures were replicated. Importantly, we have included effect sizes for all our analyses to provide a clearer picture of the meaning of the results.

2. It was not clear to me that all analyses from the original rsfMRI paper were reproduced. What about the analyses showing specificity?

[Response] The previous authors performed separate t-tests for youth-reported depressed mood and anxiety, and parent-reported ADHD (in the child) to assess the specificity of their findings. The exact reason for choosing these 3 psychiatric conditions was not clear. Nevertheless, we were able to reproduce the t-test results for anxiety and depressed mood symptoms (Supplementary Figure. 1)(See response to reviewer 1, comment #7 for more details). As of the ABCD 4.0 data release, the ABCD consortia released a notice stating diagnostic criteria for ADHD, among other disorders, required revision and that the corrected diagnostic data would not be available at this time. As such, we did not reproduce the previous authors’ findings for ADHD.

The previous authors then performed follow-up t-tests directly comparing participants with anhedonia with those with depressed mood, anxiety, and ADHD separately to further investigate specificity. For the follow-up comparisons, participants reporting between comorbidity between anhedonia and one of the other psychiatric conditions were excluded from their analyses. After careful consideration, altogether, we do not believe this approach is appropriate for several reasons:

1. Excluding participants with anhedonia and a co-morbid condition(s) would greatly reduce the sample size for these comparisons, further reducing the statistical power necessary to detect what we now know are very small effects. Thus, findings are more likely to be null or significantly inflated. In fact, the majority of the previous authors’ follow-up tests were null findings, suggesting a general lack of specificity or lack of power.

2. Many of the results from these follow-up t-tests are difficult to interpret in the context of the results of the more general t-tests. For example, the previous authors found that the CinguloParietalRightPallidum measure was significantly associated with anhedonia but not depressed mood from the general t-tests comparing anhedonia to controls, and depressed-mood to controls, suggesting specificity for anhedonia. However, their direct comparisons between those with anhedonia and those with depressed-mood showed no significant differences, suggesting lack of specificity, contradictory to the previous results. Again, lack of statistical power due to reduced sample sizes could have contributed to these null findings.

3. Separate t-tests for anhedonia and other psychiatric conditions cannot tell us about the independent contributions these conditions have on the rsfMRI measures of interest. For example, the previous authors found the WithinRetrosplenialTemporal measure to be independently associated with anhedonia and depressed mood, suggesting lack of specificity. When they compared those with anhedonia to those with depressed-mood directly, they also found no difference further suggesting lack of specificity. However, we have no information on to what extent anhedonia or depressed mood independently contribute to the rsfMRI measure.

For our specificity analyses, we decided to focus on 3 psychiatric conditions found to be significantly correlated with anhedonia, which were symptoms of depressed mood and irritability, and bipolar II disorder (Figure. 1). Like the previous authors, we performed separate t-tests for each of the co-morbid conditions and then assessed whether the rsfMRI measures associated with anhedonia were also associated with the other conditions. We did not perform follow-up t-test analyses directly comparing those with anhedonia to those with the other psychiatric conditions for the reasons mentioned above. Specificity was further explored with our multiple linear regression analyses. We highlight the following lines added to the results section of our manuscript:

“In line with the previous authors’ approach, in order to assess the specificity of the associations found for anhedonia, we next performed t-tests to compare rsfMRI connectivity measures separately between those with and without symptoms of depressed mood, irritability, and bipolar II disorder using the full ABCD 4.0 sample. The presence of a psychiatric condition was the reference group.

We found that 2 rsfMRI measures significantly associated with anhedonia using the full ABCD 4.0 sample were also significantly associated with depressed mood. These were the Default vs. Dorsal-Attention (Cohen’s d = -0.118, 95%CI [-0.191, -0.045], lnBF = 1.807) and Within-Cingulo-Opercular (Cohen’s d = 0.117, 95%CI [0.043, 0.19], lnBF = 1.646) connectivity networks (Supplementary Table. 13). Similarly, 2 rsfMRI measures associated with anhedonia were also significantly associated with irritability. These were the Salience vs. Left-Ventraldc (Cohen’ d = -0.139, 95%CI [-0.224, -0.054], lnBF = 2.075) and Default vs. Dorsal-Attention (Cohen’s d = -0.138, 95% CI [-0.223, -0.053], lnBF = 2.004) connectivity measures (Supplementary Table. 13). None of the rsfMRI measures associated with anhedonia were also associated with bipolar II.” (lines 479-494)

3. I find it curious that the paper seems to suggest that the analyses were run by a team of independent researchers when the first author of the initial paper is the second author of the current paper if I'm not mistaken. It’s not an issue per se, but I want to make sure that all coding for the reproducibility analyses was done from scratch, otherwise it may just carry forward errors.

[Response] The middle author of this manuscript (Narun Pat) is indeed the first author of the initial paper whose results we are trying to replicate in this manuscript. At the start of this project, the primary author of this paper (Yi Zhou) was not able to exactly reproduce the results from the previous paper. Upon reaching out to Narun, he provided the R code used for the original paper (which was not publicly available) and it was discovered that participants with missing responses for anhedonia were removed prior to the identification and exclusion of outliers for rsfMRI connectivity measures (outliers defined as data points exceeding 1.5 times the IQR). This small arbitrary discrepancy in the order of data processing steps prevented the exact reproduction of the previous results. Since Narun had been kind enough to share his code, as well as aid in the review of the manuscript before its submission, we invited him to be a co-author.

We acknowledge that while we used his code to guide our reproduction and replication analyses, the code for this current manuscript was otherwise written from scratch. Furthermore, we were critical of many of the analytical decisions made in the original paper (ex. not controlling for covariates, not including covariates during corrections for batch effects, and problematic specificity analyses, etc) and subsequently applied alternative ones in our second set of analyses utilizing a multiple linear regression approach. Currently, it is common practice for analysis code to be made publicly available alongside a published paper in order to increase the transparency of analytical decision making that ultimately contributes to greater reproducibility/replicability efforts.

4. May be worth presenting the correlations between covariates and anhedonia in the supplements. How were covariates decided on? Why was trauma or anxiety not included for example?

[Response] Previously, we had included the correlation matrix between youth-reported anhedonia and 33 other psychiatric symptoms and diagnoses as a supplementary figure. We have now moved that figure into the main manuscript as Figure. 1. We identified depressed-mood, irritability, and bipolar disorder as significantly comorbid psychiatric measures considered in subsequent analyses because they were significantly correlated with anhedonia and exhibited correlation coefficient values greater than 0.5. While anxiety also appeared somewhat correlated with anhedonia, we limited our selection to those exceeding correlations of 0.5 as including too many covariates in our multiple linear regressions would significantly reduce our statistical power. We have revised the results section of our manuscript to clarify this point:

“We took a step-wise approach and first only included the socio-demographic covariates (sex, age, race/ethnicity) in our regression models along with youth-reported anhedonia. Then, we added the comorbid psychiatric conditions (depressed mood, irritability, and bipolar II) to the models in order to evaluate their impact on the regression estimates and the replicability of any significant associations with anhedonia. We limited the inclusion of comorbid psychiatric conditions to these three measures in order to preserve the statistical power of our regression analyses and to account for comorbidities that are more likely to exhibit potential confounding effects based on their relatively higher correlations with anhedonia (Supplementary Table. 11).” (lines 522-530)

We also acknowledge the potential impact of environmental factors, such as trauma, on the associations between anhedonia and rsfMRI measures. These important considerations are unfortunately out of the scope of this manuscript. However, we have included the following lines in the limitations section of the discussion to address this point:

“For example, several recent studies have found that racial discrimination is associated with lower total brain volume (35) and alterations in prefrontal white matter tracts in adults (36,37). While out of the scope of this study, it will be critical to investigate how social determinants of health and other environmental factors, such as trauma (4,38), contribute to differences in health and brain-based outcomes between different racial and ethnic groups during child and adolescent development.” (lines 752-758)

5. Partial regression coefficients of all significant predictors should be displayed, not just the rsFMRI measures.

[Response] We have included the full multiple linear regression results across the different ABCD samples in our supplementary tables which includes the partial regression coefficients for all predictors and their effect sizes (the %variance in the rsfMRI measure accounted for by each predictor) (Supplementary Tables. 4-9). Unfortunately, including all the significant predictors on one table would be difficult and also likely to limit interpretability of the findings. As such, we focused on the partial regression coefficients for anhedonia in our main results (Tables. 5 and 6).

However, for the 2 rsfMRI measures with replicable effects and significant associations with anhedonia, we include a variable importance figure to visually compare the relative effect sizes of all the other predictors in the regression models (Figure. 2). The following lines were added to the discussion to elaborate on these findings:

“By including the other predictors, the multiple linear regression models accounted for about 4.5% of the total variance in the Auditory vs. Right Putamen rsfMRI measure and about 3% of the total variance for the Retrosplenial-Temporal vs. Right-Thalmaus-Proper rsfMRI measure (Figure. 2). For both regression models, the race/ethnicity predictor accounted for the vast majority of the explained variance. Upon inspection of the partial regression coefficients for each model, Black, Hispanic, and Other race/ethnicity exhibited the largest and most significant partial regression coefficients for both rsfMRI measures (Supplementary table. 9).” (lines 727-734)

6. The results from the new specificity analyses were not nearly discussed enough in the discussion section nor was the effect of controlling for additional covariates on the 1.0 sample.

[Response] We have made significant revisions to our previous specificity analyses. For the T-tests, we focused on the 11 rsfMRI measures previously found to be associated with anhedonia. Notably, 6 of the 11 rsfMRI measures were still associated with anhedonia in the full ABCD 4.0 sample. We performed separate sets of t-tests to compare rsfMRI connectivity measures separately between those with and without symptoms of depressed mood, irritability, and bipolar II disorder using the full ABCD 4.0 sample. We compared and identified which of the 11 rsfMRI measures were also associated with these 3 comorbid psychiatric conditions. For the t-test results, the following lines are now included in the results section:

“We found that 2 rsfMRI measures significantly associated with anhedonia using the full ABCD 4.0 sample were also significantly associated with depressed mood. These were the Default vs. Dorsal-Attention (Cohen’s d = -0.118, 95%CI [-0.191, -0.045], lnBF = 1.807) and Within-Cingulo-Opercular (Cohen’s d = 0.117, 95%CI [0.043, 0.19], lnBF = 1.646) connectivity networks (Supplementary Table. 13). Similarly, 2 rsfMRI measures associated with anhedonia were also significantly associated with irritability. These were the Salience vs. Left-Ventraldc (Cohen’ d = -0.139, 95%CI [-0.224, -0.054], lnBF = 2.075) and Default vs. Dorsal-Attention (Cohen’s d = -0.138, 95% CI [-0.223, -0.053], lnBF = 2.004) connectivity measures (Supplementary Table. E.1). None of the rsfMRI measures associated with anhedonia were also associated with bipolar II.

Altogether, the results of the t-test comparisons using the full ABCD 4.0 sample suggest the Cingulo-Opercular vs. BrainStem, Retrosplenial-Temporal vs. Right-Cerebellum-Cortex, and the Sensorimotor-Hand vs. BrainStem connectivity measures may be more specifically associated with anhedonia. Contrastingly, the Within-Cingulo-Opercular connectivity measure, whose association with anhedonia was the only one replicated at the more conservative adjusted p-value and lnBF statistic levels, was associated with both depressed mood and irritability.” (lines 484-501)

Additionally, we added the following lines in the discussion to elaborate on the impact of including sociodemographic covariates in the multiple linear regressions:

“Using t-tests, only the Within-Cingulo-Opercular rsfMRI measure was consistently associated with anhedonia across the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples. However, when we controlled for demographic covariates (sex, age, and race/ethnicity) using a linear regression approach, the association was no longer replicable in the ABCD 4.0 (excluding 1.0) sample. Like the other associations identified by the previous authors, we observed a significant decrease in effect size in the replication analysis after controlling for these additional covariates suggesting the presence of significant confounding effects that were not accounted for with t-tests.” (lines 682-690)

For the multiple linear regressions, we assessed specificity by including the 3 comorbid psychiatric conditions as additional predictors in the regression models. We then assessed whether the partial regression coefficients for these additional comorbidities were also significantly associated with rsfMRI measures that were found to be associated with anhedonia. The following lines are now included in the results section:

“Next, we added depressed-mood, irritability, and bipolar II disorder measures to the regression analyses across the ABCD samples in order to assess the impact of accounting for comorbid conditions on the specificity and stability of the effect sizes and significance of the associations between rsfMRI measures and anhedonia that were previously identified.

For the Auditory vs. Right-Putamen and Retrosplenial-Temporal vs. Right-Thalamus-Proper measures, we found that their significant associations with anhedonia were preserved in the regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, even after accounting for psychiatric comorbidities (Table. 6, center and right). Furthermore, their effect sizes remained relatively consistent across the analyses using the different ABCD samples as well. Importantly, depressed-mood, irritability, and bipolar II disorder were not found to be significant predictors of these rsfMRI measures in any of the multiple linear regression analyses, suggesting these associations are specific to anhedonia (Supplementary Table. 17).” (lines 588-601)

Furthermore, in the discussion, we elaborate on the meaning of the rsfMRI measures found to be specifically associated with anhedonia, as well as some potential clinical implications (see response to reviewer 1, comment 24).

7. The result section in the abstract should explicitly state that the larger full sample that replicated 6/11 associations included the data from the initial study and is therefore not an independent replication. In the same vein, the wording “replication of previous findings was limited” maybe overly optimistic given that in the independent sample only 1/11 was replicated, and, once controlled for covariates, a lot of the associations in the initial sample were no longer significant, too.

[Response] We have revised the results section of the manuscript which now reads:

“To increase our power to detect genuine associations with smaller effect sizes, we next performed our analyses using the full ABCD 4.0 release sample, including all participants from the ABCD 1.0 release. Since we are including the participants used in the initial analyses, our analyses using the full ABCD 4.0 sample would not be an independent replication of the previous results. Nevertheless, the results will help with the assessment of the stability of the effect sizes and associations.” (lines 409-414)

Our main findings were that associations between anhedonia and 2 rsfMRI measures (which were not part of the 11 measures identified by the previous authors) were replicable in the ABCD 4.0 (excluding 1.0) sample (which can be considered similar to an independent sample), even after accounting for demographic and psychiatric comorbidities. For these two rsfMRI measures, while statistical significance was not achieved in the ABCD 1.0 sample, this was likely due to the lower statistical power in this smaller sample. Notably, the effect sizes were consistent, and statistically significant, in the larger ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, where there was greater statistical power. We have included the following lines in the results to clarify this point:

“We note that the Auditory vs. Right Putamen and Retrosplenial-Temporal vs. Right-Thalamus-Proper measures were not found to be associated with anhedonia in the ABCD 1.0 sample (Table. 6, left) at the adjusted or nominal p-value levels (although there was a trend). However, we see that the effect sizes and partial regression coefficients were similar to those estimated in the corresponding regressions using the ABCD 4.0 (excluding 1.0) and full ABCD 4.0 samples, albeit with wider confidence intervals and larger standard errors. These patterns suggest that the ABCD 1.0 sample size was not well-powered enough, after including the additional psychiatric comorbidity measures, to detect these associations.” (lines 612-620)

Finally, we have revised the abstract which now reads:

“Results: While the previously reported associations were reproducible, effect sizes for most rsfMRI measures were drastically reduced in replication analyses (including both t-tests and multiple linear regressions) using the ABCD 4.0 (excluding 1.0) sample. However, 2 new rsfMRI measures (the Auditory vs. Right Putamen and the Retrosplenial-Temporal vs. Right-Thalamus-Proper measures) exhibited replicable associations with anhedonia and stable, albeit small, effect sizes across the ABCD samples, even after accounting for demographic covariates and comorbid psychiatric conditions using a multiple linear regression approach.

Conclusion: The most statistically significant associations between anhedonia and rsfMRI connectivity measures found in the ABCD 1.0 sample tended to be non-replicable and inflated. Contrastingly, replicable associations exhibited smaller effects with less statistical significance and multiple linear regressions helped assess the specificity of these findings and control the effects of confounding covariates.” (lines 34-47).

References

1. Jakobsen JC, Gluud C, Wetterslev J, Winkel P. When and how should multiple imputation be used for handling missing data in randomised clinical trials – a practical guide with flowcharts. BMC Med Res Methodol. 2017 Dec 6;17(1):162.

2. Ghasemi A, Zahediasl S. Normality Tests for Statistical Analysis: A Guide for Non-Statisticians. Int J Endocrinol Metab. 2012;10(2):486–9.

3. Yang K, Tu J, Chen T. Homoscedasticity: an overlooked critical assumption for linear regression. Gen Psychiatry. 2019 Oct 17;32(5):e100148.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Melissa A Brotman

1 Mar 2023

Associations Between Resting State Functional Brain Connectivity and Childhood Anhedonia: A Reproduction and Replication Study

PONE-D-22-28899R1

Dear Dr. Zhou,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Melissa A Brotman, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: I have no further comments. The authors did a great job with the revision - this is an important paper.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Lana Ruvolo Grasser

Reviewer #2: No

**********

Acceptance letter

Melissa A Brotman

7 Mar 2023

PONE-D-22-28899R1

Associations Between Resting State Functional Brain Connectivity and Childhood Anhedonia: A Reproduction and Replication Study

Dear Dr. Zhou:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Melissa A Brotman

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Correlations between statistics from the current analyses and those reported by the previous authors.

    Pearson correlations for student’s t-statistics (left) and lnBF statistics (right) derived from the previous author’s analyses and those derived from our reproduction analyses for A) anhedonia, B) depressed mood, and C) anxiety. LnBF are natural logarithm of Bayes Factors.

    (DOCX)

    S2 Fig. Visual inspection of normality for rsfMRI connectivity measures from the ABCD 1.0 sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures.

    (DOCX)

    S3 Fig. Comparing Welch’s t-tests to Student’s t-tests.

    To assess the potential bias introduced by unequal variances across anhedonia and control groups, we performed Welch’s t-tests for those rsfMRI measures with significant F-tests in the A) ABCD 1.0, B) ABCD 4.0 (excluding 1.0), and C) full ABCD 4.0 samples and then correlated the Welch’s t-statistics with Student’s t-statistics (left) and the Welch’s p-values with Student’s p-values (right).

    (DOCX)

    S4 Fig. Visual inspection of normality for rsfMRI connectivity measures from the ABCD 4.0 (excluding ABCD 1.0) sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures.

    (DOCX)

    S5 Fig. Visual inspection of normality for rsfMRI connectivity measures from the full ABCD 4.0 sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures.

    (DOCX)

    S6 Fig. Visual inspection of residuals from the regression (controlling for sociodemographic covariates) for the FrontoParietalRightVentraldc rsfMRI connectivity measure using the ABCD 1.0 and correlations between OLS and WLS t-statistics.

    Here, we visualize the residuals plotted against marginal fitted values of the linear regression model for the FrontoParietalRightVentraldc rsfMRI measure using the ABCD 1.0 sample (left), which exhibited a significant BP test for heteroskedasticity. We also performed weighted-least-squares regression (WLS) and correlated the t-statistics for each model predictor with those from the original ordinary-least-squares (OLS) regression (right).

    (DOCX)

    S7 Fig. Visual inspection of residuals from the regression for FrontoParietalRightVentraldc rsfMRI measure (controlling for sociodemographic and psychiatric comorbidities) using the ABCD 1.0 sample and correlations between OLS and WLS t-statistics.

    Here, we visualize the residuals plotted against marginal fitted values of the linear regression model for the FrontoParietalRightVentraldc rsfMRI measure using the ABCD 1.0 sample (left), which exhibited a significant BP test for heteroskedasticity. We also performed weighted-least-squares regression (WLS) and correlated the t-statistics for each of the model predictors with those from the original ordinary-least-squares (OLS) regressions (right).

    (DOCX)

    S8 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic covariates only) using the ABCD 4.0 (excluding 1.0) sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

    Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for each of the model predictors with those from the original ordinary-least-squares (OLS) regressions. Note that some plots present a more discrete distribution of residuals along the fitted-values axis. These patterns occur when categorical predictors (such as race/ethnicity) exhibit greater effects in the model, compared to more continuous predictors (such as age), and thus are weighted more when producing predicted values.

    (DOCX)

    S9 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic and psychiatric comorbidities) using the ABCD 4.0 (excluding 1.0) sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

    Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for the model predictors with those from the original ordinary-least-squares (OLS) regressions.

    (DOCX)

    S10 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic covariates only) using the full ABCD 4.0 sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

    Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for the model predictors with those from the original ordinary-least-squares (OLS) regressions.

    (DOCX)

    S11 Fig. Visual inspection of residual variance from regressions (controlling for sociodemographic covariates and psychiatric comorbidities) using the full ABCD 4.0 sample for rsfMRI measures with significant Breusch-Pagan tests and correlations between OLS and WLS t-statistics.

    Here, we visualize the residuals plotted against marginal fitted values for 4 rsfMRI connectivity measures exhibiting significant BP tests for heteroskedasticity. We also performed weighted-least-squares regression (WLS) for each rsfMRI measure and correlated the t-statistics for the model predictors with those from the original ordinary-least-squares (OLS) regressions.

    (DOCX)

    S12 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models controlling for sociodemographic covariates using the ABCD 1.0 sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

    (DOCX)

    S13 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic and psychiatric comorbidities using the ABCD 1.0 sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

    (DOCX)

    S14 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates using the ABCD 4.0 (excluding 1.0) sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

    (DOCX)

    S15 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates and psychiatric comorbidities using the ABCD 4.0 (excluding 1.0) sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

    (DOCX)

    S16 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates using the full ABCD 4.0 sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

    (DOCX)

    S17 Fig. Visual inspection of normality for rsfMRI connectivity measure residuals from multiple linear regression models with sociodemographic covariates and psychiatric comorbidities using the full ABCD 4.0 sample.

    Density (left) and quantile-quantile (right) plots are shown for 3 representative rsfMRI connectivity measures with significant associations with anhedonia.

    (DOCX)

    S1 Table. T-test results comparing those with anhedonia from controls using the ABCD 1.0 sample.

    Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, ln(Bayes Factor) (lnBF), group means with standard deviations (SD), Shapiro-Wilk statistics (W-statistic), and F-statistics are reported.

    (XLSX)

    S2 Table. T-test results comparing those with anhedonia from controls using the ABCD 4.0 (excluding 1.0) sample.

    Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, ln(Bayes Factor) (lnBF), group means with standard deviations (SD), Shapiro-Wilk statistics (W-statistic), and F-statistics are reported.

    (XLSX)

    S3 Table. T-test results comparing those with anhedonia from controls using the full ABCD 4.0 sample.

    Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, ln(Bayes Factor) (lnBF), group means with standard deviations (SD), Shapiro-Wilk statistics (W-statistic), and F-statistics are reported.

    (XLSX)

    S4 Table. Multiple linear regression results in the ABCD 1.0 sample, controlling for sociodemographic covariates.

    The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

    (XLSX)

    S5 Table. Multiple linear regression results in ABCD 1.0 sample, controlling for sociodemographic covariates and psychiatric comorbidities.

    The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

    (XLSX)

    S6 Table. Multiple linear regression results in ABCD 4.0 (excluding 1.0) sample, controlling for sociodemographic covariates.

    The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

    (XLSX)

    S7 Table. Multiple linear regression results in ABCD 4.0 (excluding 1.0) sample, controlling for sociodemographic covariates and psychiatric comorbidities.

    The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

    (XLSX)

    S8 Table. Multiple linear regression results in the full ABCD 4.0 sample, controlling for sociodemographic covariates.

    The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

    (XLSX)

    S9 Table. Multiple linear regression results in the full ABCD 4.0 sample, controlling for sociodemographic covariates and psychiatric comorbidities.

    The partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, significance, model R2 (R^2), Bonferroni-Hochberg Adjusted p-values (BH adjustment), Bonferroni adjustd p-values, Durbin-Watson statistic (DW_statistic), Breusch-Pagan Chi^2 (BP Chi^2), and Breusch-Pagan (BP) p-values are presented. The ICC is the proportion of variance in rsfMRI connectivity explained by the family structure random effect.

    (XLSX)

    S10 Table. Comparison of participants removed due to missing data with participants who were retained for the t-test analyses.

    The proportion (%) of participants in each group for each measure are shown. Student’s t-test was done to compare age (in months) between the “removed” and “retained” groups. Chi-square tests of independence were done for all other measures. P-values < 0.05 are bolded.

    (XLSX)

    S11 Table. Tetrachoric correlations between youth reported anhedonia and other psychiatric conditions reproted by parents or youths.

    Items ending in "_y" are youth reported measures, and items ending in "_p" are parent reported measures.

    (XLSX)

    S12 Table. Prevalence of significantly comorbid psychiatric symptoms and diagnoses in those reporting anhedonia at baseline.

    The frequencies of three psychiatric symptoms and diagnoses, in individuals reporting anhedonia, significantly correlated (tetrachoric correlation r > = 0.5) with youth reported anhedonia are shown. Note that before filtering out participants with low-quality functional MRI scans, 1104 participants at baseline reported past and/or present anhedonia. The suffix “_y” indicate measures based on youths’ self-reports.

    (XLSX)

    S13 Table. T-tests results for comparisons between those with depressed mood, irritability, and bipolar II disorder and controls using the full ABCD 4.0 sample.

    Effect sizes (Cohen’s d) with 95% Cis, t-statistics, p-values, and ln(Bayes Factor) (lnBF) statistics are reported. Bolded values represent statistically significant results, as indicated by lnBF values > 1.1.

    (XLSX)

    S14 Table. Average Generalized Variance Inflation Factor (GVIF) values for predictors from multiple linear regressions controlling for sociodemographic covariates across the ABCD samples.

    (XLSX)

    S15 Table. Average Generalized Variance Inflation Factor (GVIF) values for predictors from multiple linear regressions controlling for sociodemographic covariates and psychiatric comorbidities across the ABCD samples.

    (XLSX)

    S16 Table. Comparison of participants removed due to missing data with participants who were retained for the multiple linear regression analyses.

    The proportion (%) of participants in each group for each measure are shown. Student’s t-test was done to compare age (in months) between the "removed" and "retained" groups. Chi-square tests of independence were done for all other measures. p-values < 0.05 are bolded.

    (XLSX)

    S17 Table. Effects of bipolar II disorder, irritability, and depressed mood from multiple linear regression analyses across the ABCD study samples for 27 rsfMRI measures associated with anhedonia.

    Effect size (effect_CIs) with 95% confidence intervals represents the percentage of the total variance (proportion of variance * 100%) in a rsfMRI connectivity measure accounted for by each predictor (psychiatric symptom or diagnosis). Total model R^2 (total_R2), partial regression coefficients (Estimate), standard errors (Std.Err), t-values, p-values, and Benjamini-Hochberg corrected p-values (BH_adjustment) values are reported.

    (XLSX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All data files are available from the ABCD Study Data Repository from the NIMH Data Archive (https://nda.nih.gov/abcd). The DOI for this NDA Study is 10.15154/1526460.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES