Skip to main content
PLOS One logoLink to PLOS One
. 2022 Sep 15;17(9):e0274271. doi: 10.1371/journal.pone.0274271

The bidirectional association between depressive symptoms, assessed by the HADS, and albuminuria–A longitudinal population-based cohort study with repeated measures from the HUNT2 and HUNT3 Study

Lise Tuset Gustad 1,2,3,*,#, Anna Marie Holand 4,5,#, Torfinn Hynnekleiv 6, Ottar Bjerkeset 1,7, Michael Berk 8,9, Solfrid Romundstad 3,10
Editor: Angela Lupattelli11
PMCID: PMC9477298  PMID: 36107876

Abstract

Background

Both albuminuria and depression are associated with cardiovascular disease, reflecting low-grade systemic inflammation and endothelial dysfunction. They share risk factors including weight, blood pressure, smoking and blood glucose levels. This longitudinal study aimed to examine bidirectional associations between depression symptoms, indexed by the Hospital Anxiety and Depression scale (HADS), and the inflammation marker albuminuria.

Methods

2909 persons provided urine samples in both the second (HUNT2, 1995–97) and third wave (HUNT3, 2006–2008) of the Trøndelag Health Survey, Norway. We used a generalized linear regression model (GLM) and ANOVA to assess the association between albuminuria levels (exposure HUNT2) with depression symptoms (outcome in HUNT3); and between depression symptoms (exposure HUNT2) with albuminuria (outcome HUNT3). Depression symptoms were measured with the HADS Depression Scale, analyzed utilising the full 7 items version and analyses restricted to the first 4 items (HADS-D and HADS-4). We accounted for confounders including baseline individual levels of the exposure variables.

Results

In this 10-years follow-up study, we found no statistical evidence for an association between baseline depression symptoms and subsequent albuminuria, nor between baseline albuminuria and subsequent depression symptoms. For albuminuria, only 0.04% was explained by prior depression, and for depression, only 0.007% was explained by previous albuminuria levels. The results were essentially the same for the shorter HADS-4 measure.

Conclusion

There does not appear to be a longitudinal association between albuminuria and depression measured by the HADS.

Introduction

Depression symptoms may be more prevalent in people with albuminuria—leading to hypotheses regarding causal directions. In a previous cross-sectional population-based cohort study, albuminuria was associated with depressive symptoms and depressive episodes, even at levels of albuminuria that do not fulfil the chronic kidney disease (CKD) criteria [1]. This led to a hypothesis that albuminuria could serve as a marker for individuals at risk of depression [1]. Others have put forward a hypothesis that depression symptoms might be risk factors for albuminuria, or that the observed overlap is explained by other participant traits, i.e. reflect confounding [2]. One cross-sectional study found that the association between HADS-assessed depression and albuminuria was explained mainly by age and comorbidity [3]. Nevertheless, these conflicting cross-sectional data that suggest potential bidirectional causal relationships between albuminuria and depression symptoms might inform detection or prevention strategies for future cardiovascular disease (CVD). These speculations are important to explore as albuminuria and depressive symptoms both are potentially preventable risk factors for CVD [48].

To date, one large-scale study has investigated the longitudinal bidirectional relation between depression and albuminuria [9]. Regarding the causal direction from urinary albumin to risk of depression, Liu et al (2022) found no clear evidence of elevated urine albumin associated with future depression, while reduction of eGFR was associated with increased risk of future depression. Further, one small-scale longitudinal study of 16 children assessed the relationship between proteinuria and perceived stress [10]. While proteinuria and albuminuria are not the same, large amounts of albuminuria approximate a positive proteinuria dipstick [11]. However self-reported proteinuria utilising albustix, as used by Bakkum et al (2019) [10], is a method more prone to user error than laboratory-confirmed proteinuria [12]. In examining the causal relationship from depression to albuminuria, none of the above longitudinal studies included such analysis.

We therefore aimed to examine if levels of albuminuria were associated with future depression symptoms and if depression symptoms were associated with future levels of albuminuria. These bidirectional hypotheses were explored in a longitudinal population-based follow-up study of the general population, applying adjustments for important confounding factors such as age, weight, blood pressure, smoking and blood glucose levels, that is associated with both albuminuria and depression [5, 1318]

Methods

Study population

This study is based on participants who provided urine samples and answered questions regarding depression symptoms in both the second HUNT wave (HUNT2, 1995–97) and the third HUNT wave (HUNT3, 2006–2008) [6, 19, 20].

The albuminuria subpopulation

HUNT2 invited 11501 of the 65003 (17.7%) consenting participants to provide urine samples (the HUNT2 Albuminuria substudy). 6779 (58.9%) of the participants reported diabetes or the use of hypertensive medications, and 5% were randomly selected (n = 2686) [21]. While 9135 were invited to provide urine samples in HUNT 3, 4260 (46.6%) of these previously provided urine samples in HUNT2; 2768 (40.8%) of those with diabetes and hypertension, and 1492 (55.5%) of the random selection [6]. Consent to participate was given twice by 2909 of the re-invited (68.2%); 1843 (63.4%) of the diabetic and blood pressure samples, and 1066 (36.6%) of the randomly selected (see Fig 1 for the flow chart regarding inclusion).

Fig 1. Flow chart of recruitment of the participants in the study.

Fig 1

Measures

Laboratory data (blood and urine)

Blood sampling was performed in a non-fasting state at the clinical examination. HUNT participants returned the urine samples in standardized receptacles using prepaid envelopes. Fresh blood and urine samples were analyzed at an accredited laboratory (ISO-9001 certified and ISO/IEC-17025) in Levanger Hospital (Norway). For the analysis, HUNT2 used a Hitachi 911 autoanalyzer (Hitachi, Mito, Japan) with reagents from Boehringer Mannheim (Mannheim, Germany), and HUNT3 used an Architect ci8200 autoanalyzer (Abbot Diagnostic, Longford, Ireland) [20].

HUNT used the Jaffe method, calibrated to isotope-dilution mass-spectroscopy, to measure the serum concentration of creatinine (Se-Crea). Calibrated se-Crea was used to calculate estimated glomerulus filtration rate (eGFR), using the Chronic Kidney Disease Epidemiology Collaboration equation (CKD-EPI) [22]. Immunoturbidimetric methods using antihuman serum albumin were applied to determine urine albumin and calculate Albumin Creatinine Ratio (ACR). In HUNT2, the supplier was Dako AS, Glostrup, Denmark [23], and in HUNT3 Abbot Laboratories [20]. Detailed information on quality control and calibration methods have been previously published [24]. A correction equation was applied to ensure identical calibration of the methods: u-albuminHUNT-3Hunt-2 level = [(0.81_u-albumin HUNT-3)0.5] [6].

Clinical examination

Trained nurses performed standardized clinical examinations at baseline [20]. The assessments included measurements of the participants’ height and weight (both with light clothing without shoes, to the nearest cm or kg). Body mass index (BMI) was calculated as kg/m2. The average of the second and third systolic blood pressure (SBP) measurements was used, recorded by an automatic oscillometric method (Dinamap 845XT; Criticon, Tampa, Florida, USA) after > 5 minutes resting in a sitting position.

Self-report

Participants self-reported depression symptoms experienced in the past week using the depression subscale of the Hospital Anxiety and Depression scale (HADS). The HADS depression (HADS-D) subscale includes seven items that screen for non-somatic depression symptoms like anhedonia and psychomotor retardation [25]. The HADS-D measures the severity of depression in the general population with a sensitivity and specificity of ~80% [26]. Each question is answered using a scale of 0–3, i.e., the HADS-D subscale ranges from 0 to 21. In addition to the seven-item HADS-D, we also used only the sum of the first four HADS-D items (HADS-4), which has shown almost equal sensitivity and specificity as the seven-item version (HADS-7), however it may yield less heterogeneity and more power [27]. HADS-4 has statistical power of 0.76, while the HADS-D has power of 0.37 due to a more homogenous depression phenotype. The HADS-4 ranges from 0–12 and has almost equal sensitivity and specificity for depression as the HADS-D.

In HUNT 3, the participants self-reported diabetes (yes/no) and/or using hypertensive medication (yes/no). The HUNT2 response of hypertension was re-coded into yes/no by merging the "present use of blood pressure medication" and "previous use of blood pressure medication" into the yes-category. Weekly alcohol consumption was based on participants’ reports of how many beers, wine, and liquor units they usually consumed in two weeks. The amount of beer, wine, and liquor units were combined and categorized; zero units per week, or answering yes to being an abstainer, was defined as "abstainer," 1–14 units as "light drinker," 15–28 units as "moderate drinker" and more than 28 units as "heavy drinker". We constructed a variable for "education and work" based on self-reported education (for HUNT2 participants) and the three-class version of the Classification of Occupation Codes from Statistics Norway (for HUNT3 participants). Category 1 included participants if they had less than ten years of education or belonged to the working class; category 2 included participants reporting 10–12 years of education or belonged to the intermediate working class; category three was applied when participants had >12 years of education or belonged to the salaried class. Smoking was self-reported as “never, previous and current smoking” [20].

Ethics approval and consent to participate

All participants in HUNT2 and HUNT3 voluntarily presented for examination and gave written and informed consent to use their data for research. All HUNT participants have the ability to withdraw from the registry. This study was approved by the Regional Committee for Medical and Health Research Ethics in South East Norway (2010/178-2/REC Mid-Norway) with the last extension in 2019 (ref no 12364). The study is also approved by the Data Access Committee (DAC) for Nord-Trøndelag Hospital Trust and the DAC from the HUNT Study.

Statistical analysis

Repeated measurements from all participants attending HUNT2 and HUNT3 were used. Per protocol, we replaced 1–2 missing items on the HADS depression subscale with 6/7 and 5/7 of the values provided, and defined these as our complete case [28]. No such replacements were performed on missing items for the HADS-4. As the laboratory quality program detected three months (January–March 2008) with false elevated ACR values, we re-coded these values as missing [6]. If the participants self-reported a urinary tract infection during the last week, experienced persistent hematuria over the previous year, and if women were pregnant or menstruating at collection time, the urinary measurements were also listed as missing

In the descriptive analysis, we evaluated depression symptoms, albuminuria, and covariates, for both study waves, with HUNT2 being defined as baseline and HUNT3 as the end-point. Exposure of depression symptoms was defined as HADS-D levels in HUNT2 and outcome as HADS-D levels in HUNT3. Albuminuria was defined as an exposure in HUNT2 and an outcome in HUNT3.

To explore the association between depression symptoms and albuminuria, we performed a Spearman Rho correlation between the exposure variables, as the assumptions for a Pearson correlation were not met. Bidirectionality in our study is indicated if the exposure to one variable in HUNT2 is associated with change in the other variable in HUNT3 (the outcome). The two hypotheses (H) explored were thus;

  • H1: Depression symptoms in HUNT2 (exposure) are associated with albuminuria levels in HUNT3 (outcome).

  • H2: Albuminuria levels (exposure) in HUNT2 are associated with depression symptoms in HUNT3 (outcome).

We considered each hypothesis separately using a generalized linear regression model (GLM), adjusting for confounding factors (k) at HUNT2. See S1 File for an overview of the two statistical formulas used, equation 1 (Eqn1) and equation 2 (Eqn2), one for each hypothesis.

The confounding (k) factors were added in three different models. Model 1 included k = age and sex. Model 2 adjusted for the baseline level of the outcome variable (yi or zi), as repeated measures take height for the within-individual association for paired measurements. Model 3 added further adjustments for K = education, BMI, smoking, cholesterol, eGFR, diabetes, SBP, antihypertensive medication, and alcohol in addition to model 2.

Regression models were first fitted to the complete dataset (including missing) using model 3. For Eqn.1, the HADS-scores were treated as a continuous (range 0–21 for HADS-7 and 0–12 for HADS-4), and a GLM with a gamma-distributed dependent variable, and an identity link, was fitted. A value of 1 was added to the score, as gamma distribution does not exist for 0, and HADS scores include the value 0. When transforming back to the original scale, the expectation (E) of model 1–3 is E(y+1) = E(y) + 1. Therefore, the only transformation is for the intercept (b0–1). This should avoid using a log transformation that can lead to bias and non-linearity in the interpretation of the back-transformed estimates. For Eqn.1, a pseudo R2 was calculated as 1-(residual deviance/null deviance) and p-value is calculated from a deviance goodness of fit test [29]. R2 is the coefficient of determination.

For Eqn.2; the albuminuria variable was also treated as a continuous variable,and was log-transformed and fitted with a linear model with a Gaussian distribution. The estimates were then back-transformed using the exponential function and reported as a percentage.

A visual inspection of the residual plots revealed no obvious deviations from the assumptions of the linear regression models. Further, the variance inflation factor (VIF) was smaller than 5 for all predictors (most predictors have a VIF of 1) and did not indicate any multicollinearity causing concern in the dataset.

The missing values ranged between 0 and 9%. We assumed missing at random (MAR) for the included variables. MAR was tested by checking if missing values depended on age, sex, education, or comorbidities. Missing data were imputed using multiple imputations (MI) by fully conditional specification (FCS) allowing a flexible assumption for each variable [30]. The MI routine generated a total of 20 complete datasets by 20 iterations in the "MI chained"-routine. Passive imputation was performed for the log transformed response of albuminuria. All variables used in model 3 were included for the imputation procedure, and measurements from both study waves were used for imputation. Analytical results from MI were compared to results from the complete case. Visual inspection of the imputation indicated an appropriate imputation. The regression models were fitted to the complete dataset (with missing) to find an appropriate model, and further fitted to the imputed dataset to improve the power. Analysis of variance (ANOVA) was used to assess the overall fit of the models and find the proportion of variance in the outcome, explained by exposure (effect size of variables in model 3).

Sensitivity analysis was conducted to investigate the plausibility of the MAR assumption for HADS. The delta (δ) adjustment technique (described in paragraphs 3.8 and 9.2 in [30]) was used to explore the effect of increasing the imputed HADS scores by adding an amount δ to the values imputed under MAR. The chosen δ-values for the HADS scores from HUNT2 to HUNT3 were 0 (MAR) and 1, 2, 3, 4 and 5 (Missing Not At Random assumption). As 17.6% of the albuminuria values in HUNT3 were set to missing due to measurement error in a 3-month period at the lab, we know that these values are missing under MAR assumptions. The rest of the missingness in albuminuria (2.2% in HUNT2 and 9% in HUNT3) was related to sex, and the effect of sex should be accounted for in the models.

A potential interaction effect between age and sex on exposure was explored in model 1 and 3. This interaction effect was only found to be significant for model 1 for Eqn 2. This effect was however considered small and the interaction term did not significantly improve the other models (see S1 Table). The interaction effect was thus chosen to be excluded from the models as this interaction effect uses degrees of freedom and complicates the model.

Descriptive statistics was performed using Stata Statistical Software, TX: StataCorp LLC 2017. All other analyses were performed using R (R Core Team 2021). The MI method was performed in R using the mice package v3.13.0 [31].

Results

Table 1 shows the descriptive statistics for the 2909 participants that attended two study waves. The participants had higher albuminuria levels in HUNT 3 than in HUNT2, as expected with ten years of ageing. The average HADS-D score was stable across decades.

Table 1. Baseline characteristics of the participants at HUNT2 (1995–97) and HUNT3 (2006–2008), n = 2909.

Variable HUNT2 m, n (%) HUNT3 m, n (%)
Sex, male, n (%) 1357 (46.6) 0 (0) NA NA
Age, years, mean (SD) 54.5 (11.5) 0 (0) 65.6 (11.5) 0 (0)
ACR, mg/mmol, mean (SD) 1.2 (2.2) 98 (1.5) 2.7 (7.8) 262 (9.0)*
Depression, HADS-D score, mean (SD) 3.7 (3.1) 45 (1.6) 3.8 (3.0) 193 (6.6)
Body Mass Index, kg/m2, mean (SD) 27.7 (4.3) 0 (0) 28.7 (4.6) 13 (0.4)
eGFR (CKD-epi), mean (SD) 81.0 (15.8) 0 (0) 77.2 (16.8) 27 (2.3)
Cholesterol, mg/mmol, mean (SD) 6.1 (1.2) 0 (0) 5.4 (1.1) 58 (1.9)
Systolic blood pressure, mmHg, mean (SD) 144.2 (20.7) 0 (0) 139.2 (20.3) 5 (0–2)
Self-reported diabetes, yes, n (%) 313 (10.6) 0 (0) 525 (18.0) 3 (0.1)
Self-reported CVD, yes (n %) 337 (11.6) 0 (0) 622 (21.4) 0 (0)
Self-reported blood-pressure medication, yes, n (%) 1753 (60.2) 0 (0) 2043 (70.2) 0 (0)
Smoking Status, yes, n (%) 21 (2.1) 94 (3.2)
    Never 1301 (44.7) 1162 (39.9)
    Previous 1059 (36.4) 1326(45.6)
    Current 528 (18.2) 327 (11.2)
Alcohol Status, units per week, n (%) 98 (4.7) 32 (1.1)
    <1 1158 (39.9) 793 (27.3)
    1–7 1319 (45.3) 1448(49.8)
    8–14 261 (8.8) 505 (17.4)
    >15 73 (2.3)   131 (4.5)  
Education (HUNT2) or work status (HUNT3), n (%) 96 (3.3) 193 (6.6)
    Ten years of school or less or unskilled worker 1235 (42.5) 734 (25.2)
    10–12 years of school or intermediate working class 1074 (36.9) 1619 (55.7)
    >12 years of School or salariat working class 504 (17.3) 363 (12.5)

Abbreviations: m = missing; n = number of participants; ACR = Albumin Creatinine ratio in urine, CVD = Cardiovascular disease.

*Additional 514 (17.6%) were set to missing due to deviations in urinary analysis, or self-report of urinary tract infection during the last week, persistent hematuria over the previous year, and whether women were pregnant or menstruating at collection time.

The pooled correlation between HADS depression symptoms and albuminuria levels in HUNT2, and between each variable measured in HUNT2 with the variable measured in HUNT3, is illustrated in Table 2. The results indicate a non-significant association between depression symptoms at baseline and albuminuria levels at HUNT3 (r = .04, p = .12). A negligible association was found between albuminuria levels at baseline and HADS depression scores in HUNT3 (r = .07, p < .001 for HADS-D and r = 0.05, p<0.01 for HADS-D 4 items), although these associations were significant. The association between repeated depression symptoms across the two study waves was moderately positive (r = .54, p < .001 for HADS-D and r = .50, p<0.001 for HADS-D 4 items), and the association between repeated albuminuria levels across the two studies was weakly positive (r = .26, p < .001).

Table 2. Spearman correlation between the depression symptoms and albuminuria*.

Correlation HADS-D 7 items1 Albuminuria 2 HADS-D 7 items1 Albuminuria2
HUNT 2 HUNT 3
Depression HUNT 2 1
Albuminuria r = .02 (.02), p = .20 1
Depression HUNT 3 r = .54 (.01), p < .001 r = .07 (.02), p < .001 1
Albuminuria r = .04 (.02), p = .12 r = .26 (.02), p < .001 r = .07 (.02), p < .001 1
HADS-D 4 items 3 Albuminuria 2 HADS-D 4 items 3 Albuminuria 2
Depression HUNT2 1
Albuminuria r = .008 (.02), p = .69  1
Depression HUNT3 r = .50 (.02), p < .001  r = .05 (.02), p < .01  1
Albuminuria r = .03 (.02), p = .18 r = .25 (.02), p < .001  r = .06 (.02), p < .01  1

*Results from imputed dataset, Degrees of freedom = 2907.

Abbreviations: r = correlation coefficient, () = (standard error of pooled estimates), p = p-value.

1HADS-D 7 items = Hospital Anxiety and Depression Scale-Depression subscale, all seven items on the scale. Self-reported depression symptoms (0–21)

2Albuminuria is measured by Albumin Creatinine Ratio (ACR) in urinary samples.

3HADS-D 4 items = Hospital Anxiety and Depression Scale-Depression subscale, the first 4 items of the HADS-D 7 items scale. Self-reported depression symptoms (0–12)

The results for the GLM related to the effects of albuminuria in HUNT2 on depression symptoms in HUNT3 (eqn 1) are given in Table 3. Table 3 shows that for every one-unit increase in albuminuria values in HUNT2, the average depression symptom score in HUNT3 decreases by 0.001 points for HADS-D-7 and decreases by 0.003 points for HADS-D-4. The confidence intervals were wide and inconclusive for both HADS-depression measures. However, depression levels in HUNT2 were associated with depression levels in HUNT 3, (β = .53 (.49, .57), p < .001). All the covariates in model 3 poorly accounted for the proportion of variation, pseudo-R2 = 0.29.

Table 3. General linear regression1 of the effects of albuminuria in HUNT2 on depression symptoms in HUNT3.

HADS-Depression 7-items HUNT3 (+1)2  HADS-Depression 4-items3 HUNT3 (+1)2 
Model 1  Model 2  Model 3  Model 1 Model 2 Model 3
Variable  β (95% CI)  β (95% CI)  β (95% CI)  β (95% CI)  β (95% CI)  β (95% CI) 
Intercept4  2.60 (2.10,3.09)***  1.73 (1.35,2.11)***  .61 (-.90,2.13)  2.03 (1.72,2.34)*** 1.67 (1.41,1.92)*** 1.05 (.04,2.08)*
Albuminuria HUNT25  .006 (-.02,.03)5  .006 (-.02,.03)5  -.001 (-.02,.02)5  .0004 (-.01,.02) .0002 (-.01,.01) -.003 (-.01,.01)
Age (years)  .04 (.03,.05)***  .02 (.01,.03)***  .01 (.003,.03)*  .02 (.02,.03)*** .01 (.01,.02)*** .009 (.001,.02)*
Male sex  .34 (.11,.56)**  .12 (-.06,.30)  -.004 (-.31,.30)  -.15 (-.28,-.01)* -.19 (-.30,-.08)* -.25 (-.45,-.05)*
HADS score HUNT26  .54 (.50,.58)***  .53 (.49,.57) ***  .49 (.45,.53)*** .49 (.45,.53)***
Education or work, Intermediate  -.26 (-.47,-.04)*  -.11 (-.25,.03)
Education or work, Salariat  -.30 (-0.56,-.04)*  -.09 (-.25,.08)
Body Mass Index (kg/m2 .04 (.01,.06)**  .02 (.01,.04) **
Smoking (Previous) -.002 (-.20,.20)  -.06 (-.21,.07)
Smoking (Current ) .53 (.23,.82)***  .24 (.07,.41)**
Cholesterol (mg/mmol)  .01 (-.07,.09)  -.0002 (-.05,0.05)
Antihypertensive medication .19 (-.02,.40)  .12 (-.01,.26)
CVD (yes)7 .23 (-.09,.55)  .12 (-.09,.34)
eGFR (CKD-epi)  .01 (-.002,.02)  .004 (-.003,.01)
Diabetes (yes) .33 (.04,.64)*  .23 (.04,.42)*
Systolic blood pressure -.002 (-.01,.003)  -.002 (-.005,.001)
1–7 units per week alcohol   -.22 (-.42,.-.02)*  -.05 (-.18,.08)
8–14 units per week  -.43 (-.74,-.12)**  -.09 (-.29,.11)
>15 units per week -.35 (-.89,.20) -.19 (-.54,.16)

The grey area in the table indicates the results for the covariates (k) in the model and is not the focus of this article.

1 Equation 1 explaining the GLM approach for depression: γ_i = β_0+〖β_Sex X〗_(i,Sex)+〖β_Age X〗_(i,Age)+⋯+〖〖β_k X〗_(i,k)+ε〗_i where i is the individual participant, γi is the HADS score given in HUNT3 for individual i, β0 is the intercept, and k = confounder variables and εi is the residual effect.

2 For Equation 1 a value of +1 was added to the score as gamma distribution does not exist for 0, and HADS scores include the value 0. When transforming back to the original scale, we find that the expectation (E) of model 1–3 is E(y+1) = E(y) + 1. Thereby, the only transformation is for the intercept (b0–1).

3 HADS-D 4-item is the first 4 items of the Hospital Anxiety and Depression Score-1111Depression subscale

4 The intercept was back-transformed -1.

5 Albuminuria was measured as Albumin Creatinine ratio (ACR) in urine and treated as a continuous variable.

5 The β indicates points change in depression score in HUNT 3 associated with one unit increase in albuminuria value at HUNT2.

6 Depression was measured by the Hospital anxiety and Depression scale and treated as a continuous variable.

7 CVD = self-reported cardiovascular disease

Model 1 included k = age and sex. Model 2 included k = Model 1+baseline level of the outcome variable. Model 3 included k = education, body mass index (BMI), smoking status, cholesterol, eGFR, diabetes, systolic blood pressure, blood pressure medication and alcohol in addition to model 2.

All the predictors, k, in the model were measured at HUNT2.

*Denotes significance p<0.05.

** Denotes significance at p<0.01.

*** Denotes significance at p < .001.

Table 4 indicates that for every one-unit additional HADS-score in HUNT2, albuminuria in HUNT3 increases by 0.5% for the 7-item HADS and decreases by 0.4% for the 4- item HADS. Both estimates have wide and inconclusive confidence intervals. Albuminuria in HUNT2 was also associated with albuminuria in HUNT3, and the HUNT2 albuminuria levels explained 4.08% of the albuminuria levels in HUNT3. All the covariates in model 3 poorly accounted for the proportion of variation, pseudo-R2 = 0.15.

Table 4. General linear regression1 of the effects of depression symptoms in HUNT2 on albuminuria in HUNT3.

Albuminuria2levels in HUNT3 (log and %change)
Model 1 (log)3 Model 2 (log)3 Model 3 (log)3 Model 33 Model 34 (log) Model 34
Variable β (95% CI) β (95% CI) β (95% CI) % Change (95 CI) β (95% CI) % change (95% CI)
Intercept -.90 (-1.13,-.66)*** -.90 (-1.13,-.67)*** -1.85 (-2.63,-1.07)*** -1.77 (-2.52, -1.02)***
HADS-D score HUNT25 .006 (-.01,.02)4 .005 (-.01,.02) 4 .005 (-.01,.02) 4 0.50 (-0.99, 2.02) -.004 (-.03, .02) 5 -0.40 (-2.96, 2.02) 
Age (years) .02 (.02,.03)*** .02 (.02,.03)*** .02 (.02,.03) *** .02 (.02, .03)***
Male sex .13 (.04,.22) ** .12 (.03,.21)** -0.03 (-.18,.12) -.02 (-.17, .13)
Albuminuria HUNT2 .04 (.03,.05)*** .04 (.03,.05)*** 4.08 (3.05, 5.13)*** .04 (.03,.05)*** 4.08 (3.05, 5.13)*** 
Education (reference)
10–12 years .08 (.-.01,.19) .08 (-.03,.18)
>12 years .11 (-.01,.24) .09 (-.04,.22)
Body Mass Index (kg/m2) .003 (-.01,.01) .002 (-.01,.01)
Smoking (reference)
Previous .04 (-.07,.14) .03 (-.07,.14)
Current .22 (.10,.36)*** .22 (.10,.34)***
Cholesterol (mg/mmol) -0.02 (-.06,.02) -.01 (-.05,.03)
BP medication (yes) .15 (.04,.27)** .15 (.06,.25)**
CVD (yes)5 .001 (-.14,.14) .02 (-.12,.16)
eGFR (CKD-epi) .005 (-.001,.01) .005 (-.001,.01)
Diabetes (yes) .35 (.18,.51)*** .32 (.18,.47)***
Systolic blood pressure (mmHg) .002 (-.001,.005) .002 (-.001,.004)
Alcohol (reference)
1–7 units per week .02 (-.08,.11) .02 (-.08,.11)
8–14 units per week -.02 (-.19,.15) -.004 (-.17,.17)
15 units per week -.05 (-.35,.26) -.06 (-.37,.25)

1 Equation 2 explaining the GLM approach for albuminuria: z_i = β_0+〖β_Sex X〗_iSex+〖β_Age X〗_iAge+⋯+〖〖β_k X〗_(i,k)+ε〗_i where zi is measured albuminuria level for individual i in HUNT3.

2 Albuminuria is measured as Albumin Creatinine ratio (ACR) in urine and treated as a continuous variable.

3 Depression is measured by the 7 item depression subscale of the Hospital Anxiety and Depression Scale (HADS-D). The score is used as a continuous variable.

4 Depression is measured by the 4 first items of the HADS-D. The score is used as a continuous variable.

5 CVD = self-reported cardiovascular disease

The β indicates change in albuminuria levels in HUNT 3 associated with one unit increase in HADS-D score at HUNT2.

Model 1 included k = age and sex.

Model 2 included k = Model 1+baseline level of the outcome variable.

Model 3 included k = education, body mass index, smoking status, cholesterol, eGFR, diabetes, systolic blood pressure, blood pressure medication and alcohol in addition to model 2. All the predictors, k, in the model were measured at HUNT2.

The grey area in the table indicates the results for the covariates (k) in the model and is not the focus of this article.

*Denotes significance p<0.05.

** Denotes significance at p<0.01.

*** Denotes significance at p < .001.

95% confidence intervals (CI) for the regression coefficient β are reported in parenthesis

In S1 Table, the results from complete case analysis for Eqn1 and Eqn2 are shown with the interaction term between sex and age. In S2 Table, the results in complete case analysis are shown without the interaction term between sex and age. The complete case analysis showed no significant changes from the multiple imputed data.

In S3 Table the ANOVA analysis for albuminuria levels in HUNT3 and depression symptoms in HUNT3 are shown as outcomes respectively. For the ANOVA analysis, HADS-D 7 item and HADS-D 4 item were comparable and the results for HADS-D 7 item only are shown. Comparing the fit of the nested models using ANOVA (F-test) indicated that model 3 is more accurate than both model 1 and model 2 for both outcomes. Regarding results from the ANOVA for albuminuria in HUNT3, the etas confirm the results of the R2 values presented earlier. The ANOVA shows that only a small proportion of the variance is associated with the exposures. For albuminuria levels in HUNT3, 4% (Partial eta2 = 0.04) of the variance is explained by previous albuminuria values in HUNT2, whilst only 0.04% is explained by depression levels in HUNT2. For the depression symptoms in HUNT3, the ANOVA table indicates that very little of the variance is associated with albuminuria in HUNT2 (0.007%), whilst depression symptoms in HUNT3 have a moderate association with depression symptoms in HUNT2 (27%).

The sensitivity analysis regarding the imputation is shown in S3 Table For the range of δ-values chosen, there was a marginally/small increase in the estimated coefficient of albuminuria in HUNT2, including the p-values. The sensitivity analysis confirms that the analysis is robust to alternative plausible missing data assumptions, under all specified MAR mechanisms of missingness. In addition, the MI estimates are close to those from the complete case analysis.

Discussion

To our knowledge, this is the first study to examine the bidirectional relationship between depression symptoms and future albuminuria and simultaneously assess the relationship between albuminuria and future depression symptoms. In this 10-year follow-up study, there was no association between depression symptoms, measured by HADS score, and future albuminuria, nor between albuminuria and future depression symptoms.

Even though albuminuria in HUNT2 was significantly associated with HADS-D symptoms in HUNT3, the correlation coefficient of 0.07 indicates a negligible association between the two. This corresponds to albuminuria explaining only 0.007% of the variance in depression levels in HUNT3. Thus, albuminuria is probably not a useful biomarker for future depression symptoms. HADS-D in HUNT2 had no significant correlation with albuminuria in HUNT3, with a correlation coefficient of 0.04 for HADS-D7 and 0.03 for HADS-D4. With wide confidence intervals including the null, 0.04% of the variance in HUNT 3 albuminuria levels was explained by previous depression levels, making depression symptoms as measured by HADS ineffectual as a biomarker for albuminuria.

The only previous longitudinal study of future depression symptoms found a HR 1.25 (95% CI, 0.94 to 1.65) for depression with albuminuria ≥30 mg/g compared to those with albuminuria <10 mg/g [9]. Thus, the wide and inconclusive confidence intervals is concordant with our study, in that albuminuria is not a reliable biomarker of future depression. Liu et al. (2022) found that eGFR was a more robust marker for future depression, and several cross sectional studies also support eGFR as a possible marker for depression [2, 32, 33]. However, we did not aim to assess eGFR in our study. No previous studies have assessed if depression symptoms are a useful biomarker for future albuminuria, and thus we provide the first longitudinal results suggesting the failure of HADS-D symptoms to predict albuminuria.

While Liu (2022) et. als [9] findings of a longitudinal relationship between albuminuria and future depression were not significant, their point estimate suggested a possible risk for depression with albuminuria. This difference between our study and Liu et. al (2022) could be explained by the latter using Center for Epidemiologic Studies Depression Scale (CES-D), a scale that is broadly comparable and equivalent to the HADS-D scale, except that the ability to detect major depression is better with the CES-D than HADS-D [34]. Limitations of our study include the use of self-reported depression measures. One previous cross-sectional study which used the MINI-International Neuropsychiatric interview [35] found that the odds ratio for a minor or major depressive episode was 2.13 (95% CI 1.36–3.36) for albuminuria 15–<30 mg/24 h. The HADS questionnaire is a well-validated screening instrument for anhedonia and psychological distress [26], and performs well in screening the general population and is one of the most commonly used screening tools for depression in medically ill populations. The lack of structured clinical interviews, unlike for example the MINI-International Neuropsychiatric interview used by Martens et al [1] in confirming a clinical diagnosis of depression could be a limitation in our study, especially due to the absence of sleep items and any other vegetative items. The Structured Clinical Interview for DSM-5 (SCID-5) and Mini-International Neuropsychiatric interview are generally referred to as the gold standard for depression assessments, however the HADS-D is shown acceptable against this gold standard (AUC 0.83) [36]. The HADS-D scale has shown a cross-sectional association between depression and albuminuria, however the results were explained by confounding by age and sex [3]. A further limitation is that the association between somatic depressions symptoms and full diagnostic depression is not measured in this study. However, we added analyses of the shorter HADS-4 item version, due to psychometric analyses of the HADS that have shown less heterogeneous phenotype measures for HADS-4 in genetic analyses [27], but this did not change the results.

Our study design was able to detect that albuminuria levels at HUNT3 was explained by 4% of the albuminuria levels in HUNT2, and 27% of depression levels in HUNT3 were explained by depression levels in HUNT2. Thus, if albuminuria and the HADS-D symptom levels were strongly linked, our design should be able to detect that, although we acknowledge that more repeated measurements might have strengthened our design.

A strength of this study was the measurement of albuminuria in three urine samples [21, 37, 38]. Using the same urine sampling method, one previous cross-sectional study from the HUNT survey found that age and comorbidity explained the association between albuminuria and depression symptoms [3]. All these HUNT studies give greater precision in albuminuria analysis compared to results from one spot urine sample [19] as used in the cross-sectional study that found an association between albuminuria and depression in a diabetic sample by Yu et al (2013) [2, 39]. Further, our use of fresh urine samples avoided problems with frozen samples [19]. Fresh urine samples are shown as valid as 24 hours urine sampling [40] to establish albuminuria. One cross-sectional study used 24 hours of urine sampling and found an association between depression and albuminuria [1].

Conclusion

The gap in life expectancy seen between persons with and without mental health problems largely stem from physical disease [41]. It is important to detect and manage albuminuria in persons with and without depression symptoms to prevent kidney disease [42] and cardiovascular disease [43], as well as manage common risk factors for both.

In this first follow-up study to firstly assess the association between depression symptoms and future albuminuria and secondly assess the ability of albuminuria to predict depression symptoms, there was no evidence to support a bidirectional causal relationship between these two conditions. Future studies should investigate whether other depression measurements yields different results and whether eGFR is a better biomarker for future depression than albuminuria.

Supporting information

S1 File. Overview of statistical models.

(DOCX)

S1 Table. General linear regression results in complete data set.

(DOCX)

S2 Table. Analysis of Variance (ANOVA) for the covariates in HUNT2 explaining albuminuria or depression in HUNT3.

(DOCX)

S3 Table. Sensitivity analysis for the imputed data for model 3 with depression for HUNT 3 as response.

(DOCX)

Acknowledgments

The Nord-Trøndelag Health Study (the HUNT Study) is a collaboration between the HUNT Research Centre (Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, NTNU), Nord-Trøndelag County Council, Central Norway Regional Health Authority, and the Norwegian Institute of Public Health.

Data Availability

Due to confidentiality HUNT Research Centre wants to limit storage of data outside HUNT databank, and researchers need approval by the Regional Ethical Committee (rek-midt@mh.ntnu.no) for handling of HUNT data files. HUNT Research Centre has precise information on all data exported to different projects and there are no restrictions regarding data export given approval of applications to HUNT Research Centre (http://www.ntnu.edu/hunt/data). Interested readers may send e-mail to kontakt@hunt.ntnu.no for more information. We can confirm that interested readers will be able to access the data in the same manner that the authors have accessed it if they have a legitimate reason to be considered by the HUNT Research Centre and the Regional Ethical Committee.

Funding Statement

LTG is funded by the Liaison Committee for education, research, and innovation in Central Norway. The funding body had no role in the designs of the study, collection, analysis, interpretation of data, and in writing the manuscript.

References

  • 1.Martens RJH, Kooman JP, Stehouwer CDA, Dagnelie PC, van der Kallen CJH, Kroon AA, et al. Albuminuria is associated with a higher prevalence of depression in a population-based cohort study: the Maastricht Study. Nephrol Dial Transplant. 2018. Jan 1;33(1):128–138. Epub 2016/12/15. doi: 10.1093/ndt/gfw377 . [DOI] [PubMed] [Google Scholar]
  • 2.Yu MK, Katon W, Young BA. Diabetes self-care, major depression, and chronic kidney disease in an outpatient diabetic population. Nephron Clin Pract. 2013;124(1–2):106–12. Epub 2013/11/07. doi: 10.1159/000355551 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Romundstad S, Hynnekleiv T. Association between depression symptoms and moderately increased levels of the inflammation marker albuminuria is explained by age and comorbidity. Sci Rep. 2022. May 25;12(1):8828. Epub 20220525. doi: 10.1038/s41598-022-12635-1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Athyros VG, Katsiki N, Karagiannis A, Mikhailidis DP. Statins can improve proteinuria and glomerular filtration rate loss in chronic kidney disease patients, further reducing cardiovascular risk. Fact or fiction? Expert Opin Pharmacother. 2015;16(10):1449–61. Epub 2015/06/04. doi: 10.1517/14656566.2015.1053464 . [DOI] [PubMed] [Google Scholar]
  • 5.Bello AK, de Zeeuw D, El Nahas M, Brantsma AH, Bakker SJ, de Jong PE, et al. Impact of weight change on albuminuria in the general population. Nephrol Dial Transplant. 2007. Jun;22(6):1619–27. Epub 2007/03/16. doi: 10.1093/ndt/gfm091 . [DOI] [PubMed] [Google Scholar]
  • 6.Romundstad S, Hatlen G, Hallan SI. Long-term changes in albuminuria: underlying causes and future mortality risk in a 20-year prospective cohort: the Nord-Trondelag Health (HUNT) Study. J Hypertens. 2016. Oct;34(10):2081–9. Epub 2016/07/22. doi: 10.1097/HJH.0000000000001035 . [DOI] [PubMed] [Google Scholar]
  • 7.Stewart JC, Perkins AJ, Callahan CM. Effect of collaborative care for depression on risk of cardiovascular events: data from the IMPACT randomized controlled trial. Psychosom Med. 2014. Jan;76(1):29–37. Epub 2013/12/25. doi: 10.1097/PSY.0000000000000022 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Gustad LT, Laugsand LE, Janszky I, Dalen H, Bjerkeset O. Symptoms of anxiety and depression and risk of heart failure: the HUNT Study. Eur J Heart Fail. 2014. Aug;16(8):861–70. Epub 20140712. doi: 10.1002/ejhf.133 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Liu M, Zhang Y, Yang S, Wu Q, Ye Z, Zhou C, et al. Bidirectional relations between depression symptoms and chronic kidney disease. J Affect disord. 2022. Aug 15;311:224–230. Epub 20220521. doi: 10.1016/j.jad.2022.05.104 . [DOI] [PubMed] [Google Scholar]
  • 10.Bakkum L, Willemen AM, Zoetebier L, Bouts AH. A longitudinal study on the effects of psychological stress on proteinuria in childhood steroid-sensitive nephrotic syndrome. J Psychosom Res. 2019. Jun;121:8–13. Epub 2019/02/12. doi: 10.1016/j.jpsychores.2019.01.011 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Wu MT, Lam KK, Lee WC, Hsu KT, Wu CH, Cheng BC, et al. Albuminuria, proteinuria, and urinary albumin to protein ratio in chronic kidney disease. J Clin Lab Anal. 2012. Feb;26(2):82–92. doi: 10.1002/jcla.21487 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Shaw AB, Risdon P, Lewis-Jackson JD. Protein creatinine index and Albustix in assessment of proteinuria. Br Med J (Clin Res Ed). 1983. Oct 1;287(6397):929–32. Epub 1983/10/01. doi: 10.1136/bmj.287.6397.929 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Berk M, Williams LJ, Jacka FN, O’Neil A, Pasco JA, Moylan S, et al. So depression is an inflammatory disease, but where does the inflammation come from? BMC Med. 2013. Sep 12;11:200. Epub 2013/11/16. doi: 10.1186/1741-7015-11-200 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Chrysohoou C, Kollia N, Tousoulis D. The link between depression and atherosclerosis through the pathways of inflammation and endothelium dysfunction. Maturitas. 2018. Mar;109:1–5. Epub 2018/02/18. doi: 10.1016/j.maturitas.2017.12.001 . [DOI] [PubMed] [Google Scholar]
  • 15.Morris G, Puri BK, Olive L, Carvalho A, Berk M, Walder K, et al. Endothelial dysfunction in neuroprogressive disorders-causes and suggested treatments. BMC Med. 2020. Oct 19;18(1):305. Epub 2020/10/20. doi: 10.1186/s12916-020-01749-w . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Satchell S. The role of the glomerular endothelium in albumin handling. Nat Rev Nephrol. 2013. Dec;9(12):717–25. Epub 2013/10/02. doi: 10.1038/nrneph.2013.197 . [DOI] [PubMed] [Google Scholar]
  • 17.Stehouwer CD, Smulders YM. Microalbuminuria and risk for cardiovascular disease: Analysis of potential mechanisms. J Am Soc Nephrol. 2006. Aug;17(8):2106–11. Epub 2006/07/11. doi: 10.1681/ASN.2005121288 . [DOI] [PubMed] [Google Scholar]
  • 18.van Dooren FE, Schram MT, Schalkwijk CG, Stehouwer CD, Henry RM, Dagnelie PC, et al. Associations of low grade inflammation and endothelial dysfunction with depression—The Maastricht Study. Brain Behav Immun. 2016. Aug;56:390–6. Epub 2016/03/13. doi: 10.1016/j.bbi.2016.03.004 . [DOI] [PubMed] [Google Scholar]
  • 19.Hallan SI, Ovrehus MA, Romundstad S, Rifkin D, Langhammer A, Stevens PE, et al. Long-term trends in the prevalence of chronic kidney disease and the influence of cardiovascular risk factors in Norway. Kidney Int. 2016. Sep;90(3):665–73. Epub 2016/06/28. doi: 10.1016/j.kint.2016.04.012 . [DOI] [PubMed] [Google Scholar]
  • 20.Krokstad S, Langhammer A, Hveem K, Holmen TL, Midthjell K, Stene TR, et al. Cohort Profile: the HUNT Study, Norway. Int J Epidemiol. 2013. Aug;42(4):968–77. Epub 2012/08/11. doi: 10.1093/ije/dys095 . [DOI] [PubMed] [Google Scholar]
  • 21.Romundstad S, Holmen J, Hallan H, Kvenild K, Kruger O, Midthjell K. Microalbuminuria, cardiovascular disease and risk factors in a nondiabetic/nonhypertensive population. The Nord-Trondelag Health Study (HUNT, 1995–97), Norway. J Intern Med. 2002. Aug;252(2):164–72. Epub 2002/08/23. doi: 10.1046/j.1365-2796.2002.01025.x . [DOI] [PubMed] [Google Scholar]
  • 22.Gabin JM, Romundstad S, Saltvedt I, Holmen J. Moderately increased albuminuria, chronic kidney disease and incident dementia: the HUNT study. BMC Nephrol. 2019. Jul 12;20(1):261. Epub 2019/07/14. doi: 10.1186/s12882-019-1425-8 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Holmen JM K.; Krüger Ø.; Langhammer A.; Holmen T.L.; Bratberg G.H.; Vatten L.; et al. The Nord-Trøndelag Health Study 1995–97 (HUNT 2): Objectives, contents, methods and participation. Norsk Epidemiologi. 2003;13(1):19–23. doi: 10.5324/nje.v13i1.305 [DOI] [Google Scholar]
  • 24.Hallan H, Romundstad S, Kvenild K, Holmen J. Microalbuminuria in diabetic and hypertensive patients and the general population—consequences of various diagnostic criteria—the Nord-Trondelag Health Study (HUNT). Scand J Urol Nephrol. 2003;37(2):151–8. Epub 2003/05/15. doi: 10.1080/00365590310008901 . [DOI] [PubMed] [Google Scholar]
  • 25.Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983. Jun;67(6):361–70. Epub 1983/06/01. doi: 10.1111/j.1600-0447.1983.tb09716.x . [DOI] [PubMed] [Google Scholar]
  • 26.Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res. 2002. Feb;52(2):69–77. doi: 10.1016/s0022-3999(01)00296-3 . [DOI] [PubMed] [Google Scholar]
  • 27.Laurin CA, Hottenga JJ, Willemsen G, Boomsma DI, Lubke GH. Genetic analyses benefit from using less heterogeneous phenotypes: an illustration with the hospital anxiety and depression scale (HADS). Genet Epidemiol. 2015. May;39(4):317–24. Epub 20150401. doi: 10.1002/gepi.21897 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gustad LT, Laugsand LE, Janszky I, Dalen H, Bjerkeset O. Symptoms of anxiety and depression and risk of acute myocardial infarction: the HUNT 2 study. Eur Heart J. 2014. Jun 1;35(21):1394–403. Epub 2013/09/24. doi: 10.1093/eurheartj/eht387 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.McFadden D. Conditional Logit Analysis of Qualitative Choice Behaviour. In: Zarembka P, editor. Frontiers in Econometrics. Vol 1. New York: Academic Press; 1974. p. 105–142. [Google Scholar]
  • 30.van Buuren S. Flexible Imputation of Missing Data. Florida: Taylor & Francis Group; 2012. [Google Scholar]
  • 31.van Buuren S.aG-OK. Multivariate Imputation by Chained Equations in R. Journal of Statistical Software. 2011;45(3):1–67. https://www.jstatsoft.org/v45/i03/. [Google Scholar]
  • 32.Aggarwal HK, Jain D, Dabas G, Yadav RK. Prevalence of Depression, Anxiety and Insomnia in Chronic Kidney Disease Patients and their Co-Relation with the Demographic Variables. Pril (Makedon Akad Nauk Umet Odd Med Nauki). 2017. Sep 1;38(2):35–44. Epub 2017/10/11. doi: 10.1515/prilozi-2017-0020 . [DOI] [PubMed] [Google Scholar]
  • 33.Dalui A, Guha P, De A, Chakraborty S, Chakraborty I. Assessment of stress & related albuminuria in caregivers of severe mentally ill persons. Indian J Med Res. 2014. Jan;139(1):174–7. Epub 2014/03/08. . [PMC free article] [PubMed] [Google Scholar]
  • 34.Ren Y, Yang H, Browning C, Thomas S, Liu M. Performance of screening tools in detecting major depressive disorder among patients with coronary heart disease: a systematic review. Med Sci Monit. 2015. Mar 1;21:646–53. Epub 20150301. doi: 10.12659/MSM.892537 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22–33;quiz 34–57. . [PubMed] [Google Scholar]
  • 36.Wu Y, Levis B, Sun Y, He C, Krishnan A, Neupane D, et al. Accuracy of the Hospital Anxiety and Depression Scale Depression subscale (HADS-D) to screen for major depression: systematic review and individual participant data meta-analysis. BMJ. 2021. May 10;373:n972. Epub 20210510. doi: 10.1136/bmj.n972 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Romundstad S, Holmen J, Kvenild K, Hallan H, Ellekjaer H. Microalbuminuria and all-cause mortality in 2,089 apparently healthy individuals: a 4.4-year follow-up study. The Nord-Trondelag Health Study (HUNT), Norway. Am J Kidney Dis. 2003. Sep;42(3):466–73. Epub 2003/09/05. doi: 10.1016/s0272-6386(03)00742-x . [DOI] [PubMed] [Google Scholar]
  • 38.Romundstad S, Holmen J, Kvenild K, Aakervik O, Hallan H. Clinical relevance of microalbuminuria screening in self-reported non-diabetic/non-hypertensive persons identified in a large health screening—the Nord-Trondelag Health Study (HUNT), Norway. Clin Nephrol. 2003. Apr;59(4):241–51. Epub 2003/04/24. doi: 10.5414/cnp59241 . [DOI] [PubMed] [Google Scholar]
  • 39.Brown WW, Peters RM, Ohmit SE, Keane WF, Collins A, Chen SC, et al. Early detection of kidney disease in community settings: the Kidney Early Evaluation Program (KEEP). Am J Kidney Dis. 2003. Jul;42(1):22–35. Epub 2003/06/28. doi: 10.1016/s0272-6386(03)00405-0 . [DOI] [PubMed] [Google Scholar]
  • 40.Teo BW, Loh PT, Wong WK, Ho PJ, Choi KP, Toh QC, et al. Spot urine estimations are equivalent to 24-hour urine assessments of urine protein excretion for predicting clinical outcomes. Int J Nephrol. 2015;2015:156484. Epub doi: 10.1155/2015/156484 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Lawrence D, Hancock KJ, Kisely S. The gap in life expectancy from preventable physical illness in psychiatric patients in Western Australia: retrospective analysis of population based registers. BMJ. 2013. May 21;346:f2539. Epub 2013/05/23. doi: 10.1136/bmj.f2539 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Lambers Heerspink HJ, Gansevoort RT. Albuminuria Is an Appropriate Therapeutic Target in Patients with CKD: The Pro View. Clin J Am Soc Nephrol. 2015. Jun 5;10(6):1079–88. Epub 2015/04/19. doi: 10.2215/CJN.11511114 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Provenzano M, Coppolino G, Faga T, Garofalo C, Serra R, Andreucci M. Epidemiology of cardiovascular risk in chronic kidney disease patients: the real silent killer. Rev Cardiovasc Med. 2019. Dec 30;20(4):209–220. Epub 2020/01/09. doi: 10.31083/j.rcm.2019.04.548 . [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Angela Lupattelli

23 Jun 2022

PONE-D-22-08418A bidirectional association study between depressive symptoms and albuminuria – A longitudinal population-based cohort with repeated measures from the HUNT2 and HUNT3 StudyPLOS ONE

Dear Dr. Gustad,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 07 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Angela Lupattelli, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Competing Interests section:

“MB has received Grant/Research Support from the NIH, Cooperative Research Centre, Simons Autism Foundation, Cancer Council of Victoria, Stanley Medical Research Foundation, Medical Benefits Fund, National Health and Medical Research Council, Medical Research Futures Fund, Beyond Blue, Rotary Health, A2 milk company, Meat and Livestock Board, Woolworths, Avant and the Harry Windsor Foundation, has been a speaker for Astra Zeneca, Lundbeck, Merck, Pfizer, and served as a consultant to Allergan, Astra Zeneca, Bioadvantex, Bionomics, Collaborative Medicinal Development, Lundbeck Merck, Pfizer  and Servier – all unrelated to this work.”

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

4. We note that you have included the phrase “data not shown” in your manuscript. Unfortunately, this does not meet our data sharing requirements. PLOS does not permit references to inaccessible data. We require that authors provide all relevant data within the paper, Supporting Information files, or in an acceptable, public repository. Please add a citation to support this phrase or upload the data that corresponds with these findings to a stable repository (such as Figshare or Dryad) and provide and URLs, DOIs, or accession numbers that may be used to access these data. Or, if the data are not a core part of the research being presented in your study, we ask that you remove the phrase that refers to these data.

5. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an interesting paper, in which the bidirectional relation between albuminuria and depressive symptoms as measured by HADS was investigated in a longitudinal way. Unlike some cross sectional studies, no clinically relevant association was observed.

The study is well performed and the paper is well written. I have no major remarks, but given the discrepancy between studies that used different ways to assess depressive symptoms (e.g. HADS and mini International Neuropsychiatric Interviews. To which extent do these scales measure the same or different constructs? This would be relevant to know for the reader in order to interprete these discrepancies.

In the title "depressive symptoms by HADS"" might be the most appropriate term

Reviewer #2: A BIDIRECTIONAL ASSOCIATION STUDY BETWEEN DEPRESSIVE SYMPTOMS AND ALBUMINURIA – A LONGITUDINAL POPULATION-BASED COHORT WITH REPEATED MEASURES FROM THE HUNT2 AND HUNT3 STUDY

General comments

This paper presents findings on important areas such as depression, albuminuria, and CVD. The use of cohort compared to cross-sectional studies helps improve the scant knowledge available on the hypothesis generated in the study. The use of robust statistical tools is commendable.

The article will benefit from proof reading to correct a few grammar and typographical errors.

Introduction

The introductory section will benefit from clearly defining the purpose of the study. Authors begin by linking CVD to depression and albuminuria which is fine. Then this is lost and a focus is now on the bidirectional relationship between depression and albuminuria.

I do understand that the article hinges on the bidirectional relationship between albuminuria and depression and this was emphasized in paragraphs 2 and 3 of the introductory section.

In the second paragraph, authors stressed on the fact that only one study has used a cohort, then they introduced a cross-sectional cohort study in the third paragraph. They also make the point that this is the first cohort study looking at the bidirectional relationship between depression and albuminuria. I suggest, authors clarify this and/or make this important point clear as it provides a good strength for the paper.

Methods

I have no comment on this section

Results

Authors report no significant association between depression levels and albuminuria and vice versa but report a that some small percentage of the relationship is also attributable to depression and to albuminuria. This sounds confusing, can authors clarify these statements.

Table 2 should be improved by creating a heading to show what r, what is in the bracket and the p value stands for or can be explained at the foot note.

Discussion

Again, authors repeat this statement “For albuminuria, only 0.04% is explained by previous depression levels, and for depression symptoms, only 0.007% is explained by previous albuminuria levels”. Ideally, there should first be an association and then we go and look for the “weight” influence of the explanatory variables.

Comparison of studies which used proteinuria to current study which used albuminuria is a little out of place. Especially, when authors have hammered on its limitations in comparison to albuminuria and that is the more reason why they are using albuminuria. Is it possible to find more suitable articles to support their discussions?

The last sentence in paragraph 3 is incomplete. Authors should kindly resolve this since it was addressing an important point

Conclusion

In the conclusion, authors report no association between depression levels and albuminuria and vice versa. However, authors failed to provide guidance on the next action or way forward.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: David Nana Adjei

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE_D_22_08418_2022.docx

PLoS One. 2022 Sep 15;17(9):e0274271. doi: 10.1371/journal.pone.0274271.r002

Author response to Decision Letter 0


14 Aug 2022

We would like to thank the editor and the reviewers for putting in time and effort to elevate the quality of our manuscript. All editorial concerns are answered in the cover letter and applicable changes are done in manuscript. All reviewers concerns have been addressed and revisions to the manuscripts have been applied accordingly.

Point-by-point responses to editor are provided in the cover letter. Point-by-point responses to reviewers are provided below, and additionally we attach a rebuttal letter, which details where in the manuscript changes are made. We have provided a copy with track changes and a clean version of the manuscript.

6. Review Comments to the Author

Reviewer #1: This is an interesting paper, in which the bidirectional relation between albuminuria and depressive symptoms as measured by HADS was investigated in a longitudinal way. Unlike some cross sectional studies, no clinically relevant association was observed.

The study is well performed and the paper is well written. I have no major remarks, but given the discrepancy between studies that used different ways to assess depressive symptoms (e.g. HADS and mini International Neuropsychiatric Interviews. To which extent do these scales measure the same or different constructs? This would be relevant to know for the reader in order to interprete these discrepancies.

Authors response: In the discussion we now incorporate more detailed discussions about the differences between studies that might explain the conflicting results.

In the title "depressive symptoms by HADS"" might be the most appropriate term

Authors response: We changed the title according to reviewers suggestions and the new title reads;

“The bidirectional association depressive symptoms, assessed by the HADS and albuminuria – A longitudinal population-based cohort study with repeated measures from the HUNT2 and HUNT3 Study” (Title)

Reviewer #2: A BIDIRECTIONAL ASSOCIATION STUDY BETWEEN DEPRESSIVE SYMPTOMS AND ALBUMINURIA – A LONGITUDINAL POPULATION-BASED COHORT WITH REPEATED MEASURES FROM THE HUNT2 AND HUNT3 STUDY

General comments

This paper presents findings on important areas such as depression, albuminuria, and CVD. The use of cohort compared to cross-sectional studies helps improve the scant knowledge available on the hypothesis generated in the study. The use of robust statistical tools is commendable.

The article will benefit from proof reading to correct a few grammar and typographical errors.

Authors response: Careful proofreading is now performed by all co-authors and in particular professor Michael Birk that has English as a first language. We added this in the authors´ contribution:

“All authors interpreted the results and critically edited and proofread the manuscript ensuring intellectual content of critical importance to the work described. MB did the final English proofreading. All authors approved the final version of the manuscript” (authors´ contribution page 30)

Introduction

The introductory section will benefit from clearly defining the purpose of the study. Authors begin by linking CVD to depression and albuminuria which is fine. Then this is lost and a focus is now on the bidirectional relationship between depression and albuminuria.

I do understand that the article hinges on the bidirectional relationship between albuminuria and depression and this was emphasized in paragraphs 2 and 3 of the introductory section.

Authors response: We have reorganized the introductory section in order to make our aim more clear.

In the second paragraph, authors stressed on the fact that only one study has used a cohort, then they introduced a cross-sectional cohort study in the third paragraph. They also make the point that this is the first cohort study looking at the bidirectional relationship between depression and albuminuria. I suggest, authors clarify this and/or make this important point clear as it provides a good strength for the paper.

Authors response: We understand that we have not been clear about cross-sectional and longitudinal studies. We hope that the reorganization of the introduction described above is satisfactory in solving this issue as well. Since we sent in our manuscript one new longitudinal study have been published that has measured albuminuria and depression repeatedly; published in 2022 by Liu et al [1], which we have included in the manuscript. That paper used the Center for Epidemiologic Studies Depression Scale (-CES-D),and did not, like us, find a convincing longitudinal relation between albuminuria and depression. The HR (95% confidence interval) for depression with UACR ≥30 mg/g compared to those with UACR <10 mg/g was 1.25 (95% CI, 0.94 to 1.65). Our study thus confirm the uncertainty related to albuminuria being a useful biomarker for future depression and still our study is the first study to assess the usefulness to use albuminuria as a biomarker for depression.

Methods

I have no comment on this section

Results

Authors report no significant association between depression levels and albuminuria and vice versa but report a that some small percentage of the relationship is also attributable to depression and to albuminuria. This sounds confusing, can authors clarify these statements.

Authors respons; We agree that this was confusing and have now altered the statements. We hope the new statement is better understood. The paragraph now reads;

“Even though albuminuria in HUNT2 was significantly associated with HADS-depression symptoms in HUNT3, the correlation coefficient of 0.07 indicates a negligible association between the two. This corresponds to albuminuria explaining only 0.007% of the variance in depression levels in HUNT3. Thus albuminuria is probably not a useful biomarker for future depression symptoms. HADS-depression in HUNT2 had no significant correlation with albuminuria in HUNT3, with a correlation coefficient of 0.04 for HADS7 and 0.03 for HADS4. With wide confidence intervals including the null, 0.04% of the variance in HUNT 3 albuminuria levels was explained by previous depression levels, making depression symptoms as measured by HADS ineffectual as a biomarker for albuminuria..” Discussion page 24.

Authors reply;

Table 2 should be improved by creating a heading to show what r, what is in the bracket and the p value stands for or can be explained at the foot note.

Authors response: We have rearranged our table footnotes in order to put the explanations of our abbreviations more central

“Abbreviations: r =correlation coefficient, ()=(standard error of pooled estimates), p= p-value.” (Table 2)

Discussion

Again, authors repeat this statement “For albuminuria, only 0.04% is explained by previous depression levels, and for depression symptoms, only 0.007% is explained by previous albuminuria levels”. Ideally, there should first be an association and then we go and look for the “weight” influence of the explanatory variables.

Authors reply: We have rephrased this part of the discussion as stated above on page 6 in this rebuttal letter.

Comparison of studies which used proteinuria to current study which used albuminuria is a little out of place. Especially, when authors have hammered on its limitations in comparison to albuminuria and that is the more reason why they are using albuminuria. Is it possible to find more suitable articles to support their discussions?

Authors responce: Since we sent in our manuscript one new longitudinal study have been published that has measured albuminuria and depression repeatedly; published in 2022 by Liu et al [1], we have now discussed our findings against that paper instead-

The last sentence in paragraph 3 is incomplete. Authors should kindly resolve this since it was addressing an important point

Authors response: Thank you for spotting this sentence. We have removed one word that caused the unclarity of the sentence. The new sentence reads;

“One cross-sectional study used 24 hours urinary sampling in finding an association between depression and albuminuria” (Discussion page 27)

Conclusion

In the conclusion, authors report no association between depression levels and albuminuria and vice versa. However, authors failed to provide guidance on the next action or way forward.

Authors response: We have added the future way forward in the conclusion:

“Future studies should investigate whether other depression measurements yields different results and whether eGFR is a better biomarker for future depression than albuminuria.” (Conclusion, page 28)

________________________________________

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: David Nana Adjei

________________________________________

Attachment

Submitted filename: Rebuttal letter PONE_D_22_08418_2022.docx

Decision Letter 1

Angela Lupattelli

25 Aug 2022

The bidirectional association between depressive symptoms, assessed by the HADS, and albuminuria – A longitudinal population-based cohort study with repeated measures from the HUNT2 and HUNT3 Study

PONE-D-22-08418R1

Dear Dr. Gustad,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Angela Lupattelli, PhD

Academic Editor

PLOS ONE

Acceptance letter

Angela Lupattelli

1 Sep 2022

PONE-D-22-08418R1

The bidirectional association between depressive symptoms, assessed by the HADS, and albuminuria – A longitudinal population-based cohort study with repeated measures from the HUNT2 and HUNT3 Study

Dear Dr. Gustad:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Angela Lupattelli

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Overview of statistical models.

    (DOCX)

    S1 Table. General linear regression results in complete data set.

    (DOCX)

    S2 Table. Analysis of Variance (ANOVA) for the covariates in HUNT2 explaining albuminuria or depression in HUNT3.

    (DOCX)

    S3 Table. Sensitivity analysis for the imputed data for model 3 with depression for HUNT 3 as response.

    (DOCX)

    Attachment

    Submitted filename: PONE_D_22_08418_2022.docx

    Attachment

    Submitted filename: Rebuttal letter PONE_D_22_08418_2022.docx

    Data Availability Statement

    Due to confidentiality HUNT Research Centre wants to limit storage of data outside HUNT databank, and researchers need approval by the Regional Ethical Committee (rek-midt@mh.ntnu.no) for handling of HUNT data files. HUNT Research Centre has precise information on all data exported to different projects and there are no restrictions regarding data export given approval of applications to HUNT Research Centre (http://www.ntnu.edu/hunt/data). Interested readers may send e-mail to kontakt@hunt.ntnu.no for more information. We can confirm that interested readers will be able to access the data in the same manner that the authors have accessed it if they have a legitimate reason to be considered by the HUNT Research Centre and the Regional Ethical Committee.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES