First of all, we would like to express our satisfaction with the interest that our article1 has generated, particularly because it has elicited a comment from the esteemed Josef Finsterer.2 We thank Prof. Finsterer for his observations, which provide an opportunity to deepen and enrich the discussion on the results of our research.
We must begin by reiterating that our research was conducted amid the COVID-19 pandemic, during which social distancing was mandatory in Portugal. In this context, electronic data collection, a practice widely adopted by researchers worldwide, and which made possible numerous studies published in high-impact scientific journals such as this one,3 proved to be both appropriate and necessary. However, we understand the author's concern and view it as a timely invitation to reflect on methodological practices now largely accepted by the scientific community, such as digital data collection. This methodological option is supported by a robust empirical basis confirming the psychometric equivalence between electronic and paper versions of self-report instruments.4-9 It should also be noted that the present study is part of a broader longitudinal investigation which verified the temporal invariance of the instruments used, attesting to their reliability and psychometric adequacy.
Regarding the difficulty in separation between the constructs of interest, we recognize the complexity involved. However, it does not seem appropriate to disregard the solid theoretical-empirical body of evidence that supports the DASS-21 scale, designed precisely to differentiate these constructs, avoiding overlap between their subscales.10 The proposed three-factor structure has been extensively validated, demonstrating consistency across large samples,11 cross-cultural invariance,12 and validity in clinical and non-clinical populations.13,14 In addition, we sought to go beyond the traditional variable-centric approach by integrating a person-centered perspective through Latent Profiling. This approach allowed us to identify how the different constructs interact with each other in the various groups we analyzed. It is possible that this strategy was not explicit enough in the article, which may have limited the perception of its scope. Ultimately, the potential overlap observed between constructs may be interpreted as an expression of transdiagnostic processes, which consist of mechanisms common to multiple forms of psychological distress,14 given the relatively similar symptomatology often observed among the psychopathologies.
Regarding the heterogeneity of the groups we studied, we acknowledge the internal diversity both among participants with a history of psychiatric illness and among immigrants. However, the aim of our study was not to explore the specificities of each subgroup but rather to analyze, from an intersectional perspective, how social axes of differentiation, such as immigration, minority membership, and psychiatric diagnosis, influence mental health. This approach aims to understand broader structural dynamics without dwelling on the particular identity elements of each group.
Concerning stress, it is essential to emphasize that this construct was measured using a widely validated and internationally recognized instrument (DASS-21), which defines its operationalization in a clear, replicable manner. Although we realize that stress can have multiple manifestations and origins, the approach we adopted was consistent with the defined psychometric parameters.
We acknowledged from the outset that the unequal gender distribution was a limitation of the study. However, we conducted statistical adjustment for the impact of this variable on our analyses and the results indicated that, although gender influences some dimensions, it does not compromise the robustness of the identified patterns.
Furthermore, aware of the limitations of the cross-sectional design and the correlational nature of our analyses, throughout the article we avoided definitive conclusions and instead limited ourselves to describing the observed empirical patterns and discussing their possible theoretical and practical implications.
Finally, we consider analyzing more homogeneous groups a valid suggestion which may be explored in future research. However, we reiterate that the heterogeneity of the groups we analyzed precisely reflects the complexity of the social reality that we sought to understand through an intersectional approach.
Once again, we thank Prof. Finsterer, who, as a commentator, has contributed expressively to enriching the scientific debate. We hope this dialogue will enrich the scientific debate and contribute to advancing knowledge in mental health.
Disclosure
The authors declare no conflicts of interest.
Footnotes
How to cite this article: Fernandes CJ, Neto F, Costa P. Clarifications and perspectives on mental health assessment during the COVID-19 pandemic. Braz J Psychiatry. 2025;47:e20254296. http://doi.org/10.47626/1516-4446-2025-4296
Handling Editor: Rodolfo Damiano
References
- 1.Fernandes CJ, Neto F, Costa P. Identifying disparities in mental illness and well-being across no-risk, risk, and intersectional groups during the Covid-19 pandemic and the role of sociodemographics in mental health outcomes. Braz J Psychiatry. 2024;46:e20233532. doi: 10.47626/1516-4446-2023-3532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Finsterer J. Depression, anxiety, stress, and well-being in fringe groups. Braz J Psychiatry. 2024;46:e20243784. doi: 10.47626/1516-4446-2024-3784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Heyne L. Assessing survey mode effects in the 2019 EP elections: A comparison of online and face-to-face-survey data from six European countries. Res Politics. 2023;10 [Google Scholar]
- 4.Calleja N, Mosco JBC, Medina JHR, Colín ES. Psychometric equivalence of printed and electronic administration of three psychosocial scales. Rev Arg Cs Comp. 2020;12:50. [Google Scholar]
- 5.Shea TL, Tennant A, Pallant JF. Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS) BMC Psychiatry. 2009;9:21. doi: 10.1186/1471-244X-9-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Alfonsson S, Maathz P, Hursti T. Interformat reliability of digital psychiatric self-report questionnaires: a systematic review. J Med Internet Res. 2014;16:e268. doi: 10.2196/jmir.3395. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Campbell N, Ali F, Finlay AY, Salek SS. Equivalence of electronic and paper-based patient-reported outcome measures. Qual Life Res. 2015;24:1949–61. doi: 10.1007/s11136-015-0937-3. [DOI] [PubMed] [Google Scholar]
- 8.Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review. Value Health. 2008;11:322–33. doi: 10.1111/j.1524-4733.2007.00231.x. [DOI] [PubMed] [Google Scholar]
- 9.Muehlhausen W, Doll H, Quadri N, Fordham B, O'Donohoe P, Dogar N, et al. Equivalence of electronic and paper administration of patient-reported outcome measures: a systematic review and meta-analysis of studies conducted between 2007 and 2013. Health Qual Life Outcomes. 2015;13:167. doi: 10.1186/s12955-015-0362-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther. 1995;33:335–43. doi: 10.1016/0005-7967(94)00075-u. [DOI] [PubMed] [Google Scholar]
- 11.Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br J Clin Psychol. 2005;44:227–39. doi: 10.1348/014466505X29657. [DOI] [PubMed] [Google Scholar]
- 12.Scholten S, Velten J, Bieda A, Zhang XC, Margraf J. Testing measurement invariance of the Depression, Anxiety, and Stress Scales (DASS-21) across four countries. Psychol Assess. 2017;29:1376–90. doi: 10.1037/pas0000440. [DOI] [PubMed] [Google Scholar]
- 13.Bottesi G, Ghisi M, Altoè G, Conforti E, Melli G, Sica C. The Italian version of the Depression Anxiety Stress Scales-21: factor structure and psychometric properties on community and clinical samples. Compr Psychiatry. 2015;60:170–81. doi: 10.1016/j.comppsych.2015.04.005. [DOI] [PubMed] [Google Scholar]
- 14.Mansueto G, Carrozzino D, Christensen KS, Patierno C, Cosci F. Clinimetric properties of the 21-item Depression, Anxiety and Stress Scales (DASS-21) Mediterr J Clin Psychol. 2023;11 [Google Scholar]
