Abstract
Using daily vital statistics data from the Japanese Ministry of Health, Labour and Welfare, we provide the first weekly and age-group-specific estimates of the additional suicide burden during the COVID-19 pandemic in Japan by gender, from January through November 2020. Our results indicate that compared with the previous five years, suicide cases in 2020 in Japan have increased from late July to November for women in all age groups and for men in the 20–29 and 80+ years age group. Targeted interventions based on age and gender might be more effective in reducing suicide during the COVID-19 pandemic in Japan.
Keywords: Japan, COVID-19, Suicide
Many studies have raised concerns that the 2019 novel coronavirus disease (COVID‑19) has exacerbated multiple factors that may increase suicides, such as isolation, fear, marginalization, psychological disorders, economic fallout, and domestic abuse and intimate partner violence (Banerjee et al., 2021; Gunnell et al., 2020; Kawohl and Nordt, 2020; Reger et al., 2020). Suicide mortality varies considerably by age and gender in Japan, with much higher rates in men and older age groups (Dhungel et al., 2019), and it is important to understand how these patterns are affected by lockdowns and pandemic restrictions. According to a previous study using published monthly data on the number of suicides in Japan (Nomura et al., 2021), in 2020, excess suicide deaths were observed among women from July onward, especially in October, with an estimated increase of 72–84% compared to previous years. For men, the excess number of suicide deaths was also observed in October, with an estimated increase of 10–22% compared to previous years. This report provides more detailed estimates of the additional suicide burden during the COVID-19 pandemic in Japan by gender, using for the first time daily, individual-level vital statistics data from the Ministry of Health, Labour and Welfare of Japan (MHLW) from January through November 2020. This data allowed for estimates on a weekly basis and by 10-year age group, which can better inform and tailor suicide prevention measures.
Methods
In this study, we obtained daily data on the number of suicide deaths from the MHLW. Data from 2012 (including the last few days of 2011 for weekly analysis purposes) through November 2020 were considered in this analysis. The target population covered by vital statistics is all persons who have resident cards and died in Japan, regardless of nationality.
To estimate the expected weekly number of deaths from suicide, a quasi-Poisson regression model was used. We employed the Farrington algorithm for the estimation of parameters in the regression (Farrington et al., 1996; Noufaily et al., 2013). The Farrington algorithm is designed to limit the data for the estimation, as detailed in the supplementary material and elsewhere (Bedubourg and Le Strat, 2017; Noufaily et al., 2013): in the present study, the expected number of suicide deaths for each week was estimated using the data from the three weeks before and after the same week for the previous five years. This is the same parameter selection that was applied in the original paper that developed this algorithm (Farrington et al., 1996; Noufaily et al., 2013). This means that, for example, data from 2015 to 2019 was used to estimate the expected number of deaths in 2020.
The regression estimation was stratified by gender and age group (0–19, 20–29, 30–39, 40–49, 50–59, 60–69, 70–79, and 80+ years). These age groups were determined by considering the number of persons sufficient for analysis. The conversion from daily data to weekly data is based on the categorization used by the National Institute of Infectious Diseases' Infectious Diseases Weekly Report (National Institute of Infectious Diseases 2021).
The point estimate and upper bound of the two-sided 95% prediction interval were set as the threshold for excess deaths, and the point estimate and lower bound as the threshold for exiguous deaths—the number of deaths that is greater/lesser than would be expected under normal circumstances (e.g. in the absence of the pandemic). A range for excess and exiguous deaths was then obtained from the differences between the observed deaths and each of these thresholds. As a measure of the magnitude of the suicide burden of the COVID-19 pandemic, we calculated the percent excess and deficit as the number of excess and exiguous deaths divided by the threshold, respectively.
Since weekly excess and exiguous suicide deaths could occur in the past due to a variety of factors (including psychological, environmental, societal, and interpersonal), this study also reports excess and exiguous suicide deaths in the same period in 2017–2019 in order to compare the magnitude of excess and exiguous deaths during the COVID-19 pandemic with the past.
Results
For women, from January through November 2020, 6251 suicides were observed in Japan, of which 15.93% were in the age group 70–79 years, followed by 15.50% and 15.20% in the age groups 40–49 and 50–59 years, respectively. The first significant excess deaths in 2020 were observed from late July to early August, and although not every week, excess suicide deaths were observed most weeks through November, with the exception of the 0–19 and 80+ age groups (Fig. 1 ). In the 0–19 and 80+ age groups, excess suicide deaths were also observed in some weeks, albeit sporadically, from August and October, respectively. The largest total number of excess suicide deaths during the period was observed in the 40–49 age group (excess deaths 92–223), with the peak in the week of September 28 to October 4 (excess deaths 35–42, percent excess 205.88–247.06). Exiguous suicide deaths in 2020 were not observed in any age group for most weeks during the study period, while a few exiguous suicide deaths were observed in the age groups 40–49, 50–59, and 80+ years in April and May. Exact values of the weekly number of observed suicide deaths and weekly number of excess and exiguous suicide deaths are provided in the supplementary tables 1 and 2, respectively. The total number of excess and exiguous suicide deaths from January through November in 2020, as well as in 2017–2019 are provided in the supplementary tables 3, which shows that the total number of suicide deaths in 2020 was higher than in the past for all age groups.
For men, 12581 suicides were observed in Japan between January and November 2020, of which 17.37% were in the age group 40–49 years, followed by 16.79% and 13.65% in the age groups 50–59 and 70–79 years, respectively. Excess suicide deaths in the 20–29 and 80+ age group began to be observed since around the end of July, and the trend continued until the beginning of November, although not every week. The largest total number of excess suicide deaths during the period was observed in the 20–29 age group (excess deaths 72–274), with the peak at the week of September 28 to October 4 (excess deaths 24–32, percent excess 88.89–118.52). In the age groups 20–29, 30–39, 40–49, 50–59, and 60–69 years, exiguous suicide deaths were observed for some weeks during April and May (Fig. 2 ).
Discussion
While all previous analyses of suicide under the COVID-19 pandemic in Japan have been based on monthly data from the National Police Agency (Nomura et al., 2021; Sakamoto et al., 2021; Tanaka and Okamoto, 2021; Ueda et al., 2021), we have for the first time used daily, individual-level vital statistics data from the MHLW. With the increased number of observations this data provides, we were able to evaluate suicide trends on a weekly basis with finer stratification (by gender and 10-year age group), allowing for a more targeted and policy-oriented analysis. We especially highlight the increase in women of all age groups and men in the 20–29 and 80+ age group. The fact that suicides increased in women around July 2020 and in men at a similar time in the younger generation is consistent with other previous studies conducted in Japan (Nomura et al., 2021; Sakamoto et al., 2021; Tanaka and Okamoto, 2021; Ueda et al., 2021). This study is the first to suggest the possibility of a similar increase in the 80+ age group among men.
Our findings are also consistent with previous observations that the burden of mental health and suicidal ideation among young people and women was disproportionate during the COVID-19 pandemic (Knolle et al., 2021; Mansfield et al., 2021). Moreover, it is consistent with evidence that a short-term decline in suicide rates can occur first during times of crisis (Wasserman et al., 2020; Zortea et al., 2020). Although suicide mortality in Japan has historically been much higher among men than women and among older people than among younger people (Dhungel et al., 2019), our findings may suggest that women and younger people were particularly vulnerable to the economic downturn following social distancing measures introduced to curb the pandemic (Sakamoto et al., 2021). Young people and women are likely to be employed in lower-paid temporary jobs with unstable, precarious contracts who have been greatly affected by the pandemic, as well as in the service sector, particularly in retail, leisure and hospitality, recreation, and transportation services, which tends to be subject to social measures such as business self-restraint and shorter working hours. In fact, as of March 2021, the number of temporary workers has decreased by 27% for men compared to March 2020, while for women it has decreased by 68% (Ministry of Internal Affairs and Communications, 2021). Several previous studies have shown an association between unemployment and rising suicide rates in Japan (Liu et al., 2013), raising concerns that financial hardship as a result of the pandemic has been associated with increased suicide rates (Brown and Seals, 2019; Kawohl and Nordt, 2020).
Furthermore, violence against women may be one of the reasons for the gender difference in the COVID-19 related suicide burden in Japan. Anecdotal evidence from several countries indicates that restrictions on movement for COVID-19 control have led to an increase in family problems and domestic violence (Usher et al., 2020), which could lead to suicidal thoughts and attempts among women (Ellsberg et al., 2008). Violence against women increased substantially with the COVID-19 pandemic, and the need for emergency shelter and protection services for women has been emphasized by the United Nations Development Programme (United Nations Development Programme, 2020). In Japan, it has been reported that after the first declaration of the state of emergency in April 2020, consultations on domestic violence with national and local governments increased by 60% (Tokyo Shimbun, 2020). Also, women have historically and universally played a more caregiving role than men and globally, nearly 70% of the health and social care workforce is women (World Health Organization, 2019). Even under COVID-19, women provide most of the unpaid caregiving, including home health care (World Health Organization, 2020). The additional, disproportionate care burden for women as well as fear associated with COVID-19 also affects their livelihoods, disrupts social and protective networks, and increases stress in the household (Buller et al., 2018), imposing a greater risk for poor mental health. The results of our study confirm the possible need for efforts to protect women from gender-based violence and mental health stressors.
As these previous studies have emphasized (Nomura et al., 2021; Sakamoto et al., 2021; Tanaka and Okamoto, 2021; Ueda et al., 2021), we stressed the importance of coping with the increasing number of COVID-19 related suicides in Japan. Studies have suggested that the impact of unemployment and economic crises on suicide ideation can be mitigated through policy responses and government spending (Stuckler et al., 2009). Measures to mitigate adverse economic impact of COVID-19 include direct income support and tax concessions (Deady et al., 2020). Social support has been identified as a buffering and protective factor for suicidal ideation (Kubota et al., 2020). In May 2020, the Cabinet Secretariat established a 24-hour consultation service for domestic violence as part of its response to COVID-19. In February 2021, the Japanese government also created an office for the issue of loneliness and isolation within the Cabinet Secretariat to address the issue of suicide in relation to COVID-19 in a cross-ministry manner (The Mainichi, 2021). The findings from our study support their importance and warrant the need for further efforts to protect women and younger people from suicidal ideation and behavior. A recent systematic review suggested that self-guided digital interventions, through web-based programs or mobile applications, are effective in reducing suicidal ideation (Torok et al., 2020). Digital interventions need to be promoted widely, especially where there is a lack of or insufficient access to mental health services, and where there is prolonged social isolation.
Meanwhile, in contrast to Japan, other countries reported a different pattern of suicide, with numbers remaining largely unchanged during the COVID–19 pandemic (Pirkis et al., 2021). To our knowledge, the causes are uncertain, but financial hardship, gender-based violence, as well as a Werther effect after celebrity suicide reporting that occurred during the pandemic (although not yet rigorously assessed) may have played a part. However, it is important to note that any changes in suicide risk associated with COVID-19 are likely dynamic (Appleby, 2021; John et al., 2020). In addition, beneath the overall suicide numbers, there may be differences among sociodemographic groups in suicide trends. For example, among males we found a particular increase in suicide among younger age groups. In addition, a possible increase in suicide deaths among under-18s in the United Kingdom was reported during the first two months of lockdown. Recent studies from the United States revealed ethnic differences in suicide rates, with an increase in the black population and a decrease in the white population (Bray et al., 2021; Mitchell and Li, 2021). In the future, the research agenda for the suicide issue may not be whether the suicide rate increased with the pandemic, but rather the nuances of who committed suicide, when, and where (Appleby, 2021).
One of the limitations of our analysis was that there was no occupational level data available for inclusion in the estimation model, so we could not analyze it. Identifying which occupations are at high risk of suicide under the COVID-19 pandemic could allow for more important policy lessons. It is also important to note that this study estimated the expected number of suicide deaths, not the expected suicide rate. However, Japan's population is changing slowly, and this temporal trend was reflected to some extent in the regression models by considering the temporal trend of the weekly number of suicides for the previous five years. The population size was unlikely to change so rapidly on a weekly basis over the period of the study that it could not be considered as a temporal variation in the model.
Conclusions
This study found that compared with previous years, suicide rates in 2020 in Japan had increased since late July for women in all age groups and for men in the 20–29 and 80+ years age group. Targeted interventions and strategies based on age and gender, which address financial hardship and promote social support, may be more effective in reducing suicide during the COVID-19 pandemic in Japan.
Ethics statement
Ethical approval was granted by the ethics committee of the National Institute of Infectious Diseases, under authorization number 1174.
Funding source
The present work was supported in part by a grant from the Ministry of Health, Labour and Welfare of Japan, and the Ministry of Education, Culture, Sports, Science and Technology of Japan.
CRediT authorship contribution statement
Akifumi Eguchi: Conceptualization, Methodology, Software, Validation, Formal analysis, Investigation, Resources, Data curation, Writing – original draft, Writing – review & editing, Visualization. Shuhei Nomura: Conceptualization, Methodology, Software, Validation, Formal analysis, Investigation, Resources, Data curation, Writing – original draft, Writing – review & editing, Visualization, Supervision, Project administration. Stuart Gilmour: Conceptualization, Writing – original draft, Writing – review & editing, Supervision. Nahoko Harada: Conceptualization, Writing – original draft, Writing – review & editing. Haruka Sakamoto: Conceptualization, Writing – original draft, Writing – review & editing. Peter Ueda: Conceptualization, Writing – original draft, Writing – review & editing. Daisuke Yoneoka: Conceptualization, Methodology, Validation, Writing – original draft, Writing – review & editing. Yuta Tanoue: Conceptualization, Methodology, Validation, Writing – original draft, Writing – review & editing. Takayuki Kawashima: Conceptualization, Methodology, Validation, Writing – original draft, Writing – review & editing. Takehiko I. Hayashi: Conceptualization, Methodology, Validation, Writing – original draft, Writing – review & editing. Yuzo Arima: Conceptualization, Methodology, Validation, Writing – original draft, Writing – review & editing. Motoi Suzuki: Methodology, Software, Validation, Writing – review & editing, Supervision, Project administration, Funding acquisition. Masahiro Hashizume: Methodology, Software, Validation, Writing – review & editing, Supervision, Project administration, Funding acquisition.
Declaration of Competing Interest
None.
Acknowledgments
We appreciate the administrative support provided by Dr Takuri Takahashi.
Footnotes
Supplementary material associated with this article can be found, in the online version, at doi:10.1016/j.psychres.2021.114173.
Appendix. Supplementary materials
References
- Appleby L. What has been the effect of covid-19 on suicide rates? BMJ. 2021;372:n834. doi: 10.1136/bmj.n834. [DOI] [PubMed] [Google Scholar]
- Banerjee D., Kosagisharaf J.R., Sathyanarayana Rao T.S. The dual pandemic' of suicide and COVID-19: a biopsychosocial narrative of risks and prevention. Psychiatry Res. 2021;295 doi: 10.1016/j.psychres.2020.113577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bedubourg G., Le Strat Y. Evaluation and comparison of statistical methods for early temporal detection of outbreaks: A simulation-based study. PLoS One. 2017;12(7) doi: 10.1371/journal.pone.0181227. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bray M.J.C., Daneshvari N.O., Radhakrishnan I., Cubbage J., Eagle M., Southall P., et al. Racial differences in statewide suicide mortality trends in Maryland during the coronavirus disease 2019 (COVID-19) pandemic. JAMA Psychiatry. 2021;78(4):444–447. doi: 10.1001/jamapsychiatry.2020.3938. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown S., Seals J. Intimate partner problems and suicide: are we missing the violence? J. Inj Violence Res. 2019;11(1):53–64. doi: 10.5249/jivr.v11i1.997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buller A.M., Peterman A., Ranganathan M., Bleile A., Hidrobo M., Heise L. A mixed-method review of cash transfers and intimate partner violence inlLow- and middle-income countries. World Bank Res. Observ. 2018;33(2):218–258. [Google Scholar]
- Deady M., Tan L., Kugenthiran N., Collins D., Christensen H., Harvey S.B. Unemployment, suicide and COVID-19: using the evidence to plan for prevention. Med. J. Aust. 2020;213(4):153–154. doi: 10.5694/mja2.50715. e151. [DOI] [PubMed] [Google Scholar]
- Dhungel B., Sugai M.K., Gilmour S. Trends in suicide mortality by method from 1979 to 2016 in Japan. Int. J. Environ. Res. Public Health. 2019;16(10):1794. doi: 10.3390/ijerph16101794. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ellsberg M., Jansen H.A., Heise L., Watts C.H., Garcia-Moreno C., Health W.H.O.M.-c.S.o.W.s., et al. Intimate partner violence and women's physical and mental health in the WHO multi-country study on women's health and domestic violence: an observational study. Lancet. 2008;371(9619):1165–1172. doi: 10.1016/S0140-6736(08)60522-X. [DOI] [PubMed] [Google Scholar]
- Farrington C.P., Andrews N.J., Beale A.D., Catchpole M.A. A statistical algorithm for the early detection of outbreaks of infectious disease. J. R. Stat. Soc. Ser. A (Stat. Soc.) 1996;159(3):547–563. [Google Scholar]
- Gunnell D., Appleby L., Arensman E., Hawton K., John A., Kapur N., et al. Suicide risk and prevention during the COVID-19 pandemic. Lancet Psychiatry. 2020;7(6):468–471. doi: 10.1016/S2215-0366(20)30171-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- John A., Pirkis J., Gunnell D., Appleby L., Morrissey J. Trends in suicide during the covid-19 pandemic. BMJ. 2020;371:m4352. doi: 10.1136/bmj.m4352. [DOI] [PubMed] [Google Scholar]
- Kawohl W., Nordt C. COVID-19, unemployment, and suicide. Lancet Psychiatry. 2020;7(5):389–390. doi: 10.1016/S2215-0366(20)30141-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knolle F., Ronan L., Murray G.K. The impact of the COVID-19 pandemic on mental health in the general population: a comparison between Germany and the UK. BMC Psychol. 2021;9(1):60. doi: 10.1186/s40359-021-00565-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kubota C., Inada T., Shiino T., Ando M., Sato M., Nakamura Y., et al. The risk factors predicting suicidal ideation among perinatal women in Japan. Front. Psychiatry. 2020;11:441. doi: 10.3389/fpsyt.2020.00441. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu Y., Zhang Y., Cho Y.T., Obayashi Y., Arai A., Tamashiro H. Gender differences of suicide in Japan, 1947-2010. J. Affect. Disord. 2013;151(1):325–330. doi: 10.1016/j.jad.2013.05.100. [DOI] [PubMed] [Google Scholar]
- Mansfield K.E., Mathur R., Tazare J., Henderson A.D., Mulick A.R., Carreira H., et al. Indirect acute effects of the COVID-19 pandemic on physical and mental health in the UK: a population-based study. Lancet Digit Health. 2021;3(4):e217–e230. doi: 10.1016/S2589-7500(21)00017-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ministry of Internal Affairs and Communications. abor force survey results for March 2021 (basic statistics) [Japanese]. 2021. https://www.stat.go.jp/data/roudou/sokuhou/tsuki/index.html (accessed May 10 2021).
- Mitchell T.O., Li L. State-level data on suicide mortality during COVID-19 quarantine: early evidence of a disproportionate impact on racial minorities. Psychiatry Res. 2021;295 doi: 10.1016/j.psychres.2020.113629. [DOI] [PubMed] [Google Scholar]
- National Institute of Infectious Diseases. Report week correspondence table [Japanese]. https://www.niid.go.jp/niid/ja/calendar.html (accessed May 10 2021).
- Nomura S., Kawashima T., Harada N., Yoneoka D., Tanoue Y., Eguchi A., et al. Trends in suicide in Japan by gender during the COVID-19 pandemic, through December 2020. Psychiatry Res. 2021;300 doi: 10.1016/j.psychres.2021.113913. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Noufaily A., Enki D.G., Farrington P., Garthwaite P., Andrews N., Charlett A. An improved algorithm for outbreak detection in multiple surveillance systems. Stat. Med. 2013;32(7):1206–1222. doi: 10.1002/sim.5595. [DOI] [PubMed] [Google Scholar]
- Pirkis J., John A., Shin S., DelPozo-Banos M., Arya V., Analuisa-Aguilar P., et al. Suicide trends in the early months of the COVID-19 pandemic: an interrupted time-series analysis of preliminary data from 21 countries. Lancet Psychiatry. 2021;8(7):579–588. doi: 10.1016/S2215-0366(21)00091-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reger M.A., Stanley I.H., Joiner T.E. Suicide mortality and coronavirus disease 2019-a perfect storm? JAMA Psychiatry. 2020 doi: 10.1001/jamapsychiatry.2020.1060. [DOI] [PubMed] [Google Scholar]
- Sakamoto H., Ishikane M., Ghaznavi C., Ueda P. Assessment of suicide in Japan during the COVID-19 pandemic vs previous years. JAMA Netw. Open. 2021;4(2) doi: 10.1001/jamanetworkopen.2020.37378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stuckler D., Basu S., Suhrcke M., Coutts A., McKee M. The public health effect of economic crises and alternative policy responses in Europe: an empirical analysis. Lancet. 2009;374(9686):315–323. doi: 10.1016/S0140-6736(09)61124-7. [DOI] [PubMed] [Google Scholar]
- Tanaka T., Okamoto S. Increase in suicide following an initial decline during the COVID-19 pandemic in Japan. Nat. Hum. Behav. 2021;5(2):229–238. doi: 10.1038/s41562-020-01042-z. [DOI] [PubMed] [Google Scholar]
- The Mainichi. Japan's 'minister of loneliness' in global spotlight as media seek interviews. 2021. https://mainichi.jp/english/articles/20210514/p2a/00m/0na/051000c (accessed July 6, 2021).
- Tokyo Shimbun. The number of domestic violence consultations increased 1.6 times due to COVID-19 [Japanese]. 2020. https://www.tokyo-np.co.jp/article/60602 (accessed July 5, 2021).
- Torok M., Han J., Baker S., Werner-Seidler A., Wong I., Larsen M.E., et al. Suicide prevention using self-guided digital interventions: a systematic review and meta-analysis of randomised controlled trials. Lancet Digit Health. 2020;2(1):e25–e36. doi: 10.1016/S2589-7500(19)30199-2. [DOI] [PubMed] [Google Scholar]
- Ueda M., Nordstrom R., Matsubayashi T. Suicide and mental health during the COVID-19 pandemic in Japan. J. Public Health. 2021 doi: 10.1093/pubmed/fdab113. (Oxf) [DOI] [PMC free article] [PubMed] [Google Scholar]
- United Nations Development Programme. Gender-based violence and COVID-19. 2020. https://www.undp.org/content/dam/undp/library/km-qap/undp-gender-GBV_and_COVID-19.pdf (accessed July 5, 2021).
- Usher K., Bhullar N., Durkin J., Gyamfi N., Jackson D. Family violence and COVID-19: Increased vulnerability and reduced options for support. Int. J. Ment. Health Nurs. 2020;29(4):549–552. doi: 10.1111/inm.12735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wasserman D., Iosue M., Wuestefeld A., Carli V. Adaptation of evidence-based suicide prevention strategies during and after the COVID-19 pandemic. World Psychiatry. 2020;19(3):294–306. doi: 10.1002/wps.20801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- World Health Organization . World Health Organization; Geneva: 2019. Delivered by Women, Led by Men: A Gender and Equity Analysis of the Global Health and Social Workforce. [Google Scholar]
- World Health Organization . World Health Organization; Geneva: 2020. Gender and COVID-19. [Google Scholar]
- Zortea T.C., Brenna C.T.A., Joyce M., McClelland H., Tippett M., Tran M.M., et al. The impact of infectious disease-related public health emergencies on suicide, suicidal behavior, and suicidal thoughts. Crisis. 2020:1–14. doi: 10.1027/0227-5910/a000753. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.