Abstract
Purpose:
Given the increasing rates of suicide and non-fatal suicide attempts among Black youth in the United States, it is crucial that screening tools are valid in identifying Black youth at risk for suicide. This study assessed the validity of the Ask Suicide-Screening Questions (ASQ) among Black youth.
Methods:
This analysis used pooled data from three ASQ validation studies of pediatric medical patients ages 10-21 years. All participants completed the ASQ and the gold standard Suicidal Ideation Questionnaire.
Results:
Of the 1,083 participants, 330 (30.5%) were non-Hispanic Black and 753 (69.5%) were non-Hispanic White. ASQ psychometric properties for Black and White participants were equivalent (sensitivity = 94% vs. 90.9%; specificity = 91.4% vs. 91.8%, respectively).
Conclusions:
There were no significant differences in ASQ psychometric properties between Black and White youth, indicating that the ASQ is valid for screening Black youth at risk for suicide.
Keywords: adolescents, suicide, screening, validity, racial disparities
Introduction
Screening for suicide risk is a prevention strategy aimed at early detection of at-risk individuals who may benefit from prompt assessment and intervention. Screening tools, such as the 4-item Ask Suicide-Screening Questions (ASQ),1 have been developed to rapidly identify youth presenting to healthcare settings with suicide risk. Equitable performance of screening tools across racial groups is vital to ensure prevention strategies reach everyone.2 In the original ASQ development study,1 the sensitivity of the ASQ was reported to be significantly lower in Black participants compared with non-Black participants. Given the increasing rates of suicide and non-fatal suicide attempts among Black youth in the United States,3-5 it is imperative to ensure that screening tools are valid in identifying Black youth at risk for suicide. Therefore, in this study, we assessed the validity of the ASQ among Black youth.
Methods
Sample
This analysis uses data from three ASQ validation studies of pediatric medical patients ages 10-21 years conducted in emergency departments (ED),1 inpatient medical/surgical units,6 and outpatient specialty/primary care clinics7 of four U.S. children’s hospitals. Institutional Review Board approval was obtained from the National Institutes of Health and all participating study sites.
Measures
Ask Suicide-Screening Questions (ASQ):
All participants completed the ASQ, a brief 4-item tool used to identify suicide risk. The ASQ was originally developed in the pediatric ED, with a sensitivity of 96.9% and specificity of 87.6%,1 and has since been validated for use in both pediatric and adult medical inpatient medical units and outpatient primary care and specialty settings with equally strong psychometric properties.6-8 While the ASQ is intended to identify clinically significant suicidal ideation/past behavior, it has also been shown to demonstrate predictive validity for future suicide attempts.9
Suicidal Ideation Questionnaire (SIQ):
The SIQ/SIQ-JR was used as the criterion standard comparison for this analysis. The SIQ was developed using a sample of adolescents aged 14-19 and was found to have strong reliability and validity.10 The SIQ-JR was developed using a sample that was 71.4% Black youth aged 12-14 and demonstrated strong validity.11 The SIQ validation sample contained a sufficient number of White and Black youth to establish that no significant differences were found between White and Black participants; however, there was insufficient data on other racial and ethnic groups.12 Recent research has found the SIQ/SIQ-JR to be valid among various racial and ethnic groups,13,14 however, this remains a limited area of research. Therefore, this analysis was confined to a comparison of non-Hispanic Black (hereafter, Black) and non-Hispanic White (hereafter, White) youth, self-reported by participants.
Data Analysis
The percentages of positive risk by ASQ and by SIQ/SIQ-JR were compared by racial group (Black and White) and by study setting. Validity statistics included sensitivity, specificity, likelihood ratio positive (LR+), likelihood ratio negative (LR−), and area under receiver operating characteristic curves (AUC) were calculated for each racial group. Pairwise comparisons across racial groups using Chi-Square tests at 2-sided significance level (p-value) of 0.05 were completed, with no adjustment for multiple comparisons.
Results
Of the 1,083 participants included in this analysis, 330 (30.5%) were Black and 753 (69.5%) were White (Table 1). The proportion of positive screens was not significantly different across the three ASQ validation studies (Table 1); therefore, the samples were pooled across the three sites. When compared to the criterion standard SIQ/SIQ-JR in the combined samples, the ASQ had a sensitivity of 92.0% and a specificity of 91.7%. Among Black participants, the ASQ had a sensitivity of 94.1% and a specificity of 91.4%. Comparatively, among White participants, the ASQ had a sensitivity of 90.9% and a specificity of 91.8% (Table 2). No significant differences in ASQ sensitivity, LR+/−, and AUC were observed for Black and White participants (Table 2). ASQ screen positive rates were significantly higher in females than in males for both Black and White participants (see Table 1).
Table 1.
Racial/ethnic Identity and Suicide Risk Breakdown
| Sample | Screening Test: ASQ | Criterion Standard: SIQ/SIQ Jr |
||||
|---|---|---|---|---|---|---|
| N | Percent % | Positive n | Percent % | Positive n | Percent % | |
| Total | 1083 | 100.0 | 132 | 12.2 | 50 | 4.6 |
| Racial/Ethnic Group | ||||||
| Non-Hispanic White | 753 | 51.8 | 89 | 11.8 | 33 | 4.4 |
| Non-Hispanic Black | 330 | 22.7 | 43 | 13.0 | 17 | 5.2 |
| χ2=0.3, p-value =.575 | χ2= 0.3, p-value =.579 | |||||
| Sex and Racial/Ethnic Group | ||||||
| Non-Hispanic Whitea | ||||||
| Female | 401 | 53.8 | 57 | 14.2 | 18 | 4.5 |
| Male | 344 | 46.2 | 30 | 8.7 | 12 | 3.5 |
| χ2=5.4, p-value =.020 | χ2=0.5, p-value =.489 | |||||
| Non-Hispanic Black | ||||||
| Female | 204 | 61.8 | 34 | 16.7 | 14 | 6.9 |
| Male | 126 | 38.2 | 9 | 7.1 | 3 | 2.4 |
| χ2=6.2, p-value =.012 | χ2=3.2 , p-value =.073 | |||||
| Medical Setting | ||||||
| Emergency Department | 266 | 24.6 | 26 | 9.8 | 9 | 3.4 |
| Inpatient | 465 | 42.9 | 58 | 12.5 | 22 | 4.7 |
| Outpatient | 352 | 32.5 | 48 | 13.6 | 19 | 5.4 |
| χ2=2.2, p-value =.337 | χ2 =1.4, p-value =.492 | |||||
Eliminated 8 participants with unknown sex
Table 2.
Psychometric Properties of the ASQ across racial/ethnic subgroup
| Total | Non-Hispanic White | Non-Hispanic Black | NH-White vs. NH- Black comparison |
|||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Estimate | 95% CI | Estimate | 95% CI | Estimate | 95% CI | p-value | ||||
| Sensitivity | 0.920 | 0.845 | 0.995 | 0.909 | 0.811 | 1.000 | 0.941 | 0.829 | 1.000 | 0.613 |
| Specificity | 0.917 | 0.900 | 0.934 | 0.918 | 0.898 | 0.938 | 0.914 | 0.883 | 0.945 | 0.739 |
| LR+ | 11.051 | 8.639 | 13.462 | 11.094 | 8.129 | 14.059 | 10.911 | 6.769 | 15.053 | 0.944 |
| LR− | 0.087 | 0.005 | 0.169 | 0.099 | −0.008 | 0.206 | 0.064 | −0.058 | 0.187 | 0.922 |
| AUC | 0.918 | 0.880 | 0.957 | 0.914 | 0.863 | 0.964 | 0.928 | 0.868 | 0.987 | 0.121 |
Note: LR+: The likelihood ratio of a positive test result; LR−: The likelihood ratio of a negative test result; AUC: Area under receiver operating characteristic curve
Discussion
Pooling data from three ASQ validation studies revealed no significant differences in ASQ psychometric properties between Black and White youth, providing initial evidence that the ASQ is valid tool for screening Black youth at risk for suicide.
Limitations
Study limitations include: 1) both our sample and the SIQ/SIQ-JR validation study12 used a predominantly English-speaking sample, and race categories under analysis were limited to Black and White participants due to small sample sizes of other races; 2) the validation studies were cross-sectional without follow-up of participant outcome; 3) while the ASQ has been studied in youth starting at age 10, the SIQ/SIQ-JR is only validated for youth 12 and older; and 4) the number of Black (30.5%) participants was smaller compared to the White sample (69.5%). Given the increasing suicide rates among Black, American Indian/Alaska Native, Asian and Pacific Islander, and Latino populations, it is important future studies ensure the validity of suicide risk instruments across all racial and ethnic groups.
Conclusions
The Ask Suicide-Screening Questions (ASQ) psychometric properties for Black and White participants were equivalent (sensitivity = 94% vs. 90.9%; specificity = 91.4% vs. 91.8%, respectively), providing initial evidence that the ASQ is valid for screening Black youth at risk for suicide. Further research is needed to confirm the validity of the ASQ among Black youth and other racial and ethnic groups.
Acknowledgements:
This research was supported in part by the Intramural Research Program of the National Institute of Mental Health (Annual Report Number ZIAMH002922) and the National Institute of Drug Abuse (Dr. Aguinaldo, diversity supplement U01DA041089.). Dr. Sheftall was supported by institutional research funds from The Abigail Wexner Research Institute at Nationwide Children’s Hospital, NIMH grant R21 MH-116206, and an American Foundation for Suicide Prevention grant YIG-1-152-19. Dr. Bridge was supported by research grants from the National Institute of Mental Health, the Patient-Centered Outcomes Research Institute and the Centers for Disease Control and Prevention. Dr. Wharff was supported by institutional research funds from the Program for Patient Safety and Quality at Boston Children’s Hospital. The other authors received no additional funding. The authors would like to thank Patrick Ryan for his support in this study.
Footnotes
Ethical Publication: Institutional Review Board approval was obtained from the National Institutes of Health and all participating study sites.
Disclosure: Dr. Bridge is a member of the Scientific Advisory Board of Clarigent Health. The other authors have no conflicts of interest relevant to this article to disclose.
Declaration of interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- 1.Horowitz LM, Bridge JA, Teach SJ, et al. Ask Suicide-Screening Questions (ASQ): a brief instrument for the pediatric emergency department. Arch Pediatr Adolesc Med. Dec 2012;166(12):1170–6. doi: 10.1001/archpediatrics.2012.1276 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Ramchand R, Gordon JA, Pearson JL. Trends in Suicide Rates by Race and Ethnicity in the United States. JAMA Netw Open. May 3 2021;4(5):e2111563. doi: 10.1001/jamanetworkopen.2021.11563 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Bridge JA, Asti L, Horowitz LM, et al. Suicide Trends Among Elementary School-Aged Children in the United States From 1993 to 2012. JAMA Pediatr. Jul 2015;169(7):673–7. doi: 10.1001/jamapediatrics.2015.0465 [DOI] [PubMed] [Google Scholar]
- 4.Lindsey MA, Sheftall AH, Xiao Y, Joe S. Trends of Suicidal Behaviors Among High School Students in the United States: 1991-2017. Pediatrics. Nov 2019;144(5)doi: 10.1542/peds.2019-1187 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Sheftall AH, Vakil F, Ruch DA, Boyd RC, Lindsey MA, Bridge JA. Black Youth Suicide: Investigation of Current Trends and Precipitating Circumstances. J Am Acad Child Adolesc Psychiatry. Sep 9 2021;doi: 10.1016/j.jaac.2021.08.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Horowitz LM, Wharff EA, Mournet AM, et al. Validation and Feasibility of the ASQ Among Pediatric Medical and Surgical Inpatients. Hosp Pediatr. Sep 2020;10(9):750–757. doi: 10.1542/hpeds.2020-0087 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Aguinaldo LD, Sullivant S, Lanzillo EC, et al. Validation of the ask suicide-screening questions (ASQ) with youth in outpatient specialty and primary care clinics. Gen Hosp Psychiatry. Jan-Feb 2021;68:52–58. doi: 10.1016/j.genhosppsych.2020.11.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Horowitz LM, Snyder DJ, Boudreaux ED, et al. Validation of the Ask Suicide-Screening Questions for Adult Medical Inpatients: A Brief Tool for All Ages. Psychosomatics. Nov - Dec 2020;61(6):713–722. doi: 10.1016/j.psym.2020.04.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.DeVylder JE, Ryan TC, Cwik M, et al. Assessment of Selective and Universal Screening for Suicide Risk in a Pediatric Emergency Department. JAMA Netw Open. Oct 2 2019;2(10):e1914070. doi: 10.1001/jamanetworkopen.2019.14070 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Reynolds WM. Suicidal ideation questionnaire (SIQ). 1987. [Google Scholar]
- 11.Reynolds WM, Mazza JJ. Assessment of Suicidal Ideation in Inner-City Children and Young Adolescents: Reliability and Validity of the Suicidal Ideation Questionnaire-JR. School Psychology Review. 1999/March/01 1999;28(1):17–30. doi: 10.1080/02796015.1999.12085945 [DOI] [Google Scholar]
- 12.Davis JM. Suicidal Ideation Questionnaire. Journal of Psychoeducational Assessment. 1992;10(3):298–301. doi: 10.1177/073428299201000311 [DOI] [Google Scholar]
- 13.Hill K, Van Eck K, Goklish N, Larzelere-Hinton F, Cwik M. Factor structure and validity of the SIQ-JR in a southwest American Indian tribe. Psychological Services. 2020;17(2):207–216. doi: 10.1037/ser0000298 [DOI] [PubMed] [Google Scholar]
- 14.Jia C-X, Wang X-T, Zhao Z-T. Psychometric Properties of the Suicidal Ideation Questionnaire among Chinese High School Students. OMEGA - Journal of Death and Dying. 2014/December/01 2014;70(2):195–207. doi: 10.2190/OM.70.2.c [DOI] [PubMed] [Google Scholar]
