Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2024 Jul 1.
Published in final edited form as: J Acad Consult Liaison Psychiatry. 2022 Oct 20;64(4):332–335. doi: 10.1016/j.jaclp.2022.10.001

Assessing the Validity of the Ask Suicide-Screening Questions (ASQ) in Black Youth

Lisa M Horowitz 1, Annabelle M Mournet 1, Arielle Sheftall 2,3, Jian-Ping He 4, Nathan J Lowry 1, Laika D Aguinaldo 5, Shayla A Sullivant 6,7, Elizabeth A Wharff 8, Kathleen R Merikangas 4, Maryland Pao 1, Jeffrey A Bridge 2,3,9
PMCID: PMC10115908  NIHMSID: NIHMS1849601  PMID: 36273745

Abstract

Purpose:

Given the increasing rates of suicide and non-fatal suicide attempts among Black youth in the United States, it is crucial that screening tools are valid in identifying Black youth at risk for suicide. This study assessed the validity of the Ask Suicide-Screening Questions (ASQ) among Black youth.

Methods:

This analysis used pooled data from three ASQ validation studies of pediatric medical patients ages 10-21 years. All participants completed the ASQ and the gold standard Suicidal Ideation Questionnaire.

Results:

Of the 1,083 participants, 330 (30.5%) were non-Hispanic Black and 753 (69.5%) were non-Hispanic White. ASQ psychometric properties for Black and White participants were equivalent (sensitivity = 94% vs. 90.9%; specificity = 91.4% vs. 91.8%, respectively).

Conclusions:

There were no significant differences in ASQ psychometric properties between Black and White youth, indicating that the ASQ is valid for screening Black youth at risk for suicide.

Keywords: adolescents, suicide, screening, validity, racial disparities

Introduction

Screening for suicide risk is a prevention strategy aimed at early detection of at-risk individuals who may benefit from prompt assessment and intervention. Screening tools, such as the 4-item Ask Suicide-Screening Questions (ASQ),1 have been developed to rapidly identify youth presenting to healthcare settings with suicide risk. Equitable performance of screening tools across racial groups is vital to ensure prevention strategies reach everyone.2 In the original ASQ development study,1 the sensitivity of the ASQ was reported to be significantly lower in Black participants compared with non-Black participants. Given the increasing rates of suicide and non-fatal suicide attempts among Black youth in the United States,3-5 it is imperative to ensure that screening tools are valid in identifying Black youth at risk for suicide. Therefore, in this study, we assessed the validity of the ASQ among Black youth.

Methods

Sample

This analysis uses data from three ASQ validation studies of pediatric medical patients ages 10-21 years conducted in emergency departments (ED),1 inpatient medical/surgical units,6 and outpatient specialty/primary care clinics7 of four U.S. children’s hospitals. Institutional Review Board approval was obtained from the National Institutes of Health and all participating study sites.

Measures

Ask Suicide-Screening Questions (ASQ):

All participants completed the ASQ, a brief 4-item tool used to identify suicide risk. The ASQ was originally developed in the pediatric ED, with a sensitivity of 96.9% and specificity of 87.6%,1 and has since been validated for use in both pediatric and adult medical inpatient medical units and outpatient primary care and specialty settings with equally strong psychometric properties.6-8 While the ASQ is intended to identify clinically significant suicidal ideation/past behavior, it has also been shown to demonstrate predictive validity for future suicide attempts.9

Suicidal Ideation Questionnaire (SIQ):

The SIQ/SIQ-JR was used as the criterion standard comparison for this analysis. The SIQ was developed using a sample of adolescents aged 14-19 and was found to have strong reliability and validity.10 The SIQ-JR was developed using a sample that was 71.4% Black youth aged 12-14 and demonstrated strong validity.11 The SIQ validation sample contained a sufficient number of White and Black youth to establish that no significant differences were found between White and Black participants; however, there was insufficient data on other racial and ethnic groups.12 Recent research has found the SIQ/SIQ-JR to be valid among various racial and ethnic groups,13,14 however, this remains a limited area of research. Therefore, this analysis was confined to a comparison of non-Hispanic Black (hereafter, Black) and non-Hispanic White (hereafter, White) youth, self-reported by participants.

Data Analysis

The percentages of positive risk by ASQ and by SIQ/SIQ-JR were compared by racial group (Black and White) and by study setting. Validity statistics included sensitivity, specificity, likelihood ratio positive (LR+), likelihood ratio negative (LR−), and area under receiver operating characteristic curves (AUC) were calculated for each racial group. Pairwise comparisons across racial groups using Chi-Square tests at 2-sided significance level (p-value) of 0.05 were completed, with no adjustment for multiple comparisons.

Results

Of the 1,083 participants included in this analysis, 330 (30.5%) were Black and 753 (69.5%) were White (Table 1). The proportion of positive screens was not significantly different across the three ASQ validation studies (Table 1); therefore, the samples were pooled across the three sites. When compared to the criterion standard SIQ/SIQ-JR in the combined samples, the ASQ had a sensitivity of 92.0% and a specificity of 91.7%. Among Black participants, the ASQ had a sensitivity of 94.1% and a specificity of 91.4%. Comparatively, among White participants, the ASQ had a sensitivity of 90.9% and a specificity of 91.8% (Table 2). No significant differences in ASQ sensitivity, LR+/−, and AUC were observed for Black and White participants (Table 2). ASQ screen positive rates were significantly higher in females than in males for both Black and White participants (see Table 1).

Table 1.

Racial/ethnic Identity and Suicide Risk Breakdown

Sample Screening Test: ASQ Criterion Standard:
SIQ/SIQ Jr
N Percent % Positive n Percent % Positive n Percent %
Total 1083 100.0 132 12.2 50 4.6
Racial/Ethnic Group
 Non-Hispanic White 753 51.8 89 11.8 33 4.4
 Non-Hispanic Black 330 22.7 43 13.0 17 5.2
χ2=0.3, p-value =.575 χ2= 0.3, p-value =.579
Sex and Racial/Ethnic Group
 Non-Hispanic Whitea
  Female 401 53.8 57 14.2 18 4.5
  Male 344 46.2 30 8.7 12 3.5
χ2=5.4, p-value =.020 χ2=0.5, p-value =.489
 Non-Hispanic Black
  Female 204 61.8 34 16.7 14 6.9
  Male 126 38.2 9 7.1 3 2.4
χ2=6.2, p-value =.012 χ2=3.2 , p-value =.073
Medical Setting
 Emergency Department 266 24.6 26 9.8 9 3.4
 Inpatient 465 42.9 58 12.5 22 4.7
 Outpatient 352 32.5 48 13.6 19 5.4
χ2=2.2, p-value =.337 χ2 =1.4, p-value =.492
a

Eliminated 8 participants with unknown sex

Table 2.

Psychometric Properties of the ASQ across racial/ethnic subgroup

Total Non-Hispanic White Non-Hispanic Black NH-White vs. NH-
Black comparison
Estimate 95% CI Estimate 95% CI Estimate 95% CI p-value
Sensitivity 0.920 0.845 0.995 0.909 0.811 1.000 0.941 0.829 1.000 0.613
Specificity 0.917 0.900 0.934 0.918 0.898 0.938 0.914 0.883 0.945 0.739
LR+ 11.051 8.639 13.462 11.094 8.129 14.059 10.911 6.769 15.053 0.944
LR− 0.087 0.005 0.169 0.099 −0.008 0.206 0.064 −0.058 0.187 0.922
AUC 0.918 0.880 0.957 0.914 0.863 0.964 0.928 0.868 0.987 0.121

Note: LR+: The likelihood ratio of a positive test result; LR−: The likelihood ratio of a negative test result; AUC: Area under receiver operating characteristic curve

Discussion

Pooling data from three ASQ validation studies revealed no significant differences in ASQ psychometric properties between Black and White youth, providing initial evidence that the ASQ is valid tool for screening Black youth at risk for suicide.

Limitations

Study limitations include: 1) both our sample and the SIQ/SIQ-JR validation study12 used a predominantly English-speaking sample, and race categories under analysis were limited to Black and White participants due to small sample sizes of other races; 2) the validation studies were cross-sectional without follow-up of participant outcome; 3) while the ASQ has been studied in youth starting at age 10, the SIQ/SIQ-JR is only validated for youth 12 and older; and 4) the number of Black (30.5%) participants was smaller compared to the White sample (69.5%). Given the increasing suicide rates among Black, American Indian/Alaska Native, Asian and Pacific Islander, and Latino populations, it is important future studies ensure the validity of suicide risk instruments across all racial and ethnic groups.

Conclusions

The Ask Suicide-Screening Questions (ASQ) psychometric properties for Black and White participants were equivalent (sensitivity = 94% vs. 90.9%; specificity = 91.4% vs. 91.8%, respectively), providing initial evidence that the ASQ is valid for screening Black youth at risk for suicide. Further research is needed to confirm the validity of the ASQ among Black youth and other racial and ethnic groups.

Acknowledgements:

This research was supported in part by the Intramural Research Program of the National Institute of Mental Health (Annual Report Number ZIAMH002922) and the National Institute of Drug Abuse (Dr. Aguinaldo, diversity supplement U01DA041089.). Dr. Sheftall was supported by institutional research funds from The Abigail Wexner Research Institute at Nationwide Children’s Hospital, NIMH grant R21 MH-116206, and an American Foundation for Suicide Prevention grant YIG-1-152-19. Dr. Bridge was supported by research grants from the National Institute of Mental Health, the Patient-Centered Outcomes Research Institute and the Centers for Disease Control and Prevention. Dr. Wharff was supported by institutional research funds from the Program for Patient Safety and Quality at Boston Children’s Hospital. The other authors received no additional funding. The authors would like to thank Patrick Ryan for his support in this study.

Footnotes

Ethical Publication: Institutional Review Board approval was obtained from the National Institutes of Health and all participating study sites.

Disclosure: Dr. Bridge is a member of the Scientific Advisory Board of Clarigent Health. The other authors have no conflicts of interest relevant to this article to disclose.

Declaration of interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  • 1.Horowitz LM, Bridge JA, Teach SJ, et al. Ask Suicide-Screening Questions (ASQ): a brief instrument for the pediatric emergency department. Arch Pediatr Adolesc Med. Dec 2012;166(12):1170–6. doi: 10.1001/archpediatrics.2012.1276 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Ramchand R, Gordon JA, Pearson JL. Trends in Suicide Rates by Race and Ethnicity in the United States. JAMA Netw Open. May 3 2021;4(5):e2111563. doi: 10.1001/jamanetworkopen.2021.11563 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Bridge JA, Asti L, Horowitz LM, et al. Suicide Trends Among Elementary School-Aged Children in the United States From 1993 to 2012. JAMA Pediatr. Jul 2015;169(7):673–7. doi: 10.1001/jamapediatrics.2015.0465 [DOI] [PubMed] [Google Scholar]
  • 4.Lindsey MA, Sheftall AH, Xiao Y, Joe S. Trends of Suicidal Behaviors Among High School Students in the United States: 1991-2017. Pediatrics. Nov 2019;144(5)doi: 10.1542/peds.2019-1187 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Sheftall AH, Vakil F, Ruch DA, Boyd RC, Lindsey MA, Bridge JA. Black Youth Suicide: Investigation of Current Trends and Precipitating Circumstances. J Am Acad Child Adolesc Psychiatry. Sep 9 2021;doi: 10.1016/j.jaac.2021.08.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Horowitz LM, Wharff EA, Mournet AM, et al. Validation and Feasibility of the ASQ Among Pediatric Medical and Surgical Inpatients. Hosp Pediatr. Sep 2020;10(9):750–757. doi: 10.1542/hpeds.2020-0087 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Aguinaldo LD, Sullivant S, Lanzillo EC, et al. Validation of the ask suicide-screening questions (ASQ) with youth in outpatient specialty and primary care clinics. Gen Hosp Psychiatry. Jan-Feb 2021;68:52–58. doi: 10.1016/j.genhosppsych.2020.11.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Horowitz LM, Snyder DJ, Boudreaux ED, et al. Validation of the Ask Suicide-Screening Questions for Adult Medical Inpatients: A Brief Tool for All Ages. Psychosomatics. Nov - Dec 2020;61(6):713–722. doi: 10.1016/j.psym.2020.04.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.DeVylder JE, Ryan TC, Cwik M, et al. Assessment of Selective and Universal Screening for Suicide Risk in a Pediatric Emergency Department. JAMA Netw Open. Oct 2 2019;2(10):e1914070. doi: 10.1001/jamanetworkopen.2019.14070 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Reynolds WM. Suicidal ideation questionnaire (SIQ). 1987. [Google Scholar]
  • 11.Reynolds WM, Mazza JJ. Assessment of Suicidal Ideation in Inner-City Children and Young Adolescents: Reliability and Validity of the Suicidal Ideation Questionnaire-JR. School Psychology Review. 1999/March/01 1999;28(1):17–30. doi: 10.1080/02796015.1999.12085945 [DOI] [Google Scholar]
  • 12.Davis JM. Suicidal Ideation Questionnaire. Journal of Psychoeducational Assessment. 1992;10(3):298–301. doi: 10.1177/073428299201000311 [DOI] [Google Scholar]
  • 13.Hill K, Van Eck K, Goklish N, Larzelere-Hinton F, Cwik M. Factor structure and validity of the SIQ-JR in a southwest American Indian tribe. Psychological Services. 2020;17(2):207–216. doi: 10.1037/ser0000298 [DOI] [PubMed] [Google Scholar]
  • 14.Jia C-X, Wang X-T, Zhao Z-T. Psychometric Properties of the Suicidal Ideation Questionnaire among Chinese High School Students. OMEGA - Journal of Death and Dying. 2014/December/01 2014;70(2):195–207. doi: 10.2190/OM.70.2.c [DOI] [PubMed] [Google Scholar]

RESOURCES