Abstract
A survey of primary care clinicians suggests that a clinical decision support tool to support sexual risk assessment and prescribing of HIV pre-exposure prophylaxis was appropriate and useful for identifying at-risk patients, but uptake was hindered by workflow and usability barriers, which underscores the importance of postimplementation clinician feedback to improve the use of clinical decision support tools.
Introduction
Inadequate sexual history screening in US primary care limits identification of candidates for HIV pre-exposure prophylaxis (PrEP) and exacerbates inequities in PrEP uptake [1,2]. Many electronic health record (EHR) systems lack standardized prompts for documenting sexual risk, which contributes to missed opportunities for sexual health discussions and HIV prevention. This documentation gap is compounded by limited provider knowledge of PrEP and the absence of validated tools to guide prescribing decisions [3,4].
EHR-based clinical decision support (CDS) tools may address these gaps by facilitating sexual risk assessment and supporting PrEP prescribing [5]. Prior studies suggest that CDS tools are acceptable and feasible [6,7] and may improve PrEP prescribing [5]. Nevertheless, clinician experiences using CDS tools for sexual risk assessment and PrEP prescribing in primary care remain poorly understood. Clinician feedback about such CDS tools may inform efforts to optimize use of these tools. Therefore, we aimed to describe primary care clinicians’ experiences using CDS tools implemented in urban community health clinics to support sexual risk assessment and PrEP prescribing.
Methods
Study Design
We followed the Checklist for Reporting of Survey Studies (CROSS) guidelines to structure this report. We surveyed primary care clinicians from 12 community health clinics at John Peter Smith Health Network (JPS), a publicly funded urban health system that serves as the health care safety net for Tarrant County, Texas. JPS implemented an EHR-based CDS tool comprising a sexual history questionnaire, a PrEP SmartSet, and a noninterruptive advisory alert (Multimedia Appendix 1). When clinicians complete the sexual history questionnaire during an outpatient visit, a noninterruptive PrEP advisory alert is triggered if documented responses indicate behavioral or sexual risk factors consistent with US Centers for Disease Control and Prevention PrEP eligibility criteria.
Survey Administration and Data Collection
We conducted a cross-sectional survey using a 12-item questionnaire to assess clinician awareness, use, perceptions, and perceived barriers and facilitators to the implementation of the CDS tool. Eligible participants included attending physicians, residents, nurse practitioners, physician assistants, and clinical pharmacists providing primary care at one of 12 JPS community health clinics. Survey items were adapted from prior CDS research and informed by the Consolidated Framework for Implementation Research (Multimedia Appendix 2). The anonymous web-based questionnaire (Research Electronic Data Capture) was distributed by email from July 8 to 29, 2024, and included 11 closed-ended items in Likert-scale format and one open-ended question to identify perceived implementation barriers and facilitators (Multimedia Appendix 3). The survey included core questions on tool awareness or use for all respondents and used branching (conditional) logic that prompted questions about tool perceptions only to respondents who reported awareness.
Statistical Analysis
We summarized scores for closed-ended responses using medians and interquartile ranges (IQRs) and summarized frequencies of agreement with each item, where agreement reflects “agree” or “strongly agree” and disagreement reflects “disagree” or “strongly disagree.” Neutral responses were included in the denominator of these frequencies but not separately reported for easier contrast of extremes. We analyzed open-ended responses using conventional content analysis supported by a large language model (GPT-4 by ChatGPT) to identify recurring themes (Multimedia Appendix 4).
Ethical Considerations
The North Texas Regional Institutional Review Board approved this study (number 2023‐151). This study followed the ethical standards of the responsible committee on human experimentation and the World Medical Association Declaration of Helsinki. All participants provided informed consent before participation. The survey was accessible only after consent was obtained. We collected responses anonymously and did not link any personally identifiable information to the survey data, ensuring privacy and confidentiality. Clinicians who completed the survey were entered into a draw for one of eight US $50 Walmart e-gift cards as compensation.
Results
Our study population comprised 33 clinicians (12% of 284 eligible). Participant characteristics are summarized in Multimedia Appendix 5. Most respondents were physicians (MD/DO, n=20, 61%), followed by nurse practitioners (n=10, 30%). The majority were older than 30 years (n=29, 88%), identified as female (n=23, 70%), and were non-Hispanic White (n=19, 58%).
Fewer than half of respondents (n=15, 45%) were aware of the updated sexual history questionnaire. Table 1 summarizes awareness, use, and perceptions of the CDS tool among respondents who reported awareness of the tool. Most clinicians who reported awareness or use of the tool agreed that the questionnaire was important to implement (n=10, 67%), helpful for identifying PrEP candidates (n=9, 60%), and appropriate for primary care (n=9, 60%). In contrast, clinicians reported concerns about increased patient interaction time (n=9, 60%) and workflow fit (n=7, 47%). Most clinicians agreed that the PrEP advisory alert was appropriate for primary care (n=12, 78%) and supported guideline-concordant care (n=11, 73%), although fewer reported that the alert fit within clinical workflows (n=6, 40%).
Table 1. Awareness, use, and perceptions of the CDSa tool among clinicians who completed both awareness and use questions (N=15).b.
| Median (IQR) | Agreementc, n (%) | Disagreementc, n (%) | |
|---|---|---|---|
| Clinician attitudes and perceptions of the sexual history questionnaire | |||
| I like this tool | 3.0 (2.0‐4.0) | 5 (33) | 5 (33) |
| Suitable for my patients | 4.0 (2.5‐4.0) | 8 (53) | 4 (27) |
| The tool is easy to use | 3.0 (2.5‐4.0) | 7 (47) | 4 (27) |
| Trust evidence quality and validity | 4.0 (3.0‐4.0) | 9 (60) | 2 (13) |
| Good option to identify sexual risk factors | 3.0 (3.0‐4.0) | 7 (47) | 2 (13) |
| Facilitates sexual history-taking | 3.0 (2.0‐4.0) | 6 (40) | 6 (40) |
| Meets needs to provide resources to patients | 3.0 (2.5‐4.0) | 5 (33) | 4 (27) |
| Important to implement | 4.0 (3.0‐4.0) | 10 (67) | 1 (6.7) |
| Appropriate for primary care | 4.0 (3.0‐4.0) | 9 (60) | 3 (20) |
| Fits within workflow | 3.0 (2.0‐4.0) | 5 (33) | 7 (47) |
| Does not increase patient time | 2.0 (1.0‐3.0) | 3 (20) | 9 (60) |
| Easy to access and incorporate in workflow | 3.0 (2.0‐4.0) | 6 (40) | 5 (33) |
| Valuable for primary care | 4.0 (3.0‐4.0) | 10 (67) | 3 (20) |
| Helps identify PrEPd candidates | 4.0 (3.0‐4.0) | 9 (60) | 3 (20) |
| Clinician attitudes and perceptions of the PrEP advisory alert | |||
| I like this alert | 3.0 (3.0‐4.0) | 7 (47) | 1 (6.7) |
| Suitable for my patients | 3.0 (3.0‐4.0) | 7 (47) | 2 (13) |
| Useful and actionable | 3.0 (3.0‐4.0) | 7 (47) | 3 (20) |
| Trust evidence quality and validity | 3.0 (3.0‐4.0) | 7 (47) | 3 (20) |
| Good for guideline-concordant care for PrEP | 4.0 (3.5‐4.0) | 11 (73) | 0 (0) |
| Facilitates PrEP assessment | 3.5 (3.0‐4.0) | 7 (50) | 2 (14) |
| Easy to access and incorporate in workflow | 3.0 (2.5‐4.0) | 6 (40) | 4 (27) |
| Appropriate for primary care | 4.0 (4.0‐4.0) | 12 (79) | 0 (0) |
| Fits within existing workflow | 3.0 (2.5‐4.0) | 6 (40) | 4 (27) |
| Does not increase patient time | 2.0 (2.0‐3.0) | 2 (13) | 8 (53) |
| Adds value to practice | 4.0 (3.0‐4.0) | 8 (53) | 3 (20) |
| Valuable for primary care | 4.0 (3.0‐4.0) | 9 (64) | 1 (6.7) |
| Helps identify PrEP candidates | 4.0 (3.0‐4.0) | 8 (53) | 0 (0) |
CDS: clinical decision support.
Clinician level of awareness and use frequency of the sexual history questionnaire: n=6, 40% aware, no use; n=9, 60% aware, used at least once.
Agreement reflects “agree” or “strongly agree.” Disagreement reflects “disagree” or “strongly disagree.” Neutral responses were included in the denominator but not separately reported.
PrEP: pre-exposure prophylaxis.
Qualitative analysis of open-ended responses from 10 clinicians identified 5 themes: workflow disruption and time burden, alert fatigue, discomfort with the sexual history questionnaire, limited understanding of CDS functionality, and perceived usefulness for identifying at-risk patients. Table 2 summarizes illustrative quotes from these themes.
Table 2. Themes and illustrative quotes from clinician responses to open-ended questions regarding the use of the clinical decision support tool (sexual history questionnaire and PrEPa advisory alert).
| Theme | Illustrative quotes (participant ID) |
|---|---|
| Concern about time and workflow |
|
| Time and reducing alert fatigue as a facilitator |
|
| Patient and provider comfort and appropriateness as a barrier |
|
| Training |
|
| Perceived utility of tool |
|
PrEP: pre-exposure prophylaxis.
Discussion
Our findings suggest suboptimal awareness of the CDS tool among primary care clinicians, and uptake was limited even among clinicians who reported awareness. Clinicians who used the tool generally endorsed the value of the sexual history questionnaire and PrEP advisory alert but reported concerns regarding usability and workflow integration, particularly increased time burden during patient visits. Open-ended responses revealed workflow disruption, alert fatigue, discomfort with the sexual history questionnaire, and limited understanding of tool functionality.
Our findings should be considered in the context of a key limitation. Despite a structured reminder strategy, financial incentives, and peer-led outreach, only 12% of eligible clinicians completed the survey, and thus our findings are likely sensitive to selection bias. Low response proportions are a persistent challenge when using provider surveys and may reflect competing clinical demands or survey fatigue [8]. We were unable to apply quantitative approaches to explore the effects of this selection bias [9] because we lacked data about clinicians who did not respond to the survey. Nevertheless, we likely overestimated CDS tool awareness among our primary care clinicians, and responses among tool users likely reflect the perspectives of a highly select group of early adopters, which could overestimate favorable impressions of the CDS tool compared with the overall eligible population.
Despite the key limitation, our findings align with prior studies of CDS implementation in primary care [10] that report low awareness and barriers related to workflow integration, time constraints, alert fatigue, and limited stakeholder engagement. Clinicians in our study endorsed the potential value of the CDS tool for identifying patients who may benefit from PrEP, but perceived workflow burdens may limit adoption. These findings reinforce the importance of aligning CDS tools with clinical workflows and eliciting postimplementation clinician feedback to improve the use of CDS tools.
Supplementary material
Acknowledgments
The authors did not use generative artificial intelligence in the writing of this research letter. Open-ended survey responses were analyzed using conventional content analysis supported by a large language model (GPT-4) to identify recurring themes.
Abbreviations
- CDS
clinical decision support
- CROSS
Checklist for Reporting of Survey Studies
- EHR
electronic health record
- IQR
interquartile range
- JPS
John Peter Smith Health Network
- PrEP
pre-exposure prophylaxis
Footnotes
Funding: This study received no external funding.
Data Availability: The datasets generated and analyzed during this study are available from the corresponding author on reasonable request.
Authors’ Contributions: Conceptualization: AMA
Methodology: RPO, AMA, CTT, WL, JA, NL, EF
Investigation: AMA, CTT, WL
Data curation: AMA, WL, CTT, JA
Formal analysis: AMA, WL
Writing – original draft: AMA
Writing – review & editing: RPO, AMA, CTT, WL, JA, NL, EF
Supervision: RPO, AMA
Project administration: AMA
Conflicts of Interest: EF reports serving on an advisory board for Merck. The other authors declare no conflicts of interest.
References
- 1.Gagnon KW, Coulter RWS, Egan JE, Ho K, Hawk M. Associations between sexual history documentation in electronic health records and referral to pre-exposure prophylaxis navigator on prescription of pre-exposure prophylaxis at a multi-site federally qualified health center. AIDS Patient Care STDS. 2023 Aug;37(8):403–415. doi: 10.1089/apc.2023.0068. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Sullivan PS, DuBose SN, Castel AD, et al. Equity of PrEP uptake by race, ethnicity, sex and region in the United States in the first decade of PrEP: a population-based analysis. Lancet Reg Health Am. 2024 May;33:100738. doi: 10.1016/j.lana.2024.100738. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Agovi AMA, Anikpo I, Cvitanovich MJ, Craten KJ, Asuelime EO, Ojha RP. Knowledge needs for implementing HIV pre-exposure prophylaxis among primary care providers in a safety-net health system. Prev Med Rep. 2020 Dec;20:101266. doi: 10.1016/j.pmedr.2020.101266. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.US Preventive Services Task Force. Owens DK, Davidson KW, et al. Preexposure prophylaxis for the prevention of HIV infection: US Preventive Services Task Force recommendation statement. JAMA. 2019 Jun 11;321(22):2203–2213. doi: 10.1001/jama.2019.6390. doi. Medline. [DOI] [PubMed] [Google Scholar]
- 5.Chan CT, Vo M, Carlson J, Lee T, Chang M, Hart-Cooper G. Pediatric provider utilization of a clinical decision support alert and association with HIV pre-exposure prophylaxis prescription rates. Appl Clin Inform. 2022 Jan;13(1):30–36. doi: 10.1055/s-0041-1740484. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Pickel J, Fiks AG, Karavite D, et al. Provider perspectives on clinical decision support to improve HIV prevention in pediatric primary care: a multiple methods study. Implement Sci Commun. 2023 Feb 21;4(1):18. doi: 10.1186/s43058-023-00394-7. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.van den Berg P, Powell VE, Wilson IB, Klompas M, Mayer K, Krakower DS. Primary care providers’ perspectives on using automated HIV risk prediction models to identify potential candidates for pre-exposure prophylaxis. AIDS Behav. 2021 Nov;25(11):3651–3657. doi: 10.1007/s10461-021-03252-6. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Klabunde CN, Willis GB, Casalino LP. Facilitators and barriers to survey participation by physicians: a call to action for researchers. Eval Health Prof. 2013 Sep;36(3):279–295. doi: 10.1177/0163278713496426. doi. Medline. [DOI] [PubMed] [Google Scholar]
- 9.Smith LH. Selection mechanisms and their consequences: understanding and addressing selection bias. Curr Epidemiol Rep. 2020 Dec;7(4):179–189. doi: 10.1007/s40471-020-00241-6. doi. [DOI] [Google Scholar]
- 10.Derksen C, Walter FM, Akbar AB, et al. The implementation challenge of computerised clinical decision support systems for the detection of disease in primary care: systematic review and recommendations. Implement Sci. 2025 Jul 17;20(1):33. doi: 10.1186/s13012-025-01445-4. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Weiner BJ, Lewis CC, Stanick C, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017 Aug 29;12(1):108. doi: 10.1186/s13012-017-0635-3. doi. Medline. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
