Skip to main content
BMJ Open Quality logoLink to BMJ Open Quality
. 2021 Apr 13;10(2):e001170. doi: 10.1136/bmjoq-2020-001170

Provider engagement in Indiana’s opioid use disorder ECHO programme: there is a will but not always a way

Jon Agley 1,, Cris Henderson 1, Zachary Adams 2, Leslie Hulvershorn 2
PMCID: PMC8051380  PMID: 33849905

Introduction

Project Extension for Community Healthcare Outcomes (ECHO) is an innovative means of expanding clinical providers’ knowledge and skills using virtual case-based learning in a ‘hub-and-spoke’ network of providers and specialists.1 Especially in rural and underserved areas, where healthcare needs are great and access to care may be limited, ECHO presents a promising continuing education model and way to facilitate management of complex cases.2–5 It also provides clinicians with digital space for professional collaboration and shared learning, which is valuable in today’s high-pressure practice environment6 and can be rapidly deployed to address crises like the COVID-19 pandemic.7 However, some practitioners have argued that administrative demands on time, rather than access to specialty knowledge, are the barrier to developing networks of providers for mutual education.8 Other providers have noted that ECHO is likely not a ‘panacea for access to specialty care,’ but rather a ‘force multiplier’ for skills transfer.9 It, therefore, is important to capture and disseminate quality improvement data to determine the ways in which ECHO programmes best can serve providers’ specialty healthcare training needs.

Our multidisciplinary team started an ECHO for opioid use disorder (OUD) in Indiana, USA, in 2018. Each session was hosted on Zoom and lasted 90 min; the first 15 were a didactic presentation (eg, ‘Neurobiology of OUD and MAT’), and the latter 75 were case-based learning, moderated by a panel of experts, focused on real, deidentified cases submitted in advance by participants. Our ECHO programme has facilitated extensive participation in shared, case-based learning on OUD, producing more than 1771 person-hours of attendance in the first year of operation alone, and has elucidated the need for statewide mentorship related to OUD and psychiatric comorbidities.10 However, not all participants became regular ECHO attenders, so we surveyed low-attendance participants for programmatic quality improvement. The results of this microstudy highlighted barriers to provider engagement in continuing education and digital communities of practice.

Methods

In 2018, we offered 2 OUD ECHO programmes for clinical providers, each consisting of 12 weekly 90 min sessions. For this report, our population of interest was providers who attended at least one session of ECHO, attended fewer than the mean numbers of sessions attended (m=5.2 and 5.8, respectively), and did not attend both programmes. The latter criterion was established prior to attendance review, and all but one dual-programme participant also attended more than five sessions. The total eligible population was 21 providers (figure 1).

Figure 1.

Figure 1

Determination of sample. ECHO, Extension for Community Healthcare Outcomes.

Invitations to participate in a brief evaluation (five open-ended questions) hosted on Qualtrics were sent in three email waves; responses were incentivised by a US$20 digital Amazon.com gift card. The questions were informed by work by Salgia et al11 and White et al12 and were preceded with a statement to reduce social desirability bias.13 The questionnaire was pilot tested with clinical providers (n=7) who were ineligible for the survey, including a mix of ECHO participants and team members. It was found to have face validity, except one question, which was adjusted for clarity prior to being fielded. All participants provided informed consent.

Results

Of 21 eligible participants, 10 responded (47.6%) and 9 fully completed the survey (42.9%). Two authors reviewed and fully agreed on all major categorisations see (online supplemental file 1). Only questions relevant to this topic were extracted for the short report. These were:

Supplementary data

bmjoq-2020-001170supp001.pdf (59.9KB, pdf)

(1) In what ways did Indiana’s Opioid ECHO sessions not meet your expectations?

Two providers indicated the programme met their expectations. Among those whose expectations were not met, providers noted that scheduling or timing was difficult (n=3), or that the programme did not match their level of expertise (n=2), should not emphasise active participation (n=1) or permitted too much non-medical talk (n=1).

(2) Please tell us the primary reasons why you stopped attending the Indiana Opioid ECHO.

Most respondents identified timing and scheduling as the primary reason they stopped attending (n=8), with some adding that our attempt to make scheduling easier by holding the session around lunchtime had the opposite effect (n=3). One respondent did not feel they had enough to add to the group.

(3) What changes, if any, could have been made to the Indiana Opioid ECHO that would have increased your likelihood of continuing to attend?

Most providers noted different or shorter periods of time (n=5) as the key change. Some (n=2, including one cross-code) preferred to watch videos of missed sessions. Others (n=3) shared unique recommendations, such as a group just for those ‘just beginning’ to manage OUD.

Discussion

Infrequently attending Indiana OUD ECHO participants often were constrained by practical concerns (time/availability) rather than lack of interest or dissatisfaction with the ECHO model. This mirrors recent qualitative work indicating that external demands on time are a limiting factor for ECHO participation, though ECHO sessions were perceived as convenient and accessible.14 While accessing high-quality specialty education on Zoom is clearly more time-efficient than travelling to an academic medical centre, especially for rural providers, even 90 min sessions may not always be possible to attend.

Care should be taken with generalising results from this report, given the small sample size and single evaluation site. However, following this study, our team began to publicly release didactic notes for all sessions and more deliberately created topic-specific ‘tracks’ on different days of the week (eg, sessions on neonatal abstinence syndrome are Monday, sessions on adolescent SUD prevention are on Friday). It is not clear that these quality improvement efforts fully addressed the issues described by participants, especially in terms of session duration, but case-based learning is the core of ECHO and complex case management cannot easily be truncated.

We recommend that researchers study modified approaches (such as recorded sessions for asynchronous learning) and upstream mechanisms of supporting ECHO participation (eg, policies or incentives for healthcare systems to support protected attendance time) for their potential to increase provider engagement. In the former case, however, it will be important to closely examine the degree to which case-based learning, a core facet of ECHO, can be achieved to a reasonable degree without synchronous interaction.

Footnotes

Contributors: Concept and design: all authors. Acquisition, analysis or interpretation of data: JA and CH. Drafting of the manuscript: JA. Critical revision of the manuscript for important intellectual content: all authors. JA had access to all of the data in the study and takes responsibility for the integrity of the data and accuracy of the data analysis.

Funding: Funding for the Indiana Opioid ECHO program in this short report was provided by the Indiana Division of Mental Health and Addiction, grant #18-002.

Competing interests: None declared.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Ethics statements

Patient consent for publication

Not required.

Ethics approval

This study was originally conducted as a quality improvement evaluation. This academic write-up was not deemed to be human subjects research per the Indiana University IRB (#2008399720). However, signed informed consent (digital) was nonetheless collected from participants.

References

  • 1.Eaton L. Hierarchy disruptors: bringing specialist knowledge from hospital to community care. BMJ 2019;365:l4376. 10.1136/bmj.l4376 [DOI] [PubMed] [Google Scholar]
  • 2.Struminger BB, Arora S. Leveraging telehealth to improve health care access in rural America: it takes more than bandwidth. Ann Intern Med 2019;171:376–7. 10.7326/M19-1200 [DOI] [PubMed] [Google Scholar]
  • 3.Watson M. Project ECHO director responds to concerns. BMJ 2019;366:l5157. 10.1136/bmj.l5157 [DOI] [PubMed] [Google Scholar]
  • 4.Komaromy M, Bartlett J, Manis K, et al. Enhanced primary care treatment of behavioral disorders with echo case-based learning. Psychiatr Serv 2017;68:873–5. 10.1176/appi.ps.201600471 [DOI] [PubMed] [Google Scholar]
  • 5.Francis E, Kraschnewski J, Hogentogler R, et al. 4060 a telehealth approach to improving healthcare to rural and underserved populations. J Clin Transl Sci 2020;4:56. 10.1017/cts.2020.199 [DOI] [Google Scholar]
  • 6.Arora S, Kalishman S, Thornton K, et al. Expanding access to hepatitis C virus treatment--Extension for Community Healthcare Outcomes (ECHO) project: disruptive innovation in specialty care. Hepatology 2010;52:1124–33. 10.1002/hep.23802 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Sockalingam S, Clarkin C, Serhal E, et al. Responding to health care professionals' mental health needs during COVID-19 through the rapid implementation of Project ECHO. J Contin Educ Health Prof 2020;40:211–4. 10.1097/CEH.0000000000000311 [DOI] [PubMed] [Google Scholar]
  • 8.Mann N. Clinicians need time, not videoconferencing. BMJ 2019;366:l5156. 10.1136/bmj.l5156 [DOI] [PubMed] [Google Scholar]
  • 9.Furlan AD, Pajer KA, Gardner W, et al. Project ECHO: building capacity to manage complex conditions in rural, remote and underserved areas. Can J Rural Med 2019;24:115–20. 10.4103/CJRM.CJRM_20_18 [DOI] [PubMed] [Google Scholar]
  • 10.Agley J, Adams ZW, Hulvershorn LA. Extension for Community Healthcare Outcomes (ECHO) as a tool for continuing medical education on opioid use disorder and comorbidities. Addiction 2019;114:573–4. 10.1111/add.14494 [DOI] [PubMed] [Google Scholar]
  • 11.Salgia RJ, Mullan PB, McCurdy H, et al. The educational impact of the specialty care access Network-Extension of community healthcare outcomes program. Telemed J E Health 2014;20:1004–8. 10.1089/tmj.2013.0302 [DOI] [PubMed] [Google Scholar]
  • 12.White C, McVeigh C, Watson M, Dunwoody L. Evaluation of Project ECHO (Extension for Community Healthcare Outcomes) Northern Ireland Programme 2015 - 16. Northern Ireland: ECHO Northern Ireland; 2016. https://pure.qub.ac.uk/en/publications/evaluation-of-project-echo-extension-for-community-healthcare-out [Accessed 1 Oct 2019]. [Google Scholar]
  • 13.Latkin CA, Mai NVT, Ha TV, et al. Social desirability response bias and other factors that may influence self-reports of substance use and HIV risk behaviors: a qualitative study of drug users in Vietnam. AIDS Educ Prev 2016;28:417–25. 10.1521/aeap.2016.28.5.417 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Salvador J, Bhatt S, Fowler R, et al. Engagement with Project ECHO to increase medication-assisted treatment in rural primary care. Psychiatr Serv 2019;70:1157–60. 10.1176/appi.ps.201900142 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjoq-2020-001170supp001.pdf (59.9KB, pdf)


Articles from BMJ Open Quality are provided here courtesy of BMJ Publishing Group

RESOURCES