Abstract
In British Columbia (BC) and across the territories of over 200 First Nations and 39 Métis Nation Chartered communities, the COVID-19 pandemic catalyzed a group of partner organizations to rapidly establish seven virtual care pathways under the Real-Time Virtual Support (RTVS) network. They aimed to address inequitable access and multiple barriers to healthcare faced by rural, remote, and Indigenous communities, and provide pan-provincial services. Mixed-method evaluation assessed implementation, patient and provider experience, quality improvement, cultural safety, and sustainability. Pathways supported 38,905 patient encounters and offered 29,544 hours of peer-to-peer support from April 2020 to March 2021. Mean monthly encounter growth was 178.0% (standard deviation = 252.1%). Ninety percent of patients were satisfied with the care experience; 94% of providers enjoyed delivering virtual care. Consistent growth suggests that the virtual pathways met the needs of providers and patients in rural, remote, and Indigenous communities, and supported virtual access to care in BC.
Introduction
Gaps in healthcare for rural, remote, and Indigenous patients exist across Canada.1,2 Disproportionately fewer health professionals practice in rural areas and residents of rural and Indigenous communities experience less access to services and have poorer health outcomes.3-6 In British Columbia (BC), the COVID-19 pandemic created and exacerbated challenges for the healthcare system, such as disruption and closure of local services in First Nations communities and overwhelming nursing in BC’s public health telephone service.7,8 Developing and modifying virtual services to address health system gaps is an ongoing strategy in BC and these efforts align with pan-Canadian priorities for health services and policy research. 6 Several prior on-demand, virtual initiatives have been developed, including CODI 9 and the Robson Valley Virtual Care pilot project, and the Virtual Health and Wellness Collaborative for Rural and First Nations BC were established in early 2020.10,11
Building on existing partnerships and prior work, the COVID-19 pandemic accelerated our development and implementation of multiple on-demand, pan-provincial virtual care pathways under the Real-Time Virtual Support (RTVS) network to address urgent healthcare needs. RTVS is underpinned by a group of organizations supporting the “Partnership Pentagram Plus”12,13 approach and comprised of healthcare providers (HCPs), healthcare administrators, policy-makers, community members, academia, and linked sectors. With the launch of RTVS services in April 2020, we undertook a program evaluation to determine the changes and outcomes of RTVS in its inaugural year. Our evaluation particularly focused on how RTVS improves healthcare quality and cultural safety in terms of access and equity for both patients and HCPs in rural, remote, and Indigenous BC communities.
Methods
Design and setting
We conducted a mixed-method program evaluation of the RTVS pathways from April 1, 2020 through March 31, 2021 (the first year of programmatic implementation in conjunction with the start of the pandemic). A mixed-method approach accounts for complexities, different ways of knowing and understanding phenomena, and for sharing and learning from findings. 14 The RTVS initiative was developed through the collaboration of partnering organizations in BC, including the BC Ministry of Health, the Rural Coordination Centre of BC (RCCbc), the First Nations Health Authority (FNHA), the BC Emergency Medicine Network, and the Digital Emergency Medicine Unit in the University of British Columbia’s Department of Emergency Medicine. Our evaluation comprised a multi-stakeholder advisory committee, collaborative partners, and working groups.
Interventions: Development of RTVS pathways
In April 2020, four publicly funded RTVS pathways were launched, with three additional pathways available in July and August 2020 (Table 1). Three pathways are patient-facing, where patients across BC are able to rapidly access a physician for primary or urgent healthcare concerns: First Nations Virtual Doctor of the Day (FNvDOD), First Nations Virtual Substance Use and Psychiatry Service (FNvSUPS), and HealthLink BC Emergency iDoctor in-assistance (HEiDi). FNvDOD and FNvSUPS are available to all Indigenous people in BC and their family members, who need not be Indigenous to access the services. HEiDi is universally accessible to all in BC. Four pathways are peer-to-peer for HCPs, where rural- or remote-based providers can access a physician 24/7 on-demand for urgent, emergent, or specialist support: Child Health Advice in Real-time Electronically (CHARLiE), Maternity and Babies Advice Line (MaBAL), Rural Outreach Support group (ROSe), and Rural Urgent Doctor in-aid (RUDi). RTVS also includes “quick reply” pathways for specialist decision support including lines to assist rural healthcare providers in dermatology, rheumatology, haematology, myofascial pain presentations, and thrombosis medicine, which were not in the scope of the evaluation for year one (Y1). RTVS connects patients and providers with enhanced health resources and expertise via virtual technologies (i.e. Zoom videoconferencing). RTVS providers use healthcare-grade Zoom 1 licenses with privacy protection features, such as disabled audio and chat recording so nothing is stored; locked and encrypted sessions that prevent anyone entering (i.e. “Zoom-bombing”) an active session. Since shared platforms such as Electronic Medical Records (EMRs) are crucial to promoting information continuity and are a backbone of collaborative team-based care across settings, all RTVS pathways use a common EMR, with customizations based on specific pathway needs.
Table 1.
Description of the seven RTVS pathways launched and evaluated during Y1.
| Pathway type | Pathway name | Pathway aim(s) | Details |
|---|---|---|---|
| Patient-facing | First Nations Virtual Doctor of the Day (FNvDOD) | To provide any Indigenous person in BC access to timely, culturally safe primary care closer to home This service is available to all First Nations people in BC and their family members, even if those family members are not Indigenous | Full-service family physicians are available Monday-Friday, 8:30 AM-4:30 PM |
| Patient-facing | First Nations Virtual Substance Use and Psychiatry Service (FNvSUPS) | To provide Indigenous clients, and their family members even if not Indigenous, access to specialists and care coordinators to support their care journey and connections to other services | Addiction medicine specialists and psychiatrists are available Monday-Friday, 9:30 AM-5:30 PM and 10:00 AM-3:00 PM, respectively |
| Patient-facing | HealthLink Emergency iDoctor in-assistance (HEiDi) | To integrate VP’s into the standard telephone call-flow for HealthLink BC’s 8-1-1 Nursing Services so that urgently-triaged callers can be referred to a VP for a same-day consultation | Full-service family and emergency physicians are available daily from 9:00 AM-11:00 PM |
| Peer-to-peer | Child Health Advice in Real-time Electronically (CHARLiE) | To provide on-demand specialized paediatric support to rural HCPs managing urgent and non-urgent health problems from neonates through young adults | Pediatricians and paediatric intensivists and emergency specialists are available 24/7 |
| Peer-to-peer | Maternity and Babies Advice Line (MaBAL) | To provide on-demand support to rural HCPs managing urgent and non-urgent pre-conception, prenatal, antenatal, intrapartum, and postpartum presentations for both mothers and newborns | Full-service family physicians with expertise in maternity and newborn care are available 24/7 |
| Peer-to-peer | Rural Outreach Support group (ROSe) | To provide on-demand urgent support to critical patient cases as well as consultations, second opinions, and ongoing virtual support of patients in critical care | Critical care specialists and intensivists are available 24/7 |
| Peer-to-peer | Rural Urgent Doctor in-aid (RUDi) | To provide on-demand urgent and non-urgent support to rural HCPs managing patients with emergency and generalist medical problems, as well as education and simulation opportunities | Full-service physicians with experience in emergency medicine and rural care are available 24/7 |
Approximately 75 practicing physicians were initially recruited to serve as Virtual Physicians (VPs) on one or more of the RTVS pathways, growing to 150 VPs by the end of Y1. VPs were engaged based on clinical expertise, being non-judgemental, compassionate, and strong communicators, experienced with different technologies, knowledgeable about rural BC, and experienced in different care settings. Further, they were selected for an expressed commitment to their personal cultural safety and humility journey. RTVS pathways include a number of VPs of Indigenous ancestry, and the ethos of the VP communities of practice emphasizes the importance of knowledge exchange, role modelling and coaching that have support a model of team-based and holistic care. RTVS pathways are intended to augment and integrate with existing health services to support patient-centred team-based care within the publicly funded BC health system.
Evaluation approach
We utilized a participatory, developmental, and iterative approach15,16 to create and refine our evaluation approach and objectives, understanding and respecting that this work is taking place across and within the unceded territories of over 200 First Nations and 39 Métis Nation Chartered communities province-wide. Starting with two core, guiding principles—(1) RTVS seeks to improve access to and equity of care for rural, remote, and Indigenous patients; and (2) RTVS seeks to enable rural HCPs to access on-demand support from non-judgemental, culturally safe, knowledgeable physician colleagues—we developed an RTVS-specific, comprehensive evaluation framework (available on pages 51-53 of the RTVS Year One Evaluation report) 17 grounded in other relevant, validated frameworks, including the Quadruple Aim, 18 Social Accountability,19,20 and the BC Health Quality Matrix. 21 The RTVS evaluation framework was further contextualized through consultation with stakeholders and four guiding images were developed to highlight RTVS functions: a safety net (timely, equitable access to care, irrespective of where patients are located in BC), funnel (help patients navigate the health system and connect them to appropriate longitudinal primary care), fire department (diverse community engagement activities provided by RTVS physicians), and feather (high-quality culturally safe care for Indigenous patients).
Study populations
Given the objectives of the RTVS evaluation, several different participant groups were included. All RTVS VPs were invited to participate in interviews and surveys. Patients utilizing the patient-facing pathways were invited to complete post-encounter surveys. Snowball recruiting methods were utilized to identify HCP users of the peer-to-peer pathways and invite them to participate in interviews.
Data collection and measures
A mixed-method approach was used, including routinely collected operational and administrative data from each pathway to determine utilization rates over time as well as the locations of users. Semi-structured interviews were conducted with RTVS VPs, rural HCPs, and stakeholders to extensively investigate perspectives, experiences, and impacts of RTVS. On-line anonymous surveys (available upon request) were administered to RTVS VPs and patients to determine overall experience and satisfaction outcomes.
Data analysis
For the qualitative interview data, we used a modified constant comparative method 22 to develop themes and determine saturation from a longitudinal and iterative perspective. We calculated descriptive statistics for quantitative operational and survey data. Location data were cross-referenced with BC health regions and visually mapped to determine geographic distributions of RTVS users. Results were iteratively shared with RTVS stakeholders to co-develop next steps and recommendations. Additionally, we have published early, descriptive findings from the HEiDi pathway and refer readers there for more in-depth results. 7
Results
Encounter and call volumes
The RTVS pathways recorded a total of 38,905 clinical encounters during Y1. Almost all pathways experienced positive quarterly growth in encounter or call volumes (Table 2). However, the number of completed clinical encounters that were recorded by peer-to-peer VPs in the EMR system was impacted by the delayed launch of the EMR system used in RTVS, issues of integration within the extant EMR systems used in the province, along with usability of a newly developed system rapidly implemented to suit the diversity of RTVS pathways. These factors, along with inconsistent uptake of a new charting system by VPs, presented challenges in the first year of implementation, which have been consistently worked on into year two and beyond. Specifically, ongoing quality improvement efforts along with responsive IT support and training foster uptake and allow for tools to be responsive to evolving and diverse needs.
Table 2.
Summary of quarterly encounter volumes and change recorded by each pathway.
| FNvDOD | FNvSUPS | HEiDi | CHARLiE | MaBAL | ROSe | RUDi | |
|---|---|---|---|---|---|---|---|
| Q1, total | 640 | -- | 5332 | -- | -- | -- b | 42 |
| Q2, total (percent change) | 1206 (+88.4%) | 91 | 5965 (+11.9%) | 3 | 2 | 1 | 100 (+138.1%) |
| Q3, total (percent change) | 1721 (+42.7%) | 399 (+338.5%) | 8016 (+34.4%) | 27 (+800.0%) | 17 (+750.0%) | 25 (+2400.0%) | 337 (+237.0%) |
| Q4, total (percent change) | 2522 (+46.5%) | 620 (+55.4%) | 11224 (+40.0%) | 41 (+51.9%) | 52 (+205.9%) | 14 (-44.0%) | 508 (+50.7%) |
| Total (mean percent change) | 6089 (+59.2%) | 1110 (+197.0%) | 30537 (+28.8%) | 71 (+425.9%) | 71 (+477.9%) | 40 (+1178.0%) | 987 (+141.9%) |
aThere was a mean monthly encounter change of +178.0% (SD = 252.1%) across pathways (Table S2). By pathway type, there was an observed change of +273.7% (SD = 322.5%) for the peer-to-peer pathways (excluding extremely large values, that is, >1000%) and 82.2% (SD = 105.7%) for the patient-facing pathways.
bWhile the ROSe pathway was active during Q1, no clinical encounters were recorded by VPs in the EMR system.
The peer-to-peer pathways offered a combined total of 29,544 hours of continuous, on-demand support to rural HCPs during Y1. 17 They recorded 2,486 calls, either by telephone or Zoom, from rural HCPs, including nurses at remote nursing stations, family physicians, and other rural providers. More complicated consultations involved 30-60-minute calls so that the VP can provide guidance on an uncommon procedure, take the patient’s history, review an electrocardiogram chart or ultrasound, or develop a full care plan with the calling provider that accounts for the limited resources of the setting. Almost all VPs noted a number of urgent, complex cases that required over an hour of time. For instance, VPs described resuscitation cases at rural or remote health centres, where they supported the on-site nurse performing unfamiliar procedures. VPs indicated about 6% of calls received are solely education-based, where they offer simulations or provide guidance to rural healthcare providers on different procedures and other clinical competencies.
Communities accessing RTVS
A total of 87 distinct rural, remote, and Indigenous communities accessed at least one of the peer-to-peer pathways, with approximately half being located in the Northern Health Authority. We observed that the communities most frequently accessing the peer-to-peer pathways typically were FNHA nursing stations and patient cases where RUDi acted as most responsible provider. Fifty-five percent (55%) of clients of the FNvDoD pathway were from Northern or Vancouver Island Health Authorities, while 40% of FNvSUPS clients were from Northern Health Authority. Frequent usage by clients from these regions suggests that these services are addressing previously identified healthcare inequities.
Patient-reported experience of virtual care
A total of 1,762 HEiDi callers completed an on-line survey following their encounter, representing an estimated response rate of 6.5% (denominator = 26,907 encounters since launch of survey) but with a low rate of missing data across questions (range = 7.0%-8.5%); 123 and 16 clients from the FNvDOD and FNvSUPS pathways, respectively, completed a post-encounter survey.
Clients of the FNvDOD and FNvSUPS and callers to HEiDi generally indicated a positive virtual care experience across a range of domains; 98.2% of FNvDOD and 87.5% of FNvSUPS clients were “satisfied” or “very satisfied” with their experience. One FNvDOD client described her experience using the service:
“I attended a call with my daughter yesterday and [the doctor] called us back right away. I have not felt that respected, supported and understood from anyone in the medical industry in a very long time. She made our difficult situation so much easier to deal with…We both cried from relief after we got off the phone because we were provided an easy to follow holistic plan and felt like we were heard. Thank you for this critical service for people who are not always treated kindly in this industry. It meant the world in our time of need.” – FNvDoD Client
For HEiDi, 79.4% of callers indicated feeling “better” or “much better” after their encounter and 97.6% responded that they planned to take the action recommended by the HEiDi VP. One client described their experience calling the service when they were unable to see their family doctor:
“I … needed to better understand how to handle my concussion. Speaking with the HEiDi VP was a discussion rather than a one-sided delivery of information. He helped me figure out a plan.” – HEiDi Caller
Provider-reported experience of virtual care and support
Fifty-two out of 150 VPs completed the Y1 survey, corresponding to an estimated response rate of 34.7%. Over 90% of VPs were satisfied working on their RTVS pathway. According to respondents, the most important qualities needed in a virtual HCP are: “understanding of low resource practice settings,” “clinical expertise,” and “kindness and empathy.”
A total of 71 interviews were conducted with HCPs and related personnel from 156 individuals contacted (response rate = 45.5%). Table 3 summarizes key themes and sub-themes commonly captured across the interviews. One particular emphasis is how the RTVS peer-to-peer pathways impacted patient transport coordination and different facets, including whether RTVS is accelerating or delaying transport or whether RTVS avoids transport when clinically unwarranted. Our analysis suggests that RTVS providers are successfully supporting “patient-centred care plans involving transport” in several dimensions such as directly speaking with patients or family members by video to communicate the care plan or contacting the Patient Transport Network (PTN) or Emergency Physician On-Line Support (EPOS) to coordinate on the nurse’s behalf.
Table 3.
Summary of provider interview themes.
| Theme and sub-themes | Illustrative quote(s) |
|---|---|
| Improving patient access to care • Expanding access to care for Indigenous communities |
• “RTVS certainly has a hand in enhancing rural equity. The big success is being able to reach Indigenous communities and those really remote communities.” (MaBAL VP) • “[RTVS] is a good bridge for patients. There can be a 2-3-week waitlist for the doctor or we only have a doctor once a week. It’s like another avenue for patients to call without having to wait so long.” (Remote Community Nurse, accesses RUDi and ROSe) |
| Supporting care in place | • “Instead of having to move a patient, the patient was able to stay in their own community.” (CHARLiE VP) |
| Supporting vulnerable rural healthcare providers • Building local capacity • Facilitating interdisciplinary, team-based care |
• “I can't express enough how grateful I am as a relatively new practice physician in rural BC to have RUDi, ROSe, CHARLiE and all the lines and tools that have been rolled out…. Very quickly these supports have been very integrated to how I practice in the clinic and Emergency. Access to these services in the nick of time has changed outcomes.” (Rural GP, accesses peer-to-peer pathways) • “We are able to provide better service to clients and support us in our practice so we are more likely to stay in this line of work. Supporting the longevity of our careers and recruitment and retention in these areas.” (Remote Community Nurse, accesses peer-to-peer pathways) |
| Contributing to a “culture change” • “Phone-a-friend” approach |
• “I feel confident practicing in these remote settings knowing I have highly capable, readily available support in my back pocket who can understand the low resource context I’m working in.” (New-to-practice Physician, accesses RUDi) • “The VP’s listen, they are empathetic, they value our experience and what we are seeing.” (Remote Community Nurse, accesses RUDi) |
| Facilitating patient transportation in rural/remote settings | • “Instead of having to move a patient, the patient was able to stay in their own community.” (CHARLiE VP) |
| Enduring or new inequities | • “Getting Wi-Fi into these communities is one of the biggest challenges, but really needs to happen.” (RUDi VP) |
Rural providers also emphasized that RTVS has greatly lowered barriers to accessing collegial support, thus decreasing professional isolation, and strengthening interprofessional relationships, and potentially contributing to recruitment and retention. As one remote community nurse stated, this contributes to retention:
“We are able to provide better service to clients and support us in our practice so we are more likely to stay in this line of work. Supporting the longevity of our careers and recruitment and retention in these areas.” – Community Nurse
Interpretation
Our mixed-method Y1 program evaluation of the seven RTVS pathways yielded strong, preliminary evidence of how these virtual interventions are supporting rural, remote, and Indigenous communities in BC. All pathways demonstrated considerable uptake in Y1, with nearly 40,000 patient encounters and 2,500 rural HCP calls recorded in total, suggesting that RTVS increases patient access to timely, appropriate virtual, closer to home care, as well as access to collegial support for the HCPs serving rural communities, who are vulnerable due to contextual factors such as scarce health human resources, and geographic isolation. Findings showed positive experiences for patients and providers related to access to timely care and facilitation of patient transport, which is aligned with the reported potential effectiveness of virtual interventions. 24 Patients and providers self-reported high rates of satisfaction in their experiences with the pathways, similar to other virtual services during the pandemic.25-27
Explanation of findings
RTVS comprises a flexible, responsive suite of virtual services with new pathways launched to address the needs and health inequities that exist/remain prevalent across rural, remote, and Indigenous communities. The observed uptake and growth of RTVS pathways were associated with increased equitable access to care for patients across BC, consistent with factors elaborated in the literature. 28 Particularly, findings across RTVS pathways are emblematic of this initiative’s safety net function. By providing rapid access to VPs for a variety of primary and urgent health concerns, many and diverse patient encounters were performed by patient-facing pathways during Y1. Importantly, we observed the highest volume of encounters for the FNvDOD and FNvSUPS pathways in the Northern, Interior, and Vancouver Island Health Authorities—less-populated regions that have lower access to healthcare services. 29 Similarly for the peer-to-peer pathways, we found that nurses serving in some of the most remote, under-resourced healthcare centres in BC were frequently accessing the pathways for support.3,30
VP interview findings highlighted several ways that RTVS pathways funnel patients and connect them to primary, longitudinal services in the wider health system. In our prior work, we described how HEiDi can divert the majority of patients to less-urgent care while accelerating a minority to more-urgent in-person care. 7 Evaluation participants emphasized the importance of patient transport coordination in rural and remote settings and how RTVS can improve coordination between nurses and BC Emergency Health Services. Thus, RTVS stakeholders and VPs recognize the potential of greater integration with existing, complementary health services to promote patient-centred care in rural BC, which in turn can contribute to longer-term sustainability for RTVS. Further, in an effort to align with the United Nations Declaration on the Rights of Indigenous Peoples 31 and the findings from the In Plain Sight report 32 , as well as the recommendations from the Truth and Reconciliation Committee, 5 the FNvDOD and FNvSUPS services employ team-based care approaches that include connecting Indigenous clients to traditional wellness practitioners, supporting patients in their relationship-based care journey. Underpinning these outcomes and concepts is the feather, guiding the practice of humility and culturally safe care to address historical and current inequities and racism faced by Indigenous patients.5,19
Beyond direct clinical care and support, RTVS pathways function as a de facto “fire department, 2 ” engaging providers and communities in diverse ways when not answering clinical service calls. This included strengthening community capacity through providing educational opportunities and training to community health providers. Evaluation findings suggest that RTVS can enhance rural HCP confidence, decrease isolation by building virtual communities of practice, and improve clinical skills and knowledge through education and simulation sessions. However, existing infrastructural inequities across the province remain a barrier to providing equitable care, as also seen in Quebec, 33 particularly technological limitations for both providers and patients. A multi-modal approach that uses the most reliable communication method for the area requesting assistance would help address these inequities in infrastructure in the short-term. Continued advocacy is needed to ensure that reliable, equitable solutions are implemented for the long-term given the disparities of a standard of connectivity availability, infrastructure, and funding across rural and remote areas.
Limitations
We note several limitations in our evaluation, particularly related to implementation of the mixed-methodology and generalizability of findings. While we were able to combine and analyze data across different sources, it is possible additional data were missed or mischaracterized. Our evaluation work beyond Y1 will utilize more robust reporting and tracking methods. Qualitative data focused primarily on VPs and patients were not interviewed directly, nor is their post-encounter health system utilization known. Our subsequent phase of evaluation will include linkages to provincial administrative databases in order to determine if callers adhere to VP’s advice to attend the emergency department or visit their family physician and allow for incorporation of patient outcomes in evaluation. Subsequent evaluation will also incorporate economic metrics to provide a comprehensive understanding of the costs associated with RTVS use and allow examination of cost drivers. Generalizability of findings to rural, remote, and Indigenous communities outside of BC is unknown. However, further in-depth evaluation of specific RTVS interventions, for example, RUDi’s overnight coverage of a rural hospital emergency department, will likely yield findings that can inform applications across Canada.
Conclusion
Implementation of RTVS pathways has demonstrated successful and rapid growth in improving equity of access and access to care across BC. High satisfaction has been expressed by both patients and providers in rural, remote, and Indigenous communities. Future growth areas for RTVS pathways include not just appropriate health services and clinical care, but equity of access to health information, promotion, and general wellness advice for patients, as well as equity of access to non-judgemental, collegial support for providers. It follows that the central evaluation questions to be addressed in Year 2 are as follows: (1) How has RTVS impacted equity of access to care and support; and (2) How is RTVS participating in and advancing the emergence of hybridized healthcare delivery and what impacts are observable for providers and patients in cases of hybridized care? Following the first year of implementation, RTVS has collaboratively worked on the establishment of a robust, multi-dimensional evaluation framework with ongoing dialogue informed by data for continuous calibration through a Learning Health System.34,35 At the time of this article, these services have continued to be funded provisionally. Such partnership, evaluation, and collaboration are essential to working together to ensure ongoing sustainment of these programs.
Acknowledgements
The authors would like to express their sincere thanks to Ted Patterson, Shana Ooms, and Lindsay Arscott from the BC Ministry of Health, for their support, extensive availability, and collaboration. We would like to thank the Year One RTVS Evaluation Advisory Committee and all the participants who shared their insights and time to take part in the evaluation, and the membership of the RTVS Working Group. Special thanks to Sandra Sundhu, HealthLink BC, BC Ministry of Health, Dr. Don Burke, Dr. David Wensley, Dr. Jeanette Boyd, and Dr. Alan Ruddiman for their insight and guidance on evaluation in the context of the RTVS partnership. We also wish to thank Elizabeth Stacy, Elsie Wang, and Erin Crisfield for their contributions on the evaluation team during the timeframe of the report, and Dave Harris and Tom Skinner for their virtual care, implementation, and technology expertise. We gratefully acknowledge the BC Ministry of Health and the Joint Standing Committee on Rural Issues for being the primary funders of the RTVS Evaluation. We also gratefully acknowledge additional financial and in-kind support from the Rural Coordination Centre of BC, Michael Smith Health Research (formerly BC Academic Health Sciences Network), Emergency Care BC (formerly BC Emergency Medicine Network), and UBC Department of Emergency Medicine.
Notes
Zoom for Healthcare is endorsed by the BC Ministry of Health and is compliant with the Personal Information Protection and Electronic Documents Act (PIPEDA) and Personal Health Information Protection Act (PHIPA).
In Year 2, the Fire Department concept evolved and was funded as a program, providing outreach, RTVS training through simulation, as well as onboarding for RTVS providers.
Footnotes
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the BC Ministry of Health and the Joint Standing Committee on Rural Issues for being the primary funders of the RTVS Evaluation. We also gratefully acknowledge additional financial and in-kind support from the Rural Coordination Centre of BC, Michael Smith Health Research (formerly BC Academic Health Sciences Network), Emergency Care BC (formerly BC Emergency Medicine Network), and UBC Department of Emergency Medicine.
Ethical approval: As this program evaluation work was for quality assurance and improvement purposes, an ethics waiver was provided by the University of British Columbia's research ethics board, in keeping with the Tri-Council Policy Statement. 23
Data sharing: The data are not publicly available.
ORCID iDs
Helen Novak Lauscher https://orcid.org/0000-0002-4992-7662
Kurtis Stewart https://orcid.org/0000-0003-3730-9733
Erika Pritchard https://orcid.org/0000-0002-2511-8799
References
- 1.UBC Rural Continuing Professional Development (RCPD) Program . Rural Emergency Medicine Needs Assessment British Columbia, Canada [Internet]. UBC Continuing Professional Development (UBC CPD). 2015. Available from: https://ubccpd.ca/sites/ubccpd.ca/files/2015-Report-Rural-EM-Needs-Assessment.pdf [Google Scholar]
- 2.Greenwood M, de Leeuw S, Lindsay N. Challenges in health equity for Indigenous peoples in Canada. The Lancet. 2018;391(10131):1645-1648. [DOI] [PubMed] [Google Scholar]
- 3.Government of British Columbia . Rural Practice Subsidiary Agreement [Internet]. 2022. Available from: https://www2.gov.bc.ca/gov/content/health/practitioner-professional-resources/physician-compensation/rural-practice-programs/rural-practice-subsidiary-agreement [Google Scholar]
- 4.Rural Coordination Centre of British Columbia . RSA Communities [Internet]. Rural Coordination Centre of British Columbia. 2021. Available from: https://rccbc.ca/rccbc/about-the-jsc/rsa-communities/ [Google Scholar]
- 5.Turpel-Lafond M. In Plain Sight: Addressing Indigenous-specific Racism and Discrimination in B.C. Health Care [Internet], 2020. Available from: https://engage.gov.bc.ca/app/uploads/sites/613/2020/11/In-Plain-Sight-Full-Report.pdf [Google Scholar]
- 6.McMahon M, Nadigel J, Thompson E, Glazier R. Informing Canada’s health system response to COVID-19: priorities for health services and policy research. hcpol. 2020;16(1):112–124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Ho K, Lauscher HN, Stewart K, et al. Integration of virtual physician visits into a provincial 8-1-1 health information telephone service during the COVID-19 pandemic: a descriptive study of HealthLink BC Emergency iDoctor-in-assistance (HEiDi). cmajo. 2021;9(2):E635–41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Curtis S, Martin H, DiNella M, et al. Kidney check point-of-care testing—furthering patient engagement and patient-centered care in canada’s rural and remote indigenous communities: program report. Can J Kidney Health Dis. 2021;8:205435812110037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Burke D, Pawlovich J. CODI is live! | BC Rural Update [Internet]. RCCBC (Rural Coordination Centre of BC). 2018. [cited 2021 Nov 17]. Available from: https://enews.rccbc.ca/2018/10/24/codi-is-live/ [Google Scholar]
- 10.Government of British Columbia . Helping rural, remote and Indigenous communities respond to COVID-19 [Internet]. 2020. [cited 2022 Mar 1]. Available from: https://news.gov.bc.ca/releases/2020PREM0020-000725
- 11.First Nations Health Authority . The FNHA and Province of BC Partner to Support Indigenous, Rural and Remote Communities during COVID-19 [Internet]. 2020. [cited 2022 Mar 1]. Available from: https://www.fnha.ca/about/news-and-events/news/helping-rural-remote-and-indigenous-communities-respond-to-covid-19 [Google Scholar]
- 12.Rural Coordination Centre of British Columbia . Partnership Pentagram Plus [Internet]. 2021. [cited 2022 Mar 1]. Available from: https://rccbc.ca/rccbc/about-rccbc/how-we-work/ [Google Scholar]
- 13.Boelen C. Towards Unity for Health: Challenges and Opportunities for Partnership in Health Development: A Working Paper [Internet]. World Health Organization; 2000. Available from: https://apps.who.int/iris/handle/10665/66566 [Google Scholar]
- 14.Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health. 2011;38(1):44-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Cargo M, Mercer SL. The value and challenges of participatory research: strengthening its practice. Annu Rev Public Health. 2008;29(1):325-350. [DOI] [PubMed] [Google Scholar]
- 16.Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(S1):S40-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.University of British Columbia Digital Emergency Medicine . Real-time virtual support: year one evaluation report. 2021. Available from: https://www.bcemergencynetwork.ca/wp-content/uploads/2022/06/2021-07-09-RTVS-Year-1-Evaluation-Report-v4.0.pdf
- 18.Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. The Annals of Family Medicine. 2014;12(6):573-576. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Markham R, Hunt M, Woollard R, et al. Addressing rural and indigenous health inequities in Canada through socially accountable health partnerships. BMJ Open. 2021;11(11):e048053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Boelen C, Woollard R. Social accountability: the extra leap to excellence for educational institutions. Medical Teacher. 2011;33(8):614-619. [DOI] [PubMed] [Google Scholar]
- 21.BC Patient Safety & Quality Council . BC Health Quality Matrix [Internet], 2020. [cited 2022 Mar 1]. Available from: https://bcpsqc.ca/resource/bc-health-quality-matrix/ [Google Scholar]
- 22.Glaser BG, Strauss AL. The Discovery of Grounded Theory: Strategies for Qualitative Research [Internet]. 1st ed. Routledge; 2017. [cited 2022 Mar 1]. Available from: https://www.taylorfrancis.com/books/9781351522168 [Google Scholar]
- 23.Panel on Research Ethics . Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans – TCPS 2 (2018) [Internet], 2020. Available from: https://ethics.gc.ca/eng/policy-politique_tcps2-eptc2_2018.html [Google Scholar]
- 24.Speyer R, Denman D, Wilkes-Gillan S, et al. Effects of telehealth by allied health professionals and nurses in rural and remote areas: A systematic review and meta-analysis. J Rehabil Med. 2018;50(3):225-235. [DOI] [PubMed] [Google Scholar]
- 25.Canadian Medical Association . What Canadians Think About Virtual Health Care [Internet]. 2020. Available from: https://www.cma.ca/sites/default/files/pdf/virtual-care/cma-virtual-care-public-poll-june-2020-e.pdf [Google Scholar]
- 26.Canadian Medical Association . Virtual Care is Real Care: National Poll Shows Canadians are Overwhelmingly Satisfied With Virtual Healthcare. [Internet]. Canadian Medical Association. 2020. Available from: https://www.cma.ca/news/virtual-care-real-care-national-poll-shows-canadians-are-overwhelmingly-satisfied-virtual [Google Scholar]
- 27.(Zhirui) Li C, Borycki EM, Kushniruk AW. Connecting the world of healthcare virtually: a scoping review on virtual care delivery. Healthcare. 2021;9(10):1325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Kruse CS, Krowski N, Rodriguez B, Tran L, Vela J, Brooks M. Telehealth and patient satisfaction: a systematic review and narrative analysis. BMJ Open. 2017;7(8):e016242. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Lavoie JG, Wong ST, Ibrahim N, O’Neil JD, Green M, Ward A. Underutilized and undertheorized: the use of hospitalization for ambulatory care sensitive conditions for assessing the extent to which primary healthcare services are meeting needs in British Columbia First Nation communities. BMC Health Serv Res. 2019;19(1):50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Johnston CS, Belanger E, Wong K, Snadden D. How can rural community-engaged health services planning achieve sustainable healthcare system changes? BMJ Open. 2021;11(10):e047165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.United Nations . United Nations Declaration on the Rights of Indigenous Peoples. 2007. www.un.org/development/desa/indigenouspeoples/wp-content/uploads/sites/19/2018/11/UNDRIP_E_web.pdf. Accessed 30 April 2023. [Google Scholar]
- 32.Truth and Reconciliation Commission of Canada . Calls to Action. 2015. https://ehprnh2mwo3.exactdn.com/wpcontent/uploads/2021/01/Calls_to_Action_English2.pdf. Accessed 30 April 2023. [Google Scholar]
- 33.Breton M, Sullivan EE, Deville-Stoetzel N, et al. Telehealth challenges during COVID-19 as reported by primary healthcare physicians in Quebec and Massachusetts. BMC Fam Pract. 2021;22(1):192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Friedman CP, Allee NJ, Delaney BC, et al. The science of Learning Health Systems: Foundations for a new journal: The science of Learning Health Systems: Foundations for a new journal. Learn Health Sys. 2017;1(1):e10020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Menear M, Blanchette M-A, Demers-Payette O, Roy D. A framework for value-creating learning health systems. Health Res Policy Sys. 2019;17(1):79. [DOI] [PMC free article] [PubMed] [Google Scholar]
