Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2020 Aug 26;17(17):6183. doi: 10.3390/ijerph17176183

An Online Training Intervention on Prehospital Stroke Codes in Catalonia to Improve the Knowledge, Pre-Notification Compliance and Time Performance of Emergency Medical Services Professionals

Montse Gorchs-Molist 1,2,*, Silvia Solà-Muñoz 1, Iago Enjo-Perez 2,*, Marisol Querol-Gil 1, David Carrera-Giraldo 3, Jose María Nicolàs-Arfelis 2, Francesc Xavier Jiménez-Fàbrega 1,2, Natalia Pérez de la Ossa 4
PMCID: PMC7503298  PMID: 32858885

Abstract

Strokes are a time-dependent medical emergency. The training of emergency medical service (EMS) professionals is essential to ensure the activation of stroke codes with pre-notification, as well as a rapid transfer to achieve early therapy. New assessment scales for the detection of patients with suspected large vessel occlusion ensures earlier access to endovascular therapy. The aim of this study was to evaluate the impact on an online training intervention focused on the Rapid Arterial oCclusion Evaluation (RACE) scoring of EMS professionals based on the prehospital stroke code in Catalonia from 2014 to 2018 in a pre–post intervention study. All Catalonian EMS professionals and the clinical records from primary stroke patients were included. The Kirkpatrick model guided the evaluation of the intervention. Data were collected on the knowledge on stroke recognition and management, pre-notification compliance, activated stroke codes and time performance of EMS professionals. Knowledge improved significatively in most items and across all categories, reaching a global achievement of 82%. Pre-notification compliance also improved significantly and remained high in the long-term. Increasingly higher notification of RACE scores were recorded from 60% at baseline to 96.3% in 2018, and increased on-site clinical care time and global time were also observed. Therefore, the online training intervention was effective for increasing EMS professionals’ knowledge and pre-notification compliance upon stroke code activation, and the wide adoption of a new prehospital scale for the assessment of stroke severity (i.e., the RACE scale) was achieved.

Keywords: stroke, prehospital emergency care, training, stroke code, large vessel occlusion, prehospital scales

1. Introduction

Strokes are a time-dependent medical emergency, in which treatment delay negatively influences patient prognosis [1]. For acute ischemic stroke patients with an evolution of less than 4.5 h of evolution, fibrinolysis therapy improves prognosis [2], yet its benefits are limited for the subgroup of patients with large vessel occlusion (LVO) [3]. These patients benefit the most from endovascular thrombectomy, with a therapeutic window of up to 24 h from stroke onset according to multimodal neuroimaging criteria, at an adequate specialized tertiary hospital, which doubles their chances of clinical improvement [4]. For this reason, in recent years, stroke code (SC) systems have been developed to rapidly identify patients with acute stroke, allowing agile transfers to a specialized center [5,6]. This rapid assessment of acute stroke patients is paramount to obtaining the maximum benefits from reperfusion therapies. Thus, emergency medical services (EMS) are essential [7], not only for identifying stroke patients, but also for identifying a subgroup of patients with suspected large vessel occlusion (LVO), who would benefit the most from endovascular treatment [8]. The traditional prehospital assessment scales were developed to detect the typical symptoms of stroke patients [9]. Since then, several new scales for the specific detection of LVO patients have been designed, but few have been validated prospectively in prehospital care [10]. Implementing these new prehospital diagnostic tools as part of SCs is a priority to ensure familiarity with the protocol and to achieve current therapeutic standards [11]. Giving pre-notification of patients to the receiving center is also important to ensure allocation of in-hospital resources and to accelerate diagnostic and therapeutic decision-making through a minimum set of clinical data [12]. Additionally, international guidelines also emphasized the need to prioritize specific training in SCs, diagnostic tools and pre-notification systems for EMS professionals [13,14,15]. Following these recommendations, our group developed the Rapid Arterial oCclusion Evaluation (RACE) [16] scale for prehospital assessment of patients with a suspected LVO stroke (Figure S1). The RACE scale was validated in 2014, and international guidelines endorsed the RACE scale as a valid tool alongside others [17,18]. For implementation by EMS professionals, an online training intervention (OTI) was designed to update their knowledge on acute stroke recognition and the SC activation circuit, as well as to train them on the administration of the RACE scale.

The aim of this study was to evaluate the impact on an OTI focused on the RACE scoring for EMS professionals based on prehospital SCs in Catalonia from 2014 to 2018.

2. Materials and Methods

We performed a pre–post intervention study from January 2014 to December 2018 in the Catalonian EMS (prehospital care). This EMS provides care for 7.5 million people, employing more than 4000 professionals, and it activated approximately eight daily SCs before 2014. For this study, we included data from both EMS professionals and stroke patients. All EMS professionals (i.e., emergency technicians, nurses, and physicians) were invited to participate, and all of those who accepted were included, as no exclusion criteria were considered. A non-probabilistic sampling method was used. All clinical records of patients older than 18 years old and classified as primary acute stroke patients upon activation of SCs by the dispatch center were included. Records of patients who were being transferred between hospital settings were excluded.

2.1. Online Training Intervention

An online training intervention (OTI) was developed to provide 6 h of training through a learning management system (i.e., Moodle). The programme comprised four modules: Three theoretical modules that addressed the (a) signs and symptoms of a stroke, (b) stroke treatment, and (c) prehospital management of stroke, including the administration of prehospital scales and SC protocol; the final module was practical, and was introduced to address the application of the RACE scale using five clinical scenarios. The contents and evaluation methods considered the recommendations of the Cerebrovascular Disease Master Plan in Catalonia to attain content validity. Additionally, international recommendations from the European and American Stroke Organizations were incorporated into the curriculum. A pilot test was performed with an interprofessional group of 30 individuals that included neurologists and EMS professionals (i.e., physicians, nurses, and emergency technicians) between March and April 2014. The training was accredited by the regional council for the continuous education of healthcare professionals.

The OTI was administered progressively according to the Catalonian healthcare regions. All professionals from the same region participated in the course simultaneously for a 30-day period with on-demand access to the training platform. Fourteen replications of the training program were necessary to cover all regions and professionals. The training was completed by 2830 EMS professionals from May to September 2014. All EMS professionals were supported by forum interactions with the faculty, and additional resources were provided. A collaboration network was established by developing a Facebook group, a Twitter account (@escalaRACE), and a website (www.racescale.org).

2.2. Assessment of the Online Training Programme

The variables measuring the effectiveness of the OTI with regard to prehospital SCs were categorized using Kirkpatrick’s [19,20] model of training evaluation as follows:

  • Kirkpatrick level 1 (reaction): A satisfaction survey (Supplementary material S2) was administered at the end of the training using a five-point Likert scale based on five dimensions. Satisfaction of the aims of the training, the available materials, the RACE scale usefulness in clinical practice, and the faculty, as well as the overall satisfaction regarding the perceived increased in knowledge or competency, were addressed.

  • Kirkpatrick level 2 (learning): A knowledge-related multiple-choice questionnaire about knowledge was administered prior to and 3 months after the intervention (Supplementary material S3). A set of 24 questions were used, most of which (i.e., 10) were related to the identification of signs and symptoms of a stroke, as well as available treatment options. Eight questions explored respondents’ knowledge on the SC protocol, prehospital management, and prehospital assessment scales for stroke patients. A final set of six questions were used to analyze the decision-making on acute stroke medical emergencies in clinical scenarios.

  • Kirkpatrick level 3 (behavior): The transfer to clinical practice was measured by compliance rates with the EMS prenotification system (i.e., Minimum Data Set register). We observed the notification of the patient’s identification number, the time of the onset of symptoms, anticoagulant treatment, glycaemia, systolic and diastolic blood pressure, and RACE scores.

  • Kirkpatrick level 4 (results): The impact of the intervention on prehospital SC was assessed by determining the number of activated codes and the changes in prehospital care times. The observed times were: (a) The alert time, that is, the period between the start and the end of a call; (b) the activation time, that is, the time from the start of a call to the allocation of clinical resources; (c) the response time, that is, the period from resource allocation to the arrival of the EMS team; (d) the care time, that is, the time from the arrival at the place of care to the start of the transfer; (e) the transfer time, that is, the period from the start of the transfer to the arrival at the receiving center; and (f) a global time was also registered.

2.3. Data Collection

This study was performed at five time-points: (a) Baseline (first quarter of 2014 (Q1)), (b) training intervention (second (Q2) and third quarter (Q3) of 2014), (c) immediate follow-up (fourth quarter of 2014 (Q4)), (d) follow-up after 1–2 years (2015–2016), and (e) follow-up after 3–4 years (2017–2018). The period between 2014 Q1 (baseline) and Q4 (immediate follow-up) was used to pilot the training intervention (March to April 2014); and to train the EMS professionals (May to September 2014).

Data from EMS professionals were obtained on the same learning management system (i.e., Moodle) on which the course was provided. Socio-demographics were obtained at the beginning of the intervention (i.e., 2014 Q2 and Q3). Data on Kirkpatrick level 1 was recorded at the end of the intervention (i.e., 2014 Q2 and Q3). Kirkpatrick level 2 data were obtained at the beginning of the intervention (i.e., 2014 Q2 and Q3), and 3 months after the end of the training (2014 Q4). Data on all results from Kirkpatrick levels 3 and 4 were obtained through the Informatic System for Emergency Management (SITREM®) register between 2014 and 2018 (all periods except the intervention, that is, 2014 Q2 and Q3). This register prospectively records information about all Catalonian EMS activity, including details on SC activation, patients, time of call, first time of care, and arrival at the receiving hospital. From September 2014, RACE scores were also included in the register.

The data were processed in compliance with the European Data Protection Regulation 2016/679. The study was approved by the Clinical Research Ethics Committee of the University Hospital Germans Trias i Pujol (Badalona, Spain) with identification code PI-15-030.

2.4. Statistical Analysis

The results are expressed in means and standard deviations (SDs) for quantitative variables, and absolute frequencies and percentages for qualitative variables.

The Student’s t-test was used for the comparative analysis of paired data. A p-value of <0.05 was considered statistically significant. Data were analyzed with the statistical software program SPSS version 24.0 (SPSS Inc.; Chicago, IL, USA).

3. Results

A total of 2830 EMS professionals undertook the training programme, and 69.5% completed the baseline questionnaire while 53.2% answered the three-month follow-up (Figure 1). The majority were males (76.7%) with a mean age of 35.8 years (SD = 6.3) and more than 10 years of experience in EMS (45.4%). Emergency medical technicians accounted for 90.3% of the staff, followed by nurses (6.4%) and then physicians (3.2%). Most of them worked as care providers (98.3%) and only 1.7% did so in the dispatch center. Meanwhile, 65% had received previous training on strokes. The satisfaction survey (Kirkpatrick level 1) at the end of the training was completed by 2668 (94.3%), scoring at least 4 out of 5 in all items.

Figure 1.

Figure 1

Flowchart of emergency medical services (EMS) professionals’ participation.

3.1. Learning Assessment (Kirkpatrick Level 2)

After the OTI, there was a significant increase in 80% of the questions related to the recognition of the signs and symptoms of a stroke (Table 1), especially for those addressing location-specific signs, as well as the treatment. Two generic questions about strokes were non-significant but scored high prior to the training. The questions regarding SCs, prehospital management, and prehospital stroke assessment increased significantly, with most scores above 85%. Changes were observed in stroke recognition, with improved identification in 5/6 of the clinical scenarios.

Table 1.

Differences in the responses to the knowledge multiple-choice test.

Topics Baseline (n = 1968) After Training (n = 1506) p-Value
(% Correct) (% Correct) (* <0.05)
Signs and symptoms of a stroke 1960 (99.6) 1500 (99.7) 0.97
Ischemic stroke etiology 1934 (98.3) 1483 (98.5) 0.645
Hemorrhagic stroke etiology 1891 (96.1) 1491 (99.1) <0.001 *
Left hemisphere stroke signs/symptoms 1029 (5.2) 925 (61.4) <0.001 *
Right hemispheres stroke signs/symptoms 267 (13.7) 615 (40.9) <0.001 *
Transient ischemic attack definition 1272 (64.6) 1024 (68.0) 0.038 *
Brainstem stroke signs/symptoms 1245 (63.2) 1240 (82.3) <0.001 *
Window for thrombolysis 689 (35.0) 774 (51.4) <0.001 *
Endovascular indications 974 (49.5) 1022 (67.9) <0.001 *
Benefits of stroke treatment 1027 (52.2) 1209 (80.3) <0.001 *
Aim of the stroke code 1833 (93.1) 1446 (96.0) <0.001 *
Target age for the stroke code 1510 (76.7) 1430 (95.0) <0.001 *
Time criteria from onset to code activation 1247 (63.3) 1322 (87.8) <0.001 *
Criteria for activation of the stoke code 1251 (63.6) 1341 (89.1) <0.001 *
Recognition of comorbidity scales 403 (40.1) 906 (60.2) <0.001 *
Recognition of stroke diagnostic scales 1186 (50.3) 1393 (92.5) <0.001 *
RAPID 1 scale recognition 1033 (52.5) 1236 (82.1) <0.001 *
RANCOM 2 scale recognition 1616 (82.1) 1390 (92.3) <0.001 *
Hypertension and nausea 1298 (65.9) 961 (63.8) 0.189
Transient ischemic attack 1534 (77.9) 1277 (84.8) <0.001 *
90 years. 5 h start of symptoms 1515 (77.0) 1364 (90.6) <0.001 *
Treatment with anticoagulants 1560 (79.3) 1288 (85.5) <0.001 *
Awakening stroke 1644 (83.5) 1430 (95.0) <0.001 *
RANCOM 2 scale 1309 (66.5) 1145 (76.0) <0.001 *

1 The smile, raise the arm, talk, stroke, call 911 fast mnemotechnic (i.e., RAPID) is a Catalan stroke assessment tool, equivalent to the FAST mnemotechnic in English-speaking countries. 2 Rankin Comorbidity (i.e., RANCOM) is a Catalan comorbidity scale for prehospital assessment of stroke patients. * p < 0.05.

3.2. Transfer to the Clinical Setting (Kirkpatrick Level 3)

The Minimum Data Set (MDS) records available in the SITREM® register were analyzed for 17,135 patients in the study period (Table 2). Immediately after the training, we found a significant increase in the registration of patient identification (ID) codes, glycaemia, systolic and diastolic blood pressure (SBP/DBP), and RACE scores, yet notification of the time of the onset of symptoms decreased. For the 2015–2016 follow-up, only the patient ID and RACE records continued to increase, in contrast to the time of symptom onset (TSO), SBP and DBP. There were significant differences for all items in the 2017–2018 follow-up period: All items increased (i.e., TSO, glycaemia, ID, SBP, DBP, and RACE notification), and the frequency of anticoagulant treatment notification decreased. Overall, 71.5% of the items increased from baseline to the last follow-up. Only the registration of TSO and the notification of anticoagulant treatment diminished consistently over time.

Table 2.

Differences in the pre-notification items from the Minimum Data Set register over time.

Item Baseline (2014) Immediately after Training (2014 Q4) Immediately after Training (2014 Q4) 1–2 Years after Training (2015–2016) 1–2 Years after Training (2015–2016) 3–4 Years after Training (2017–2018)
n = 834 n = 965 n = 965 n = 7261 n = 7261 n = 8075
n (%) n (%) p-Value n (%) n (%) p-Value n (%) n (%) p-Value
Patient identification no. 460 (55.2%) 632 (65.5%) <0.001 * 632 (65.5%) 4998 (68.8%) 0.036 * 4998 (68.8%) 6904 (85.5%) <0.001 *
Time from onset of symptoms 714 (85.6%) 759 (78.7%) <0.001 * 759 (78.7%) 5305 (73.1%) <0.001 * 5305 (73.1%) 6211 (76.9%) <0.001 *
Anticoagulant therapy 704 (84.4%) 809 (83.8%) 0.738 809 (83.8%) 6237 (85.9%) 0.086 6237 (85.9%) 6327 (78.3%) <0.001 *
Glycaemia 246 (29.5%) 672 (69.6%) <0.001 * 672 (69.6%) 4922 (67.8%) 0.247 4922 (67.8%) 6524 (80.8%) <0.001 *
Systolic blood pressure 255 (30.6%) 711 (73.7%) <0.00 1* 711 (73.7%) 5043 (69.5%) 0.009 * 5043 (69.5%) 7007 (86.8%) <0.001 *
Diastolic blood pressure 254 (30.5%) 711 (73.7%) <0.001 * 711 (73.7%) 5044 (69.5%) 0.007 * 5044 (69.5%) 6516 (80.7%) <0.001 *
RACE scores --------------- 588 (60.9%) 588 (60.9%) 5165 (71.1%) <0.001 * 5165 (71.1%) 7350 (91.0) <0.001 *

RACE, Rapid Arterial oCclusion Evaluation; * p < 0.05.

Compliance with the RACE scale upon SC activation increased continuously over time. Starting from 60.9% immediately after training, compliance rose to over 85% by the 2017–2018 follow-up, reaching a 96.3% compliance level in 2018.

3.3. Impact on Prehospital Stroke Code (Kirkpatrick Level 4)

3.3.1. Stroke Code Activation

Activation of SCs increased over time. At baseline (2014 Q1), 9.2 codes were activated daily (n = 834), which increased immediately after training (2014 Q4) to 10.7 (n = 965), maintaining at 9.9 in both 2015 (n = 2635) and 2016 (n = 3635). In 2017, 10.6 codes were initiated (n = 3888), which reached a daily maximum of 11.4 (n = 4187) in 2018.

3.3.2. Time Performance in Stroke Code

The main differences in time performance were the overall time of prehospital care (Table 3), which increased from 48.9 to 53.6 min (p = 0.015). This extra time was mostly due to increased on-site clinical care time (p = 0.034) prior to transfer to hospital, which increased from 21.5 to 24.3 min. However, there were no changes in activation, alert, response, or transfer times.

Table 3.

Differences in time performance over time.

Item Baseline
(2014 Q1)
n = 834
Immediately after Training (2014 Q4) n = 965 1–2 Years after Training (2015–2016)
n = 7261
3–4 Years after Training (2017–2018)
n = 8075
95%CI of the Difference p-Value
Mean (SD) Mean (SD) Mean (SD) Mean (SD)
Alert time 1 3.10 (6.7) 2.96 (5.6) 2.90 (5.8) 3.13 (6.1) −0.25 to 0.56 0.877
Activation time 2 4.78 (7.1) 4.97 (6.7) 4.86 (7.0) 5.35 (7.6) −1.64 to 0.73 0.053
Response time 3 8.08 (4.9) 8.68 (5.3) 8.57 (5.6) 8.70 (6.0) −0.34 to 1.23 0.083
Clinical care time 4 21.51 (8.4) 21.87 (8.3) 22.24 (8.9) 24.32 (8.9) 0.75 to 3.27 0.034 *
Transfer time 5 12.29 (10.1) 13.11 (10.6) 12.73 (10.3) 12.86 (11.2) −1.51 to 1.66 0.402
Overall time 6 48.9 (19.9) 51.60 (19.5) 51.52 (19.6) 53.62 (20.0) 1.04 to 5.33 0.015 *

1 Alert time: The time between the start and the end of a call at the dispatch center. 2 Activation time: The time from the start of a call to the allocation of clinical resources at the dispatch center. 3 Response time: The period from the resource allocation to the arrival of the EMS team at point of care. 4 Clinical care time: The time from the arrival of the EMS team at the point of care to the start of transfer; on-site care is provided. 5 Transfer time: The time of transportation from the point of care to arrival at the receiving center. 6 Overall time: The sum of all previous times. CI, confidence interval; SD standard deviation. * p < 0.05.

4. Discussion

Time is brain when dealing with acute stroke patients. International Stroke Organizations advocate for the development of specific training programs for healthcare professionals, as those who have not been trained specifically on strokes contribute to delay patients’ access to adequate therapy [21]. On the other hand, the Stroke Alliance for Europe advocates for a systematic approach to continuous education in EMS as one of their 12 quality care indicators on strokes [22].

In this study, the OTI was well-received, scoring high in satisfaction (Kirkpatrick level 1). It was associated with a knowledge gain for all categories (Kirkpatrick level 2), as observed in similar studies with EMS professionals [23,24,25]. Participants accurately identified the signs and symptoms of a stroke and became aware of the differences between hemorrhagic and ischemic strokes. On the other hand, very few improvements were observed in recognizing transient ischemic attacks. Despite most EMS professionals (65%) having had previous education on strokes, a lot of heterogeneity was found at baseline for the recognition of very specific signs and symptoms. This training improved their competency, which is consistent with the improvements in knowledge observed by Hsieh et al. [23] in Taiwan, where 48% had previously received training. The window for thrombolytic therapy was only identified by a third of the participants, and half signaled the indications for endovascular treatment. However, these items might be very specific, which could explain the low number of correct answers in our case, or why a similar study in Dubai [24], received no correct responses for these questions. It should be noted that while diagnostic and comorbidity scales determine the activation of the SCs, only 50.3% and 40.1%, respectively, were familiarized with them, which is similar to the finding of DiBiasio in Rhode Island [25]. An integrative review [26] on the impact of training programs on strokes found that only 1 of 21 courses was taught online. In that single UK-based study (RESPONSE [27]), there was a greater improvement in knowledge compared to our findings (95.6% vs. 82%), while the response rates varied (39% vs. 54%). These differences could be explained by the fact that our study managed to include a greater percentage of EMS professionals and that the context of the education was different. Most professionals in RESPONSE were paramedics (55%), who had received 2–5 years of university training (Paramedic Sciences), in contrast to our 90.3% participation of emergency technicians, who had received a 2-year non-university qualification. This could also explain some of the very low scores at baseline when recognizing specific stroke signs and symptoms.

Improving pre-notification systems in SCs is essential for ensuring the allocation of in-hospital resources and for accelerating communication between EMS teams and receiving hospitals [28]. We observed a progressive improvement in the compliance with the pre-notification register in 80% of the items, increasing from an overall 53% compliance score in 2014 to a 73% in 2015–2016, and 83% in 2017–2018 (Kirkpatrick level 3). This increment was greater than in another study performed in the USA [29] that achieved an increase from 60.9% to 77.3%; the last peak of 10% increase in our case could have been due to the start of RACECAT, a clinical trial focused on different transfer approaches for stroke patients. Pre-notifications systems have also been found effective in improving in-hospital times for therapy access [30,31]. We observed fewer notifications of TSO, which could be explained by the presence of more cases of awakening strokes in the last period (2017–2018).

New specific scales for LVO patients have been created, but most are still uncommon in EMS [32,33,34]. Our group developed and validated the RACE scale [12] in 2014, which has received endorsement by international guidelines [35,36,37]. We documented a great compliance with the prehospital assessment of LVO patients with the RACE scale, starting at 61% immediately after training (Kirkpatrick level 3), up to 71% at the 1- to 2-year follow-up, and 91% in the 3- to 4-year follow-up. During the last year (i.e., 2018) compliance reached 96.3%, which is similar to that found in a study in Ohio (USA) [38] that reached 100% compliance in recoding RACE scores. The results of studies using other scales for LVO recognition are varied; for example, an Australian study [39] reached 88% notification, while another study involving multiple EMS agencies involved only provided data in 53% of the cases. In our study, support from the EMS directorate and continuous education department, as well as the inclusion of the RACE scores in the EMS clinical register (i.e., SITREM®), were paramount to achieving these positive long-term results.

Acute strokes are a time-dependent medical emergency where time between the onset of symptoms and treatment is essential. We recorded changes in prehospital care time as overall prehospital care time, which increased by 4.7 min (Kirkpatrick level 4). Additionally, on-site clinical care time increased by 2.8 min. A UK study, PASTA [40], showed an increase in time from assessment to thrombolysis by 8.5 min after a specific training programme for paramedics. Another UK project [41] focused on training at the dispatch center revealed a non-significant 2.8 min reduction in the time between alert activation to the arrival of the ambulance. The benefits of patient assessment using the RACE and the obtained pre-registration data (i.e., vital signs, assessment of stroke severity, and RACE scores) could outweigh the slight increase in the overall prehospital care time.

However, this study has some limitations. First, it was limited to the prehospital setting. Second, the correlation between the RACE score at prehospital assessment and endovascular therapy effectiveness remains unknown. Finally, we have no data on the prognosis and evolution of the stroke patients (i.e., final diagnosis, false positives or negatives, stroke mimics, and reperfusion therapy rates). Future studies should seek to include further in-hospital clinical variables.

5. Conclusions

An interprofessional OTI on strokes in the Catalonian EMS was effective in increasing the participants’ knowledge on cerebrovascular medical emergencies. Both strengths and areas for improvement were detected for future training opportunities. This study had a positive long-term impact on prehospital compliance with the pre-notification system upon SC activation. This training intervention permitted the wide adoption of a new prehospital scale for the assessment of stroke severity (i.e., the RACE scale), reaching high notification compliance.

These results encouraged the Catalonian EMS to maintain this training intervention in their continuous education program, which, starting back in 2015, is delivered twice a year.

Supplementary Materials

The following are available online at https://www.mdpi.com/1660-4601/17/17/6183/s1, Figure S1: Summary table RACE Scale and Instructions to evaluate the RACE scale, S2: satisfaction survey, S3: knowledge-related multiple-choice questionnaire.

Author Contributions

Conceptualization, N.P.d.l.O. and F.X.J.-F.; methodology, M.G.-M., S.S.-M. and I.E.-P.; validation, M.G.-M., S.S.-M. and J.M.N.-A.; formal analysis, M.G.-M. and S.S.-M.; investigation, M.G.-M., D.C.-G. and M.Q.-G.; resources, N.P.; data curation, M.G.-M., S.S.-M. and I.E.-P.; writing—original draft preparation, M.G.-M. and I.E.-P.; writing—review and editing, I.E.-P. and S.S.-M.; visualization, M.G.-M.; supervision, N.P.d.l.O. and F.X.J.-F.; project administration, N.P.d.l.O. and F.X.J.-F.; funding acquisition, N.P.d.l.O. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Spanish Ministry of Health, Instituto de Salud Carlos III (Fondo de Investigación En Salud), grant number PI13/02041.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of the data; in the writing of the manuscript, or in the decision to publish the results.

References

  • 1.Stroke Unit Trialists’ Collaboration Organised inpatient (stroke unit) care for stroke. Cochrane Database. Syst. Rev. 2013;2013:CD000197. doi: 10.1002/14651858.CD000197.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Emberson J., Lees K.R., Lyden P., Blackwell L., Albers G., Bluhmki E., Brott T., Cohen G., Davis S., Donnan G., et al. Effect of treatment delay, age, and stroke severity on the effects of intravenous thrombolysis with alteplase for acute ischemic stroke: A meta-analysis of individual patient data from randomized trials. Lancet. 2014;384:1929–1935. doi: 10.1016/S0140-6736(14)60584-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Goyal M., Menon B.K., van Zwam W.H., Dippel D., Mitchell P.J., Demchuk A.M., Dávalos A., Majoie C.H., van der Lugt A., de Miquel M.A., et al. Endovascular thrombectomy after large-vessel ischaemic stroke: A meta-analysis of individual patient data from five randomised trials. Lancet. 2016;387:1723–1731. doi: 10.1016/S0140-6736(16)00163-X. [DOI] [PubMed] [Google Scholar]
  • 4.XLin Y., Schulze V., Brockmeyer M., Parco C., Karathanos A., Heinen Y., Gliem M., Hartung H.P., Antoch G., Jander S., et al. Endovascular Thrombectomy as a Means to Improve Survival in Acute Ischemic Stroke: A Meta-analysis. JAMA Neurol. 2019:6–10. doi: 10.1001/jamaneurol.2019.0525. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.De Luca A., Toni D., Lauria L., Sacchetti M.L., Giorgi Rossi P., Ferri M., Puca E., Prencipe M., Guasticchi G., The “IMPLementazione Percorso Clinico Assistenziale ICtus Acuto (IMPLICA) Study Group” An emergency clinical pathway for stroke patients—Results of a cluster randomized trial (isrctn41456865) BMC Health Serv. Res. 2009;9:1–10. doi: 10.1186/1472-6963-9-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Baldereschi M., Piccardi B., Di Carlo A., Lucente G., Guidetti D., Consoli D., Toni D., Sacchetti M.L., Polizzi B.M., Inzitari D., et al. Relevance of Prehospital Stroke Code Activation for Acute Treatment Measures in Stroke Care: A Review. Cerebrovasc. Dis. 2012;10:182–190. doi: 10.1159/000341856. [DOI] [PubMed] [Google Scholar]
  • 7.Crocco T.J., Grotta J.C., Jauch E.C., Kasner S.E., Kothari R.U., Larmon B.R., Saver J.L., Sayre M.R., Davis S.M. EMS management of acute stroke—Prehospital triage (resource document to NAEMSP position statement) Prehospital Emerg. Care. 2007;11:313–317. doi: 10.1080/10903120701347844. [DOI] [PubMed] [Google Scholar]
  • 8.Powers W.J., Derdeyn C.P., Biller J., Coffey C.S., Hoh B.L., Jauch E.C., Johnston K.C., Johnston S.C., Khalessi A.A., Kidwellet C.S., et al. 2015 American Heart Association/American Stroke Association Focused Update of the 2013 Guidelines for the Early Management of Patients with Acute Ischemic Stroke Regarding Endovascular Treatment: A Guideline for Healthcare Professionals from the American Heart Association/American Stroke Association. Stroke. 2015;46:3020–3035. doi: 10.1161/STR.0000000000000074. [DOI] [PubMed] [Google Scholar]
  • 9.Zhelev Z., Walker G., Henschke N., Fridhandler J., Yip S. Prehospital stroke scales as screening tools for early identification of stroke and transient ischemic attack. Cochrane Database Syst. Rev. 2019;4:CD011427. doi: 10.1002/14651858.CD011427.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Smith E.E., Kent D.M., Bulsara K.R., Leung L.Y., Lichtman J.H., Reeve M.J., Towfighi A., Whiteley W.N., Zahuranec D.B. Accuracy of prediction instruments for diagnosing large vessel occlusion in individuals with suspected stroke: A systematic review for the 2018 guidelines for the early management of patients with acute ischemic stroke. Stroke. 2018;49:e111–e122. doi: 10.1161/STR.0000000000000160. [DOI] [PubMed] [Google Scholar]
  • 11.Turc G., Bhogal P., Fischer U., Khatri P., Lobotesis K., Mazighi M., Schellinger P.D., Toni D., de Vries J., White P., et al. European Stroke Organisation (ESO)—European Society for Minimally Invasive Neurological Therapy (ESMINT) Guidelines on Mechanical Thrombectomy in Acute Ischaemic StrokeEndorsed by Stroke Alliance for Europe (SAFE) Eur. Stroke J. 2019;4:6–12. doi: 10.1177/2396987319832140. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Lin C.B., Peterson E.D., Smith E.E., Saver J.L., Liang L., Xian Y., Olson M.D., Shah B.R., Hernandez A.F., Schwamm L.H., et al. Emergency medical service hospital prenotification is associated with improved evaluation and treatment of acute ischemic stroke. Circ. Cardiovasc. Qual. Outcomes. 2012;5:514–522. doi: 10.1161/CIRCOUTCOMES.112.965210. [DOI] [PubMed] [Google Scholar]
  • 13.Jauch E.C., Saver J.L., Chair V., Adams H.P., Bruno A., Connors J., Demaerschalk B.M., Khatri P., McMullan P.W., Qureshi A.I., et al. AHA/ASA Guidelines for the Early Management of Patients With Acute Ischemic Stroke A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Am. Hear. Assoc Stroke Counc. 2013;44:870–947. doi: 10.1161/STR.0b013e318284056a. [DOI] [PubMed] [Google Scholar]
  • 14.Kobayashi A., Czlonkowska A., Ford G.A., Fonseca A.C., Luijckx G.J., Korv J., Pérez de la Ossa N., Price C., Russell D., Tsiskaridze A., et al. European Academy of Neurology and European Stroke Organization consensus statement and practical guidance for pre-hospital management of stroke. Eur. J. Neurol. 2018;25:425–433. doi: 10.1111/ene.13539. [DOI] [PubMed] [Google Scholar]
  • 15.Boulanger J.M., Lindsay M.P., Gubitz G., Smith E.E., Stotts G., Foley N., Bhogal S., Boyle K., Braun L., Goddard T., et al. Canadian Stroke Best Practice Recommendations for Acute Stroke Management: Prehospital, Emergency Department, and Acute Inpatient Stroke Care, 6th Edition, Update 2018. Int. J. Stroke. 2018;13:949–984. doi: 10.1177/1747493018786616. [DOI] [PubMed] [Google Scholar]
  • 16.De La Ossa N.P., Carrera D., Gorchs M., Querol M., Millán M., Gomis M., Dorado L., López-Cancio E., Hernández-Pérez M., Chicharro V., et al. Design and validation of a prehospital stroke scale to predict large arterial occlusion: The rapid arterial occlusion evaluation scale. Stroke. 2014;45:87–91. doi: 10.1161/STROKEAHA.113.003071. [DOI] [PubMed] [Google Scholar]
  • 17.Pride G.L., Fraser J.F., Gupta R., Alberts M.J., Rutledge J.N., Fowler R., Ansari S.A., Abruzzo T., Albani B., Arthur A., et al. Prehospital care delivery and triage of stroke with emergent large vessel occlusion (ELVO): Report of the Standards and Guidelines Committee of the Society of Neurointerventional Surgery. J. Neurointerv. Surg. 2017;9:802–812. doi: 10.1136/neurintsurg-2016-012699. [DOI] [PubMed] [Google Scholar]
  • 18.Fiehler J., Cognard C., Gallitelli M., Jansen O., Kobayashi A., Heinrich P., Mattle H.P., Keith W., Muir K.W., Mikael Mazighi M., et al. European Recommendations on Organisation of Interventional Care in Acute Stroke (EROICAS) Int. J. Stroke. 2016;11:701–716. doi: 10.1177/1747493016647735. [DOI] [PubMed] [Google Scholar]
  • 19.Ruiz J.G., Mintzer M.J., Leipzig R.M. The impact of e-learning in medical education. Acad Med. 2006;81:207–212. doi: 10.1097/00001888-200603000-00002. [DOI] [PubMed] [Google Scholar]
  • 20.Kirkpatrick D.L. Evaluating Training Programs. The Four Levels. Berrett-Koehler; Philadelphia, PA, USA: 1998. [Google Scholar]
  • 21.Acker J.E., Pancioli A.M., Crocco T.J., Eckstein M.K., Jauch E.C., Larrabee H., Meltzer N.M., Mergendahl W.C., Munn J.W., Prentiss S.M., et al. Implementation strategies for emergency medical services within stroke systems of care: A policy statement from the American Heart Association/American Stroke Association expert panel on emergency medical services systems and the stroke council. Stroke. 2007;38:3097–3115. doi: 10.1161/STROKEAHA.107.186094. [DOI] [PubMed] [Google Scholar]
  • 22.King’s College London The Burden of Stroke in Europe. London. [(accessed on 29 October 2018)];2017 Available online: http://www.strokeeurope.eu/downloads/TheBurdenOfStrokeInEuropeReport.pdf.
  • 23.Hsieh H.-C., Hsieh C.-Y., Lin C.-H., Sung P.-S., Li C.-Y., Chi C.-H., Chen C.H. Development of an Educational Program for Staffs of Emergency Medical Service to Improve Their Awareness of Stroke within 3 Hours of Symptom Onset: A Pilot Study. Acta Neurol. Taiwan. 2013;22:4–12. [PubMed] [Google Scholar]
  • 24.Shire F., Kasim Z., Alrukn S., Khan M. Stroke awareness among Dubai emergency medical service staff and impact of an educational intervention. BMC Res. Notes. 2017;10:255. doi: 10.1186/s13104-017-2585-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.DiBiasio E.L., Jayaraman M.V., Oliver L., Paolucci G., Clark M., Watkins C., DeLisi K., Wilks A., Yaghi S., Morgan Hemendinger M., et al. Emergency medical systems education may improve knowledge of pre-hospital stroke triage protocols. J. Neurointerv. Surg. 2020;12:370–373. doi: 10.1136/neurintsurg-2018-014108. [DOI] [PubMed] [Google Scholar]
  • 26.Jones S.P., Miller C., Gibson J.M.E., Cook J., Price C., Watkins C.L. The impact of education and training interventions for nurses and other health care staff involved in the delivery of stroke care: An integrative review. Nurse Educ. Today. 2017 doi: 10.1016/j.nedt.2017.11.024. [DOI] [PubMed] [Google Scholar]
  • 27.Jones S., McLoughlin A., Watkins C. Acute stroke management: An online course. J. Paramed. Pract. 2011;3:322–327. doi: 10.12968/jpar.2011.3.6.322. [DOI] [Google Scholar]
  • 28.Oostema J.A., Nasiri M., Chassee T., Reeves M.J. The quality of prehospital ischemic stroke care: Compliance with guidelines and impact on in-hospital stroke response. J. Stroke Cerebrovasc. Dis. 2014;23:2773–2779. doi: 10.1016/j.jstrokecerebrovasdis.2014.06.030. [DOI] [PubMed] [Google Scholar]
  • 29.Oostema J.A., Chassee T., Baer W., Edberg A., Reeves M.J. Brief Educational Intervention Improves Emergency Medical Services Stroke Recognition. Stroke. 2019;50:1193–1200. doi: 10.1161/STROKEAHA.118.023885. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Bae H.J., Kim D.H., Yoo N.T., Choi J.H., Huh J.T., Cha J.K., Kim S.K., Choi J.S., Kim J.W. Prehospital notification from the emergency medical service reduces the transfer and intra-hospital processing times for acute stroke patients. J. Clin. Neurol. 2010;6:138–142. doi: 10.3988/jcn.2010.6.3.138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Mckinney J.S., Mylavarapu K., Lane J., Roberts V., Ohman-Strickland P., Merlin M.A. Hospital prenotification of stroke patients by emergency medical services improves stroke time targets. J. Stroke Cerebrovasc. Dis. 2013;22 doi: 10.1016/j.jstrokecerebrovasdis.2011.06.018. [DOI] [PubMed] [Google Scholar]
  • 32.Teleb M.S., Ver Hage A., Carter J., Jayaraman M.V., McTaggart R.A. Stroke vision, aphasia, neglect (VAN) assessment-a novel emergent large vessel occlusion screening tool: Pilot study and comparison with current clinical severity indices. J. Neurointerv. Surg. 2017;9:122–126. doi: 10.1136/neurintsurg-2015-012131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Schlemm L., Ebinger M., Nolte C.H., Endres M. Impact of prehospital triage scales to detect large vessel occlusion on resource utilization and time to treatment. Stroke. 2018;49:439–446. doi: 10.1161/STROKEAHA.117.019431. [DOI] [PubMed] [Google Scholar]
  • 34.Noorian A.R., Sanossian N., Shkirkova K., Liebeskind D.S., Eckstein M., Stratton S.J., Pratt F.D., Conwit R., Chatfield F., Sharma L.K., et al. Los Angeles Motor Scale to identify large vessel occlusion: Prehospital validation and comparison with other screens. Stroke. 2018;49:565–572. doi: 10.1161/STROKEAHA.117.019228. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.American Heart Association American Heart Association Mission Lifeline: Stroke Severity-Based Stroke Triage Algorithm for EMS. [(accessed on 26 December 2019)];2018 Available online: https://www.heart.org/HEARTORG/Professional/MissionLifelineHomePage/MissionLifeline-Stroke_UCM_491623_SubHomePage.jsp.
  • 36.Ahmed N., Steiner T., Caso V., Wahlgren N. ESO-KSU session participants. Recommendations from the ESO-Karolinska Stroke Update Conference, Stockholm, 13–15 November 2016. Eur Stroke J. 2017;2:95–102. doi: 10.1177/2396987317699144. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Powers W.J., Rabinstein A.A., Ackerson T., Adeoye O.M., Bambakidis N.C., Becker K., Biller J., Brown M., Demaerschalk B.M., Hoh B., et al. Guidelines for the Early Management of Patients with Acute Ischemic Stroke: 2019 Update to the 2018 Guidelines for the Early Management of Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke. 2019;50:344–418. doi: 10.1161/STR.0000000000000211. [DOI] [PubMed] [Google Scholar]
  • 38.Jumaa M.A., Castonguay A.C., Salahuddin H., Shawver J., Saju L., Burgess R., Kung V., Slawski D.E., Tietjen G., Parquette B., et al. Long-term implementation of a prehospital severity scale for EMS triage of acute stroke: A real-world experience. J. NeuroIntervent. Surg. 2020;12:19–24. doi: 10.1136/neurintsurg-2019-014997. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Bray J.E., Martin J., Cooper G., Barger B., Bernard S., Bladin C. An interventional study to improve paramedic diagnosis of stroke. Prehosp. Emerg. Care. 2005;9:297–302. doi: 10.1080/10903120590962382. [DOI] [PubMed] [Google Scholar]
  • 40.Price C.I., Shaw L., Dodd P., Exley C., Flynn D., Francis R., Islam S., Javanbakht M., Lakey R., Lally J., et al. Paramedic Acute Stroke Treatment Assessment (PASTA): Study protocol for a randomised controlled trial. Trials. 2019;20:121. doi: 10.1186/s13063-018-3144-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Watkins C.L., Leathley M.J., Jones S.P., Ford G.A., Quinn T., Chris J., Sutton C.J. Training emergency services’ dispatchers to recognise stroke: An interrupted time-series analysis. BMC Health Serv. Res. 2013;13:318. doi: 10.1186/1472-6963-13-318. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES